Pasar al contenido principal

MODELADO DEL COMPORTAMIENTO DE ENTIDADES DIGITALES MEDIANTE TECNOLOGIAS DEL LENGUAJE HUMANO

RTI2018-094653-B-C22

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos I+D+i Retos de Investigación
Año convocatoria 2018
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSIDAD DE ALICANTE

Resultados relacionados

Resultados totales (Incluyendo duplicados): 50
Encontrada(s) 1 página(s)

RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Automatic extension of corpora from the intelligent ensembling of eHealth knowledge discovery systems outputs

  • Consuegra-Ayala, Juan Pablo
  • Gutiérrez, Yoan
  • Piad-Morffis, Alejandro
  • Almeida-Cruz, Yudivian
  • Palomar, Manuel
  • Gutiérrez, Yoan|||/items/8f7f89db-a015-4ed6-85b9-75bd041ee8bd
  • Palomar, Manuel|||/items/71e8f2d8-8d56-4c8e-89df-d6ce2497d967
  • Consuegra-Ayala, Juan Pablo|||/items/5a98e4ca-607f-4aa0-91c2-a5d929bab52c
Corpora are one of the most valuable resources at present for building machine learning systems. However, building new corpora is an expensive task, which makes the automatic extension of corpora a highly attractive task to develop. Hence, finding new strategies that reduce the cost and effort involved in this task, while at the same time guaranteeing quality, remains an open and important challenge for the research community. In this paper, we present a set of ensembling strategies oriented toward entity and relation extraction tasks. The main goal is to combine several automatically annotated versions of corpora to produce a single version with improved quality. An ensembler is built by exploring a configuration space in search of the combination that maximizes the fitness of the ensembled collection according to a reference collection. The eHealth-KD 2019 challenge was chosen for the case study. The submitted systems’ outputs were ensembled, resulting in the construction of an automatically annotated collection of 8000 sentences. We show that using this collection as additional training input for a baseline algorithm has a positive impact on its performance. Additionally, the ensembling pipeline was used as a participant system in the 2020 edition of the challenge. The ensembled run achieved a slightly better performance than the individual runs.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Atención automatizada a estudiantes en el proceso de matriculación en la Universidad de Alicante, Automatic Students Service in the Enrolment Process at the University of Alicante

  • Moreno, Isabel
  • Gutiérrez, Yoan
  • Montoyo, Andres
  • Gutiérrez, Yoan|||/items/8f7f89db-a015-4ed6-85b9-75bd041ee8bd
  • Montoyo, Andres|||/items/a2b7158a-7032-423a-a7b5-0f7b92902b72
Esta demo presenta un chatbot diseñado para automatizar la atención a los estudiantes durante el proceso de matrícula en la Universidad de Alicante (UA). Hemos creado un chatbot en la plataforma de mensajería instantánea Telegram mediante tecnologías del lenguaje humano e inteligencia artificial. El principal obstáculo ha sido ofrecer el chatbot en los dos idiomas oficiales de la Comunidad Valenciana, por lo que se ha utilizado traducción automática como componente intermedio. Este chatbot ofrece numerosos beneficios a la UA para el proceso de matriculación, pero destacamos el refuerzo que representa para la atención del estudiante, en términos de reducción de costes y asistencia 24/7. Esta tecnología generará un ambiente de confianza entre la UA y sus potenciales estudiantes.
RUA. Repositorio Institucional de la Universidad de Alicante
Software de investigación Software (Software)

GPLSI-UH LETO V1.0: Motor de aprendizaje a través de ontologías, GPLSI-UH LETO V1.0: Learning Engine Through Ontologies

  • Estévez-Velarde, Suilan
  • Piad-Morffis, Alejandro
  • Gutiérrez, Yoan
  • Montoyo, Andres
  • Muñoz, Rafael
  • Almeida-Cruz, Yudivian
  • Palomar, Manuel
  • Valdés Pérez, Daniel Alejandro
  • Gutiérrez, Yoan|||/items/8f7f89db-a015-4ed6-85b9-75bd041ee8bd
  • Montoyo, Andres|||/items/a2b7158a-7032-423a-a7b5-0f7b92902b72
  • Muñoz, Rafael|||/items/d6ef1286-fc50-4e8b-9d97-bcbc30e3d1bc
  • Palomar, Manuel|||/items/71e8f2d8-8d56-4c8e-89df-d6ce2497d967
LETO es un marco de aprendizaje de ontologías diseñado para extraer conocimiento de una variedad de fuentes. Estas fuentes pudieran ser datos estructurados y no estructurados, y de ellas se podrá descubrir, actualizar continuamente, enriquecer e integrar información relevante como parte de un único conocimiento semántico. En la actual versión 1.0 se limita a la extracción de conocimiento desde datos no estructurados, i.e. textos en lenguaje natural, siguiendo el modelo semántico publicado en [EGM2018]. Entre sus funcionalidades está la extracción de entidades y relaciones semánticas desde fuentes textuales; la transformación de esta información en elementos interrelacionados mediante técnicas de agrupamientos; y finalmente generación de ontologías representativas del contenido procesado. Se proporciona un punto de acceso API, y una herramienta visual para la manipulación de procesos y visualización de las ontologías obtenidas [EMA2019].
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

The Disinformation Battle: Linguistics and Artificial Intelligence Join to Beat it, La Batalla de la Desinformación: la Lingüística y la Inteligencia Artificial se Unen para Vencerla

  • Bonet-Jover, Alba
  • Bonet-Jover, Alba|||/items/6bd6e7a1-46a7-415c-bdde-2a1e56f97a2f
At present, the era of digitalisation has led to the era of disinformation by witnessing a peak of the spreading of fake news that are disseminated in order to get profit. Like everything, fake news has an Achilles' heel and it could be language. The linguistic structure as well as the expression of emotions through language could be key in detecting deception. The modelling of a language of deception typical of fake news and its later automation through machine learning would allow to take a further step towards the fight against disinformation.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Exploiting discourse structure of traditional digital media to enhance automatic fake news detection

  • Bonet-Jover, Alba
  • Piad-Morffis, Alejandro
  • Saquete Boró, Estela
  • Martínez-Barco, Patricio
  • García Cumbreras, Miguel Ángel
  • Bonet-Jover, Alba|||/items/6bd6e7a1-46a7-415c-bdde-2a1e56f97a2f
  • Martínez-Barco, Patricio|||/items/f9630270-fe31-44c8-b611-dfaf9c109a4d
  • Saquete Boró, Estela|||/items/452393f2-fb8d-4840-b797-4b65a4bc9a87
This paper presents a novel architecture for dealing with Automatic Fake News detection. The architecture factors in the discourse structure of news in traditional digital media and is based on two premises. First, fake news tends to mix true and false information with the purpose of confusing readers. Second, this research is focused on fake news delivered in traditional digital media, so our approach considers the influence of the journalistic structure of news, and the way journalists tend to introduce the essential content in a news story using 5W1H answer. Considering both premises, this proposal deals with the news components separately because some may be true or false, instead of considering the veracity value of the news article as a unit. A two-layer architecture is proposed, Structure and Veracity layers. To demonstrate the validity of the proposal, a new dataset was created and annotated with a new fine-grained annotation scheme (FNDeepML) that considers the different elements of the news document and their veracity. Due to the severity of the COVID-19 pandemic crisis, health is the chosen domain, and Spanish is the language used to validate the architecture, given the lack of research in this language. However, the proposal can be applied to any other language or domain. The performance of the Veracity layer of our proposal, which factors in the traditional news article structure and the 5W1H annotation, is capable of delivering a result of F1=0.807. This represents a strong improvement when compared to the baseline, which uses the whole document with a single veracity value, obtaining F1=0.605. These findings validate the suitability and effectiveness of our approach.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

“Here Are the Rules: Ignore All Rules”: Automatic Contradiction Detection in Spanish

  • Sepúlveda-Torres, Robiert
  • Bonet-Jover, Alba
  • Saquete Boró, Estela
  • Bonet-Jover, Alba|||/items/6bd6e7a1-46a7-415c-bdde-2a1e56f97a2f
  • Saquete Boró, Estela|||/items/452393f2-fb8d-4840-b797-4b65a4bc9a87
  • Sepúlveda-Torres, Robiert|||/items/60f24ee2-fe45-4b5c-a70c-c025ed1b5e4a
This paper tackles automatic detection of contradictions in Spanish within the news domain. Two pieces of information are classified as compatible, contradictory, or unrelated information. To deal with the task, the ES-Contradiction dataset was created. This dataset contains a balanced number of each of the three types of information. The novelty of the research is the fine-grained annotation of the different types of contradictions in the dataset. Presently, four different types of contradictions are covered in the contradiction examples: negation, antonyms, numerical, and structural. However, future work will extend the dataset with all possible types of contradictions. In order to validate the effectiveness of the dataset, a pretrained model is used (BETO), and after performing different experiments, the system is able to detect contradiction with a F1m of 92.47%. Regarding the type of contradictions, the best results are obtained with negation contradiction (F1m = 98%), whereas structural contradictions obtain the lowest results (F1m = 69%) because of the smaller number of structural examples, due to the complexity of generating them. When dealing with a more generalistic dataset such as XNLI, our dataset fails to detect most of the contradictions properly, as the size of both datasets are very different and our dataset only covers four types of contradiction. However, using the classification of the contradictions leads us to conclude that there are highly complex contradictions that will need external knowledge in order to be properly detected and this will avoid the need for them to be previously exposed to the system.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Social-Univ 2.0: Monitorización del entorno digital social universitario, Social-Univ 2.0: Monitoring the Digital and Social Environment of the University

  • Moreno, Isabel
  • Fernández Martínez, Javier
  • Gutiérrez, Yoan
  • Fernández Martínez, Javier|||/items/f9b0416b-2411-47be-a586-11f90957e00f
  • Gutiérrez, Yoan|||/items/8f7f89db-a015-4ed6-85b9-75bd041ee8bd
Social-Univ 2.0 es una aplicación web que monitoriza el ecosistema digital de universidades con presencia en redes sociales y, más concretamente, se centra en analizar el entorno de la Universidad de Alicante. Usa las tecnologías del lenguaje humano para extraer meta-datos sobre comentarios en Twitter para representar perfiles de actores sociales, así como su relación social en un período de tiempo. Esta aplicación, en su primera versión: facilita tanto el estudio de interacciones sociales y sus matices, como el analisis de grupos sociales y sus comportamientos; identifica a actores sociales relevantes e influyentes, así como los temas comunes en determinados grupos sociales; y favorece la medición del impacto de campañas y eventos.
RUA. Repositorio Institucional de la Universidad de Alicante
Software de investigación Software (Software)

Social Univ 2.0: Monitorización del entorno digital social universitario, Social Univ 2.0: Monitoring the Digital and Social Environment of the University

  • Gutiérrez, Yoan
  • Moreno, Isabel
  • Fernández Martínez, Javier
  • Martínez-Barco, Patricio
  • Fernández Martínez, Javier|||/items/f9b0416b-2411-47be-a586-11f90957e00f
  • Gutiérrez, Yoan|||/items/8f7f89db-a015-4ed6-85b9-75bd041ee8bd
  • Martínez-Barco, Patricio|||/items/f9630270-fe31-44c8-b611-dfaf9c109a4d
Social-Univ 2.0 es una aplicación web que monitoriza el ecosistema digital de universidades con presencia en redes sociales. Su objetivo es, mediante tecnologías del lenguaje humano, analizar comentarios de la red social Twitter, así como los metadatos asociados, y relacionar actores mediante los mensajes en los que estos intervienen en un período de tiempo. Para iniciar el estudio social, el sistema requiere la definición de palabras claves que definan con precisión a la universidad que se desea observar en el entorno social. Estas palabras claves pueden ser identificadores (ej. @nickname), hashtags u otros elementos identificativos que señalen a una entidad digital en cuestión. A continuación, el sistema descarga comentarios de Twitter y los analiza semánticamente para valorar las diferentes posturas (ej. opiniones positivas, negativas y neutrales) que cada actor tiene respecto a otros, así como su influencia en el entorno digital-social. Por último, se muestra al usuario la información social analizada mediante grafos, perfiles y nubes de palabras en una interfaz que permite filtrar el análisis por periodos inferiores a 6 meses. Todo lo anterior permite a Social-Univ 2.0: (I) facilitar tanto el estudio de interacciones sociales y sus matices, como el análisis de grupos sociales y sus comportamientos; (II) identificar a actores sociales relevantes e influyentes, así como los temas comunes en determinados grupos sociales; y (III) y favorecer la medición del impacto de campañas y eventos. Una descripción más detallada del sistema completo se puede encontrar en [MFG19].
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

A computational ecosystem to support eHealth Knowledge Discovery technologies in Spanish

  • Piad-Morffis, Alejandro
  • Gutiérrez, Yoan
  • Almeida-Cruz, Yudivian
  • Muñoz, Rafael
  • Gutiérrez, Yoan|||/items/8f7f89db-a015-4ed6-85b9-75bd041ee8bd
  • Muñoz, Rafael|||/items/d6ef1286-fc50-4e8b-9d97-bcbc30e3d1bc
The massive amount of biomedical information published online requires the development of automatic knowledge discovery technologies to effectively make use of this available content. To foster and support this, the research community creates linguistic resources, such as annotated corpora, and designs shared evaluation campaigns and academic competitive challenges. This work describes an ecosystem that facilitates research and development in knowledge discovery in the biomedical domain, specifically in Spanish language. To this end, several resources are developed and shared with the research community, including a novel semantic annotation model, an annotated corpus of 1045 sentences, and computational resources to build and evaluate automatic knowledge discovery techniques. Furthermore, a research task is defined with objective evaluation criteria, and an online evaluation environment is setup and maintained, enabling researchers interested in this task to obtain immediate feedback and compare their results with the state-of-the-art. As a case study, we analyze the results of a competitive challenge based on these resources and provide guidelines for future research. The constructed ecosystem provides an effective learning and evaluation environment to encourage research in knowledge discovery in Spanish biomedical documents.
RUA. Repositorio Institucional de la Universidad de Alicante
Software de investigación Software (Software)

Dossier Next

  • Fernández Martínez, Javier
  • Gómez, José M.
  • Martínez-Barco, Patricio
  • Gutiérrez, Yoan
  • Llopis, Fernando
  • Muñoz, Rafael
  • Montoyo, Andres
  • Moreda, Paloma
  • Palomar, Manuel
  • Fernández Martínez, Javier|||/items/f9b0416b-2411-47be-a586-11f90957e00f
  • Gutiérrez, Yoan|||/items/8f7f89db-a015-4ed6-85b9-75bd041ee8bd
  • Llopis, Fernando|||/items/e8548380-b70f-44e7-a7fa-c7bed36990d8
  • Martínez-Barco, Patricio|||/items/f9630270-fe31-44c8-b611-dfaf9c109a4d
  • Montoyo, Andres|||/items/a2b7158a-7032-423a-a7b5-0f7b92902b72
  • Moreda, Paloma|||/items/aeb186ed-9034-4fdf-96fc-88941be830e7
  • Muñoz, Rafael|||/items/d6ef1286-fc50-4e8b-9d97-bcbc30e3d1bc
  • Palomar, Manuel|||/items/71e8f2d8-8d56-4c8e-89df-d6ce2497d967
Dossier Next es una aplicación web que permite rastrear y clasificar de forma automática y periódica la información procedente de cualquier tipo de fuente de internet con contenido textual i.e. páginas web, periódicos digitales, boletines oficiales, etc., extrayendo únicamente la información más interesante para el usuario y descartando el resto. Para comenzar la recolección de información, el usuario debe indicar las fuentes a partir de las cuales desea obtener información, haciendo referencia a cada una las partes de interés para la recuperación de información, i.e. título, cuerpo, fecha, autor, etc. Para que el sistema pueda decidir qué contenido es relevante para el usuario, éste debe indicar también una serie de palabras claves, que deben aparecer en el documento en cuestión. Una vez establecida esta configuración del sistema se procede a descargar toda la información deseada por el usuario. Desde la página inicial se pueden visualizar los documentos por fecha y fuente.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

A Supervised Approach for Sentiment Analysis using Skipgrams and its Application to Sentiment Visualisation in Social Media

  • Fernández Martínez, Javier
  • Fernández Martínez, Javier|||/items/f9b0416b-2411-47be-a586-11f90957e00f
In this Ph.D. thesis we propose, as fundamental research, the design, development and evaluation of a supervised approach for sentiment analysis. This work is based on the hypothesis that an efficient use of the skipgram modelling can improve sentiment analysis tasks and reduce the resources they need. In summary, it consists on a supervised approach that uses machine learning techniques and skipgrams as information units, mainly focused on skipgram selection and filtering. This approach will be evaluated and compared to current state-of-the-art techniques. In addition, as applied research we propose a sentiment visualisation tool, strongly integrated with our sentiment analysis approach. This tool is oriented in the context of social media, measuring reputation and user interactions in real time.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Overview of the eHealth Knowledge Discovery Challenge at IberLEF 2020

  • Piad-Morffis, Alejandro
  • Gutiérrez, Yoan
  • Cañizares-Diaz, Hian
  • Estévez-Velarde, Suilan
  • Muñoz, Rafael
  • Montoyo, Andres
  • Almeida-Cruz, Yudivian
  • Gutiérrez, Yoan|||/items/8f7f89db-a015-4ed6-85b9-75bd041ee8bd
  • Montoyo, Andres|||/items/a2b7158a-7032-423a-a7b5-0f7b92902b72
  • Muñoz, Rafael|||/items/d6ef1286-fc50-4e8b-9d97-bcbc30e3d1bc
This paper summarises the results of the third edition of the eHealth Knowledge Discovery (KD) challenge, hosted at the Iberian Language Evaluation Forum 2020. The eHealth-KD challenge proposes two computational tasks involving the identification of semantic entities and relations in natural language text, focusing on Spanish language health documents. In this edition, besides text extracted from medical sources, Wikipedia content was introduced into the corpus, and a novel transfer-learning evaluation scenario was designed that challenges participants to create systems that provide cross-domain generalisation. A total of eight teams participated with a variety of approaches including deep learning end-to-end systems as well as rule-based and knowledge-driven techniques. This paper analyses the most successful approaches and highlights the most interesting challenges for future research in this field.
RUA. Repositorio Institucional de la Universidad de Alicante
Software de investigación Software (Software)

GPLSI FieroBoT: Asistente virtual para la captación de insultos, GPLSI FieroBoT: A virtual assistant for collecting insults

  • Botella-Gil, Beatriz
  • Gutiérrez, Yoan
  • Martínez-Barco, Patricio
  • Palomar, Manuel
  • Gutiérrez, Yoan|||/items/8f7f89db-a015-4ed6-85b9-75bd041ee8bd
  • Martínez-Barco, Patricio|||/items/f9630270-fe31-44c8-b611-dfaf9c109a4d
  • Palomar, Manuel|||/items/71e8f2d8-8d56-4c8e-89df-d6ce2497d967
  • Botella-Gil, Beatriz|||/items/a03c3d62-efa7-4c50-8870-103ca1d81d37
FieroBoT es un asistente virtual orientado a la recopilación de insultos desde la aplicación de mensajería Telegram. A través del sistema de mensajería de Telegram los usuarios pueden libremente tener una conversación con el robot donde se incita a que lo insultemos. El proceso es el siguiente, en primer lugar, se nos preguntará nuestro sexo y la edad y a continuación podremos insultar al robot. Solo se almacenará el contenido del mensaje y los datos demográficos genéricos como rango de edad y sexo con el fin de organizar el contenido. Los insultos recolectados servirán para la creación de un recurso de palabras y expresiones violentas que podrá ser utilizado para distintos estudios relacionados con el lenguaje popular.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Overview of the eHealth Knowledge Discovery Challenge at IberLEF 2021, Resumen de la Tarea de Descubrimiento de Conocimiento en Salud en IberLEF 2021

  • Piad-Morffis, Alejandro
  • Estévez-Velarde, Suilan
  • Gutiérrez, Yoan
  • Almeida-Cruz, Yudivian
  • Montoyo, Andres
  • Muñoz, Rafael
  • Gutiérrez, Yoan|||/items/8f7f89db-a015-4ed6-85b9-75bd041ee8bd
  • Montoyo, Andres|||/items/a2b7158a-7032-423a-a7b5-0f7b92902b72
  • Muñoz, Rafael|||/items/d6ef1286-fc50-4e8b-9d97-bcbc30e3d1bc
This paper summarises the eHealth Knowledge Discovery Challenge hosted at IberLEF 2021. We describe the task, resources, and participating systems, highlighting and discussing the main results achieved in the challenge. We analyse the best performing systems and present recommendations for future research.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Improving Open Data Web API Documentation through Interactivity and Natural Language Generation

  • González Mora, César
  • Barros, Cristina
  • Garrigós, Irene
  • Zubcoff, Jose
  • Lloret, Elena
  • Mazón, Jose-Norberto
  • Garrigós, Irene|||/items/50e21847-f541-4051-8e6d-4064e0e80ea3
  • González Mora, César|||/items/bffa7ade-023b-4e37-893a-cf0aa181e2d4
  • Lloret, Elena|||/items/4593ef69-8308-49d3-8f0f-17e6ee078be5
  • Mazón, Jose-Norberto|||/items/31f8766d-f389-4889-ba06-adeb367a0753
  • Zubcoff, Jose|||/items/c8d086dc-e561-4ce4-9d9b-2db5c48a75f5
Widely adoption of Information Technologies has resulted in the continuous growing of open data available on the Web. However, the lack of suitable mechanisms to understand open data sources hampers its reusability. One way to overcome this limitation is by means of Web Application Programming Interfaces (APIs) with proper documentation, nowadays being the existing very rudimentary, hard to follow, and sometimes incomplete or even inaccurate in most cases. In order to improve the documentation of Web APIs that access open data, this paper proposes a novel approach to automatically generate interactive Web API documentation, both machine and user readable. This process starts by analysing the documentation of an API to obtain important information, automatically constructing Natural Language descriptions of the main Web API concepts by applying Natural Language Processing (NLP), and specifically, language generation techniques. Then, the documentation is made interactive by making it available as a Web interface, offering easy access to open data provided by Web APIs. Therefore, the use and comprehension of the Web APIs is facilitated, thus promoting the reusability of open data. The feasibility of our approach is presented through a case study and an experiment with users, both showing the benefits of our approach.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Veracity vs. Reliability: Changing the Approach of Our Annotation Guideline

  • Bonet-Jover, Alba
  • Bonet-Jover, Alba|||/items/6bd6e7a1-46a7-415c-bdde-2a1e56f97a2f
This paper presents the evolution of an annotation guideline designed for the disinformation detection task, an essential step of my doctoral thesis. The annotation proposal aims to label all the structural and content elements of a news item, as well as to classify them as Reliable or Unreliable. The initial objective was to annotate those elements into Fake or True, but for that classification, world knowledge is needed. Our current goal is to annotate news on the basis of a purely textual, semantic and linguistic analysis, without using external knowledge and, for that reason, the annotation was redirected towards a reliability rating, rather than a veracity classification. This article justifies the change of perspective at this stage of the thesis, explains the difference between veracity and reliability and shows the concrete changes that have been adopted in our annotation proposal with this new approach.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Utopian and dystopian ideological systems and unintended and adverse consequences

  • Usó i Domènech, Josep Lluís
  • Nescolarde-Selva, Josué Antonio
  • Lloret-Climent, Miguel
  • Alonso-Stenberg, Kristian
  • Gash, Hugh
  • Alonso-Stenberg, Kristian|||/items/523fe094-37ca-49e6-b043-5db9d7393ed1
  • Lloret-Climent, Miguel|||/items/f2c9b599-7042-49f9-98e0-bb91f11d9ed7
  • Nescolarde-Selva, Josué Antonio|||/items/bd921352-9e91-44d9-a574-4587b28566ba
Purpose – The purpose of this paper is to demonstrate mathematically the impossibility of achieving a utopian society. Demonstrate that any attempt to correct deviations from a hypothetical trajectory whose ultimate goal is the utopia, increasingly demands more work, including measures that lead to terror, which may even be absolute, leading to the horrible paradox that in seeking paradise hell is constructed. Design/methodology/approach – Scientific tools that the authors have used are: the theory of the system linkage, alysidal algebra, kinematic theory and vector analysis. Findings – Myths are the substrate of some complex systems of beliefs and utopia is its ultimate goal. The use of the combination of the theory of trajectories, belonging to the alysidal algebra, the theorem of unintended effects and kinematics theory provides an approximation to deviations suffering utopian ideological currents and their corrections. Originality/value – This paper is a continuation of other previous papers developing the theory of complex societies.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

UH-MatCom at eHealth-KD Challenge 2020: Deep-Learning and Ensemble Models for Knowledge Discovery in Spanish Documents

  • Consuegra-Ayala, Juan Pablo
  • Palomar, Manuel
  • Palomar, Manuel|||/items/71e8f2d8-8d56-4c8e-89df-d6ce2497d967
  • Consuegra-Ayala, Juan Pablo|||/items/5a98e4ca-607f-4aa0-91c2-a5d929bab52c
The eHealth-KD challenge hosted at IberLEF 2020 proposes a set of resources and evaluation scenarios to encourage the development of systems for the automatic extraction of knowledge from unstructured text. This paper describes the system presented by team UH-MatCom in the challenge. Several deep-learning models are trained and ensembled to automatically extract relevant entities and relations from plain text documents. State of the art techniques such as BERT, Bi-LSTM, and CRF are applied. The use of external knowledge sources such as ConceptNet is explored. The system achieved average results in the challenge, ranking fifth across all different evaluation scenarios. The ensemble method produced a slight improvement in performance. Additional work needs to be done for the relation extraction task to successfully benefit from external knowledge sources.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

HeadlineStanceChecker: Exploiting summarization to detect headline disinformation

  • Sepúlveda-Torres, Robiert
  • Vicente, Marta
  • Saquete Boró, Estela
  • Lloret, Elena
  • Palomar, Manuel
  • Lloret, Elena|||/items/4593ef69-8308-49d3-8f0f-17e6ee078be5
  • Palomar, Manuel|||/items/71e8f2d8-8d56-4c8e-89df-d6ce2497d967
  • Saquete Boró, Estela|||/items/452393f2-fb8d-4840-b797-4b65a4bc9a87
  • Sepúlveda-Torres, Robiert|||/items/60f24ee2-fe45-4b5c-a70c-c025ed1b5e4a
The headline of a news article is designed to succinctly summarize its content, providing the reader with a clear understanding of the news item. Unfortunately, in the post-truth era, headlines are more focused on attracting the reader’s attention for ideological or commercial reasons, thus leading to mis- or disinformation through false or distorted headlines. One way of combating this, although a challenging task, is by determining the relation between the headline and the body text to establish the stance. Hence, to contribute to the detection of mis- and disinformation, this paper proposes an approach—HeadlineStanceChecker—that determines the stance of a headline with respect to the body text to which it is associated. The novelty rests on the use of a two-stage classification architecture that uses summarization techniques to shape the input for both classifiers instead of directly passing the full news body text, thereby reducing the amount of information to be processed while keeping important information. Specifically, summarization is done through Positional Language Models leveraging on semantic resources to identify salient information in the body text that is then compared to its corresponding headline. The results obtained show that our approach achieves 94.31% accuracy for the overall classification and the best FNC-1 relative score compared with the state of the art. It is especially remarkable that the system, which uses only the relevant information provided by the automatic summaries instead of the whole text, is able to classify the different stance categories with very competitive results, especially in the discuss stance between the headline and the news body text. It can be concluded that using automatic extractive summaries as input of our approach together with the two-stage architecture is an appropriate solution to the problem.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

General-purpose hierarchical optimisation of machine learning pipelines with grammatical evolution

  • Estévez-Velarde, Suilan
  • Gutiérrez, Yoan
  • Almeida-Cruz, Yudivian
  • Montoyo, Andres
  • Gutiérrez, Yoan|||/items/8f7f89db-a015-4ed6-85b9-75bd041ee8bd
  • Montoyo, Andres|||/items/a2b7158a-7032-423a-a7b5-0f7b92902b72
This paper introduces Hierarchical Machine Learning Optimisation (HML-Opt), an AutoML framework that is based on probabilistic grammatical evolution. HML-Opt has been designed to provide a flexible framework where a researcher can define the space of possible pipelines to solve a specific machine learning problem, which can range from high-level decisions about representation and features to low-level hyper-parameter values. The evaluation of HML-Opt is presented via two different case studies, both of which demonstrate that it is competitive with existing AutoML tools on a variety of benchmarks. Furthermore, HML-Opt can be applied to novel problems, such as knowledge extraction from natural language text, whereas other techniques are insufficiently flexible to capture the complexity of these scenarios. The source code for HML-Opt is available online for the research community.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Knowledge Discovery in COVID-19 Research Literature

  • Piad-Morffis, Alejandro
  • Estévez-Velarde, Suilan
  • Estevanell-Valladares, Ernesto L.
  • Gutiérrez, Yoan
  • Montoyo, Andres
  • Muñoz, Rafael
  • Almeida-Cruz, Yudivian
  • Estevanell-Valladares, Ernesto L.|||/items/d8b1af9a-112f-48de-813f-b4d8f1df8bd1
  • Gutiérrez, Yoan|||/items/8f7f89db-a015-4ed6-85b9-75bd041ee8bd
  • Montoyo, Andres|||/items/a2b7158a-7032-423a-a7b5-0f7b92902b72
  • Muñoz, Rafael|||/items/d6ef1286-fc50-4e8b-9d97-bcbc30e3d1bc
This paper presents the preliminary results of an ongoing project that analyzes the growing body of scientific research published around the COVID-19 pandemic. In this research, a general-purpose semantic model is used to double annotate a batch of 500 sentences that were manually selected by the researchers from the CORD-19 corpus. Afterwards, a baseline text-mining pipeline is designed and evaluated via a large batch of 100,959 sentences. We present a qualitative analysis of the most interesting facts automatically extracted and highlight possible future lines of development. The preliminary results show that general-purpose semantic models are a useful tool for discovering fine-grained knowledge in large corpora of scientific documents.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Cascade of Biased Two-class Classifiers for Multi-class Sentiment Analysis

  • Abreu Salas, José Ignacio
  • Mirabal, Pedro
  • Ballester-Espinosa, Adrián
  • Abreu Salas, José Ignacio|||/items/99fd9ec6-0b97-4c02-a28e-98bc309cff48
In this paper, we describe our participation in the Rest-Mex 2021 Sentiment Analysis Task. Our approach is based on an ensemble of BERT|BETO-based classifiers arranged in a cascade of binary models trained with a bias towards specific classes with the aim of lowering the Mean Average Error. The resulting models were judged in the 2nd and the 3rd place according to the evaluation rule of the Mean Absolute Error.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Automatic Contradiction Detection in Spanish

  • Sepúlveda-Torres, Robiert
  • Sepúlveda-Torres, Robiert|||/items/60f24ee2-fe45-4b5c-a70c-c025ed1b5e4a
This paper addresses the lack of automated contradiction detection systems for the Spanish language. The ES-Contradiction dataset was created and contains examples with two pieces of information classified as Compatible, Contradiction, or Unrelated. To the author’s knowledge, a Spanish-language contradiction dataset is non-existent and therefore, the ES-Contradiction dataset fills an important research gap, given Spanish being one of the most widely spoken languages. Moreover, the dataset built includes a fine-grained annotation of the different types of contradictions in the dataset. A baseline system was designed to validate the effectiveness of the dataset. The BETO transformer model was used to build this baseline system, which obtained a good result to detect the three class labels Compatible, Contradiction, or Unrelated.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Model-Driven Development of Web APIs to Access Integrated Tabular Open Data

  • González Mora, César
  • Tomás, David
  • Garrigós, Irene
  • Zubcoff, Jose
  • Mazón, Jose-Norberto
  • Garrigós, Irene|||/items/50e21847-f541-4051-8e6d-4064e0e80ea3
  • González Mora, César|||/items/bffa7ade-023b-4e37-893a-cf0aa181e2d4
  • Mazón, Jose-Norberto|||/items/31f8766d-f389-4889-ba06-adeb367a0753
  • Tomás, David|||/items/cf031fc3-3c30-454b-a6df-3762c29cc296
  • Zubcoff, Jose|||/items/c8d086dc-e561-4ce4-9d9b-2db5c48a75f5
More and more governments around the world are publishing tabular open data, mainly in formats such as CSV or XLS(X). These datasets are mostly individually published, i.e. each publisher exposes its data on the Web without considering potential relationships with other datasets (from its own or from other publishers). As a result, reusing several open datasets together is not a trivial task, thus requiring mechanisms that allow data consumers (as software developers or data scientists) to integrate and access tabular open data published on the Web. In this paper, we propose a model-driven approach to automatically generate Web APIs that homogeneously access multiple integrated tabular open datasets. This work focuses on data that can be integrated by means of join and union operations. As a first step, our approach detects unionable and joinable tabular open data by using a table similarity measure based on word embeddings. Then, an APIfication process is developed to create APIs that access the previously integrated datasets through a single endpoint. A running example is presented throughout the article, as well as a set of experiments for performance evaluation to show the feasibility of our approach.
RUA. Repositorio Institucional de la Universidad de Alicante
Software de investigación Software (Software)

GPLSI AitanaWEB. Asistente Virtual sobre procesos de matriculación académica

  • Gutiérrez, Yoan
  • Abreu Salas, José Ignacio
  • Montoyo, Andres
  • Muñoz, Rafael
  • Abreu Salas, José Ignacio|||/items/99fd9ec6-0b97-4c02-a28e-98bc309cff48
  • Gutiérrez, Yoan|||/items/8f7f89db-a015-4ed6-85b9-75bd041ee8bd
  • Montoyo, Andres|||/items/a2b7158a-7032-423a-a7b5-0f7b92902b72
  • Muñoz, Rafael|||/items/d6ef1286-fc50-4e8b-9d97-bcbc30e3d1bc
AitanaWEB es un chatbot para la asistencia telemática a usuarios sobre los procesos de matriculación académica y cuestiones relacionadas. Ofrece información sobre temas como los Horarios, Notas de Corte, Matrícula, Traslado de Expediente entre otros. Esta diseñado orientado a la accesibilidad y la usabilidad, posibilitando el acceso en Valenciano y Castellano. Permite el acceso desde diferentes navegadores, como Chrome, Firefox, Edge, Chrome para Android y Safari. Incorpora un narrador y facilidades de reconocimiento del habla permitiendo al usuario realizar la interacción con el sistema mediante voz. El proyecto cuenta de dos componentes básicos: (i) uso de DialogFlow de Google como servicio de Inteligencia Artificial donde se estructuran y entrenan las preguntas y respuestas. (ii) componente de desarrollo propio que hace de controlador, intérprete y enrutador entre DialogFlow y la interfaz de usuario final.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Why are some social-media contents more popular than others? Opinion and association rules mining applied to virality patterns discovery

  • Saquete Boró, Estela
  • Zubcoff, Jose
  • Gutiérrez, Yoan
  • Martínez-Barco, Patricio
  • Fernández Martínez, Javier
  • Fernández Martínez, Javier|||/items/f9b0416b-2411-47be-a586-11f90957e00f
  • Gutiérrez, Yoan|||/items/8f7f89db-a015-4ed6-85b9-75bd041ee8bd
  • Martínez-Barco, Patricio|||/items/f9630270-fe31-44c8-b611-dfaf9c109a4d
  • Saquete Boró, Estela|||/items/452393f2-fb8d-4840-b797-4b65a4bc9a87
  • Zubcoff, Jose|||/items/c8d086dc-e561-4ce4-9d9b-2db5c48a75f5
Discovering the main features of virality patterns in Twitter is the focus of this research. Five trending topics related to the COVID-19 pandemic were selected for the study, with Spanish as the target language. To carry out the discovery of virality patterns, we applied opinion mining techniques that enable us to structure the information based on the polarity of the messages and the emotions they contain. After transforming the information from an unstructured textual representation to a structured one, data mining techniques were applied, specifically association rules mining. Message patterns with the highest virality (high shares and high likes), and at the same time the most relevant characteristics of the patterns with less impact were extracted. After an exhaustive analysis of the most relevant non-redundant rules, it can be concluded that messages with a high-negative polarity and a very high emotional charge, especially emotions that have intensified with the COVID-19 pandemic, such as fear, sadness, anger and surprise are more likely to go viral in social media. By contrast, messages with little news coverage in the media, few authors, and the absence of surprise are relevant features when it comes to seeing messages with very low dissemination in social media.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Fighting post-truth using natural language processing: A review and open challenges

  • Saquete Boró, Estela
  • Tomás, David
  • Moreda, Paloma
  • Martínez-Barco, Patricio
  • Palomar, Manuel
  • Martínez-Barco, Patricio|||/items/f9630270-fe31-44c8-b611-dfaf9c109a4d
  • Moreda, Paloma|||/items/aeb186ed-9034-4fdf-96fc-88941be830e7
  • Palomar, Manuel|||/items/71e8f2d8-8d56-4c8e-89df-d6ce2497d967
  • Saquete Boró, Estela|||/items/452393f2-fb8d-4840-b797-4b65a4bc9a87
  • Tomás, David|||/items/cf031fc3-3c30-454b-a6df-3762c29cc296
Post-truth is a term that describes a distorting phenomenon that aims to manipulate public opinion and behavior. One of its key engines is the spread of Fake News. Nowadays most news is rapidly disseminated in written language via digital media and social networks. Therefore, to detect fake news it is becoming increasingly necessary to apply Artificial Intelligence (AI) and, more specifically Natural Language Processing (NLP). This paper presents a review of the application of AI to the complex task of automatically detecting fake news. The review begins with a definition and classification of fake news. Considering the complexity of the fake news detection task, a divide-and-conquer methodology was applied to identify a series of subtasks to tackle the problem from a computational perspective. As a result, the following subtasks were identified: deception detection; stance detection; controversy and polarization; automated fact checking; clickbait detection; and, credibility scores. From each subtask, a PRISMA compliant systematic review of the main studies was undertaken, searching Google Scholar. The various approaches and technologies are surveyed, as well as the resources and competitions that have been involved in resolving the different subtasks. The review concludes with a roadmap for addressing the future challenges that have emerged from the analysis of the state of the art, providing a rich source of potential work for the research community going forward.
RUA. Repositorio Institucional de la Universidad de Alicante
Software de investigación Software (Software)

PCT Observer Tablero de Parques Científicos/Tecnológicos, PCT Observer

  • Francés, Olga
  • Abreu Salas, José Ignacio
  • Gutiérrez, Yoan
  • Fernández Martínez, Javier
  • Palomar, Manuel
  • Abreu Salas, José Ignacio|||/items/99fd9ec6-0b97-4c02-a28e-98bc309cff48
  • Fernández Martínez, Javier|||/items/f9b0416b-2411-47be-a586-11f90957e00f
  • Francés, Olga|||/items/174da0ee-29c0-4901-a69c-cfe706e01dce
  • Gutiérrez, Yoan|||/items/8f7f89db-a015-4ed6-85b9-75bd041ee8bd
  • Palomar, Manuel|||/items/71e8f2d8-8d56-4c8e-89df-d6ce2497d967
PCT Observer es una aplicación web para visualizar y analizar datos relacionados con los parques científicos/tecnológicos. Permite descubrir la existencia de diferencias significativas o relaciones entre los indicadores clave, comparar su evolución en el tiempo, y determinar los indicadores más relevantes para caracterizar los diferentes tipos de parques.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Active Learning for Assisted Corpus Construction: A Case Study in Knowledge Discovery from Biomedical Text

  • Cañizares-Diaz, Hian
  • Piad-Morffis, Alejandro
  • Estévez-Velarde, Suilan
  • Gutiérrez, Yoan
  • Almeida-Cruz, Yudivian
  • Montoyo, Andres
  • Muñoz, Rafael
  • Gutiérrez, Yoan|||/items/8f7f89db-a015-4ed6-85b9-75bd041ee8bd
  • Montoyo, Andres|||/items/a2b7158a-7032-423a-a7b5-0f7b92902b72
  • Muñoz, Rafael|||/items/d6ef1286-fc50-4e8b-9d97-bcbc30e3d1bc
This paper presents an active learning approach that aims to reduce the human effort required during the annotation of natural language corpora composed of entities and semantic relations. Our approach assists human annotators by intelligently selecting the most informative sentences to annotate and then pre-annotating them with a few highly accurate entities and semantic relations. We define an uncertainty-based query strategy with a weighted density factor, using similarity metrics based on sentence embeddings. As a case study, we evaluate our approach via simulation in a biomedical corpus and estimate the potential reduction in total annotation time. Experimental results suggest that the query strategy reduces by between 35% and 40% the number of sentences that must be manually annotated to develop systems able to reach a target F1 score, while the pre-annotation strategy produces an additional 24% reduction in the total annotation time. Overall, our preliminary experiments suggest that as much as 60% of the annotation time could be saved while producing corpora that have the same usefulness for training machine learning algorithms. An open-source computational tool that implements the aforementioned strategies is presented and published online for the research community.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Knowledge Discovery in COVID-19 Research Literature

  • Estevanell-Valladares, Ernesto L.
  • Piad-Morffis, Alejandro
  • Estévez-Velarde, Suilan
  • Gutiérrez, Yoan
  • Montoyo, Andres
  • Muñoz, Rafael
  • Almeida-Cruz, Yudivian
  • Estevanell-Valladares, Ernesto L.|||/items/d8b1af9a-112f-48de-813f-b4d8f1df8bd1
  • Gutiérrez, Yoan|||/items/8f7f89db-a015-4ed6-85b9-75bd041ee8bd
  • Montoyo, Andres|||/items/a2b7158a-7032-423a-a7b5-0f7b92902b72
  • Muñoz, Rafael|||/items/d6ef1286-fc50-4e8b-9d97-bcbc30e3d1bc
This paper presents the preliminary results of an ongoing project that analyzes the growing body of scientific research published around the COVID-19 pandemic. In this research, a general-purpose semantic model is used to double annotate a batch of 500 sentences that were manually selected from the CORD-19 corpus. Afterwards, a baseline text-mining pipeline is designed and evaluated via a large batch of 100,959 sentences. We present a qualitative analysis of the most interesting facts automatically extracted and highlight possible future lines of development. The preliminary results show that general-purpose semantic models are a useful tool for discovering fine-grained knowledge in large corpora of scientific documents.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Demo Application for the AutoGOAL Framework

  • Estévez-Velarde, Suilan
  • Piad-Morffis, Alejandro
  • Gutiérrez, Yoan
  • Montoyo, Andres
  • Muñoz, Rafael
  • Almeida-Cruz, Yudivian
  • Gutiérrez, Yoan|||/items/8f7f89db-a015-4ed6-85b9-75bd041ee8bd
  • Montoyo, Andres|||/items/a2b7158a-7032-423a-a7b5-0f7b92902b72
  • Muñoz, Rafael|||/items/d6ef1286-fc50-4e8b-9d97-bcbc30e3d1bc
This paper introduces a web demo that showcases the main characteristics of the AutoGOAL framework. AutoGOAL is a framework in Python for automatically finding the best way to solve a given task. It has been designed mainly for automatic machine learning (AutoML) but it can be used in any scenario where several possible strategies are available to solve a given computational task. In contrast with alternative frameworks, AutoGOAL can be applied seamlessly to Natural Language Processing as well as structured classification problems. This paper presents an overview of the framework’s design and experimental evaluation in several machine learning problems, including two recent NLP challenges. The accompanying software demo is available online and full source code is provided under the MIT open-source license.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

LIVING-LANG: Living digital entities by human language technologies, LIVING-LANG: Tecnologías del lenguaje humano para entidades digitales vivas

  • Ureña López, Luis Alfonso
  • Saquete Boró, Estela
  • Martín Valdivia, María Teresa
  • Martínez-Barco, Patricio
  • Martínez-Barco, Patricio|||/items/f9630270-fe31-44c8-b611-dfaf9c109a4d
  • Saquete Boró, Estela|||/items/452393f2-fb8d-4840-b797-4b65a4bc9a87
This project pursues the dynamic modeling at a spatial-temporal level of digital entities in social media for predicting their behavior. Firstly, digital entities are modelled by identifying the characteristics of individuals through their language and footprint on the network. Then, the extraction of relationships between digital entities is one of the nuclear challenges of the project. The proposal pursues this objective on a semantic level, structuring the information into representations of knowledge suitable for logical processing. Considering the heterogeneous nature of the sources to be dealt with, filtering of information is fundamental, using metrics and quality criteria. This spatial-temporal characterization, together with screening processes, will allow us to study high-performance predictive strategies in the evolution of digital entities. This project is coordinated by the SINAI and GPLSI research groups.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

To what extent does content selection affect surface realization in the context of headline generation?

  • Barros, Cristina
  • Vicente, Marta
  • Lloret, Elena
  • Lloret, Elena|||/items/4593ef69-8308-49d3-8f0f-17e6ee078be5
Headline generation is a task where the most important information of a news article is condensed and embodied into a single short sentence. This task is normally addressed by summarization techniques, ideally combining extractive and abstractive methods together with sentence compression or fusion techniques. Although Natural Language Generation (NLG) techniques have not been directly exploited for headline generation, they may provide better mechanisms than summarization techniques to paraphrase the information of a text. Therefore, this paper analyzes and evaluates the effectiveness of NLG techniques for generating headlines. In NLG, both content selection and surface realization are equally important—there is no point in generating text without knowing the topic. Considering this premise, we therefore take HanaNLG—a hybrid surface realization approach—as a basis, and we analyze the effect in the generated text when different content selection strategies are integrated at macroplanning stage. The experiments conducted show that, despite not using any sophisticated summarization method, the proposed approach provided the following benefits: i) it generated a coherent, linguistically structured headline; ii) it obtained results on standard datasets (i.e., DUC 2003 and DUC 2004) that were comparable to several competitive systems, in terms of the content of the generated headline; and, iii) the headlines generated by the whole approach (PLM-HanaNLG) were preferred by human assessors compared to those generated by the best performing system in DUC 2003.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Detección de información engañosa mediante Tecnologías del Lenguaje Humano e Inteligencia Artificial

  • Sepúlveda-Torres, Robiert
  • Sepúlveda-Torres, Robiert|||/items/60f24ee2-fe45-4b5c-a70c-c025ed1b5e4a
En los últimos años, el consumo de noticias en medios impresos ha sido sustituido en gran medida por el acceso a estas en variados formatos a través de medios digitales y redes sociales. Los bajos costes de acceso a la información y la profusión de las plataformas de comunicación y dispositivos móviles han producido un cambio en los hábitos de consumo de información, la que es recibida desde múltiples fuentes y replicada con inmediatez en un ambiente global. En este contexto, se ha incrementado la desinformación, un problema originado en los albores de la prensa tradicional. En la última década, la desinformación ha alcanzado una escala inmanejable debido al gran volumen de información al que un ciudadano común está expuesto cada día. A esto se suma que la mayoría de estos medios digitales no son arbitrados, y permiten publicar y compartir cualquier tipo de información. En este ambiente es muy probable la proliferación de información engañosa que, en la mayoría de los casos, pretende influir en la opinión pública para perseguir un objetivo económico, social o político subyacente. Esto puede perjudicar a las organizaciones, a las marcas y a las personas, entre otros, derivando en muchas ocasiones en conclusiones precipitadas por parte de los usuarios que la consumen. En este contexto surge el término de la posverdad como una tendencia a priorizar la subjetividad de una interpretación a la verificación de hechos reales. El titular de una noticia está diseñado para resumir sucintamente su contenido, proporcionando al lector una comprensión clara de la misma. Desafortunadamente, en la era de la posverdad, los titulares están más enfocados en atraer la atención del lector que en presentar con precisión el contenido de la noticia. Esto abre una enorme oportunidad para difundir desinformación con la construcción de titulares falsos o distorsionados. Las técnicas tradicionales de verificación de hechos realizadas por humanos son definitivamente impracticables y obsoletas ante la cantidad de textos informativos que se generan incluso cada hora. En este trabajo se abordan soluciones novedosas utilizando Tecnologías de Lenguaje Humano (TLH) y técnicas de Inteligencia Artificial (IA). Esta investigación se ha desarrollado en un área donde se intersecan confusamente diferentes conceptos, herramientas y aproximaciones. Se parte de una ubicación en el estado del arte acerca de las principales soluciones relacionadas con la detección de titulares engañosos, detección de posturas, detección de contradicciones, interrelación entre estos elementos y verificación automática de hechos. A partir del problema enunciado y sus conceptos, se profundiza en diferentes estrategias de solución con la aspiración de proponer una aproximación que permita, con un enfoque suficientemente práctico, aportar a la detección de información engañosa en medios digitales lo que puede convertirse en una herramienta de alerta en el complejo ambiente antes descrito. Entre los elementos considerados, se valora la utilización de ML y de DL como técnicas tradicionales de trabajo en el espacio de estas soluciones, así como sus alcances y limitaciones. Además, se introduce la idea de sustituir el contenido de una noticia por un resumen suficientemente esencial y obtenido de manera automática. La memoria presenta de manera lógica el curso de la investigación que parte de lo conceptual y utiliza el pensamiento deductivo y experimental para alcanzar generalizaciones y aplicarlas deductivamente a la solución de problemas específicos. Con ello, se abordan determinadas tareas que pueden contribuir parcialmente a la solución de parte del problema planteado, se diseñan experimentos y se especifica la solución en el ámbito del idioma español donde no se reportan aportaciones similares. Se propone una arquitectura flexible para la detección de titulares engañosos que ha permitido implementar sobre ella dos prototipos cuyos resultados experimentales y documentados suponen un paso de avance hacia la automatización de esta tarea. Esta arquitectura alcanza resultados notables al ser aplicada sobre dos conjuntos de datos en idioma inglés y español. Siguiendo los principios y las experiencias adquiridas se presenta una aplicación de una arquitectura similar para la detección de noticias falsas, lo que hace presumir su posible generalidad.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Relevant Content Selection through Positional Language Models: An Exploratory Analysis, Selección de Contenido Relevante mediante Modelos de Lenguaje Posicionales: Un Análisis Experimental

  • Vicente, Marta
  • Lloret, Elena
  • Lloret, Elena|||/items/4593ef69-8308-49d3-8f0f-17e6ee078be5
Extractive Summarisation, like other areas in Natural Language Processing, has succumbed to the general trend marked by the success of neural approaches. However, the required resources-computational, temporal, data-are not always available. We present an experimental study of a method based on statistical techniques that, exploiting the semantic information from the source and its structure, provides competitive results against the state of the art. We propose a Discourse-Informed approach for Cost-effective Extractive Summarisation (DICES). DICES is an unsupervised, lightweight and adaptable framework that requires neither training data nor high-performance computing resources to achieve promising results.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Automatic Discovery of Heterogeneous Machine Learning Pipelines: An Application to Natural Language Processing

  • Estévez-Velarde, Suilan
  • Gutiérrez, Yoan
  • Montoyo, Andres
  • Almeida-Cruz, Yudivian
  • Gutiérrez, Yoan|||/items/8f7f89db-a015-4ed6-85b9-75bd041ee8bd
  • Montoyo, Andres|||/items/a2b7158a-7032-423a-a7b5-0f7b92902b72
This paper presents AutoGOAL, a system for automatic machine learning (AutoML) that uses heterogeneous techniques. In contrast with existing AutoML approaches, our contribution can automatically build machine learning pipelines that combine techniques and algorithms from different frameworks, including shallow classifiers, natural language processing tools, and neural networks. We define the heterogeneous AutoML optimization problem as the search for the best sequence of algorithms that transforms specific input data into the desired output. This provides a novel theoretical and practical approach to AutoML. Our proposal is experimentally evaluated in diverse machine learning problems and compared with alternative approaches, showing that it is competitive with other AutoML alternatives in standard benchmarks. Furthermore, it can be applied to novel scenarios, such as several NLP tasks, where existing alternatives cannot be directly deployed. The system is freely available and includes in-built compatibility with a large number of popular machine learning frameworks, which makes our approach useful for solving practical problems with relative ease and effort.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Applying Smarta to the analysis of tourist networks

  • Lloret-Climent, Miguel
  • Nescolarde-Selva, Josué Antonio
  • Alonso-Stenberg, Kristian
  • Montoyo, Andres
  • Gutiérrez, Yoan
  • Alonso-Stenberg, Kristian|||/items/523fe094-37ca-49e6-b043-5db9d7393ed1
  • Gutiérrez, Yoan|||/items/8f7f89db-a015-4ed6-85b9-75bd041ee8bd
  • Lloret-Climent, Miguel|||/items/f2c9b599-7042-49f9-98e0-bb91f11d9ed7
  • Montoyo, Andres|||/items/a2b7158a-7032-423a-a7b5-0f7b92902b72
  • Nescolarde-Selva, Josué Antonio|||/items/bd921352-9e91-44d9-a574-4587b28566ba
The framework of the present study was the destination life cycle model, a classical model that describes the development of tourist destinations. We examined mass tourism in Benidorm based on tourist accommodation supply and demand statistics over the January 2016 to October 2018 period, provided by Spain's National Institute for Statistics. The objective was to analyze the life cycle and competitiveness of Benidorm's tourism system and interpret whether the tourism product was sustainable and at what stage in the cycle Benidorm is currently in. To do this, we used Smarta software, which, based on network analysis, enables to interpret the system's virtuous cycles and analyze causality by observing relationship patterns in the system's attractors, thus complementing typical processing based on causal maps and the study of social networks. The results obtained by this application (which has been developed by our research team) show six sets of attractors that mark the trends of the tourist system. Finally, the analysis of the significant variables of these attractors has helped us to justify that the tourist system of Benidorm is in the rejuvenation phase.
RUA. Repositorio Institucional de la Universidad de Alicante
Software de investigación Software (Software)

Dossier Next Report

  • Fernández Martínez, Javier
  • Gutiérrez, Yoan
  • Martínez-Barco, Patricio
  • Gómez, José M.
  • Llopis, Fernando
  • Muñoz, Rafael
  • Montoyo, Andres
  • Moreda, Paloma
  • Palomar, Manuel
  • Fernández Martínez, Javier|||/items/f9b0416b-2411-47be-a586-11f90957e00f
  • Gutiérrez, Yoan|||/items/8f7f89db-a015-4ed6-85b9-75bd041ee8bd
  • Llopis, Fernando|||/items/e8548380-b70f-44e7-a7fa-c7bed36990d8
  • Martínez-Barco, Patricio|||/items/f9630270-fe31-44c8-b611-dfaf9c109a4d
  • Montoyo, Andres|||/items/a2b7158a-7032-423a-a7b5-0f7b92902b72
  • Moreda, Paloma|||/items/aeb186ed-9034-4fdf-96fc-88941be830e7
  • Muñoz, Rafael|||/items/d6ef1286-fc50-4e8b-9d97-bcbc30e3d1bc
  • Palomar, Manuel|||/items/71e8f2d8-8d56-4c8e-89df-d6ce2497d967
Dossier Next Report es una aplicación que permite generar resúmenes automáticos y análisis estadístico a partir de la base de datos de una aplicación Dossier Next. Simplemente se ha de indicar un intervalo de fechas y se generarán automáticamente varios resúmenes: uno general, teniendo en cuenta todos los documentos de ese período, y otro para cada entidad detectada dentro de los documentos de ese período. De esta forma, es posible obtener la información más importante de una colección de textos y de cada una de las entidades mencionadas en esa colección.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

From Unstructured Data to Narrative Abstractive Summaries

  • Saquete Boró, Estela
  • Saquete Boró, Estela|||/items/452393f2-fb8d-4840-b797-4b65a4bc9a87
To provide with easy and optimal access to digital information, narrative summaries must have a coherent and natural structure. Depending on how a summary is produced, a distinction can be made between extractive and abstractive summaries. Using an abstractive summarization approach, the relevant information (e.g., who? what?, when?, where?,...) could be fused together, leading to the generation of one or more new sentences. However, in order to do this it is necessary to obtain and process the temporal information in a text. A very effective way is the generation of timelines starting from multiple documents so that the generation of summaries is supported by the generated timeline, without losing the relevant temporal information of the texts. In this proposal, a enriched timeline is generated automatically, and the process of generating abstractive summaries is presented using this timeline as a basis [Barros et al., 2019]. Finally, potential applications of the automatic timeline generation would be presented, as for example its application to Fake News detection.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Interpreting the Smartphone Life Cycle Through Smarta

  • Alonso-Stenberg, Kristian
  • Lloret-Climent, Miguel
  • Nescolarde-Selva, Josué Antonio
  • Mora, Higinio
  • Alonso-Stenberg, Kristian|||/items/523fe094-37ca-49e6-b043-5db9d7393ed1
  • Lloret-Climent, Miguel|||/items/f2c9b599-7042-49f9-98e0-bb91f11d9ed7
  • Mora, Higinio|||/items/77871521-ed51-42c5-9240-dca1930db8e5
  • Nescolarde-Selva, Josué Antonio|||/items/bd921352-9e91-44d9-a574-4587b28566ba
Many complex systems, such as the product life cycle (PLC), can be described in terms of networks, with elements interacting and based on terms of graph theory. In this article, we intend to analyze the PLC from the point of view of network theory and chaos. To do this we will use the Smarta software, developed by our research group (but not yet in a commercial phase), based on network analysis and that allows us to interpret the virtuous circles that the system possesses, and analyze the causalities by observing the plot of existing relationships between the system’s attractors. Smarta allows us to manage the uncertainty of whether or not the product is ecological, and to be proactive, in the sense of designing strategies that anticipate it. A case study is the PLC of a smartphone, where Smarta will act as a filter since it will allow us to associate the concepts of ecological and attractor, so that if the product is recyclable an attractor will be found, and if it is not recyclable it will lack attractors.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Intelligent Ensembling of Auto-ML System Outputs for Solving Classification Problems

  • Consuegra-Ayala, Juan Pablo
  • Gutiérrez, Yoan
  • Almeida-Cruz, Yudivian
  • Palomar, Manuel
  • Gutiérrez, Yoan|||/items/8f7f89db-a015-4ed6-85b9-75bd041ee8bd
  • Palomar, Manuel|||/items/71e8f2d8-8d56-4c8e-89df-d6ce2497d967
  • Consuegra-Ayala, Juan Pablo|||/items/5a98e4ca-607f-4aa0-91c2-a5d929bab52c
Automatic Machine Learning (Auto-ML) tools enable the automatic solution of real-world problems through machine learning techniques. These tools tend to be more time consuming than standard machine learning libraries, therefore, exploiting all the available resources to the full is a valuable feature. This paper presents a two-phase optimization system for solving classification problems. The system is designed to produce more robust classifiers by exploiting the different architectures that are generated while solving classification problems with Auto-ML tools, particularly AutoGOAL. In the first phase, the system follows a probabilistic strategy to find the best combination of algorithms and hyperparameters to generate a collection of base models according to certain diversity criteria; and in the second, it follows similar Auto-ML strategies to ensemble those models. The HAHA 2019 challenge corpus and the Adult dataset were used to evaluate the system. The experimental results show that: i) a better solution can be built by ensembling a subset of the already tested models; ii) the performance of ensemble methods depends on the collection of base models used; and, iii) ensuring diversity using the double-fault measure produces better results than the disagreement measure. The source code is available online for the research community.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Developing an ontology schema for enriching and linking digital media assets

  • Gutiérrez, Yoan
  • Tomás, David
  • Moreno, Isabel
  • Gutiérrez, Yoan|||/items/8f7f89db-a015-4ed6-85b9-75bd041ee8bd
  • Tomás, David|||/items/cf031fc3-3c30-454b-a6df-3762c29cc296
The abundance of digital media information coming from different sources, completely redefines approaches to media content production management and distribution for all contexts (i.e. technical, business and operational). Such content includes descriptive information (i.e. metadata) about an asset (e.g. a movie, song or game), as well as playable media (e.g. audio or video files). Metadata is organised following a variety of inconsistent structures and formats that are supplied by various content providers. Some challenges have been addressed in terms of standardising and enriching media assets metadata from a semantic perspective. Well known examples include Europeana and DBpedia. Nevertheless, due to the ongoing variability and evolution of digital contents, constant support and creation of new semantic representations are necessary. This article presents an ontology schema covering the requirements of users (content providers and content consumers) involved in the overall life cycle of a digital media asset, which has been designed and developed for a real scenario. The construction of this schema has been documented and evaluated following a methodology supported by quantitative and qualitative metrics. As part of the tangible results, the following outcomes were produced: (i) an RDF/XML schema available via Zenodo and GitHub; (ii) competence questions used for validation are published at GitHub; (iii) an exemplary ontology repository; and (iv) CRUD (Create, Read, Update and Delete) technologies for managing semantic repositories based on such schema. These results form an active part of the framework of a European project and other ongoing research initiatives.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Introducing Sustainability in a Robotic Engineering Degree: A Case Study

  • Pujol, Francisco A.
  • Tomás, David
  • Pujol, Francisco A.|||/items/f6155231-4b70-412a-a6af-2bea51ac458a
  • Tomás, David|||/items/cf031fc3-3c30-454b-a6df-3762c29cc296
This paper describes a group activity concerning the topic of climate change, designed to introduce the concepts of sustainable development into a Robotic Engineering degree. The purpose of this activity was to make students reflect about the impact of their work on the planet as future engineers by asking them to design an environmentally friendly robot that also integrated social and economic aspects, covering the three dimensions of sustainability in this way. Students were surveyed in order to study different aspects of their commitment, attitudes, practices, and motivation towards sustainability. In addition to the overall analysis of the survey, three specific studies were carried out with the aim of comparing the responses of different population groups: (i) Students who completed the proposed assignment and students who did not, (ii) female and male students, and (iii) roles played in the assignment. The results of the analysis revealed the high commitment of the students with respect to sustainability, but also a lack of active participation and awareness of their impact as future engineers. The activity was not only a way to introduce sustainability concepts, but in many cases, it also became a motivation for the participants, especially for the female students.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

GPLSI team at CheckThat! 2021: Fine-tuning BETO and RoBERTa

  • Sepúlveda-Torres, Robiert
  • Saquete Boró, Estela
  • Saquete Boró, Estela|||/items/452393f2-fb8d-4840-b797-4b65a4bc9a87
  • Sepúlveda-Torres, Robiert|||/items/60f24ee2-fe45-4b5c-a70c-c025ed1b5e4a
CheckThat! Lab is a challenging lab aimed at tackling the disinformation problem. The GPLSI team from the University of Alicante (Spain) has participated in two tasks of the CheckThat! Lab namely, Task 1 (Check-Worthiness Estimation) and Task 3 (Fake News Detection). We attained second and fifth place in the Spanish-version and English-version of Subtask 1A. Our systems use models based on transfer learning such as RoBERTa and BETO. The best results were achieved by fine-tuning these models. However, our results for Subtask 3A are low compared to the team that achieved the best result. We included some external features in the models for Subtask 1A and 3A, but we could not improve the results. In future work, we will experiment by incorporating other external features into the models with the aim of improving the results of the tasks.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Can Text Summarization Enhance the Headline Stance Detection Task? Benefits and Drawbacks

  • Vicente, Marta
  • Sepúlveda-Torres, Robiert
  • Barros, Cristina
  • Saquete-Boró, Estela
  • Lloret, Elena
  • Sepúlveda-Torres, Robiert|||/items/60f24ee2-fe45-4b5c-a70c-c025ed1b5e4a
  • Saquete Boró, Estela|||/items/452393f2-fb8d-4840-b797-4b65a4bc9a87
  • Lloret, Elena|||/items/4593ef69-8308-49d3-8f0f-17e6ee078be5
This paper presents an exploratory study that analyzes the benefits and drawbacks of summarization techniques for the headline stance detection. Different types of summarization approaches are tested, as well as two stance detection methods (machine learning vs deep learning) on two state-of-the-art datasets (Emergent and FNC–1). Journalists’ headlines sourced from the Emergent dataset have demonstrated with very competitive results that they can be considered a summary of the news article. Based on this finding, this work evaluates the effectiveness of using summaries as a substitute for the full body text to determine the stance of a headline. As for automatic summarization methods, although there is still some room for improvement, several of the techniques analyzed show greater results compared to using the full body text—Lead Summarizer and PLM Summarizer are among the best-performing ones. In particular, PLM summarizer, especially when five sentences are selected as the summary length and deep learning is used, obtains the highest results compared to the other automatic summarization methods analyzed.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Deep learning and multilingual sentiment analysis on social media data: An overview

  • Agüero-Torales, Marvin M.
  • Abreu Salas, José Ignacio
  • López-Herrera, Antonio G.
  • Abreu Salas, José Ignacio|||/items/99fd9ec6-0b97-4c02-a28e-98bc309cff48
Twenty-four studies on twenty-three distinct languages and eleven social media illustrate the steady interest in deep learning approaches for multilingual sentiment analysis of social media. We improve over previous reviews with wider coverage from 2017 to 2020 as well as a study focused on the underlying ideas and commonalities behind the different solutions to achieve multilingual sentiment analysis. Interesting findings of our research are (i) the shift of research interest to cross-lingual and code-switching approaches, (ii) the apparent stagnation of the less complex architectures derived from a backbone featuring an embedding layer, a feature extractor based on a single CNN or LSTM and a classifier, (iii) the lack of approaches tackling multilingual aspect-based sentiment analysis through deep learning, and, surprisingly, (iv) the lack of more complex architectures such as the transformers-based, despite results suggest the more difficult tasks requires more elaborated architectures.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Modeling Complex Social Systems: A New Network Point of View in Labour Markets

  • Lloret-Climent, Miguel
  • Nescolarde-Selva, Josué Antonio
  • Mora, Higinio
  • Alonso-Stenberg, Kristian
  • Mollá Sirvent, Rafael Alejandro
  • Alonso-Stenberg, Kristian|||/items/523fe094-37ca-49e6-b043-5db9d7393ed1
  • Lloret-Climent, Miguel|||/items/f2c9b599-7042-49f9-98e0-bb91f11d9ed7
  • Mora, Higinio|||/items/77871521-ed51-42c5-9240-dca1930db8e5
  • Nescolarde-Selva, Josué Antonio|||/items/bd921352-9e91-44d9-a574-4587b28566ba
Complex Systems is a new field of science studying how parts of a system give rise to the collective behaviours of the system, and how the system interacts with its environment. Graph theory is a fundamental tool in the study of social systems and economic issues. The input-output tables are precisely one of the main examples of it. We use the interpretation of labour market through networks to get a better understanding on its overall functioning. One benefit of the network perspective is that a large body of mathematics exists to help analyse many forms of networks models. If an economic system has a suitable model, then it becomes possible to utilize relevant mathematical tools, such as general systems theory, graph theory and discrete chaos theory, to better understand the way the labour market works. In this article, we apply concepts including structural functions, coverage and invariant sets to a social system’s modelling.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Team GPLSI. Approach for automated fact checking

  • Alonso-Reina, Aimée
  • Sepúlveda-Torres, Robiert
  • Saquete Boró, Estela
  • Palomar, Manuel
  • Sepúlveda-Torres, Robiert|||/items/60f24ee2-fe45-4b5c-a70c-c025ed1b5e4a
  • Saquete Boró, Estela|||/items/452393f2-fb8d-4840-b797-4b65a4bc9a87
  • Palomar, Manuel|||/items/71e8f2d8-8d56-4c8e-89df-d6ce2497d967
Fever Shared 2.0 Task is a challenge meant for developing automated fact checking systems. Our approach for the Fever 2.0 is based on a previous proposal developed by Team Athene UKP TU Darmstadt. Our proposal modifies the sentence retrieval phase, using statement extraction and representation in the form of triplets (subject, object, action). Triplets are extracted from the claim and compare to triplets extracted from Wikipedia articles using semantic similarity. Our results are satisfactory but there is room for improvement.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Exploring Summarization to Enhance Headline Stance Detection

  • Sepúlveda-Torres, Robiert
  • Vicente, Marta
  • Saquete Boró, Estela
  • Lloret, Elena
  • Palomar, Manuel
  • Sepúlveda-Torres, Robiert|||/items/60f24ee2-fe45-4b5c-a70c-c025ed1b5e4a
  • Saquete Boró, Estela|||/items/452393f2-fb8d-4840-b797-4b65a4bc9a87
  • Lloret, Elena|||/items/4593ef69-8308-49d3-8f0f-17e6ee078be5
  • Palomar, Manuel|||/items/71e8f2d8-8d56-4c8e-89df-d6ce2497d967
The spread of fake news and misinformation is causing serious problems to society, partly due to the fact that more and more people only read headlines or highlights of news assuming that everything is reliable, instead of carefully analysing whether it can contain distorted or false information. Specifically, the headline of a correctly designed news item must correspond to a summary of the main information of that news item. Unfortunately, this is not always happening, since various interests, such as increasing the number of clicks as well as political interests can be behind of the generation of a headlines that does not meet its intended original purpose. This paper analyses the use of automatic news summaries to determine the stance (i.e., position) of a headline with respect to the body of text associated with it. To this end, we propose a two-stage approach that uses summary techniques as input for both classifiers instead of the full text of the news body, thus reducing the amount of information that must be processed while maintaining the important information. The experimentation has been carried out using the Fake News Challenge FNC-1 dataset, leading to a 94.13% accuracy, surpassing the state of the art. It is especially remarkable that the proposed approach, which uses only the relevant information provided by the automatic summaries instead of the full text, is able to classify the different stance categories with very competitive results, so it can be concluded that the use of the automatic extractive summaries has a positive impact for determining the stance of very short information (i.e., headline, sentence) with respect to its whole content.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

EmoLabel: Semi-Automatic Methodology for Emotion Annotation of Social Media Text

  • Canales Zaragoza, Lea
  • Daelemans, Walter
  • Boldrini, Ester
  • Martínez-Barco, Patricio
  • Martínez-Barco, Patricio|||/items/f9630270-fe31-44c8-b611-dfaf9c109a4d
The exponential growth of the amount of subjective information on the Web 2.0. has caused an increasing interest from researchers willing to develop methods to extract emotion data from these new sources. One of the most important challenges in textual emotion detection is the gathering of data with emotion labels because of the subjectivity of assigning these labels. Basing on this rationale, the main objective of our research is to contribute to the resolution of this important challenge. This is tackled by proposing EmoLabel: a semi-automatic methodology based on pre-annotation, which consists of two main phases: (1) an automatic process to pre-annotate the unlabelled English sentences; and (2) a manual process of refinement where human annotators determine which is the dominant emotion. Our objective is to assess the influence of this automatic pre-annotation method on manual emotion annotation from two points of view: agreement and time needed for annotation. The evaluation performed demonstrates the benefits of pre-annotation processes since the results on annotation time show a gain of near 20% when the pre-annotation process is applied (Pre-ML) without reducing annotator performance. Moreover, the benefits of pre-annotation are higher in those contributors whose performance is low (inaccurate annotators).