Pasar al contenido principal

FAIRTRANSNLP-DIAGNOSTICO: MIDIENDO Y CUANTIFICANDO EL SESGO Y LA JUSTICIA EN SISTEMAS DE PLN

PID2021-124361OB-C32

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal para Impulsar la Investigación Científico-Técnica y su Transferencia
Subprograma Subprograma Estatal de Generación de Conocimiento
Convocatoria Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Año convocatoria 2021
Plan Estatal 2021-2023 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSIDAD NACIONAL DE EDUCACION A DISTANCIA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 4
Encontrada(s) 1 página(s)

RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Overview of DIPROMATS 2023: automatic detection and characterization of propaganda techniques in messages from diplomats and authorities of world powers, Overview de DIPROMATS 2023: detección y caracterización automáticas de técnicas de propaganda en mensajes de diplomáticos y autoridades de potencias mundiales

  • Moral, Pablo
  • Marco Remón, Guillermo
  • Gonzalo Arroyo, Julio
  • Carrillo-de-Albornoz, Jorge
  • Gonzalo-Verdugo, Iván
This paper presents the results of the DIPROMATS 2023 challenge, a shared task included at the Iberian Languages Evaluation Forum (IberLEF). DIPROMATS 2023 provides a dataset with 12012 annotated tweets in English and 9501 tweets in Spanish, posted by authorities of China, Russia, United States and the European Union. Three tasks are proposed for each language. The first one aims to distinguish if a tweet has propaganda techniques or not. The second task seeks to classify the tweet into four clusters of propaganda techniques, whereas the third one offers a fine-grained categorization of 15 techniques. For the three tasks we have received a total of 34 runs from 9 different teams.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Identifying Media Bias beyond Words: Using Automatic Identification of Persuasive Techniques for Media Bias Detection, Identificación del sesgo en los medios más allá de las palabras: uso de la identificación automática de técnicas persuasivas para la detección del sesgo mediático

  • Rodrigo-Ginés, Francisco-Javier
  • Carrillo-de-Albornoz, Jorge
  • Plaza Morales, Laura
Detecting media bias is a challenging task due to the complexity and ambiguity of language. Current approaches are limited in their ability to generalise across regions and styles of journalism. This paper proposes a new approach that focusses on detecting rhetorical linguistic techniques rather than just analysing words or contextual representations. We compare three different systems based on different techniques for identifying media bias, including a lexical-based system, a language transformers-based system, and a cascade transformers system that relies on persuasive techniques detection. We have evaluated these systems using a Ukraine crisis news dataset and splitting it by according to the country to generate training and test sets, i.e. different sets for each country. The results of the cascade system outperforms by at least a 6% the other approaches in identifying media bias when evaluating with different countries setup. Our results suggest that models capable of detecting rhetorical and persuasive linguistic techniques are necessary to generalise media bias effectively.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Overview of EXIST 2022: sEXism Identification in Social neTworks, Overview de EXIST 2022: Identificación de Sexismo en Redes Sociales

  • Rodríguez-Sánchez, Francisco
  • Carrillo-de-Albornoz, Jorge
  • Plaza Morales, Laura
  • Mendieta-Aragón, Adrián
  • Marco Remón, Guillermo
  • Makeienko, Maryna
  • Plaza, María
  • Gonzalo Arroyo, Julio
  • Spina, Damiano
  • Rosso, Paolo
The paper describes the organization, goals, and results of the sEXism Identification in Social neTworks (EXIST)2022 challenge, a shared task proposed for the second year at IberLEF. EXIST 2022 consists of two challenges: sexism identification and sexism categorization of tweets and gabs, both in Spanish and English. We have received a total of 45 runs for the sexism identification task and 29 runs for the sexism categorization task, submitted by 19 different teams. In this paper, we present the dataset, the evaluation methodology, an overview of the proposed systems, and the results obtained. The final dataset consists of more than 12,000 annotated texts from two social networks (Twitter and Gab) labelled following two different procedures: external contributors and trained experts.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

LyricSIM: A novel dataset and benchmark for similarity detection in Spanish song lyrics, LyricSIM: Un nuevo dataset y benchmark para la detección de similitud en letras de canciones en español

  • Benito-Santos, Alejandro
  • Ghajari, Adrián
  • Hernández, Pedro
  • Fresno Fernández, Víctor
  • Ros, Salvador
  • González-Blanco García, Elena
In this paper, we present a new dataset and benchmark tailored to the task of semantic similarity in song lyrics. Our dataset, originally consisting of 2775 pairs of Spanish songs, was annotated in a collective annotation experiment by 63 native annotators. After collecting and refining the data to ensure a high degree of consensus and data integrity, we obtained 676 high-quality annotated pairs that were used to evaluate the performance of various state-of-the-art monolingual and multilingual language models. Consequently, we established baseline results that we hope will be useful to the community in all future academic and industrial applications conducted in this context.