Pasar al contenido principal

MULTI-FACETED DOMAIN ADAPTATION FOR ADVANCED TEXTUAL SEMANTIC PROCESSING

TIN2015-65308-C5-1-R

•
Nombre agencia financiadora Ministerio de Economía y Competitividad
Acrónimo agencia financiadora MINECO
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos I+D+i Retos de Investigación
Año convocatoria 2015
Plan Estatal 2013-2016 Plan Estatal de Investigación Científica y Técnica y de Innovación
Unidad de gestión Dirección General de Investigación Científica y Técnica
Centro beneficiario UNIVERSIDAD DEL PAIS VASCO EUSKAL HERRIKO UNIBERTSITATEA
Identificador persistente http://dx.doi.org/10.13039/501100003329

Resultados relacionados

Resultados totales (Incluyendo duplicados): 35
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Interpretable semantic textual similarity: Finding and explaining differences between sentences

  • Lopez-Gazpio, Iñigo
  • Maritxalar, Montserrat
  • Gonzalez Agirre, Aitor
  • Rigau Claramunt, German
  • Uria, Larraitz
  • Agirre, Eneko
User acceptance of artificial intelligence agents might depend on their ability to explain their reasoning to the users. We focus on a specific text processing task, the Semantic Textual Similarity task (STS), where systems need to measure the degree of semantic equivalence between two sentences. We propose to add an interpretability layer (iSTS for short) formalized as the alignment between pairs of segments across the two sentences, where the relation between the segments is labeled with a relation type and a similarity score. This way, a system performing STS could use the interpretability layer to explain to users why it returned that specific score for the given sentence pair. We present a publicly available dataset of sentence pairs annotated following the formalization. We then develop an iSTS system trained on this dataset, which given a sentence pair finds what is similar and what is different, in the form of graded and typed segment alignments. When evaluated on the dataset, the system performs better than an informed baseline, showing that the dataset and task are well-defined and feasible. Most importantly, two user studies show how the iSTS system output can be used to automatically produce explanations in natural language. Users performed the two tasks better when having access to the explanations, providing preliminary evidence that our dataset and method to automatically produce explanations do help users understand the output of STS systems better., Aitor Gonzalez-Agirre and Inigo Lopez-Gazpio are supported by doctoral grants from MINECO. The work described in this project has been partially funded by MINECO in projects MUSTER (PCIN-2015-226) and TUNER (TIN 2015-65308-C5-1-R), as well as the Basque Government (A group research team, IT344-10).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Introducing idioms in the Galician WordNet: methods, problems and results

  • Álvarez de la Granja, María
  • Gómez Clemente, Xosé María
  • Gómez Guinovart, Xavier
This study describes the introduction of verbal idioms in the Galician language version (Galnet) of the semantic network WordNet; a network that does not traditionally include many phraseological units. To enhance Galnet, a list of 803 Galician verbal idioms was developed to then review each of them individually and assess whether they could be introduced in an existing WordNet synset (a group of synonyms expressing the same concept) or not. Of those 803 idioms, 490 (61%) could be included in this network. Besides, Galnet was enlarged with 750 extra verbal idioms, most of them synonyms or variants of the former. In this study, we present the working methodology for the experiment and an analysis of the results, to help understand the most important problems found when trying to introduce idioms in Galnet. We also discuss the reasons preventing the inclusion of some expressions, and the criteria used to introduce the idioms that finally made it into the network., This research has been supported by the Xunta de Galicia and the European Union (under grant GRC2013/40) and by the Ministry of Economy and Competitiveness of the Spanish Government (Project TUNER: Automatic domain adaptation for semantic processing, TIN2015-65308-C5-1-R).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Through the Eyes of VERTa

  • Comelles, Elisabet
  • Atserias, Jordi
This paper describes a practical demo of VERTa for Spanish. VERTa is an MT evaluation metric that combines linguistic features at different levels. VERTa has been developed for English and Spanish but can be easily adapted to other languages. VERTa can be used to evaluate adequacy, fluency and ranking of sentences. In this paper, VERTa’s modules are described briefly, as well as its graphical interface which provides information on VERTa’s performance and possible MT errors., This work has been funded by the Spanish Government (project TUNER, TIN2015-65308-C5-1-R).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

SemEval-2016 Task 2: Interpretable semantic textual similarity

  • Agirre, Eneko
  • Gonzalez Agirre, Aitor
  • Lopez-Gazpio, Iñigo
  • Maritxalar, Montserrat
  • Rigau Claramunt, German
  • Uria, Larraitz
Comunicació presentada al 10th International Workshop on Semantic Evaluation (SemEval-2016), celebrat els dies 16 i 17 de juny de 2016 a San Diego, Califòrnia., The final goal of Interpretable Semantic Textual Similarity (iSTS) is to build systems that explain which are the differences and commonalities between two sentences. The task adds an explanatory level on top of STS, formalized as an alignment between the chunks in the two input sentences, indicating the relation and similarity score of each alignment. The task provides train and test data on three datasets: news headlines, image captions and student answers. It attracted nine teams, totaling 20 runs. All datasets and the annotation guideline are freely available., This material is based in part upon work supported a MINECO grant to the University of the Basque Country (TUNER project TIN2015-65308-C5-1-R). Aitor Gonzalez Agirre and Inigo Lopez-Gazpio are by doctoral grants from MINECO. The IXA group is funded by the Basque Government (A type Research Group).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

A comparison of domain-based word polarity estimation using different word embeddings

  • García-Pablos, Aitor
  • Cuadros Oller, Montse
  • Rigau Claramunt, German
Comunicació presentada a la Tenth International Conference on Language Resources and Evaluation (LREC 2016), celebrada els dies 23 a 28 de maig de 2016 a Portorož, Eslovènia., A key point in Sentiment Analysis is to determine the polarity of the sentiment implied by a certain word or expression. In basic Sentiment Analysis systems this sentiment polarity of the words is accounted and weighted in different ways to provide a degree of positivity/negativity. Currently words are also modelled as continuous dense vectors, known as word embeddings, which seem to encode interesting semantic knowledge. With regard to Sentiment Analysis, word embeddings are used as features to more complex supervised classification systems to obtain sentiment classifiers. In this paper we compare a set of existing sentiment lexicons and sentiment lexicon generation techniques. We also show a simple but effective technique to calculate a word polarity value for each word in a domain using existing continuous word embeddings generation methods. Further, we also show that word embeddings calculated on in-domain corpus capture the polarity better than the ones calculated on general-domain corpus., This work has been supported by Vicomtech-IK4 and partially funded by TUNER project (TIN2015-65308-C5-1-R).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

An adaptable lexical simplification architecture for major ibero-romance languages

  • Ferrés, Daniel
  • Saggion, Horacio
  • Gómez Guinovart, Xavier
Comunicació presentada a: EMNLP 2017, Workshop Building Linguistically Generalizable NLP Systems; celebrat el 8 de setembre de 2017 a Copenhagen, Dinamarca., Lexical Simplification is the task of reducing the lexical complexity of textual documents by replacing difficult words with easier to read (or understand) expressions while preserving the original meaning. The development of robust pipelined multilingual architectures able to adapt to new languages is of paramount importance in lexical simplification. This paper describes and evaluates a modular hybrid linguistic-statistical Lexical Simplifier that deals with the four major Ibero-Romance Languages: Spanish, Portuguese, Catalan, and Galician. The architecture of the system is the same for the four languages addressed, only the language resources used during simplification are language specific., This work is (partly) supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and by the TUNER project (TIN2015-65308-C5-5-R and TIN2015- 65308-C5-1-R, MINECO/FEDER, UE).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

A multilingual predicate matrix

  • Lopez de Lacalle, Maddalen
  • Laparra, Egoitz
  • Aldabe, Itziar
  • Rigau Claramunt, German
Comunicació presentada a la Tenth International Conference on Language Resources and Evaluation (LREC 2016), celebrada els dies 23 a 28 de maig de 2016 a Portorož, Eslovènia., This paper presents the Predicate Matrix 1.3, a lexical resource resulting from the integration of multiple sources of predicate information including FrameNet, VerbNet, PropBank and WordNet. This new version of the Predicate Matrix has been extended to cover nominal predicates by adding mappings to NomBank. Similarly, we have integrated resources in Spanish, Catalan and Basque. As a result, the Predicate Matrix 1.3 provides a multilingual lexicon to allow interoperable semantic analysis in multiple languages., This work has been partially funded by NewsReader (FP7-ICT-2011-8-316404) and TUNER (TIN2015-65308-C5-1-R) projects.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Multilingual CALL framework for automatic language exercise generation from free text

  • Perez Miguel, Naiara
  • Cuadros Oller, Montse
Comunicació presentada a la 15th Conference of the European Chapter of the Association for Computatinal Linguistics (EACL 2017), celebrada els dies 3 a 7 d'abril de 2017 a València, Espanya., This paper describes a web-based application to design and answer exercises for language learning. It is available in Basque, Spanish, English, and French. Based on open-source Natural Language Processing (NLP) technology such as word embedding models and word sense disambiguation, the system enables users to create automatically and in real time three types of exercises, namely, Fill-inthe-Gaps, Multiple Choice, and Shuffled Sentences questionnaires. These are generated from texts of the users’ own choice, so they can train their language skills with content of their particular interest., This work has been funded by the Spanish Government (project TIN2015-65308-C5-1-R).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

The Event and Implied Situation Ontology (ESO): application and evaluation

  • Segers, Roxane
  • Rospocher, Marco
  • Vossen, Piek
  • Laparra, Egoitz
  • Rigau Claramunt, German
  • Minard, Anne-Lyse
Comunicació presentada a la Tenth International Conference on Language Resources and Evaluation (LREC 2016), celebrada els dies 23 a 28 de maig de 2016 a Portorož, Eslovènia., This paper presents the Event and Implied Situation Ontology (ESO), a manually constructed resource which formalizes the pre and post situations of events and the roles of the entities affected by an event. The ontology is built on top of existing resources such as WordNet, SUMO and FrameNet. The ontology is injected to the Predicate Matrix, a resource that integrates predicate and role information from amongst others FrameNet, VerbNet, PropBank, NomBank and WordNet. We illustrate how these resources are used on large document collections to detect information that otherwise would have remained implicit. The ontology is evaluated on two aspects: recall and precision based on a manually annotated corpus and secondly, on the quality of the knowledge inferred by the situation assertions in the ontology. Evaluation results on the quality of the system show that 50% of the events typed and enriched with ESO assertions are correct., The research for this paper has been partially funded by the European Union 7th Framework Programme NewsReader (FP7-ICT-2011-8-316404) and the Spanish national project TUNER (TIN2015-65308-C5-1-R).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Robust multilingual Named Entity Recognition with shallow semi-supervised features

  • Agerri, Rodrigo
  • Rigau Claramunt, German
We present a multilingual Named Entity Recognition approach based on a robust and general set of features across languages and datasets. Our system combines shallow local information with clustering semi-supervised features induced on large amounts of unlabeled text. Understanding via empirical experimentation how to effectively combine various types of clustering features allows us to seamlessly export our system to other datasets and languages. The result is a simple but highly competitive system which obtains state of the art results across five languages and twelve datasets. The results are reported on standard shared task evaluation data such as CoNLL for English, Spanish and Dutch. Furthermore, and despite the lack of linguistically motivated features, we also report best results for languages such as Basque and German. In addition, we demonstrate that our method also obtains very competitive results even when the amount of supervised data is cut by half, alleviating the dependency on manually annotated data. Finally, the results show that our emphasis on clustering features is crucial to develop robust out-of-domain models. The system and models are freely available to facilitate its use and guarantee the reproducibility of results., This work has been supported by the European projects NewsReader, EC/FP7/316404 and QTLeap – EC/FP7/610516, and by the Spanish Ministry of Economy and Competitiveness (MINECO) SKATER, Grant No. TIN2012-38584-C06-01 and TUNER, TIN2015-65308-C5-1-R.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Savana: a global information extraction and terminology expansion framework in the medical domain

  • Espinosa-Anke, Luis
  • Tello, Jorge
  • Pardo, Albert, 1964-
  • Medrano, Ignacio
  • Ureña, Alberto
  • Salcedo, Ignacio
  • Saggion, Horacio
Terminological databases constitute a fundamental source of information in the medical domain. They are used daily both by practitioners in the area, as well as in academia. Several resources of this kind are available, e.g. CIE, SnomedCT or UMLS (Unified Medical Language System). These terminological databases are of high quality due to them being the result of collaborative expert knowledge. However, they may show certain drawbacks in terms of faithfully representing the ever-changing medical domain. Therefore, systems aimed at capturing novel terminological knowledge in heterogeneous text sources, and able to include them in standard terminologies have the potential to add great value to such repositories. This paper presents, first, Savana, a Biomedical Information Extraction system which, combined with a validation phase carried out by medical practitioners, is used to populate the Spanish branch of SnomedCT with novel knowledge. Second, we describe and evaluate a system which, given a novel medical term, finds its most likely hypernym, thus becoming an enabler in the task of terminological database enrichment and expansion., This work is partially funded by the Spanish Ministry of Economy and Competitiveness under the following sponsorships: Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), and TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Un detector de la unidad central de un texto basado en técnicas de aprendizaje automático en textos científicos para el euskera

  • Bengoetxea, Kepa
  • Atutxa, Aitziber
  • Iruskieta, Mikel
En este artículo presentamos el primer detector de la Unidad Central (UC) de resúmenes científicos en euskera basado en técnicas de aprendizaje automático. Después de segmentar el texto en unidades de discurso elementales, la detección de la unidad central es crucial para anotar de forma más fiable la estructura relacional de textos bajo la Teoría de la Estructura Retórica o Rhetorical Structure Theory (RST). Además, la unidad central puede ser explotada en diversas tareas como resumen automático, tareas de pregunta y respuesta o análisis del sentimiento. Los resultados obtenidos demuestran que las técnicas de aprendizaje automático superan a las técnicas basadas en reglas a pesar del pequeño tamaño del corpus y de la heterogeneidad de los dominios que éste muestra, dejando todavía lugar para mejoras y desarrollo., Este trabajo a sido financiado en parte por el siguiente proyecto: TIN2015-65308-C5-1-R (MINECO/FEDER).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Multilingual event detection using the NewsReader pipelines

  • Agerri, Rodrigo
  • Aldabe, Itziar
  • Laparra, Egoitz
  • Rigau Claramunt, German
  • Fokkens, Antske
  • Huijgen, Paul
  • Izquierdo Beviá, Rubén
  • van Erp, Marieke
  • Vossen, Piek
  • Minard, Anne-Lyse
  • Magnini, Bernardo
Comunicació presentada al LREC 2016 Workshop: Cross-Platform Text Mining and Natural Language Processing Interoperability, celebrat el dia 23 de maig de 2016 a Portoroz, Eslovènia., We describe a novel modular system for cross-lingual event extraction for English, Spanish, Dutch and Italian texts. The system consists of a ready-to-use modular set of advanced multilingual Natural Language Processing (NLP) tools. The pipeline integrates modules for basic NLP processing as well as more advanced tasks such as cross-lingual Named Entity Linking, Semantic Role Labeling and time normalization. Thus, our cross-lingual framework allows for the interoperable semantic interpretation of events, participants, locations and time, as well as the relations between them., This work has been partially funded by NewsReader (FP7-ICT2011-8-316404) and TUNER (TIN2015-65308-C5-1-R).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

​Annotation of negation in the IULA Spanish Clinical Record Corpus

  • Marimon, Montserrat
  • Vivaldi, J. (Jorge), 1952-
  • Bel Rafecas, Núria
Comunicació presentada a SemBEaR 2017: Computational Semantics Beyond Events and Roles, celebrat el dia 4 d'abril de 2017 a València, Espanya., This paper presents the IULA Spanish Clinical Record Corpus, a corpus of 3,194 sentences extracted from anonymized clinical records and manually annotated with negation markers and their scope. The corpus was conceived as a resource to support clinical text-mining systems, but it is also a useful resource for other Natural Language Processing systems handling clinical texts: automatic encoding of clinical records, diagnosis support, term extraction, among others, as well as for the study of clinical texts. The corpus is publicly available with a CC-BY-SA 3.0 license., This work was partially supported by the project TUNER (TIN2015-65308-C5-1-R, MINECO/FEDER).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

SemEval-2016 Task 1: Semantic textual similarity, monolingual and cross-lingual evaluation

  • Agirre, Eneko
  • Banea, Carmen
  • Cer, Daniel
  • Diab, Mona
  • Gonzalez Agirre, Aitor
  • Mihalcea, Rada
  • Rigau Claramunt, German
  • Wiebe, Janyce
Comunicació presentada al 10th International Workshop on Semantic Evaluation (SemEval-2016), celebrat els dies 16 i 17 de juny de 2016 a San Diego, Califòrnia., Semantic Textual Similarity (STS) seeks to measure the degree of semantic equivalence between two snippets of text. Similarity is expressed on an ordinal scale that spans from semantic equivalence to complete unrelatedness. Intermediate values capture specifically defined levels of partial similarity. While prior evaluations constrained themselves to just monolingual snippets of text, the 2016 shared task includes a pilot subtask on computing semantic similarity on cross-lingual text snippets. This year’s traditional monolingual subtask involves the evaluation of English text snippets from the following four domains: Plagiarism Detection, Post-Edited Machine Translations, Question-Answering and News Article Headlines. From the questionanswering domain, we include both questionquestion and answer-answer pairs. The cross-lingual subtask provides paired SpanishEnglish text snippets drawn from the same sources as the English data as well as independently sampled news data. The English subtask attracted 43 participating teams producing 119 system submissions, while the crosslingual Spanish-English pilot subtask attracted 10 teams resulting in 26 systems., This material is based in part upon work supported by DARPA-BAA-12-47 DEFT grant to George Washington University, by DEFT grant #12475008 to the University of Michigan, and by a MINECO grant to the University of the Basque Country (TUNER project TIN2015-65308-C5-1-R). Aitor Gonzalez Agirre is supported by a doctoral grant from MINECO (PhD grant FPU12/06243).
Minerva. Repositorio Institucional de la Universidad de Santiago de Compostela
Publicación Artículo científico (JournalArticle)

Introducing idioms in the Galician WordNet: methods, problems and results

  • Álvarez de la Granja, María
  • Gómez Clemente, Xosé María
  • Gómez Guinovart, Xavier
This study describes the introduction of verbal idioms in the Galician language version (Galnet) of the semantic network WordNet; a network that does not traditionally include many phraseological units. To enhance Galnet, a list of 803 Galician verbal idioms was developed to then review each of them individually and assess whether they could be introduced in an existing WordNet synset (a group of synonyms expressing the same concept) or not. Of those 803 idioms, 490 (61%) could be included in this network. Besides, Galnet was enlarged with 750 extra verbal idioms, most of them synonyms or variants of the former. In this study, we present the working methodology for the experiment and an analysis of the results, to help understand the most important problems found when trying to introduce idioms in Galnet. We also discuss the reasons preventing the inclusion of some expressions, and the criteria used to introduce the idioms that finally made it into the network
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Through the Eyes of VERTa, A Través de los Ojos de VERTa

  • Comelles Pujadas, Elisabet
  • Atserias Batalla, Jordi
This paper describes a practical demo of VERTa for Spanish. VERTa is an MT evaluation metric that combines linguistic features at different levels. VERTa has been developed for English and Spanish but can be easily adapted to other languages. VERTa can be used to evaluate adequacy, fluency and ranking of sentences. In this paper, VERTa’s modules are described briefly, as well as its graphical interface which provides information on VERTa’s performance and possible MT errors.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Un detector de la unidad central de un texto basado en técnicas de aprendizaje automático en textos científicos para el euskera, A Machine Learning based Central Unit Detector for Basque Scientific Texts

  • Bengoetxea Kortazar, Kepa
  • Atutxa Salazar, Aitziber
  • Iruskieta Quintian, Mikel
En este artículo presentamos el primer detector de la Unidad Central (UC) de resúmenes científicos en euskera basado en técnicas de aprendizaje automático. Después de segmentar el texto en unidades de discurso elementales, la detección de la unidad central es crucial para anotar de forma más fiable la estructura relacional de textos bajo la Teoría de la Estructura Retórica o Rhetorical Structure Theory (RST). Además, la unidad central puede ser explotada en diversas tareas como resumen automático, tareas de pregunta y respuesta o análisis del sentimiento. Los resultados obtenidos demuestran que las técnicas de aprendizaje automático superan a las técnicas basadas en reglas a pesar del pequeño tamaño del corpus y de la heterogeneidad de los dominios que éste muestra, dejando todavía lugar para mejoras y desarrollo.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Detecting the Central Units of Brazilian Portuguese argumentative answer texts, Detección de las unidades centrales para textos de respuesta argumentativa en Portugués-Brasileño

  • Bengoetxea Kortazar, Kepa
  • Iruskieta Quintian, Mikel
  • Antonio, Juliano Desiderato
Understanding or writing properly the main idea or the Central Unit (CU) of a text is a very important task in exams. So, detecting automatically the CU may be of interest in language evaluation tasks. This paper presents a CU detector based on machine learning techniques for argumentative answer texts in Brazilian Portuguese. Results show that the detection of CUs following machine learning techniques in argumentative answer texts is better that those using rules.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Diseño y elaboración del corpus SemCor del gallego anotado semánticamente con WordNet 3.0, Design and development of the Galician SemCor corpus semantically tagged with WordNet 3.0

  • Solla Portela, Miguel Anxo
  • Gómez Guinovart, Xavier
En esta presentación describimos la metodología utilizada para la creación del Corpus SensoGal, un corpus paralelo inglés-gallego etiquetado semánticamente con WordNet 3.0 y basado en el SemCor de la lengua inglesa.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

SemEval-2016 Task 1: Semantic textual similarity, monolingual and cross-lingual evaluation

  • Agirre, Eneko
  • Banea, Carmen
  • Cer, Daniel
  • Diab, Mona
  • Gonzalez Agirre, Aitor
  • Mihalcea, Rada
  • Rigau Claramunt, German
  • Wiebe, Janyce
Comunicació presentada al 10th International Workshop on Semantic Evaluation (SemEval-2016), celebrat els dies 16 i 17 de juny de 2016 a San Diego, Califòrnia., Semantic Textual Similarity (STS) seeks to measure the degree of semantic equivalence between two snippets of text. Similarity is expressed on an ordinal scale that spans from semantic equivalence to complete unrelatedness. Intermediate values capture specifically defined levels of partial similarity. While prior evaluations constrained themselves to just monolingual snippets of text, the 2016 shared task includes a pilot subtask on computing semantic similarity on cross-lingual text snippets. This year’s traditional monolingual subtask involves the evaluation of English text snippets from the following four domains: Plagiarism Detection, Post-Edited Machine Translations, Question-Answering and News Article Headlines. From the questionanswering domain, we include both questionquestion and answer-answer pairs. The cross-lingual subtask provides paired SpanishEnglish text snippets drawn from the same sources as the English data as well as independently sampled news data. The English subtask attracted 43 participating teams producing 119 system submissions, while the crosslingual Spanish-English pilot subtask attracted 10 teams resulting in 26 systems., This material is based in part upon work supported by DARPA-BAA-12-47 DEFT grant to George Washington University, by DEFT grant #12475008 to the University of Michigan, and by a MINECO grant to the University of the Basque Country (TUNER project TIN2015-65308-C5-1-R). Aitor Gonzalez Agirre is supported by a doctoral grant from MINECO (PhD grant FPU12/06243).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Interpretable semantic textual similarity: Finding and explaining differences between sentences

  • Lopez-Gazpio, Iñigo
  • Maritxalar, Montserrat
  • Gonzalez Agirre, Aitor
  • Rigau Claramunt, German
  • Uria, Larraitz
  • Agirre, Eneko
User acceptance of artificial intelligence agents might depend on their ability to explain their reasoning to the users. We focus on a specific text processing task, the Semantic Textual Similarity task (STS), where systems need to measure the degree of semantic equivalence between two sentences. We propose to add an interpretability layer (iSTS for short) formalized as the alignment between pairs of segments across the two sentences, where the relation between the segments is labeled with a relation type and a similarity score. This way, a system performing STS could use the interpretability layer to explain to users why it returned that specific score for the given sentence pair. We present a publicly available dataset of sentence pairs annotated following the formalization. We then develop an iSTS system trained on this dataset, which given a sentence pair finds what is similar and what is different, in the form of graded and typed segment alignments. When evaluated on the dataset, the system performs better than an informed baseline, showing that the dataset and task are well-defined and feasible. Most importantly, two user studies show how the iSTS system output can be used to automatically produce explanations in natural language. Users performed the two tasks better when having access to the explanations, providing preliminary evidence that our dataset and method to automatically produce explanations do help users understand the output of STS systems better., Aitor Gonzalez-Agirre and Inigo Lopez-Gazpio are supported by doctoral grants from MINECO. The work described in this project has been partially funded by MINECO in projects MUSTER (PCIN-2015-226) and TUNER (TIN 2015-65308-C5-1-R), as well as the Basque Government (A group research team, IT344-10).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Multilingual CALL framework for automatic language exercise generation from free text

  • Perez Miguel, Naiara
  • Cuadros Oller, Montse
Comunicació presentada a la 15th Conference of the European Chapter of the Association for Computatinal Linguistics (EACL 2017), celebrada els dies 3 a 7 d'abril de 2017 a València, Espanya., This paper describes a web-based application to design and answer exercises for language learning. It is available in Basque, Spanish, English, and French. Based on open-source Natural Language Processing (NLP) technology such as word embedding models and word sense disambiguation, the system enables users to create automatically and in real time three types of exercises, namely, Fill-inthe-Gaps, Multiple Choice, and Shuffled Sentences questionnaires. These are generated from texts of the users’ own choice, so they can train their language skills with content of their particular interest., This work has been funded by the Spanish Government (project TIN2015-65308-C5-1-R).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

​Annotation of negation in the IULA Spanish Clinical Record Corpus

  • Marimon, Montserrat
  • Vivaldi, J. (Jorge), 1952-
  • Bel Rafecas, Núria
Comunicació presentada a SemBEaR 2017: Computational Semantics Beyond Events and Roles, celebrat el dia 4 d'abril de 2017 a València, Espanya., This paper presents the IULA Spanish Clinical Record Corpus, a corpus of 3,194 sentences extracted from anonymized clinical records and manually annotated with negation markers and their scope. The corpus was conceived as a resource to support clinical text-mining systems, but it is also a useful resource for other Natural Language Processing systems handling clinical texts: automatic encoding of clinical records, diagnosis support, term extraction, among others, as well as for the study of clinical texts. The corpus is publicly available with a CC-BY-SA 3.0 license., This work was partially supported by the project TUNER (TIN2015-65308-C5-1-R, MINECO/FEDER).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Multilingual event detection using the NewsReader pipelines

  • Agerri, Rodrigo
  • Aldabe, Itziar
  • Laparra, Egoitz
  • Rigau Claramunt, German
  • Fokkens, Antske
  • Huijgen, Paul
  • Izquierdo Beviá, Rubén
  • van Erp, Marieke
  • Vossen, Piek
  • Minard, Anne-Lyse
  • Magnini, Bernardo
Comunicació presentada al LREC 2016 Workshop: Cross-Platform Text Mining and Natural Language Processing Interoperability, celebrat el dia 23 de maig de 2016 a Portoroz, Eslovènia., We describe a novel modular system for cross-lingual event extraction for English, Spanish, Dutch and Italian texts. The system consists of a ready-to-use modular set of advanced multilingual Natural Language Processing (NLP) tools. The pipeline integrates modules for basic NLP processing as well as more advanced tasks such as cross-lingual Named Entity Linking, Semantic Role Labeling and time normalization. Thus, our cross-lingual framework allows for the interoperable semantic interpretation of events, participants, locations and time, as well as the relations between them., This work has been partially funded by NewsReader (FP7-ICT2011-8-316404) and TUNER (TIN2015-65308-C5-1-R).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Introducing idioms in the Galician WordNet: methods, problems and results

  • Álvarez de la Granja, María
  • Gómez Clemente, Xosé María
  • Gómez Guinovart, Xavier
This study describes the introduction of verbal idioms in the Galician language version (Galnet) of the semantic network WordNet; a network that does not traditionally include many phraseological units. To enhance Galnet, a list of 803 Galician verbal idioms was developed to then review each of them individually and assess whether they could be introduced in an existing WordNet synset (a group of synonyms expressing the same concept) or not. Of those 803 idioms, 490 (61%) could be included in this network. Besides, Galnet was enlarged with 750 extra verbal idioms, most of them synonyms or variants of the former. In this study, we present the working methodology for the experiment and an analysis of the results, to help understand the most important problems found when trying to introduce idioms in Galnet. We also discuss the reasons preventing the inclusion of some expressions, and the criteria used to introduce the idioms that finally made it into the network., This research has been supported by the Xunta de Galicia and the European Union (under grant GRC2013/40) and by the Ministry of Economy and Competitiveness of the Spanish Government (Project TUNER: Automatic domain adaptation for semantic processing, TIN2015-65308-C5-1-R).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

An adaptable lexical simplification architecture for major ibero-romance languages

  • Ferrés, Daniel
  • Saggion, Horacio
  • Gómez Guinovart, Xavier
Comunicació presentada a: EMNLP 2017, Workshop Building Linguistically Generalizable NLP Systems; celebrat el 8 de setembre de 2017 a Copenhagen, Dinamarca., Lexical Simplification is the task of reducing the lexical complexity of textual documents by replacing difficult words with easier to read (or understand) expressions while preserving the original meaning. The development of robust pipelined multilingual architectures able to adapt to new languages is of paramount importance in lexical simplification. This paper describes and evaluates a modular hybrid linguistic-statistical Lexical Simplifier that deals with the four major Ibero-Romance Languages: Spanish, Portuguese, Catalan, and Galician. The architecture of the system is the same for the four languages addressed, only the language resources used during simplification are language specific., This work is (partly) supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and by the TUNER project (TIN2015-65308-C5-5-R and TIN2015- 65308-C5-1-R, MINECO/FEDER, UE).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

The Event and Implied Situation Ontology (ESO): application and evaluation

  • Segers, Roxane
  • Rospocher, Marco
  • Vossen, Piek
  • Laparra, Egoitz
  • Rigau Claramunt, German
  • Minard, Anne-Lyse
Comunicació presentada a la Tenth International Conference on Language Resources and Evaluation (LREC 2016), celebrada els dies 23 a 28 de maig de 2016 a Portorož, Eslovènia., This paper presents the Event and Implied Situation Ontology (ESO), a manually constructed resource which formalizes the pre and post situations of events and the roles of the entities affected by an event. The ontology is built on top of existing resources such as WordNet, SUMO and FrameNet. The ontology is injected to the Predicate Matrix, a resource that integrates predicate and role information from amongst others FrameNet, VerbNet, PropBank, NomBank and WordNet. We illustrate how these resources are used on large document collections to detect information that otherwise would have remained implicit. The ontology is evaluated on two aspects: recall and precision based on a manually annotated corpus and secondly, on the quality of the knowledge inferred by the situation assertions in the ontology. Evaluation results on the quality of the system show that 50% of the events typed and enriched with ESO assertions are correct., The research for this paper has been partially funded by the European Union 7th Framework Programme NewsReader (FP7-ICT-2011-8-316404) and the Spanish national project TUNER (TIN2015-65308-C5-1-R).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

A comparison of domain-based word polarity estimation using different word embeddings

  • García-Pablos, Aitor
  • Cuadros Oller, Montse
  • Rigau Claramunt, German
Comunicació presentada a la Tenth International Conference on Language Resources and Evaluation (LREC 2016), celebrada els dies 23 a 28 de maig de 2016 a Portorož, Eslovènia., A key point in Sentiment Analysis is to determine the polarity of the sentiment implied by a certain word or expression. In basic Sentiment Analysis systems this sentiment polarity of the words is accounted and weighted in different ways to provide a degree of positivity/negativity. Currently words are also modelled as continuous dense vectors, known as word embeddings, which seem to encode interesting semantic knowledge. With regard to Sentiment Analysis, word embeddings are used as features to more complex supervised classification systems to obtain sentiment classifiers. In this paper we compare a set of existing sentiment lexicons and sentiment lexicon generation techniques. We also show a simple but effective technique to calculate a word polarity value for each word in a domain using existing continuous word embeddings generation methods. Further, we also show that word embeddings calculated on in-domain corpus capture the polarity better than the ones calculated on general-domain corpus., This work has been supported by Vicomtech-IK4 and partially funded by TUNER project (TIN2015-65308-C5-1-R).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Un detector de la unidad central de un texto basado en técnicas de aprendizaje automático en textos científicos para el euskera

  • Bengoetxea, Kepa
  • Atutxa, Aitziber
  • Iruskieta, Mikel
En este artículo presentamos el primer detector de la Unidad Central (UC) de resúmenes científicos en euskera basado en técnicas de aprendizaje automático. Después de segmentar el texto en unidades de discurso elementales, la detección de la unidad central es crucial para anotar de forma más fiable la estructura relacional de textos bajo la Teoría de la Estructura Retórica o Rhetorical Structure Theory (RST). Además, la unidad central puede ser explotada en diversas tareas como resumen automático, tareas de pregunta y respuesta o análisis del sentimiento. Los resultados obtenidos demuestran que las técnicas de aprendizaje automático superan a las técnicas basadas en reglas a pesar del pequeño tamaño del corpus y de la heterogeneidad de los dominios que éste muestra, dejando todavía lugar para mejoras y desarrollo., Este trabajo a sido financiado en parte por el siguiente proyecto: TIN2015-65308-C5-1-R (MINECO/FEDER).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Through the Eyes of VERTa

  • Comelles, Elisabet
  • Atserias, Jordi
This paper describes a practical demo of VERTa for Spanish. VERTa is an MT evaluation metric that combines linguistic features at different levels. VERTa has been developed for English and Spanish but can be easily adapted to other languages. VERTa can be used to evaluate adequacy, fluency and ranking of sentences. In this paper, VERTa’s modules are described briefly, as well as its graphical interface which provides information on VERTa’s performance and possible MT errors., This work has been funded by the Spanish Government (project TUNER, TIN2015-65308-C5-1-R).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

A multilingual predicate matrix

  • Lopez de Lacalle, Maddalen
  • Laparra, Egoitz
  • Aldabe, Itziar
  • Rigau Claramunt, German
Comunicació presentada a la Tenth International Conference on Language Resources and Evaluation (LREC 2016), celebrada els dies 23 a 28 de maig de 2016 a Portorož, Eslovènia., This paper presents the Predicate Matrix 1.3, a lexical resource resulting from the integration of multiple sources of predicate information including FrameNet, VerbNet, PropBank and WordNet. This new version of the Predicate Matrix has been extended to cover nominal predicates by adding mappings to NomBank. Similarly, we have integrated resources in Spanish, Catalan and Basque. As a result, the Predicate Matrix 1.3 provides a multilingual lexicon to allow interoperable semantic analysis in multiple languages., This work has been partially funded by NewsReader (FP7-ICT-2011-8-316404) and TUNER (TIN2015-65308-C5-1-R) projects.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Savana: a global information extraction and terminology expansion framework in the medical domain

  • Espinosa-Anke, Luis
  • Tello, Jorge
  • Pardo, Albert, 1964-
  • Medrano, Ignacio
  • Ureña, Alberto
  • Salcedo, Ignacio
  • Saggion, Horacio
Terminological databases constitute a fundamental source of information in the medical domain. They are used daily both by practitioners in the area, as well as in academia. Several resources of this kind are available, e.g. CIE, SnomedCT or UMLS (Unified Medical Language System). These terminological databases are of high quality due to them being the result of collaborative expert knowledge. However, they may show certain drawbacks in terms of faithfully representing the ever-changing medical domain. Therefore, systems aimed at capturing novel terminological knowledge in heterogeneous text sources, and able to include them in standard terminologies have the potential to add great value to such repositories. This paper presents, first, Savana, a Biomedical Information Extraction system which, combined with a validation phase carried out by medical practitioners, is used to populate the Spanish branch of SnomedCT with novel knowledge. Second, we describe and evaluate a system which, given a novel medical term, finds its most likely hypernym, thus becoming an enabler in the task of terminological database enrichment and expansion., This work is partially funded by the Spanish Ministry of Economy and Competitiveness under the following sponsorships: Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), and TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Robust multilingual Named Entity Recognition with shallow semi-supervised features

  • Agerri, Rodrigo
  • Rigau Claramunt, German
We present a multilingual Named Entity Recognition approach based on a robust and general set of features across languages and datasets. Our system combines shallow local information with clustering semi-supervised features induced on large amounts of unlabeled text. Understanding via empirical experimentation how to effectively combine various types of clustering features allows us to seamlessly export our system to other datasets and languages. The result is a simple but highly competitive system which obtains state of the art results across five languages and twelve datasets. The results are reported on standard shared task evaluation data such as CoNLL for English, Spanish and Dutch. Furthermore, and despite the lack of linguistically motivated features, we also report best results for languages such as Basque and German. In addition, we demonstrate that our method also obtains very competitive results even when the amount of supervised data is cut by half, alleviating the dependency on manually annotated data. Finally, the results show that our emphasis on clustering features is crucial to develop robust out-of-domain models. The system and models are freely available to facilitate its use and guarantee the reproducibility of results., This work has been supported by the European projects NewsReader, EC/FP7/316404 and QTLeap – EC/FP7/610516, and by the Spanish Ministry of Economy and Competitiveness (MINECO) SKATER, Grant No. TIN2012-38584-C06-01 and TUNER, TIN2015-65308-C5-1-R.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

SemEval-2016 Task 2: Interpretable semantic textual similarity

  • Agirre, Eneko
  • Gonzalez Agirre, Aitor
  • Lopez-Gazpio, Iñigo
  • Maritxalar, Montserrat
  • Rigau Claramunt, German
  • Uria, Larraitz
Comunicació presentada al 10th International Workshop on Semantic Evaluation (SemEval-2016), celebrat els dies 16 i 17 de juny de 2016 a San Diego, Califòrnia., The final goal of Interpretable Semantic Textual Similarity (iSTS) is to build systems that explain which are the differences and commonalities between two sentences. The task adds an explanatory level on top of STS, formalized as an alignment between the chunks in the two input sentences, indicating the relation and similarity score of each alignment. The task provides train and test data on three datasets: news headlines, image captions and student answers. It attracted nine teams, totaling 20 runs. All datasets and the annotation guideline are freely available., This material is based in part upon work supported a MINECO grant to the University of the Basque Country (TUNER project TIN2015-65308-C5-1-R). Aitor Gonzalez Agirre and Inigo Lopez-Gazpio are by doctoral grants from MINECO. The IXA group is funded by the Basque Government (A type Research Group).