Pasar al contenido principal

TECNICAS SEMISUPERVISADAS DE EXTRACCION Y ESTRUCTURACION DE CONTENIDO SEMANTICO PARA EL PROCESAMIENTO DE LENGUAJE NATURAL

TIN2015-65308-C5-5-R

•
Nombre agencia financiadora Ministerio de Economía y Competitividad
Acrónimo agencia financiadora MINECO
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos I+D+i Retos de Investigación
Año convocatoria 2015
Plan Estatal 2013-2016 Plan Estatal de Investigación Científica y Técnica y de Innovación
Unidad de gestión Dirección General de Investigación Científica y Técnica
Centro beneficiario UNIVERSITAT POMPEU FABRA CCT
Identificador persistente http://dx.doi.org/10.13039/501100003329

Resultados relacionados

Resultados totales (Incluyendo duplicados): 72
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Classifying short texts for a Social Media monitoring system

  • Bel Rafecas, Núria
  • Diz Pico, Jorge
  • Marimon, Montserrat
  • Pocostales, Joel
We present the system for the classification of sentences and short texts into Marketing Mix classes developed within the LPS-BIGGER project. The system classifies short texts from Social Media into categories that are considered business indicators to monitor consumer's opinion., This work was supported by the Spanish CIEN project LPS-BIGGER cofunded by the MINECO and CDTI (IDI-20141260) and TUNER project TIN2015-65308-C5-5-R (MINECO/FEDER, UE).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Can domain adaptation be handled as analogies?

  • Bel Rafecas, Núria
  • Pocostales, Joel
Comunicació presentada a: 11th International Conference on Language Resources and Evaluation, celebrada a Miyazaki, Japó, del 7 al 12 de maig del 2018., Aspect identification in user generated texts by supervised text classification might suffer degradation in performance when changing to other domains than the one used for training. For referring to aspects such as quality, price or customer services the vocabulary might differ and affect performance. In this paper, we present an experiment to validate a method to handle domain shifts when there is no available labeled data to retrain. The system is based on the offset method as used for solving word analogy problems in vector semantic models such as word embedding. Despite of the fact that the offset method indeed found relevant analogues in the new domain for the classifier initial selected features, the classifiers did not deliver the expected results. The analysis showed that a number of words were found as analogues for many different initial features. This phenomenon was already described in the literature as 'default words' or 'hubs'. However, our data showed that it cannot be explained in terms of word frequency or distance to the question word, as suggested., This work was supported by the Spanish TUNER project TIN2015-65308-C5-5-R (MINECO/FEDER, UE).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

What sentence are you referring to and why? Identifying cited sentences in scientific literature

  • AbuRa'ed, Ahmed Ghassan Tawfiq
  • Chiruzzo, Luis
  • Saggion, Horacio
Comunicació presentada a la International Conference Recent Advances in Natural Language Processing (RANLP 2017), celebrada els dies 2 a 8 de setembre de 2017 a Varna, Bulgària., In the current context of scientific information overload, text mining tools are of paramount importance for researchers who have to read scientific papers and assess their value. Current citation networks, which link papers by citation relationships (reference and citing paper), are useful to quantitatively understand the value of a piece of scientific work, however they are limited in that they do not provide information about what specific part of the reference paper the citing paper is referring to. This qualitative information is very important, for example, in the context of current community-based scientific summarization activities. In this paper, and relying on an annotated dataset of co-citation sentences, we carry out a number of experiments aimed at, given a citation sentence, automatically identify a part of a reference paper being cited. Additionally our algorithm predicts the specific reason why such reference sentence has been cited out of five possible reasons., This work is (partly) supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and by the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Spanish morphological generation with wide-coverage lexicons and decision trees

  • Ferrés, Daniel
  • AbuRa'ed, Ahmed Ghassan Tawfiq
  • Saggion, Horacio
Morphological Generation is the task of producing the appropiate in- flected form of a lemma in a given textual context and according to some morphological features. This paper describes and evaluates wide-coverage morphological lexicons and a Decision Tree algorithm that perform Morphological Generation in Spanish at state-of-the art level. The Freeling, Leffe and Apertium Spanish lexicons, the J48 Decision Tree algorithm and the combination of J48 with Freeling and Leffe lexicons have been evaluated with the following datasets for Spanish: i) CoNLL2009 Shared Task dataset, ii) Durrett and DeNero dataset of Spanish Verbs (DDN), and iii) SIGMORPHON 2016 Shared Task (task-1) dataset. The results show that: i) the Freeling and Leffe lexicons achieve high coverage and precision over the DDN and SIGMORPHON 2016 datasets, ii) the J48 algorithm achieves state-of-the-art results in all of the three datasets, and iii) the combination of Freeling, Leffe and the J48 algorithm outperformed the results of our other approaches in the three evaluation datasets, improved slightly the results of the CoNLL2009 and SIGMORPHON 2016 reported in the state-of-the-art literature, and achieved results comparable to the ones reported in the state-of-the-art literature on the DDN dataset evaluation., This work was partly funded by the ABLETO-INCLUDE project (European Commission CIP Grant No. 621055), the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE), and the Spanish MINECO Ministry (MDM-2015-0502).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

LaSTUS/TALN+INCO @ CL-SciSumm 2018 - Using regression and convolutions for cross-document semantic linking and summarization of scholarly literature

  • AbuRa'ed, Ahmed Ghassan Tawfiq
  • Bravo Serrano, Àlex, 1984-
  • Chiruzzo, Luis
  • Saggion, Horacio
Comunicació presentada al congrés BIRNDL 2018, 3rd Joint Workshop on Bibliometric-enhanced Information Retrieval and Natural Language Processing for Digital Libraries que va tenir lloc el 21 de juliol de 2018 a Ann Arbor, Estats Units., In this paper we present several systems developed to partic- ipate in the 3rd Computational Linguistics Scienti c Document Summa- rization Shared challenge which addresses the problem of summarizing a scienti c paper taking advantage of its citation network (i.e., the pa- pers that cite the given paper). Given a cluster of scienti c documents where one is a reference paper (RP) and the remaining documents are papers citing the reference, two tasks are proposed: (i) to identify which sentences in the reference paper are being cited and why they are cited, and (ii) to produce a citation-based summary of the reference paper using the information in the cluster. Our systems are based on both supervised (Convolutional Neural Networks) and unsupervised techiques taking ad- vantage of word embeddings representations and features computed from the linguistic and semantic analysis of the documents., This work is (partly) supported by the Spanish Ministry of Economy and Com- petitiveness under the Maria de Maeztu Units of Excellence Programme (MDM- 2015-0502) and by the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Multi-level mining and visualization of scientific text collections

  • Accuosto, Pablo
  • Ronzano, Francesco
  • Ferrés, Daniel
  • Saggion, Horacio
Comunicació presentada a: 6th International Workshop on Mining Scientific Publications (WOSP 2017), celebrat el 19 de juny a Toronto, Canada., We present a system to mine and visualize collections of scientific documents by semantically browsing information extracted from single publications or aggregated throughout corpora of articles. The text mining tool performs deep analysis of document collections allowing the extraction and interpretation of research paper’s contents. In addition to the extraction and enrichment of documents with metadata (titles, authors, affiliations, etc), the deep analysis performed comprises semantic interpretation, rhetorical analysis of sentences, triple-based information extraction, and text summarization. The visualization components allow geographicalbased exploration of collections, topic-evolution interpretation, and collaborative network analysis among others. The paper presents a case study of a bilingual collection in the field of Natural Language Processing (NLP)., This work is (partly) supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and by the TUNER project (TIN2015- 65308-C5-5-R, MINECO/FEDER, UE).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Exploring customer reviews for music genre classification and evolutionary studies

  • Oramas, Sergio
  • Espinosa-Anke, Luis
  • Lawlor, Aonghus
  • Serra, Xavier
  • Saggion, Horacio
Comunicació presentada a la 17th International Society for Music Information Retrieval Conference (ISMIR 2016), celebrada els dies 7 a 11 d'agost de 2016 a Nova York, EUA., In this paper, we explore a large multimodal dataset of about 65k albums constructed from a combination of Amazon customer reviews, MusicBrainz metadata and AcousticBrainz audio descriptors. Review texts are further enriched with named entity disambiguation along with polarity information derived from an aspect-based sentiment analysis framework. This dataset constitutes the cornerstone of two main contributions: First, we perform experiments on music genre classification, exploring a variety of feature types, including semantic, sentimental and acoustic features. These experiments show that modeling semantic information contributes to outperforming strong bag-of-words baselines. Second, we provide a diachronic study of the criticism of music genres via a quantitative analysis of the polarity associated to musical aspects over time. Our analysis hints at a potential correlation between key cultural and geopolitical events and the language and evolving sentiments found in music reviews., This work was partially funded by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), by the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE), by the Keystone COST Action IC1302 and by the Insight Centre for Data Analytics under grant number SFI/12/RC/2289.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

SemEval-2018 Task 9: hypernym discovery

  • Camacho-Collados, Jose
  • Delli Bovi, Claudio
  • Espinosa-Anke, Luis
  • Oramas, Sergio
  • Pasini, Tommaso
  • Santus, Enrico
  • Shwartz, Vered
  • Navigli, Roberto
  • Saggion, Horacio
Comunicació presentada al 12th International Workshop on Semantic Evaluation (SemEval-2018), celebrat els dies 5 i 6 de juny de 2018 a Nova Orleans, EUA., This paper describes the SemEval 2018 Shared Task on Hypernym Discovery. We put forward this task as a complementary benchmark for modeling hypernymy, a problem which has traditionally been cast as a binary classification task, taking a pair of candidate words as input. Instead, our reformulated task is defined as follows: given an input term, retrieve (or discover) its suitable hypernyms from a target corpus. We proposed five different subtasks covering three languages (English, Spanish, and Italian), and two specific domains of knowledge in English (Medical and Music). Participants were allowed to compete in any or all of the subtasks. Overall, a total of 11 teams participated, with a total of 39 different systems submitted through all subtasks. Data, results and further information about the task can be found at https://competitions. codalab.org/competitions/17119., The authors gratefully acknowledge the economic support in the construction of the datasets from the Maria de Maeztu-UPF Grant provided to Horacio Saggion, Luis Espinosa-Anke and Sergio Oramas; Google Research through the Google Doctoral Fellowship in Natural Language Processing to Jose Camacho-Collados; and Bar-Ilan University through Vered Shwartz. This work is partially supported by the TUNER project (TIN2015- 65308-C5-5-R, MINECO/FEDER, UE), Spanish Ministry of Economy and Competitiveness.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

An adaptable lexical simplification architecture for major ibero-romance languages

  • Ferrés, Daniel
  • Saggion, Horacio
  • Gómez Guinovart, Xavier
Comunicació presentada a: EMNLP 2017, Workshop Building Linguistically Generalizable NLP Systems; celebrat el 8 de setembre de 2017 a Copenhagen, Dinamarca., Lexical Simplification is the task of reducing the lexical complexity of textual documents by replacing difficult words with easier to read (or understand) expressions while preserving the original meaning. The development of robust pipelined multilingual architectures able to adapt to new languages is of paramount importance in lexical simplification. This paper describes and evaluates a modular hybrid linguistic-statistical Lexical Simplifier that deals with the four major Ibero-Romance Languages: Spanish, Portuguese, Catalan, and Galician. The architecture of the system is the same for the four languages addressed, only the language resources used during simplification are language specific., This work is (partly) supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and by the TUNER project (TIN2015-65308-C5-5-R and TIN2015- 65308-C5-1-R, MINECO/FEDER, UE).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Supervised distributional hypernym discovery via domain adaptation

  • Espinosa-Anke, Luis
  • Camacho-Collados, Jose
  • Delli Bovi, Claudio
  • Saggion, Horacio
Comunicació presentada a la Conference on Empirical Methods in Natural Language Processing celebrada els dies 1 a 5 de novembre de 2016 a Austin, Texas., Lexical taxonomies are graph-like hierarchical structures that provide a formal representation of knowledge. Most knowledge graphs to date rely on is-a (hypernymic) relations as the backbone of their semantic structure. In this paper, we propose a supervised distributional framework for hypernym discovery which operates at the sense level, enabling large-scale automatic acquisition of disambiguated taxonomies. By exploiting semantic regularities between hyponyms and hypernyms in embeddings spaces, and integrating a domain clustering algorithm, our model becomes sensitive to the target data. We evaluate several configurations of our approach, training with information derived from a manually created knowledge base, along with hypernymic relations obtained from Open Information Extraction systems. The integration of both sources of knowledge yields the best overall results according to both automatic and manual evaluation on ten different domains., This work is partially funded by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and under the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE). The authors also acknowledge support from Dr. Inventor (FP7-ICT-2013.8.1611383). José CamachoCollados is supported by a Google Doctoral Fellowship in Natural Language Processing.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

CobaltF: a fluent metric for MT evaluation

  • Fomicheva, Marina
  • Bel Rafecas, Núria
  • Specia, Lucia
  • da Cunha Fanego, Iria
  • Malinovskiy, Anton
Comunicació presentada a la First Conference on Machine Translation (WMT), que es va dur a terme durant el 54th Annual Meeting of the Association for Computational Linguistics, els dies 7 a 12 d'agost de 2016 a Berlín, Alemanya., The vast majority of Machine Translation (MT) evaluation approaches are based on the idea that the closer the MT output is to a human reference translation, the higher its quality. While translation quality has two important aspects, adequacy and fluency, the existing referencebased metrics are largely focused on the former. In this work we combine our metric UPF-Cobalt, originally presented at the WMT15 Metrics Task, with a number of features intended to capture translation fluency. Experiments show that the integration of fluency-oriented features significantly improves the results, rivalling the best-performing evaluation metrics on the WMT15 data., This work was partially funded by TUNER (TIN2015-65308-C5-5-R) and MINECO/FEDER, UE. Marina Fomicheva was supported by funding from the FI-DGR grant program of the Generalitat de Catalunya. Iria da Cunha was supported by a Ramon y Cajal contract (RYC-2014-16935). Lucia Specia was supported by the QT21 project (H2020 No. 645452).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

SemEval 2018 Task 2: multilingual emoji prediction

  • Barbieri, Francesco
  • Camacho-Collados, Jose
  • Ronzano, Francesco
  • Espinosa-Anke, Luis
  • Ballesteros, Miguel
  • Basile, Valerio
  • Patti, Viviana
  • Saggion, Horacio
Comunicació presentada al 12th International Workshop on Semantic Evaluation (SemEval-2018), celebrat els dies 5 i 6 de juny de 2018 a Nova Orleans, EUA., This paper describes the results of the first shared task on Multilingual Emoji Prediction, organized as part of SemEval 2018. Given the text of a tweet, the task consists of predicting the most likely emoji to be used along such tweet. Two subtasks were proposed, one for English and one for Spanish, and participants were allowed to submit a system run to one or both subtasks. In total, 49 teams participated in the English subtask and 22 teams submitted a system run to the Spanish subtask. Evaluation was carried out emoji-wise, and the final ranking was based on macro F-Score. Data and further information about this task can be found at https://competitions. codalab.org/competitions/17344., Francesco B. and Horacio S. acknowledge support from the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE) and the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502). The work of V. Patti and V. Basile was partially funded by the IHatePrejudice project (S1618 L2 BOSC 01).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Trainable citation-enhanced summarization of scientific articles

  • Saggion, Horacio
  • AbuRa'ed, Ahmed Ghassan Tawfiq
  • Ronzano, Francesco
In order to cope with the growing number of relevant scientific publications to consider at a given time, automatic text summarization is a useful technique. However, summarizing scientific papers poses important challenges for the natural language processing community. In recent years a number of evaluation challenges have been proposed to address the problem of summarizing a scientific paper taking advantage of its citation network (i.e., the papers that cite the given paper). Here, we present our trainable technology to address a number of challenges in the context of the 2nd Computational Linguistics Scientific Document/nSummarization Shared Task., This work is (partly) supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE) and the European Project Dr. Inventor (FP7-ICT-2013.8.1 - Grant no: 611383).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Exploring emoji usage and prediction through a temporal variation lens

  • Barbieri, Francesco
  • Marujo, Luís
  • Karuturi, Pradeep
  • Brendel, William
  • Saggion, Horacio
Comunicació presentada a l'International Workshop on Emoji Understanding and Applications in Social Media (Emoji) celebrat el 25 de juny de 2018) a Stanford, Estats Units., The frequent use of Emojis on social media platforms has created a new form of multimodal social interaction. Developing methods for the study and representation of emoji semantics helps to improve future multimodal communication systems. In this paper we explore the usage and semantics of emojis over time. We compare emoji embeddings trained on a corpus of different seasons and show that some emojis are used differently depending on the time of the year. Moreover, we propose a method to take into account the time information for emoji prediction systems, outperforming state-of-the-art systems. We show that, using the time information, the accuracy of some emojis can be significantly improved., Part of this work was done when Francesco B. interned at Snap Inc. Francesco B. and Horacio S. acknowledge support from the TUNER project (TIN2015-65308- C5-5-R, MINECO/FEDER, UE) and the Maria de Maeztu Units of Excellence Programme (MDM-2015- 0502).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

PDFdigest: an adaptable layout-aware PDF-to-XML textual content extractor for scientific articles

  • Ferrés, Daniel
  • Saggion, Horacio
  • Ronzano, Francesco
  • Bravo Serrano, Àlex, 1984-
Comunicació presentada a la Language Resources and Evaluation Conference (LREC) 2018, celebrada els dies 7 a 12 de maig de 2018 a Miyazaki, Japó., The availability of automated approaches and tools to extract structured textual content from PDF articles is essential to enable scientific text mining. This paper describes and evaluates the PDFdigest tool, a PDF-to-XML textual content extraction system specially designed to extract scientific articles’ headings and logical structure (title, authors, abstract,...) and its textual content. The extractor deals with both text-based and image-based PDF articles using custom rule-based algorithms implemented with existing state-of-the-art open-source tools for both PDF-to-HTML conversion and image-based PDF Optical Character Recognition., This work was partly funded by the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE) and the Spanish MINECO Ministry (MDM-2015-0502).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Extending WordNet with fine-grained collocational information via supervised distributional learning

  • Espinosa-Anke, Luis
  • Camacho-Collados, Jose
  • Rodríguez Fernández, Sara
  • Saggion, Horacio
  • Wanner, Leo
Comunicació presentada a COLING 2016: the 26th International Conference on Computational Linguistics; 2016 Dec. 11-16; Osaka (Japan), WordNet is probably the best known lexical resource in Natural Language Processing. While it/nis widely regarded as a high quality repository of concepts and semantic relations, updating and/nextending it manually is costly. One important type of relation which could potentially add enormous/nvalue toWordNet is the inclusion of collocational information, which is paramount in tasks/nsuch as Machine Translation, Natural Language Generation and Second Language Learning. In/nthis paper, we present ColWordNet (CWN), an extended WordNet version with fine-grained collocational/ninformation, automatically introduced thanks to a method exploiting linear relations/nbetween analogous sense-level embeddings spaces. We perform both intrinsic and extrinsic evaluations,/nand release CWN for the use and scrutiny of the community., This work was partially funded by the following projects: MULTISENSOR (FP7-ICT-610411),/nKRISTINA (H2020-645012-RIA), HARENES (FFI201130219-CO2-02), through a predoctoral grant/n(BES-2012-057036), the Mar´ıa de Maeztu Units of Excellence Program (MDM-2015-0502) and TUNER/n(TIN2015-65308-C5-5-R, MINECO/FEDER, UE). Jose Camacho-Collados is supported by a Google/nDoctoral Fellowship in Natural Language Processing.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Are emojis predictable?

  • Barbieri, Francesco
  • Ballesteros, Miguel
  • Saggion, Horacio
Comunicació presentada a la 15th Conference of the European Chapter of the Association for Computational Linguistics, celebrada els dies 3 a 7 d'abril de 2017 a València, Espanya., Emojis are ideograms which are naturally combined with plain text to visually complement or condense the meaning of a message. Despite being widely used in social media, their underlying semantics have received little attention from a Natural Language Processing standpoint. In this paper, we investigate the relation between words and emojis, studying the novel task of predicting which emojis are evoked by text-based tweet messages. We train several models based on Long ShortTerm Memory networks (LSTMs) in this task. Our experimental results show that our neural model outperforms two baselines as well as humans solving the same task, suggesting that computational models are able to better capture the underlying semantics of emojis., First and third authors acknowledge support from the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE) and the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Interpretable emoji prediction via label-wise attention LSTMs

  • Barbieri, Francesco
  • Espinosa-Anke, Luis
  • Camacho-Collados, Jose
  • Schockaert, Steven
  • Saggion, Horacio
Comunicació presentada a la Conference on Empirical Methods in Natural Language Processing, celebrada del 31 d'octubre al 4 de novembre de 2018 a Brussel·les, Bèlgica., Human language has evolved towards newer forms of communication such as social media, where emojis (i.e., ideograms bearing a visual meaning) play a key role. While there is an increasing body of work aimed at the computational modeling of emoji semantics, there is currently little understanding about what makes a computational model represent or predict a given emoji in a certain way. In this paper we propose a label-wise attention mechanism with which we attempt to better understand the nuances underlying emoji prediction. In addition to advantages in terms of interpretability, we show that our proposed architecture improves over standard baselines in emoji prediction, and does particularly well when predicting infrequent emojis., F. Barbieri and H. Saggion acknowledge support from the TUNER project (TIN2015-65308-C5-5- R, MINECO/FEDER, UE). Luis Espinosa-Anke, Jose Camacho-Collados and Steven Schockaert have been supported by ERC Starting Grant 637277.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

How gender and skin tone modifiers affect emoji semantics in Twitter

  • Barbieri, Francesco
  • Camacho-Collados, Jose
Comunicació presentada a la Seventh Joint Conference on Lexical and Computational Semantics, celebrada els dies 5 i 6 de juny de 2018 a Nova Orleans, EUA., In this paper we analyze the use of emojis in social media with respect to gender and skin tone. By gathering a dataset of over twenty two million tweets from United States some findings are clearly highlighted after performing a simple frequency-based analysis. Moreover, we carry out a semantic analysis on the usage of emojis and their modifiers (e.g. gender and skin tone) by embedding all words, emojis and modifiers into the same vector space. Our analyses reveal that some stereotypes related to the skin color and gender seem to be reflected on the use of these modifiers. For example, emojis representing hand gestures are more widely utilized with lighter skin tones, and the usage across skin tones differs significantly. At the same time, the vector corresponding to the male modifier tends to be semantically close to emojis related to business or technology, whereas their female counterparts appear closer to emojis about love or makeup., Francesco B. acknowledges support from the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE) and the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Multi-task emoji learning

  • Barbieri, Francesco
  • Marujo, Luís
  • Karuturi, Pradeep
  • Brendel, William
Comunicació presentada a la 12th International AAAI Conference on Web and Social Media (ICWSM 2018) celebrada a Stanford (EEUU) el 25 de juny de 2018., Emojis are very common in social media and understanding their underlying semantics is of great interest from a Natural Language Processing point of view. In this work, we investigate emoji prediction in short text messages using a multi-task pipeline that simultaneously predicts emojis, their categories and sub-categories. The categories are either manually predefined in the unicode standard or automatically obtained by clustering over word embeddings. We show that using this categorical information adds meaningful information, thus improving the performance of emoji prediction task. We systematically analyze the performance of the emoji prediction task by varying the number of training samples and also do a qualitative analysis by using attention weights from the prediction task., This work was done when Francesco B. interned at Snap Inc. Francesco B. acknowledge support also from the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE) and the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

LaSTUS/TALN @ CLSciSumm-17: cross-document sentence matching and scientific text summarization systems

  • AbuRa'ed, Ahmed Ghassan Tawfiq
  • Chiruzzo, Luis
  • Saggion, Horacio
  • Accuosto, Pablo
  • Bravo Serrano, Àlex, 1984-
Comunicació presentada a: CL-SciSumm 2017, organitzat com a part de The 2nd Joint Workshop on Bibliometric-enhanced Information Retrieval and Natural Language Processing for Digital Libraries (BIRNDL 2017) i conjuntament amb The 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2017), In recent years there has been an increasing interest in approaches to scienti c summarization that take advantage of the citations a research paper has received in order to extract its main contributions. In this context, the CL-SciSumm 2017 Shared Task has been proposed to address citation-based information extraction and summarization. In this paper we present several systems to address three of the CL-SciSumm tasks. Notably, unsupervised systems to match citing and cited sentences (Task 1A), a supervised approach to identify the type of information being cited (Task 1B), and a supervised citation-based summarizer (Task 2)., This work is supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and by the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Experiments in detection of implicit citations

  • AbuRa'ed, Ahmed Ghassan Tawfiq
  • Chiruzzo, Luis
  • Saggion, Horacio
Comunicació presentada al WOSP 2018: 7th International Workshop on Mining Scientific Publications, celebrat el 7 de maig de 2018 a Miyazaki, Japó., The identification of explicit and implicit citations to a given reference paper is important for numerous scientific text mining activities such as citation purpose identification, scientific opinion mining, and scientific summarization. This paper presents experiments on the identification of implicit citations in scientific papers. As in previous work, and relying on an annotated dataset of explicit and implicit citation sentences, we cast the problem as classification, evaluating several machine learning algorithms trained on a set of task-motivated features. We compare our work with the state of the art on the annotated dataset obtaining improved performance. We also annotate a new dataset which we make publicly available to validate our approach. The results on the new dataset confirm our set of features outperforms previously published research., This work is (partly) supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and by the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Information extraction for knowledge base construction in the music domain

  • Oramas, Sergio
  • Espinosa-Anke, Luis
  • Sordo, Mohamed
  • Saggion, Horacio
  • Serra, Xavier
The rate at which information about music is being created and shared on the web is growing exponentially. However, the challenge of making sense of all this data remains an open problem. In this paper, we present and evaluate an Information Extraction pipeline aimed at the construction of a Music Knowledge Base. Our approach starts off by collecting thousands of stories about songs from the songfacts.com website. Then, we combine a state-of-the-art Entity Linking tool and a linguistically motivated rule-based algorithm to extract semantic relations between entity pairs. Next, relations with similar semantics are grouped into clusters by exploiting syntactic dependencies. These relations are ranked thanks to a novel confidence measure based on statistical and linguistic evidence. Evaluation is carried out intrinsically, by assessing each component of the pipeline, as well as in an extrinsic task, in which we evaluate the contribution of natural language explanations in music recommendation. We demonstrate that our method is able to discover novel facts with high precision, which are missing in current generic as well as music-specific knowledge repositories., This work is partially funded by the Spanish Ministry of Economy and Competitiveness under the María de Maeztu Units of Excellence Programme (MDM-2015-0502), and under the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

MultiScien: a bi-lingual natural language processing system for mining and enrichment of scientific collections

  • Saggion, Horacio
  • Ronzano, Francesco
  • Accuosto, Pablo
  • Ferrés, Daniel
Comunicació presentada a: 2nd Joint Workshop on Bibliometric-enhanced Information Retrieval and Natural Language Processing for Digital Libraries (BIRNDL 2017) celebrada a Tokyo l'11 d'agost de 2017., In the current online Open Science context, scientific datasets and tools for deep text analysis, visualization and exploitation play a major role.We present a system for deep analysis and annotation of scientific text collections. We also introduce the first version of the SEPLN Anthology, a bi-lingual (Spanish and English) fully annotated text resource in the field of natural language processing that we created with our system. Moreover, a faceted-search and visualization system to explore the created resource is introduced. All resources created for this paper will be available to the research community., This work is (partly) supported by the Spanish Ministry of Economy and Com- petitiveness under the Maria de Maeztu Units of Excellence Programme (MDM- 2015-0502) and by the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Improving the accessibility of biomedical texts by semantic enrichment and definition expansion

  • Accuosto, Pablo
  • Saggion, Horacio
Comunicació presentada a: XXXIV Congreso Internacional de la Sociedad Española para el Procesamiento del Lenguaje Natural, celebrat del 19 al 21 de setembre de 2018 a Sevilla., We present work aimed at facilitating the comprehensibility of health-related English-Spanish parallel texts by means of the semantic annotation of biomedical concepts and the automatic expansion of their definitions. In order to overcome the limitations posed by the scarcity of resources available for Spanish, we propose to exploit existing tools targeted at English and then transfer the produced annotations. The evaluations performed show the feasibility of this approach. An enriched set of texts is made available, which can be retrieved, visualized and downloaded through a web interface., Este trabajo busca facilitar la comprensión de textos médicos en un corpus paralelo inglés-español mediante la anotación semántica de conceptos y la expansión automática de definiciones. Considerando la limitación de recursos disponibles para el español, proponemos explotar herramientas dirigidas al inglés para obtener anotaciones que luego se transfieren a los textos en español. Las evaluaciones realizadas muestran la viabilidad de este enfoque. Se hace público un conjunto de textos enriquecidos que se pueden recuperar, visualizar y descargar mediante una interfaz web.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Making sense of massive amounts of scientific publications: the scientific knowledge miner project

  • Ronzano, Francesco
  • Freire, Ana
  • Sáez-Trumper, Diego
  • Saggion, Horacio
The World Wide Web has become the hugest repository ever for scientific publications and it continues to increase at an unprecedented rate. Nevertheless, this information overload makes the exploration of this content a very time-consuming task. In this landscape, the availability of text mining tools to characterize and explore distinctive features of the scientific literature is mandatory./nWe present the Scientific Knowledge Miner (SKM) Project, that aims to investigate new approaches and frameworks to facilitate the extraction of knowledge from scientific publications across different disciplines. More specifically, we will focus on citation characterization, recommendation and scientific document summarization., This work is supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), by the European Project Dr. Inventor (FP7-ICT-2013.8.1 - Grant: 611383), the Catalonia Trade and Investment Agency (Agència per la competitivitat de l’empresa, ACCIÓ) and the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Able to read my mail: An accessible e-mail client with assistive technology

  • Saggion, Horacio
  • Ferrés, Daniel
  • Sevens, Leen
  • Schuurman, Ineke
  • Ripollés, Marta
  • Rodríguez, Olga
Comunicació presentada a la conferència Web for All Conference on The Future of Accessible Work celebrada del 2 al 4 d'abril de 2017 a Perth, Austràlia., The Able to Include project aims at improving the living conditions of people with intellectual or developmental disabilities (IDD) in key areas of society. One of its focus points concerns improving the integration of people with IDD in the workplace by introducing accessible Web-based tools. This paper describes one of the tools developed as result of the project: an e-mail client with text simplification and other assistive technologies which makes information transmitted over the Internet more understandable to people with IDD therefore facilitating their labor integration. The accessible Web e-mail client has been developed following a User-Centered Design and tested with people with IDD. The results so far are encouraging., This work was partly funded by the ABLE-TO-INCLUDE project (European Commission CIP Grant No. 621055), the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE), and the Spanish MINECO Ministry (MDM-2015-0502).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

How gender and skin tone modifiers affect emoji semantics in Twitter

  • Barbieri, Francesco
  • Camacho-Collados, Jose
Comunicació presentada a la Seventh Joint Conference on Lexical and Computational Semantics, celebrada els dies 5 i 6 de juny de 2018 a Nova Orleans, EUA., In this paper we analyze the use of emojis in social media with respect to gender and skin tone. By gathering a dataset of over twenty two million tweets from United States some findings are clearly highlighted after performing a simple frequency-based analysis. Moreover, we carry out a semantic analysis on the usage of emojis and their modifiers (e.g. gender and skin tone) by embedding all words, emojis and modifiers into the same vector space. Our analyses reveal that some stereotypes related to the skin color and gender seem to be reflected on the use of these modifiers. For example, emojis representing hand gestures are more widely utilized with lighter skin tones, and the usage across skin tones differs significantly. At the same time, the vector corresponding to the male modifier tends to be semantically close to emojis related to business or technology, whereas their female counterparts appear closer to emojis about love or makeup.., Francesco B. acknowledges support from the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE) and the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Finding and expanding hypernymic relations in the music domain

  • Espinosa-Anke, Luis
  • Oramas, Sergio
  • Camacho-Collados, Jose
  • Saggion, Horacio
Comunicació presentada a la 19th International Conference of the Catalan Association for Artificial Intelligence (CCIA) celebrada del 19 al 21 d'octubre de 2016 a Barcelona, Espanya., Lexical taxonomies are tree or directed acyclic graph-like structures where each node represents a concept and each edge encodes a binary hypernymic (is-a) relation. These lexical resources are useful for AI tasks like Information Retrieval or Machine Translation. Two main trends exist in the construction and exploitation of these resources: On one hand, general purpose taxonomies like Word- Net, and on the other, domain-specific databases such as the CheBi chemical ontology, or MusicBrainz in the music domain. In both cases these are based on finding correct hypernymic relations between pairs of concepts. In this paper, we propose a generic framework for hypernym discovery, based on exploiting linear relations between (term, hypernym) pairs in Wikidata, and apply it to the domain of music. Our promising results, based on several metrics used in Information Retrieval, show that in several cases we are able to discover the correct hypernym for a given novel term., This work is partially funded by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), and under the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE). We also acknowledge support from Dr. Inventor (FP7-ICT-2013.8.1611383).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

How cosmopolitan are emojis? Exploring emojis usage and meaning over different languages with distributional semantics

  • Barbieri, Francesco
  • Kruszewski, German
  • Ronzano, Francesco
  • Saggion, Horacio
Comunicació presentada a: ACM Conference on Multimedia Conference (MM 2016), celebrada del 15 al 19 d'octubre de 2016 a Amsterdam, Holanda., Choosing the right emoji to visually complement or con- dense the meaning of a message has become part of our daily life. Emojis are pictures, which are naturally combined with plain text, thus creating a new form of language. These pic- tures are the same independently of where we live, but they can be interpreted and used in diferent ways. In this pa- per we compare the meaning and the usage of emojis across diferent languages. Our results suggest that the overall se- mantics of the subset of the emojis we studied is preserved across all the languages we analysed. However, some emojis are interpreted in a diferent way from language to language, and this could be related to socio-geographical diferences., We thank the three anonymous reviewers for their useful comments, especially for the future work. We received par- tial support from the TUNER project (TIN2015-65308-C5-5-R,MINECO/FEDER, UE) and theMaria deMaeztu Units of Excellence Programme (MDM-2015-0502). First author also acknowledges the COST Action IC1307 iV&L Net (European Network on Integrating Vision and Language), supported by COST (European Cooperation in Science and Technology).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Towards the understanding of gaming audiences by modeling Twitch emotes

  • Barbieri, Francesco
  • Espinosa-Anke, Luis
  • Ballesteros, Miguel
  • Soler Company, Juan
  • Saggion, Horacio
Comunicació presentada al Third Workshop on Noisy User-generated Text (W-NUT 2017), celebrat el dia 7 de setembre de 2017 a Copenhaguen, Dinamarca., Videogame streaming platforms have become a paramount example of noisy usergenerated text. These are websites where gaming is broadcasted, and allows interaction with viewers via integrated chatrooms. Probably the best known platform of this kind is Twitch, which has more than 100 million monthly viewers. Despite these numbers, and unlike other platforms featuring short messages (e.g. Twitter), Twitch has not received much attention from the Natural Language Processing community. In this paper we aim at bridging this gap by proposing two important tasks specific to the Twitch platform, namely (1) Emote prediction; and (2) Trolling detection. In our experiments, we evaluate three models: a BOW baseline, a logistic supervised classifiers based on word embeddings, and a bidirectional long short-term memory recurrent neural network (LSTM). Our results show that the LSTM model outperforms the other two models, where explicit features with proven effectiveness for similar tasks were encoded., Francesco, Luis and Horacio acknowledge support from the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE) and the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Revealing patterns of Twitter emoji usage in Barcelona and Madrid

  • Barbieri, Francesco
  • Espinosa-Anke, Luis
  • Saggion, Horacio
Comunicació presentada a: 19th International Conference of the Catalan Association for Artificial Intelligence, Barcelona, Catalonia, Spain, October 19–21, 2016, Emojis are small sized images which are naturally combined with free text to visually complement or condense the meaning of a message. The set of available emojis is fixed, irrespective of a user’s location. However, their interpretation and the way they are used may vary. In this paper, we compare the meaning and usage of emojis across two Spanish cities: Barcelona and Madrid. Our results suggest that the overall semantics of the subset of emojis we studied is preserved over these cities. However, some of them are interpreted differently, which suggests there may exist cultural differences between inhabitants of Barcelona and Madrid, and that these are reflected in how they communicate in social networks., We acknowledge partial support from the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE) and the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Arabic medical entity tagging using distant learning in a multilingual framework

  • Cotik, Viviana
  • Rodríguez, Horacio
  • Vivaldi, Jorge
A semantic tagger aiming to detect relevant entities in Arabic medical documents and tagging them with their appropriate semantic class is presented. The system takes profit of a Multilingual Framework covering four languages (Arabic, English, French, and Spanish), in a way that resources available for each language can be used to improve the results of the others, this is specially important for less resourced languages as Arabic. The approach has been evaluated against Wikipedia pages of the four languages belonging to the medical domain. The core of the system is the definition of a base tagset consisting of the three most represented classes in SNOMED-CT taxonomy and the learning of a binary classifier for each semantic category in the tagset and each language, using a distant learning approach over three widely used knowledge resources, namely Wikipedia, Dbpedia, and SNOMED-CT., This work was partially supported by the TUNER project (Spanish Ministerio de Economía y Competitividad, TIN2015-65308-C5-5-R) and the GRAPH-MED project (Spanish Ministerio de Economía y Competitividad, TIN2016-77820-C3-3-R).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

LaSTUS/TALN at Complex Word Identification (CWI) 2018 Shared Task

  • AbuRa'ed, Ahmed Ghassan Tawfiq
  • Saggion, Horacio
Comunicació presentada al 13th Workshop on Innovative Use of NLP for Building Educational Applications, celebrat el dia 5 de juny de 2018 a Nova Orleans, EUA., This paper presents the participation of the LaSTUS/TALN team in the Complex Word Identification (CWI) Shared Task 2018 in the English monolingual track . The purpose of the task was to determine if a word in a given sentence can be judged as complex or not by a certain target audience. For the English track, task organizers provided a training and a development datasets of 27,299 and 3,328 words respectively together with the sentence in which each word occurs. The words were judged as complex or not by 20 human evaluators; ten of whom are natives. We submitted two systems: one system modeled each word to evaluate as a numeric vector populated with a set of lexical, semantic and contextual features while the other system relies on a word embedding representation and a distance metric. We trained two separate classifiers to automatically decide if each word is complex or not. We submitted six runs, two for each of the three subsets of the English monolingual CWI track., This work is (partly) supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and by the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE).
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Spanish Morphological Generation with Wide-Coverage Lexicons and Decision Trees, Generación Morfológica del Español con Lexicones de Amplia Cobertura y Árboles de Decisión

  • Ferrés, Daniel
  • AbuRa'ed, Ahmed
  • Saggion, Horacio
Morphological Generation is the task of producing the appropiate inflected form of a lemma in a given textual context and according to some morphological features. This paper describes and evaluates wide-coverage morphological lexicons and a Decision Tree algorithm that perform Morphological Generation in Spanish at state-of-the art level. The Freeling, Leffe and Apertium Spanish lexicons, the J48 Decision Tree algorithm and the combination of J48 with Freeling and Leffe lexicons have been evaluated with the following datasets for Spanish: i) CoNLL2009 Shared Task dataset, ii) Durrett and DeNero dataset of Spanish Verbs (DDN), and iii) SIGMORPHON 2016 Shared Task (task-1) dataset. The results show that: i) the Freeling and Leffe lexicons achieve high coverage and precision over the DDN and SIGMORPHON 2016 datasets, ii) the J48 algorithm achieves state-of-the-art results in all of the three datasets, and iii) the combination of Freeling, Leffe and the J48 algorithm outperformed the results of our other approaches in the three evaluation datasets, improved slightly the results of the CoNLL2009 and SIGMORPHON 2016 reported in the state-of-the-art literature, and achieved results comparable to the ones reported in the state-of-the-art literature on the DDN dataset evaluation.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Savana: A Global Information Extraction and Terminology Expansion Framework in the Medical Domain, Savana: Un Entorno Integral de Extracción de Información y Expansión de Terminologías en el Dominio de la Medicina

  • Espinosa-Anke, Luis
  • Tello, Jorge
  • Pardo, Alberto
  • Medrano, Ignacio
  • Ureña, Alberto
  • Salcedo, Ignacio
  • Saggion, Horacio
Terminological databases constitute a fundamental source of information in the medical domain. They are used daily both by practitioners in the area, as well as in academia. Several resources of this kind are available, e.g. CIE, SnomedCT or UMLS (Unified Medical Language System). These terminological databases are of high quality due to them being the result of collaborative expert knowledge. However, they may show certain drawbacks in terms of faithfully representing the ever-changing medical domain. Therefore, systems aimed at capturing novel terminological knowledge in heterogeneous text sources, and able to include them in standard terminologies have the potential to add great value to such repositories. This paper presents, first, Savana, a Biomedical Information Extraction system which, combined with a validation phase carried out by medical practitioners, is used to populate the Spanish branch of SnomedCT with novel knowledge. Second, we describe and evaluate a system which, given a novel medical term, finds its most likely hypernym, thus becoming an enabler in the task of terminological database enrichment and expansion.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Classifying short texts for a Social Media monitoring system, Clasificación de textos cortos para un sistema monitor de los Social Media

  • Bel Rafecas, Núria
  • Diz-Pico, Jorge
  • Marimon Felipe, Montserrat
  • Pocostales, Joel
We present the system for the classification of sentences and short texts into Marketing Mix classes developed within the LPS-BIGGER project. The system classifies short texts from Social Media into categories that are considered business indicators to monitor consumer's opinion.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Improving the accessibility of biomedical texts by semantic enrichment and definition expansion, Mejora de la accesibilidad de textos biomédicos mediante enriquecimiento semántico y expansión de definiciones

  • Accuosto, Pablo
  • Saggion, Horacio
We present work aimed at facilitating the comprehensibility of health-related English-Spanish parallel texts by means of the semantic annotation of biomedical concepts and the automatic expansion of their definitions. In order to overcome the limitations posed by the scarcity of resources available for Spanish, we propose to exploit existing tools targeted at English and then transfer the produced annotations. The evaluations performed show the feasibility of this approach. An enriched set of texts is made available, which can be retrieved, visualized and downloaded through a web interface.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Interpretable emoji prediction via label-wise attention LSTMs

  • Barbieri, Francesco
  • Espinosa-Anke, Luis
  • Camacho-Collados, Jose
  • Schockaert, Steven
  • Saggion, Horacio
Comunicació presentada a la Conference on Empirical Methods in Natural Language Processing, celebrada del 31 d'octubre al 4 de novembre de 2018 a Brussel·les, Bèlgica., Human language has evolved towards newer forms of communication such as social media, where emojis (i.e., ideograms bearing a visual meaning) play a key role. While there is an increasing body of work aimed at the computational modeling of emoji semantics, there is currently little understanding about what makes a computational model represent or predict a given emoji in a certain way. In this paper we propose a label-wise attention mechanism with which we attempt to better understand the nuances underlying emoji prediction. In addition to advantages in terms of interpretability, we show that our proposed architecture improves over standard baselines in emoji prediction, and does particularly well when predicting infrequent emojis., F. Barbieri and H. Saggion acknowledge support from the TUNER project (TIN2015-65308-C5-5- R, MINECO/FEDER, UE). Luis Espinosa-Anke, Jose Camacho-Collados and Steven Schockaert have been supported by ERC Starting Grant 637277.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

LaSTUS/TALN+INCO @ CL-SciSumm 2018 - Using regression and convolutions for cross-document semantic linking and summarization of scholarly literature

  • AbuRa'ed, Ahmed Ghassan Tawfiq
  • Bravo Serrano, Àlex, 1984-
  • Chiruzzo, Luis
  • Saggion, Horacio
Comunicació presentada al congrés BIRNDL 2018, 3rd Joint Workshop on Bibliometric-enhanced Information Retrieval and Natural Language Processing for Digital Libraries que va tenir lloc el 21 de juliol de 2018 a Ann Arbor, Estats Units., In this paper we present several systems developed to partic- ipate in the 3rd Computational Linguistics Scienti c Document Summa- rization Shared challenge which addresses the problem of summarizing a scienti c paper taking advantage of its citation network (i.e., the pa- pers that cite the given paper). Given a cluster of scienti c documents where one is a reference paper (RP) and the remaining documents are papers citing the reference, two tasks are proposed: (i) to identify which sentences in the reference paper are being cited and why they are cited, and (ii) to produce a citation-based summary of the reference paper using the information in the cluster. Our systems are based on both supervised (Convolutional Neural Networks) and unsupervised techiques taking ad- vantage of word embeddings representations and features computed from the linguistic and semantic analysis of the documents., This work is (partly) supported by the Spanish Ministry of Economy and Com- petitiveness under the Maria de Maeztu Units of Excellence Programme (MDM- 2015-0502) and by the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

How cosmopolitan are emojis? Exploring emojis usage and meaning over different languages with distributional semantics

  • Barbieri, Francesco
  • Kruszewski, German
  • Ronzano, Francesco
  • Saggion, Horacio
Comunicació presentada a: ACM Conference on Multimedia Conference (MM 2016), celebrada del 15 al 19 d'octubre de 2016 a Amsterdam, Holanda., Choosing the right emoji to visually complement or con- dense the meaning of a message has become part of our daily life. Emojis are pictures, which are naturally combined with plain text, thus creating a new form of language. These pic- tures are the same independently of where we live, but they can be interpreted and used in diferent ways. In this pa- per we compare the meaning and the usage of emojis across diferent languages. Our results suggest that the overall se- mantics of the subset of the emojis we studied is preserved across all the languages we analysed. However, some emojis are interpreted in a diferent way from language to language, and this could be related to socio-geographical diferences., We thank the three anonymous reviewers for their useful comments, especially for the future work. We received par- tial support from the TUNER project (TIN2015-65308-C5-5-R,MINECO/FEDER, UE) and theMaria deMaeztu Units of Excellence Programme (MDM-2015-0502). First author also acknowledges the COST Action IC1307 iV&L Net (European Network on Integrating Vision and Language), supported by COST (European Cooperation in Science and Technology).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Revealing patterns of Twitter emoji usage in Barcelona and Madrid

  • Barbieri, Francesco
  • Espinosa-Anke, Luis
  • Saggion, Horacio
Comunicació presentada a: 19th International Conference of the Catalan Association for Artificial Intelligence, Barcelona, Catalonia, Spain, October 19–21, 2016, Emojis are small sized images which are naturally combined with free text to visually complement or condense the meaning of a message. The set of available emojis is fixed, irrespective of a user’s location. However, their interpretation and the way they are used may vary. In this paper, we compare the meaning and usage of emojis across two Spanish cities: Barcelona and Madrid. Our results suggest that the overall semantics of the subset of emojis we studied is preserved over these cities. However, some of them are interpreted differently, which suggests there may exist cultural differences between inhabitants of Barcelona and Madrid, and that these are reflected in how they communicate in social networks., We acknowledge partial support from the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE) and the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

SemEval 2018 Task 2: multilingual emoji prediction

  • Barbieri, Francesco
  • Camacho-Collados, Jose
  • Ronzano, Francesco
  • Espinosa-Anke, Luis
  • Ballesteros, Miguel
  • Basile, Valerio
  • Patti, Viviana
  • Saggion, Horacio
Comunicació presentada al 12th International Workshop on Semantic Evaluation (SemEval-2018), celebrat els dies 5 i 6 de juny de 2018 a Nova Orleans, EUA., This paper describes the results of the first shared task on Multilingual Emoji Prediction, organized as part of SemEval 2018. Given the text of a tweet, the task consists of predicting the most likely emoji to be used along such tweet. Two subtasks were proposed, one for English and one for Spanish, and participants were allowed to submit a system run to one or both subtasks. In total, 49 teams participated in the English subtask and 22 teams submitted a system run to the Spanish subtask. Evaluation was carried out emoji-wise, and the final ranking was based on macro F-Score. Data and further information about this task can be found at https://competitions. codalab.org/competitions/17344., Francesco B. and Horacio S. acknowledge support from the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE) and the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502). The work of V. Patti and V. Basile was partially funded by the IHatePrejudice project (S1618 L2 BOSC 01).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Can domain adaptation be handled as analogies?

  • Bel Rafecas, Núria
  • Pocostales, Joel
Comunicació presentada a: 11th International Conference on Language Resources and Evaluation, celebrada a Miyazaki, Japó, del 7 al 12 de maig del 2018., Aspect identification in user generated texts by supervised text classification might suffer degradation in performance when changing to other domains than the one used for training. For referring to aspects such as quality, price or customer services the vocabulary might differ and affect performance. In this paper, we present an experiment to validate a method to handle domain shifts when there is no available labeled data to retrain. The system is based on the offset method as used for solving word analogy problems in vector semantic models such as word embedding. Despite of the fact that the offset method indeed found relevant analogues in the new domain for the classifier initial selected features, the classifiers did not deliver the expected results. The analysis showed that a number of words were found as analogues for many different initial features. This phenomenon was already described in the literature as 'default words' or 'hubs'. However, our data showed that it cannot be explained in terms of word frequency or distance to the question word, as suggested., This work was supported by the Spanish TUNER project TIN2015-65308-C5-5-R (MINECO/FEDER, UE).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Trainable citation-enhanced summarization of scientific articles

  • Saggion, Horacio
  • AbuRa'ed, Ahmed Ghassan Tawfiq
  • Ronzano, Francesco
In order to cope with the growing number of relevant scientific publications to consider at a given time, automatic text summarization is a useful technique. However, summarizing scientific papers poses important challenges for the natural language processing community. In recent years a number of evaluation challenges have been proposed to address the problem of summarizing a scientific paper taking advantage of its citation network (i.e., the papers that cite the given paper). Here, we present our trainable technology to address a number of challenges in the context of the 2nd Computational Linguistics Scientific Document/nSummarization Shared Task., This work is (partly) supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE) and the European Project Dr. Inventor (FP7-ICT-2013.8.1 - Grant no: 611383).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

MultiScien: a bi-lingual natural language processing system for mining and enrichment of scientific collections

  • Saggion, Horacio
  • Ronzano, Francesco
  • Accuosto, Pablo
  • Ferrés, Daniel
Comunicació presentada a: 2nd Joint Workshop on Bibliometric-enhanced Information Retrieval and Natural Language Processing for Digital Libraries (BIRNDL 2017) celebrada a Tokyo l'11 d'agost de 2017., In the current online Open Science context, scientific datasets and tools for deep text analysis, visualization and exploitation play a major role.We present a system for deep analysis and annotation of scientific text collections. We also introduce the first version of the SEPLN Anthology, a bi-lingual (Spanish and English) fully annotated text resource in the field of natural language processing that we created with our system. Moreover, a faceted-search and visualization system to explore the created resource is introduced. All resources created for this paper will be available to the research community., This work is (partly) supported by the Spanish Ministry of Economy and Com- petitiveness under the Maria de Maeztu Units of Excellence Programme (MDM- 2015-0502) and by the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Making sense of massive amounts of scientific publications: the scientific knowledge miner project

  • Ronzano, Francesco
  • Freire, Ana
  • Sáez-Trumper, Diego
  • Saggion, Horacio
The World Wide Web has become the hugest repository ever for scientific publications and it continues to increase at an unprecedented rate. Nevertheless, this information overload makes the exploration of this content a very time-consuming task. In this landscape, the availability of text mining tools to characterize and explore distinctive features of the scientific literature is mandatory./nWe present the Scientific Knowledge Miner (SKM) Project, that aims to investigate new approaches and frameworks to facilitate the extraction of knowledge from scientific publications across different disciplines. More specifically, we will focus on citation characterization, recommendation and scientific document summarization., This work is supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), by the European Project Dr. Inventor (FP7-ICT-2013.8.1 - Grant: 611383), the Catalonia Trade and Investment Agency (Agència per la competitivitat de l’empresa, ACCIÓ) and the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Able to read my mail: An accessible e-mail client with assistive technology

  • Saggion, Horacio
  • Ferrés, Daniel
  • Sevens, Leen
  • Schuurman, Ineke
  • Ripollés, Marta
  • Rodríguez, Olga
Comunicació presentada a la conferència Web for All Conference on The Future of Accessible Work celebrada del 2 al 4 d'abril de 2017 a Perth, Austràlia., The Able to Include project aims at improving the living conditions of people with intellectual or developmental disabilities (IDD) in key areas of society. One of its focus points concerns improving the integration of people with IDD in the workplace by introducing accessible Web-based tools. This paper describes one of the tools developed as result of the project: an e-mail client with text simplification and other assistive technologies which makes information transmitted over the Internet more understandable to people with IDD therefore facilitating their labor integration. The accessible Web e-mail client has been developed following a User-Centered Design and tested with people with IDD. The results so far are encouraging., This work was partly funded by the ABLE-TO-INCLUDE project (European Commission CIP Grant No. 621055), the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE), and the Spanish MINECO Ministry (MDM-2015-0502).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

LaSTUS/TALN at Complex Word Identification (CWI) 2018 Shared Task

  • AbuRa'ed, Ahmed Ghassan Tawfiq
  • Saggion, Horacio
Comunicació presentada al 13th Workshop on Innovative Use of NLP for Building Educational Applications, celebrat el dia 5 de juny de 2018 a Nova Orleans, EUA., This paper presents the participation of the LaSTUS/TALN team in the Complex Word Identification (CWI) Shared Task 2018 in the English monolingual track . The purpose of the task was to determine if a word in a given sentence can be judged as complex or not by a certain target audience. For the English track, task organizers provided a training and a development datasets of 27,299 and 3,328 words respectively together with the sentence in which each word occurs. The words were judged as complex or not by 20 human evaluators; ten of whom are natives. We submitted two systems: one system modeled each word to evaluate as a numeric vector populated with a set of lexical, semantic and contextual features while the other system relies on a word embedding representation and a distance metric. We trained two separate classifiers to automatically decide if each word is complex or not. We submitted six runs, two for each of the three subsets of the English monolingual CWI track., This work is (partly) supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and by the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

An adaptable lexical simplification architecture for major ibero-romance languages

  • Ferrés, Daniel
  • Saggion, Horacio
  • Gómez Guinovart, Xavier
Comunicació presentada a: EMNLP 2017, Workshop Building Linguistically Generalizable NLP Systems; celebrat el 8 de setembre de 2017 a Copenhagen, Dinamarca., Lexical Simplification is the task of reducing the lexical complexity of textual documents by replacing difficult words with easier to read (or understand) expressions while preserving the original meaning. The development of robust pipelined multilingual architectures able to adapt to new languages is of paramount importance in lexical simplification. This paper describes and evaluates a modular hybrid linguistic-statistical Lexical Simplifier that deals with the four major Ibero-Romance Languages: Spanish, Portuguese, Catalan, and Galician. The architecture of the system is the same for the four languages addressed, only the language resources used during simplification are language specific., This work is (partly) supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and by the TUNER project (TIN2015-65308-C5-5-R and TIN2015- 65308-C5-1-R, MINECO/FEDER, UE).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Multi-level mining and visualization of scientific text collections

  • Accuosto, Pablo
  • Ronzano, Francesco
  • Ferrés, Daniel
  • Saggion, Horacio
Comunicació presentada a: 6th International Workshop on Mining Scientific Publications (WOSP 2017), celebrat el 19 de juny a Toronto, Canada., We present a system to mine and visualize collections of scientific documents by semantically browsing information extracted from single publications or aggregated throughout corpora of articles. The text mining tool performs deep analysis of document collections allowing the extraction and interpretation of research paper’s contents. In addition to the extraction and enrichment of documents with metadata (titles, authors, affiliations, etc), the deep analysis performed comprises semantic interpretation, rhetorical analysis of sentences, triple-based information extraction, and text summarization. The visualization components allow geographicalbased exploration of collections, topic-evolution interpretation, and collaborative network analysis among others. The paper presents a case study of a bilingual collection in the field of Natural Language Processing (NLP)., This work is (partly) supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and by the TUNER project (TIN2015- 65308-C5-5-R, MINECO/FEDER, UE).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

LaSTUS/TALN @ CLSciSumm-17: cross-document sentence matching and scientific text summarization systems

  • AbuRa'ed, Ahmed Ghassan Tawfiq
  • Chiruzzo, Luis
  • Saggion, Horacio
  • Accuosto, Pablo
  • Bravo Serrano, Àlex, 1984-
Comunicació presentada a: CL-SciSumm 2017, organitzat com a part de The 2nd Joint Workshop on Bibliometric-enhanced Information Retrieval and Natural Language Processing for Digital Libraries (BIRNDL 2017) i conjuntament amb The 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2017), In recent years there has been an increasing interest in approaches to scienti c summarization that take advantage of the citations a research paper has received in order to extract its main contributions. In this context, the CL-SciSumm 2017 Shared Task has been proposed to address citation-based information extraction and summarization. In this paper we present several systems to address three of the CL-SciSumm tasks. Notably, unsupervised systems to match citing and cited sentences (Task 1A), a supervised approach to identify the type of information being cited (Task 1B), and a supervised citation-based summarizer (Task 2)., This work is supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and by the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Extending WordNet with fine-grained collocational information via supervised distributional learning

  • Espinosa-Anke, Luis
  • Camacho-Collados, Jose
  • Rodríguez Fernández, Sara
  • Saggion, Horacio
  • Wanner, Leo
Comunicació presentada a COLING 2016: the 26th International Conference on Computational Linguistics; 2016 Dec. 11-16; Osaka (Japan), WordNet is probably the best known lexical resource in Natural Language Processing. While it/nis widely regarded as a high quality repository of concepts and semantic relations, updating and/nextending it manually is costly. One important type of relation which could potentially add enormous/nvalue toWordNet is the inclusion of collocational information, which is paramount in tasks/nsuch as Machine Translation, Natural Language Generation and Second Language Learning. In/nthis paper, we present ColWordNet (CWN), an extended WordNet version with fine-grained collocational/ninformation, automatically introduced thanks to a method exploiting linear relations/nbetween analogous sense-level embeddings spaces. We perform both intrinsic and extrinsic evaluations,/nand release CWN for the use and scrutiny of the community., This work was partially funded by the following projects: MULTISENSOR (FP7-ICT-610411),/nKRISTINA (H2020-645012-RIA), HARENES (FFI201130219-CO2-02), through a predoctoral grant/n(BES-2012-057036), the Mar´ıa de Maeztu Units of Excellence Program (MDM-2015-0502) and TUNER/n(TIN2015-65308-C5-5-R, MINECO/FEDER, UE). Jose Camacho-Collados is supported by a Google/nDoctoral Fellowship in Natural Language Processing.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

How gender and skin tone modifiers affect emoji semantics in Twitter

  • Barbieri, Francesco
  • Camacho-Collados, Jose
Comunicació presentada a la Seventh Joint Conference on Lexical and Computational Semantics, celebrada els dies 5 i 6 de juny de 2018 a Nova Orleans, EUA., In this paper we analyze the use of emojis in social media with respect to gender and skin tone. By gathering a dataset of over twenty two million tweets from United States some findings are clearly highlighted after performing a simple frequency-based analysis. Moreover, we carry out a semantic analysis on the usage of emojis and their modifiers (e.g. gender and skin tone) by embedding all words, emojis and modifiers into the same vector space. Our analyses reveal that some stereotypes related to the skin color and gender seem to be reflected on the use of these modifiers. For example, emojis representing hand gestures are more widely utilized with lighter skin tones, and the usage across skin tones differs significantly. At the same time, the vector corresponding to the male modifier tends to be semantically close to emojis related to business or technology, whereas their female counterparts appear closer to emojis about love or makeup., Francesco B. acknowledges support from the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE) and the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Finding and expanding hypernymic relations in the music domain

  • Espinosa-Anke, Luis
  • Oramas, Sergio
  • Camacho-Collados, Jose
  • Saggion, Horacio
Comunicació presentada a la 19th International Conference of the Catalan Association for Artificial Intelligence (CCIA) celebrada del 19 al 21 d'octubre de 2016 a Barcelona, Espanya., Lexical taxonomies are tree or directed acyclic graph-like structures where each node represents a concept and each edge encodes a binary hypernymic (is-a) relation. These lexical resources are useful for AI tasks like Information Retrieval or Machine Translation. Two main trends exist in the construction and exploitation of these resources: On one hand, general purpose taxonomies like Word- Net, and on the other, domain-specific databases such as the CheBi chemical ontology, or MusicBrainz in the music domain. In both cases these are based on finding correct hypernymic relations between pairs of concepts. In this paper, we propose a generic framework for hypernym discovery, based on exploiting linear relations between (term, hypernym) pairs in Wikidata, and apply it to the domain of music. Our promising results, based on several metrics used in Information Retrieval, show that in several cases we are able to discover the correct hypernym for a given novel term., This work is partially funded by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), and under the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE). We also acknowledge support from Dr. Inventor (FP7-ICT-2013.8.1611383).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Classifying short texts for a Social Media monitoring system

  • Bel Rafecas, Núria
  • Diz Pico, Jorge
  • Marimon, Montserrat
  • Pocostales, Joel
We present the system for the classification of sentences and short texts into Marketing Mix classes developed within the LPS-BIGGER project. The system classifies short texts from Social Media into categories that are considered business indicators to monitor consumer's opinion., This work was supported by the Spanish CIEN project LPS-BIGGER cofunded by the MINECO and CDTI (IDI-20141260) and TUNER project TIN2015-65308-C5-5-R (MINECO/FEDER, UE).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

SemEval-2018 Task 9: hypernym discovery

  • Camacho-Collados, Jose
  • Delli Bovi, Claudio
  • Espinosa-Anke, Luis
  • Oramas, Sergio
  • Pasini, Tommaso
  • Santus, Enrico
  • Shwartz, Vered
  • Navigli, Roberto
  • Saggion, Horacio
Comunicació presentada al 12th International Workshop on Semantic Evaluation (SemEval-2018), celebrat els dies 5 i 6 de juny de 2018 a Nova Orleans, EUA., This paper describes the SemEval 2018 Shared Task on Hypernym Discovery. We put forward this task as a complementary benchmark for modeling hypernymy, a problem which has traditionally been cast as a binary classification task, taking a pair of candidate words as input. Instead, our reformulated task is defined as follows: given an input term, retrieve (or discover) its suitable hypernyms from a target corpus. We proposed five different subtasks covering three languages (English, Spanish, and Italian), and two specific domains of knowledge in English (Medical and Music). Participants were allowed to compete in any or all of the subtasks. Overall, a total of 11 teams participated, with a total of 39 different systems submitted through all subtasks. Data, results and further information about the task can be found at https://competitions. codalab.org/competitions/17119., The authors gratefully acknowledge the economic support in the construction of the datasets from the Maria de Maeztu-UPF Grant provided to Horacio Saggion, Luis Espinosa-Anke and Sergio Oramas; Google Research through the Google Doctoral Fellowship in Natural Language Processing to Jose Camacho-Collados; and Bar-Ilan University through Vered Shwartz. This work is partially supported by the TUNER project (TIN2015- 65308-C5-5-R, MINECO/FEDER, UE), Spanish Ministry of Economy and Competitiveness.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

CobaltF: a fluent metric for MT evaluation

  • Fomicheva, Marina
  • Bel Rafecas, Núria
  • Specia, Lucia
  • da Cunha Fanego, Iria
  • Malinovskiy, Anton
Comunicació presentada a la First Conference on Machine Translation (WMT), que es va dur a terme durant el 54th Annual Meeting of the Association for Computational Linguistics, els dies 7 a 12 d'agost de 2016 a Berlín, Alemanya., The vast majority of Machine Translation (MT) evaluation approaches are based on the idea that the closer the MT output is to a human reference translation, the higher its quality. While translation quality has two important aspects, adequacy and fluency, the existing referencebased metrics are largely focused on the former. In this work we combine our metric UPF-Cobalt, originally presented at the WMT15 Metrics Task, with a number of features intended to capture translation fluency. Experiments show that the integration of fluency-oriented features significantly improves the results, rivalling the best-performing evaluation metrics on the WMT15 data., This work was partially funded by TUNER (TIN2015-65308-C5-5-R) and MINECO/FEDER, UE. Marina Fomicheva was supported by funding from the FI-DGR grant program of the Generalitat de Catalunya. Iria da Cunha was supported by a Ramon y Cajal contract (RYC-2014-16935). Lucia Specia was supported by the QT21 project (H2020 No. 645452).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

How gender and skin tone modifiers affect emoji semantics in Twitter

  • Barbieri, Francesco
  • Camacho-Collados, Jose
Comunicació presentada a la Seventh Joint Conference on Lexical and Computational Semantics, celebrada els dies 5 i 6 de juny de 2018 a Nova Orleans, EUA., In this paper we analyze the use of emojis in social media with respect to gender and skin tone. By gathering a dataset of over twenty two million tweets from United States some findings are clearly highlighted after performing a simple frequency-based analysis. Moreover, we carry out a semantic analysis on the usage of emojis and their modifiers (e.g. gender and skin tone) by embedding all words, emojis and modifiers into the same vector space. Our analyses reveal that some stereotypes related to the skin color and gender seem to be reflected on the use of these modifiers. For example, emojis representing hand gestures are more widely utilized with lighter skin tones, and the usage across skin tones differs significantly. At the same time, the vector corresponding to the male modifier tends to be semantically close to emojis related to business or technology, whereas their female counterparts appear closer to emojis about love or makeup.., Francesco B. acknowledges support from the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE) and the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Exploring customer reviews for music genre classification and evolutionary studies

  • Oramas, Sergio
  • Espinosa-Anke, Luis
  • Lawlor, Aonghus
  • Serra, Xavier
  • Saggion, Horacio
Comunicació presentada a la 17th International Society for Music Information Retrieval Conference (ISMIR 2016), celebrada els dies 7 a 11 d'agost de 2016 a Nova York, EUA., In this paper, we explore a large multimodal dataset of about 65k albums constructed from a combination of Amazon customer reviews, MusicBrainz metadata and AcousticBrainz audio descriptors. Review texts are further enriched with named entity disambiguation along with polarity information derived from an aspect-based sentiment analysis framework. This dataset constitutes the cornerstone of two main contributions: First, we perform experiments on music genre classification, exploring a variety of feature types, including semantic, sentimental and acoustic features. These experiments show that modeling semantic information contributes to outperforming strong bag-of-words baselines. Second, we provide a diachronic study of the criticism of music genres via a quantitative analysis of the polarity associated to musical aspects over time. Our analysis hints at a potential correlation between key cultural and geopolitical events and the language and evolving sentiments found in music reviews., This work was partially funded by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), by the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE), by the Keystone COST Action IC1302 and by the Insight Centre for Data Analytics under grant number SFI/12/RC/2289.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Are emojis predictable?

  • Barbieri, Francesco
  • Ballesteros, Miguel
  • Saggion, Horacio
Comunicació presentada a la 15th Conference of the European Chapter of the Association for Computational Linguistics, celebrada els dies 3 a 7 d'abril de 2017 a València, Espanya., Emojis are ideograms which are naturally combined with plain text to visually complement or condense the meaning of a message. Despite being widely used in social media, their underlying semantics have received little attention from a Natural Language Processing standpoint. In this paper, we investigate the relation between words and emojis, studying the novel task of predicting which emojis are evoked by text-based tweet messages. We train several models based on Long ShortTerm Memory networks (LSTMs) in this task. Our experimental results show that our neural model outperforms two baselines as well as humans solving the same task, suggesting that computational models are able to better capture the underlying semantics of emojis., First and third authors acknowledge support from the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE) and the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

PDFdigest: an adaptable layout-aware PDF-to-XML textual content extractor for scientific articles

  • Ferrés, Daniel
  • Saggion, Horacio
  • Ronzano, Francesco
  • Bravo Serrano, Àlex, 1984-
Comunicació presentada a la Language Resources and Evaluation Conference (LREC) 2018, celebrada els dies 7 a 12 de maig de 2018 a Miyazaki, Japó., The availability of automated approaches and tools to extract structured textual content from PDF articles is essential to enable scientific text mining. This paper describes and evaluates the PDFdigest tool, a PDF-to-XML textual content extraction system specially designed to extract scientific articles’ headings and logical structure (title, authors, abstract,...) and its textual content. The extractor deals with both text-based and image-based PDF articles using custom rule-based algorithms implemented with existing state-of-the-art open-source tools for both PDF-to-HTML conversion and image-based PDF Optical Character Recognition., This work was partly funded by the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE) and the Spanish MINECO Ministry (MDM-2015-0502).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

What sentence are you referring to and why? Identifying cited sentences in scientific literature

  • AbuRa'ed, Ahmed Ghassan Tawfiq
  • Chiruzzo, Luis
  • Saggion, Horacio
Comunicació presentada a la International Conference Recent Advances in Natural Language Processing (RANLP 2017), celebrada els dies 2 a 8 de setembre de 2017 a Varna, Bulgària., In the current context of scientific information overload, text mining tools are of paramount importance for researchers who have to read scientific papers and assess their value. Current citation networks, which link papers by citation relationships (reference and citing paper), are useful to quantitatively understand the value of a piece of scientific work, however they are limited in that they do not provide information about what specific part of the reference paper the citing paper is referring to. This qualitative information is very important, for example, in the context of current community-based scientific summarization activities. In this paper, and relying on an annotated dataset of co-citation sentences, we carry out a number of experiments aimed at, given a citation sentence, automatically identify a part of a reference paper being cited. Additionally our algorithm predicts the specific reason why such reference sentence has been cited out of five possible reasons., This work is (partly) supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and by the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Experiments in detection of implicit citations

  • AbuRa'ed, Ahmed Ghassan Tawfiq
  • Chiruzzo, Luis
  • Saggion, Horacio
Comunicació presentada al WOSP 2018: 7th International Workshop on Mining Scientific Publications, celebrat el 7 de maig de 2018 a Miyazaki, Japó., The identification of explicit and implicit citations to a given reference paper is important for numerous scientific text mining activities such as citation purpose identification, scientific opinion mining, and scientific summarization. This paper presents experiments on the identification of implicit citations in scientific papers. As in previous work, and relying on an annotated dataset of explicit and implicit citation sentences, we cast the problem as classification, evaluating several machine learning algorithms trained on a set of task-motivated features. We compare our work with the state of the art on the annotated dataset obtaining improved performance. We also annotate a new dataset which we make publicly available to validate our approach. The results on the new dataset confirm our set of features outperforms previously published research., This work is (partly) supported by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and by the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Multi-task emoji learning

  • Barbieri, Francesco
  • Marujo, Luís
  • Karuturi, Pradeep
  • Brendel, William
Comunicació presentada a la 12th International AAAI Conference on Web and Social Media (ICWSM 2018) celebrada a Stanford (EEUU) el 25 de juny de 2018., Emojis are very common in social media and understanding their underlying semantics is of great interest from a Natural Language Processing point of view. In this work, we investigate emoji prediction in short text messages using a multi-task pipeline that simultaneously predicts emojis, their categories and sub-categories. The categories are either manually predefined in the unicode standard or automatically obtained by clustering over word embeddings. We show that using this categorical information adds meaningful information, thus improving the performance of emoji prediction task. We systematically analyze the performance of the emoji prediction task by varying the number of training samples and also do a qualitative analysis by using attention weights from the prediction task., This work was done when Francesco B. interned at Snap Inc. Francesco B. acknowledge support also from the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE) and the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Exploring emoji usage and prediction through a temporal variation lens

  • Barbieri, Francesco
  • Marujo, Luís
  • Karuturi, Pradeep
  • Brendel, William
  • Saggion, Horacio
Comunicació presentada a l'International Workshop on Emoji Understanding and Applications in Social Media (Emoji) celebrat el 25 de juny de 2018) a Stanford, Estats Units., The frequent use of Emojis on social media platforms has created a new form of multimodal social interaction. Developing methods for the study and representation of emoji semantics helps to improve future multimodal communication systems. In this paper we explore the usage and semantics of emojis over time. We compare emoji embeddings trained on a corpus of different seasons and show that some emojis are used differently depending on the time of the year. Moreover, we propose a method to take into account the time information for emoji prediction systems, outperforming state-of-the-art systems. We show that, using the time information, the accuracy of some emojis can be significantly improved., Part of this work was done when Francesco B. interned at Snap Inc. Francesco B. and Horacio S. acknowledge support from the TUNER project (TIN2015-65308- C5-5-R, MINECO/FEDER, UE) and the Maria de Maeztu Units of Excellence Programme (MDM-2015- 0502).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Improving the accessibility of biomedical texts by semantic enrichment and definition expansion

  • Accuosto, Pablo
  • Saggion, Horacio
Comunicació presentada a: XXXIV Congreso Internacional de la Sociedad Española para el Procesamiento del Lenguaje Natural, celebrat del 19 al 21 de setembre de 2018 a Sevilla., We present work aimed at facilitating the comprehensibility of health-related English-Spanish parallel texts by means of the semantic annotation of biomedical concepts and the automatic expansion of their definitions. In order to overcome the limitations posed by the scarcity of resources available for Spanish, we propose to exploit existing tools targeted at English and then transfer the produced annotations. The evaluations performed show the feasibility of this approach. An enriched set of texts is made available, which can be retrieved, visualized and downloaded through a web interface., Este trabajo busca facilitar la comprensión de textos médicos en un corpus paralelo inglés-español mediante la anotación semántica de conceptos y la expansión automática de definiciones. Considerando la limitación de recursos disponibles para el español, proponemos explotar herramientas dirigidas al inglés para obtener anotaciones que luego se transfieren a los textos en español. Las evaluaciones realizadas muestran la viabilidad de este enfoque. Se hace público un conjunto de textos enriquecidos que se pueden recuperar, visualizar y descargar mediante una interfaz web.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Towards the understanding of gaming audiences by modeling Twitch emotes

  • Barbieri, Francesco
  • Espinosa-Anke, Luis
  • Ballesteros, Miguel
  • Soler Company, Juan
  • Saggion, Horacio
Comunicació presentada al Third Workshop on Noisy User-generated Text (W-NUT 2017), celebrat el dia 7 de setembre de 2017 a Copenhaguen, Dinamarca., Videogame streaming platforms have become a paramount example of noisy usergenerated text. These are websites where gaming is broadcasted, and allows interaction with viewers via integrated chatrooms. Probably the best known platform of this kind is Twitch, which has more than 100 million monthly viewers. Despite these numbers, and unlike other platforms featuring short messages (e.g. Twitter), Twitch has not received much attention from the Natural Language Processing community. In this paper we aim at bridging this gap by proposing two important tasks specific to the Twitch platform, namely (1) Emote prediction; and (2) Trolling detection. In our experiments, we evaluate three models: a BOW baseline, a logistic supervised classifiers based on word embeddings, and a bidirectional long short-term memory recurrent neural network (LSTM). Our results show that the LSTM model outperforms the other two models, where explicit features with proven effectiveness for similar tasks were encoded., Francesco, Luis and Horacio acknowledge support from the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE) and the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Spanish morphological generation with wide-coverage lexicons and decision trees

  • Ferrés, Daniel
  • AbuRa'ed, Ahmed Ghassan Tawfiq
  • Saggion, Horacio
Morphological Generation is the task of producing the appropiate in- flected form of a lemma in a given textual context and according to some morphological features. This paper describes and evaluates wide-coverage morphological lexicons and a Decision Tree algorithm that perform Morphological Generation in Spanish at state-of-the art level. The Freeling, Leffe and Apertium Spanish lexicons, the J48 Decision Tree algorithm and the combination of J48 with Freeling and Leffe lexicons have been evaluated with the following datasets for Spanish: i) CoNLL2009 Shared Task dataset, ii) Durrett and DeNero dataset of Spanish Verbs (DDN), and iii) SIGMORPHON 2016 Shared Task (task-1) dataset. The results show that: i) the Freeling and Leffe lexicons achieve high coverage and precision over the DDN and SIGMORPHON 2016 datasets, ii) the J48 algorithm achieves state-of-the-art results in all of the three datasets, and iii) the combination of Freeling, Leffe and the J48 algorithm outperformed the results of our other approaches in the three evaluation datasets, improved slightly the results of the CoNLL2009 and SIGMORPHON 2016 reported in the state-of-the-art literature, and achieved results comparable to the ones reported in the state-of-the-art literature on the DDN dataset evaluation., This work was partly funded by the ABLETO-INCLUDE project (European Commission CIP Grant No. 621055), the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE), and the Spanish MINECO Ministry (MDM-2015-0502).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Information extraction for knowledge base construction in the music domain

  • Oramas, Sergio
  • Espinosa-Anke, Luis
  • Sordo, Mohamed
  • Saggion, Horacio
  • Serra, Xavier
The rate at which information about music is being created and shared on the web is growing exponentially. However, the challenge of making sense of all this data remains an open problem. In this paper, we present and evaluate an Information Extraction pipeline aimed at the construction of a Music Knowledge Base. Our approach starts off by collecting thousands of stories about songs from the songfacts.com website. Then, we combine a state-of-the-art Entity Linking tool and a linguistically motivated rule-based algorithm to extract semantic relations between entity pairs. Next, relations with similar semantics are grouped into clusters by exploiting syntactic dependencies. These relations are ranked thanks to a novel confidence measure based on statistical and linguistic evidence. Evaluation is carried out intrinsically, by assessing each component of the pipeline, as well as in an extrinsic task, in which we evaluate the contribution of natural language explanations in music recommendation. We demonstrate that our method is able to discover novel facts with high precision, which are missing in current generic as well as music-specific knowledge repositories., This work is partially funded by the Spanish Ministry of Economy and Competitiveness under the María de Maeztu Units of Excellence Programme (MDM-2015-0502), and under the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Supervised distributional hypernym discovery via domain adaptation

  • Espinosa-Anke, Luis
  • Camacho-Collados, Jose
  • Delli Bovi, Claudio
  • Saggion, Horacio
Comunicació presentada a la Conference on Empirical Methods in Natural Language Processing celebrada els dies 1 a 5 de novembre de 2016 a Austin, Texas., Lexical taxonomies are graph-like hierarchical structures that provide a formal representation of knowledge. Most knowledge graphs to date rely on is-a (hypernymic) relations as the backbone of their semantic structure. In this paper, we propose a supervised distributional framework for hypernym discovery which operates at the sense level, enabling large-scale automatic acquisition of disambiguated taxonomies. By exploiting semantic regularities between hyponyms and hypernyms in embeddings spaces, and integrating a domain clustering algorithm, our model becomes sensitive to the target data. We evaluate several configurations of our approach, training with information derived from a manually created knowledge base, along with hypernymic relations obtained from Open Information Extraction systems. The integration of both sources of knowledge yields the best overall results according to both automatic and manual evaluation on ten different domains., This work is partially funded by the Spanish Ministry of Economy and Competitiveness under the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502) and under the TUNER project (TIN2015-65308-C5-5-R, MINECO/FEDER, UE). The authors also acknowledge support from Dr. Inventor (FP7-ICT-2013.8.1611383). José CamachoCollados is supported by a Google Doctoral Fellowship in Natural Language Processing.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Arabic medical entity tagging using distant learning in a multilingual framework

  • Cotik, Viviana
  • Rodríguez, Horacio
  • Vivaldi, Jorge
A semantic tagger aiming to detect relevant entities in Arabic medical documents and tagging them with their appropriate semantic class is presented. The system takes profit of a Multilingual Framework covering four languages (Arabic, English, French, and Spanish), in a way that resources available for each language can be used to improve the results of the others, this is specially important for less resourced languages as Arabic. The approach has been evaluated against Wikipedia pages of the four languages belonging to the medical domain. The core of the system is the definition of a base tagset consisting of the three most represented classes in SNOMED-CT taxonomy and the learning of a binary classifier for each semantic category in the tagset and each language, using a distant learning approach over three widely used knowledge resources, namely Wikipedia, Dbpedia, and SNOMED-CT., This work was partially supported by the TUNER project (Spanish Ministerio de Economía y Competitividad, TIN2015-65308-C5-5-R) and the GRAPH-MED project (Spanish Ministerio de Economía y Competitividad, TIN2016-77820-C3-3-R).