Pasar al contenido principal

ANALYSIS AND VALIDATION OF SOFTWARE AND WEB RESOURCES

PID2019-104735RB-C42

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Año convocatoria 2019
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSIDAD DE CASTILLA-LA MANCHA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 5
Encontrada(s) 1 página(s)

Docta Complutense
Publicación Artículo científico (JournalArticle)

Metamorphic testing of OpenStreetMap

  • Almendros-Jiménez, Jesús M.
  • Becerra-Terón, Antonio
  • García Merayo, María De Las Mercedes
  • Núñez García, Manuel
OpenStreetMap represents a collaborative effort of many different and unrelated users to create a free map of the world. Although contributors follow some general guidelines, unsupervised additions are prone to include erroneous information. Unfortunately, it is impossible to automatically detect most of these issues because there does not exist an oracle to evaluate whether the information is correct or not. Metamorphic testing has shown to be very useful in assessing the correctness of very heterogeneous artifacts when oracles are not available. The main goal of our work is to provide a (fully implemented) framework, based on metamorphic testing, that will support the analysis of the information provided in OpenStreetMap with the goal of detecting faulty information. We defined a general metamorphic testing framework to deal with OpenStreetMap. We identified a set of good metamorphic relations. In order to have as much automation as possible, we paid special attention to the automatic selection of follow-up inputs because they are fundamental to diminish manual testing. In order to assess the usefulness of our framework, we applied it to analyze maps of four cities in different continents. The rationale is that we would be dealing with different problems created by different contributors. We obtained experimental evidence that shows the potential value of our framework. The application of our framework to the analysis of the chosen cities revealed errors in all of them and in all the considered categories. The experiments showed the usefulness of our framework to identify potential issues in the information appearing in OpenStreetMap. Although our metamorphic relations are very helpful, future users of the framework might identify other relations to deal with specific situations not covered by our relations. Since we provide a general pattern to define metamorphic relations, it is relatively easy to extend the existing framework. In particular, since all our metamorphic relations are implemented and the code is freely available, users have a pattern to implement new relations.
RUA. Repositorio Institucional de la Universidad de Alicante
Publicación Otros (Other)

Un enfoque semántico en la selección de características basadas en léxico para la detección de emociones, A semantic approach in the lexicon-based feature selection for emotion detection

  • González-Guerra, Harold
  • Simón-Cuevas, Alfredo
  • Perea Ortega, José Manuel
  • Olivas, José Ángel
La detección de emociones es una tarea del análisis de sentimientos que trata la extracción y el análisis de las emociones en textos. Reconocer emociones implícitas es uno de los principales desafíos en enfoques basados en palabras claves o lexicones. Este trabajo presenta un enfoque híbrido de detección de emociones, que combina la selección de características relevantes de emoción basada en un lexicón, con un enfoque clásico de aprendizaje para determinar la emoción. El proceso de selección de características propuesto se centra en capturar el significado emocional del texto mediante el cálculo de la relación semántica entre su contenido y el vocabulario del lexicón, con el objetivo de incrementar el reconocimiento de emociones implícitas. La solución propuesta fue evaluada en la clasificación de emociones en tweets en español incluidos en el corpus AIT, con diferentes alternativas para computar la relación semántica y varios algoritmos de clasificación, obteniéndose resultados muy prometedores.
Docta Complutense
Publicación Artículo científico (JournalArticle)

Combining Metamorphic Testing and Machine Learning to Enhance OpenStreetMap

  • Méndez Hurtado, Manuel
  • Becerra-Terón, Antonio
  • Almendros-Jiménez, Jesús M.
  • García Merayo, María De Las Mercedes
  • Núñez García, Manuel
Metamorphic testing (MT) is a useful tool to test systems where an oracle is not available. MT relies on the definition of metamorphic relations (MR), that is, certain properties that relate a set of inputs and the set of outputs produced by the system under test (SUT) as response to these inputs. Usually, a violation of an MR implies that the SUT is faulty. However, some work on MT accepts, for certain SUTs, that the violation of an MR almost always is a symptom of an error but assumes the potential existence of false positives. This is the case, for instance, of our recent work where we applied MT to improve OpenStreetMap (OSM). Our MRs were able to uncover a large amount of errors in all the analyzed maps but we suffered the presence of a nonnegligible number of false positives. Therefore, an expert had to manually check the suspicious elements identified by our MRs. If we analyze large maps, then this manual task is unfeasible. In this article we solve the main limitation of our previous approach: we accurately and automatically discard false positives. Our new framework combines MT, along the same lines of our previous work, and machine learning. Specifically, we provide three models, one for each MR, based on the random forest model. The models were extensively trained with real data obtained from the application of MRs to maps of cities located in different continents. In order to evaluate the usefulness of our models, we tested them using different cities, in countries that were not considered in the training set. The results were very good: accuracy of the models is never lower than 0.90, it is usually much higher and in many situations reaches 1.0. The computation of the F1-scores yielded similar results.
Docta Complutense
Publicación Artículo científico (JournalArticle)

Implementing WordNet Measures of Lexical Semantic Similarity in a Fuzzy Logic Programming System

  • Pascual, Julián_Iranzo
  • Sáenz Pérez, Fernando
This paper introduces techniques to integrate WordNet into a Fuzzy Logic Programming system. Since WordNet relates words but does not give graded information on the relation between them, we have implemented standard similarity measures and new directives allowing the proximity equations linking two words to be generated with an approximation degree. Proximity equations are the key syntactic structures which, in addition to a weak unification algorithm, make a flexible query-answering process possible in this kind of programming language. This addition widens the scope of Fuzzy Logic Programming, allowing certain forms of lexical reasoning, and reinforcing Natural Language Processing applications.
Docta Complutense
Publicación Artículo científico (JournalArticle)

Using Metamorphic Testing to Improve the Quality of Tags in OpenStreetMap

  • Almendros-Jimenez, Jesus M.
  • Becerra-Teron, Antonio
  • García Merayo, María De Las Mercedes
  • Núñez García, Manuel
We present a metamorphic testing approach to validate the information included in OpenStreetMap, a collaborative effort to produce a free map of the world. We focus on the quality of the tags storing the information about the elements of the map. We identified metamorphic relations with the potential to detect different types of tagging errors. In particular, we carefully designed mechanisms to automatically generate follow-up inputs , a fundamental component in the successful application of a metamorphic testing approach. The intrinsic nature of automatically analysing tags implies that we will detect real errors but some false positives as well. In order to obtain a good trade-off between real errors and false positives, we introduce thresholds . Our MRs will raise an error associated with a certain value if, depending on the nature of the MR, we have a certain number of elements (not) fulfilling a given condition. In order to evaluate the goodness and versatility of our framework, we chose four cities in different continents with the goal of analysing very heterogeneous contributors adding information in different languages. The application of this framework to the analysis of the chosen cities revealed errors in all of them and in all the considered categories. In addition, around 66% of the errors found by our MRs in the analysed areas have not been previously reported by Osmose , the de facto standard OSM error checker.