Skip to main content

METODOS DE LA LINGUISTICA COMPUTACIONAL PARA LA LEGIBILIDAD Y SIMPLIFICACION AUTOMATICA DEL DISCURSO MEDICO

PID2020-116001RA-C33

•
Funding agency name Agencia Estatal de Investigación
Funding agency acronym AEI
Program Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Call Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Call year 2020
State Plan 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Beneficiary centre AGENCIA ESTATAL CONSEJO SUPERIOR DE INVESTIGACIONES CIENTIFICAS (CSIC)

Resultados relacionados

Resultados totales (Incluyendo duplicados): 3
Encontrada(s) 1 página(s)

DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Otros (Other)

Replace, Paraphrase or Fine-tune? Evaluating Automatic Simplification for Medical Texts in Spanish

  • Campillos-Llanos, Leonardo
  • Terroba Reinares, Ana Rosa
  • Bartolomé, Rocío
  • Valverde, Ana
  • González, Cristina
  • Capllonch Carrión, Adrián
  • Heras, Jónathan
Este capítulo está sujeto a una licencia CC BY-NC 4.0, Patients can not always completely understand medical documents given the myriad of technical terms they contain. Automatic text simplification techniques can help, but they must guarantee that the content is transmitted rigorously and not creating wrong information. In this work, we tested: 1) lexicon-based simplification approaches, using a Spanish lexicon of technical and laymen terms collected for this task (SimpMedLexSp); 2) deep-learning (DL) based methods, with BART-based and prompt-learning-based models; and 3) a combination of both techniques. As a test set, we used 5000 parallel (technical and laymen) sentence pairs: 3800 manually aligned sentences from the CLARA-MeD corpus; and 1200 sentences from clinical trials simplified by linguists. We conducted a quantitative evaluation with standard measures (BLEU, ROUGE and SARI) and a human evaluation, in which eleven subjects scored the simplification output of several methods. In our experiments, the lexicon improved the quantitative results when combined with the DL models. The simplified sentences using only the lexicon were assessed with the highest scores regarding semantic adequacy; however, their fluency needs to be improved. The prompt-method had similar ratings in this aspect and in simplification. We make available the models and the data to reproduce our results., This work was done in project CLARAMED (PID2020-116001RA-C33) funded by MCIN/AEI/10.13039/501100011033/, in call: "Proyectos I+D+i Retos Investigación"; and also partially supported by Grant PID2020-115225RBI00 funded by MCIN/AEI/10.13039/501100011033., Peer reviewed
DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication Otros (Other)

CLARA-MeD Tool – A System to Help Patients Understand Clinical Trial Announcements and Consent Forms in Spanish

  • Campillos-Llanos, Leonardo
  • Ortega Riba, Federico
  • Terroba Reinares, Ana Rosa
  • Valverde Mateos, Ana
  • Capllonch Carrión, Adrián
We present an NLP web-based tool to help users understand consent forms (CFs) and clinical trial announcements (CTAs) in Spanish. For complex word identification, we collected: 1) a lexicon of technical terms and simplified synonyms (14 465 entries); and 2) a glossary (70 547 terms) with explanations from sources such as UMLS, the NCI dictionary, Orphadata or the FDA. For development, we extracted entities from 60 CTAs, 60 CFs and 60 patient information documents (PIDs). To prepare definitions for new terms, we used ChatGPT and experts validated them (28.99% needed to be fixed). We tested the system on 15 new CTAs, 15 CFs, and 15 PIDs, and we achieved an average F1 score of 82.91% (strict match) and of 94.65% (relaxed). The tool is available at: http://claramed.csic.es/demo., CLARA-MeD project (PID2020-116001RA-C33) funded by AEI/MICIU/10.13039/50 1100011033/, Peer reviewed
RUA. Repositorio Institucional de la Universidad de Alicante
Publication Otros (Other)

Building a comparable corpus and a benchmark for Spanish medical text simplification, Construcción de un corpus comparable y un recurso de referencia para la simplificación de textos médicos en español

  • Campillos Llanos, Leonardo
  • Terroba Reinares, Ana R.
  • Zakhir Puig, Sofía
  • Valverde, Ana
  • Capllonch-Carrión, Adrián
We report the collection of the CLARA-MeD comparable corpus, which is made up of 24 298 pairs of professional and simplified texts in the medical domain for the Spanish language (>96M tokens). Texts types range from drug leaflets and summaries of product characteristics (10 211 pairs of texts, >82M words), abstracts of systematic reviews (8138 pairs of texts, >9M words), cancer-related information summaries (201 pairs of texts, >3M tokens) and clinical trials announcements (5748 pairs of texts, 451 690 words). We also report the alignment of professional and simplified sentences, conducted manually by pairs of annotators. A subset of 3800 sentence pairs (149 862 tokens) has been aligned each by 2 experts, with an average inter-annotator agreement kappa score of 0.839 (0.076). The data are available in the community and contributes with a new benchmark to develop and evaluate automatic medical text simplification systems.