DIGITAL.CSIC. Repositorio Institucional del CSIC
Publication
Otros (Other)
Replace, Paraphrase or Fine-tune? Evaluating Automatic Simplification for Medical Texts in Spanish
Este capítulo está sujeto a una licencia CC BY-NC 4.0, Patients can not always completely understand medical documents given the myriad of technical terms they contain.
Automatic text simplification techniques can help, but they must guarantee that the content is transmitted rigorously
and not creating wrong information. In this work, we tested: 1) lexicon-based simplification approaches, using a
Spanish lexicon of technical and laymen terms collected for this task (SimpMedLexSp); 2) deep-learning (DL) based
methods, with BART-based and prompt-learning-based models; and 3) a combination of both techniques. As a
test set, we used 5000 parallel (technical and laymen) sentence pairs: 3800 manually aligned sentences from the
CLARA-MeD corpus; and 1200 sentences from clinical trials simplified by linguists. We conducted a quantitative
evaluation with standard measures (BLEU, ROUGE and SARI) and a human evaluation, in which eleven subjects
scored the simplification output of several methods. In our experiments, the lexicon improved the quantitative results
when combined with the DL models. The simplified sentences using only the lexicon were assessed with the highest
scores regarding semantic adequacy; however, their fluency needs to be improved. The prompt-method had similar
ratings in this aspect and in simplification. We make available the models and the data to reproduce our results., This work was done in project CLARAMED (PID2020-116001RA-C33) funded by
MCIN/AEI/10.13039/501100011033/, in call:
"Proyectos I+D+i Retos Investigación"; and also
partially supported by Grant PID2020-115225RBI00 funded by MCIN/AEI/10.13039/501100011033., Peer reviewed