RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication
Artículo científico (JournalArticle)
A methodology for synthetic corpus engineering
[EN] This article describes a methodological framework for developing synthetic corpora with
a small language model from a prompt engineering perspective. Instead of the typical
approach in text mining, which prioritises corpus size in model training, this study applies
a corpus linguistics methodology that accounts for corpus domain and distribution considerations to generate diverse and realistic texts. These synthetic corpora were evaluated
through their integration into a text classification system to detect social problems. Therefore, the objective is to demonstrate whether using a theoretically sound methodology
based on corpus linguistics can improve the performance of systems trained with such
synthetic corpora. The study concludes that factors such as stratification and proportionality in the sampling method have even more impact than corpus size., This publication is part of the R&D&I projects PID2020-112827GB-I00 and PID2023-147137NB-I00, funded by MICIU/AEI/10.13039/501100011033 and by ERDF, EU, and partially supported by the research project CIPROM/2023/29, funded by Direcció General de Ciència i Investigació Generalitat Valenciana (Spain).
Project:
Agencia Estatal de Investigación / Plan Estatal de Investigación Científica y Técnica y de Innovación 2017-2020 PID2020-112827GB-I00
,
Agencia Estatal de Investigación / Plan Estatal de Investigación Científica y Técnica y de Innovación 2021-2023 PID2023-147137NB-I00
,
Generalitat Valenciana CIPROM/2023/29