RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación
Artículo científico (JournalArticle)
In Search of Evidence for Model-Driven Development Claims: An Experiment on Quality, Effort, Productivity and Satisfaction
Context: Model-Driven Development (MDD) is a paradigm that prescribes building conceptual models
that abstractly represent the system and generating code from these models through transformation
rules. The literature is rife with claims about the benefits of MDD, but they are hardly supported by
evidences.
Objective: This experimental investigation aims to verify some of the most cited benefits of MDD.
Method: We run an experiment on a small set of classes using student subjects to compare the quality,
effort, productivity and satisfaction of traditional development and MDD. The experiment participants
built two web applications from scratch, one where the developers implement the code by hand and
another using an industrial MDD tool that automatically generates the code from a conceptual model.
Results: Outcomes show that there are no significant differences between both methods with regard to
effort, productivity and satisfaction, although quality in MDD is more robust to small variations in
problem complexity. We discuss possible explanations for these results.
Conclusions: For small systems and less programming-experienced subjects, MDD does not always yield
better results than a traditional method, even regarding effort and productivity. This contradicts some
previous statements about MDD advantages. The benefits of developing a system with MDD appear to
depend on certain characteristics of the development context.
2015 Elsevier B.V. All rights reserved., This work was developed with the support of the Spanish Ministry of Science and Innovation project SMART ADAPT (TIN2013-42981-P), TIN2011-23216 and was co-financed by ERDF. It also has the support of Generalitat Valenciana-funded IDEO project (PROMETEOII/2014/039) and UV (UV-INV-PRECOMP13-115032).