Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 7
Encontrada(s) 1 página(s)

RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

Delta GUI change detection using inferred models

  • Pastor-Ricós, Fernando|||0000-0002-5790-193X
  • Marín, Beatriz|||0000-0001-8025-0023
  • Vos, Tanja Ernestina|||0000-0002-6003-9113
  • Neeft, Rick
  • Aho, Pekka
[EN] Recent software development methodologies emphasize iterative and incremental evolution to align with stakeholders' needs. This perpetual and rapid software evolution demands ongoing research into verification practices and technologies that ensure swift responsiveness and effective management of software delta increments. Strategies such as code review have been widely adopted for development and verification, ensuring readability and consistency in the delta increments of software projects. However, the integration of techniques to detect and visually report delta changes within the Graphical User Interface (GUI) software applications remains an underutilized process. In this paper, we set out to achieve two objectives. First, we aim to conduct a comprehensive review of existing studies concerning GUI change detection in desktop, web, and mobile applications to recognize common practices. Second, we introduce a novel change detection tool capable of highlighting delta GUI changes for this diverse range of applications. To accomplish our first objective, we performed a systematic mapping of the literature using the Scopus database. To address the second objective, we designed and developed a GUI change detection tool. This tool simultaneously transits and compares state models inferred by a scriptless testing tool, enabling the detection and highlighting of GUI changes to detect the widgets or functionalities that have been added, removed, or modified. Our study reveals the existence of a multitude of techniques for change detection in specific GUI systems with different objectives. However, there is no widely adopted technique suitable for the diverse range of existing desktop, web, and mobile applications. Our tool and findings demonstrate the effectiveness of using inferred state models to highlight between 8 and 20 GUI changes in software delta increments containing a large number of changes over months and between 4 and 6 GUI changes in delta increments of small iterations performed over multiple weeks. Moreover, some of these changes were recognized by the software developers as GUI failures that required a fix. Finally, we expose the motivation for using this technique to help developers and testers analyze GUI changes to validate delta increments and detect potential GUI failures, thereby fostering knowledge dissemination and paving the way to standard practices., This research has been funded by the project European Innovation Alliance for Testing Education (ENACTEST) , ERASMUS+ number 101055874, 2022-2025.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

The Impact of Model Simulation on Semantic Conceptual Model Quality for Novice Modelers

  • Cammaerts, Felix
  • Snoeck, Monique
  • Marín, Beatriz|||0000-0001-8025-0023
[EN] Purpose:Conceptual modeling is crucial for information systems development, yet novice modelers often struggle with ensuring a high semantic quality, leading to flawed system designs. This study investigates the impact of Feedback-enabled Interactive Rapid Prototyping (FIRP) simulation on novice modelers' ability to identify and correct semantic errors in conceptual models.Methods:We analyzed data from 39 master-level students who used the MERODE prototyper in a FIRP simulation environment. We examined the relationship between testing effort, measured by event invocations and model coverage, and the likelihood of students identifying seeded semantic mistakes and providing correct solutions, using logistic regression.Results:Logistic regression analyses revealed a statistically significant positive correlation between testing effort and the detection of specific behavioral constraint violations that resulted in deadlocks. However, the relationship was not consistent across all mistake types.Conclusion:FIRP simulation is particularly effective in helping novice modelers identify behavioral constraint violations that disrupt system workflows, i.e., those leading to deadlocks. Active model exploration through FIRP enhances error detection, highlighting its potential as a valuable tool for conceptual modeling education. However, the effectiveness varies with the type of semantic error, suggesting the need for tailored simulation strategies., This work was funded by the ENACTEST - European innovation alliance for testing education (ERASMUS+ Project number 101055874, 2022-2025).
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

A model-driven approach to adopt good practices for agile process configuration and certification

  • Giachetti-Herrera, Giovanni Andrés
  • Marín, Beatriz|||0000-0001-8025-0023
  • de la Vara, José Luis
[EN] Context: The agile development paradigm has been extensively adopted in the industry. This adoption is highly dependent on the knowledge and good practices applied by most experienced practitioners in organizations. Hence, it would be valuable to count on appropriate support to preserve and systematically use this expert knowledge in configuring agile development processes aligned with organizational standards. Objective: This paper presents a model-driven approach for representing and selecting good practices to configure agile practices in development processes aligned with organizational development practices and quality standards. Method: We define a conceptual approach for configuring agile development processes that fulfills enterprise good practices and external quality standards. This approach was implemented in a tool suite and applied to an industrial development scenario related to ISO 9001 certification. Results: The approach was implemented in a model-driven tool that provides automatic support for identifying good practices when configuring agile development processes. The tool also verifies consistency with development methods and quality standards, such as ISO 9001. Conclusions: The results obtained from the industrial application indicate that practitioners can reuse expert knowledge to configure agile development processes aligned with quality certifications. Moreover, the approach also facilitates the tailoring of agile practices into concrete development processes that take advantage of organizational good practices., The work leading to this paper received funding from the iRel4.0 (H2020-ECSEL grant agreement no 876659; Spain's MICINN ref. PCI2020-112240), VALU3S (H2020-ECSEL grant agreement no 876852; Spain's MICINN ref. PCI2020-112001); Treasure (JCCM ref. SBPLY/19/180501/000270; EC's European Regional Development Fund) projects; The Ramon y Cajal Program (Spain's MICINN ref. RYC-2017-22836; EC's European Social Fund); ENACTEST project (ERASMUS+ Project Number 101055874-ENACTEST-ERASMUS-EDU-2021-PI-ALL-INNO); The Valencian Innovation Agency and Innovation through the OGMIOS project (INNEST/2021/57); The Generalitat Valenciana through the CoMoDiD project (CIPROM/2021/023); The Spanish State Research Agency through the DELFOS (PDC2021-121243-I00) and SREC (PID2021-123824OB-I00) projects; MICIN/AEI/10.13039/501 100011033; and co-financed with ERDF and the European Union Next Generation EU/PRTR; SIAM (Chile's CORFO-INNOVA ref. 16COTE-60218), and from NISUM Technologies Chile.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

Teachers&apos, Perspective on Software Testing Education

  • Fasolino, Anna Rita
  • Mendes, Alexandra
  • Paiva, Ana C. R.
  • Cammaerts, Felix
  • Snoeck, Monique
  • Saadatmand, Mehrdad
  • Tramontana, Porfirio
  • Vos, Tanja Ernestina|||0000-0002-6003-9113
  • Marín, Beatriz|||0000-0001-8025-0023
[EN] Context. Software testing is a critical aspect of the software development lifecycle, yet it remains underrepresented in academic curricula. Despite advances in pedagogical practices and increased attention from the academic community, challenges persist in effectively teaching software testing. Understanding these challenges from the teachers' perspective is crucial to aligning education with industry needs. Objective. To analyze the characteristics, practices, tools, and challenges of software testing courses in higher education, from the perspective of educators, and to assess the integration of recent pedagogical approaches in software testing education. Method. A structured survey consisting of 52 questions was distributed to 143 software testing educators across Western European universities, resulting in 49 valid responses. The survey explored topics taught, course organization, teaching practices, tools and materials used, gamification approaches, and teacher satisfaction. Results. The survey revealed significant variability in course content, structure, and teaching methods. Most dedicated software testing courses are offered at the master's level and are elective, whereas testing is introduced earlier in less specialized (NST) courses. There is low adoption of formal guidelines (e.g., ACM, SWEBOK), limited integration of non-functional testing types, and a high diversity in textbooks and tools used. While modern practices like Test-Driven Development and automated assessment are increasingly adopted, gamification and active learning approaches remain underutilized. Teachers expressed a need for improved and more consistent teaching materials. Conclusion. The study highlights a mismatch between academic practices and industry expectations in software testing education. Greater integration of standardized curricula, broader adoption of modern teaching tools, and increased support for teachers through high-quality, adaptable teaching materials are needed to enhance the effectiveness of software testing education., This work has been funded by ENACTEST (European iNnovation AllianCe for TESTing education) , ERASMUS+ Project number 101055874, 2022-2025.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

Behavior Driven Development for 3D games

  • Pastor-Ricós, Fernando|||0000-0002-5790-193X
  • Marín, Beatriz|||0000-0001-8025-0023
  • Vos, Tanja Ernestina|||0000-0002-6003-9113
  • I.S.W.B. PRASETYA
  • Davidson, Joseph
  • Hovorka, Karel
[EN] Computer 3D games are complex software environments that require novel testing processes to ensure high-quality standards. The Intelligent Verification/Validation for Extended Reality Based Systems (iv4XR) framework addresses this need by enabling the implementation of autonomous agents to automate game testing scenarios. This framework facilitates the automation of regression test cases for complex 3D games like Space Engineers. Nevertheless, the technical expertise required to define test scripts using iv4XR can constrain seamless collaboration between developers and testers. This paper reports how integrating a Behavior-Driven Development (BDD) approach with the iv4XR framework allows the industrial company behind Space Engineers to automate regression testing. The success of this industrial collaboration has inspired the iv4XR team to integrate the BDD approach to improve the automation of play-testing for the experimental 3D game LabRecruits. Furthermore, the iv4XR framework has been extended with tactical programming to enable the automation of long-play test scenarios in Space Engineers. These results underscore the versatility of the iv4XR framework in supporting diverse testing approaches while showcasing how BDD empowers users to create, manage, and execute automated game tests using comprehensive and human-readable statements., This work has been partially funded by : H2020 EU iv4XR, Spain grant nr. 856716 and ENACTEST ERASMUS+, The Netherlands grant nr. 101055874.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

Towards understanding students&apos, sensemaking of test case design

  • Doorn, Niels
  • Vos, Tanja Ernestina|||0000-0002-6003-9113
  • Marín, Beatriz|||0000-0001-8025-0023
[EN] Context: Software testing is the most used technique for quality assurance in industry. However, in computer science education software testing is still treated as a second-class citizen and students are unable to test their software well enough. One reason for this is that teaching the subject of software testing is difficult as it is a complex intellectual activity for which students need to allocate multiple cognitive resources at the same time. A myriad of primary and secondary studies have tried to solve this problem in education, however still with very limited results.Objective: Before we can design interventions to improve our pedagogical approaches, we need to gain more in-depth understanding and recognition of sensemaking as it is happening when students design test cases.Method: An initial exploratory study identified four different sensemaking approaches used by students while creating test models. In this paper we present a follow-up study with 50 students from a large university in Spain. The used methodology was based on the previous study with the improvements that originated from its evaluation. We asked the participants to create a test model based on a description of a test problem using a specialized web-based tool for modeling test cases. We measured how well these models fit the test problem, the sensemaking process that students went through when creating the models, and the students' perception of the modeling task. The participants received no compensation for their efforts, and we scheduled the experiment during a regular class. Apart from the created models and their metadata, we also collected recordings of the students' computer screens made during the experiment and used a questionnaire to study their perspectives on the assignment. All the collected textual, graphical, and video data was analyzed using an iterative inductive analysis process to allow new information about the different sensemaking approaches to emerge.Results: We gained better insights into the sensemaking processes of students while modeling test cases for a problem. The results enabled us to refine our previous findings, and we identified new sensemaking approaches.Conclusions: Based on these results, we can further investigate ways to influence the sense-making process in education, the possible misconceptions that have a negative influence on it, and the desired mental model we want our students to have to design test cases., We like to thank Silvio Cacace for his input on the assignment, and for the use of the TestCompass tool, Erik Barendsen for his advice and feedback on this research and of course the participating students from the bachelor GTDM at the Universitat Politecnica de Valencia. The work leading to this paper has received funding from the European Union by the ENACTEST project (101055874) and the Erasmus + project QPeD under contract number 2020-1-NL01-KA203-064626.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publication Artículo científico (JournalArticle)

Identifying testing behaviour patterns in conceptual modelling education

  • Cammaerts, Felix
  • Tramontana, Porfirio
  • Flores, Nuno
  • Doorn, Niels
  • Fasolino, Anna Rita
  • Paiva, Ana C. R.
  • Snoeck, Monique
  • Vos, Tanja Ernestina|||0000-0002-6003-9113
  • Marín, Beatriz|||0000-0001-8025-0023
[EN] Context: Software testing is an often used method to ensure software quality, with developers spending a significant amount of time on it. However, software testing education is underrepresented in curricula, particularly with regard to Conceptual Modelling (CM), where model-level validation is important. As a consequence, graduate students are insufficiently prepared for industry-level testing. Objective: We want to understand students' behavioural patterns during model testing and their relationship to testing effectiveness. Methods: We use process mining to analyse 554 interaction logs from students using a conceptual model simulation tool. Results: We identify three behavioural profiles: the coverage chaser (using feedback iteratively), the problem solver (balancing feedback with requirements focus), and the disconnected tester (avoiding feedback-driven iteration). High-coverage students tended to integrate feedback into test loops; low-coverage students did not. Notably, high and average-coverage students achieved similar, generally high grades, a pattern consistent with a performance plateau where systematic testing is associated with sufficient educational performance without requiring maximum coverage. Conclusions: Our findings suggest that systematic use of coverage feedback is associated with more effective testing outcomes, suggesting that coverage-feedback use may be a promising focus for future instructional support in CM education., This work has been funded by ENACTEST-European innovation alliance for testing education-ERASMUS+ Project no. 101055874, 2022-2025.