Pasar al contenido principal

ANALITICA DEL APRENDIZAJE PARA MEJORAR EL DISEÑO Y LA ORQUESTACION EN ENTORNOS INTELIGENTES DE APRENDIZAJE ESCALABLES Y UBICUOS, ENRIQUECIDOS CON INTERNET DE LAS COSAS

TIN2017-85179-C3-3-R

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos I+D+i Retos de Investigación
Año convocatoria 2017
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSITAT POMPEU FABRA CCT

Resultados relacionados

Resultados totales (Incluyendo duplicados): 52
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Round or rectangular tables for collaborative problem solving? A multimodal learning analytics study

  • Vujovic, Milica
  • Hernández Leo, Davinia
  • Tassani, Simone
  • Spikol, Daniel
The current knowledge of the effects of the physical environment on learners’ behaviour in collaborative problem‐solving tasks is underexplored. This paper aims to critically examine the potential of multimodal learning analytics, using new data sets, in studying how the shapes of shared tables affect the learners’ behaviour when collaborating in terms of patterns of participation and indicators related to physical social interactions. The research presented in this paper investigates this question considering the potential interplay with contextual aspects (level of education) and learning design decisions (group size). Three dependent variables (distance between students, range of movement and level of participation) are tested using quantitative and qualitative analyses of data collected using a motion capture system and video recordings. Results show that the use of round tables (vs rectangular tables) leads to higher levels of on‐task participation in the case of elementary school students. For university students, different table shapes seem to have a limited impact on their levels of participation in collaborative problem solving. The analysis shows significant differences regarding the relationship between group size and the distance between students, but there is no substantial evidence that group size affects the level of participation. The findings support previous research highlighting the importance of studying the role of the physical environment as an element of learning design and the potential of multimodal learning analytics in approaching these studies., This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No. 713673. M. Vujovic has received financial support through the “La Caixa” INPhINIT Fellowship Grant for Doctoral studies at Spanish Research Centres of Excellence, “La Caixa” Banking Foundation, Barcelona, Spain. D. Hernández-Leo acknowledges the financial support from ICREA under the ICREA Academia programme. This work has been partially supported by the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM2015-0502, TIN2017-85179-C3-3-R.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Deconstructing orchestration load: comparing teacher support through mirroring and guiding

  • Amarasinghe, Ishari
  • Hernández Leo, Davinia
  • Hoppe, H. Ulrich
Under the notion of “CSCL scripts”, different pedagogical models for structuring and supporting collaboration in the classroom have been proposed. We report on a practical experience with scripts based on the Pyramid collaborative learning flow pattern supported by a specific classroom tool and a teacher-facing dashboard that implements mirroring and guiding support. The input data of our analysis stems from recordings of classroom interactions guided by several teachers using the PyramidApp with different levels of teaching support. For the analysis, we introduce a specific coding scheme enabling a quantitative comparison and deeper analysis using epistemic network analysis. The results show that the guiding support enabled teachers to perform more orchestration actions, more targeted interactions and to make more announcements to the class (regarding time, phase transitions, and students’ activity participation) when compared to the mirroring support. Teachers’ actionable differences observed under the mirroring and guiding support directed us to deconstruct the notion of orchestration load into different facets and to discuss how different support provisions correspond to the different facets of orchestration load., TIDE-UPF acknowledges the support by FEDER, the National Research Agency of the Spanish Ministry, TIN2017-85179-C3-3-R, PID2020-112584RB-C33, MDM-2015-0502, and by ICREA under the ICREA Academia programme (D. Hernández-Leo, Serra Hunter).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

EdCrumble, a data-enriched visual authoring design tool for blended learning

  • Albó, Laia
  • Hernández Leo, Davinia
This paper presents an evaluation of edCrumble, a blended learning authoring tool for teachers. The tool visually represents learning designs and integrates data analytics to scaffold teacher design decisions. In addition to assessing the usability of edCrumble using UMUX questionnaire, analyses of participant views on the advantages and disadvantages of the tool in comparison to traditional course planning approaches and participant-elicited factors that can facilitate or hinder adoption of the tool are presented. Three evaluation workshops were held with teachers of different backgrounds, educational stakeholders, and students. Data-gathering instruments included interviews and questionnaires to collect qualitative and quantitative data. Further, design artifacts resulting from the workshops were analysed. The evaluation shows that the tool possesses specific features that facilitate the representation of and support for designing blended learning, uncovers the factors that may promote or inhibit its adoption, exposes its connection with solving actual educational challenges, and reveals the strengths and weaknesses in the tools usability., This work was supported by the Spanish Ministry of Science (TIN2014-53199-C3-3-R and TIN2017-85179-C3-3-R), the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), RecerCaixa (CoT project) and the UPF PlaQUID2012. D.H.L acknowledges the support by ICREA under the ICREA Academia programme. (Corresponding author: Laia Albó).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Supporting awareness in communities of learning design practice

  • Michos, Konstantinos
  • Hernández Leo, Davinia
The field of learning design has extensively studied the use of technology for the authoring of learning activities. However, the social dimension of the learning design process is still underexplored. In this paper, we investigate communities of teachers who used a social learning design platform (ILDE). We seek to understand how community awareness facilitates the learning design activity of teachers in different educational contexts. Following a design-based research methodology, we developed a community awareness dashboard (inILDE) based on the Cultural Historical Activity Theory (CHAT) framework. The dashboard displays the activity of teachers in ILDE, such as their interactions with learning designs, other members, and with supporting learning design tools. Evaluations of the inILDE dashboard were carried out in four educational communities – two secondary schools, a master programme for pre-service teachers, and in a Massive Open Online Course (MOOC) for teachers. The dashboard was perceived to be useful in summarizing the activity of the community and in identifying content and members’ roles. Further, the use of the dashboard increased participants’ interactions such as profile views and teachers showed a willingness to build on the contributions of others. As conclusions of the study, we propose five design principles for supporting awareness in learning design communities, namely community context, practice-related insights, visualizations and representations, tasks and community interests., This work has been partially funded by RecerCaixa (CoT project) and the Spanish Ministry of Economy and Competitiveness under MDM-2015-0502, TIN2014–53199-C3-3-R, TIN2017-85179-C3-3-R.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

El papel de los espacios como facilitadores del aprendizaje colaborativo: Estudio cualitativo en Grados en Ingeniería y Másteres TIC de la UPF

  • Santos Rodríguez, Patrícia
  • Moreno, Verónica
  • Hernández Leo, Davinia
Este artículo presenta los resultados obtenidos en un análisis realizado en estudios de grado y master (ámbitos de ingeniería y TIC) de la UPF enfocado en el papel que juegan los espacios colaborativos de aprendizaje (físicos y virtuales) ofrecidos por la universidad en actividades académicas. El estudio usa una metodología cualitativa para la recogida de datos. Los resultados obtenidos muestran un diagnóstico de la situación actual, incluyendo buenas prácticas que podrían reforzarse en el futuro o aspectos de mejora a considerar en la reformulación de los espacios de aprendizaje., This article presents the results obtained in a study carried out in Studies of Engineering Degrees and ICT Masters at UPF. Its purpose is the study of the role of collaborative learning spaces (physical and virtual) offered by the university in academic activities. The study uses a qualitative methodology for data collection. The results show a diagnosis of the current situation, including best practices that could be strengthened in the future or aspects of improvement to be considered in the reformulation of learning spaces., Este trabajo ha sido parcialmente financiado por el programa UPF PlaClik y el Fondo de Desarrollo Regional de la UE y la Agencia Nacional de Investigación del Ministerio de Ciencia, Innovación y Universidades de España (TIN2017-85179-C3-3-R).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

An actionable orchestration dashboard to enhance collaboration in the classroom

  • Amarasinghe, Ishari
  • Hernández Leo, Davinia
  • Michos, Konstantinos
  • Vujovic, Milica
The orchestration of collaborative learning activities in technology-enhanced classrooms has become a nontrivial endeavor for educators. Depending on the behaviors and needs of students that emerge in real educational situations, educators may need to orchestrate activity adaptations on the fly. These adaptations may range from the provision of additional scaffolding by the educator (e.g., the educator's participation in a group discussion) to a change in the planned pedagogical scenario (e.g., the duration). This article aims to contribute to the orchestration of technology-mediated collaborative learning sessions in a classroom context. We present the design, implementation, and evaluation of a teacher-facing dashboard that supports teachers in orchestrating scripted collaboration. Evaluation studies were conducted in 16 classroom sessions. The findings indicate that teachers found the information on the dashboard to be actionable and help facilitate just in time support to student groups., This work has been partially funded by "la Caixa Foundation" (CoT project, 100010434) and the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015- 0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Learning to learn: university student perceptions of a science of learning intervention

  • Beardsley, Marc Yoshimi
  • Martínez Moreno, Judit
  • Hernández Leo, Davinia
Comunicació presentada a: XI Congrés CIDUI celebrat del 30 de juny al 2 de juliol de 2021 de manera virtual., Many students use ineffective learning strategies and lack confidence in their learning skills and knowledge. This paper presents the results of a pre- and post-survey study involving first-year university students that completed a 2-hour classroom lesson on the science of learning and learning skills. The results of the study confirm that students perceive that they lack knowledge and confidence about learning; and that students found a lesson on the science of learning to be beneficial., This work was partially funded by the European Regional Development Fund, Erasmus+, and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities, under project grants TIN2017-85179-C3-3-R, 2017-1-ES01-KA201-038220 and MDM-2015-0502. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Enhancing consent forms to support participant decision making in multimodal learning data research

  • Beardsley, Marc Yoshimi
  • Martínez Moreno, Judit
  • Vujovic, Milica
  • Santos Rodríguez, Patrícia
  • Hernández Leo, Davinia
Advances in the field of multimodal learning analytics (MMLA) research is often accomplished by actively exploring new technologies and techniques related to the collection and analysis of data. Exploration of ethical principles and procedures for governing the use of new technologies and techniques, however, is not as readily pursued. As collected data grow in complexity and invasiveness, potentially, a growing need is arising to scrutinize ethical aspects of MMLA research. In our study, we introduce an informed consent comprehension test for educational technology research and assess the effects of enhancing MMLA consent forms on comprehension of informed consent and on rates of enrollment in a MMLA study. One form is written from a researcher perspective and the other from a participant perspective. Results of the study involving first‐year undergraduate students suggest that the overall level of comprehension did not differ between conditions. Yet, the participant‐oriented consent form resulted in significantly lower rates of enrollment. Implications for MMLA researchers are discussed., This work was partially funded by the Spanish Ministry of Economy and Competitiveness under MDM-2015-0502, TIN2017-85179-C3-3-R. D. Hernández-Leo acknowledges financial support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Smartphones or laptops in the collaborative classroom? A study of video-based learning in higher education

  • Albó, Laia
  • Hernández Leo, Davinia
  • Moreno Oliver, Verónica
This paper explores how the use of smartphones vs. laptops influences students’ engagement, behaviour and experience watching academic videos in a collaborative classroom. Experiments were run in authentic teaching sessions with a total of 483 first-year higher education students. The methodology applied is a quasi-experimental design with post-test-only, being the independent variable, the device used to visualise the academic videos. Results indicate that the use of laptops has provided better results in terms of student’s engagement with the videos, their collaborative behaviour and satisfaction with the device. Hence, the findings of this research suggest that the type of mobile device used in activities that consider the use of videos in a collaborative class need to be carefully chosen to maximise the student’s comfortability – and in consequence, their engagement with the video-based learning activity and their positive behaviour and experience within the collaborative context., This work was supported by Ministerio de Ciencia y Tecnología [grant number MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R], Universitat Pompeu Fabra (UPF) [grant number PlaQUID2012], and RecerCaixa [grant number Communities of Teaching (CoT) Project].
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Teacher-led inquiry in technology-supported school communities

  • Michos, Konstantinos
  • Hernández Leo, Davinia
  • Albó, Laia
Learning design is a research field which studies how to best support teachers as designers of Technology Enhanced Learning (TEL) situations. Although substantial work has been done in the articulation of the learning design process, little is known about how learning designs are experienced by students and teachers, especially in the context of schools. This paper empirically examines if a teacher inquiry model, as a tool for systematic research by teachers into their own practice, facilitates the connection between the design and data‐informed reflection on TEL interventions in two school communities. High school teachers participated in a learning design professional development program supported by a web‐based community platform integrating a teacher inquiry tool (TILE). A multiple case study was conducted aimed at understanding: (a) current teacher practice and (b) teacher involvement in inquiry cycles of design and classroom implementations with technologies. Multiple data sources were used over a one year period including focus groups transcripts, teacher interview protocols, digital artifacts, and questionnaires. Sharing teacher‐led inquiries together with learning analytics was perceived as being useful for connecting pedagogical intentions with the evaluation of their enactment with learners, and this differed from their current practice. Teachers’ reflections about their designs focused on the time management of learning activities and their familiarity with the enactment and analytics tools. Results inform how technology can support teacher‐led inquiry and collective reflective practice in schools., This work has been partially funded by RecerCaixa (CoT project) and the Spanish Ministry of Economy and Competitiveness under MDM-2015-0502, TIN2014-53199-C3-3-R and TIN2017-85179-C3-3-R.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Talking to plants: an IoT system supporting human-plant interactions and learning

  • Tabuenca, Bernardo
  • Greller, Wolfgang
  • Hernández Leo, Davinia
  • Gilarranz-Casado, Carlos
  • García-Alcántara, Vicente
  • Tovar, Edmundo
The presence of plants in learning spaces can substantially improve well-being among students and teachers. Plants can positively influence environmental parameters such as air quality, temperature, or reverberation, but they also have an impact on parameters such as concentration, collaboration, and learning performance. This study aims to use plants as a learning object to promote ecological learning spaces. The paper presents an IoT system (Smart Spike) designed to collect data, and to provide real-time feedback on the state of the plant, soil, and environment variables. Moreover, this prototype was evaluated by 62 students of Agronomics and Computer Engineering to explore what measurements they considered most relevant, and how they would communicate with the plant using a mobile chatbot. The results aim to establish a better understanding of potential interactions between plants, learners, teachers, and the microclimate with a view to scaffolding learning activities supported by IoT technology and artificial intelligence., This work was funded through Erasmus+ Strategic Partnerships for Higher Education project TEASPILS (2020-1-ES01-KA203-082258). Partial support has also been received from the Madrid Regional Government through the e-Madrid-CM Project under grant S2018/TCS-4307, a project which is co-funded by the European Structural Funds (FSE and FEDER) and the Spanish Ministry TIN2017-85179-C3-3-R, PID2020-112584RBC33. MDM-2015-0502. D. Hernández-Leo (Serra Húnter) acknowledges the support by ICREA under the ICREA Academia program.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Human-centred design to empower ‘teachers as designers’

  • Garreta Domingo, Muriel
  • Sloep, Peter B.
  • Hernández Leo, Davinia
Educators of all sectors are learning designers, often unwittingly. To succeed as designers, they need to adopt a design mindset and acquire the skills needed to address the design challenges they encounter in their everyday practice. Human-centred design (HCD) provides professional designers with the methods needed to address complex problems. It emphasizes the human perspective throughout the design lifecycle and provides a practice-oriented approach, which naturally fits educators’ realities. This research reports the experiences of educators who used HCD to design ICT-based learning activities. A mixed-methods approach was used to gauge how participating educators experienced the design tasks. The perceived level of difficulty and value of the various methods varied, revealing significant differences between educators according to their level of knowledge of pedagogy frameworks. We discuss our findings from the vantage point of educators’ pedagogical beliefs and how experience shapes these. The results support the idea that HCD is a valuable framework for educators, one that may inform ongoing international efforts to shape a science and practice of learning design for teaching., This work has been partially supported by MDM-2015- 0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R, RecerCaixa (CoT).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Knowledge-based design analytics for authoring courses with smart learning content

  • Albó, Laia
  • Barria-Pineda, Jordan
  • Brusilovsky, Peter
  • Hernández Leo, Davinia
Over the last 10 years, learning analytics have provided educators with both dashboards and tools to understand student behaviors within specific technological environments. However, there is a lack of work to support educators in making data-informed design decisions when designing a blended course and planning appropriate learning activities. In this paper, we introduce knowledge-based design analytics that uncover facets of the learning activities that are being created. A knowledge-based visualization is integrated into edCrumble, a (blended) learning design authoring tool. This new approach is explored in the context of a higher education programming course, where instructors design labs and home practice sessions with online smart learning content on a weekly basis. We performed a within-subjects user study to compare the use of the design tool both with and without visualization. We studied the differences in terms of cognitive load, controllability, confidence and ease of choice, design outcomes, and user actions within the system to compare both conditions with the objective of evaluating the impact of using design analytics during the decision-making phase of course design. Our results indicate that the use of a knowledge-based visualization allows the teachers to reduce the cognitive load (especially in terms of mental demand) and that it facilitates the choice of the most appropriate activities without affecting the overall design time. In conclusion, the use of knowledge-based design analytics improves the overall learning design quality and helps teachers avoid committing design errors., This work is a result of a collaboration within a mobility grant for research funded by the SEBAP, Societat Econòmica Barcelonesa d’Amics del País. This work has also been partially funded by NSF DRL 1740775, “la Caixa Foundation” (CoT project, 100010434) and FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Meta-research conference: data-driven planning of a research methods situated-learning activity

  • Michos, Konstantinos
  • Hernández Leo, Davinia
This paper presents the Meta-Research Conference, a learning task for situated learning implemented in two consecutive years in a master course on Research Methods. Through this task students tackle responsible research aspects, apply skills learned during the course, and engage in tasks of professional researchers. The paper also shows how learning analytics based on LMS activity logs, student feedback questionnaires and grades are used to improve the course design., This work has been partially funded by the EU Regional Development Fund and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities under project grants TIN2017-85179-C3-3-R, RED2018-102725-T, and the UPF PlaClik program. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Emergency education effects on teacher abilities and motivation to use digital technologies

  • Beardsley, Marc Yoshimi
  • Albó, Laia
  • Aragón, Pablo
  • Hernández Leo, Davinia
To identify factors that can contribute toward supporting educator adoption of digital technologies beyond the emergency remote teaching response to COVID‐19, we investigated how teachers’ motivation and abilities related to the use of digital technologies for teaching changed since the onset of the pandemic. Two surveys and interviews were conducted with school teachers in Spain. The first survey was completed at the onset of the COVID‐19 lockdown, the second survey and interviews in the weeks leading up to the school year that followed. Survey questions were from SELFIE and the Work Tasks Motivation Scale for Teachers. Moreover we analysed the type of advice teachers sought on Twitter during the lockdown and post‐lockdown periods. Results indicate that teachers believe their proficiency in using digital technologies for teaching has improved. Teacher confidence in using technology for preparing lessons, class teaching, assessing and providing feedback, and for communicating with students and families has increased along with teacher motivation to improve their digital skills and use digital technologies for teaching. Teacher advice seeking on Twitter seemed to shift from serving immediate instructional needs to focussing on professional development and the creation of their own digital content., This work has been partially funded by the EU Regional Development Fund, the National Research Agency of the Spanish Ministry of Science, Innovation and Universities and Erasmus+, under project grants TIN2017‐85179‐C3‐3‐R, 2019‐1‐FI01‐KA201‐060881, 2019‐1‐ES01‐KA201‐065279. D. Hernández‐Leo acknowledges financial support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

CIDA: a collective inquiry framework to study and support teachers as designers in technological environments

  • Michos, Konstantinos
  • Hernández Leo, Davinia
The use of new technologies such as learning analytics by teachers is challenging due to the changes they bring to teachers’ practices and their pedagogical interventions. A design approach into teaching has been proposed for mapping pedagogy with technology to effectively integrate these changes. However, limited collective approaches exist in which teachers participate in professional communities to build knowledge for the design and implementation of learning scenarios with learning analytics. In this paper, we propose a framework (CIDA) for collective inquiry in such professional communities of teachers. Based on other collective inquiry frameworks for knowledge building, we propose three interconnected components: the inquiry process, the collective process, and technological support to facilitate and study teachers´ design practices in technological environments. We explain the framework with examples of implemented technologies and present empirical results of three cases; two High schools and a Massive Open Online Course (MOOC). Results inform further how our framework can be implemented in practice and its required supports to facilitate knowledge building for inquiry communities of teachers., DHL is a Serra Húnter Fellow. This work has been partially funded by “la Caixa Foundation” (CoT project, 100010434); by the European Regional Development Fund and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities, under project grants TIN 2014-53199-C3-3-R, TIN2014-53199-C3-2-R, TIN 2017-85179-C3-2-R, TIN 2017-85179-C3-3-R, MDM-2015-0502
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Seeking reproducibility: assessing a multimodal study of the testing effect

  • Beardsley, Marc Yoshimi
  • Hernández Leo, Davinia
  • Ramírez, Rafael, 1966-
Low‐cost devices have widened the use of multimodal data in experiments providing a more complete picture of behavioural effects. However, the accurate collection and combination of multimodal and behavioural data in a manner that enables reproducibility is challenging and often requires researchers to refine their approaches. This paper presents a direct replication of a multimodal wordlist experiment. Specifically, we use a low‐cost Emotiv EPOC® to acquire electrophysiological measures of brain activity to investigate whether retrieval during learning facilitates the encoding of subsequent learning as measured by performance on recall tests and reflected by changes in alpha wave oscillations. Behavioural results of the wordlist experiment were replicated, but physiological results were not. We conclude the paper by highlighting the challenges faced in terms of replicating the previous work and in attempting to facilitate the reproducibility of our own experiment., This work has been partially supported by RecerCaixa (CoT project) and the Spanish Ministry of Economy and Competitiveness under MDM‐2015‐0502, TIN2014‐53199‐C3‐3‐R, TIN2017‐85179‐C3‐3‐R.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Involving teachers in learning analytics design: lessons learned from two case studies

  • Michos, Konstantinos
  • Lang, Charles
  • Hernández Leo, Davinia
  • Price-Dennis, Detra
Comunicació presentada a: LAK20, celebrat del 23 al 27 de març de 2020 a Frankfurt, Alemanya., Involving teachers in the design of technology-enhanced learning environments is a useful method towards bridging the gap between research and practice. This is especially relevant for learning analytics tools, wherein the presentation of educational data to teachers or students requires meaningful sense-making to effectively support data-driven actions. In this paper, we present two case studies carried out in the context of two research projects in the USA and Spain which aimed to involve teachers in the co-design of learning analytics tools through professional development programs. The results of a cross-case analysis highlight lessons learned around challenges and principles regarding the meaningful involvement of teachers in learning analytics tooling design., This work has been partially funded by "la Caixa Foundation" (CoT project, 100010434), FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities TIN 2017-85179- C3-2-R, TIN 2017-85179-C3-3-R, MDM-2015-0502.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Conceptualising a visual representation model for MOOC-based blended learning designs

  • Albó, Laia
  • Hernández Leo, Davinia
This article reports on a study about how massive open online course (MOOC)-based blended learning designs can be visually represented to facilitate their comprehension and sharing. We carried out an iterative co-creation process with different stakeholders to conceptualise a visual learning design representation model within the context of blending MOOCs with face-to-face courses. The data analysed was derived from questionnaires and the generated representations. Results indicate that the representation enabled educators to easily visualise the overall structure of the learning designs and the relationships between the different design elements, providing a context for fostering reflection and decision-making during the planning of MOOC-based blended learning designs., The authors would like to thank all the participants of the workshops. This work has been partially funded by “la Caixa Foundation” (CoT project, 100010434) and FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R. Davinia Hernández-Leo (one of the authors) is a Serra Húnter Fellow.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Learning design and learning analytics in mobile and ubiquitous learning: a systematic review

  • Pishtari, Gerti
  • Rodríguez-Triana, María Jesús
  • Sarmiento Márquez, Edna M.
  • Pérez Sanagustín, Maria del Mar
  • Ruiz Calleja, Adolfo
  • Santos Rodríguez, Patrícia
  • Prieto, Luis P.
  • Serrano Iglesias, Sergio
  • Väljataga, Terje
Mobile and Ubiquitous Learning (m/u‐learning) are finding an increasing adoption in education. They are often distinguished by hybrid learning environments that encompass elements of formal and informal learning, in activities that happen in distributed settings (indoors and outdoors), across physical and virtual spaces. Despite their purported benefits, these environments imply additional complexity in the design, monitoring and evaluation of learning activities. The research literature on learning design (LD) and learning analytics (LA) has started to deal with these issues. This paper presents a systematic literature review of LD and LA, in m/u‐learning. Apart from providing an overview of the current research in the field, this review elicits elements of common ground between both communities, as shown by the similar learning contexts and complementary research contributions, and based on the research gaps, proposes to: address m/u‐learning beyond higher education settings, reinforce the connection between physical and virtual learning spaces, and more systematically align LD and LA processes., This research was partially funded by EU grants 669074, 586120-EPP-1-2017-1-ES-EPPKA2CBHE-JP, and Spanish projects TIN2017-85179-C3-1-R, TIN2017-85179-C3-2-R, TIN201785179-C3-3-R, VA257P18.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Comparing pre-service and in-service teacher perceptions of the science of learning

  • Beardsley, Marc Yoshimi
  • Martínez Moreno, Judit
  • Hernández Leo, Davinia
Comunicació presentada a: XI Congrés CIDUI celebrat del 30 de juny al 2 de juliol de 2021 de manera virtual., This paper presents the results of a survey on teacher formation and beliefs related to the science of learning (e.g. the science of how people learn) completed by in-service and pre-service teachers. The study results suggest there is a gap, as perceived by both in-service and pre-service teachers themselves, in teacher knowledge and confidence related to the science of learning. This gap exists despite most teachers indicating that the science of learning should be a required part of initial teacher education. Overall, this study supports the notion that teachers’ would be receptive to interventions that improve their knowledge of the science of learning., This work was partially funded by the European Regional Development Fund, Erasmus+, and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities, under project grants TIN2017-85179-C3-3-R, 2017-1-ES01-KA201-038220 and MDM-2015-0502. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Collaborative learning designs using PyramidApp: computer supported collaborative learning in classroom sessions

  • Amarasinghe, Ishari
  • Hernández Leo, Davinia
  • Manathunga, Kalpani
  • Beardsley, Marc Yoshimi
  • Bosch Garcia, Jordi
  • Carrió, Mar
  • Chacón Pérez, Jonathan, 1986-
  • Jiménez Morales, Manel
  • Llanos Santos, David
  • Lope Pastor, Silvia
  • Martínez Moreno, Judit
  • Santos Rodríguez, Patrícia
  • Vujovic, Milica
Comunicació presentada a: XI Congrés CIDUI 2021 celebrat del 29 de juny al 2 de juliol de 2021 de manera virtual., Designing effective collaborative learning activities for classroom is challenging. The PyramidApp is a tool that facilitates the implementation of the Pyramid pattern, shaping a collaboration structure that promotes the participation of all students and fruitful social interactions. This paper shows how this educational strategy can be applied to different types of tasks and subject matters, shedding light about how computer-supported collaborative learning can be incorporated in the classroom., This work has been partially funded by FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2017-85179-C3-3-R, and UPF PlaClik. Davinia Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Supporting online collaborative design for teacher professional development

  • Marín, Victoria I.
  • Asensio-Pérez, Juan I.
  • Villagrá-Sobrino, Sara L.
  • Hernández Leo, Davinia
  • García-Sastre, Sara
This article describes a study of online collaborative design in the context of teacher professional development. Twenty-five teachers from different Spanish universities participated in the online course. The aim was to understand how to support teachers in interuniversity teams to collaborate fully online throughout the learning design process of a scenario based on their discipline integrating information and communications technology (ICT), an issue scarcely tackled in the literature. The described interpretive study, using mixed methods, explores the support of online co-design provided by a novel ICT community platform named ILDE (Integrated Learning Design Environment). Lessons drawn from the results can contribute to the improvement of online collaborative design processes in the context of teacher professional development., This work has been partially supported by the Spanish Ministry of Science, Innovation and Universities [project EDU2017-84223-R], the Spanish State Research Agency (AEI) [projects TIN2017-85179-C3-2-R and TIN2014-53199-C3-2-R, TIN2014-53199-C3-3-R and TIN2017-85179-C3-3-R], the Regional Government of Castilla y León and the European Regional Development Fund [project VA018U16], the European Commission [project 588438-EPP-1-2017-1-EL-EPPKA2-KA], the Spanish Ministry of Economy and Competitiveness [project MDM-2015-0502] and RecerCaixa (CoT).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Data-informed design parameters for adaptive collaborative scripting in across-spaces learning situations

  • Amarasinghe, Ishari
  • Hernández Leo, Davinia
  • Jonsson, Anders, 1973-
This study presents how predictive analytics can be used to inform the formulation of adaptive collaborative learning groups in the context of Computer Supported Collaborative Learning considering across-spaces learning situations. During the study we have collected data from different learning spaces which depicted both individual and collaborative learning activity engagement of students in two different learning contexts (namely the classroom learning and distance learning context) and attempted to predict individual student’s future collaborative learning activity participation in a pyramid-based collaborative learning activity using supervised machine learning techniques. We conducted experimental case studies in the classroom and in distance learning settings, in which real-time predictions of student’s future collaborative learning activity participation were used to formulate adaptive collaborative learner groups. Findings of the case studies showed that the data collected from across-spaces learning scenarios is informative when predicting future collaborative learning activity participation of students hence facilitating the formulation of adaptive collaborative group configurations that adapt to the activity participation differences of students in real-time. Limitations of the proposed approach and future research direction are illustrated., This work has been partially funded by FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R and “la Caixa Foundation” (CoT project, 100010434). DHL is a Serra Húnter Fellow.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

4FAD: A framework for mapping the evolution of artefacts in the learning design process

  • Muñoz Cristóbal, Juan Alberto
  • Hernández Leo, Davinia
  • Carvalho, Lucila
  • Martinez-Maldonado, Roberto
  • Thompson, Kate
  • Wardak, Dewa
  • Goodyear, Peter
A number of researchers have explored the role and nature of design in education, proposing a diverse array of life cycle models. Design plays subtly different roles in each of these models. The learning design research community is shifting its attention from the representation of pedagogical plans to considering design as an ongoing process. As a result, the study of the artefacts generated and used by educational designers is also changing: from a focus on the final designed artefact (the product of the design process) to the many artefacts generated and used by designers at different stages of the design process (e.g., sketches, reflections, drawings, or pictures). However, there is still a dearth of studies exploring the evolution of such artefacts throughout the learning design life cycle. A deeper understanding of these evolutionary processes is needed – to help smooth the transitions between stages in the life cycle. In this paper, we introduce the four-dimensional framework for artefacts in design (4FAD) to generate understanding and facilitate the mapping of the evolution of learning design artefacts. We illustrate the value of the framework by applying it in the analysis of an authentic design case., This research has been partially supported by the Spanish Projects TIN2011-28308-C03-02, TIN2014-53199-C3-2-R, TIN2014-53199-C3-3-R, TIN2017-85179-C3-2-R, TIN2017-85179-C3-3-R, MDM-2015-0502, RecerCaixa (CoT) and VA082U16, and by the Australian Research Council through Laureate grant FL100100203.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Supporting online collaborative design for teacher professional development

  • Marín, Victoria I.
  • Asensio Pérez, Juan I.
  • Villagrá Sobrino, Sara
  • Hernández Leo, Davinia
  • García Sastre, Sara
This paper describes a study on online collaborative design in the context of teacher professional development. 25 teachers from different Spanish universities and disciplines participated in the study. The aim was to understand how to support teachers in interuniversity teams to collaborate fully online along the learning design process of a discipline-based situation that integrates ICT, a problem scarcely tackled in the literature. The described interpretive study, using mixed methods, explores the support to online co-design provided by a novel ICT community platform named ILDE (Integrated Learning Design Environment). Lessons drawn from the results can contribute to the improvement of online collaborative design processes in the context of teacher professional development., This work has been partially supported by the Spanish Ministry of Science, Innovation and Universities [project EDU2017-84223-R], the Spanish State Research Agency (AEI) [projects TIN2017-85179-C3-2-R and TIN2014-53199-C3-2-R, TIN2014-53199-C3-3-R and TIN2017-85179-C3-3-R], the Regional Government of Castilla y León and the European Regional Development Fund [project VA018U16], the European Commission [project 588438-EPP-1-2017-1-EL-EPPKA2-KA], the Spanish Ministry of Economy and Competitiveness [project MDM-2015-0502] and RecerCaixa (CoT).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Meta-research conference: data-driven planning of a research methods situated-learning activity

  • Michos, Konstantinos
  • Hernández Leo, Davinia
This paper presents the Meta-Research Conference, a learning task for situated learning implemented in two consecutive years in a master course on Research Methods. Through this task students tackle responsible research aspects, apply skills learned during the course, and engage in tasks of professional researchers. The paper also shows how learning analytics based on LMS activity logs, student feedback questionnaires and grades are used to improve the course design., This work has been partially funded by the EU Regional Development Fund and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities under project grants TIN2017-85179-C3-3-R, RED2018-102725-T, and the UPF PlaClik program. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Learning to learn: university student perceptions of a science of learning intervention

  • Beardsley, Marc Yoshimi
  • Martínez Moreno, Judit
  • Hernández Leo, Davinia
Comunicació presentada a: XI Congrés CIDUI celebrat del 30 de juny al 2 de juliol de 2021 de manera virtual., Many students use ineffective learning strategies and lack confidence in their learning skills and knowledge. This paper presents the results of a pre- and post-survey study involving first-year university students that completed a 2-hour classroom lesson on the science of learning and learning skills. The results of the study confirm that students perceive that they lack knowledge and confidence about learning; and that students found a lesson on the science of learning to be beneficial., This work was partially funded by the European Regional Development Fund, Erasmus+, and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities, under project grants TIN2017-85179-C3-3-R, 2017-1-ES01-KA201-038220 and MDM-2015-0502. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Smartphones or laptops in the collaborative classroom? A study of video-based learning in higher education

  • Albó, Laia
  • Hernández Leo, Davinia
  • Moreno Oliver, Verónica
This paper explores how the use of smartphones vs. laptops influences students’ engagement, behaviour and experience watching academic videos in a collaborative classroom. Experiments were run in authentic teaching sessions with a total of 483 first-year higher education students. The methodology applied is a quasi-experimental design with post-test-only, being the independent variable, the device used to visualise the academic videos. Results indicate that the use of laptops has provided better results in terms of student’s engagement with the videos, their collaborative behaviour and satisfaction with the device. Hence, the findings of this research suggest that the type of mobile device used in activities that consider the use of videos in a collaborative class need to be carefully chosen to maximise the student’s comfortability – and in consequence, their engagement with the video-based learning activity and their positive behaviour and experience within the collaborative context., This work was supported by Ministerio de Ciencia y Tecnología [grant number MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R], Universitat Pompeu Fabra (UPF) [grant number PlaQUID2012], and RecerCaixa [grant number Communities of Teaching (CoT) Project].
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Deconstructing orchestration load: comparing teacher support through mirroring and guiding

  • Amarasinghe, Ishari
  • Hernández Leo, Davinia
  • Hoppe, H. Ulrich
Under the notion of “CSCL scripts”, different pedagogical models for structuring and supporting collaboration in the classroom have been proposed. We report on a practical experience with scripts based on the Pyramid collaborative learning flow pattern supported by a specific classroom tool and a teacher-facing dashboard that implements mirroring and guiding support. The input data of our analysis stems from recordings of classroom interactions guided by several teachers using the PyramidApp with different levels of teaching support. For the analysis, we introduce a specific coding scheme enabling a quantitative comparison and deeper analysis using epistemic network analysis. The results show that the guiding support enabled teachers to perform more orchestration actions, more targeted interactions and to make more announcements to the class (regarding time, phase transitions, and students’ activity participation) when compared to the mirroring support. Teachers’ actionable differences observed under the mirroring and guiding support directed us to deconstruct the notion of orchestration load into different facets and to discuss how different support provisions correspond to the different facets of orchestration load., TIDE-UPF acknowledges the support by FEDER, the National Research Agency of the Spanish Ministry, TIN2017-85179-C3-3-R, PID2020-112584RB-C33, MDM-2015-0502, and by ICREA under the ICREA Academia programme (D. Hernández-Leo, Serra Hunter).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Supporting awareness in communities of learning design practice

  • Michos, Konstantinos
  • Hernández Leo, Davinia
The field of learning design has extensively studied the use of technology for the authoring of learning activities. However, the social dimension of the learning design process is still underexplored. In this paper, we investigate communities of teachers who used a social learning design platform (ILDE). We seek to understand how community awareness facilitates the learning design activity of teachers in different educational contexts. Following a design-based research methodology, we developed a community awareness dashboard (inILDE) based on the Cultural Historical Activity Theory (CHAT) framework. The dashboard displays the activity of teachers in ILDE, such as their interactions with learning designs, other members, and with supporting learning design tools. Evaluations of the inILDE dashboard were carried out in four educational communities – two secondary schools, a master programme for pre-service teachers, and in a Massive Open Online Course (MOOC) for teachers. The dashboard was perceived to be useful in summarizing the activity of the community and in identifying content and members’ roles. Further, the use of the dashboard increased participants’ interactions such as profile views and teachers showed a willingness to build on the contributions of others. As conclusions of the study, we propose five design principles for supporting awareness in learning design communities, namely community context, practice-related insights, visualizations and representations, tasks and community interests., This work has been partially funded by RecerCaixa (CoT project) and the Spanish Ministry of Economy and Competitiveness under MDM-2015-0502, TIN2014–53199-C3-3-R, TIN2017-85179-C3-3-R.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Human-centred design to empower ‘teachers as designers’

  • Garreta Domingo, Muriel
  • Sloep, Peter B.
  • Hernández Leo, Davinia
Educators of all sectors are learning designers, often unwittingly. To succeed as designers, they need to adopt a design mindset and acquire the skills needed to address the design challenges they encounter in their everyday practice. Human-centred design (HCD) provides professional designers with the methods needed to address complex problems. It emphasizes the human perspective throughout the design lifecycle and provides a practice-oriented approach, which naturally fits educators’ realities. This research reports the experiences of educators who used HCD to design ICT-based learning activities. A mixed-methods approach was used to gauge how participating educators experienced the design tasks. The perceived level of difficulty and value of the various methods varied, revealing significant differences between educators according to their level of knowledge of pedagogy frameworks. We discuss our findings from the vantage point of educators’ pedagogical beliefs and how experience shapes these. The results support the idea that HCD is a valuable framework for educators, one that may inform ongoing international efforts to shape a science and practice of learning design for teaching., This work has been partially supported by MDM-2015- 0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R, RecerCaixa (CoT).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Involving teachers in learning analytics design: lessons learned from two case studies

  • Michos, Konstantinos
  • Lang, Charles
  • Hernández Leo, Davinia
  • Price-Dennis, Detra
Comunicació presentada a: LAK20, celebrat del 23 al 27 de març de 2020 a Frankfurt, Alemanya., Involving teachers in the design of technology-enhanced learning environments is a useful method towards bridging the gap between research and practice. This is especially relevant for learning analytics tools, wherein the presentation of educational data to teachers or students requires meaningful sense-making to effectively support data-driven actions. In this paper, we present two case studies carried out in the context of two research projects in the USA and Spain which aimed to involve teachers in the co-design of learning analytics tools through professional development programs. The results of a cross-case analysis highlight lessons learned around challenges and principles regarding the meaningful involvement of teachers in learning analytics tooling design., This work has been partially funded by "la Caixa Foundation" (CoT project, 100010434), FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities TIN 2017-85179- C3-2-R, TIN 2017-85179-C3-3-R, MDM-2015-0502.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Talking to plants: an IoT system supporting human-plant interactions and learning

  • Tabuenca, Bernardo
  • Greller, Wolfgang
  • Hernández Leo, Davinia
  • Gilarranz-Casado, Carlos
  • García-Alcántara, Vicente
  • Tovar, Edmundo
The presence of plants in learning spaces can substantially improve well-being among students and teachers. Plants can positively influence environmental parameters such as air quality, temperature, or reverberation, but they also have an impact on parameters such as concentration, collaboration, and learning performance. This study aims to use plants as a learning object to promote ecological learning spaces. The paper presents an IoT system (Smart Spike) designed to collect data, and to provide real-time feedback on the state of the plant, soil, and environment variables. Moreover, this prototype was evaluated by 62 students of Agronomics and Computer Engineering to explore what measurements they considered most relevant, and how they would communicate with the plant using a mobile chatbot. The results aim to establish a better understanding of potential interactions between plants, learners, teachers, and the microclimate with a view to scaffolding learning activities supported by IoT technology and artificial intelligence., This work was funded through Erasmus+ Strategic Partnerships for Higher Education project TEASPILS (2020-1-ES01-KA203-082258). Partial support has also been received from the Madrid Regional Government through the e-Madrid-CM Project under grant S2018/TCS-4307, a project which is co-funded by the European Structural Funds (FSE and FEDER) and the Spanish Ministry TIN2017-85179-C3-3-R, PID2020-112584RBC33. MDM-2015-0502. D. Hernández-Leo (Serra Húnter) acknowledges the support by ICREA under the ICREA Academia program.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

An actionable orchestration dashboard to enhance collaboration in the classroom

  • Amarasinghe, Ishari
  • Hernández Leo, Davinia
  • Michos, Konstantinos
  • Vujovic, Milica
The orchestration of collaborative learning activities in technology-enhanced classrooms has become a nontrivial endeavor for educators. Depending on the behaviors and needs of students that emerge in real educational situations, educators may need to orchestrate activity adaptations on the fly. These adaptations may range from the provision of additional scaffolding by the educator (e.g., the educator's participation in a group discussion) to a change in the planned pedagogical scenario (e.g., the duration). This article aims to contribute to the orchestration of technology-mediated collaborative learning sessions in a classroom context. We present the design, implementation, and evaluation of a teacher-facing dashboard that supports teachers in orchestrating scripted collaboration. Evaluation studies were conducted in 16 classroom sessions. The findings indicate that teachers found the information on the dashboard to be actionable and help facilitate just in time support to student groups., This work has been partially funded by "la Caixa Foundation" (CoT project, 100010434) and the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015- 0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Conceptualising a visual representation model for MOOC-based blended learning designs

  • Albó, Laia
  • Hernández Leo, Davinia
This article reports on a study about how massive open online course (MOOC)-based blended learning designs can be visually represented to facilitate their comprehension and sharing. We carried out an iterative co-creation process with different stakeholders to conceptualise a visual learning design representation model within the context of blending MOOCs with face-to-face courses. The data analysed was derived from questionnaires and the generated representations. Results indicate that the representation enabled educators to easily visualise the overall structure of the learning designs and the relationships between the different design elements, providing a context for fostering reflection and decision-making during the planning of MOOC-based blended learning designs., The authors would like to thank all the participants of the workshops. This work has been partially funded by “la Caixa Foundation” (CoT project, 100010434) and FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R. Davinia Hernández-Leo (one of the authors) is a Serra Húnter Fellow.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Teacher-led inquiry in technology-supported school communities

  • Michos, Konstantinos
  • Hernández Leo, Davinia
  • Albó, Laia
Learning design is a research field which studies how to best support teachers as designers of Technology Enhanced Learning (TEL) situations. Although substantial work has been done in the articulation of the learning design process, little is known about how learning designs are experienced by students and teachers, especially in the context of schools. This paper empirically examines if a teacher inquiry model, as a tool for systematic research by teachers into their own practice, facilitates the connection between the design and data‐informed reflection on TEL interventions in two school communities. High school teachers participated in a learning design professional development program supported by a web‐based community platform integrating a teacher inquiry tool (TILE). A multiple case study was conducted aimed at understanding: (a) current teacher practice and (b) teacher involvement in inquiry cycles of design and classroom implementations with technologies. Multiple data sources were used over a one year period including focus groups transcripts, teacher interview protocols, digital artifacts, and questionnaires. Sharing teacher‐led inquiries together with learning analytics was perceived as being useful for connecting pedagogical intentions with the evaluation of their enactment with learners, and this differed from their current practice. Teachers’ reflections about their designs focused on the time management of learning activities and their familiarity with the enactment and analytics tools. Results inform how technology can support teacher‐led inquiry and collective reflective practice in schools., This work has been partially funded by RecerCaixa (CoT project) and the Spanish Ministry of Economy and Competitiveness under MDM-2015-0502, TIN2014-53199-C3-3-R and TIN2017-85179-C3-3-R.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

El papel de los espacios como facilitadores del aprendizaje colaborativo: Estudio cualitativo en Grados en Ingeniería y Másteres TIC de la UPF

  • Santos Rodríguez, Patrícia
  • Moreno, Verónica
  • Hernández Leo, Davinia
Este artículo presenta los resultados obtenidos en un análisis realizado en estudios de grado y master (ámbitos de ingeniería y TIC) de la UPF enfocado en el papel que juegan los espacios colaborativos de aprendizaje (físicos y virtuales) ofrecidos por la universidad en actividades académicas. El estudio usa una metodología cualitativa para la recogida de datos. Los resultados obtenidos muestran un diagnóstico de la situación actual, incluyendo buenas prácticas que podrían reforzarse en el futuro o aspectos de mejora a considerar en la reformulación de los espacios de aprendizaje., This article presents the results obtained in a study carried out in Studies of Engineering Degrees and ICT Masters at UPF. Its purpose is the study of the role of collaborative learning spaces (physical and virtual) offered by the university in academic activities. The study uses a qualitative methodology for data collection. The results show a diagnosis of the current situation, including best practices that could be strengthened in the future or aspects of improvement to be considered in the reformulation of learning spaces., Este trabajo ha sido parcialmente financiado por el programa UPF PlaClik y el Fondo de Desarrollo Regional de la UE y la Agencia Nacional de Investigación del Ministerio de Ciencia, Innovación y Universidades de España (TIN2017-85179-C3-3-R).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Supporting online collaborative design for teacher professional development

  • Marín, Victoria I.
  • Asensio Pérez, Juan I.
  • Villagrá Sobrino, Sara
  • Hernández Leo, Davinia
  • García Sastre, Sara
This paper describes a study on online collaborative design in the context of teacher professional development. 25 teachers from different Spanish universities and disciplines participated in the study. The aim was to understand how to support teachers in interuniversity teams to collaborate fully online along the learning design process of a discipline-based situation that integrates ICT, a problem scarcely tackled in the literature. The described interpretive study, using mixed methods, explores the support to online co-design provided by a novel ICT community platform named ILDE (Integrated Learning Design Environment). Lessons drawn from the results can contribute to the improvement of online collaborative design processes in the context of teacher professional development., This work has been partially supported by the Spanish Ministry of Science, Innovation and Universities [project EDU2017-84223-R], the Spanish State Research Agency (AEI) [projects TIN2017-85179-C3-2-R and TIN2014-53199-C3-2-R, TIN2014-53199-C3-3-R and TIN2017-85179-C3-3-R], the Regional Government of Castilla y León and the European Regional Development Fund [project VA018U16], the European Commission [project 588438-EPP-1-2017-1-EL-EPPKA2-KA], the Spanish Ministry of Economy and Competitiveness [project MDM-2015-0502] and RecerCaixa (CoT).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Comparing pre-service and in-service teacher perceptions of the science of learning

  • Beardsley, Marc Yoshimi
  • Martínez Moreno, Judit
  • Hernández Leo, Davinia
Comunicació presentada a: XI Congrés CIDUI celebrat del 30 de juny al 2 de juliol de 2021 de manera virtual., This paper presents the results of a survey on teacher formation and beliefs related to the science of learning (e.g. the science of how people learn) completed by in-service and pre-service teachers. The study results suggest there is a gap, as perceived by both in-service and pre-service teachers themselves, in teacher knowledge and confidence related to the science of learning. This gap exists despite most teachers indicating that the science of learning should be a required part of initial teacher education. Overall, this study supports the notion that teachers’ would be receptive to interventions that improve their knowledge of the science of learning., This work was partially funded by the European Regional Development Fund, Erasmus+, and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities, under project grants TIN2017-85179-C3-3-R, 2017-1-ES01-KA201-038220 and MDM-2015-0502. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Emergency education effects on teacher abilities and motivation to use digital technologies

  • Beardsley, Marc Yoshimi
  • Albó, Laia
  • Aragón, Pablo
  • Hernández Leo, Davinia
To identify factors that can contribute toward supporting educator adoption of digital technologies beyond the emergency remote teaching response to COVID‐19, we investigated how teachers’ motivation and abilities related to the use of digital technologies for teaching changed since the onset of the pandemic. Two surveys and interviews were conducted with school teachers in Spain. The first survey was completed at the onset of the COVID‐19 lockdown, the second survey and interviews in the weeks leading up to the school year that followed. Survey questions were from SELFIE and the Work Tasks Motivation Scale for Teachers. Moreover we analysed the type of advice teachers sought on Twitter during the lockdown and post‐lockdown periods. Results indicate that teachers believe their proficiency in using digital technologies for teaching has improved. Teacher confidence in using technology for preparing lessons, class teaching, assessing and providing feedback, and for communicating with students and families has increased along with teacher motivation to improve their digital skills and use digital technologies for teaching. Teacher advice seeking on Twitter seemed to shift from serving immediate instructional needs to focussing on professional development and the creation of their own digital content., This work has been partially funded by the EU Regional Development Fund, the National Research Agency of the Spanish Ministry of Science, Innovation and Universities and Erasmus+, under project grants TIN2017‐85179‐C3‐3‐R, 2019‐1‐FI01‐KA201‐060881, 2019‐1‐ES01‐KA201‐065279. D. Hernández‐Leo acknowledges financial support by ICREA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Knowledge-based design analytics for authoring courses with smart learning content

  • Albó, Laia
  • Barria-Pineda, Jordan
  • Brusilovsky, Peter
  • Hernández Leo, Davinia
Over the last 10 years, learning analytics have provided educators with both dashboards and tools to understand student behaviors within specific technological environments. However, there is a lack of work to support educators in making data-informed design decisions when designing a blended course and planning appropriate learning activities. In this paper, we introduce knowledge-based design analytics that uncover facets of the learning activities that are being created. A knowledge-based visualization is integrated into edCrumble, a (blended) learning design authoring tool. This new approach is explored in the context of a higher education programming course, where instructors design labs and home practice sessions with online smart learning content on a weekly basis. We performed a within-subjects user study to compare the use of the design tool both with and without visualization. We studied the differences in terms of cognitive load, controllability, confidence and ease of choice, design outcomes, and user actions within the system to compare both conditions with the objective of evaluating the impact of using design analytics during the decision-making phase of course design. Our results indicate that the use of a knowledge-based visualization allows the teachers to reduce the cognitive load (especially in terms of mental demand) and that it facilitates the choice of the most appropriate activities without affecting the overall design time. In conclusion, the use of knowledge-based design analytics improves the overall learning design quality and helps teachers avoid committing design errors., This work is a result of a collaboration within a mobility grant for research funded by the SEBAP, Societat Econòmica Barcelonesa d’Amics del País. This work has also been partially funded by NSF DRL 1740775, “la Caixa Foundation” (CoT project, 100010434) and FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Supporting online collaborative design for teacher professional development

  • Marín, Victoria I.
  • Asensio-Pérez, Juan I.
  • Villagrá-Sobrino, Sara L.
  • Hernández Leo, Davinia
  • García-Sastre, Sara
This article describes a study of online collaborative design in the context of teacher professional development. Twenty-five teachers from different Spanish universities participated in the online course. The aim was to understand how to support teachers in interuniversity teams to collaborate fully online throughout the learning design process of a scenario based on their discipline integrating information and communications technology (ICT), an issue scarcely tackled in the literature. The described interpretive study, using mixed methods, explores the support of online co-design provided by a novel ICT community platform named ILDE (Integrated Learning Design Environment). Lessons drawn from the results can contribute to the improvement of online collaborative design processes in the context of teacher professional development., This work has been partially supported by the Spanish Ministry of Science, Innovation and Universities [project EDU2017-84223-R], the Spanish State Research Agency (AEI) [projects TIN2017-85179-C3-2-R and TIN2014-53199-C3-2-R, TIN2014-53199-C3-3-R and TIN2017-85179-C3-3-R], the Regional Government of Castilla y León and the European Regional Development Fund [project VA018U16], the European Commission [project 588438-EPP-1-2017-1-EL-EPPKA2-KA], the Spanish Ministry of Economy and Competitiveness [project MDM-2015-0502] and RecerCaixa (CoT).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Round or rectangular tables for collaborative problem solving? A multimodal learning analytics study

  • Vujovic, Milica
  • Hernández Leo, Davinia
  • Tassani, Simone
  • Spikol, Daniel
The current knowledge of the effects of the physical environment on learners’ behaviour in collaborative problem‐solving tasks is underexplored. This paper aims to critically examine the potential of multimodal learning analytics, using new data sets, in studying how the shapes of shared tables affect the learners’ behaviour when collaborating in terms of patterns of participation and indicators related to physical social interactions. The research presented in this paper investigates this question considering the potential interplay with contextual aspects (level of education) and learning design decisions (group size). Three dependent variables (distance between students, range of movement and level of participation) are tested using quantitative and qualitative analyses of data collected using a motion capture system and video recordings. Results show that the use of round tables (vs rectangular tables) leads to higher levels of on‐task participation in the case of elementary school students. For university students, different table shapes seem to have a limited impact on their levels of participation in collaborative problem solving. The analysis shows significant differences regarding the relationship between group size and the distance between students, but there is no substantial evidence that group size affects the level of participation. The findings support previous research highlighting the importance of studying the role of the physical environment as an element of learning design and the potential of multimodal learning analytics in approaching these studies., This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No. 713673. M. Vujovic has received financial support through the “La Caixa” INPhINIT Fellowship Grant for Doctoral studies at Spanish Research Centres of Excellence, “La Caixa” Banking Foundation, Barcelona, Spain. D. Hernández-Leo acknowledges the financial support from ICREA under the ICREA Academia programme. This work has been partially supported by the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM2015-0502, TIN2017-85179-C3-3-R.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Seeking reproducibility: assessing a multimodal study of the testing effect

  • Beardsley, Marc Yoshimi
  • Hernández Leo, Davinia
  • Ramírez, Rafael, 1966-
Low‐cost devices have widened the use of multimodal data in experiments providing a more complete picture of behavioural effects. However, the accurate collection and combination of multimodal and behavioural data in a manner that enables reproducibility is challenging and often requires researchers to refine their approaches. This paper presents a direct replication of a multimodal wordlist experiment. Specifically, we use a low‐cost Emotiv EPOC® to acquire electrophysiological measures of brain activity to investigate whether retrieval during learning facilitates the encoding of subsequent learning as measured by performance on recall tests and reflected by changes in alpha wave oscillations. Behavioural results of the wordlist experiment were replicated, but physiological results were not. We conclude the paper by highlighting the challenges faced in terms of replicating the previous work and in attempting to facilitate the reproducibility of our own experiment., This work has been partially supported by RecerCaixa (CoT project) and the Spanish Ministry of Economy and Competitiveness under MDM‐2015‐0502, TIN2014‐53199‐C3‐3‐R, TIN2017‐85179‐C3‐3‐R.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

4FAD: A framework for mapping the evolution of artefacts in the learning design process

  • Muñoz Cristóbal, Juan Alberto
  • Hernández Leo, Davinia
  • Carvalho, Lucila
  • Martinez-Maldonado, Roberto
  • Thompson, Kate
  • Wardak, Dewa
  • Goodyear, Peter
A number of researchers have explored the role and nature of design in education, proposing a diverse array of life cycle models. Design plays subtly different roles in each of these models. The learning design research community is shifting its attention from the representation of pedagogical plans to considering design as an ongoing process. As a result, the study of the artefacts generated and used by educational designers is also changing: from a focus on the final designed artefact (the product of the design process) to the many artefacts generated and used by designers at different stages of the design process (e.g., sketches, reflections, drawings, or pictures). However, there is still a dearth of studies exploring the evolution of such artefacts throughout the learning design life cycle. A deeper understanding of these evolutionary processes is needed – to help smooth the transitions between stages in the life cycle. In this paper, we introduce the four-dimensional framework for artefacts in design (4FAD) to generate understanding and facilitate the mapping of the evolution of learning design artefacts. We illustrate the value of the framework by applying it in the analysis of an authentic design case., This research has been partially supported by the Spanish Projects TIN2011-28308-C03-02, TIN2014-53199-C3-2-R, TIN2014-53199-C3-3-R, TIN2017-85179-C3-2-R, TIN2017-85179-C3-3-R, MDM-2015-0502, RecerCaixa (CoT) and VA082U16, and by the Australian Research Council through Laureate grant FL100100203.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

EdCrumble, a data-enriched visual authoring design tool for blended learning

  • Albó, Laia
  • Hernández Leo, Davinia
This paper presents an evaluation of edCrumble, a blended learning authoring tool for teachers. The tool visually represents learning designs and integrates data analytics to scaffold teacher design decisions. In addition to assessing the usability of edCrumble using UMUX questionnaire, analyses of participant views on the advantages and disadvantages of the tool in comparison to traditional course planning approaches and participant-elicited factors that can facilitate or hinder adoption of the tool are presented. Three evaluation workshops were held with teachers of different backgrounds, educational stakeholders, and students. Data-gathering instruments included interviews and questionnaires to collect qualitative and quantitative data. Further, design artifacts resulting from the workshops were analysed. The evaluation shows that the tool possesses specific features that facilitate the representation of and support for designing blended learning, uncovers the factors that may promote or inhibit its adoption, exposes its connection with solving actual educational challenges, and reveals the strengths and weaknesses in the tools usability., This work was supported by the Spanish Ministry of Science (TIN2014-53199-C3-3-R and TIN2017-85179-C3-3-R), the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), RecerCaixa (CoT project) and the UPF PlaQUID2012. D.H.L acknowledges the support by ICREA under the ICREA Academia programme. (Corresponding author: Laia Albó).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

CIDA: a collective inquiry framework to study and support teachers as designers in technological environments

  • Michos, Konstantinos
  • Hernández Leo, Davinia
The use of new technologies such as learning analytics by teachers is challenging due to the changes they bring to teachers’ practices and their pedagogical interventions. A design approach into teaching has been proposed for mapping pedagogy with technology to effectively integrate these changes. However, limited collective approaches exist in which teachers participate in professional communities to build knowledge for the design and implementation of learning scenarios with learning analytics. In this paper, we propose a framework (CIDA) for collective inquiry in such professional communities of teachers. Based on other collective inquiry frameworks for knowledge building, we propose three interconnected components: the inquiry process, the collective process, and technological support to facilitate and study teachers´ design practices in technological environments. We explain the framework with examples of implemented technologies and present empirical results of three cases; two High schools and a Massive Open Online Course (MOOC). Results inform further how our framework can be implemented in practice and its required supports to facilitate knowledge building for inquiry communities of teachers., DHL is a Serra Húnter Fellow. This work has been partially funded by “la Caixa Foundation” (CoT project, 100010434); by the European Regional Development Fund and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities, under project grants TIN 2014-53199-C3-3-R, TIN2014-53199-C3-2-R, TIN 2017-85179-C3-2-R, TIN 2017-85179-C3-3-R, MDM-2015-0502
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Data-informed design parameters for adaptive collaborative scripting in across-spaces learning situations

  • Amarasinghe, Ishari
  • Hernández Leo, Davinia
  • Jonsson, Anders, 1973-
This study presents how predictive analytics can be used to inform the formulation of adaptive collaborative learning groups in the context of Computer Supported Collaborative Learning considering across-spaces learning situations. During the study we have collected data from different learning spaces which depicted both individual and collaborative learning activity engagement of students in two different learning contexts (namely the classroom learning and distance learning context) and attempted to predict individual student’s future collaborative learning activity participation in a pyramid-based collaborative learning activity using supervised machine learning techniques. We conducted experimental case studies in the classroom and in distance learning settings, in which real-time predictions of student’s future collaborative learning activity participation were used to formulate adaptive collaborative learner groups. Findings of the case studies showed that the data collected from across-spaces learning scenarios is informative when predicting future collaborative learning activity participation of students hence facilitating the formulation of adaptive collaborative group configurations that adapt to the activity participation differences of students in real-time. Limitations of the proposed approach and future research direction are illustrated., This work has been partially funded by FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R and “la Caixa Foundation” (CoT project, 100010434). DHL is a Serra Húnter Fellow.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Enhancing consent forms to support participant decision making in multimodal learning data research

  • Beardsley, Marc Yoshimi
  • Martínez Moreno, Judit
  • Vujovic, Milica
  • Santos Rodríguez, Patrícia
  • Hernández Leo, Davinia
Advances in the field of multimodal learning analytics (MMLA) research is often accomplished by actively exploring new technologies and techniques related to the collection and analysis of data. Exploration of ethical principles and procedures for governing the use of new technologies and techniques, however, is not as readily pursued. As collected data grow in complexity and invasiveness, potentially, a growing need is arising to scrutinize ethical aspects of MMLA research. In our study, we introduce an informed consent comprehension test for educational technology research and assess the effects of enhancing MMLA consent forms on comprehension of informed consent and on rates of enrollment in a MMLA study. One form is written from a researcher perspective and the other from a participant perspective. Results of the study involving first‐year undergraduate students suggest that the overall level of comprehension did not differ between conditions. Yet, the participant‐oriented consent form resulted in significantly lower rates of enrollment. Implications for MMLA researchers are discussed., This work was partially funded by the Spanish Ministry of Economy and Competitiveness under MDM-2015-0502, TIN2017-85179-C3-3-R. D. Hernández-Leo acknowledges financial support by ICREA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Learning design and learning analytics in mobile and ubiquitous learning: a systematic review

  • Pishtari, Gerti
  • Rodríguez-Triana, María Jesús
  • Sarmiento Márquez, Edna M.
  • Pérez Sanagustín, Maria del Mar
  • Ruiz Calleja, Adolfo
  • Santos Rodríguez, Patrícia
  • Prieto, Luis P.
  • Serrano Iglesias, Sergio
  • Väljataga, Terje
Mobile and Ubiquitous Learning (m/u‐learning) are finding an increasing adoption in education. They are often distinguished by hybrid learning environments that encompass elements of formal and informal learning, in activities that happen in distributed settings (indoors and outdoors), across physical and virtual spaces. Despite their purported benefits, these environments imply additional complexity in the design, monitoring and evaluation of learning activities. The research literature on learning design (LD) and learning analytics (LA) has started to deal with these issues. This paper presents a systematic literature review of LD and LA, in m/u‐learning. Apart from providing an overview of the current research in the field, this review elicits elements of common ground between both communities, as shown by the similar learning contexts and complementary research contributions, and based on the research gaps, proposes to: address m/u‐learning beyond higher education settings, reinforce the connection between physical and virtual learning spaces, and more systematically align LD and LA processes., This research was partially funded by EU grants 669074, 586120-EPP-1-2017-1-ES-EPPKA2CBHE-JP, and Spanish projects TIN2017-85179-C3-1-R, TIN2017-85179-C3-2-R, TIN201785179-C3-3-R, VA257P18.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Collaborative learning designs using PyramidApp: computer supported collaborative learning in classroom sessions

  • Amarasinghe, Ishari
  • Hernández Leo, Davinia
  • Manathunga, Kalpani
  • Beardsley, Marc Yoshimi
  • Bosch Garcia, Jordi
  • Carrió, Mar
  • Chacón Pérez, Jonathan, 1986-
  • Jimenez Morales, Manel
  • Llanos Santos, David
  • Lope Pastor, Silvia
  • Martínez Moreno, Judit
  • Santos Rodríguez, Patrícia
  • Vujovic, Milica
Comunicació presentada a: XI Congrés CIDUI 2021 celebrat del 29 de juny al 2 de juliol de 2021 de manera virtual., Designing effective collaborative learning activities for classroom is challenging. The PyramidApp is a tool that facilitates the implementation of the Pyramid pattern, shaping a collaboration structure that promotes the participation of all students and fruitful social interactions. This paper shows how this educational strategy can be applied to different types of tasks and subject matters, shedding light about how computer-supported collaborative learning can be incorporated in the classroom., This work has been partially funded by FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2017-85179-C3-3-R, and UPF PlaClik. Davinia Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.