Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 122
Encontrada(s) 2 página(s)

Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Synergies between humans and machines to support the orchestration of CSCL scripts at different scales

  • Amarasinghe, Ishari
  • Hernández Leo, Davinia
Comunicació presentada a: 14th International Conference on Computer-Supported Collaborative Learning (CSCL) celebrada del 7 a l'11 de juny de 2021 a Bochum, Alemanya., This study presents the orchestration challenges associated with scripted collaborative learning situations at different scales and how different Learning Analytics (LA) interventions may facilitate to address those issues. The proposed LA interventions were characterised as machine-in-control, human-in-control and hybrid approaches given different agents in charge of orchestration actions. A framing of the proposed LA interventions is presented considering also the different scales within which those interventions were deployed, in an attempt to seek the balance between different types of interventions., This work has been partially funded by FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2017-85179-C3-3-R. Davinia Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Teachers’ views about the impact of Learning Design Community platforms on Well-being

  • Hakami, Eyad
  • Hernández Leo, Davinia
Comunicació presentada a: International Symposium on Computers in Education (SIIE) celebrat el 23 i 24 de setembre de manera virtual., Since their first advent, digital technologies have been connected to ethical questions and concerns about their impact on people’s lives and the well-being of individuals and communities. This case study belongs to a broader framework where we apply an iterative process guided by IEEE P7010-2020 standard for Well-being Impact Assessment to a set of data-driven educational technologies to evaluate their impacts on well-being by collecting subjective and objective data from creators and users. In this paper, we survey teachers from Saudi Arabia (n=68) to investigate their views about the impact of learning design community platforms supported by learning analytics on their well-being based on well-being indicators distributed to twelve domains. The participants identified several possible well-being impacts that are well-aligned with the creators’ views. Yet, the potential negative well-being impacts indicated by the studied tool’s creators were less likely to occur from the users’ perspective., This work has been partially funded by the EU Regional Development Fund and the National Research Agency of the Spanish Ministry of Science and Innovation under project grants TIN2017-85179-C3-3-R, PID2020-112584RB-C33. D. Hernández-Leo (Serra Húnter) acknowledges the support by ICREA under the ICREA Academia program. E. Hakami acknowledges the grant by Jazan University, Saudi Arabia.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Citizen science, data science and education: how to support teacher’s inspiration during the learning activities design with technology enhance learning

  • Calvera Isabal, Miriam
  • Santos Rodríguez, Patrícia
  • Hernández Leo, Davinia
Comunicació presentada a: Doctoral Consortium of the Sixteenth European Conference on Technology Enhanced Learning (EC-TEL) celebrat de manera virtual del 20 al 24 de setembre de 2021., This research will investigate the potential that Citizen Science (CS) projects data has in a formal educational context to learn. CS involves citizens in scientific research generating knowledge and scientific results. Citizens participate in CS projects conducting many activities developing skills, interest in science or scientific literacy. These projects share their information in online repositories also called CS platforms to inform citizens about the aim of the project, their advances on research or how to take part in it. Although the connection between CS and education has been explored, remains to be understood and must be made more explicit. Web scraping and data mining methods have the potential to obtain CS projects data available online and analyze it to extract conclusions. The main aim of this research is to understand how to analyze and visualize CS data in a technology enhanced learning (TEL) tool to support educators during the learning design of educational activities. It is also intended to improve scientific knowledge and to bring official science closer to educational environments., This work has been partially funded by the CS Track project, European Union’s Horizon 2020 research and innovation program under grant agreement No 872522., a Grant for activities to increase the social impact of research” from UPF, the EU Regional Development Fund and the National Research Agency of the Spanish Ministry of Science and Innovation under project grants TIN2017-85179-C3-3-R, PID2020-112584RB-C33. D. Hernández-Leo (Serra Húnter) acknowledges the support by ICREA under the ICREA Academia program.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Maker education in primary education: changes in students’ maker-mindset and gender differences

  • Martínez Moreno, Judit
  • Santos, Patricia
  • Hernández Leo, Davinia
Comunicació presentada a: TEEM'21 celebrat del 27 a 29 d'octubre de 2021 a Barcelona, Espanya., Students must learn how to be prepared to enter the global digital network and acquire skills for the 21st century. Maker education allows for the development of such skills. This paper focuses on the implementation of Maker activities within a primary education context through a 10-hour programme across 10 schools. The study aims to analyse the possible impacts of maker education interventions on students’ Maker mindset (self-efficacy, interest and motivation), as well as assessing potential gender differences regarding their prior experience with Maker education and changes experienced on their Maker mindset. Questionnaires were administered before and after the programme's implementation on a sample of 239 students. Results showed that Maker interventions can have positive effects on students’ Maker mindset, increasing their self-efficacy, interest and motivation. In terms of gender differences, girls seemed to have less prior experience with Maker education than boys, yet they reported the same level of interest and motivation. This study contributes to demonstrating the positive impact that Maker education can have on primary education school settings in order to develop 21st century digital skills and bridging the gender gap in STEAM-related subjects., This work has been partially funded by the EU Regional Development Fund and the National Research Agency of the Spanish Ministry of Science, under project grants TIN2017-85179-C3-3-R, PID2020-112584RB-C33, MDM-2015-0502, the Ramon y Cajal programme (P. Santos) and by ICREA under the ICREA Academia programme (D. Hernández-Leo, Serra Hunter).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Emotion annotation of music: a citizen science approach

  • Gutiérrez Páez, Nicolás Felipe
  • Gómez Cañón, Juan Sebastián
  • Porcaro, Lorenzo
  • Santos Rodríguez, Patrícia
  • Hernández Leo, Davinia
  • Gómez Gutiérrez, Emilia, 1975-
Comunicació presentada a: 27th International Conference, CollabTech 2021 celebrat de manera virtual del 31 d'agost al 3 de setembre de 2021., The understanding of the emotions in music has motivated research across diverse areas of knowledge for decades. In the field of computer science, there is a particular interest in developing algorithms to “predict” the emotions in music perceived by or induced to a listener. However, the gathering of reliable “ground truth” data for modeling the emotional content of music poses challenges, since tasks related with annotations of emotions are time consuming, expensive and cognitively demanding due to its inherent subjectivity and its cross-disciplinary nature. Citizen science projects have proven to be a useful approach to solve these types of problems where there is a need for recruiting collaborators for massive scale tasks. We developed a platform for annotating emotional content in musical pieces following a citizen science approach, to benefit not only the researchers, who benefit from the generated dataset, but also the volunteers, who are engaged to collaborate on the research project, not only by providing annotations but also through their self and community-awareness about the emotional perception of the music. Likewise, gamification mechanisms motivate the participants to explore and discover new music based on the emotional content. Preliminary user evaluations showed that the platform design is in line with the motivations of the general public, and that the citizen science approach offers an iterative refinement to enhance the quantity and quality of contributions by involving volunteers in the design process. The usability of the platform was acceptable, although some of the features require improvements., This work has been partially funded by the TROMPA project, European Union’s Horizon 2020 research and innovation programme under grant agreement no. 770376. TIDE-UPF also acknowledges the support by FEDER, the National Research Agency of the Spanish Ministry of Science and Innovation, TIN2017-85179-C3-3-R, PID2020-112584RB-C33, MDM-2015-0502, the Ramon y Cajal programme (P. Santos) and by ICREA under the ICREA Academia programme (D. Hernández-Leo, Serra Hunter).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

The Challenge of gathering self-reported moods: Cases using a classroom orchestration tool

  • Beardsley, Marc Yoshimi
  • Vujovic, Milica
  • Theophilou, Emily
  • Hernández Leo, Davinia
  • Portero Tresserra, Marta
Comunicació presentada a: ICALT 2020 International Conference on Advanced Learning Technologies and Technology-enhanced Learning, organitzada a Tartu, Estònia, del 6 al 9 de juliol de 2020, Self-reports of affective states are increasingly being collected in educational settings. However, individual definitions and usage of emotion and mood terms are often subjective despite objective definitions becoming more widely accepted. We explore whether the variation among individual learners in how mood terms are defined presents an obstacle to using self-reported mood data for group comparison studies. Following a design-based research methodology, we ran two case studies to explore the use of ClassMood App in a multimodal learning study and the validity of the self-reported mood data it collected. During the first case, 24 primary school students experienced difficulty understanding the words used to describe the moods in ClassMood App. In the second case, involving 77 university students, we explored whether the misunderstanding of mood words persisted with older students. Participants were asked to rate their familiarity with and match definitions to a set of 8 mood words. We found that levels of familiarity with the mood words varied greatly and 17.9% of all definition matching attempts were incorrect. The results suggest that the variation in subjective definitions of mood terms is likely to affect the validity of the data collected by the ClassMood App for group comparison studies., This work has been partially funded by the European Regional Development Fund, Erasmus+, and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities, under project grants TIN2017-85179-C3-3-R, 2018-1-ESOI-KA20I-050646, and MDM-2015-0502. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Shall we learn together in loud spaces? Towards understanding the effects of sound in collaborative learning environments

  • Vujovic, Milica
  • Hernández Leo, Davinia
Comunicació presentada a: the 13th International Conference on Computer Supported Collaborative Learning (CSCL), celebrada del 17 al 21 de juny de 2019 a Lió, França., In this paper we question the role of environmental sound on the process of CL. The first pilot study is presented where we investigated effects of environmental sound on EDA and voice VA of the participants. The created visualization presents the dependence between mentioned parameters and serves as an awareness tool for participants in CL. Preliminary results are provocative; there seems to be mentioned dependences and participants accept the proposed visualization as a useful tool to support self-regulation during CL., This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No. 713673. Milica Vujovic has received financial support through the “la Caixa” INPhINIT Fellowship Grant for Doctoral studies at Spanish Research Centres of Excellence, “la Caixa” Banking Foundation, Barcelona, Spain. This work has been partially supported by the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Round or rectangular tables for collaborative problem solving? A multimodal learning analytics study

  • Vujovic, Milica
  • Hernández Leo, Davinia
  • Tassani, Simone
  • Spikol, Daniel
The current knowledge of the effects of the physical environment on learners’ behaviour in collaborative problem‐solving tasks is underexplored. This paper aims to critically examine the potential of multimodal learning analytics, using new data sets, in studying how the shapes of shared tables affect the learners’ behaviour when collaborating in terms of patterns of participation and indicators related to physical social interactions. The research presented in this paper investigates this question considering the potential interplay with contextual aspects (level of education) and learning design decisions (group size). Three dependent variables (distance between students, range of movement and level of participation) are tested using quantitative and qualitative analyses of data collected using a motion capture system and video recordings. Results show that the use of round tables (vs rectangular tables) leads to higher levels of on‐task participation in the case of elementary school students. For university students, different table shapes seem to have a limited impact on their levels of participation in collaborative problem solving. The analysis shows significant differences regarding the relationship between group size and the distance between students, but there is no substantial evidence that group size affects the level of participation. The findings support previous research highlighting the importance of studying the role of the physical environment as an element of learning design and the potential of multimodal learning analytics in approaching these studies., This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No. 713673. M. Vujovic has received financial support through the “La Caixa” INPhINIT Fellowship Grant for Doctoral studies at Spanish Research Centres of Excellence, “La Caixa” Banking Foundation, Barcelona, Spain. D. Hernández-Leo acknowledges the financial support from ICREA under the ICREA Academia programme. This work has been partially supported by the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM2015-0502, TIN2017-85179-C3-3-R.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Deconstructing orchestration load: comparing teacher support through mirroring and guiding

  • Amarasinghe, Ishari
  • Hernández Leo, Davinia
  • Hoppe, H. Ulrich
Under the notion of “CSCL scripts”, different pedagogical models for structuring and supporting collaboration in the classroom have been proposed. We report on a practical experience with scripts based on the Pyramid collaborative learning flow pattern supported by a specific classroom tool and a teacher-facing dashboard that implements mirroring and guiding support. The input data of our analysis stems from recordings of classroom interactions guided by several teachers using the PyramidApp with different levels of teaching support. For the analysis, we introduce a specific coding scheme enabling a quantitative comparison and deeper analysis using epistemic network analysis. The results show that the guiding support enabled teachers to perform more orchestration actions, more targeted interactions and to make more announcements to the class (regarding time, phase transitions, and students’ activity participation) when compared to the mirroring support. Teachers’ actionable differences observed under the mirroring and guiding support directed us to deconstruct the notion of orchestration load into different facets and to discuss how different support provisions correspond to the different facets of orchestration load., TIDE-UPF acknowledges the support by FEDER, the National Research Agency of the Spanish Ministry, TIN2017-85179-C3-3-R, PID2020-112584RB-C33, MDM-2015-0502, and by ICREA under the ICREA Academia programme (D. Hernández-Leo, Serra Hunter).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Examining university students’ motivation, abilities and preferences related to learning to learn

  • Beardsley, Marc Yoshimi
  • Gutierrez, Nicolas
  • Hernández Leo, Davinia
Comunicació presentada a: ICALT 2020 International Conference on Advanced Learning Technologies and Technology-enhanced Learning, organitzada a Tartu, Estònia, del 6 al 9 de juliol de 2020, Learning to learn has been identified as an underdeveloped yet critical skill for learners. However, interventions often struggle to alter learner behavior in a lasting manner. We conducted a quasi-experimental study, guided by the Fogg Behavior Model, that involved 83 first-year university students in a computer engineering degree program. Our study examined learner levels of motivation, self-assessments of their abilities, and preferences for future interventions related to learning to learn. Our results suggest that student learning to learn skills are underdeveloped, not all students are motivated to improve their learning skills, and ICT-based solutions are preferred to more traditional educational approaches., This work was partially funded by the European Regional Development Fund, Erasmus+, and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities, under project grants TIN2017-85179-C3-3-R, 2017-1-ESOI-KA201-038220 and MDM-2015-0502. D. Hernandez-Leo acknowledges the support by ICRA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

EdCrumble, a data-enriched visual authoring design tool for blended learning

  • Albó, Laia
  • Hernández Leo, Davinia
This paper presents an evaluation of edCrumble, a blended learning authoring tool for teachers. The tool visually represents learning designs and integrates data analytics to scaffold teacher design decisions. In addition to assessing the usability of edCrumble using UMUX questionnaire, analyses of participant views on the advantages and disadvantages of the tool in comparison to traditional course planning approaches and participant-elicited factors that can facilitate or hinder adoption of the tool are presented. Three evaluation workshops were held with teachers of different backgrounds, educational stakeholders, and students. Data-gathering instruments included interviews and questionnaires to collect qualitative and quantitative data. Further, design artifacts resulting from the workshops were analysed. The evaluation shows that the tool possesses specific features that facilitate the representation of and support for designing blended learning, uncovers the factors that may promote or inhibit its adoption, exposes its connection with solving actual educational challenges, and reveals the strengths and weaknesses in the tools usability., This work was supported by the Spanish Ministry of Science (TIN2014-53199-C3-3-R and TIN2017-85179-C3-3-R), the Maria de Maeztu Units of Excellence Programme (MDM-2015-0502), RecerCaixa (CoT project) and the UPF PlaQUID2012. D.H.L acknowledges the support by ICREA under the ICREA Academia programme. (Corresponding author: Laia Albó).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Towards socially shared regulation within CSCL scripts: mirroring group participation in PyramidApp

  • Theophilou, Emily
  • Amarasinghe, Ishari
  • Hernández Leo, Davinia
  • Lobo Quintero, René Alejandro
  • Crespi, Francisco
Comunicació presentada a: LASI Spain celebrat de manera híbrida del 7 al 9 de juliol de 2021 a Barcelona, Espanya., Computer-Supported Collaborative Learning (CSCL) has been shown to enhance learning by promoting peer interactions. With the support of collaborative learning flow patterns (CLFP), the collaboration process within the socalled CSCL macro-scripts can be further structured and constrained. However, social dynamics within tasks, even within scripts, have the potential to hinder the collaborative element as students might not participate sufficiently in conversations. To determine if participation in discussions between students was balanced within a CSCL script we analysed data from an implementation of the Pyramid CLFP. The data showed that student participation varied across different groups, with some groups and students not initiating conversation between them. Socially shared regulation is a social form of regulation where students regulate their learning as a group rather than as individuals through the means of discussion, negotiation, and perspective taking. As research has shown that for collaborative learning to be successful students need to engage in fruitful discussions and support each other to regulate their learning, we propose the implementation of a social awareness feature mirroring group participation through learning analytics in a CLFP tool (PyramidApp) to promote socially shared regulated learning., This work has been partially funded by the Volkswagen Foundation in the framework of the project COURAGE (no. 95567) and by FEDER, the National Research Agency of the Spanish Ministry, TIN2017-85179-C3-3-R and MDM-2015-0502. D. Hernández-Leo also acknowledges the support of ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Supporting awareness in communities of learning design practice

  • Michos, Konstantinos
  • Hernández Leo, Davinia
The field of learning design has extensively studied the use of technology for the authoring of learning activities. However, the social dimension of the learning design process is still underexplored. In this paper, we investigate communities of teachers who used a social learning design platform (ILDE). We seek to understand how community awareness facilitates the learning design activity of teachers in different educational contexts. Following a design-based research methodology, we developed a community awareness dashboard (inILDE) based on the Cultural Historical Activity Theory (CHAT) framework. The dashboard displays the activity of teachers in ILDE, such as their interactions with learning designs, other members, and with supporting learning design tools. Evaluations of the inILDE dashboard were carried out in four educational communities – two secondary schools, a master programme for pre-service teachers, and in a Massive Open Online Course (MOOC) for teachers. The dashboard was perceived to be useful in summarizing the activity of the community and in identifying content and members’ roles. Further, the use of the dashboard increased participants’ interactions such as profile views and teachers showed a willingness to build on the contributions of others. As conclusions of the study, we propose five design principles for supporting awareness in learning design communities, namely community context, practice-related insights, visualizations and representations, tasks and community interests., This work has been partially funded by RecerCaixa (CoT project) and the Spanish Ministry of Economy and Competitiveness under MDM-2015-0502, TIN2014–53199-C3-3-R, TIN2017-85179-C3-3-R.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Towards estimating classroom orchestration load using physiological and self-perception measures

  • Amarasinghe, Ishari
  • Vujovic, Milica
  • Hernández Leo, Davinia
Comunicació presentada a: 14th International Conference on Computer-Supported Collaborative Learning (CSCL) celebrada del 7 a l'11 de juny de 2021 a Bochum, Alemanya., This poster presents the exploration of a method to estimate the notion of orchestration load using physiological measures in triangulation with self-perception measures in the classroom computer-supported collaborative learning (CSCL) context. Details of a pilot study conducted in which a teacher orchestrated CSCL activities under different supporting conditions are presented. Different facets of the orchestration load were disentangled in light of the study findings., This work has been partially funded by FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2017-85179-C3-3-R. Davinia Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Awareness tools for monitoring socio-emotional regulation during collaboration in settings outside school without teacher supervision

  • Velamazán, Mariano
  • Santos, Patricia
  • Hernández Leo, Davinia
Comunicació presentada a 16th European Conference on Technology Enhanced Learning (EC-TEL 2021), celebrat del 20 al 24 de setembre de 2021 de manera virtual., There are several awareness tools developed to research how to support different phases and modes of socio-emotional regulation of learning. Most of these tools have focused on only one mode of regulation (self-, co- or socially-shared) or on one phase (planning, monitoring or reflection) and have been tested in formal settings and at specific, researchers’ predetermined, moments of collaboration (at the beginning, in the middle or at the end of collaboration). In this paper we extend previous research in this area to propose a new tool that could be more naturally integrated during the whole process of collaboration in the underexplored context of informal settings without teacher supervision. The tool presented introduces some features that aim at facilitating a better understanding of social and emotional interactions and regulation of learning. More precisely, the tool supports a communication flow during the monitoring phase of regulation and includes: a) the possibility to be used by a large number of groups of learners, b) awareness tools for monitoring self-, co- and socially-shared emotional regulation c) at any time needed during collaboration, and d) includes other affordances that should indirectly support a better asynchronous collaboration., This work has been partially funded by FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities TIN2017-85179-C3-3-R, PID2020-112584RB-C33. Davinia Hernández-Leo (Serra Húnter) acknowledges the support by ICREA under the ICREA Academia programme. Patricia Santos acknowledges the support by the Spanish Ministry of Science and Innovation under the Ramón y Cajal programme.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Supporting the planning of hybrid-MOOCs learning designs

  • Albó, Laia
  • Butera Castelo, Rodrigo
  • Hernández Leo, Davinia
Comunicació presentada a la Conferència European MOOCs Stakeholders Submmit 2019 celebrada del 20 al 22 de maig de 2019 a Nàpols, Itàlia., This paper presents a work-in-progress solution for planning hybrid Massive Open Online Courses (MOOC). The use of MOOCs in brick and mortar courses presents several design challenges. One of them is to find the most suitableonline course regarding the alignment with the face-to-face course structure, timelineand syllabus. Despite there are different lesson planning and design tools which support educators in the design of their courses, there is a lack of solutions allowing to incorporate the use of MOOC or MOOC resources in the planning processof blended courses. In this paper, we present aMOOC design module for being used in design authoring toolswhich aim to support theplanning of blended courses thatincorporate MOOCs (or MOOCs resources). We discuss twodifferent solutions for gathering information regarding existing MOOCs in the market: the creation of our own MOOC database versus the parsing of MOOC information from existing search engines on demand. Our exploration leadsus to discard the first solution as maintaining the database is highly demanding. Thus, the final system uses existing MOOC search engines to extract the online courses design information to later be used in the overall hybrid-course planning. As it is a work-in-progress article, we present and discuss our future steps for supporting educators in the of design hybrid MOOCs scenarios., This work has been partially funded by “la Caixa Foundation” (CoTproject, 100010434) and FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R. DHL is a Serra Húnter Fellow.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

El papel de los espacios como facilitadores del aprendizaje colaborativo: Estudio cualitativo en Grados en Ingeniería y Másteres TIC de la UPF

  • Santos Rodríguez, Patrícia
  • Moreno, Verónica
  • Hernández Leo, Davinia
Este artículo presenta los resultados obtenidos en un análisis realizado en estudios de grado y master (ámbitos de ingeniería y TIC) de la UPF enfocado en el papel que juegan los espacios colaborativos de aprendizaje (físicos y virtuales) ofrecidos por la universidad en actividades académicas. El estudio usa una metodología cualitativa para la recogida de datos. Los resultados obtenidos muestran un diagnóstico de la situación actual, incluyendo buenas prácticas que podrían reforzarse en el futuro o aspectos de mejora a considerar en la reformulación de los espacios de aprendizaje., This article presents the results obtained in a study carried out in Studies of Engineering Degrees and ICT Masters at UPF. Its purpose is the study of the role of collaborative learning spaces (physical and virtual) offered by the university in academic activities. The study uses a qualitative methodology for data collection. The results show a diagnosis of the current situation, including best practices that could be strengthened in the future or aspects of improvement to be considered in the reformulation of learning spaces., Este trabajo ha sido parcialmente financiado por el programa UPF PlaClik y el Fondo de Desarrollo Regional de la UE y la Agencia Nacional de Investigación del Ministerio de Ciencia, Innovación y Universidades de España (TIN2017-85179-C3-3-R).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Flexible CSCL orchestration technology: mechanisms for elasticity and dynamism in pyramid script flows

  • Manathunga, Kalpani
  • Hernández Leo, Davinia
Comunicació presentada a: the 13th International Conference on Computer Supported Collaborative Learning (CSCL), celebrada del 17 al 21 de juny de 2019 a Lió, França., Flow patterns (e.g., Pyramid or Snowball) formulate good practices to script collaborative learning scenarios, which have been experimented in small-scale settings widely. Applying flow patterns on large-scale contexts present challenges to educators in terms of orchestration load. Orchestration technology can support educators to manage collaborative activities; yet existing technology do not address flexibility challenges like accommodating growing numbers of students or tolerating dynamic conditions in learning settings. We define elasticity and dynamism as two key elements in the flexibility of a script. Elasticity is related to the capacity of an orchestration technology to incorporate varying participant counts. Dynamism is the capacity to maintain a pedagogically meaningful script progression in presence of different individual behaviors. In this paper we propose flow creation and flow control mechanisms to address elasticity and dynamism in orchestration technology for Pyramid flows. These mechanisms, implemented in the PyramidApp tool, have been evaluated across four scenarios varying from small to large settings. The results show that rules enabling pyramid creation on-demand and the use of timers are useful to achieve elasticity and dynamism in the pyramid formation and progression in an automatic manner., DHL is a Serra Húnter fellow. This work has been partially funded by “la Caixa Foundation” (CoT project, 100010434) and the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

An actionable orchestration dashboard to enhance collaboration in the classroom

  • Amarasinghe, Ishari
  • Hernández Leo, Davinia
  • Michos, Konstantinos
  • Vujovic, Milica
The orchestration of collaborative learning activities in technology-enhanced classrooms has become a nontrivial endeavor for educators. Depending on the behaviors and needs of students that emerge in real educational situations, educators may need to orchestrate activity adaptations on the fly. These adaptations may range from the provision of additional scaffolding by the educator (e.g., the educator's participation in a group discussion) to a change in the planned pedagogical scenario (e.g., the duration). This article aims to contribute to the orchestration of technology-mediated collaborative learning sessions in a classroom context. We present the design, implementation, and evaluation of a teacher-facing dashboard that supports teachers in orchestrating scripted collaboration. Evaluation studies were conducted in 16 classroom sessions. The findings indicate that teachers found the information on the dashboard to be actionable and help facilitate just in time support to student groups., This work has been partially funded by "la Caixa Foundation" (CoT project, 100010434) and the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015- 0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Understanding participants motivational factors for the design of a teacher community

  • Gutiérrez Páez, Nicolás Felipe
  • Santos Rodríguez, Patrícia
  • Hernández Leo, Davinia
Comunicació presentada a: 21st International Conference on Advanced Learning Technologies (ICALT 2021) celebrat del 12 al 15 de juliol de 2021 a Tartu, Estonia., Online communities (OC) offer teachers a context for mutual inspiration, collaboration, and professional development. Yet, despite there being several studies analyzing teachers’ motivations to participate in these communities, it is still unclear how these motivations relate with the supporting collaborative platforms and how they can serve as an input for defining and prioritizing design requirements. A survey study was conducted with the participants of an open online and a face-toface training course in the different phases of a 'Maker' educational activity, which were introduced to a supporting platform for sharing, exploring, and co-creating learning designs. Information about 170 teachers’ self-reported motivations to participate in a collaborative environment and their perceptions about the usefulness of the implemented features was gathered. Findings show that participants’ main motivations are not only to gain knowledge, but also include to have fun or to collaborate with the community development. Regarding their perception about the supporting platform, more than the 30% of the participants acknowledged the usefulness of the features implemented and identified the lack of resources and training as the main limitations to participate. Results provide evidence of the importance of the participants motivations to determine design requirements for a platform to enhance collaboration within an OC of teachers., This work has been partially funded by FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities TIN2017-85179-C3-3-R. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Distributed retrieval practice enhances primary school students’ retention of computational thinking concepts

  • Casanova de Vilalta, Lydia
  • Theophilou, Emily
  • Beardsley, Marc Yoshimi
  • Santos Rodríguez, Patrícia
  • Hernández Leo, Davinia
Comunicació presentada al 17th International Conference on Cognition and Exploratory Learning in Digital Age (CELDA 2020), celebrat del 18 al 20 de novembre de 2020 a Lisboa, Portugal., Efforts are being made to add Computational Thinking (CT) to the curriculum of primary schools in order to develop student abilities to use computational tools to solve problems and better prepare them for an increasingly digital society. Distributed Practice (DP) and Retrieval Practice (RP) are evidence-based practices that have shown to lead to efficient and durable learning. Studies investigating Distributed Retrieval Practice (DRP), a combination of the two evidence-based practices, have found positive effects of DRP on university student learning of anatomy and vocabulary items. As CT is considered to be a complex thinking skill, one that is acquired over time with practice, we investigated whether DRP had durable effects on primary student learning of CT concepts. We conducted a quasi-experimental study involving 20 primary school students between 11 and 12 years of age. The students participated in 6 weekly sessions on CT and completed two tests – one at the end of the fifth session (immediate) and the other a week later (delayed). At the end of each of the first 4 sessions, students performed DRP by completing a class-wide review quiz consisting of 5 multiple-choice questions. The results of the study show that students attained higher scores on the delayed test (72.6% ± 19.2) in comparison to the immediate test (67.9% ± 20.7). However, the difference in scores was not significant. The results suggest that DRP may play a role in helping students overcome the natural decay of memory, however, studies with a larger sample size are required. Further, this study demonstrates that DRP can be applied in an authentic classroom environment that involves primary school student learning of a complex subject such as CT., This work has been partially funded by the European Regional Development Fund, Erasmus+, and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities under project grants TIN2017-85179-C3-3-R, 2017-1-ES01-KA201-038220 and MDM-2015-0502. Dr. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Learning to learn: university student perceptions of a science of learning intervention

  • Beardsley, Marc Yoshimi
  • Martínez Moreno, Judit
  • Hernández Leo, Davinia
Comunicació presentada a: XI Congrés CIDUI celebrat del 30 de juny al 2 de juliol de 2021 de manera virtual., Many students use ineffective learning strategies and lack confidence in their learning skills and knowledge. This paper presents the results of a pre- and post-survey study involving first-year university students that completed a 2-hour classroom lesson on the science of learning and learning skills. The results of the study confirm that students perceive that they lack knowledge and confidence about learning; and that students found a lesson on the science of learning to be beneficial., This work was partially funded by the European Regional Development Fund, Erasmus+, and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities, under project grants TIN2017-85179-C3-3-R, 2017-1-ES01-KA201-038220 and MDM-2015-0502. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Teachers’ self-perception in maker education: three approaches for STEM professional development

  • Martínez Moreno, Judit
  • Santos Rodríguez, Patrícia
  • Hernández Leo, Davinia
Comunicació presentada a: 21st International Conference on Advanced Learning Technologies (ICALT) celebrat del 12 al 15 de juliol de 2021 a Tartu, Estònia., This paper analyzes the effect that three different approaches for teacher professional development based on the maker education have on teachers’ self-perceived ability for implementing the maker educational practices. The results indicate that there is a significant improvement regarding the feeling of being able to design maker-based educational lessons after participating in any of the professional development courses. Concretely, individual and practical activities requiring the development of a maker project are the ones that help the most to improve teachers’ self-perception regarding the maker and STEM education in primary education levels., This work has been partially funded by the EU Regional Development Fund and the National Research Agency of the Spanish Ministry of Science, under project grants TIN2017-85179-C3-3-R, MDM-2015-0502. Dr. Hemández- Leo acknowledges the support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Understanding the well-being impact of a computer-supported collaborative learning tool: the case of PyramidApp

  • Hakami, Eyad
  • Hernández Leo, Davinia
  • Amarasinghe, Ishari
Comunicació presentada a: 16th European Conference on Technology Enhanced Learning, EC-TEL celebrat del 20 al 24 de setembre de 2021 de manera virtual., The global efforts toward evaluating the impact of the use of data-driven technologies on humans’ well-being continue to establish societal guidelines for such systems to remain human-centric, serving humanity’s values and safeguarding well-being. In this paper, we apply the first activity of IEEE P7010 recommended practice, a methodology and a set of metrics, to understand the well-being impact of a web-based tool (PyramidApp) that allows teachers to design and deploy Pyramid-pattern based collaborative learning activities in classroom learning scenarios. The tool’s creators who are learning technology researchers (n = 2) and a sample of the tool’s users and stakeholders who are undergraduate students (n = 11), master students (n = 14) and instructors (n = 2) are engaged in surveys and interviews to investigate the tool’s well-being impact by reflecting on well-being indicators distributed to multiple well-being domains. The findings discuss possible impacts of the tool on the well-being domains of life satisfaction, affect, psychological state, community, education, government, human settlement and work. The creators also share views about the extent to which the use of IEEE P7010 increases their awareness of the intended and unintended impacts of their tool on well-being., This work has been partially funded by the EU Regional Development Fund and the National Research Agency of the Spanish Ministry of Science and Innovation under project grants TIN2017-85179-C3-3-R, PID2020-112584RB-C33. D. Hernández-Leo (Serra Húnter) acknowledges the support by ICREA under the ICREA Academia program. E. Hakami acknowledges the grant by Jazan University, Saudi Arabia.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

ClassMood App: a classroom orchestration tool for identifying and influencing student moods

  • Beardsley, Marc Yoshimi
  • Vujovic, Milica
  • Portero Tresserra, Marta
  • Hernández Leo, Davinia
Comunicació presentada a: EC-TEL 2019 celebrat a Delft, Països Baixos, del 16 al 19 de setembre de 2019., Certain affective states are less conducive to learning than others. Moreover, results from studies suggest that a classroom’s social-emotional climate affects student motivation and performance; and that moods can be automatically transferred among individuals in a group. The ClassMood App is an online classroom orchestration tool for social emotional learning that identifies the aggregate mood of a class and suggests classroom activities for educators to help shift the class mood to one that is more conducive to learning. Suggested activities are categorized based on how they aim to impact students’ internal state of arousal. The application aims to facilitate learner and educator development of self-awareness and self-management competencies consistent with the CASEL framework for systemic social and emotional learning. Preliminary results, conducted as part of an iterative designed-based research process, suggest that the tool is perceived as being easy-to-use for both educators and undergraduate students., This work has been co-funded by the European Union, Project Number 2018-1-ES01-KA201-050646 (Spotlighters) under the Erasmus + programme; and partially supported by FEDER, the National Research Agency of the Spanish Ministry of Science MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R. DHL is a Serra Húnter Fellow. Note: The material in this paper reflects only the authors’ views and the European Commission cannot be held responsible for any use that may be made of the information it contains. The authors want to thank Pablo Abenia for the technical implementation of the application, and Minna Huotilainen for her advice regarding the student graphical interface.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Emergency remote teaching: capturing teacher experiences in Spain with SELFIE

  • Albó, Laia
  • Beardsley, Marc Yoshimi
  • Martínez Moreno, Judit
  • Santos Rodríguez, Patrícia
  • Hernández Leo, Davinia
Comunicació presentada a: the 15th European Conference on Technology Enhanced Learning, EC-TEL 2020, celebrada del 14 al 18 de setembre de 2020 a Heidelberg, Alemanya., COVID-19 thrust teachers into emergency online pedagogy. Teachers had to rapidly digitize their practices. A week into compulsory online teaching, we captured a snapshot of teacher experiences to identify their impressions of support received and the challenges they faced in relation to teaching remotely. We conducted a survey study with primary and secondary school teachers in Spain. 67 teachers completed an adapted version of SELFIE to measure the way digital technologies are used for teaching. Respondents were directed to mark two responses to each survey item to reflect the situations both before and during the pandemic. Results indicate that during the pandemic teachers had more training opportunities, found online professional training to be of greater use, and gained confidence in using a wide variety of technologies for both teaching and communicating with parents and students. However, the digital divide among students and a lack of technical resources and support affected their abilities to carry out online education effectively. Our study highlights teachers’ perspectives on the rapid advancement of digital competences and technology in education. Information that can inform TEL research and interventions., This work has been partially funded by the EU Regional Development Fund, the National Research Agency of the Spanish Ministry of Science, Innovation and Universities and Erasmus+, under project grants TIN2017-85179-C3-3-R, 2019-1-FI01-KA201-060881, 2019-1-ES01-KA201-065279. D.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Enhancing consent forms to support participant decision making in multimodal learning data research

  • Beardsley, Marc Yoshimi
  • Martínez Moreno, Judit
  • Vujovic, Milica
  • Santos Rodríguez, Patrícia
  • Hernández Leo, Davinia
Advances in the field of multimodal learning analytics (MMLA) research is often accomplished by actively exploring new technologies and techniques related to the collection and analysis of data. Exploration of ethical principles and procedures for governing the use of new technologies and techniques, however, is not as readily pursued. As collected data grow in complexity and invasiveness, potentially, a growing need is arising to scrutinize ethical aspects of MMLA research. In our study, we introduce an informed consent comprehension test for educational technology research and assess the effects of enhancing MMLA consent forms on comprehension of informed consent and on rates of enrollment in a MMLA study. One form is written from a researcher perspective and the other from a participant perspective. Results of the study involving first‐year undergraduate students suggest that the overall level of comprehension did not differ between conditions. Yet, the participant‐oriented consent form resulted in significantly lower rates of enrollment. Implications for MMLA researchers are discussed., This work was partially funded by the Spanish Ministry of Economy and Competitiveness under MDM-2015-0502, TIN2017-85179-C3-3-R. D. Hernández-Leo acknowledges financial support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Smartphones or laptops in the collaborative classroom? A study of video-based learning in higher education

  • Albó, Laia
  • Hernández Leo, Davinia
  • Moreno Oliver, Verónica
This paper explores how the use of smartphones vs. laptops influences students’ engagement, behaviour and experience watching academic videos in a collaborative classroom. Experiments were run in authentic teaching sessions with a total of 483 first-year higher education students. The methodology applied is a quasi-experimental design with post-test-only, being the independent variable, the device used to visualise the academic videos. Results indicate that the use of laptops has provided better results in terms of student’s engagement with the videos, their collaborative behaviour and satisfaction with the device. Hence, the findings of this research suggest that the type of mobile device used in activities that consider the use of videos in a collaborative class need to be carefully chosen to maximise the student’s comfortability – and in consequence, their engagement with the video-based learning activity and their positive behaviour and experience within the collaborative context., This work was supported by Ministerio de Ciencia y Tecnología [grant number MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R], Universitat Pompeu Fabra (UPF) [grant number PlaQUID2012], and RecerCaixa [grant number Communities of Teaching (CoT) Project].
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Teacher-led inquiry in technology-supported school communities

  • Michos, Konstantinos
  • Hernández Leo, Davinia
  • Albó, Laia
Learning design is a research field which studies how to best support teachers as designers of Technology Enhanced Learning (TEL) situations. Although substantial work has been done in the articulation of the learning design process, little is known about how learning designs are experienced by students and teachers, especially in the context of schools. This paper empirically examines if a teacher inquiry model, as a tool for systematic research by teachers into their own practice, facilitates the connection between the design and data‐informed reflection on TEL interventions in two school communities. High school teachers participated in a learning design professional development program supported by a web‐based community platform integrating a teacher inquiry tool (TILE). A multiple case study was conducted aimed at understanding: (a) current teacher practice and (b) teacher involvement in inquiry cycles of design and classroom implementations with technologies. Multiple data sources were used over a one year period including focus groups transcripts, teacher interview protocols, digital artifacts, and questionnaires. Sharing teacher‐led inquiries together with learning analytics was perceived as being useful for connecting pedagogical intentions with the evaluation of their enactment with learners, and this differed from their current practice. Teachers’ reflections about their designs focused on the time management of learning activities and their familiarity with the enactment and analytics tools. Results inform how technology can support teacher‐led inquiry and collective reflective practice in schools., This work has been partially funded by RecerCaixa (CoT project) and the Spanish Ministry of Economy and Competitiveness under MDM-2015-0502, TIN2014-53199-C3-3-R and TIN2017-85179-C3-3-R.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Motion capture as an instrument in multimodal collaborative learning analytics

  • Vujovic, Milica
  • Tassani, Simone
  • Hernández Leo, Davinia
Comunicació presentada a: EC-TEL 2019 celebrat a Delft, Països Baixos, del 16 al 19 de setembre de 2019., In this paper, we describe an exploratory study where we investigate the possibilities of motion capture system as an instrument to consider in multi-modal analyses of face-to-face collaborative learning scenarios. The goal is to understand to what extent motion capture can facilitate certain measurements leading to collaborative learning indicators that are currently time-consuming to achieve with other instruments. We focus on the simultaneous measurement of known physical collaboration indicators such as gaze direction, the distance be-tween learners and the speed of movement/reactions. The study considers a lab setting simulating a classroom scenario based on the Jigsaw collaborative learn-ing flow pattern, which proposes a sequence of activities with changes in group size and formation. Preliminary results indicate a high degree of applicability of the system in measuring these indicators, with certain limitations for gaze direc-tion measurements. With appropriate marker position on the participants, the sys-tem is able to automatically provide desired measurements with satisfactory pre-cision. Additionally, with a small number of additional markers, we were able to determine the way students used working surfaces (shared desks)., This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No. 713673. Milica Vujovic has received financial support through the “la Caixa” INPhINIT Fellowship Grant for Doctoral studies at Spanish Research Centres of Excellence, “la Caixa” Banking Foundation, Barcelona, Spain. This work has been partially supported by the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2014- 53199-C3-3-R, TIN2017-85179-C3-3-R.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Talking to plants: an IoT system supporting human-plant interactions and learning

  • Tabuenca, Bernardo
  • Greller, Wolfgang
  • Hernández Leo, Davinia
  • Gilarranz-Casado, Carlos
  • García-Alcántara, Vicente
  • Tovar, Edmundo
The presence of plants in learning spaces can substantially improve well-being among students and teachers. Plants can positively influence environmental parameters such as air quality, temperature, or reverberation, but they also have an impact on parameters such as concentration, collaboration, and learning performance. This study aims to use plants as a learning object to promote ecological learning spaces. The paper presents an IoT system (Smart Spike) designed to collect data, and to provide real-time feedback on the state of the plant, soil, and environment variables. Moreover, this prototype was evaluated by 62 students of Agronomics and Computer Engineering to explore what measurements they considered most relevant, and how they would communicate with the plant using a mobile chatbot. The results aim to establish a better understanding of potential interactions between plants, learners, teachers, and the microclimate with a view to scaffolding learning activities supported by IoT technology and artificial intelligence., This work was funded through Erasmus+ Strategic Partnerships for Higher Education project TEASPILS (2020-1-ES01-KA203-082258). Partial support has also been received from the Madrid Regional Government through the e-Madrid-CM Project under grant S2018/TCS-4307, a project which is co-funded by the European Structural Funds (FSE and FEDER) and the Spanish Ministry TIN2017-85179-C3-3-R, PID2020-112584RBC33. MDM-2015-0502. D. Hernández-Leo (Serra Húnter) acknowledges the support by ICREA under the ICREA Academia program.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

How are learning analytics considering the societal values of fairness, accountability, transparency and human well-being?: a literature review

  • Hakami, Eyad
  • Hernández Leo, Davinia
Comunicació presentada al LASI-SPAIN 2020: Learning Analytics Summer Institute Spain 2020, celebrat del 15 al 16 de juny de 2020 a Valladolid, Espanya., The scientific community is currently engaged in global efforts towards a movement that promotes positive human values in the ways we formulate and apply Artificial Intelligence (AI) solutions. As the use of intelligent algorithms and analytics are becoming more involved in how decisions are made in public and private life, the societal values of Fairness, Accountability and Transparency (FAT) and the multidimensional value of human Well-being are being discussed in the context of addressing potential negative and positive impacts of AI. This research paper reviews these four values and their implications in algorithms and investigates their empirical existence in the interdisciplinary field of Learning Analytics (LA). We present and highlight results of a literature review that was conducted across all the editions of the Learning Analytics & Knowledge (LAK) ACM conference proceedings. The findings provide different insights on how these societal and human values are being considered in LA research, tools, applications and ethical frameworks., This work has been partially funded by the EU Regional Development Fund and the National Research Agency of the Spanish Ministry of Science and Innovation under project grants TIN2017-85179-C3-3-R, RED2018- 102725-T. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia program.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Human-centred design to empower ‘teachers as designers’

  • Garreta Domingo, Muriel
  • Sloep, Peter B.
  • Hernández Leo, Davinia
Educators of all sectors are learning designers, often unwittingly. To succeed as designers, they need to adopt a design mindset and acquire the skills needed to address the design challenges they encounter in their everyday practice. Human-centred design (HCD) provides professional designers with the methods needed to address complex problems. It emphasizes the human perspective throughout the design lifecycle and provides a practice-oriented approach, which naturally fits educators’ realities. This research reports the experiences of educators who used HCD to design ICT-based learning activities. A mixed-methods approach was used to gauge how participating educators experienced the design tasks. The perceived level of difficulty and value of the various methods varied, revealing significant differences between educators according to their level of knowledge of pedagogy frameworks. We discuss our findings from the vantage point of educators’ pedagogical beliefs and how experience shapes these. The results support the idea that HCD is a valuable framework for educators, one that may inform ongoing international efforts to shape a science and practice of learning design for teaching., This work has been partially supported by MDM-2015- 0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R, RecerCaixa (CoT).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Knowledge-based design analytics for authoring courses with smart learning content

  • Albó, Laia
  • Barria-Pineda, Jordan
  • Brusilovsky, Peter
  • Hernández Leo, Davinia
Over the last 10 years, learning analytics have provided educators with both dashboards and tools to understand student behaviors within specific technological environments. However, there is a lack of work to support educators in making data-informed design decisions when designing a blended course and planning appropriate learning activities. In this paper, we introduce knowledge-based design analytics that uncover facets of the learning activities that are being created. A knowledge-based visualization is integrated into edCrumble, a (blended) learning design authoring tool. This new approach is explored in the context of a higher education programming course, where instructors design labs and home practice sessions with online smart learning content on a weekly basis. We performed a within-subjects user study to compare the use of the design tool both with and without visualization. We studied the differences in terms of cognitive load, controllability, confidence and ease of choice, design outcomes, and user actions within the system to compare both conditions with the objective of evaluating the impact of using design analytics during the decision-making phase of course design. Our results indicate that the use of a knowledge-based visualization allows the teachers to reduce the cognitive load (especially in terms of mental demand) and that it facilitates the choice of the most appropriate activities without affecting the overall design time. In conclusion, the use of knowledge-based design analytics improves the overall learning design quality and helps teachers avoid committing design errors., This work is a result of a collaboration within a mobility grant for research funded by the SEBAP, Societat Econòmica Barcelonesa d’Amics del País. This work has also been partially funded by NSF DRL 1740775, “la Caixa Foundation” (CoT project, 100010434) and FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Collaborative educational location-based activities with no teacher supervision: design implications

  • Velamazán, Mariano
  • Santos Rodríguez, Patrícia
  • Hernández Leo, Davinia
Comunicació presentada al DELbA 2020: Workshop on Designing and Facilitating Educational Location-based Applications, celebrat el 15 de setembre a Heidelberg, Alemanya., This paper analyses a gamified collaborative formal–informal outdoor activity and uses the findings to inform the design of future mobile collaboration tools. We present a case study framed in two editions (in years 2018 and 2019) of a (math) gymkhana1 for 15- and 16-year-old students, during which small groups worked collaboratively outside school, with no teacher supervision. From the case study, we present the analysis of the observations of three groups that participated in the activity and the post-activity questionnaire answered by 80 students. The analysis of the questionnaire reveals factors that students appreciated as promoting productive work (i.e. working together, a sense of agency because they were completely on their own and a change of perception of the nature of the subject matter). The analysis of the observations points to other elements that promote successful collaborative work, most of them confirming findings from previous research, such as engaged feedback, joint attention and alignment of goals. But other elements require more research, such as the importance of role changes over time and a broader view of the subject matter, as well as those specific to collaborating outdoors, such as finding/locating the task and matching the description of the task with the real object/place. From those elements, we derive design implications that should inform the design of future mobile educational location-based apps (ELbAs) for collaboration., This work has been partially funded by the EU Regional Development Fund and the National Research Agency of the Spanish Ministry of Science (TIN2017- 85179-C3-3-R). D. Hernández-Leo acknowledges the support by the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Meta-research conference: data-driven planning of a research methods situated-learning activity

  • Michos, Konstantinos
  • Hernández Leo, Davinia
This paper presents the Meta-Research Conference, a learning task for situated learning implemented in two consecutive years in a master course on Research Methods. Through this task students tackle responsible research aspects, apply skills learned during the course, and engage in tasks of professional researchers. The paper also shows how learning analytics based on LMS activity logs, student feedback questionnaires and grades are used to improve the course design., This work has been partially funded by the EU Regional Development Fund and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities under project grants TIN2017-85179-C3-3-R, RED2018-102725-T, and the UPF PlaClik program. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Emergency education effects on teacher abilities and motivation to use digital technologies

  • Beardsley, Marc Yoshimi
  • Albó, Laia
  • Aragón, Pablo
  • Hernández Leo, Davinia
To identify factors that can contribute toward supporting educator adoption of digital technologies beyond the emergency remote teaching response to COVID‐19, we investigated how teachers’ motivation and abilities related to the use of digital technologies for teaching changed since the onset of the pandemic. Two surveys and interviews were conducted with school teachers in Spain. The first survey was completed at the onset of the COVID‐19 lockdown, the second survey and interviews in the weeks leading up to the school year that followed. Survey questions were from SELFIE and the Work Tasks Motivation Scale for Teachers. Moreover we analysed the type of advice teachers sought on Twitter during the lockdown and post‐lockdown periods. Results indicate that teachers believe their proficiency in using digital technologies for teaching has improved. Teacher confidence in using technology for preparing lessons, class teaching, assessing and providing feedback, and for communicating with students and families has increased along with teacher motivation to improve their digital skills and use digital technologies for teaching. Teacher advice seeking on Twitter seemed to shift from serving immediate instructional needs to focussing on professional development and the creation of their own digital content., This work has been partially funded by the EU Regional Development Fund, the National Research Agency of the Spanish Ministry of Science, Innovation and Universities and Erasmus+, under project grants TIN2017‐85179‐C3‐3‐R, 2019‐1‐FI01‐KA201‐060881, 2019‐1‐ES01‐KA201‐065279. D. Hernández‐Leo acknowledges financial support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

CIDA: a collective inquiry framework to study and support teachers as designers in technological environments

  • Michos, Konstantinos
  • Hernández Leo, Davinia
The use of new technologies such as learning analytics by teachers is challenging due to the changes they bring to teachers’ practices and their pedagogical interventions. A design approach into teaching has been proposed for mapping pedagogy with technology to effectively integrate these changes. However, limited collective approaches exist in which teachers participate in professional communities to build knowledge for the design and implementation of learning scenarios with learning analytics. In this paper, we propose a framework (CIDA) for collective inquiry in such professional communities of teachers. Based on other collective inquiry frameworks for knowledge building, we propose three interconnected components: the inquiry process, the collective process, and technological support to facilitate and study teachers´ design practices in technological environments. We explain the framework with examples of implemented technologies and present empirical results of three cases; two High schools and a Massive Open Online Course (MOOC). Results inform further how our framework can be implemented in practice and its required supports to facilitate knowledge building for inquiry communities of teachers., DHL is a Serra Húnter Fellow. This work has been partially funded by “la Caixa Foundation” (CoT project, 100010434); by the European Regional Development Fund and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities, under project grants TIN 2014-53199-C3-3-R, TIN2014-53199-C3-2-R, TIN 2017-85179-C3-2-R, TIN 2017-85179-C3-3-R, MDM-2015-0502
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Seeking reproducibility: assessing a multimodal study of the testing effect

  • Beardsley, Marc Yoshimi
  • Hernández Leo, Davinia
  • Ramírez, Rafael, 1966-
Low‐cost devices have widened the use of multimodal data in experiments providing a more complete picture of behavioural effects. However, the accurate collection and combination of multimodal and behavioural data in a manner that enables reproducibility is challenging and often requires researchers to refine their approaches. This paper presents a direct replication of a multimodal wordlist experiment. Specifically, we use a low‐cost Emotiv EPOC® to acquire electrophysiological measures of brain activity to investigate whether retrieval during learning facilitates the encoding of subsequent learning as measured by performance on recall tests and reflected by changes in alpha wave oscillations. Behavioural results of the wordlist experiment were replicated, but physiological results were not. We conclude the paper by highlighting the challenges faced in terms of replicating the previous work and in attempting to facilitate the reproducibility of our own experiment., This work has been partially supported by RecerCaixa (CoT project) and the Spanish Ministry of Economy and Competitiveness under MDM‐2015‐0502, TIN2014‐53199‐C3‐3‐R, TIN2017‐85179‐C3‐3‐R.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Involving teachers in learning analytics design: lessons learned from two case studies

  • Michos, Konstantinos
  • Lang, Charles
  • Hernández Leo, Davinia
  • Price-Dennis, Detra
Comunicació presentada a: LAK20, celebrat del 23 al 27 de març de 2020 a Frankfurt, Alemanya., Involving teachers in the design of technology-enhanced learning environments is a useful method towards bridging the gap between research and practice. This is especially relevant for learning analytics tools, wherein the presentation of educational data to teachers or students requires meaningful sense-making to effectively support data-driven actions. In this paper, we present two case studies carried out in the context of two research projects in the USA and Spain which aimed to involve teachers in the co-design of learning analytics tools through professional development programs. The results of a cross-case analysis highlight lessons learned around challenges and principles regarding the meaningful involvement of teachers in learning analytics tooling design., This work has been partially funded by "la Caixa Foundation" (CoT project, 100010434), FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities TIN 2017-85179- C3-2-R, TIN 2017-85179-C3-3-R, MDM-2015-0502.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Identifying design principles for learning design tools: the case of edCrumble

  • Albó, Laia
  • Hernández Leo, Davinia
Comunicació acceptada al congrés "The 13th European Conference on Technology-Enhanced Learning (EC-TEL 2018)" que tindrà lloc a Leeds (UK), del 3 al 6 de setembre de 2018., Despite the existing variety of learning design tools, there is a gap in their understanding and adoption by the educators in their everyday practices. Sharing is one of the main pillars of learning design but sometimes it is not a sufficient reason to convince teachers to adopt the habit of documenting their practices so they can be shared. This study presents the design principles of ed- Crumble, an online learning design platform that allow teachers the creation and sharing of blended learning designs with the support of data analytics. The design principles have been learned and extracted from a participatory design process with teachers during the conceptualization and ongoing development of the tool. Several workshops including interviews were carried out as part of a design-based research iteration process. Later analysis has been done to extract and highlight those design principles aiming informing the development of learning design tools towards better learning design adoption., This work has been partially funded by RecerCaixa (CoT project) and the Spanish Ministry of Economy and Competitiveness under MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Conceptualising a visual representation model for MOOC-based blended learning designs

  • Albó, Laia
  • Hernández Leo, Davinia
This article reports on a study about how massive open online course (MOOC)-based blended learning designs can be visually represented to facilitate their comprehension and sharing. We carried out an iterative co-creation process with different stakeholders to conceptualise a visual learning design representation model within the context of blending MOOCs with face-to-face courses. The data analysed was derived from questionnaires and the generated representations. Results indicate that the representation enabled educators to easily visualise the overall structure of the learning designs and the relationships between the different design elements, providing a context for fostering reflection and decision-making during the planning of MOOC-based blended learning designs., The authors would like to thank all the participants of the workshops. This work has been partially funded by “la Caixa Foundation” (CoT project, 100010434) and FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R. Davinia Hernández-Leo (one of the authors) is a Serra Húnter Fellow.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Supporting students in making informed data sharing decisions: from comprehension to consenting

  • Beardsley, Marc Yoshimi
  • Martínez Moreno, Judit
  • Santos Rodríguez, Patrícia
  • Hernández Leo, Davinia
Comunicació presentada a: ICALT 2020 International Conference on Advanced Learning Technologies and Technology-enhanced Learning, organitzada a Tartu, Estònia, del 6 al 9 de juliol de 2020, Whether deciding to participate in a study or gain access to online applications, research suggests that individuals often fail to understand the conditions they agree to when giving consent. Limited comprehension related to the risks of big data and habituation may contribute to consent being given in a manner that counters the best interests of individuals (i.e. a privacy paradox). Who is responsible for helping students learn to make informed decisions regarding the sharing of their data? We conducted a quasi-experimental study involving 127 undergraduate students. We explored the effects on study enrolment of supporting students in making informed data sharing decisions. Prior to reading the consent form for a study involving the evaluation of a collaborative learning application, one group of participants was primed to think about data sharing risks and evaluate their participation in terms of a harm-benefit decision whereas the other group was not. The primed group scored lower on a consent form comprehension quiz yet had higher enrolment rates and were more likely to cite trust as reasoning for enrolling in the study., This work has been partially funded by the European Regional Development Fund and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities, under project grants TIN2017-85179-C3-3-R and MDM-2015-0502. D. Hernãndez-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Learning gains in Pyramid computer-supported collaboration scripts: factors and implications for design

  • Amarasinghe, Ishari
  • Hernández Leo, Davinia
  • Theophilou, Emily
  • Sánchez Reina, Jesús Roberto
  • Lobo Quintero, René Alejandro
Comunicació presentada a: 27th International Conference, CollabTech 2021 celebrat de manera virtual del 31 d'agost al 3 de setembre de 2021., Computer-Supported Collaborative Learning (CSCL) scripts aim to structure the process of collaboration creating opportunities for productive social interaction and learning. Despite CSCL research has shown these benefits for some scripts in particular contexts, more evidence is needed about to what extent learning gains are actually achieved for more families of scripts and in different conditions of implementation. This paper studies how three CSCL scripts based on the Pyramid collaborative learning flow pattern facilitate students learning in online classes. Learning gains are measured in terms of precision and confusion assessment criteria. Students’ behaviour in the learning process, regarding agreement in the knowledge exchange, is also analysed in relation to the learning gains. Results bring out several factors, and implications for the design of fruitful Pyramid scripts implementation, that related to the pedagogical envelope, the type of tasks, pyramid design elements, the need for epistemic orchestration, and debriefing., This work has been partially funded by the Volkswagen Foundation (COURAGE project, no. 95567). TIDE-UPF also acknowledges the support by FEDER, the National Research Agency of the Spanish Ministry, TIN2017-85179-C3-3-R, PID2020-112584RB-C33, MDM-2015-0502 and by ICREA under the ICREA Academia programme (D. Hernández-Leo, Serra Hunter).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Learning design and learning analytics in mobile and ubiquitous learning: a systematic review

  • Pishtari, Gerti
  • Rodríguez-Triana, María Jesús
  • Sarmiento Márquez, Edna M.
  • Pérez Sanagustín, Maria del Mar
  • Ruiz Calleja, Adolfo
  • Santos Rodríguez, Patrícia
  • Prieto, Luis P.
  • Serrano Iglesias, Sergio
  • Väljataga, Terje
Mobile and Ubiquitous Learning (m/u‐learning) are finding an increasing adoption in education. They are often distinguished by hybrid learning environments that encompass elements of formal and informal learning, in activities that happen in distributed settings (indoors and outdoors), across physical and virtual spaces. Despite their purported benefits, these environments imply additional complexity in the design, monitoring and evaluation of learning activities. The research literature on learning design (LD) and learning analytics (LA) has started to deal with these issues. This paper presents a systematic literature review of LD and LA, in m/u‐learning. Apart from providing an overview of the current research in the field, this review elicits elements of common ground between both communities, as shown by the similar learning contexts and complementary research contributions, and based on the research gaps, proposes to: address m/u‐learning beyond higher education settings, reinforce the connection between physical and virtual learning spaces, and more systematically align LD and LA processes., This research was partially funded by EU grants 669074, 586120-EPP-1-2017-1-ES-EPPKA2CBHE-JP, and Spanish projects TIN2017-85179-C3-1-R, TIN2017-85179-C3-2-R, TIN201785179-C3-3-R, VA257P18.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

edCrumble: designing for learning with data analytics

  • Albó, Laia
  • Hernández Leo, Davinia
Comunicació acceptada al congrés "The 13th European Conference on Technology-Enhanced Learning (EC-TEL 2018)" que tindrà lloc a Leeds (UK), del 3 al 6 de setembre de 2018., This demonstration introduces ILDE2/edCrumble, an online learning design platform that allows teachers the creation of learning designs (LDs) with the support of data analytics. ILDE2/edCrumble is built on top of the LdShake platform, which provides social features enabling the sharing and co-edition of LDs. The tool provides an innovative visual representation of LDs combining face-to-face and online learning in different places (in-class and out-of-class) and times (synchronous and asynchronous). Decision making during the LD process is supported by two types of analytics: resulting from the design of the activities sequenced in a timeline (LD analytics); and aggregated meta-data ex- tracted from several grouped LDs (community analytics). Preliminary results conducted as part of an iterative design-based research process, show that the tool is being perceived as easy to use and useful. During the demo we will show the use case of how LD and community analytics can help balancing the work- load and design between different courses which are part of a whole curriculum., This work has been partially funded by RecerCaixa (CoT pro- ject) and the Spanish Ministry of Economy and Competitiveness under MDM-2015- 0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Narrative scripts embedded in social media towards empowering digital and self-protection skills

  • Hernández Leo, Davinia
  • Theophilou, Emily
  • Lobo Quintero, René Alejandro
  • Sánchez Reina, Jesús Roberto
  • Ognibene, Dimitri
Social media has become an important part of adolescents' lives, with an increasing number of teenagers spending a great part of their time creating, sharing, and socializing with online content. Although the popularity of social media keeps growing, different studies identified threats and dangers that exist in such networks. From harmful content to negative behaviors, users can fall victim to negative social media phenomena that can affect their mental health and wellbeing. Several media literacy initiatives have been designed to promote social media awareness amongst the youth using traditional approaches to teaching about social media risks and threats. However, these approaches are limited in enabling deep reflection about the dangers behind their social media interactions and empowering their empathy, perspective-taking, critical thinking, digital and self-protection skills. This demo paper introduces a perspective in this context proposing the integration of educational opportunities within social media. The proposed approach is designed as a social media simulated learning platform where embedded learning activities follow a novel “narrative scripting” approach, in which Computer Supported Collaborative Learning script mechanisms are combined with counter-narratives strategies., This work has been partially funded by the Volkswagen Foundation (COURAGE project, no. 95567). TIDE-UPF also acknowledges he support by FEDER, the National Research Agency of the Spanish Ministry, TIN2017-85179-C3-3-R and by ICREA under the ICREA Academia programme (D. Hernández-Leo, Serra Hunter).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Comparing pre-service and in-service teacher perceptions of the science of learning

  • Beardsley, Marc Yoshimi
  • Martínez Moreno, Judit
  • Hernández Leo, Davinia
Comunicació presentada a: XI Congrés CIDUI celebrat del 30 de juny al 2 de juliol de 2021 de manera virtual., This paper presents the results of a survey on teacher formation and beliefs related to the science of learning (e.g. the science of how people learn) completed by in-service and pre-service teachers. The study results suggest there is a gap, as perceived by both in-service and pre-service teachers themselves, in teacher knowledge and confidence related to the science of learning. This gap exists despite most teachers indicating that the science of learning should be a required part of initial teacher education. Overall, this study supports the notion that teachers’ would be receptive to interventions that improve their knowledge of the science of learning., This work was partially funded by the European Regional Development Fund, Erasmus+, and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities, under project grants TIN2017-85179-C3-3-R, 2017-1-ES01-KA201-038220 and MDM-2015-0502. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Collaborative learning designs using PyramidApp: computer supported collaborative learning in classroom sessions

  • Amarasinghe, Ishari
  • Hernández Leo, Davinia
  • Manathunga, Kalpani
  • Beardsley, Marc Yoshimi
  • Bosch Garcia, Jordi
  • Carrió, Mar
  • Chacón Pérez, Jonathan, 1986-
  • Jiménez Morales, Manel
  • Llanos Santos, David
  • Lope Pastor, Silvia
  • Martínez Moreno, Judit
  • Santos Rodríguez, Patrícia
  • Vujovic, Milica
Comunicació presentada a: XI Congrés CIDUI 2021 celebrat del 29 de juny al 2 de juliol de 2021 de manera virtual., Designing effective collaborative learning activities for classroom is challenging. The PyramidApp is a tool that facilitates the implementation of the Pyramid pattern, shaping a collaboration structure that promotes the participation of all students and fruitful social interactions. This paper shows how this educational strategy can be applied to different types of tasks and subject matters, shedding light about how computer-supported collaborative learning can be incorporated in the classroom., This work has been partially funded by FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2017-85179-C3-3-R, and UPF PlaClik. Davinia Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Towards teacher orchestration load-aware teacher-facing dashboards

  • Amarasinghe, Ishari
  • Vujovic, Milica
  • Hernández Leo, Davinia
Comunicació presentada a: 10th International Learning and Analytics Conference (LAK 2020), el 24 de març de 2020, virtualment., In this workshop paper, we report a study conducted to investigate the use of tracking technologies to measure the teachers’ orchestration load when conducting colocated collaborative learning activities. We distinguish the orchestration load experienced by the teachers in the absence and presence of teacher supporting tools, i.e. teacher-facing dashboards. Electrodermal activity (EDA) sensor and other multimodal data including observations, log data and subjective responses to questionnaires have been collected to measure the teachers’ orchestration load in authentic collaborative learning scenarios. This workshop paper presents the study context, quantitative and qualitative data collection process undertaken and other considerations in detail., This work has been partially funded by FEDER, the national research agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2017-85179-C3-3-R.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Concept-level design analytics for blended courses

  • Albó, Laia
  • Barria-Pineda, Jordan
  • Brusilovsky, Peter
  • Hernández Leo, Davinia
Comunicació presentada a: EC-TEL 2019 celebrat a Delft, Països Baixos, del 16 al 19 de setembre de 2019., Although many efforts are being made to provide educators with dashboards and tools to understand student behaviors within specific technological environments (learning analytics), there is a lack of work in supporting educators in making data-informed design decisions when designing a blended course and planning learning activities. In this paper, we introduce concept-level design analytics, a knowledge-based visualization, which uncovers facets of the learning activities that are being authored. The visualization is integrated into a (blended) learning design authoring tool, edCrumble. This new approach is explored in the context of a higher education programming course, where teaching assistants design labs and home practice sessions with online smart learning content on a weekly basis. We performed a within-subjects user study to compare the use of the design tool both with and without the visualization. We studied the differences in terms of cognitive load, design outcomes and user actions within the system to compare both conditions to the objective of evaluating the impact of using design analytics during the decision-making phase of course design., This work has also been partially funded by NSF DRL 1740775, “la Caixa Foundation” (CoT project, 100010434) and FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R. DHL is a Serra Húnter Fellow.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Supporting online collaborative design for teacher professional development

  • Marín, Victoria I.
  • Asensio-Pérez, Juan I.
  • Villagrá-Sobrino, Sara L.
  • Hernández Leo, Davinia
  • García-Sastre, Sara
This article describes a study of online collaborative design in the context of teacher professional development. Twenty-five teachers from different Spanish universities participated in the online course. The aim was to understand how to support teachers in interuniversity teams to collaborate fully online throughout the learning design process of a scenario based on their discipline integrating information and communications technology (ICT), an issue scarcely tackled in the literature. The described interpretive study, using mixed methods, explores the support of online co-design provided by a novel ICT community platform named ILDE (Integrated Learning Design Environment). Lessons drawn from the results can contribute to the improvement of online collaborative design processes in the context of teacher professional development., This work has been partially supported by the Spanish Ministry of Science, Innovation and Universities [project EDU2017-84223-R], the Spanish State Research Agency (AEI) [projects TIN2017-85179-C3-2-R and TIN2014-53199-C3-2-R, TIN2014-53199-C3-3-R and TIN2017-85179-C3-3-R], the Regional Government of Castilla y León and the European Regional Development Fund [project VA018U16], the European Commission [project 588438-EPP-1-2017-1-EL-EPPKA2-KA], the Spanish Ministry of Economy and Competitiveness [project MDM-2015-0502] and RecerCaixa (CoT).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Data-informed design parameters for adaptive collaborative scripting in across-spaces learning situations

  • Amarasinghe, Ishari
  • Hernández Leo, Davinia
  • Jonsson, Anders, 1973-
This study presents how predictive analytics can be used to inform the formulation of adaptive collaborative learning groups in the context of Computer Supported Collaborative Learning considering across-spaces learning situations. During the study we have collected data from different learning spaces which depicted both individual and collaborative learning activity engagement of students in two different learning contexts (namely the classroom learning and distance learning context) and attempted to predict individual student’s future collaborative learning activity participation in a pyramid-based collaborative learning activity using supervised machine learning techniques. We conducted experimental case studies in the classroom and in distance learning settings, in which real-time predictions of student’s future collaborative learning activity participation were used to formulate adaptive collaborative learner groups. Findings of the case studies showed that the data collected from across-spaces learning scenarios is informative when predicting future collaborative learning activity participation of students hence facilitating the formulation of adaptive collaborative group configurations that adapt to the activity participation differences of students in real-time. Limitations of the proposed approach and future research direction are illustrated., This work has been partially funded by FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R and “la Caixa Foundation” (CoT project, 100010434). DHL is a Serra Húnter Fellow.
Repositorio Digital de la UPF
Publicación Capítulo o parte de un libro (BookPart)

Responsible educational technology research: from open science and open data to ethics and trustworthy learning analytics

  • Hernández Leo, Davinia
  • Amarasinghe, Ishari
  • Beardsley, Marc Yoshimi
  • Hakami, Eyad
  • Ruiz Garcia, Aurelio
  • Santos Rodríguez, Patrícia
This chapter unfolds some elements of responsible research in the educational technology field and provides examples about how these elements have been considered in initiatives by the Interactive and Distributed Technologies for Education (TIDE) research group at Universitat Pompeu Fabra in Barcelona. First, it focuses on open science, an ongoing movement that promotes, on the one hand, transparent and frequent open-access updates of the research progress and the collected data and, on the other hand, reproducible, accurate, and verifiable research, bringing benefits for the individual researchers, the research community, and the society. Second, the chapter discusses ethics perspectives in educational technology research, relevant when collecting and sharing data and also in the design and development of technologies, especially when they are based on data analytics or artificial intelligence techniques. The latter aspects relate to the capacity of educational software systems to support human agency and preserve human well-being., TIDE-UPF acknowledges the support from the National Research Agency of the Spanish Ministry of Science and Innovation (PID2020-112584RB-C33/MICIN/AEI/10.13039/501100011033), and previously from TIN2017-85179-C3-3-R, MDM-2015-0502, AGAUR (2017 SGR 1698. DHL (Serra Húnter) acknowledges the support by ICREA under the ICREA Academia programme, PS by the Ramon y Cajal programme and EH by Jazan University, Saudi Arabia.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Co-creation process and challenges in the conceptualization and development of the edCrumble learning design tool

  • Albó, Laia
  • Hernández Leo, Davinia
Comunicació presentada al Workshop on Co-Creation in the Design, Development and Implementation of Technology-Enhanced Learning (CC-TEL'18), dins el congrés EC-TEL 2018, que se celebra el 3 de setembre a Leeds (Regne Unit)., This paper presents the co-creation process followed during the conceptualization, development and evaluation of edCrumble: a learning design (LD) tool which provides an innovative visual representation of the LDs characterized by data analytics with the aim of facilitating the planning, visualization, understanding and reuse of complex LDs. Researchers used several participants’ sources and profiles, different methods (including paper and web-based prototyping, questionnaires, interviews, focus groups, role-play games, sharing activities) and workshop types (isolated vs. long-time). Participatory design workshops and activities are described as well as the challenges encountered during the co-design process with the aim of informing other researchers who are thinking of using co-creation. These challenges include the recruitment and motivation of participants, the management of their expectations, the prioritization of the feedback diversity and a short evaluation of the methods used., This work has been partially funded by RecerCaixa (CoT project) and the Spanish Ministry of Economy and Competitiveness under MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

4FAD: A framework for mapping the evolution of artefacts in the learning design process

  • Muñoz Cristóbal, Juan Alberto
  • Hernández Leo, Davinia
  • Carvalho, Lucila
  • Martinez-Maldonado, Roberto
  • Thompson, Kate
  • Wardak, Dewa
  • Goodyear, Peter
A number of researchers have explored the role and nature of design in education, proposing a diverse array of life cycle models. Design plays subtly different roles in each of these models. The learning design research community is shifting its attention from the representation of pedagogical plans to considering design as an ongoing process. As a result, the study of the artefacts generated and used by educational designers is also changing: from a focus on the final designed artefact (the product of the design process) to the many artefacts generated and used by designers at different stages of the design process (e.g., sketches, reflections, drawings, or pictures). However, there is still a dearth of studies exploring the evolution of such artefacts throughout the learning design life cycle. A deeper understanding of these evolutionary processes is needed – to help smooth the transitions between stages in the life cycle. In this paper, we introduce the four-dimensional framework for artefacts in design (4FAD) to generate understanding and facilitate the mapping of the evolution of learning design artefacts. We illustrate the value of the framework by applying it in the analysis of an authentic design case., This research has been partially supported by the Spanish Projects TIN2011-28308-C03-02, TIN2014-53199-C3-2-R, TIN2014-53199-C3-3-R, TIN2017-85179-C3-2-R, TIN2017-85179-C3-3-R, MDM-2015-0502, RecerCaixa (CoT) and VA082U16, and by the Australian Research Council through Laureate grant FL100100203.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Towards reward-based gamification in collaborative learning flow patterns based on learning analytics

  • Lobo Quintero, René Alejandro
  • Ortega Arranz, Alejandro
  • Hernández Leo, Davinia
Comunicació presentada al LASI-SPAIN 2020: Learning Analytics Summer Institute Spain 2020, celebrat del 15 al 16 de juny de 2020 a Valladolid, Espanya., Collaborative learning flow patterns (CLFPs) formulate good practices for the orchestration of activity sequences and collaboration mechanisms that can elicit fruitful social interactions. Despite their benefits, it is worth exploring how their implementation can be improved. The use of reward-based gamification strategies accompanied with Learning Analytics is one approach that can potentially. reinforce the participation and collaboration between participants, and at the same type help teachers to make decisions and measure the impact of the activities. This paper presents a first iteration for a model to integrate the use of gamification and learning analytics in collaborative learning activities structured following the Jigsaw and Pyramid CLFP. The applicability of the model is illustrated through two scenarios (face-to-face and MOOC settings)., This work has been partially funded by the Eu. Regional Development Fund and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities, under project grants TIN2017-85179-C3-2-R, TIN2017-85179-C3-3-R. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Individual versus computer-supported collaborative self-explanations: how do their writing analytics differ?

  • Albó, Laia
  • Beardsley, Marc Yoshimi
  • Amarasinghe, Ishari
  • Hernández Leo, Davinia
Comunicació presentada a: ICALT 2020 International Conference on Advanced Learning Technologies and Technology-enhanced Learning, organitzada a Tartu, Estònia, del 6 al 9 de juliol de 2020, Researchers have demonstrated the effectiveness of self-explanations (SE) as an instructional practice and study strategy. However, there is a lack of work studying the characteristics of SE responses prompted by collaborative activities. In this paper, we use writing analytics to investigate differences between SE text responses resulting from individual versus collaborative learning activities. A Coh-Metrix analysis suggests that students in the collaborative SE activity demonstrated a higher level of comprehension. Future research should explore how writing analytics can be incorporated into CSCL systems to support student performance of SE activities., This work has been partially funded by the EU Regional Development Fund, Erasmus +, and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities under project grants TIN2017-85179-C3-3-R, 2017-1-ES01-KA201-038220, RED2018-102725-T, and the UPF PlaClik program. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Investigating the Well-being impacts of educational technologies supported by learning analytics: An application of the initial phase of IEEE P7010 recommended practice to a set of cases

  • Hakami, Eyad
  • Hernández Leo, Davinia
Comunicació presentada a: LAK21 Conference celebrat del 12 al 16 d'abril de 2021 de manera virtual., The accelerated adoption of digital technologies by people and communities results in a close relation between, on one hand, the state of individual and societal well-being and, on the other hand, the state of the digital technologies that underpin our life experiences. The ethical concerns and questions about the impact of such technologies on human well-being become more crucial when data analytics and intelligent competences are integrated. To investigate how learning technologies could impact human well-being considering the promising and concerning roles of learning analytics, we apply the initial phase of the recently produced IEEE P7010 Well-being Impact Assessment, a methodology and a set of metrics, to allow the digital well-being of a set of educational technologies to be more comprehensively tackled and evaluated. We posit that the use of IEEE P7010 well-being metrics could help identify where educational technologies supported by learning analytics would increase or decrease well-being, providing new routes to future technological innovation in Learning Analytics research., Development Fund and the National Research Agency of the Spanish Ministry of Science and Innovation under project grants TIN2017-85179- C3-3-R, RED2018- 102725-T. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia program. E. Hakami acknowledges the grant by Jazan University, Saudi Arabia.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Including students’ voices in the design of blended learning lesson plans

  • Albó, Laia
  • Stylianidou, Nayia
  • Chalatsis, Xenofon
  • Dieckmann, Max
  • Hernández Leo, Davinia
Comunicació presentada a 16th European Conference on Technology Enhanced Learning (EC-TEL 2021), celebrat del 20 al 24 de setembre de 2021 de manera virtual., Voice inclusive pedagogy urges teachers to consider how they will act to incorporate children’s voices within their teaching practice. In blended learning environments, students’ views in technology-enhanced classrooms are a useful source of information that is often not utilised to its full potential. This demon-stration paper presents an authoring tool that facilitates the co-design of blended learning lesson plans between teachers and students. The platform supports teachers to collect students’ voices to define the main components of a lesson plan. It has integrated an inquiry feature to gather students’ feedback during the design process throughout the definition of the learning objectives, the activities and tools, and the procedures for reflection and assessment., The authors would like to thank all members of the BLENDI project for their contributions in shaping the platform. This work has been partially funded by the EU Regional Development Fund, the National Research Agency of the Spanish Ministry of Science and Innovation and Erasmus+, under project grants TIN2017-85179-C3-3-R, PID2020-112584RB-C33, 2019-1-FI01-KA201-060881. D. Hernández-Leo (Serra Húnter) acknowledges the support by ICREA under the ICREA Academia programme.
Repositori Obert UdL
Publicación Artículo científico (JournalArticle)

Supporting online collaborative design for teacher professional development

  • Marín, Victoria I.
  • Asensio Pérez, Juan I.
  • Villagrá Sobrino, Sara
  • Hernández Leo, Davinia
  • García Sastre, Sara
This paper describes a study on online collaborative design in the context of teacher professional development. 25 teachers from different Spanish universities and disciplines participated in the study. The aim was to understand how to support teachers in interuniversity teams to collaborate fully online along the learning design process of a discipline-based situation that integrates ICT, a problem scarcely tackled in the literature. The described interpretive study, using mixed methods, explores the support to online co-design provided by a novel ICT community platform named ILDE (Integrated Learning Design Environment). Lessons drawn from the results can contribute to the improvement of online collaborative design processes in the context of teacher professional development., This work has been partially supported by the Spanish Ministry of Science, Innovation and Universities [project EDU2017-84223-R], the Spanish State Research Agency (AEI) [projects TIN2017-85179-C3-2-R and TIN2014-53199-C3-2-R, TIN2014-53199-C3-3-R and TIN2017-85179-C3-3-R], the Regional Government of Castilla y León and the European Regional Development Fund [project VA018U16], the European Commission [project 588438-EPP-1-2017-1-EL-EPPKA2-KA], the Spanish Ministry of Economy and Competitiveness [project MDM-2015-0502] and RecerCaixa (CoT).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Meta-research conference: data-driven planning of a research methods situated-learning activity

  • Michos, Konstantinos
  • Hernández Leo, Davinia
This paper presents the Meta-Research Conference, a learning task for situated learning implemented in two consecutive years in a master course on Research Methods. Through this task students tackle responsible research aspects, apply skills learned during the course, and engage in tasks of professional researchers. The paper also shows how learning analytics based on LMS activity logs, student feedback questionnaires and grades are used to improve the course design., This work has been partially funded by the EU Regional Development Fund and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities under project grants TIN2017-85179-C3-3-R, RED2018-102725-T, and the UPF PlaClik program. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Learning to learn: university student perceptions of a science of learning intervention

  • Beardsley, Marc Yoshimi
  • Martínez Moreno, Judit
  • Hernández Leo, Davinia
Comunicació presentada a: XI Congrés CIDUI celebrat del 30 de juny al 2 de juliol de 2021 de manera virtual., Many students use ineffective learning strategies and lack confidence in their learning skills and knowledge. This paper presents the results of a pre- and post-survey study involving first-year university students that completed a 2-hour classroom lesson on the science of learning and learning skills. The results of the study confirm that students perceive that they lack knowledge and confidence about learning; and that students found a lesson on the science of learning to be beneficial., This work was partially funded by the European Regional Development Fund, Erasmus+, and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities, under project grants TIN2017-85179-C3-3-R, 2017-1-ES01-KA201-038220 and MDM-2015-0502. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Motion capture as an instrument in multimodal collaborative learning analytics

  • Vujovic, Milica
  • Tassani, Simone
  • Hernández Leo, Davinia
Comunicació presentada a: EC-TEL 2019 celebrat a Delft, Països Baixos, del 16 al 19 de setembre de 2019., In this paper, we describe an exploratory study where we investigate the possibilities of motion capture system as an instrument to consider in multi-modal analyses of face-to-face collaborative learning scenarios. The goal is to understand to what extent motion capture can facilitate certain measurements leading to collaborative learning indicators that are currently time-consuming to achieve with other instruments. We focus on the simultaneous measurement of known physical collaboration indicators such as gaze direction, the distance be-tween learners and the speed of movement/reactions. The study considers a lab setting simulating a classroom scenario based on the Jigsaw collaborative learn-ing flow pattern, which proposes a sequence of activities with changes in group size and formation. Preliminary results indicate a high degree of applicability of the system in measuring these indicators, with certain limitations for gaze direc-tion measurements. With appropriate marker position on the participants, the sys-tem is able to automatically provide desired measurements with satisfactory pre-cision. Additionally, with a small number of additional markers, we were able to determine the way students used working surfaces (shared desks)., This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No. 713673. Milica Vujovic has received financial support through the “la Caixa” INPhINIT Fellowship Grant for Doctoral studies at Spanish Research Centres of Excellence, “la Caixa” Banking Foundation, Barcelona, Spain. This work has been partially supported by the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2014- 53199-C3-3-R, TIN2017-85179-C3-3-R.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Smartphones or laptops in the collaborative classroom? A study of video-based learning in higher education

  • Albó, Laia
  • Hernández Leo, Davinia
  • Moreno Oliver, Verónica
This paper explores how the use of smartphones vs. laptops influences students’ engagement, behaviour and experience watching academic videos in a collaborative classroom. Experiments were run in authentic teaching sessions with a total of 483 first-year higher education students. The methodology applied is a quasi-experimental design with post-test-only, being the independent variable, the device used to visualise the academic videos. Results indicate that the use of laptops has provided better results in terms of student’s engagement with the videos, their collaborative behaviour and satisfaction with the device. Hence, the findings of this research suggest that the type of mobile device used in activities that consider the use of videos in a collaborative class need to be carefully chosen to maximise the student’s comfortability – and in consequence, their engagement with the video-based learning activity and their positive behaviour and experience within the collaborative context., This work was supported by Ministerio de Ciencia y Tecnología [grant number MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R], Universitat Pompeu Fabra (UPF) [grant number PlaQUID2012], and RecerCaixa [grant number Communities of Teaching (CoT) Project].
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Towards teacher orchestration load-aware teacher-facing dashboards

  • Amarasinghe, Ishari
  • Vujovic, Milica
  • Hernández Leo, Davinia
Comunicació presentada a: 10th International Learning and Analytics Conference (LAK 2020), el 24 de març de 2020, virtualment., In this workshop paper, we report a study conducted to investigate the use of tracking technologies to measure the teachers’ orchestration load when conducting colocated collaborative learning activities. We distinguish the orchestration load experienced by the teachers in the absence and presence of teacher supporting tools, i.e. teacher-facing dashboards. Electrodermal activity (EDA) sensor and other multimodal data including observations, log data and subjective responses to questionnaires have been collected to measure the teachers’ orchestration load in authentic collaborative learning scenarios. This workshop paper presents the study context, quantitative and qualitative data collection process undertaken and other considerations in detail., This work has been partially funded by FEDER, the national research agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2017-85179-C3-3-R.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Deconstructing orchestration load: comparing teacher support through mirroring and guiding

  • Amarasinghe, Ishari
  • Hernández Leo, Davinia
  • Hoppe, H. Ulrich
Under the notion of “CSCL scripts”, different pedagogical models for structuring and supporting collaboration in the classroom have been proposed. We report on a practical experience with scripts based on the Pyramid collaborative learning flow pattern supported by a specific classroom tool and a teacher-facing dashboard that implements mirroring and guiding support. The input data of our analysis stems from recordings of classroom interactions guided by several teachers using the PyramidApp with different levels of teaching support. For the analysis, we introduce a specific coding scheme enabling a quantitative comparison and deeper analysis using epistemic network analysis. The results show that the guiding support enabled teachers to perform more orchestration actions, more targeted interactions and to make more announcements to the class (regarding time, phase transitions, and students’ activity participation) when compared to the mirroring support. Teachers’ actionable differences observed under the mirroring and guiding support directed us to deconstruct the notion of orchestration load into different facets and to discuss how different support provisions correspond to the different facets of orchestration load., TIDE-UPF acknowledges the support by FEDER, the National Research Agency of the Spanish Ministry, TIN2017-85179-C3-3-R, PID2020-112584RB-C33, MDM-2015-0502, and by ICREA under the ICREA Academia programme (D. Hernández-Leo, Serra Hunter).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

The Challenge of gathering self-reported moods: Cases using a classroom orchestration tool

  • Beardsley, Marc Yoshimi
  • Vujovic, Milica
  • Theophilou, Emily
  • Hernández Leo, Davinia
  • Portero Tresserra, Marta
Comunicació presentada a: ICALT 2020 International Conference on Advanced Learning Technologies and Technology-enhanced Learning, organitzada a Tartu, Estònia, del 6 al 9 de juliol de 2020, Self-reports of affective states are increasingly being collected in educational settings. However, individual definitions and usage of emotion and mood terms are often subjective despite objective definitions becoming more widely accepted. We explore whether the variation among individual learners in how mood terms are defined presents an obstacle to using self-reported mood data for group comparison studies. Following a design-based research methodology, we ran two case studies to explore the use of ClassMood App in a multimodal learning study and the validity of the self-reported mood data it collected. During the first case, 24 primary school students experienced difficulty understanding the words used to describe the moods in ClassMood App. In the second case, involving 77 university students, we explored whether the misunderstanding of mood words persisted with older students. Participants were asked to rate their familiarity with and match definitions to a set of 8 mood words. We found that levels of familiarity with the mood words varied greatly and 17.9% of all definition matching attempts were incorrect. The results suggest that the variation in subjective definitions of mood terms is likely to affect the validity of the data collected by the ClassMood App for group comparison studies., This work has been partially funded by the European Regional Development Fund, Erasmus+, and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities, under project grants TIN2017-85179-C3-3-R, 2018-1-ESOI-KA20I-050646, and MDM-2015-0502. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Flexible CSCL orchestration technology: mechanisms for elasticity and dynamism in pyramid script flows

  • Manathunga, Kalpani
  • Hernández Leo, Davinia
Comunicació presentada a: the 13th International Conference on Computer Supported Collaborative Learning (CSCL), celebrada del 17 al 21 de juny de 2019 a Lió, França., Flow patterns (e.g., Pyramid or Snowball) formulate good practices to script collaborative learning scenarios, which have been experimented in small-scale settings widely. Applying flow patterns on large-scale contexts present challenges to educators in terms of orchestration load. Orchestration technology can support educators to manage collaborative activities; yet existing technology do not address flexibility challenges like accommodating growing numbers of students or tolerating dynamic conditions in learning settings. We define elasticity and dynamism as two key elements in the flexibility of a script. Elasticity is related to the capacity of an orchestration technology to incorporate varying participant counts. Dynamism is the capacity to maintain a pedagogically meaningful script progression in presence of different individual behaviors. In this paper we propose flow creation and flow control mechanisms to address elasticity and dynamism in orchestration technology for Pyramid flows. These mechanisms, implemented in the PyramidApp tool, have been evaluated across four scenarios varying from small to large settings. The results show that rules enabling pyramid creation on-demand and the use of timers are useful to achieve elasticity and dynamism in the pyramid formation and progression in an automatic manner., DHL is a Serra Húnter fellow. This work has been partially funded by “la Caixa Foundation” (CoT project, 100010434) and the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Towards socially shared regulation within CSCL scripts: mirroring group participation in PyramidApp

  • Theophilou, Emily
  • Amarasinghe, Ishari
  • Hernández Leo, Davinia
  • Lobo Quintero, René Alejandro
  • Crespi, Francisco
Comunicació presentada a: LASI Spain celebrat de manera híbrida del 7 al 9 de juliol de 2021 a Barcelona, Espanya., Computer-Supported Collaborative Learning (CSCL) has been shown to enhance learning by promoting peer interactions. With the support of collaborative learning flow patterns (CLFP), the collaboration process within the socalled CSCL macro-scripts can be further structured and constrained. However, social dynamics within tasks, even within scripts, have the potential to hinder the collaborative element as students might not participate sufficiently in conversations. To determine if participation in discussions between students was balanced within a CSCL script we analysed data from an implementation of the Pyramid CLFP. The data showed that student participation varied across different groups, with some groups and students not initiating conversation between them. Socially shared regulation is a social form of regulation where students regulate their learning as a group rather than as individuals through the means of discussion, negotiation, and perspective taking. As research has shown that for collaborative learning to be successful students need to engage in fruitful discussions and support each other to regulate their learning, we propose the implementation of a social awareness feature mirroring group participation through learning analytics in a CLFP tool (PyramidApp) to promote socially shared regulated learning., This work has been partially funded by the Volkswagen Foundation in the framework of the project COURAGE (no. 95567) and by FEDER, the National Research Agency of the Spanish Ministry, TIN2017-85179-C3-3-R and MDM-2015-0502. D. Hernández-Leo also acknowledges the support of ICREA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Emotion annotation of music: a citizen science approach

  • Gutiérrez Páez, Nicolás Felipe
  • Gómez Cañón, Juan Sebastián
  • Porcaro, Lorenzo
  • Santos Rodríguez, Patrícia
  • Hernández Leo, Davinia
  • Gómez Gutiérrez, Emilia, 1975-
Comunicació presentada a: 27th International Conference, CollabTech 2021 celebrat de manera virtual del 31 d'agost al 3 de setembre de 2021., The understanding of the emotions in music has motivated research across diverse areas of knowledge for decades. In the field of computer science, there is a particular interest in developing algorithms to “predict” the emotions in music perceived by or induced to a listener. However, the gathering of reliable “ground truth” data for modeling the emotional content of music poses challenges, since tasks related with annotations of emotions are time consuming, expensive and cognitively demanding due to its inherent subjectivity and its cross-disciplinary nature. Citizen science projects have proven to be a useful approach to solve these types of problems where there is a need for recruiting collaborators for massive scale tasks. We developed a platform for annotating emotional content in musical pieces following a citizen science approach, to benefit not only the researchers, who benefit from the generated dataset, but also the volunteers, who are engaged to collaborate on the research project, not only by providing annotations but also through their self and community-awareness about the emotional perception of the music. Likewise, gamification mechanisms motivate the participants to explore and discover new music based on the emotional content. Preliminary user evaluations showed that the platform design is in line with the motivations of the general public, and that the citizen science approach offers an iterative refinement to enhance the quantity and quality of contributions by involving volunteers in the design process. The usability of the platform was acceptable, although some of the features require improvements., This work has been partially funded by the TROMPA project, European Union’s Horizon 2020 research and innovation programme under grant agreement no. 770376. TIDE-UPF also acknowledges the support by FEDER, the National Research Agency of the Spanish Ministry of Science and Innovation, TIN2017-85179-C3-3-R, PID2020-112584RB-C33, MDM-2015-0502, the Ramon y Cajal programme (P. Santos) and by ICREA under the ICREA Academia programme (D. Hernández-Leo, Serra Hunter).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

edCrumble: designing for learning with data analytics

  • Albó, Laia
  • Hernández Leo, Davinia
Comunicació acceptada al congrés "The 13th European Conference on Technology-Enhanced Learning (EC-TEL 2018)" que tindrà lloc a Leeds (UK), del 3 al 6 de setembre de 2018., This demonstration introduces ILDE2/edCrumble, an online learning design platform that allows teachers the creation of learning designs (LDs) with the support of data analytics. ILDE2/edCrumble is built on top of the LdShake platform, which provides social features enabling the sharing and co-edition of LDs. The tool provides an innovative visual representation of LDs combining face-to-face and online learning in different places (in-class and out-of-class) and times (synchronous and asynchronous). Decision making during the LD process is supported by two types of analytics: resulting from the design of the activities sequenced in a timeline (LD analytics); and aggregated meta-data ex- tracted from several grouped LDs (community analytics). Preliminary results conducted as part of an iterative design-based research process, show that the tool is being perceived as easy to use and useful. During the demo we will show the use case of how LD and community analytics can help balancing the work- load and design between different courses which are part of a whole curriculum., This work has been partially funded by RecerCaixa (CoT pro- ject) and the Spanish Ministry of Economy and Competitiveness under MDM-2015- 0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Including students’ voices in the design of blended learning lesson plans

  • Albó, Laia
  • Stylianidou, Nayia
  • Chalatsis, Xenofon
  • Dieckmann, Max
  • Hernández Leo, Davinia
Comunicació presentada a 16th European Conference on Technology Enhanced Learning (EC-TEL 2021), celebrat del 20 al 24 de setembre de 2021 de manera virtual., Voice inclusive pedagogy urges teachers to consider how they will act to incorporate children’s voices within their teaching practice. In blended learning environments, students’ views in technology-enhanced classrooms are a useful source of information that is often not utilised to its full potential. This demon-stration paper presents an authoring tool that facilitates the co-design of blended learning lesson plans between teachers and students. The platform supports teachers to collect students’ voices to define the main components of a lesson plan. It has integrated an inquiry feature to gather students’ feedback during the design process throughout the definition of the learning objectives, the activities and tools, and the procedures for reflection and assessment., The authors would like to thank all members of the BLENDI project for their contributions in shaping the platform. This work has been partially funded by the EU Regional Development Fund, the National Research Agency of the Spanish Ministry of Science and Innovation and Erasmus+, under project grants TIN2017-85179-C3-3-R, PID2020-112584RB-C33, 2019-1-FI01-KA201-060881. D. Hernández-Leo (Serra Húnter) acknowledges the support by ICREA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Supporting awareness in communities of learning design practice

  • Michos, Konstantinos
  • Hernández Leo, Davinia
The field of learning design has extensively studied the use of technology for the authoring of learning activities. However, the social dimension of the learning design process is still underexplored. In this paper, we investigate communities of teachers who used a social learning design platform (ILDE). We seek to understand how community awareness facilitates the learning design activity of teachers in different educational contexts. Following a design-based research methodology, we developed a community awareness dashboard (inILDE) based on the Cultural Historical Activity Theory (CHAT) framework. The dashboard displays the activity of teachers in ILDE, such as their interactions with learning designs, other members, and with supporting learning design tools. Evaluations of the inILDE dashboard were carried out in four educational communities – two secondary schools, a master programme for pre-service teachers, and in a Massive Open Online Course (MOOC) for teachers. The dashboard was perceived to be useful in summarizing the activity of the community and in identifying content and members’ roles. Further, the use of the dashboard increased participants’ interactions such as profile views and teachers showed a willingness to build on the contributions of others. As conclusions of the study, we propose five design principles for supporting awareness in learning design communities, namely community context, practice-related insights, visualizations and representations, tasks and community interests., This work has been partially funded by RecerCaixa (CoT project) and the Spanish Ministry of Economy and Competitiveness under MDM-2015-0502, TIN2014–53199-C3-3-R, TIN2017-85179-C3-3-R.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

ClassMood App: a classroom orchestration tool for identifying and influencing student moods

  • Beardsley, Marc Yoshimi
  • Vujovic, Milica
  • Portero Tresserra, Marta
  • Hernández Leo, Davinia
Comunicació presentada a: EC-TEL 2019 celebrat a Delft, Països Baixos, del 16 al 19 de setembre de 2019., Certain affective states are less conducive to learning than others. Moreover, results from studies suggest that a classroom’s social-emotional climate affects student motivation and performance; and that moods can be automatically transferred among individuals in a group. The ClassMood App is an online classroom orchestration tool for social emotional learning that identifies the aggregate mood of a class and suggests classroom activities for educators to help shift the class mood to one that is more conducive to learning. Suggested activities are categorized based on how they aim to impact students’ internal state of arousal. The application aims to facilitate learner and educator development of self-awareness and self-management competencies consistent with the CASEL framework for systemic social and emotional learning. Preliminary results, conducted as part of an iterative designed-based research process, suggest that the tool is perceived as being easy-to-use for both educators and undergraduate students., This work has been co-funded by the European Union, Project Number 2018-1-ES01-KA201-050646 (Spotlighters) under the Erasmus + programme; and partially supported by FEDER, the National Research Agency of the Spanish Ministry of Science MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R. DHL is a Serra Húnter Fellow. Note: The material in this paper reflects only the authors’ views and the European Commission cannot be held responsible for any use that may be made of the information it contains. The authors want to thank Pablo Abenia for the technical implementation of the application, and Minna Huotilainen for her advice regarding the student graphical interface.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Human-centred design to empower ‘teachers as designers’

  • Garreta Domingo, Muriel
  • Sloep, Peter B.
  • Hernández Leo, Davinia
Educators of all sectors are learning designers, often unwittingly. To succeed as designers, they need to adopt a design mindset and acquire the skills needed to address the design challenges they encounter in their everyday practice. Human-centred design (HCD) provides professional designers with the methods needed to address complex problems. It emphasizes the human perspective throughout the design lifecycle and provides a practice-oriented approach, which naturally fits educators’ realities. This research reports the experiences of educators who used HCD to design ICT-based learning activities. A mixed-methods approach was used to gauge how participating educators experienced the design tasks. The perceived level of difficulty and value of the various methods varied, revealing significant differences between educators according to their level of knowledge of pedagogy frameworks. We discuss our findings from the vantage point of educators’ pedagogical beliefs and how experience shapes these. The results support the idea that HCD is a valuable framework for educators, one that may inform ongoing international efforts to shape a science and practice of learning design for teaching., This work has been partially supported by MDM-2015- 0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R, RecerCaixa (CoT).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Involving teachers in learning analytics design: lessons learned from two case studies

  • Michos, Konstantinos
  • Lang, Charles
  • Hernández Leo, Davinia
  • Price-Dennis, Detra
Comunicació presentada a: LAK20, celebrat del 23 al 27 de març de 2020 a Frankfurt, Alemanya., Involving teachers in the design of technology-enhanced learning environments is a useful method towards bridging the gap between research and practice. This is especially relevant for learning analytics tools, wherein the presentation of educational data to teachers or students requires meaningful sense-making to effectively support data-driven actions. In this paper, we present two case studies carried out in the context of two research projects in the USA and Spain which aimed to involve teachers in the co-design of learning analytics tools through professional development programs. The results of a cross-case analysis highlight lessons learned around challenges and principles regarding the meaningful involvement of teachers in learning analytics tooling design., This work has been partially funded by "la Caixa Foundation" (CoT project, 100010434), FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities TIN 2017-85179- C3-2-R, TIN 2017-85179-C3-3-R, MDM-2015-0502.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Talking to plants: an IoT system supporting human-plant interactions and learning

  • Tabuenca, Bernardo
  • Greller, Wolfgang
  • Hernández Leo, Davinia
  • Gilarranz-Casado, Carlos
  • García-Alcántara, Vicente
  • Tovar, Edmundo
The presence of plants in learning spaces can substantially improve well-being among students and teachers. Plants can positively influence environmental parameters such as air quality, temperature, or reverberation, but they also have an impact on parameters such as concentration, collaboration, and learning performance. This study aims to use plants as a learning object to promote ecological learning spaces. The paper presents an IoT system (Smart Spike) designed to collect data, and to provide real-time feedback on the state of the plant, soil, and environment variables. Moreover, this prototype was evaluated by 62 students of Agronomics and Computer Engineering to explore what measurements they considered most relevant, and how they would communicate with the plant using a mobile chatbot. The results aim to establish a better understanding of potential interactions between plants, learners, teachers, and the microclimate with a view to scaffolding learning activities supported by IoT technology and artificial intelligence., This work was funded through Erasmus+ Strategic Partnerships for Higher Education project TEASPILS (2020-1-ES01-KA203-082258). Partial support has also been received from the Madrid Regional Government through the e-Madrid-CM Project under grant S2018/TCS-4307, a project which is co-funded by the European Structural Funds (FSE and FEDER) and the Spanish Ministry TIN2017-85179-C3-3-R, PID2020-112584RBC33. MDM-2015-0502. D. Hernández-Leo (Serra Húnter) acknowledges the support by ICREA under the ICREA Academia program.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Co-creation process and challenges in the conceptualization and development of the edCrumble learning design tool

  • Albó, Laia
  • Hernández Leo, Davinia
Comunicació presentada al Workshop on Co-Creation in the Design, Development and Implementation of Technology-Enhanced Learning (CC-TEL'18), dins el congrés EC-TEL 2018, que se celebra el 3 de setembre a Leeds (Regne Unit)., This paper presents the co-creation process followed during the conceptualization, development and evaluation of edCrumble: a learning design (LD) tool which provides an innovative visual representation of the LDs characterized by data analytics with the aim of facilitating the planning, visualization, understanding and reuse of complex LDs. Researchers used several participants’ sources and profiles, different methods (including paper and web-based prototyping, questionnaires, interviews, focus groups, role-play games, sharing activities) and workshop types (isolated vs. long-time). Participatory design workshops and activities are described as well as the challenges encountered during the co-design process with the aim of informing other researchers who are thinking of using co-creation. These challenges include the recruitment and motivation of participants, the management of their expectations, the prioritization of the feedback diversity and a short evaluation of the methods used., This work has been partially funded by RecerCaixa (CoT project) and the Spanish Ministry of Economy and Competitiveness under MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Distributed retrieval practice enhances primary school students’ retention of computational thinking concepts

  • Casanova de Vilalta, Lydia
  • Theophilou, Emily
  • Beardsley, Marc Yoshimi
  • Santos Rodríguez, Patrícia
  • Hernández Leo, Davinia
Comunicació presentada al 17th International Conference on Cognition and Exploratory Learning in Digital Age (CELDA 2020), celebrat del 18 al 20 de novembre de 2020 a Lisboa, Portugal., Efforts are being made to add Computational Thinking (CT) to the curriculum of primary schools in order to develop student abilities to use computational tools to solve problems and better prepare them for an increasingly digital society. Distributed Practice (DP) and Retrieval Practice (RP) are evidence-based practices that have shown to lead to efficient and durable learning. Studies investigating Distributed Retrieval Practice (DRP), a combination of the two evidence-based practices, have found positive effects of DRP on university student learning of anatomy and vocabulary items. As CT is considered to be a complex thinking skill, one that is acquired over time with practice, we investigated whether DRP had durable effects on primary student learning of CT concepts. We conducted a quasi-experimental study involving 20 primary school students between 11 and 12 years of age. The students participated in 6 weekly sessions on CT and completed two tests – one at the end of the fifth session (immediate) and the other a week later (delayed). At the end of each of the first 4 sessions, students performed DRP by completing a class-wide review quiz consisting of 5 multiple-choice questions. The results of the study show that students attained higher scores on the delayed test (72.6% ± 19.2) in comparison to the immediate test (67.9% ± 20.7). However, the difference in scores was not significant. The results suggest that DRP may play a role in helping students overcome the natural decay of memory, however, studies with a larger sample size are required. Further, this study demonstrates that DRP can be applied in an authentic classroom environment that involves primary school student learning of a complex subject such as CT., This work has been partially funded by the European Regional Development Fund, Erasmus+, and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities under project grants TIN2017-85179-C3-3-R, 2017-1-ES01-KA201-038220 and MDM-2015-0502. Dr. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

How are learning analytics considering the societal values of fairness, accountability, transparency and human well-being?: a literature review

  • Hakami, Eyad
  • Hernández Leo, Davinia
Comunicació presentada al LASI-SPAIN 2020: Learning Analytics Summer Institute Spain 2020, celebrat del 15 al 16 de juny de 2020 a Valladolid, Espanya., The scientific community is currently engaged in global efforts towards a movement that promotes positive human values in the ways we formulate and apply Artificial Intelligence (AI) solutions. As the use of intelligent algorithms and analytics are becoming more involved in how decisions are made in public and private life, the societal values of Fairness, Accountability and Transparency (FAT) and the multidimensional value of human Well-being are being discussed in the context of addressing potential negative and positive impacts of AI. This research paper reviews these four values and their implications in algorithms and investigates their empirical existence in the interdisciplinary field of Learning Analytics (LA). We present and highlight results of a literature review that was conducted across all the editions of the Learning Analytics & Knowledge (LAK) ACM conference proceedings. The findings provide different insights on how these societal and human values are being considered in LA research, tools, applications and ethical frameworks., This work has been partially funded by the EU Regional Development Fund and the National Research Agency of the Spanish Ministry of Science and Innovation under project grants TIN2017-85179-C3-3-R, RED2018- 102725-T. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia program.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

An actionable orchestration dashboard to enhance collaboration in the classroom

  • Amarasinghe, Ishari
  • Hernández Leo, Davinia
  • Michos, Konstantinos
  • Vujovic, Milica
The orchestration of collaborative learning activities in technology-enhanced classrooms has become a nontrivial endeavor for educators. Depending on the behaviors and needs of students that emerge in real educational situations, educators may need to orchestrate activity adaptations on the fly. These adaptations may range from the provision of additional scaffolding by the educator (e.g., the educator's participation in a group discussion) to a change in the planned pedagogical scenario (e.g., the duration). This article aims to contribute to the orchestration of technology-mediated collaborative learning sessions in a classroom context. We present the design, implementation, and evaluation of a teacher-facing dashboard that supports teachers in orchestrating scripted collaboration. Evaluation studies were conducted in 16 classroom sessions. The findings indicate that teachers found the information on the dashboard to be actionable and help facilitate just in time support to student groups., This work has been partially funded by "la Caixa Foundation" (CoT project, 100010434) and the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015- 0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Conceptualising a visual representation model for MOOC-based blended learning designs

  • Albó, Laia
  • Hernández Leo, Davinia
This article reports on a study about how massive open online course (MOOC)-based blended learning designs can be visually represented to facilitate their comprehension and sharing. We carried out an iterative co-creation process with different stakeholders to conceptualise a visual learning design representation model within the context of blending MOOCs with face-to-face courses. The data analysed was derived from questionnaires and the generated representations. Results indicate that the representation enabled educators to easily visualise the overall structure of the learning designs and the relationships between the different design elements, providing a context for fostering reflection and decision-making during the planning of MOOC-based blended learning designs., The authors would like to thank all the participants of the workshops. This work has been partially funded by “la Caixa Foundation” (CoT project, 100010434) and FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R. Davinia Hernández-Leo (one of the authors) is a Serra Húnter Fellow.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Teacher-led inquiry in technology-supported school communities

  • Michos, Konstantinos
  • Hernández Leo, Davinia
  • Albó, Laia
Learning design is a research field which studies how to best support teachers as designers of Technology Enhanced Learning (TEL) situations. Although substantial work has been done in the articulation of the learning design process, little is known about how learning designs are experienced by students and teachers, especially in the context of schools. This paper empirically examines if a teacher inquiry model, as a tool for systematic research by teachers into their own practice, facilitates the connection between the design and data‐informed reflection on TEL interventions in two school communities. High school teachers participated in a learning design professional development program supported by a web‐based community platform integrating a teacher inquiry tool (TILE). A multiple case study was conducted aimed at understanding: (a) current teacher practice and (b) teacher involvement in inquiry cycles of design and classroom implementations with technologies. Multiple data sources were used over a one year period including focus groups transcripts, teacher interview protocols, digital artifacts, and questionnaires. Sharing teacher‐led inquiries together with learning analytics was perceived as being useful for connecting pedagogical intentions with the evaluation of their enactment with learners, and this differed from their current practice. Teachers’ reflections about their designs focused on the time management of learning activities and their familiarity with the enactment and analytics tools. Results inform how technology can support teacher‐led inquiry and collective reflective practice in schools., This work has been partially funded by RecerCaixa (CoT project) and the Spanish Ministry of Economy and Competitiveness under MDM-2015-0502, TIN2014-53199-C3-3-R and TIN2017-85179-C3-3-R.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

El papel de los espacios como facilitadores del aprendizaje colaborativo: Estudio cualitativo en Grados en Ingeniería y Másteres TIC de la UPF

  • Santos Rodríguez, Patrícia
  • Moreno, Verónica
  • Hernández Leo, Davinia
Este artículo presenta los resultados obtenidos en un análisis realizado en estudios de grado y master (ámbitos de ingeniería y TIC) de la UPF enfocado en el papel que juegan los espacios colaborativos de aprendizaje (físicos y virtuales) ofrecidos por la universidad en actividades académicas. El estudio usa una metodología cualitativa para la recogida de datos. Los resultados obtenidos muestran un diagnóstico de la situación actual, incluyendo buenas prácticas que podrían reforzarse en el futuro o aspectos de mejora a considerar en la reformulación de los espacios de aprendizaje., This article presents the results obtained in a study carried out in Studies of Engineering Degrees and ICT Masters at UPF. Its purpose is the study of the role of collaborative learning spaces (physical and virtual) offered by the university in academic activities. The study uses a qualitative methodology for data collection. The results show a diagnosis of the current situation, including best practices that could be strengthened in the future or aspects of improvement to be considered in the reformulation of learning spaces., Este trabajo ha sido parcialmente financiado por el programa UPF PlaClik y el Fondo de Desarrollo Regional de la UE y la Agencia Nacional de Investigación del Ministerio de Ciencia, Innovación y Universidades de España (TIN2017-85179-C3-3-R).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Supporting online collaborative design for teacher professional development

  • Marín, Victoria I.
  • Asensio Pérez, Juan I.
  • Villagrá Sobrino, Sara
  • Hernández Leo, Davinia
  • García Sastre, Sara
This paper describes a study on online collaborative design in the context of teacher professional development. 25 teachers from different Spanish universities and disciplines participated in the study. The aim was to understand how to support teachers in interuniversity teams to collaborate fully online along the learning design process of a discipline-based situation that integrates ICT, a problem scarcely tackled in the literature. The described interpretive study, using mixed methods, explores the support to online co-design provided by a novel ICT community platform named ILDE (Integrated Learning Design Environment). Lessons drawn from the results can contribute to the improvement of online collaborative design processes in the context of teacher professional development., This work has been partially supported by the Spanish Ministry of Science, Innovation and Universities [project EDU2017-84223-R], the Spanish State Research Agency (AEI) [projects TIN2017-85179-C3-2-R and TIN2014-53199-C3-2-R, TIN2014-53199-C3-3-R and TIN2017-85179-C3-3-R], the Regional Government of Castilla y León and the European Regional Development Fund [project VA018U16], the European Commission [project 588438-EPP-1-2017-1-EL-EPPKA2-KA], the Spanish Ministry of Economy and Competitiveness [project MDM-2015-0502] and RecerCaixa (CoT).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Supporting students in making informed data sharing decisions: from comprehension to consenting

  • Beardsley, Marc Yoshimi
  • Martínez Moreno, Judit
  • Santos Rodríguez, Patrícia
  • Hernández Leo, Davinia
Comunicació presentada a: ICALT 2020 International Conference on Advanced Learning Technologies and Technology-enhanced Learning, organitzada a Tartu, Estònia, del 6 al 9 de juliol de 2020, Whether deciding to participate in a study or gain access to online applications, research suggests that individuals often fail to understand the conditions they agree to when giving consent. Limited comprehension related to the risks of big data and habituation may contribute to consent being given in a manner that counters the best interests of individuals (i.e. a privacy paradox). Who is responsible for helping students learn to make informed decisions regarding the sharing of their data? We conducted a quasi-experimental study involving 127 undergraduate students. We explored the effects on study enrolment of supporting students in making informed data sharing decisions. Prior to reading the consent form for a study involving the evaluation of a collaborative learning application, one group of participants was primed to think about data sharing risks and evaluate their participation in terms of a harm-benefit decision whereas the other group was not. The primed group scored lower on a consent form comprehension quiz yet had higher enrolment rates and were more likely to cite trust as reasoning for enrolling in the study., This work has been partially funded by the European Regional Development Fund and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities, under project grants TIN2017-85179-C3-3-R and MDM-2015-0502. D. Hernãndez-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Comparing pre-service and in-service teacher perceptions of the science of learning

  • Beardsley, Marc Yoshimi
  • Martínez Moreno, Judit
  • Hernández Leo, Davinia
Comunicació presentada a: XI Congrés CIDUI celebrat del 30 de juny al 2 de juliol de 2021 de manera virtual., This paper presents the results of a survey on teacher formation and beliefs related to the science of learning (e.g. the science of how people learn) completed by in-service and pre-service teachers. The study results suggest there is a gap, as perceived by both in-service and pre-service teachers themselves, in teacher knowledge and confidence related to the science of learning. This gap exists despite most teachers indicating that the science of learning should be a required part of initial teacher education. Overall, this study supports the notion that teachers’ would be receptive to interventions that improve their knowledge of the science of learning., This work was partially funded by the European Regional Development Fund, Erasmus+, and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities, under project grants TIN2017-85179-C3-3-R, 2017-1-ES01-KA201-038220 and MDM-2015-0502. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Teachers’ self-perception in maker education: three approaches for STEM professional development

  • Martínez Moreno, Judit
  • Santos Rodríguez, Patrícia
  • Hernández Leo, Davinia
Comunicació presentada a: 21st International Conference on Advanced Learning Technologies (ICALT) celebrat del 12 al 15 de juliol de 2021 a Tartu, Estònia., This paper analyzes the effect that three different approaches for teacher professional development based on the maker education have on teachers’ self-perceived ability for implementing the maker educational practices. The results indicate that there is a significant improvement regarding the feeling of being able to design maker-based educational lessons after participating in any of the professional development courses. Concretely, individual and practical activities requiring the development of a maker project are the ones that help the most to improve teachers’ self-perception regarding the maker and STEM education in primary education levels., This work has been partially funded by the EU Regional Development Fund and the National Research Agency of the Spanish Ministry of Science, under project grants TIN2017-85179-C3-3-R, MDM-2015-0502. Dr. Hemández- Leo acknowledges the support by ICREA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Examining university students’ motivation, abilities and preferences related to learning to learn

  • Beardsley, Marc Yoshimi
  • Gutierrez, Nicolas
  • Hernández Leo, Davinia
Comunicació presentada a: ICALT 2020 International Conference on Advanced Learning Technologies and Technology-enhanced Learning, organitzada a Tartu, Estònia, del 6 al 9 de juliol de 2020, Learning to learn has been identified as an underdeveloped yet critical skill for learners. However, interventions often struggle to alter learner behavior in a lasting manner. We conducted a quasi-experimental study, guided by the Fogg Behavior Model, that involved 83 first-year university students in a computer engineering degree program. Our study examined learner levels of motivation, self-assessments of their abilities, and preferences for future interventions related to learning to learn. Our results suggest that student learning to learn skills are underdeveloped, not all students are motivated to improve their learning skills, and ICT-based solutions are preferred to more traditional educational approaches., This work was partially funded by the European Regional Development Fund, Erasmus+, and the National Research Agency of the Spanish Ministry of Science, Innovation and Universities, under project grants TIN2017-85179-C3-3-R, 2017-1-ESOI-KA201-038220 and MDM-2015-0502. D. Hernandez-Leo acknowledges the support by ICRA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Collaborative educational location-based activities with no teacher supervision: design implications

  • Velamazán, Mariano
  • Santos Rodríguez, Patrícia
  • Hernández Leo, Davinia
Comunicació presentada al DELbA 2020: Workshop on Designing and Facilitating Educational Location-based Applications, celebrat el 15 de setembre a Heidelberg, Alemanya., This paper analyses a gamified collaborative formal–informal outdoor activity and uses the findings to inform the design of future mobile collaboration tools. We present a case study framed in two editions (in years 2018 and 2019) of a (math) gymkhana1 for 15- and 16-year-old students, during which small groups worked collaboratively outside school, with no teacher supervision. From the case study, we present the analysis of the observations of three groups that participated in the activity and the post-activity questionnaire answered by 80 students. The analysis of the questionnaire reveals factors that students appreciated as promoting productive work (i.e. working together, a sense of agency because they were completely on their own and a change of perception of the nature of the subject matter). The analysis of the observations points to other elements that promote successful collaborative work, most of them confirming findings from previous research, such as engaged feedback, joint attention and alignment of goals. But other elements require more research, such as the importance of role changes over time and a broader view of the subject matter, as well as those specific to collaborating outdoors, such as finding/locating the task and matching the description of the task with the real object/place. From those elements, we derive design implications that should inform the design of future mobile educational location-based apps (ELbAs) for collaboration., This work has been partially funded by the EU Regional Development Fund and the National Research Agency of the Spanish Ministry of Science (TIN2017- 85179-C3-3-R). D. Hernández-Leo acknowledges the support by the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Concept-level design analytics for blended courses

  • Albó, Laia
  • Barria-Pineda, Jordan
  • Brusilovsky, Peter
  • Hernández Leo, Davinia
Comunicació presentada a: EC-TEL 2019 celebrat a Delft, Països Baixos, del 16 al 19 de setembre de 2019., Although many efforts are being made to provide educators with dashboards and tools to understand student behaviors within specific technological environments (learning analytics), there is a lack of work in supporting educators in making data-informed design decisions when designing a blended course and planning learning activities. In this paper, we introduce concept-level design analytics, a knowledge-based visualization, which uncovers facets of the learning activities that are being authored. The visualization is integrated into a (blended) learning design authoring tool, edCrumble. This new approach is explored in the context of a higher education programming course, where teaching assistants design labs and home practice sessions with online smart learning content on a weekly basis. We performed a within-subjects user study to compare the use of the design tool both with and without the visualization. We studied the differences in terms of cognitive load, design outcomes and user actions within the system to compare both conditions to the objective of evaluating the impact of using design analytics during the decision-making phase of course design., This work has also been partially funded by NSF DRL 1740775, “la Caixa Foundation” (CoT project, 100010434) and FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R. DHL is a Serra Húnter Fellow.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Emergency education effects on teacher abilities and motivation to use digital technologies

  • Beardsley, Marc Yoshimi
  • Albó, Laia
  • Aragón, Pablo
  • Hernández Leo, Davinia
To identify factors that can contribute toward supporting educator adoption of digital technologies beyond the emergency remote teaching response to COVID‐19, we investigated how teachers’ motivation and abilities related to the use of digital technologies for teaching changed since the onset of the pandemic. Two surveys and interviews were conducted with school teachers in Spain. The first survey was completed at the onset of the COVID‐19 lockdown, the second survey and interviews in the weeks leading up to the school year that followed. Survey questions were from SELFIE and the Work Tasks Motivation Scale for Teachers. Moreover we analysed the type of advice teachers sought on Twitter during the lockdown and post‐lockdown periods. Results indicate that teachers believe their proficiency in using digital technologies for teaching has improved. Teacher confidence in using technology for preparing lessons, class teaching, assessing and providing feedback, and for communicating with students and families has increased along with teacher motivation to improve their digital skills and use digital technologies for teaching. Teacher advice seeking on Twitter seemed to shift from serving immediate instructional needs to focussing on professional development and the creation of their own digital content., This work has been partially funded by the EU Regional Development Fund, the National Research Agency of the Spanish Ministry of Science, Innovation and Universities and Erasmus+, under project grants TIN2017‐85179‐C3‐3‐R, 2019‐1‐FI01‐KA201‐060881, 2019‐1‐ES01‐KA201‐065279. D. Hernández‐Leo acknowledges financial support by ICREA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Knowledge-based design analytics for authoring courses with smart learning content

  • Albó, Laia
  • Barria-Pineda, Jordan
  • Brusilovsky, Peter
  • Hernández Leo, Davinia
Over the last 10 years, learning analytics have provided educators with both dashboards and tools to understand student behaviors within specific technological environments. However, there is a lack of work to support educators in making data-informed design decisions when designing a blended course and planning appropriate learning activities. In this paper, we introduce knowledge-based design analytics that uncover facets of the learning activities that are being created. A knowledge-based visualization is integrated into edCrumble, a (blended) learning design authoring tool. This new approach is explored in the context of a higher education programming course, where instructors design labs and home practice sessions with online smart learning content on a weekly basis. We performed a within-subjects user study to compare the use of the design tool both with and without visualization. We studied the differences in terms of cognitive load, controllability, confidence and ease of choice, design outcomes, and user actions within the system to compare both conditions with the objective of evaluating the impact of using design analytics during the decision-making phase of course design. Our results indicate that the use of a knowledge-based visualization allows the teachers to reduce the cognitive load (especially in terms of mental demand) and that it facilitates the choice of the most appropriate activities without affecting the overall design time. In conclusion, the use of knowledge-based design analytics improves the overall learning design quality and helps teachers avoid committing design errors., This work is a result of a collaboration within a mobility grant for research funded by the SEBAP, Societat Econòmica Barcelonesa d’Amics del País. This work has also been partially funded by NSF DRL 1740775, “la Caixa Foundation” (CoT project, 100010434) and FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Supporting online collaborative design for teacher professional development

  • Marín, Victoria I.
  • Asensio-Pérez, Juan I.
  • Villagrá-Sobrino, Sara L.
  • Hernández Leo, Davinia
  • García-Sastre, Sara
This article describes a study of online collaborative design in the context of teacher professional development. Twenty-five teachers from different Spanish universities participated in the online course. The aim was to understand how to support teachers in interuniversity teams to collaborate fully online throughout the learning design process of a scenario based on their discipline integrating information and communications technology (ICT), an issue scarcely tackled in the literature. The described interpretive study, using mixed methods, explores the support of online co-design provided by a novel ICT community platform named ILDE (Integrated Learning Design Environment). Lessons drawn from the results can contribute to the improvement of online collaborative design processes in the context of teacher professional development., This work has been partially supported by the Spanish Ministry of Science, Innovation and Universities [project EDU2017-84223-R], the Spanish State Research Agency (AEI) [projects TIN2017-85179-C3-2-R and TIN2014-53199-C3-2-R, TIN2014-53199-C3-3-R and TIN2017-85179-C3-3-R], the Regional Government of Castilla y León and the European Regional Development Fund [project VA018U16], the European Commission [project 588438-EPP-1-2017-1-EL-EPPKA2-KA], the Spanish Ministry of Economy and Competitiveness [project MDM-2015-0502] and RecerCaixa (CoT).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Understanding participants motivational factors for the design of a teacher community

  • Gutiérrez Páez, Nicolás Felipe
  • Santos Rodríguez, Patrícia
  • Hernández Leo, Davinia
Comunicació presentada a: 21st International Conference on Advanced Learning Technologies (ICALT 2021) celebrat del 12 al 15 de juliol de 2021 a Tartu, Estonia., Online communities (OC) offer teachers a context for mutual inspiration, collaboration, and professional development. Yet, despite there being several studies analyzing teachers’ motivations to participate in these communities, it is still unclear how these motivations relate with the supporting collaborative platforms and how they can serve as an input for defining and prioritizing design requirements. A survey study was conducted with the participants of an open online and a face-toface training course in the different phases of a 'Maker' educational activity, which were introduced to a supporting platform for sharing, exploring, and co-creating learning designs. Information about 170 teachers’ self-reported motivations to participate in a collaborative environment and their perceptions about the usefulness of the implemented features was gathered. Findings show that participants’ main motivations are not only to gain knowledge, but also include to have fun or to collaborate with the community development. Regarding their perception about the supporting platform, more than the 30% of the participants acknowledged the usefulness of the features implemented and identified the lack of resources and training as the main limitations to participate. Results provide evidence of the importance of the participants motivations to determine design requirements for a platform to enhance collaboration within an OC of teachers., This work has been partially funded by FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities TIN2017-85179-C3-3-R. D. Hernández-Leo acknowledges the support by ICREA under the ICREA Academia programme.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Maker education in primary education: changes in students’ maker-mindset and gender differences

  • Martínez Moreno, Judit
  • Santos, Patricia
  • Hernández Leo, Davinia
Comunicació presentada a: TEEM'21 celebrat del 27 a 29 d'octubre de 2021 a Barcelona, Espanya., Students must learn how to be prepared to enter the global digital network and acquire skills for the 21st century. Maker education allows for the development of such skills. This paper focuses on the implementation of Maker activities within a primary education context through a 10-hour programme across 10 schools. The study aims to analyse the possible impacts of maker education interventions on students’ Maker mindset (self-efficacy, interest and motivation), as well as assessing potential gender differences regarding their prior experience with Maker education and changes experienced on their Maker mindset. Questionnaires were administered before and after the programme's implementation on a sample of 239 students. Results showed that Maker interventions can have positive effects on students’ Maker mindset, increasing their self-efficacy, interest and motivation. In terms of gender differences, girls seemed to have less prior experience with Maker education than boys, yet they reported the same level of interest and motivation. This study contributes to demonstrating the positive impact that Maker education can have on primary education school settings in order to develop 21st century digital skills and bridging the gender gap in STEAM-related subjects., This work has been partially funded by the EU Regional Development Fund and the National Research Agency of the Spanish Ministry of Science, under project grants TIN2017-85179-C3-3-R, PID2020-112584RB-C33, MDM-2015-0502, the Ramon y Cajal programme (P. Santos) and by ICREA under the ICREA Academia programme (D. Hernández-Leo, Serra Hunter).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Round or rectangular tables for collaborative problem solving? A multimodal learning analytics study

  • Vujovic, Milica
  • Hernández Leo, Davinia
  • Tassani, Simone
  • Spikol, Daniel
The current knowledge of the effects of the physical environment on learners’ behaviour in collaborative problem‐solving tasks is underexplored. This paper aims to critically examine the potential of multimodal learning analytics, using new data sets, in studying how the shapes of shared tables affect the learners’ behaviour when collaborating in terms of patterns of participation and indicators related to physical social interactions. The research presented in this paper investigates this question considering the potential interplay with contextual aspects (level of education) and learning design decisions (group size). Three dependent variables (distance between students, range of movement and level of participation) are tested using quantitative and qualitative analyses of data collected using a motion capture system and video recordings. Results show that the use of round tables (vs rectangular tables) leads to higher levels of on‐task participation in the case of elementary school students. For university students, different table shapes seem to have a limited impact on their levels of participation in collaborative problem solving. The analysis shows significant differences regarding the relationship between group size and the distance between students, but there is no substantial evidence that group size affects the level of participation. The findings support previous research highlighting the importance of studying the role of the physical environment as an element of learning design and the potential of multimodal learning analytics in approaching these studies., This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No. 713673. M. Vujovic has received financial support through the “La Caixa” INPhINIT Fellowship Grant for Doctoral studies at Spanish Research Centres of Excellence, “La Caixa” Banking Foundation, Barcelona, Spain. D. Hernández-Leo acknowledges the financial support from ICREA under the ICREA Academia programme. This work has been partially supported by the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM2015-0502, TIN2017-85179-C3-3-R.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Awareness tools for monitoring socio-emotional regulation during collaboration in settings outside school without teacher supervision

  • Velamazán, Mariano
  • Santos, Patricia
  • Hernández Leo, Davinia
Comunicació presentada a 16th European Conference on Technology Enhanced Learning (EC-TEL 2021), celebrat del 20 al 24 de setembre de 2021 de manera virtual., There are several awareness tools developed to research how to support different phases and modes of socio-emotional regulation of learning. Most of these tools have focused on only one mode of regulation (self-, co- or socially-shared) or on one phase (planning, monitoring or reflection) and have been tested in formal settings and at specific, researchers’ predetermined, moments of collaboration (at the beginning, in the middle or at the end of collaboration). In this paper we extend previous research in this area to propose a new tool that could be more naturally integrated during the whole process of collaboration in the underexplored context of informal settings without teacher supervision. The tool presented introduces some features that aim at facilitating a better understanding of social and emotional interactions and regulation of learning. More precisely, the tool supports a communication flow during the monitoring phase of regulation and includes: a) the possibility to be used by a large number of groups of learners, b) awareness tools for monitoring self-, co- and socially-shared emotional regulation c) at any time needed during collaboration, and d) includes other affordances that should indirectly support a better asynchronous collaboration., This work has been partially funded by FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities TIN2017-85179-C3-3-R, PID2020-112584RB-C33. Davinia Hernández-Leo (Serra Húnter) acknowledges the support by ICREA under the ICREA Academia programme. Patricia Santos acknowledges the support by the Spanish Ministry of Science and Innovation under the Ramón y Cajal programme.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Understanding the well-being impact of a computer-supported collaborative learning tool: the case of PyramidApp

  • Hakami, Eyad
  • Hernández Leo, Davinia
  • Amarasinghe, Ishari
Comunicació presentada a: 16th European Conference on Technology Enhanced Learning, EC-TEL celebrat del 20 al 24 de setembre de 2021 de manera virtual., The global efforts toward evaluating the impact of the use of data-driven technologies on humans’ well-being continue to establish societal guidelines for such systems to remain human-centric, serving humanity’s values and safeguarding well-being. In this paper, we apply the first activity of IEEE P7010 recommended practice, a methodology and a set of metrics, to understand the well-being impact of a web-based tool (PyramidApp) that allows teachers to design and deploy Pyramid-pattern based collaborative learning activities in classroom learning scenarios. The tool’s creators who are learning technology researchers (n = 2) and a sample of the tool’s users and stakeholders who are undergraduate students (n = 11), master students (n = 14) and instructors (n = 2) are engaged in surveys and interviews to investigate the tool’s well-being impact by reflecting on well-being indicators distributed to multiple well-being domains. The findings discuss possible impacts of the tool on the well-being domains of life satisfaction, affect, psychological state, community, education, government, human settlement and work. The creators also share views about the extent to which the use of IEEE P7010 increases their awareness of the intended and unintended impacts of their tool on well-being., This work has been partially funded by the EU Regional Development Fund and the National Research Agency of the Spanish Ministry of Science and Innovation under project grants TIN2017-85179-C3-3-R, PID2020-112584RB-C33. D. Hernández-Leo (Serra Húnter) acknowledges the support by ICREA under the ICREA Academia program. E. Hakami acknowledges the grant by Jazan University, Saudi Arabia.