Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 30
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Effect of specific over nonspecific VR-based rehabilitation on poststroke motor recovery: a systematic meta-analysis

  • Maier, Martina
  • Rubio Ballester, Belén
  • Duff, Armin
  • Duarte Oller, Esther
  • Verschure, Paul F. M. J.
BACKGROUND: Despite the rise of virtual reality (VR)-based interventions in stroke rehabilitation over the past decade, no consensus has been reached on its efficacy. This ostensibly puzzling outcome might not be that surprising given that VR is intrinsically neutral to its use-that is, an intervention is effective because of its ability to mobilize recovery mechanisms, not its technology. As VR systems specifically built for rehabilitation might capitalize better on the advantages of technology to implement neuroscientifically grounded protocols, they might be more effective than those designed for recreational gaming. OBJECTIVE: We evaluate the efficacy of specific VR (SVR) and nonspecific VR (NSVR) systems for rehabilitating upper-limb function and activity after stroke. METHODS: We conducted a systematic search for randomized controlled trials with adult stroke patients to analyze the effect of SVR or NSVR systems versus conventional therapy (CT). RESULTS: We identified 30 studies including 1473 patients. SVR showed a significant impact on body function (standardized mean difference [SMD] = 0.23; 95% CI = 0.10 to 0.36; P = .0007) versus CT, whereas NSVR did not (SMD = 0.16; 95% CI = -0.14 to 0.47; P = .30). This result was replicated in activity measures. CONCLUSIONS: Our results suggest that SVR systems are more beneficial than CT for upper-limb recovery, whereas NSVR systems are not. Additionally, we identified 6 principles of neurorehabilitation that are shared across SVR systems and are possibly responsible for their positive effect. These findings may disambiguate the contradictory results found in the current literature., The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This study was supported by SANAR (MINECO, TIN2013- 44200), cDAC (ERC 2013 ADG 341196), and socSMCs (Grant Number EC, H2020-641321).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Adaptive conjunctive cognitive training (ACCT) in virtual reality for chronic stroke patients: a randomized controlled pilot trial

  • Maier, Martina
  • Rubio Ballester, Belén
  • Leiva Bañuelos, Núria
  • Duarte Oller, Esther
  • Verschure, Paul F. M. J.
Background: Current evidence for the effectiveness of post-stroke cognitive rehabilitation is weak, possibly due to two reasons. First, patients typically express cognitive deficits in several domains. Therapies focusing on specific cognitive deficits might not address their interrelated neurological nature. Second, co-occurring psychological problems are often neglected or not diagnosed, although post-stroke depression is common and related to cognitive deficits. This pilot trial aims to test a rehabilitation program in virtual reality that trains various cognitive domains in conjunction, by adapting to the patient's disability and while investigating the influence of comorbidities. Methods: Thirty community-dwelling stroke patients at the chronic stage and suffering from cognitive impairment performed 30 min of daily training for 6 weeks. The experimental group followed, so called, adaptive conjunctive cognitive training (ACCT) using RGS, whereas the control group solved standard cognitive tasks at home for an equivalent amount of time. A comprehensive test battery covering executive function, spatial awareness, attention, and memory as well as independence, depression, and motor impairment was applied at baseline, at 6 weeks and 18-weeks follow-up. Results: At baseline, 75% of our sample had an impairment in more than one cognitive domain. The experimental group showed improvements in attention ([Formula: see text] (2) = 9.57, p < .01), spatial awareness ([Formula: see text] (2) = 11.23, p < .01) and generalized cognitive functioning ([Formula: see text] (2) = 15.5, p < .001). No significant change was seen in the executive function and memory domain. For the control group, no significant change over time was found. Further, they worsened in their depression level after treatment (T = 45, r = .72, p < .01) but returned to baseline at follow-up. The experimental group displayed a lower level of depression than the control group after treatment (Ws = 81.5, z = - 2.76, r = - .60, p < .01) and (Ws = 92, z = - 2.03, r = - .44, p < .05). Conclusions: ACCT positively influences attention and spatial awareness, as well as depressive mood in chronic stroke patients., This study was supported by EIT Health ID 19277 (RGS@HOME) under H2020, SANAR (MINECO, TIN2013–44200), cDAC (ERC-2013-ADG-341196), and socSMCs (641321H2020-FETPROACT-2014).
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

A wearable bracelet device for promoting arm use in stroke patients

  • Rubio Ballester, Belén
  • Lathe, Alica
  • Duarte Oller, Esther
  • Duff, Armin
  • Verschure, Paul F. M. J.
Comunicació presentada a: 3rd International Congress on Neurotechnology, Electronics and Informatics (NEUROTECHNIX), celebrada a Lisboa (Portugal) del 16 al 17 de novembre de 2015., After stroke, many patients experience hemiparesis or weakness on one side of the body. In order to compensate for this lack of motor function, they tend to overuse their non-affected limb. This so called learned non-use may be one of the most relevant contributors to functional loss after post-stroke hospital discharge. We hypothesize that frequent exposure to movement related feedback through a wearable bracelet device may 1) increase the patient’s intrinsic motivation for using the paretic limb, and 2) counteract learned non-use, therefore inducing motor recovery. First, to validate the accelerometers-based measurement of arm use, we recruited 10 right-handed volunteers without neurological impairments. Second, we explored the acceptability and clinical impact of a low-cost wearable system on 4 chronic stroke patients with hemiparesis. Our results suggest that frequent exposure to direct feedback about arm use promotes the integration of the paretic limb in the performanc e of instrumental activities of daily living (iADLs). In addition, results from questionnaires revealed that the use of wearable devices may influence positively the patient’s intrinsic motivation for using the affected arm. To the best of our knowledge, this is the first study suggesting the benefits of wearable-based feedback as an intervention tool for counteracting learned non-use., We would like to acknowledge all patients who participated in this study. Special thanks to Dr. Boza Gomez for her assistance in recruiting stroke patients. This project was supported through ERC project cDAC (FP7-IDEAS-ERC 341196), EC H2020 project socSMCs (H2020-EU.1.2.2. 641321) and MINECO project SANAR (Gobierno de Espaa).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Size matters: How scaling affects the interaction between grid and border cells

  • Santos-Pata, Diogo
  • Zucca, Riccardo
  • Low, Sock Ching
  • Verschure, Paul F. M. J.
Many hippocampal cell types are characterized by a progressive increase in scale along the dorsal-to-ventral axis, such as in the cases of head-direction, grid and place cells. Also located in the medial entorhinal cortex (MEC), border cells would be expected to benefit from such scale modulations. However, this phenomenon has not been experimentally observed. Grid cells in the MEC of mammals integrate velocity related signals to map the environment with characteristic hexagonal tessellation patterns. Due to the noisy nature of these input signals, path integration processes tend to accumulate errors as animals explore the environment, leading to a loss of grid-like activity. It has been suggested that border-to-grid cells' associations minimize the accumulated grid cells' error when rodents explore enclosures. Thus, the border-grid interaction for error minimization is a suitable scenario to study the effects of border cell scaling within the context of spatial representation. In this study, we computationally address the question of (i) border cells' scale from the perspective of their role in maintaining the regularity of grid cells' firing fields, as well as (ii) what are the underlying mechanisms of grid-border associations relative to the scales of both grid and border cells. Our results suggest that for optimal contribution to grid cells' error minimization, border cells should express smaller firing fields relative to those of the associated grid cells, which is consistent with the hypothesis of border cells functioning as spatial anchoring signals., The research leading to these results has received funding from the European Research Council under the European Union's Seventh Framework Programme (FP7/2007–2013)/ERC grant agreement no (341196) cDAC. H2020-SocSMC (socSMC-641321H2020-FETPROACT- 2014).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Collaboration variability in autism spectrum disorder

  • Blancas Muñoz, Maria
  • Maffei, Giovanni
  • Sánchez Fibla, Martí
  • Vouloutsi, Vasiliki
  • Verschure, Paul F. M. J.
This paper addresses how impairments in prediction in young adults with autism spectrum disorder (ASD) relate to their behavior during collaboration. To assess it, we developed a task where participants play in collaboration with a synthetic agent to maximize their score. The agent’s behavior changes during the different phases of the game, requiring participants to model the agent’s sensorimotor contingencies to play collaboratively. Our results (n = 30, 15 per group) show differences between autistic and neurotypical individuals in their behavioral adaptation to the other partner. Contrarily, there are no differences in the self-reports of that collaboration., This work received funding from the European Research Council under the European Union’s Seventh Framework Programme socSMCs (Grant No. EC, H2020-641321). MS-F was supported by Spanish National Grant INSOCO-DPI2016-80116-P.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Erratum to: the visual amplification of goal-oriented movements counteracts acquired non-use in hemiparetic stroke patients

  • Rubio Ballester, Belén
  • Nirme, Jens
  • Duarte Oller, Esther
  • Cuxart, Ampar
  • Rodriguez, Susana
  • Verschure, Paul F. M. J.
  • Duff, Armin
BACKGROUND: Stroke-induced impairments result from both primary and secondary causes, i.e. damage to the brain and the acquired non-use of the impaired limbs. Indeed, stroke patients often under-utilize their paretic limb despite sufficient residual motor function. We hypothesize that acquired non-use can be overcome by reinforcement-based training strategies. METHODS: Hemiparetic stroke patients (n = 20, 11 males, 9 right-sided hemiparesis) were asked to reach targets appearing in either the real world or in a virtual environment. Sessions were divided into 3 phases: baseline, intervention and washout. During the intervention the movement of the virtual representation of the patients' paretic limb was amplified towards the target. RESULTS: We found that the probability of using the paretic limb during washout was significantly higher in comparison to baseline. Patients showed generalization of these results by displaying a more substantial workspace in real world task. These gains correlated with changes in effector selection patterns. CONCLUSIONS: The amplification of the movement of the paretic limb in a virtual environment promotes the use of the paretic limb in stroke patients. Our findings indicate that reinforcement-based therapies may be an effective approach for counteracting learned non-use and may modulate motor performance in the real world., This project was supported through ERC project cDAC (FP7-IDEAS-ERC 341196), EC H2020 project socSMCs (H2020-EU.1.2.2. 641321) and MINECO project SANAR (Gobierno de España).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Editorial: sensorimotor foundations of social cognition

  • Engel, Andreas Karl
  • Verschure, Paul F. M. J.
  • Kragic, Danica
  • Polani, Daniel
  • Effenberg, Alfred O.
  • König, Peter
In classical representation-oriented approaches of social cognition, agents are thought to interact with conspecifics based on their capacity to develop a “theory-of-mind”, i.e., to generate complex models of the intentions, beliefs, and personalities of their interaction partners. In this framework, the primary mode of interaction with the social environment is that of a detached observer who theorizes and produces inferences about other participants. In contrast, this Research Topic seeks to turn the spotlight on the grounding of social cognition in dynamic sensorimotor and informational coupling of agents, in human-human as well as human-robot interaction settings. According to this view, interaction dynamics hold substantial clues to the mechanism of social understanding and its disturbances (as for example observed in autism spectrum disorders). The argument is that high-level social deficits may be rooted in the impaired capacity for entraining and sustaining sensorimotor and informational coupling. Beyond novel insights into the mechanisms of functional and dysfunctional social behavior, the investigation of basic sensorimotor interaction patterns may help the development of socially competent robot technology. Tapping into the same logic, robotic agents sensitive to interpersonal sensorimotor contingencies should have an advantage over technology that does not consider this key aspect of human interaction. This Research Topic provides an interdisciplinary overview of trends and recent developments in conceptual, methodological and basic research, as well as applications of sensorimotor approaches in social cognitive science, neuroscience, and robotic research. One of the key questions is how concepts and methods from social cognitive and neuroscience transfer to human-robot interaction., The authors acknowledge support by the EU through project socSMCs (H2020-641321).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Estimating upper-extremity function from kinematics in stroke patients following goal-oriented computer-based training

  • Rubio Ballester, Belén
  • Antenucci, Fabrizio
  • Maier, Martina
  • Coolen, Anthony C. C.
  • Verschure, Paul F. M. J.
Introduction: After a stroke, a wide range of deficits can occur with varying onset latencies. As a result, assessing impairment and recovery are enormous challenges in neurorehabilitation. Although several clinical scales are generally accepted, they are time-consuming, show high inter-rater variability, have low ecological validity, and are vulnerable to biases introduced by compensatory movements and action modifications. Alternative methods need to be developed for efficient and objective assessment. In this study, we explore the potential of computer-based body tracking systems and classification tools to estimate the motor impairment of the more affected arm in stroke patients. Methods: We present a method for estimating clinical scores from movement parameters that are extracted from kinematic data recorded during unsupervised computer-based rehabilitation sessions. We identify a number of kinematic descriptors that characterise the patients’ hemiparesis (e.g., movement smoothness, work area), we implement a double-noise model and perform a multivariate regression using clinical data from 98 stroke patients who completed a total of 191 sessions with RGS. Results: Our results reveal a new digital biomarker of arm function, the Total Goal-Directed Movement (TGDM), which relates to the patients work area during the execution of goal-oriented reaching movements. The model’s performance to estimate FM-UE scores reaches an accuracy of R2: 0.38 with an error (σ: 12.8). Next, we evaluate its reliability (r = 0.89 for test-retest), longitudinal external validity (95% true positive rate), sensitivity, and generalisation to other tasks that involve planar reaching movements (R2: 0.39). The model achieves comparable accuracy also for the Chedoke Arm and Hand Activity Inventory (R2: 0.40) and Barthel Index (R2: 0.35). Conclusions: Our results highlight the clinical value of kinematic data collected during unsupervised goal-oriented motor training with the RGS combined with data science techniques, and provide new insight into factors underlying recovery and its biomarkers., This study was supported by the European Commission (EC), the European Research Council under Grant agreement 341196 (cDAC), EC H2020 project socSMCs (H2020EU.1.2.2. 641321), and by the RGS@home, EIT Health project 19277. EIT Health is supported by EIT, a body of the European Union.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Modeling the formation of social conventions from embodied real-time interactions

  • Freire, Ismael T.
  • Moulin-Frier, Clément
  • Sánchez Fibla, Martí
  • Arsiwalla, Xerxes D.
  • Verschure, Paul F. M. J.
What is the role of real-time control and learning in the formation of social conventions? To answer this question, we propose a computational model that matches human behavioral data in a social decision-making game that was analyzed both in discrete-time and continuous-time setups. Furthermore, unlike previous approaches, our model takes into account the role of sensorimotor control loops in embodied decision-making scenarios. For this purpose, we introduce the Control-based Reinforcement Learning (CRL) model. CRL is grounded in the Distributed Adaptive Control (DAC) theory of mind and brain, where low-level sensorimotor control is modulated through perceptual and behavioral learning in a layered structure. CRL follows these principles by implementing a feedback control loop handling the agent’s reactive behaviors (pre-wired reflexes), along with an Adaptive Layer that uses reinforcement learning to maximize long-term reward. We test our model in a multi-agent game-theoretic task in which coordination must be achieved to find an optimal solution. We show that CRL is able to reach human-level performance on standard game-theoretic metrics such as efficiency in acquiring rewards and fairness in reward distribution., PFMJV. This project has received funding from the European Union’s Horizon 2020 research and innovation programme, ID:820742 and ID:641321. MSF and CMF. This project has been supported by INSOCO-DPI2016-80116-P. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Counteracting learned non-use in chronic stroke patients with reinforcement-induced movement therapy

  • Rubio Ballester, Belén
  • Maier, Martina
  • San Segundo Mozo, Rosa María
  • Castañeda, Victoria
  • Duff, Armin
  • Verschure, Paul F. M. J.
Background: After stroke, patients who suffer from hemiparesis tend to suppress the use of the affected extremity, a condition called learned non-use. Consequently, the lack of training may lead to the progressive deterioration of motor function. Although Constraint-Induced Movement Therapies (CIMT) have shown to be effective in treating this condition, the method presents several limitations, and the high intensity of its protocols severely compromises its adherence. We propose a novel rehabilitation approach called Reinforcement-Induced Movement Therapy (RIMT), which proposes to restore motor function through maximizing arm use. This is achieved by exposing the patient to amplified goal-oriented movements in VR that match the intended actions of the patient. We hypothesize that through this method we can increase the patients self-efficacy, reverse learned non-use, and induce long-term motor improvements. Methods: We conducted a randomized, double-blind, longitudinal clinical study with 18 chronic stroke patients. Patients performed 30 minutes of daily VR-based training during six weeks. During training, the experimental group experienced goal-oriented movement amplification in VR. The control group followed the same training protocol but without movement amplification. Evaluators blinded to group designation performed clinical measurements at the beginning, at the end of the training and at 12-weeks follow-up. We used the Fugl-Meyer Assessment for the upper extremities (UE-FM) (Sanford et al., Phys Ther 73:447–454, 1993) as a primary outcome measurement of motor recovery. Secondary outcome measurements included the Chedoke Arm and Hand Activity Inventory (CAHAI-7) (Barreca et al., Arch Phys Med Rehabil 6:1616–1622, 2005) for measuring functional motor gains in the performance of Activities of Daily Living (ADLs), the Barthel Index (BI) for the evaluation of the patient’s perceived independence (Collin et al., Int Disabil Stud 10:61–63, 1988), and the Hamilton scale (Knesevich et al., Br J Psychiatr J Mental Sci 131:49–52, 1977) for the identification of improvements in mood disorders that could be induced by the reinforcement-based intervention. In order to study and predict the effects of this intervention we implemented a computational model of recovery after stroke. Results: While both groups showed significant motor gains at 6-weeks post-treatment, only the experimental group continued to exhibit further gains in UE-FM at 12-weeks follow-up (p<.05). This improvement was accompanied by a significant increase in arm-use during training in the experimental group. Conclusions: Implicitly reinforcing arm-use by augmenting visuomotor feedback as proposed by RIMT seems beneficial for inducing significant improvement in chronic stroke patients. By challenging the patients’ self-limiting believe system and perceived low self-efficacy this approach might counteract learned non-use., This project was supported through ERC project cDAC (FP7-IDEAS-ERC 341196), EC H2020 project socSMCs (H2020-EU.1.2.2. 641321) and MINECO project SANAR (Gobierno de España).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

A critical time window for recovery extends beyond one-year post-stroke

  • Rubio Ballester, Belén
  • Maier Martina
  • Duff, Armin
  • Cameirão, Mónica
  • Bermúdez i Badia, Sergi
  • Duarte Oller, Esther
  • Cuxart, Ampar
  • Rodriguez, Susana
  • San Segundo Mozo, Rosa María
  • Verschure, Paul F. M. J.
The impact of rehabilitation on post-stroke motor recovery and its dependency on the patient's chronicity remain unclear. The field has widely accepted the notion of a proportional recovery rule with a "critical window for recovery" within the first 3-6 mo poststroke. This hypothesis justifies the general cessation of physical therapy at chronic stages. However, the limits of this critical window have, so far, been poorly defined. In this analysis, we address this question, and we further explore the temporal structure of motor recovery using individual patient data from a homogeneous sample of 219 individuals with mild to moderate upper-limb hemiparesis. We observed that improvement in body function and structure was possible even at late chronic stages. A bootstrapping analysis revealed a gradient of enhanced sensitivity to treatment that extended beyond 12 mo poststroke. Clinical guidelines for rehabilitation should be revised in the context of this temporal structure. NEW & NOTEWORTHY Previous studies in humans suggest that there is a 3- to 6-mo "critical window" of heightened neuroplasticity poststroke. We analyze the temporal structure of recovery in patients with hemiparesis and uncover a precise gradient of enhanced sensitivity to treatment that expands far beyond the limits of the so-called critical window. These findings highlight the need for providing therapy to patients at the chronic and late chronic stages.
Repositorio Digital de la UPF
Publicación Contribución de congreso (ConferenceOutput)

Autonomous development of turn-taking behaviors in agent populations: a computational study

  • Moulin-Frier, Clément
  • Sánchez Fibla, Martí
  • Verschure, Paul F. M. J.
Comunicació presentada a 5th IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob); 2015 Aug 13-16; Providence, USA., We provide an original computational model showing how turn-taking behaviors can self-organize out of sensorimotor/ninteractions between vocalizing agents. These agents are equipped with a cognitive architecture based on two coupled/ncontrol loops: a reactive one implementing a basic regulatory behavior to maintain vocal listening and an adaptive one learning an action policy to maximize an overall group presence estimation. We show that the reactive process allows to bootstrap the adaptive learning to converge toward a collective turn-taking strategy. This model provides a computational support to the hypothesis that turn-taking can emerge from functional constraints related to group cohesion and vocal signal interferences and suggests future directions of research to understand how social behaviors/ncan result from sensorimotor interactions., This work is supported by the Socialising Sensori-Motor Contingencies project socSMC-641321H2020-FETPROACT-2014.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Consensus paper: towards a systems-level view of cerebellar function: the interplay between cerebellum, basal ganglia, and cortex

  • Caligiore, Daniele
  • Pezzulo, Giovanni
  • Baldassarre, Gianluca
  • Bostan, Andreea C.
  • Strick, Peter L.
  • Doya, Kenji
  • Helmich, Rick C.
  • Dirkx, Michiel
  • Houk, James
  • Jörntell, Henrik
  • Lago-Rodriguez, Angel
  • Galea, Joseph M.
  • Miall, R. Chris
  • Popa, Traian
  • Kishore, Asha
  • Verschure, Paul F. M. J.
  • Zucca, Riccardo
  • Herreros, Ivan
Despite increasing evidence suggesting the cerebellum works in concert with the cortex and basal ganglia, the nature of the reciprocal interactions between these three brain regions remains unclear. This consensus paper gathers diverse recent views on a variety of important roles played by the cerebellum within the cerebello-basal ganglia-thalamo-cortical system across a range of motor and cognitive functions. The paper includes theoretical and empirical contributions, which cover the following topics: recent evidence supporting the dynamical interplay between cerebellum, basal ganglia, and cortical areas in humans and other animals; theoretical neuroscience perspectives and empirical evidence on the reciprocal influences between cerebellum, basal ganglia, and cortex in learning and control processes; and data suggesting possible roles of the cerebellum in basal ganglia movement disorders. Although starting from different backgrounds and dealing with different topics, all the contributors agree that viewing the cerebellum, basal ganglia, and cortex as an integrated system enables us to understand the function of these areas in radically different ways. In addition, there is unanimous consensus between the authors that future experimental and computational work is needed to understand the function of cerebellar-basal ganglia circuitry in both motor and non-motor functions. The paper reports the most advanced perspectives on the role of the cerebellum within the cerebello-basal ganglia-thalamo-cortical system and illustrates other elements of consensus as well as disagreements and open questions in the field., The present research was supported by the European Commission 7th Framework Programme (FP7/2007-2013), “Challenge 2—Cognitive Systems, Interaction, Robotics,” grant agreement No. ICT IP-231722, project “IM-CLeVeR—Intrinsically Motivated Cumulative Learning Versatile Robots” to D. Caligiore; by the Human Frontier Science Program (HFSP), award number RGY0088/2014 to G. Pezzulo; in parts by funds from the Office of Research and Development, Medical Research Service, Department of Veterans Affairs and National Institutes of Health Grants R01 NS24328, R01 MH56661, P40 OD010996, and P30 NS076405 to P. L. Strick; by the European Research Council project MotMotLearn (637488) to J. Galea; by the MRC (grant R/J012610/1) to R.C. Miall and Wellcome Trust, grant WT087554 to R.C. Miall and A. Lago-Rodriguez; by the European Research Council under the European Union’s Seventh Framework Programme (FP7/2007-2013)/ERC grant agreement no. 341196 to P. F. M. J. Verschure; and by the European Commission’s Horizon 2020 socSMC (under agreement number socSMC-641321H2020-FETPROACT-2014) to I. Herreros. We thank the two anonymous reviewers and Professor Michael A. Arbib who have contributed to enhance the quality of this consensus paper with precious comments.
Dipòsit Digital de la UB
Publicación Artículo científico (JournalArticle)

Modeling the formation of social conventions from embodied real-time interactions

  • Freire, Ismael T.
  • Moulin Frier, Clement
  • Sanchez Fibla, Marti
  • Arsiwalla, Xerxes D.
  • Verschure, Paul F. M. J.
What is the role of real-time control and learning in the formation of social conventions? To answer this question, we propose a computational model that matches human behavioral data in a social decision-making game that was analyzed both in discrete-time and continuous-time setups. Furthermore, unlike previous approaches, our model takes into account the role of sensorimotor control loops in embodied decision-making scenarios. For this purpose, we introduce the Control-based Reinforcement Learning (CRL) model. CRL is grounded in the Distributed Adaptive Control (DAC) theory of mind and brain, where low-level sensorimotor control is modulated through perceptual and behavioral learning in a layered structure. CRL follows these principles by implementing a feedback control loop handling the agent's reactive behaviors (pre-wired reflexes), along with an Adaptive Layer that uses reinforcement learning to maximize long-term reward. We test our model in a multi-agent game-theoretic task in which coordination must be achieved to find an optimal solution. We show that CRL is able to reach human-level performance on standard game-theoretic metrics such as efficiency in acquiring rewards and fairness in reward distribution.
Dipòsit Digital de la UB
Publicación Artículo científico (JournalArticle)

Effect of specific over nonspecific VR-based rehabilitation on poststroke motor recovery: A systematic meta-analysis

  • Maier, Martina
  • Rubio Ballester, Belén
  • Duff, Armin
  • Duarte Oller, Esther
  • Verschure, Paul
Background. Despite the rise of virtual reality (VR)-based interventions in stroke rehabilitation over the past decade, no consensus has been reached on its efficacy. This ostensibly puzzling outcome might not be that surprising given that VR is intrinsically neutral to its use—that is, an intervention is effective because of its ability to mobilize recovery mechanisms, not its technology. As VR systems specifically built for rehabilitation might capitalize better on the advantages of technology to implement neuroscientifically grounded protocols, they might be more effective than those designed for recreational gaming. Objective. We evaluate the efficacy of specific VR (SVR) and nonspecific VR (NSVR) systems for rehabilitating upper-limb function and activity after stroke. Methods. We conducted a systematic search for randomized controlled trials with adult stroke patients to analyze the effect of SVR or NSVR systems versus conventional therapy (CT). Results. We identified 30 studies including 1473 patients. SVR showed a significant impact on body function (standardized mean difference [SMD] = 0.23; 95% CI = 0.10 to 0.36; P = .0007) versus CT, whereas NSVR did not (SMD = 0.16; 95% CI = −0.14 to 0.47; P = .30). This result was replicated in activity measures. Conclusions. Our results suggest that SVR systems are more beneficial than CT for upper-limb recovery, whereas NSVR systems are not. Additionally, we identified 6 principles of neurorehabilitation that are shared across SVR systems and are possibly responsible for their positive effect. These findings may disambiguate the contradictory results found in the current literature.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Counteracting learned non-use in chronic stroke patients with reinforcement-induced movement therapy

  • Rubio Ballester, Belén
  • Maier, Martina
  • San Segundo Mozo, Rosa María
  • Castañeda, Victoria
  • Duff, Armin
  • Verschure, Paul F. M. J.
Background: After stroke, patients who suffer from hemiparesis tend to suppress the use of the affected extremity, a condition called learned non-use. Consequently, the lack of training may lead to the progressive deterioration of motor function. Although Constraint-Induced Movement Therapies (CIMT) have shown to be effective in treating this condition, the method presents several limitations, and the high intensity of its protocols severely compromises its adherence. We propose a novel rehabilitation approach called Reinforcement-Induced Movement Therapy (RIMT), which proposes to restore motor function through maximizing arm use. This is achieved by exposing the patient to amplified goal-oriented movements in VR that match the intended actions of the patient. We hypothesize that through this method we can increase the patients self-efficacy, reverse learned non-use, and induce long-term motor improvements. Methods: We conducted a randomized, double-blind, longitudinal clinical study with 18 chronic stroke patients. Patients performed 30 minutes of daily VR-based training during six weeks. During training, the experimental group experienced goal-oriented movement amplification in VR. The control group followed the same training protocol but without movement amplification. Evaluators blinded to group designation performed clinical measurements at the beginning, at the end of the training and at 12-weeks follow-up. We used the Fugl-Meyer Assessment for the upper extremities (UE-FM) (Sanford et al., Phys Ther 73:447–454, 1993) as a primary outcome measurement of motor recovery. Secondary outcome measurements included the Chedoke Arm and Hand Activity Inventory (CAHAI-7) (Barreca et al., Arch Phys Med Rehabil 6:1616–1622, 2005) for measuring functional motor gains in the performance of Activities of Daily Living (ADLs), the Barthel Index (BI) for the evaluation of the patient’s perceived independence (Collin et al., Int Disabil Stud 10:61–63, 1988), and the Hamilton scale (Knesevich et al., Br J Psychiatr J Mental Sci 131:49–52, 1977) for the identification of improvements in mood disorders that could be induced by the reinforcement-based intervention. In order to study and predict the effects of this intervention we implemented a computational model of recovery after stroke. Results: While both groups showed significant motor gains at 6-weeks post-treatment, only the experimental group continued to exhibit further gains in UE-FM at 12-weeks follow-up (p<.05). This improvement was accompanied by a significant increase in arm-use during training in the experimental group. Conclusions: Implicitly reinforcing arm-use by augmenting visuomotor feedback as proposed by RIMT seems beneficial for inducing significant improvement in chronic stroke patients. By challenging the patients’ self-limiting believe system and perceived low self-efficacy this approach might counteract learned non-use., This project was supported through ERC project cDAC (FP7-IDEAS-ERC 341196), EC H2020 project socSMCs (H2020-EU.1.2.2. 641321) and MINECO project SANAR (Gobierno de España).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

A wearable bracelet device for promoting arm use in stroke patients

  • Rubio Ballester, Belén
  • Lathe, Alica
  • Duarte Oller, Esther
  • Duff, Armin
  • Verschure, Paul F. M. J.
Comunicació presentada a: 3rd International Congress on Neurotechnology, Electronics and Informatics (NEUROTECHNIX), celebrada a Lisboa (Portugal) del 16 al 17 de novembre de 2015., After stroke, many patients experience hemiparesis or weakness on one side of the body. In order to compensate for this lack of motor function, they tend to overuse their non-affected limb. This so called learned non-use may be one of the most relevant contributors to functional loss after post-stroke hospital discharge. We hypothesize that frequent exposure to movement related feedback through a wearable bracelet device may 1) increase the patient’s intrinsic motivation for using the paretic limb, and 2) counteract learned non-use, therefore inducing motor recovery. First, to validate the accelerometers-based measurement of arm use, we recruited 10 right-handed volunteers without neurological impairments. Second, we explored the acceptability and clinical impact of a low-cost wearable system on 4 chronic stroke patients with hemiparesis. Our results suggest that frequent exposure to direct feedback about arm use promotes the integration of the paretic limb in the performanc e of instrumental activities of daily living (iADLs). In addition, results from questionnaires revealed that the use of wearable devices may influence positively the patient’s intrinsic motivation for using the affected arm. To the best of our knowledge, this is the first study suggesting the benefits of wearable-based feedback as an intervention tool for counteracting learned non-use., We would like to acknowledge all patients who participated in this study. Special thanks to Dr. Boza Gomez for her assistance in recruiting stroke patients. This project was supported through ERC project cDAC (FP7-IDEAS-ERC 341196), EC H2020 project socSMCs (H2020-EU.1.2.2. 641321) and MINECO project SANAR (Gobierno de Espaa).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Editorial: sensorimotor foundations of social cognition

  • Engel, Andreas Karl
  • Verschure, Paul F. M. J.
  • Kragic, Danica
  • Polani, Daniel
  • Effenberg, Alfred O.
  • König, Peter
In classical representation-oriented approaches of social cognition, agents are thought to interact with conspecifics based on their capacity to develop a “theory-of-mind”, i.e., to generate complex models of the intentions, beliefs, and personalities of their interaction partners. In this framework, the primary mode of interaction with the social environment is that of a detached observer who theorizes and produces inferences about other participants. In contrast, this Research Topic seeks to turn the spotlight on the grounding of social cognition in dynamic sensorimotor and informational coupling of agents, in human-human as well as human-robot interaction settings. According to this view, interaction dynamics hold substantial clues to the mechanism of social understanding and its disturbances (as for example observed in autism spectrum disorders). The argument is that high-level social deficits may be rooted in the impaired capacity for entraining and sustaining sensorimotor and informational coupling. Beyond novel insights into the mechanisms of functional and dysfunctional social behavior, the investigation of basic sensorimotor interaction patterns may help the development of socially competent robot technology. Tapping into the same logic, robotic agents sensitive to interpersonal sensorimotor contingencies should have an advantage over technology that does not consider this key aspect of human interaction. This Research Topic provides an interdisciplinary overview of trends and recent developments in conceptual, methodological and basic research, as well as applications of sensorimotor approaches in social cognitive science, neuroscience, and robotic research. One of the key questions is how concepts and methods from social cognitive and neuroscience transfer to human-robot interaction., The authors acknowledge support by the EU through project socSMCs (H2020-641321).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Adaptive conjunctive cognitive training (ACCT) in virtual reality for chronic stroke patients: a randomized controlled pilot trial

  • Maier, Martina
  • Rubio Ballester, Belén
  • Leiva Bañuelos, Núria
  • Duarte Oller, Esther
  • Verschure, Paul F. M. J.
Background: Current evidence for the effectiveness of post-stroke cognitive rehabilitation is weak, possibly due to two reasons. First, patients typically express cognitive deficits in several domains. Therapies focusing on specific cognitive deficits might not address their interrelated neurological nature. Second, co-occurring psychological problems are often neglected or not diagnosed, although post-stroke depression is common and related to cognitive deficits. This pilot trial aims to test a rehabilitation program in virtual reality that trains various cognitive domains in conjunction, by adapting to the patient's disability and while investigating the influence of comorbidities. Methods: Thirty community-dwelling stroke patients at the chronic stage and suffering from cognitive impairment performed 30 min of daily training for 6 weeks. The experimental group followed, so called, adaptive conjunctive cognitive training (ACCT) using RGS, whereas the control group solved standard cognitive tasks at home for an equivalent amount of time. A comprehensive test battery covering executive function, spatial awareness, attention, and memory as well as independence, depression, and motor impairment was applied at baseline, at 6 weeks and 18-weeks follow-up. Results: At baseline, 75% of our sample had an impairment in more than one cognitive domain. The experimental group showed improvements in attention ([Formula: see text] (2) = 9.57, p < .01), spatial awareness ([Formula: see text] (2) = 11.23, p < .01) and generalized cognitive functioning ([Formula: see text] (2) = 15.5, p < .001). No significant change was seen in the executive function and memory domain. For the control group, no significant change over time was found. Further, they worsened in their depression level after treatment (T = 45, r = .72, p < .01) but returned to baseline at follow-up. The experimental group displayed a lower level of depression than the control group after treatment (Ws = 81.5, z = - 2.76, r = - .60, p < .01) and (Ws = 92, z = - 2.03, r = - .44, p < .05). Conclusions: ACCT positively influences attention and spatial awareness, as well as depressive mood in chronic stroke patients., This study was supported by EIT Health ID 19277 (RGS@HOME) under H2020, SANAR (MINECO, TIN2013–44200), cDAC (ERC-2013-ADG-341196), and socSMCs (641321H2020-FETPROACT-2014).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Size matters: How scaling affects the interaction between grid and border cells

  • Santos-Pata, Diogo
  • Zucca, Riccardo
  • Low, Sock Ching
  • Verschure, Paul F. M. J.
Many hippocampal cell types are characterized by a progressive increase in scale along the dorsal-to-ventral axis, such as in the cases of head-direction, grid and place cells. Also located in the medial entorhinal cortex (MEC), border cells would be expected to benefit from such scale modulations. However, this phenomenon has not been experimentally observed. Grid cells in the MEC of mammals integrate velocity related signals to map the environment with characteristic hexagonal tessellation patterns. Due to the noisy nature of these input signals, path integration processes tend to accumulate errors as animals explore the environment, leading to a loss of grid-like activity. It has been suggested that border-to-grid cells' associations minimize the accumulated grid cells' error when rodents explore enclosures. Thus, the border-grid interaction for error minimization is a suitable scenario to study the effects of border cell scaling within the context of spatial representation. In this study, we computationally address the question of (i) border cells' scale from the perspective of their role in maintaining the regularity of grid cells' firing fields, as well as (ii) what are the underlying mechanisms of grid-border associations relative to the scales of both grid and border cells. Our results suggest that for optimal contribution to grid cells' error minimization, border cells should express smaller firing fields relative to those of the associated grid cells, which is consistent with the hypothesis of border cells functioning as spatial anchoring signals., The research leading to these results has received funding from the European Research Council under the European Union's Seventh Framework Programme (FP7/2007–2013)/ERC grant agreement no (341196) cDAC. H2020-SocSMC (socSMC-641321H2020-FETPROACT- 2014).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Effect of specific over nonspecific VR-based rehabilitation on poststroke motor recovery: a systematic meta-analysis

  • Maier, Martina
  • Rubio Ballester, Belén
  • Duff, Armin
  • Duarte Oller, Esther
  • Verschure, Paul F. M. J.
BACKGROUND: Despite the rise of virtual reality (VR)-based interventions in stroke rehabilitation over the past decade, no consensus has been reached on its efficacy. This ostensibly puzzling outcome might not be that surprising given that VR is intrinsically neutral to its use-that is, an intervention is effective because of its ability to mobilize recovery mechanisms, not its technology. As VR systems specifically built for rehabilitation might capitalize better on the advantages of technology to implement neuroscientifically grounded protocols, they might be more effective than those designed for recreational gaming. OBJECTIVE: We evaluate the efficacy of specific VR (SVR) and nonspecific VR (NSVR) systems for rehabilitating upper-limb function and activity after stroke. METHODS: We conducted a systematic search for randomized controlled trials with adult stroke patients to analyze the effect of SVR or NSVR systems versus conventional therapy (CT). RESULTS: We identified 30 studies including 1473 patients. SVR showed a significant impact on body function (standardized mean difference [SMD] = 0.23; 95% CI = 0.10 to 0.36; P = .0007) versus CT, whereas NSVR did not (SMD = 0.16; 95% CI = -0.14 to 0.47; P = .30). This result was replicated in activity measures. CONCLUSIONS: Our results suggest that SVR systems are more beneficial than CT for upper-limb recovery, whereas NSVR systems are not. Additionally, we identified 6 principles of neurorehabilitation that are shared across SVR systems and are possibly responsible for their positive effect. These findings may disambiguate the contradictory results found in the current literature., The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This study was supported by SANAR (MINECO, TIN2013- 44200), cDAC (ERC 2013 ADG 341196), and socSMCs (Grant Number EC, H2020-641321).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Effect of specific over nonspecific VR-based rehabilitation on poststroke motor recovery: A systematic meta-analysis

  • Maier, Martina
  • Rubio Ballester, Belén
  • Duff, Armin
  • Duarte Oller, Esther
  • Verschure, Paul
Background. Despite the rise of virtual reality (VR)-based interventions in stroke rehabilitation over the past decade, no consensus has been reached on its efficacy. This ostensibly puzzling outcome might not be that surprising given that VR is intrinsically neutral to its use—that is, an intervention is effective because of its ability to mobilize recovery mechanisms, not its technology. As VR systems specifically built for rehabilitation might capitalize better on the advantages of technology to implement neuroscientifically grounded protocols, they might be more effective than those designed for recreational gaming. Objective. We evaluate the efficacy of specific VR (SVR) and nonspecific VR (NSVR) systems for rehabilitating upper-limb function and activity after stroke. Methods. We conducted a systematic search for randomized controlled trials with adult stroke patients to analyze the effect of SVR or NSVR systems versus conventional therapy (CT). Results. We identified 30 studies including 1473 patients. SVR showed a significant impact on body function (standardized mean difference [SMD] = 0.23; 95% CI = 0.10 to 0.36; P = .0007) versus CT, whereas NSVR did not (SMD = 0.16; 95% CI = −0.14 to 0.47; P = .30). This result was replicated in activity measures. Conclusions. Our results suggest that SVR systems are more beneficial than CT for upper-limb recovery, whereas NSVR systems are not. Additionally, we identified 6 principles of neurorehabilitation that are shared across SVR systems and are possibly responsible for their positive effect. These findings may disambiguate the contradictory results found in the current literature.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Erratum to: the visual amplification of goal-oriented movements counteracts acquired non-use in hemiparetic stroke patients

  • Rubio Ballester, Belén
  • Nirme, Jens
  • Duarte Oller, Esther
  • Cuxart, Ampar
  • Rodriguez, Susana
  • Verschure, Paul F. M. J.
  • Duff, Armin
BACKGROUND: Stroke-induced impairments result from both primary and secondary causes, i.e. damage to the brain and the acquired non-use of the impaired limbs. Indeed, stroke patients often under-utilize their paretic limb despite sufficient residual motor function. We hypothesize that acquired non-use can be overcome by reinforcement-based training strategies. METHODS: Hemiparetic stroke patients (n = 20, 11 males, 9 right-sided hemiparesis) were asked to reach targets appearing in either the real world or in a virtual environment. Sessions were divided into 3 phases: baseline, intervention and washout. During the intervention the movement of the virtual representation of the patients' paretic limb was amplified towards the target. RESULTS: We found that the probability of using the paretic limb during washout was significantly higher in comparison to baseline. Patients showed generalization of these results by displaying a more substantial workspace in real world task. These gains correlated with changes in effector selection patterns. CONCLUSIONS: The amplification of the movement of the paretic limb in a virtual environment promotes the use of the paretic limb in stroke patients. Our findings indicate that reinforcement-based therapies may be an effective approach for counteracting learned non-use and may modulate motor performance in the real world., This project was supported through ERC project cDAC (FP7-IDEAS-ERC 341196), EC H2020 project socSMCs (H2020-EU.1.2.2. 641321) and MINECO project SANAR (Gobierno de España).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

A critical time window for recovery extends beyond one-year post-stroke

  • Rubio Ballester, Belén
  • Maier Martina
  • Duff, Armin
  • Cameirão, Mónica
  • Bermúdez i Badia, Sergi
  • Duarte Oller, Esther
  • Cuxart, Ampar
  • Rodriguez, Susana
  • San Segundo Mozo, Rosa María
  • Verschure, Paul F. M. J.
The impact of rehabilitation on post-stroke motor recovery and its dependency on the patient's chronicity remain unclear. The field has widely accepted the notion of a proportional recovery rule with a "critical window for recovery" within the first 3-6 mo poststroke. This hypothesis justifies the general cessation of physical therapy at chronic stages. However, the limits of this critical window have, so far, been poorly defined. In this analysis, we address this question, and we further explore the temporal structure of motor recovery using individual patient data from a homogeneous sample of 219 individuals with mild to moderate upper-limb hemiparesis. We observed that improvement in body function and structure was possible even at late chronic stages. A bootstrapping analysis revealed a gradient of enhanced sensitivity to treatment that extended beyond 12 mo poststroke. Clinical guidelines for rehabilitation should be revised in the context of this temporal structure. NEW & NOTEWORTHY Previous studies in humans suggest that there is a 3- to 6-mo "critical window" of heightened neuroplasticity poststroke. We analyze the temporal structure of recovery in patients with hemiparesis and uncover a precise gradient of enhanced sensitivity to treatment that expands far beyond the limits of the so-called critical window. These findings highlight the need for providing therapy to patients at the chronic and late chronic stages.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Modeling the formation of social conventions from embodied real-time interactions

  • Freire, Ismael T.
  • Moulin-Frier, Clément
  • Sánchez Fibla, Martí
  • Arsiwalla, Xerxes D.
  • Verschure, Paul F. M. J.
What is the role of real-time control and learning in the formation of social conventions? To answer this question, we propose a computational model that matches human behavioral data in a social decision-making game that was analyzed both in discrete-time and continuous-time setups. Furthermore, unlike previous approaches, our model takes into account the role of sensorimotor control loops in embodied decision-making scenarios. For this purpose, we introduce the Control-based Reinforcement Learning (CRL) model. CRL is grounded in the Distributed Adaptive Control (DAC) theory of mind and brain, where low-level sensorimotor control is modulated through perceptual and behavioral learning in a layered structure. CRL follows these principles by implementing a feedback control loop handling the agent’s reactive behaviors (pre-wired reflexes), along with an Adaptive Layer that uses reinforcement learning to maximize long-term reward. We test our model in a multi-agent game-theoretic task in which coordination must be achieved to find an optimal solution. We show that CRL is able to reach human-level performance on standard game-theoretic metrics such as efficiency in acquiring rewards and fairness in reward distribution., PFMJV. This project has received funding from the European Union’s Horizon 2020 research and innovation programme, ID:820742 and ID:641321. MSF and CMF. This project has been supported by INSOCO-DPI2016-80116-P. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Consensus paper: towards a systems-level view of cerebellar function: the interplay between cerebellum, basal ganglia, and cortex

  • Caligiore, Daniele
  • Pezzulo, Giovanni
  • Baldassarre, Gianluca
  • Bostan, Andreea C.
  • Strick, Peter L.
  • Doya, Kenji
  • Helmich, Rick C.
  • Dirkx, Michiel
  • Houk, James
  • Jörntell, Henrik
  • Lago-Rodriguez, Angel
  • Galea, Joseph M.
  • Miall, R. Chris
  • Popa, Traian
  • Kishore, Asha
  • Verschure, Paul F. M. J.
  • Zucca, Riccardo
  • Herreros, Ivan
Despite increasing evidence suggesting the cerebellum works in concert with the cortex and basal ganglia, the nature of the reciprocal interactions between these three brain regions remains unclear. This consensus paper gathers diverse recent views on a variety of important roles played by the cerebellum within the cerebello-basal ganglia-thalamo-cortical system across a range of motor and cognitive functions. The paper includes theoretical and empirical contributions, which cover the following topics: recent evidence supporting the dynamical interplay between cerebellum, basal ganglia, and cortical areas in humans and other animals; theoretical neuroscience perspectives and empirical evidence on the reciprocal influences between cerebellum, basal ganglia, and cortex in learning and control processes; and data suggesting possible roles of the cerebellum in basal ganglia movement disorders. Although starting from different backgrounds and dealing with different topics, all the contributors agree that viewing the cerebellum, basal ganglia, and cortex as an integrated system enables us to understand the function of these areas in radically different ways. In addition, there is unanimous consensus between the authors that future experimental and computational work is needed to understand the function of cerebellar-basal ganglia circuitry in both motor and non-motor functions. The paper reports the most advanced perspectives on the role of the cerebellum within the cerebello-basal ganglia-thalamo-cortical system and illustrates other elements of consensus as well as disagreements and open questions in the field., The present research was supported by the European Commission 7th Framework Programme (FP7/2007-2013), “Challenge 2—Cognitive Systems, Interaction, Robotics,” grant agreement No. ICT IP-231722, project “IM-CLeVeR—Intrinsically Motivated Cumulative Learning Versatile Robots” to D. Caligiore; by the Human Frontier Science Program (HFSP), award number RGY0088/2014 to G. Pezzulo; in parts by funds from the Office of Research and Development, Medical Research Service, Department of Veterans Affairs and National Institutes of Health Grants R01 NS24328, R01 MH56661, P40 OD010996, and P30 NS076405 to P. L. Strick; by the European Research Council project MotMotLearn (637488) to J. Galea; by the MRC (grant R/J012610/1) to R.C. Miall and Wellcome Trust, grant WT087554 to R.C. Miall and A. Lago-Rodriguez; by the European Research Council under the European Union’s Seventh Framework Programme (FP7/2007-2013)/ERC grant agreement no. 341196 to P. F. M. J. Verschure; and by the European Commission’s Horizon 2020 socSMC (under agreement number socSMC-641321H2020-FETPROACT-2014) to I. Herreros. We thank the two anonymous reviewers and Professor Michael A. Arbib who have contributed to enhance the quality of this consensus paper with precious comments.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Modeling the formation of social conventions from embodied real-time interactions

  • Freire, Ismael T.
  • Moulin Frier, Clement
  • Sanchez Fibla, Marti
  • Arsiwalla, Xerxes D.
  • Verschure, Paul F. M. J.
What is the role of real-time control and learning in the formation of social conventions? To answer this question, we propose a computational model that matches human behavioral data in a social decision-making game that was analyzed both in discrete-time and continuous-time setups. Furthermore, unlike previous approaches, our model takes into account the role of sensorimotor control loops in embodied decision-making scenarios. For this purpose, we introduce the Control-based Reinforcement Learning (CRL) model. CRL is grounded in the Distributed Adaptive Control (DAC) theory of mind and brain, where low-level sensorimotor control is modulated through perceptual and behavioral learning in a layered structure. CRL follows these principles by implementing a feedback control loop handling the agent's reactive behaviors (pre-wired reflexes), along with an Adaptive Layer that uses reinforcement learning to maximize long-term reward. We test our model in a multi-agent game-theoretic task in which coordination must be achieved to find an optimal solution. We show that CRL is able to reach human-level performance on standard game-theoretic metrics such as efficiency in acquiring rewards and fairness in reward distribution.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Contribución de congreso (ConferenceOutput)

Autonomous development of turn-taking behaviors in agent populations: a computational study

  • Moulin-Frier, Clément
  • Sánchez Fibla, Martí
  • Verschure, Paul F. M. J.
Comunicació presentada a 5th IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL-EpiRob); 2015 Aug 13-16; Providence, USA., We provide an original computational model showing how turn-taking behaviors can self-organize out of sensorimotor/ninteractions between vocalizing agents. These agents are equipped with a cognitive architecture based on two coupled/ncontrol loops: a reactive one implementing a basic regulatory behavior to maintain vocal listening and an adaptive one learning an action policy to maximize an overall group presence estimation. We show that the reactive process allows to bootstrap the adaptive learning to converge toward a collective turn-taking strategy. This model provides a computational support to the hypothesis that turn-taking can emerge from functional constraints related to group cohesion and vocal signal interferences and suggests future directions of research to understand how social behaviors/ncan result from sensorimotor interactions., This work is supported by the Socialising Sensori-Motor Contingencies project socSMC-641321H2020-FETPROACT-2014.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Estimating upper-extremity function from kinematics in stroke patients following goal-oriented computer-based training

  • Rubio Ballester, Belén
  • Antenucci, Fabrizio
  • Maier, Martina
  • Coolen, Anthony C. C.
  • Verschure, Paul F. M. J.
Introduction: After a stroke, a wide range of deficits can occur with varying onset latencies. As a result, assessing impairment and recovery are enormous challenges in neurorehabilitation. Although several clinical scales are generally accepted, they are time-consuming, show high inter-rater variability, have low ecological validity, and are vulnerable to biases introduced by compensatory movements and action modifications. Alternative methods need to be developed for efficient and objective assessment. In this study, we explore the potential of computer-based body tracking systems and classification tools to estimate the motor impairment of the more affected arm in stroke patients. Methods: We present a method for estimating clinical scores from movement parameters that are extracted from kinematic data recorded during unsupervised computer-based rehabilitation sessions. We identify a number of kinematic descriptors that characterise the patients’ hemiparesis (e.g., movement smoothness, work area), we implement a double-noise model and perform a multivariate regression using clinical data from 98 stroke patients who completed a total of 191 sessions with RGS. Results: Our results reveal a new digital biomarker of arm function, the Total Goal-Directed Movement (TGDM), which relates to the patients work area during the execution of goal-oriented reaching movements. The model’s performance to estimate FM-UE scores reaches an accuracy of R2: 0.38 with an error (σ: 12.8). Next, we evaluate its reliability (r = 0.89 for test-retest), longitudinal external validity (95% true positive rate), sensitivity, and generalisation to other tasks that involve planar reaching movements (R2: 0.39). The model achieves comparable accuracy also for the Chedoke Arm and Hand Activity Inventory (R2: 0.40) and Barthel Index (R2: 0.35). Conclusions: Our results highlight the clinical value of kinematic data collected during unsupervised goal-oriented motor training with the RGS combined with data science techniques, and provide new insight into factors underlying recovery and its biomarkers., This study was supported by the European Commission (EC), the European Research Council under Grant agreement 341196 (cDAC), EC H2020 project socSMCs (H2020EU.1.2.2. 641321), and by the RGS@home, EIT Health project 19277. EIT Health is supported by EIT, a body of the European Union.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Collaboration variability in autism spectrum disorder

  • Blancas Muñoz, Maria
  • Maffei, Giovanni
  • Sánchez Fibla, Martí
  • Vouloutsi, Vasiliki
  • Verschure, Paul F. M. J.
This paper addresses how impairments in prediction in young adults with autism spectrum disorder (ASD) relate to their behavior during collaboration. To assess it, we developed a task where participants play in collaboration with a synthetic agent to maximize their score. The agent’s behavior changes during the different phases of the game, requiring participants to model the agent’s sensorimotor contingencies to play collaboratively. Our results (n = 30, 15 per group) show differences between autistic and neurotypical individuals in their behavioral adaptation to the other partner. Contrarily, there are no differences in the self-reports of that collaboration., This work received funding from the European Research Council under the European Union’s Seventh Framework Programme socSMCs (Grant No. EC, H2020-641321). MS-F was supported by Spanish National Grant INSOCO-DPI2016-80116-P.