Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 58
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Challenging the boundaries of the physical self: distal cues impact body ownership

  • Grechuta, Klaudia
  • Torre Costa, Javier de la
  • Rubio Ballester, Belén
  • Verschure, Paul F. M. J.
The unique ability to identify one’s own body and experience it as one’s own is fundamental in goal-oriented behavior and survival. However, the mechanisms underlying the so-called body ownership are yet not fully understood. Evidence based on Rubber Hand Illusion (RHI) paradigms has demonstrated that body ownership is a product of reception and integration of self and externally generated multisensory information, feedforward and feedback processing of sensorimotor signals, and prior knowledge about the body. Crucially, however, these designs commonly involve the processing of proximal modalities while the contribution of distal sensory signals to the experience of ownership remains elusive. Here we propose that, like any robust percept, body ownership depends on the integration and prediction across all sensory modalities, including distal sensory signals pertaining to the environment. To test our hypothesis, we created an embodied goal-oriented Virtual Air Hockey Task, in which participants were to hit a virtual puck into a goal. In two conditions, we manipulated the congruency of distal multisensory cues (auditory and visual) while preserving proximal and action-driven signals entirely predictable. Compared to a fully congruent condition, our results revealed a significant decrease on three dimensions of ownership evaluation when distal signals were incongruent, including the subjective report as well as physiological and kinematic responses to an unexpected threat. Together, these findings support the notion that the way we represent our body is contingent upon all the sensory stimuli, including distal and action-independent signals. The present data extend the current framework of body ownership and may also find applications in rehabilitation scenarios., This study was supported by ReHyb ID 871767 and EIT Health ID 19277 (RGS@HOME) under H2020, cDAC (ERC-2013-ADG-341196), FPI Grant No. BES2014068791.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Connectomics to semantomics: addressing the brain's big data challenge

  • Arsiwalla, Xerxes D.
  • Dalmazzo, David
  • Zucca, Riccardo
  • Betella, Alberto
  • Brandi Hernández, Santiago
  • Martínez Bueno, Enrique
  • Omedas, Pedro
  • Verschure, Paul F. M. J.
Can semantic corpora be coupled to dynamical simulations in such a way so as to extract new associations from the data that were hitherto unapparent? We attempt to do this within neuroscience as an application domain, by introducing the notion of the semantome and coupling it to the connectome of the human brain network. This is implemented using BrainX3, a virtual reality simulation cum data mining platform that can be used for visualization, analysis and feature extraction of neuroscience data. We use this system to explore anatomical, functional and symptomatic semantics associated to simulated neuronal activity of a healthy brain, one with stroke and one perturbed by transcranial magnetic stimulation. In particular, we find that parietal and occipital lesions in stroke affect the visual processing pathway leading to symptoms such as visual neglect, depression and photo-sensitivity seizures. Integrating semantomics with connectomics thus generates hypotheses about symptoms, functions and brain activity that supplement existing tools for diagnosis of mental illness. Our results suggest a new approach to big data with potential applications to other domains., We thank Olaf Sporns and Chris Honey for sharing the DSI data. Research supported by CEEDS (FP7-ICT-2009-5) & CDAC (ERC-2013-ADG 341196) projects.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Motor cost influences perceptual decisions

  • Marcos Sanmartín, Encarni
  • Cos Aguilera, Ignasi
  • Girard, Benoît
  • Verschure, Paul F. M. J.
Perceptual decision making has been widely studied using tasks in which subjects are asked to discriminate a visual stimulus and instructed to report their decision with a movement. In these studies, performance is measured by assessing the accuracy of the participants’ choices as a function of the ambiguity of the visual stimulus. Typically, the reporting movement is considered as a mere means of reporting the decision with no influence on the decision-making process. However, recent studies have shown that even subtle differences of biomechanical costs between movements may influence how we select between them. Here we investigated whether this purely motor cost could also influence decisions in a perceptual discrimination task in detriment of accuracy. In other words, are perceptual decisions only dependent on the visual stimulus and entirely orthogonal to motor costs? Here we show the results of a psychophysical experiment in which human subjects were presented with a random dot motion discrimination task and asked to report the perceived motion direction using movements of different biomechanical cost. We found that the pattern of decisions exhibited a significant bias towards the movement of lower cost, even when this bias reduced performance accuracy. This strongly suggests that motor costs influence decision making in visual discrimination tasks for which its contribution is neither instructed nor beneficial., This work was supported by the EU FP7 framework under grant agreements no FP7-ICT-270108 - Goal-Leaders, FP7-ICT-270212 - eSMC and ERC-341196 - CDAC (PV) and Ville de Paris HABOT-Project grant (IC & BG).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Visuotactile integration modulates motor performance in a perceptual decision-making task

  • Grechuta, Klaudia
  • Guga, Jelena
  • Maffei, Giovanni
  • Rubio Ballester, Belén
  • Verschure, Paul F. M. J.
Body ownership is critically dependent on multimodal integration as for instance revealed in the Rubber Hand Illusion (RHI) and a number of studies which have addressed the neural correlates of the processes underlying this phenomenon. Both experimental and clinical research have shown that the structures underlying body ownership seem to significantly overlap with those of motor control including the parietal and ventral premotor cortices, Temporal Parietal Junction (TPJ) and the insula. This raises the question of whether this structural overlap between body ownership and motor control structures is of any functional significance. Here, we investigate the specific question of whether experimentally induced ownership over a virtual limb can modulate the performance of that limb in a simple sensorimotor task. Using a Virtual reality (VR) environment we modulate body ownership in three experimental conditions with respect to the (in)congruence of stimulus configurations. Our results show that the degree of ownership directly modulates motor performance. This implies that body ownership is not exclusively a perceptual and/or subjective multimodal state but that it is tightly coupled to systems for decision-making and motor control., This research has been supported by the MINECO “Retos Investigacion tos Investigacion I + d + i”, Plan Nacional project, SANAR (Gobierno de Espan∽a) - under agreement TIN2013-44200-REC and also FPI grant nr. BES-2014-068791, European Research Council under grant agreement 341196 (CDAC), and “Excellence in Human Resources as a Source of Competitiveness” project (CZ.1.07/2.3.00/30.0013), OP Education for Competitiveness, funded by the European Social Fund in the Czech Republic and by the State Budget of the Czech Republic.
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

A wearable bracelet device for promoting arm use in stroke patients

  • Rubio Ballester, Belén
  • Lathe, Alica
  • Duarte Oller, Esther
  • Duff, Armin
  • Verschure, Paul F. M. J.
Comunicació presentada a: 3rd International Congress on Neurotechnology, Electronics and Informatics (NEUROTECHNIX), celebrada a Lisboa (Portugal) del 16 al 17 de novembre de 2015., After stroke, many patients experience hemiparesis or weakness on one side of the body. In order to compensate for this lack of motor function, they tend to overuse their non-affected limb. This so called learned non-use may be one of the most relevant contributors to functional loss after post-stroke hospital discharge. We hypothesize that frequent exposure to movement related feedback through a wearable bracelet device may 1) increase the patient’s intrinsic motivation for using the paretic limb, and 2) counteract learned non-use, therefore inducing motor recovery. First, to validate the accelerometers-based measurement of arm use, we recruited 10 right-handed volunteers without neurological impairments. Second, we explored the acceptability and clinical impact of a low-cost wearable system on 4 chronic stroke patients with hemiparesis. Our results suggest that frequent exposure to direct feedback about arm use promotes the integration of the paretic limb in the performanc e of instrumental activities of daily living (iADLs). In addition, results from questionnaires revealed that the use of wearable devices may influence positively the patient’s intrinsic motivation for using the affected arm. To the best of our knowledge, this is the first study suggesting the benefits of wearable-based feedback as an intervention tool for counteracting learned non-use., We would like to acknowledge all patients who participated in this study. Special thanks to Dr. Boza Gomez for her assistance in recruiting stroke patients. This project was supported through ERC project cDAC (FP7-IDEAS-ERC 341196), EC H2020 project socSMCs (H2020-EU.1.2.2. 641321) and MINECO project SANAR (Gobierno de Espaa).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Visual anticipation biases conscious decision making but not bottom-up visual processing

  • Mathews, Zenon
  • Cetnarski, Ryszard
  • Verschure, Paul F. M. J.
Prediction plays a key role in control of attention but it is not clear which aspects of prediction are most prominent in conscious experience. An evolving view on the brain is that it can be seen as a prediction machine that optimizes its ability to predict states of the world and the self through the top-down propagation of predictions and the bottom-up presentation of prediction errors. There are competing views though on whether prediction or prediction errors dominate the formation of conscious experience. Yet, the dynamic effects of prediction on perception, decision making and consciousness have been difficult to assess and to model. We propose a novel mathematical framework and a psychophysical paradigm that allows us to assess both the hierarchical structuring of perceptual consciousness, its content and the impact of predictions and/or errors on conscious experience, attention and decision-making. Using a displacement detection task combined with reverse correlation, we reveal signatures of the usage of prediction at three different levels of perceptual processing: bottom-up fast saccades, top-down driven slow saccades and consciousnes decisions. Our results suggest that the brain employs multiple parallel mechanism at different levels of perceptual processing in order to shape effective sensory consciousness within a predicted perceptual scene. We further observe that bottom-up sensory and top-down predictive processes can be dissociated through cognitive load. We propose a probabilistic data association model from dynamical systems theory to model the predictive multi-scale bias in perceptual processing that we observe and its role in the formation of conscious experience. We propose that these results support the hypothesis that consciousness provides a time-delayed description of a task that is used to prospectively optimize real time control structures, rather than being engaged in the real-time control of behavior itself, This work was carried out as part of the CEEDS project; an EU funded Integrated Project under the Seventh Framework Programme (ICT-258749) and ERC grant cDAC (ERC-341196).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Size matters: How scaling affects the interaction between grid and border cells

  • Santos-Pata, Diogo
  • Zucca, Riccardo
  • Low, Sock Ching
  • Verschure, Paul F. M. J.
Many hippocampal cell types are characterized by a progressive increase in scale along the dorsal-to-ventral axis, such as in the cases of head-direction, grid and place cells. Also located in the medial entorhinal cortex (MEC), border cells would be expected to benefit from such scale modulations. However, this phenomenon has not been experimentally observed. Grid cells in the MEC of mammals integrate velocity related signals to map the environment with characteristic hexagonal tessellation patterns. Due to the noisy nature of these input signals, path integration processes tend to accumulate errors as animals explore the environment, leading to a loss of grid-like activity. It has been suggested that border-to-grid cells' associations minimize the accumulated grid cells' error when rodents explore enclosures. Thus, the border-grid interaction for error minimization is a suitable scenario to study the effects of border cell scaling within the context of spatial representation. In this study, we computationally address the question of (i) border cells' scale from the perspective of their role in maintaining the regularity of grid cells' firing fields, as well as (ii) what are the underlying mechanisms of grid-border associations relative to the scales of both grid and border cells. Our results suggest that for optimal contribution to grid cells' error minimization, border cells should express smaller firing fields relative to those of the associated grid cells, which is consistent with the hypothesis of border cells functioning as spatial anchoring signals., The research leading to these results has received funding from the European Research Council under the European Union's Seventh Framework Programme (FP7/2007–2013)/ERC grant agreement no (341196) cDAC. H2020-SocSMC (socSMC-641321H2020-FETPROACT- 2014).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

The why, what, where, when and how of goal-directed choice: neuronal and computational principles

  • Verschure, Paul F. M. J.
  • Pennartz, Cyriel
  • Pezzulo, Giovanni
The central problems that goal-directed animals must solve are: ‘What do I need and Why, Where and When can this be obtained, and How do I get it?' or the H4W problem. Here, we elucidate the principles underlying the neuronal solutions to H4W using a combination of neurobiological and neurorobotic approaches. First, we analyse H4W from a system-level perspective by mapping its objectives onto the Distributed Adaptive Control embodied cognitive architecture which sees the generation of adaptive action in the real world as the primary task of the brain rather than optimally solving abstract problems. We next map this functional decomposition to the architecture of the rodent brain to test its consistency. Following this approach, we propose that the mammalian brain solves the H4W problem on the basis of multiple kinds of outcome predictions, integrating central representations of needs and drives (e.g. hypothalamus), valence (e.g. amygdala), world, self and task state spaces (e.g. neocortex, hippocampus and prefrontal cortex, respectively) combined with multi-modal selection (e.g. basal ganglia). In our analysis, goal-directed behaviour results from a well-structured architecture in which goals are bootstrapped on the basis of predefined needs, valence and multiple learning, memory and planning mechanisms rather than being generated by a singular computation., Research funded by the EU FP7 framework under grant agreements no. FP7-ICT-270108 (Goal-Leaders), FP7-ICT-270490 (EFAA), FP7-ICT-612139 (WYSIWYD), ERC-341196 (CDAC) and FP7-ICT-601167 (CSN II).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Motor adaptation impairment in chronic cannabis users assessed by a visuomotor rotation task

  • Herreros Alonso, Ivan
  • Miquel, Laia
  • Blithikioti, Chrysanthi
  • Nuño, Laura
  • Rubio Ballester, Belén
  • Grechuta, Klaudia
  • Gual, Antoni
  • Balcells-Oliveró, Mercè
  • Verschure, Paul F. M. J.
Background—The cerebellum has been recently suggested as an important player in the addiction brain circuit. Cannabis is one of the most used drugs worldwide, and its long-term effects on the central nervous system are not fully understood. No valid clinical evaluations of cannabis impact on the brain are available today. The cerebellum is expected to be one of the brain structures that are highly affected by prolonged exposure to cannabis, due to its high density in endocannabinoid receptors. We aim to use a motor adaptation paradigm to indirectly assess cerebellar function in chronic cannabis users (CCUs). Methods—We used a visuomotor rotation (VMR) task that probes a putatively-cerebellar implicit motor adaptation process together with the learning and execution of an explicit aiming rule. We conducted a case-control study, recruiting 18 CCUs and 18 age-matched healthy controls. Our main measure was the angular aiming error. Results—Our results show that CCUs have impaired implicit motor adaptation, as they showed a smaller rate of adaptation compared with healthy controls (drift rate: 19.3 +/− 6.8° vs. 27.4 +/− 11.6°; t(26) = −2.1, p = 0.048, Cohen’s d = −0.8, 95% CI = (−1.7, −0.15)). Conclusions—We suggest that a visuomotor rotation task might be the first step towards developing a useful tool for the detection of alterations in implicit learning among cannabis users., This work was supported by MINECO “Retos Investigacion I+d+i”, Plan Nacional project, SANAR (Gobierno de España)—under agreement TIN2013-44200-REC, FPI grant nr. BES-2014-068791, and by the European Research Council under grant agreement 341196 (CDAC).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

The morphospace of consciousness: three kinds of complexity for minds and machines

  • Arsiwalla, Xerxes D.
  • Solé Vicente, Ricard, 1962-
  • Moulin-Frier, Clément
  • Herreros, Ivan
  • Sánchez-Fibla, Martí
  • Verschure, Paul F. M. J.
In this perspective article, we show that a morphospace, based on information-theoretic measures, can be a useful construct for comparing biological agents with artificial intelligence (AI) systems. The axes of this space label three kinds of complexity: (i) autonomic, (ii) computational and (iii) social complexity. On this space, we map biological agents such as bacteria, bees, C. elegans, primates and humans; as well as AI technologies such as deep neural networks, multi-agent bots, social robots, Siri and Watson. A complexity-based conceptualization provides a useful framework for identifying defining features and classes of conscious and intelligent systems. Starting with cognitive and clinical metrics of consciousness that assess awareness and wakefulness, we ask how AI and synthetically engineered life-forms would measure on homologous metrics. We argue that awareness and wakefulness stem from computational and autonomic complexity. Furthermore, tapping insights from cognitive robotics, we examine the functional role of consciousness in the context of evolutionary games. This points to a third kind of complexity for describing consciousness, namely, social complexity. Based on these metrics, our morphospace suggests the possibility of additional types of consciousness other than biological; namely, synthetic, group-based and simulated. This space provides a common conceptual framework for comparing traits and highlighting design principles of minds and machines., This research was funded by the European Research Council’s CDAC project: “The Role of Consciousness in Adaptive Behavior: A Combined Empirical, Computational and Robot based Approach” (ERC-2013- ADG 341196).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Erratum to: the visual amplification of goal-oriented movements counteracts acquired non-use in hemiparetic stroke patients

  • Rubio Ballester, Belén
  • Nirme, Jens
  • Duarte Oller, Esther
  • Cuxart, Ampar
  • Rodriguez, Susana
  • Verschure, Paul F. M. J.
  • Duff, Armin
BACKGROUND: Stroke-induced impairments result from both primary and secondary causes, i.e. damage to the brain and the acquired non-use of the impaired limbs. Indeed, stroke patients often under-utilize their paretic limb despite sufficient residual motor function. We hypothesize that acquired non-use can be overcome by reinforcement-based training strategies. METHODS: Hemiparetic stroke patients (n = 20, 11 males, 9 right-sided hemiparesis) were asked to reach targets appearing in either the real world or in a virtual environment. Sessions were divided into 3 phases: baseline, intervention and washout. During the intervention the movement of the virtual representation of the patients' paretic limb was amplified towards the target. RESULTS: We found that the probability of using the paretic limb during washout was significantly higher in comparison to baseline. Patients showed generalization of these results by displaying a more substantial workspace in real world task. These gains correlated with changes in effector selection patterns. CONCLUSIONS: The amplification of the movement of the paretic limb in a virtual environment promotes the use of the paretic limb in stroke patients. Our findings indicate that reinforcement-based therapies may be an effective approach for counteracting learned non-use and may modulate motor performance in the real world., This project was supported through ERC project cDAC (FP7-IDEAS-ERC 341196), EC H2020 project socSMCs (H2020-EU.1.2.2. 641321) and MINECO project SANAR (Gobierno de España).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Discrepancies between multi-electrode LFP and CSD phase-patterns: A forward modeling study

  • Hindriks, Rikkert
  • Arsiwalla, Xerxes D.
  • Panagiotaropoulos, Theofanis I.
  • Besserve, Michel
  • Verschure, Paul F. M. J.
  • Logothetis, Nikos
  • Deco, Gustavo
Multi-electrode recordings of local field potentials (LFPs) provide the opportunity to investigate the spatiotemporal organization of neural activity on the scale of several millimeters. In particular, the phases of oscillatory LFPs allow studying the coordination of neural oscillations in time and space and to tie it to cognitive processing. Given the computational roles of LFP phases, it is important to know how they relate to the phases of the underlying current source densities (CSDs) that generate them. Although CSDs and LFPs are distinct physical quantities, they are often (implicitly) identified when interpreting experimental observations. That this identification is problematic is clear from the fact that LFP phases change when switching to different electrode montages, while the underlying CSD phases remain unchanged. In this study we use a volume-conductor model to characterize discrepancies between LFP and CSD phase-patterns, to identify the contributing factors, and to assess the effect of different electrode montages. Although we focus on cortical LFPs recorded with two-dimensional (Utah) arrays, our findings are also relevant for other electrode configurations. We found that the main factors that determine the discrepancy between CSD and LFP phase-patterns are the frequency of the neural oscillations and the extent to which the laminar CSD profile is balanced. Furthermore, the presence of laminar phase-differences in cortical oscillations, as commonly observed in experiments, precludes identifying LFP phases with those of the CSD oscillations at a given cortical depth. This observation potentially complicates the interpretation of spike-LFP coherence and spike-triggered LFP averages. With respect to reference strategies, we found that the average-reference montage leads to larger discrepancies between LFP and CSD phases as compared with the referential montage, while the Laplacian montage reduces these discrepancies. We therefore advice to conduct analysis of two-dimensional LFP recordings using the Laplacian montage., RH and GD were funded by the European Research Council (Advanced Grant DYSTRUCTURE No. 295129), the Spanish Research Project PSI2013-42091-P, the CONSOLIDER-INGENIO 2010 Program CSD2007-00012, and the FP7-ICT Brainscales (269921). XA and PV are supported by the European Research Council's CDAC project: “The Role of Consciousness in Adaptive Behavior: A Combined Empirical, Computational and Robot based Approach” (ERC-2013- ADG 341196).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

The affective slider: a digital self-assessment scale for the measurement of human emotions

  • Betella, Alberto
  • Verschure, Paul F. M. J.
Self-assessment methods are broadly employed in emotion research for the collection of subjective affective ratings. The Self-Assessment Manikin (SAM), a pictorial scale developed in the eighties for the measurement of pleasure, arousal, and dominance, is still among the most popular self-reporting tools, despite having been conceived upon design principles which are today obsolete. By leveraging on state-of-the-art user interfaces and metacommunicative pictorial representations, we developed the Affective Slider (AS), a digital self-reporting tool composed of two slider controls for the quick assessment of pleasure and arousal. To empirically validate the AS, we conducted a systematic comparison between AS and SAM in a task involving the emotional assessment of a series of images taken from the International Affective Picture System (IAPS), a database composed of pictures representing a wide range of semantic categories often used as a benchmark in psychological studies. Our results show that the AS is equivalent to SAM in the self-assessment of pleasure and arousal, with two added advantages: the AS does not require written instructions and it can be easily reproduced in latest-generation digital devices, including smartphones and tablets. Moreover, we compared new and normative IAPS ratings and found a general drop in reported arousal of pictorial stimuli. Not only do our results demonstrate that legacy scales for the self-report of affect can be replaced with new measurement tools developed in accordance to modern design principles, but also that standardized sets of stimuli which are widely adopted in research on human emotion are not as effective as they were in the past due to a general desensitization towards highly arousing content., This work was supported by European Research Council grant 341196 (CDAC).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Estimating upper-extremity function from kinematics in stroke patients following goal-oriented computer-based training

  • Rubio Ballester, Belén
  • Antenucci, Fabrizio
  • Maier, Martina
  • Coolen, Anthony C. C.
  • Verschure, Paul F. M. J.
Introduction: After a stroke, a wide range of deficits can occur with varying onset latencies. As a result, assessing impairment and recovery are enormous challenges in neurorehabilitation. Although several clinical scales are generally accepted, they are time-consuming, show high inter-rater variability, have low ecological validity, and are vulnerable to biases introduced by compensatory movements and action modifications. Alternative methods need to be developed for efficient and objective assessment. In this study, we explore the potential of computer-based body tracking systems and classification tools to estimate the motor impairment of the more affected arm in stroke patients. Methods: We present a method for estimating clinical scores from movement parameters that are extracted from kinematic data recorded during unsupervised computer-based rehabilitation sessions. We identify a number of kinematic descriptors that characterise the patients’ hemiparesis (e.g., movement smoothness, work area), we implement a double-noise model and perform a multivariate regression using clinical data from 98 stroke patients who completed a total of 191 sessions with RGS. Results: Our results reveal a new digital biomarker of arm function, the Total Goal-Directed Movement (TGDM), which relates to the patients work area during the execution of goal-oriented reaching movements. The model’s performance to estimate FM-UE scores reaches an accuracy of R2: 0.38 with an error (σ: 12.8). Next, we evaluate its reliability (r = 0.89 for test-retest), longitudinal external validity (95% true positive rate), sensitivity, and generalisation to other tasks that involve planar reaching movements (R2: 0.39). The model achieves comparable accuracy also for the Chedoke Arm and Hand Activity Inventory (R2: 0.40) and Barthel Index (R2: 0.35). Conclusions: Our results highlight the clinical value of kinematic data collected during unsupervised goal-oriented motor training with the RGS combined with data science techniques, and provide new insight into factors underlying recovery and its biomarkers., This study was supported by the European Commission (EC), the European Research Council under Grant agreement 341196 (cDAC), EC H2020 project socSMCs (H2020EU.1.2.2. 641321), and by the RGS@home, EIT Health project 19277. EIT Health is supported by EIT, a body of the European Union.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

The Global dynamical complexity of the human brain network

  • Arsiwalla, Xerxes D.
  • Verschure, Paul F. M. J.
How much information do large brain networks integrate as a whole over the sum of their parts? Can the dynamical complexity of such networks be globally quantified in an information-theoretic way and be meaningfully coupled to brain function? Recently, measures of dynamical complexity such as integrated information have been proposed. However, problems related to the normalization and Bell number of partitions associated to these measures make these approaches computationally infeasible for large-scale brain networks. Our goal in this work is to address this problem. Our formulation of network integrated information is based on the Kullback-Leibler divergence between the multivariate distribution on the set of network states versus the corresponding factorized distribution over its parts. We find that implementing the maximum information partition optimizes computations. These methods are well-suited for large networks with linear stochastic dynamics. We compute the integrated information for both, the system’s attractor states, as well as non-stationary dynamical states of the network. We then apply this formalism to brain networks to compute the integrated information for the human brain’s connectome. Compared to a randomly re-wired network, we find that the specific topology of the brain generates greater information complexity., This work has been supported by the European Research Council’s CDAC project: “The Role of Consciousness in Adaptive Behavior: A Combined Empirical, Computational and Robot based Approach” (ERC-2013- ADG 341196).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

A spatial-context effect in recognition memory

  • Pacheco, Daniel
  • Sánchez Fibla, Martí
  • Duff, Armin
  • Verschure, Paul F. M. J.
We designed a novel experiment to investigate the modulation of human recognition memory by environmental context. Human participants were asked to navigate through a four-arm Virtual Reality (VR) maze in order to find and memorize discrete items presented at specific locations in the environment. They were later on tested on their ability to recognize items as previously presented or new. By manipulating the spatial position of half of the studied items during the testing phase of our experiment, we could assess differences in performance related to the congruency of environmental information at encoding and retrieval. Our results revealed that spatial context had a significant effect on the quality of memory. In particular, we found that recognition performance was significantly better in trials in which contextual information was congruent as opposed to those in which it was different. Our results are in line with previous studies that have reported spatial-context effects in recognition memory, further characterizing their magnitude under ecologically valid experimental conditions., The research leading to these results has received funding from the ERC grant agreement n° 341196 (CDAC).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Counteracting learned non-use in chronic stroke patients with reinforcement-induced movement therapy

  • Rubio Ballester, Belén
  • Maier, Martina
  • San Segundo Mozo, Rosa María
  • Castañeda, Victoria
  • Duff, Armin
  • Verschure, Paul F. M. J.
Background: After stroke, patients who suffer from hemiparesis tend to suppress the use of the affected extremity, a condition called learned non-use. Consequently, the lack of training may lead to the progressive deterioration of motor function. Although Constraint-Induced Movement Therapies (CIMT) have shown to be effective in treating this condition, the method presents several limitations, and the high intensity of its protocols severely compromises its adherence. We propose a novel rehabilitation approach called Reinforcement-Induced Movement Therapy (RIMT), which proposes to restore motor function through maximizing arm use. This is achieved by exposing the patient to amplified goal-oriented movements in VR that match the intended actions of the patient. We hypothesize that through this method we can increase the patients self-efficacy, reverse learned non-use, and induce long-term motor improvements. Methods: We conducted a randomized, double-blind, longitudinal clinical study with 18 chronic stroke patients. Patients performed 30 minutes of daily VR-based training during six weeks. During training, the experimental group experienced goal-oriented movement amplification in VR. The control group followed the same training protocol but without movement amplification. Evaluators blinded to group designation performed clinical measurements at the beginning, at the end of the training and at 12-weeks follow-up. We used the Fugl-Meyer Assessment for the upper extremities (UE-FM) (Sanford et al., Phys Ther 73:447–454, 1993) as a primary outcome measurement of motor recovery. Secondary outcome measurements included the Chedoke Arm and Hand Activity Inventory (CAHAI-7) (Barreca et al., Arch Phys Med Rehabil 6:1616–1622, 2005) for measuring functional motor gains in the performance of Activities of Daily Living (ADLs), the Barthel Index (BI) for the evaluation of the patient’s perceived independence (Collin et al., Int Disabil Stud 10:61–63, 1988), and the Hamilton scale (Knesevich et al., Br J Psychiatr J Mental Sci 131:49–52, 1977) for the identification of improvements in mood disorders that could be induced by the reinforcement-based intervention. In order to study and predict the effects of this intervention we implemented a computational model of recovery after stroke. Results: While both groups showed significant motor gains at 6-weeks post-treatment, only the experimental group continued to exhibit further gains in UE-FM at 12-weeks follow-up (p<.05). This improvement was accompanied by a significant increase in arm-use during training in the experimental group. Conclusions: Implicitly reinforcing arm-use by augmenting visuomotor feedback as proposed by RIMT seems beneficial for inducing significant improvement in chronic stroke patients. By challenging the patients’ self-limiting believe system and perceived low self-efficacy this approach might counteract learned non-use., This project was supported through ERC project cDAC (FP7-IDEAS-ERC 341196), EC H2020 project socSMCs (H2020-EU.1.2.2. 641321) and MINECO project SANAR (Gobierno de España).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Long-term spatial clustering in free recall

  • Pacheco Estefan, Daniel
  • Verschure, Paul F. M. J.
We explored the influence of space on the organisation of items in long-term memory. In two experiments, we asked our participants to explore a virtual environment and memorise discrete items presented at specific locations. Memory for those items was later on tested in immediate (T1) and 24 hours delayed (T2) free recall tests, in which subjects were asked to recall as many items as possible in any order. In experiment 2, we further examined the contribution of active and passive navigation in recollection dynamics. Results across experiments revealed a significant tendency for participants to consecutively recall items that were encountered in proximate locations during learning. Moreover, the degree of spatial organisation and the total number of items recalled were positively correlated in the immediate and the delayed tests. Results from experiment 2 indicated that the spatial clustering of items was independent of navigation types. Our results highlight the long-term stability of spatial clustering effects and their correlation with recall performance, complementing previous results collected in immediate or briefly delayed tests., This work was supported by European Research Council (341196).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Human vicarious trial and error is predictive of spatial navigation performance

  • Santos-Pata, Diogo
  • Verschure, Paul F. M. J.
When learning new environments, rats often pause at decision points and look back and forth over their possible trajectories as if they were imagining the future outcome of their actions, a behavior termed “Vicarious trial and error” (VTE). As the animal learns the environmental configuration, rats change from deliberative to habitual behavior, and VTE tends to disappear, suggesting a functional relevance in the early stages of learning. Despite the extensive research on spatial navigation, learning and VTE in the rat model, fewer studies have focused on humans. Here, we tested whether head-scanning behaviors that humans typically exhibit during spatial navigation are as predictive of spatial learning as in the rat. Subjects performed a goal-oriented virtual navigation task in a symmetric environment. Spatial learning was assessed through the analysis of trajectories, timings, and head orientations, under habitual and deliberative spatial navigation conditions. As expected, we found that trajectory length and duration decreased with the trial number, implying that subjects learned the spatial configuration of the environment over trials. Interestingly, IdPhi (a standard metric of VTE) also decreased with the trial number, suggesting that humans benefit from the same head-orientation scanning behavior as rats at spatial decision-points. Moreover, IdPhi captured exclusively at the first decision-point of each trial, was correlated with trial trajectory duration and length. Our findings demonstrate that in VTE is a signature of the stage of spatial learning in humans, and can be used to predict performance in navigation tasks with high accuracy., The research leading to these results has received funding from the European Research Council under the European Union's Seventh Framework Programme (FP7/20072013)/ERC grant agreement no (341196) cDAC.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

iCub-HRI: a software framework for complex human-robot interaction scenarios on the iCub humanoid robot

  • Fischer, Tobias
  • Puigbò Llobet, Jordi-Ysard
  • Camilleri, Daniel
  • Nguyen, Phuong D.H.
  • Moulin-Frier, Clément
  • Lallée, Stéphane
  • Metta, Giorgio
  • Prescott, Tony J.
  • Demiris, Yiannis
  • Verschure, Paul F. M. J.
Generating complex, human-like behavior in a humanoid robot like the iCub requires the integration of a wide range of open source components and a scalable cognitive architecture. Hence, we present the iCub-HRI library which provides convenience wrappers for components related to perception (object recognition, agent tracking, speech recognition, and touch detection), object manipulation (basic and complex motor actions), and social interaction (speech synthesis and joint attention) exposed as a C++ library with bindings for Java (allowing to use iCub-HRI within Matlab) and Python. In addition to previously integrated components, the library allows for simple extension to new components and rapid prototyping by adapting to changes in interfaces between components. We also provide a set of modules which make use of the library, such as a high-level knowledge acquisition module and an action recognition module. The proposed architecture has been successfully employed for a complex human–robot interaction scenario involving the acquisition of language capabilities, execution of goal-oriented behavior and expression of a verbal narrative of the robot’s experience in the world. Accompanying this paper is a tutorial which allows a subset of this interaction to be reproduced. The architecture is aimed at researchers familiarizing themselves with the iCub ecosystem, as well as expert users, and we expect the library to be widely used in the iCub community., The research leading to these results has received funding under the European Union’s Seventh Framework Programme (FP/2007-2013)/ERC Grant Agreement n. FP7-ICT-612139 (WYSIWYD—What You Say Is What You Did) and FP7-ICT-270490 (EFAA—The Experimental Functional Android Assistant). PN was supported by a Marie Curie Early Stage Researcher Fellowship (H2020-MSCA-ITA, SECURE 642667). PV was supported by the ERC advanced grant 341196 (cDAC—Role of Consciousness in Adaptive Behavior).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

A critical time window for recovery extends beyond one-year post-stroke

  • Rubio Ballester, Belén
  • Maier Martina
  • Duff, Armin
  • Cameirão, Mónica
  • Bermúdez i Badia, Sergi
  • Duarte Oller, Esther
  • Cuxart, Ampar
  • Rodriguez, Susana
  • San Segundo Mozo, Rosa María
  • Verschure, Paul F. M. J.
The impact of rehabilitation on post-stroke motor recovery and its dependency on the patient's chronicity remain unclear. The field has widely accepted the notion of a proportional recovery rule with a "critical window for recovery" within the first 3-6 mo poststroke. This hypothesis justifies the general cessation of physical therapy at chronic stages. However, the limits of this critical window have, so far, been poorly defined. In this analysis, we address this question, and we further explore the temporal structure of motor recovery using individual patient data from a homogeneous sample of 219 individuals with mild to moderate upper-limb hemiparesis. We observed that improvement in body function and structure was possible even at late chronic stages. A bootstrapping analysis revealed a gradient of enhanced sensitivity to treatment that extended beyond 12 mo poststroke. Clinical guidelines for rehabilitation should be revised in the context of this temporal structure. NEW & NOTEWORTHY Previous studies in humans suggest that there is a 3- to 6-mo "critical window" of heightened neuroplasticity poststroke. We analyze the temporal structure of recovery in patients with hemiparesis and uncover a precise gradient of enhanced sensitivity to treatment that expands far beyond the limits of the so-called critical window. These findings highlight the need for providing therapy to patients at the chronic and late chronic stages.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Spectral modes of network dynamics reveal increased informational complexity near criticality

  • Arsiwalla, Xerxes D.
  • Martinez Mediano, Pedro Antonio
  • Verschure, Paul F. M. J.
What does the informational complexity of dynamical networked systems tell us about intrinsic mechanisms and functions of these complex systems? Recent complexity measures such as integrated information have sought to operationalize this problem taking a whole-versus-parts perspective, wherein one explicitly computes the amount of information generated by a network as a whole over and above that generated by the sum of its parts during state transitions. While several numerical schemes for estimating network integrated information exist, it is instructive to pursue an analytic approach that computes integrated information as a function of network weights. Our formulation of integrated information uses a Kullback-Leibler divergence between the multi-variate distribution on the set of network states versus the corresponding factorized distribution over its parts. Implementing stochastic Gaussian dynamics, we perform computations for several prototypical network topologies. Our findings show increased informational complexity near criticality, which remains consistent across network topologies. Spectral decomposition of the system’s dynamics reveals how informational complexity is governed by eigenmodes of both, the network’s covariance and adjacency matrices. We find that as the dynamics of the system approach criticality, high integrated information is exclusively driven by the eigenmode corresponding to the leading eigenvalue of the covariance matrix, while sub-leading modes get suppressed. The implication of this result is that it might be favorable for complex dynamical networked systems such as the human brain or communication systems to operate near criticality so that efficient information integration might be achieved., This work has been supported by the European Research Council’s CDAC project: ”The Role of Consciousness in Adaptive Behavior: A Combined Empirical, Computational and Robot based Approach” (ERC-2013- ADG 341196).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

DAC-h3: a proactive robot cognitive architecture to acquire and express knowledge about the world and the self

  • Moulin-Frier, Clément
  • Fischer, Tobias
  • Petit, Maxime
  • Pointeau, Grégoire
  • Puigbò Llobet, Jordi-Ysard
  • Pattacini, Ugo
  • Ching Low, Sock
  • Camilleri, Daniel
  • Nguyen, Phuong
  • Hoffmann, Matej
  • Jin Chang, Hyung
  • Zambelli, Martina
  • Mealier, Anne-Laure
  • Metta, Giorgio
  • Prescott, Tony J.
  • Demiris, Yiannis
  • Ford Dominey, Peter
  • Verschure, Paul F. M. J.
This paper introduces a cognitive architecture for a humanoid robot to engage in a proactive, mixed-initiative exploration and manipulation of its environment, where the initiative can originate from both human and robot. The framework, based on a biologically grounded theory of the brain and mind, integrates a reactive interaction engine, a number of state-of-the-art perceptual and motor learning algorithms, as well as planning abilities and an autobiographical memory. The architecture as a whole drives the robot behavior to solve the symbol grounding problem, acquire language capabilities, execute goal-oriented behavior, and express a verbal narrative of its own experience in the world. We validate our approach in human-robot interaction experiments with the iCub humanoid robot, showing that the proposed cognitive architecture can be applied in real time within a realistic scenario and that it can be used with naive users., This work was supported in part by the European Research Council through the European Union’s Seventh Framework Programme (FP/2007–2013), in part by the ERC through the What You Say Is What You Did project under Grant FP7-ICT-612139, and in part by the ERC’s CDAC Project—Role of Consciousness in Adaptive Behavior under Grant ERC-2013-ADG 341196. The work of D. Camilleri and T. Prescott was supported by the EU Seventh Framework Programme as part of the Human Brain (HBP-SGA1) under Project 720270. The work of P. Nguyen was supported by the ERC’s H2020 under Grant 642667 (SECURE). The work of M. Hoffmann was supported by the Czech Science Foundation under Project GA17-15697Y.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Self beyond the body: Action-driven and task-relevant purely distal cues modulate performance and body ownership

  • Grechuta, Klaudia
  • Ulysse, Laura
  • Rubio Ballester, Belén
  • Verschure, Paul F. M. J.
Our understanding of body ownership largely relies on the so-called Rubber Hand Illusion (RHI). In this paradigm, synchronous stroking of the real and the rubber hands leads to an illusion of ownership of the rubber hand provided that it is physically, anatomically, and spatially plausible. Self-attribution of an artificial hand also occurs during visuomotor synchrony. In particular, participants experience ownership over a virtual or a rubber hand when the visual feedback of self-initiated movements follows the trajectory of the instantiated motor commands, such as in the Virtual Hand Illusion (VHI) or the moving Rubber Hand Illusion (mRHI). Evidence yields that both when the cues are triggered externally (RHI) and when they result from voluntary actions (VHI and mRHI), the experience of ownership is established through bottom-up integration and top-down prediction of proximodistal cues (visuotactile or visuomotor) within the peripersonal space. It seems, however, that depending on whether the sensory signals are externally (RHI) or self-generated (VHI and mRHI), the top-down expectation signals are qualitatively different. On the one hand, in the RHI the sensory correlations are modulated by top-down influences which constitute empirically induced priors related to the internal (generative) model of the body. On the other hand, in the VHI and mRHI body ownership is actively shaped by processes which allow for continuous comparison between the expected and the actual sensory consequences of the actions. Ample research demonstrates that the differential processing of the predicted and the reafferent information is addressed by the central nervous system via an internal (forward) model or corollary discharge. Indeed, results from the VHI and mRHI suggest that, in action-contexts, the mechanism underlying body ownership could be similar to the forward model. Crucially, forward models integrate across all self-generated sensory signals including not only proximodistal (i.e., visuotactile or visuomotor) but also purely distal sensory cues (i.e., visuoauditory). Thus, if body ownership results from a consistency of a forward model, it will be affected by the (in)congruency of purely distal cues provided that they inform about action-consequences and are relevant to a goal-oriented task. Specifically, they constitute a corrective error signal. Here, we explicitly addressed this question. To test our hypothesis, we devised an embodied virtual reality-based motor task where action outcomes were signaled by distinct auditory cues. By manipulating the cues with respect to their spatial, temporal and semantic congruency, we show that purely distal (visuoauditory) feedback which violates predictions about action outcomes compromises both performance and body ownership. These results demonstrate, for the first time, that body ownership is influenced by not only externally and self-generated cues which pertain to the body within the peripersonal space but also those arising outside of the body. Hence, during goal-oriented tasks body ownership may result from the consistency of forward models., This research has been supported by the MINECO Retos Investigacion I+D+I, Plan Nacional project, SANAR (Gobierno de Espana) under agreement TIN2013–44200–REC, FPI grant nr. BES–2014–068791, and also European Research Council under grant agreement 341196 (CDAC).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

The impact of cortical lesions on thalamo-cortical network dynamics after acute ischaemic stroke: a combined experimental and theoretical study

  • Van Wijngaarden, Joeri B. G.
  • Zucca, Riccardo
  • Finnigan, Simon
  • Verschure, Paul F. M. J.
The neocortex and thalamus provide a core substrate for perception, cognition, and action, and are interconnected through different direct and indirect pathways that maintain specific dynamics associated with functional states including wakefulness and sleep. It has been shown that a lack of excitation, or enhanced subcortical inhibition, can disrupt this system and drive thalamic nuclei into an attractor state of low-frequency bursting and further entrainment of thalamo-cortical circuits, also called thalamo-cortical dysrhythmia (TCD). The question remains however whether similar TCD-like phenomena can arise with a cortical origin. For instance, in stroke, a cortical lesion could disrupt thalamo-cortical interactions through an attenuation of the excitatory drive onto the thalamus, creating an imbalance between excitation and inhibition that can lead to a state of TCD. Here we tested this hypothesis by comparing the resting-state EEG recordings of acute ischaemic stroke patients (N = 21) with those of healthy, age-matched control-subjects (N = 17). We observed that these patients displayed the hallmarks of TCD: a characteristic downward shift of dominant α-peaks in the EEG power spectra, together with increased power over the lower frequencies (δ and θ-range). Contrary to general observations in TCD, the patients also displayed a broad reduction in β-band activity. In order to explain the genesis of this stroke-induced TCD, we developed a biologically constrained model of a general thalamocortical module, allowing us to identify the specific cellular and network mechanisms involved. Our model showed that a lesion in the cortical component leads to sustained cell membrane hyperpolarization in the corresponding thalamic relay neurons, that in turn leads to the de-inactivation of voltage-gated T-type Ca2+-channels, switching neurons from tonic spiking to a pathological bursting regime. This thalamic bursting synchronises activity on a population level through divergent intrathalamic circuits, and entrains thalamo-cortical pathways by means of propagating low-frequency oscillations beyond the restricted region of the lesion. Hence, pathological stroke-induced thalamo-cortical dynamics can be the source of diaschisis, and account for the dissociation between lesion location and non-specific symptoms of stroke such as neuropathic pain and hemispatial neglect., This work was supported by the European Research Council under the European Union's Seventh Framework Programme FP7/2007-2013/ERC grant agreement n. 341196 [CDAC], and the Research and Technological Development Programme FP7-ICT-612139 in the WYSIWYD project to PFMJV. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Measuring the complexity of consciousness

  • Arsiwalla, Xerxes D.
  • Verschure, Paul F. M. J.
The grand quest for a scientific understanding of consciousness has given rise to many new theoretical and empirical paradigms for investigating the phenomenology of consciousness as well as clinical disorders associated to it. A major challenge in this field is to formalize computational measures that can reliably quantify global brain states from data. In particular, information-theoretic complexity measures such as integrated information have been proposed as measures of conscious awareness. This suggests a new framework to quantitatively classify states of consciousness. However, it has proven increasingly difficult to apply these complexity measures to realistic brain networks. In part, this is due to high computational costs incurred when implementing these measures on realistically large network dimensions. Nonetheless, complexity measures for quantifying states of consciousness are important for assisting clinical diagnosis and therapy. This article is meant to serve as a lookup table of measures of consciousness, with particular emphasis on clinical applicability. We consider both, principle-based complexity measures as well as empirical measures tested on patients. We address challenges facing these measures with regard to realistic brain networks, and where necessary, suggest possible resolutions., This work has been supported by the European Research Council's CDAC project: The Role of Consciousness in Adaptive Behavior: A Combined Empirical, Computational and Robot based Approach (ERC-2013- ADG 341196).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Consensus paper: towards a systems-level view of cerebellar function: the interplay between cerebellum, basal ganglia, and cortex

  • Caligiore, Daniele
  • Pezzulo, Giovanni
  • Baldassarre, Gianluca
  • Bostan, Andreea C.
  • Strick, Peter L.
  • Doya, Kenji
  • Helmich, Rick C.
  • Dirkx, Michiel
  • Houk, James
  • Jörntell, Henrik
  • Lago-Rodriguez, Angel
  • Galea, Joseph M.
  • Miall, R. Chris
  • Popa, Traian
  • Kishore, Asha
  • Verschure, Paul F. M. J.
  • Zucca, Riccardo
  • Herreros, Ivan
Despite increasing evidence suggesting the cerebellum works in concert with the cortex and basal ganglia, the nature of the reciprocal interactions between these three brain regions remains unclear. This consensus paper gathers diverse recent views on a variety of important roles played by the cerebellum within the cerebello-basal ganglia-thalamo-cortical system across a range of motor and cognitive functions. The paper includes theoretical and empirical contributions, which cover the following topics: recent evidence supporting the dynamical interplay between cerebellum, basal ganglia, and cortical areas in humans and other animals; theoretical neuroscience perspectives and empirical evidence on the reciprocal influences between cerebellum, basal ganglia, and cortex in learning and control processes; and data suggesting possible roles of the cerebellum in basal ganglia movement disorders. Although starting from different backgrounds and dealing with different topics, all the contributors agree that viewing the cerebellum, basal ganglia, and cortex as an integrated system enables us to understand the function of these areas in radically different ways. In addition, there is unanimous consensus between the authors that future experimental and computational work is needed to understand the function of cerebellar-basal ganglia circuitry in both motor and non-motor functions. The paper reports the most advanced perspectives on the role of the cerebellum within the cerebello-basal ganglia-thalamo-cortical system and illustrates other elements of consensus as well as disagreements and open questions in the field., The present research was supported by the European Commission 7th Framework Programme (FP7/2007-2013), “Challenge 2—Cognitive Systems, Interaction, Robotics,” grant agreement No. ICT IP-231722, project “IM-CLeVeR—Intrinsically Motivated Cumulative Learning Versatile Robots” to D. Caligiore; by the Human Frontier Science Program (HFSP), award number RGY0088/2014 to G. Pezzulo; in parts by funds from the Office of Research and Development, Medical Research Service, Department of Veterans Affairs and National Institutes of Health Grants R01 NS24328, R01 MH56661, P40 OD010996, and P30 NS076405 to P. L. Strick; by the European Research Council project MotMotLearn (637488) to J. Galea; by the MRC (grant R/J012610/1) to R.C. Miall and Wellcome Trust, grant WT087554 to R.C. Miall and A. Lago-Rodriguez; by the European Research Council under the European Union’s Seventh Framework Programme (FP7/2007-2013)/ERC grant agreement no. 341196 to P. F. M. J. Verschure; and by the European Commission’s Horizon 2020 socSMC (under agreement number socSMC-641321H2020-FETPROACT-2014) to I. Herreros. We thank the two anonymous reviewers and Professor Michael A. Arbib who have contributed to enhance the quality of this consensus paper with precious comments.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Coordinated representational reinstatement in the human hippocampus and lateral temporal cortex during episodic memory retrieval

  • Pacheco Estefan, D.
  • Sánchez Fibla, Martí
  • Duff, Armin
  • Principe, Alessandro
  • Rocamora Zúñiga, Rodrigo Alberto
  • Zhang, Hui
  • Axmacher, Nikolai
  • Verschure, Paul F. M. J.
Theoretical models of episodic memory have proposed that retrieval depends on interactions between the hippocampus and neocortex, where hippocampal reinstatement of item-context associations drives neocortical reinstatement of item information. Here, we simultaneously recorded intracranial EEG from hippocampus and lateral temporal cortex (LTC) of epilepsy patients who performed a virtual reality spatial navigation task. We extracted stimulus-specific representations of both item and item-context associations from the time-frequency patterns of activity in hippocampus and LTC. Our results revealed a double dissociation of representational reinstatement across time and space: an early reinstatement of item-context associations in hippocampus preceded a later reinstatement of item information in LTC. Importantly, reinstatement levels in hippocampus and LTC were correlated across trials, and the quality of LTC reinstatement was predicted by the magnitude of phase synchronization between hippocampus and LTC. These findings confirm that episodic memory retrieval in humans relies on coordinated representational interactions within a hippocampal-neocortical network., The research leading to these results has received funding from the ERC grant agreement n° 341196 (CDAC). N.A. received funding by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) – Projektnummer 316803389 – SFB 1280 as well as via Projektnummer 122679504 – SFB 874. M.S. received funding by Spanish National Project INSOCO-DPI2016-80116-P.
Dipòsit Digital de la UB
Publication Artículo científico (JournalArticle)

Effect of specific over nonspecific VR-based rehabilitation on poststroke motor recovery: A systematic meta-analysis

  • Maier, Martina
  • Rubio Ballester, Belén
  • Duff, Armin
  • Duarte Oller, Esther
  • Verschure, Paul
Background. Despite the rise of virtual reality (VR)-based interventions in stroke rehabilitation over the past decade, no consensus has been reached on its efficacy. This ostensibly puzzling outcome might not be that surprising given that VR is intrinsically neutral to its use—that is, an intervention is effective because of its ability to mobilize recovery mechanisms, not its technology. As VR systems specifically built for rehabilitation might capitalize better on the advantages of technology to implement neuroscientifically grounded protocols, they might be more effective than those designed for recreational gaming. Objective. We evaluate the efficacy of specific VR (SVR) and nonspecific VR (NSVR) systems for rehabilitating upper-limb function and activity after stroke. Methods. We conducted a systematic search for randomized controlled trials with adult stroke patients to analyze the effect of SVR or NSVR systems versus conventional therapy (CT). Results. We identified 30 studies including 1473 patients. SVR showed a significant impact on body function (standardized mean difference [SMD] = 0.23; 95% CI = 0.10 to 0.36; P = .0007) versus CT, whereas NSVR did not (SMD = 0.16; 95% CI = −0.14 to 0.47; P = .30). This result was replicated in activity measures. Conclusions. Our results suggest that SVR systems are more beneficial than CT for upper-limb recovery, whereas NSVR systems are not. Additionally, we identified 6 principles of neurorehabilitation that are shared across SVR systems and are possibly responsible for their positive effect. These findings may disambiguate the contradictory results found in the current literature.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Counteracting learned non-use in chronic stroke patients with reinforcement-induced movement therapy

  • Rubio Ballester, Belén
  • Maier, Martina
  • San Segundo Mozo, Rosa María
  • Castañeda, Victoria
  • Duff, Armin
  • Verschure, Paul F. M. J.
Background: After stroke, patients who suffer from hemiparesis tend to suppress the use of the affected extremity, a condition called learned non-use. Consequently, the lack of training may lead to the progressive deterioration of motor function. Although Constraint-Induced Movement Therapies (CIMT) have shown to be effective in treating this condition, the method presents several limitations, and the high intensity of its protocols severely compromises its adherence. We propose a novel rehabilitation approach called Reinforcement-Induced Movement Therapy (RIMT), which proposes to restore motor function through maximizing arm use. This is achieved by exposing the patient to amplified goal-oriented movements in VR that match the intended actions of the patient. We hypothesize that through this method we can increase the patients self-efficacy, reverse learned non-use, and induce long-term motor improvements. Methods: We conducted a randomized, double-blind, longitudinal clinical study with 18 chronic stroke patients. Patients performed 30 minutes of daily VR-based training during six weeks. During training, the experimental group experienced goal-oriented movement amplification in VR. The control group followed the same training protocol but without movement amplification. Evaluators blinded to group designation performed clinical measurements at the beginning, at the end of the training and at 12-weeks follow-up. We used the Fugl-Meyer Assessment for the upper extremities (UE-FM) (Sanford et al., Phys Ther 73:447–454, 1993) as a primary outcome measurement of motor recovery. Secondary outcome measurements included the Chedoke Arm and Hand Activity Inventory (CAHAI-7) (Barreca et al., Arch Phys Med Rehabil 6:1616–1622, 2005) for measuring functional motor gains in the performance of Activities of Daily Living (ADLs), the Barthel Index (BI) for the evaluation of the patient’s perceived independence (Collin et al., Int Disabil Stud 10:61–63, 1988), and the Hamilton scale (Knesevich et al., Br J Psychiatr J Mental Sci 131:49–52, 1977) for the identification of improvements in mood disorders that could be induced by the reinforcement-based intervention. In order to study and predict the effects of this intervention we implemented a computational model of recovery after stroke. Results: While both groups showed significant motor gains at 6-weeks post-treatment, only the experimental group continued to exhibit further gains in UE-FM at 12-weeks follow-up (p<.05). This improvement was accompanied by a significant increase in arm-use during training in the experimental group. Conclusions: Implicitly reinforcing arm-use by augmenting visuomotor feedback as proposed by RIMT seems beneficial for inducing significant improvement in chronic stroke patients. By challenging the patients’ self-limiting believe system and perceived low self-efficacy this approach might counteract learned non-use., This project was supported through ERC project cDAC (FP7-IDEAS-ERC 341196), EC H2020 project socSMCs (H2020-EU.1.2.2. 641321) and MINECO project SANAR (Gobierno de España).
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

A wearable bracelet device for promoting arm use in stroke patients

  • Rubio Ballester, Belén
  • Lathe, Alica
  • Duarte Oller, Esther
  • Duff, Armin
  • Verschure, Paul F. M. J.
Comunicació presentada a: 3rd International Congress on Neurotechnology, Electronics and Informatics (NEUROTECHNIX), celebrada a Lisboa (Portugal) del 16 al 17 de novembre de 2015., After stroke, many patients experience hemiparesis or weakness on one side of the body. In order to compensate for this lack of motor function, they tend to overuse their non-affected limb. This so called learned non-use may be one of the most relevant contributors to functional loss after post-stroke hospital discharge. We hypothesize that frequent exposure to movement related feedback through a wearable bracelet device may 1) increase the patient’s intrinsic motivation for using the paretic limb, and 2) counteract learned non-use, therefore inducing motor recovery. First, to validate the accelerometers-based measurement of arm use, we recruited 10 right-handed volunteers without neurological impairments. Second, we explored the acceptability and clinical impact of a low-cost wearable system on 4 chronic stroke patients with hemiparesis. Our results suggest that frequent exposure to direct feedback about arm use promotes the integration of the paretic limb in the performanc e of instrumental activities of daily living (iADLs). In addition, results from questionnaires revealed that the use of wearable devices may influence positively the patient’s intrinsic motivation for using the affected arm. To the best of our knowledge, this is the first study suggesting the benefits of wearable-based feedback as an intervention tool for counteracting learned non-use., We would like to acknowledge all patients who participated in this study. Special thanks to Dr. Boza Gomez for her assistance in recruiting stroke patients. This project was supported through ERC project cDAC (FP7-IDEAS-ERC 341196), EC H2020 project socSMCs (H2020-EU.1.2.2. 641321) and MINECO project SANAR (Gobierno de Espaa).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

The affective slider: a digital self-assessment scale for the measurement of human emotions

  • Betella, Alberto
  • Verschure, Paul F. M. J.
Self-assessment methods are broadly employed in emotion research for the collection of subjective affective ratings. The Self-Assessment Manikin (SAM), a pictorial scale developed in the eighties for the measurement of pleasure, arousal, and dominance, is still among the most popular self-reporting tools, despite having been conceived upon design principles which are today obsolete. By leveraging on state-of-the-art user interfaces and metacommunicative pictorial representations, we developed the Affective Slider (AS), a digital self-reporting tool composed of two slider controls for the quick assessment of pleasure and arousal. To empirically validate the AS, we conducted a systematic comparison between AS and SAM in a task involving the emotional assessment of a series of images taken from the International Affective Picture System (IAPS), a database composed of pictures representing a wide range of semantic categories often used as a benchmark in psychological studies. Our results show that the AS is equivalent to SAM in the self-assessment of pleasure and arousal, with two added advantages: the AS does not require written instructions and it can be easily reproduced in latest-generation digital devices, including smartphones and tablets. Moreover, we compared new and normative IAPS ratings and found a general drop in reported arousal of pictorial stimuli. Not only do our results demonstrate that legacy scales for the self-report of affect can be replaced with new measurement tools developed in accordance to modern design principles, but also that standardized sets of stimuli which are widely adopted in research on human emotion are not as effective as they were in the past due to a general desensitization towards highly arousing content., This work was supported by European Research Council grant 341196 (CDAC).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Visual anticipation biases conscious decision making but not bottom-up visual processing

  • Mathews, Zenon
  • Cetnarski, Ryszard
  • Verschure, Paul F. M. J.
Prediction plays a key role in control of attention but it is not clear which aspects of prediction are most prominent in conscious experience. An evolving view on the brain is that it can be seen as a prediction machine that optimizes its ability to predict states of the world and the self through the top-down propagation of predictions and the bottom-up presentation of prediction errors. There are competing views though on whether prediction or prediction errors dominate the formation of conscious experience. Yet, the dynamic effects of prediction on perception, decision making and consciousness have been difficult to assess and to model. We propose a novel mathematical framework and a psychophysical paradigm that allows us to assess both the hierarchical structuring of perceptual consciousness, its content and the impact of predictions and/or errors on conscious experience, attention and decision-making. Using a displacement detection task combined with reverse correlation, we reveal signatures of the usage of prediction at three different levels of perceptual processing: bottom-up fast saccades, top-down driven slow saccades and consciousnes decisions. Our results suggest that the brain employs multiple parallel mechanism at different levels of perceptual processing in order to shape effective sensory consciousness within a predicted perceptual scene. We further observe that bottom-up sensory and top-down predictive processes can be dissociated through cognitive load. We propose a probabilistic data association model from dynamical systems theory to model the predictive multi-scale bias in perceptual processing that we observe and its role in the formation of conscious experience. We propose that these results support the hypothesis that consciousness provides a time-delayed description of a task that is used to prospectively optimize real time control structures, rather than being engaged in the real-time control of behavior itself, This work was carried out as part of the CEEDS project; an EU funded Integrated Project under the Seventh Framework Programme (ICT-258749) and ERC grant cDAC (ERC-341196).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Visuotactile integration modulates motor performance in a perceptual decision-making task

  • Grechuta, Klaudia
  • Guga, Jelena
  • Maffei, Giovanni
  • Rubio Ballester, Belén
  • Verschure, Paul F. M. J.
Body ownership is critically dependent on multimodal integration as for instance revealed in the Rubber Hand Illusion (RHI) and a number of studies which have addressed the neural correlates of the processes underlying this phenomenon. Both experimental and clinical research have shown that the structures underlying body ownership seem to significantly overlap with those of motor control including the parietal and ventral premotor cortices, Temporal Parietal Junction (TPJ) and the insula. This raises the question of whether this structural overlap between body ownership and motor control structures is of any functional significance. Here, we investigate the specific question of whether experimentally induced ownership over a virtual limb can modulate the performance of that limb in a simple sensorimotor task. Using a Virtual reality (VR) environment we modulate body ownership in three experimental conditions with respect to the (in)congruence of stimulus configurations. Our results show that the degree of ownership directly modulates motor performance. This implies that body ownership is not exclusively a perceptual and/or subjective multimodal state but that it is tightly coupled to systems for decision-making and motor control., This research has been supported by the MINECO “Retos Investigacion tos Investigacion I + d + i”, Plan Nacional project, SANAR (Gobierno de Espan∽a) - under agreement TIN2013-44200-REC and also FPI grant nr. BES-2014-068791, European Research Council under grant agreement 341196 (CDAC), and “Excellence in Human Resources as a Source of Competitiveness” project (CZ.1.07/2.3.00/30.0013), OP Education for Competitiveness, funded by the European Social Fund in the Czech Republic and by the State Budget of the Czech Republic.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Long-term spatial clustering in free recall

  • Pacheco Estefan, Daniel
  • Verschure, Paul F. M. J.
We explored the influence of space on the organisation of items in long-term memory. In two experiments, we asked our participants to explore a virtual environment and memorise discrete items presented at specific locations. Memory for those items was later on tested in immediate (T1) and 24 hours delayed (T2) free recall tests, in which subjects were asked to recall as many items as possible in any order. In experiment 2, we further examined the contribution of active and passive navigation in recollection dynamics. Results across experiments revealed a significant tendency for participants to consecutively recall items that were encountered in proximate locations during learning. Moreover, the degree of spatial organisation and the total number of items recalled were positively correlated in the immediate and the delayed tests. Results from experiment 2 indicated that the spatial clustering of items was independent of navigation types. Our results highlight the long-term stability of spatial clustering effects and their correlation with recall performance, complementing previous results collected in immediate or briefly delayed tests., This work was supported by European Research Council (341196).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Motor adaptation impairment in chronic cannabis users assessed by a visuomotor rotation task

  • Herreros Alonso, Ivan
  • Miquel, Laia
  • Blithikioti, Chrysanthi
  • Nuño, Laura
  • Rubio Ballester, Belén
  • Grechuta, Klaudia
  • Gual, Antoni
  • Balcells-Oliveró, Mercè
  • Verschure, Paul F. M. J.
Background—The cerebellum has been recently suggested as an important player in the addiction brain circuit. Cannabis is one of the most used drugs worldwide, and its long-term effects on the central nervous system are not fully understood. No valid clinical evaluations of cannabis impact on the brain are available today. The cerebellum is expected to be one of the brain structures that are highly affected by prolonged exposure to cannabis, due to its high density in endocannabinoid receptors. We aim to use a motor adaptation paradigm to indirectly assess cerebellar function in chronic cannabis users (CCUs). Methods—We used a visuomotor rotation (VMR) task that probes a putatively-cerebellar implicit motor adaptation process together with the learning and execution of an explicit aiming rule. We conducted a case-control study, recruiting 18 CCUs and 18 age-matched healthy controls. Our main measure was the angular aiming error. Results—Our results show that CCUs have impaired implicit motor adaptation, as they showed a smaller rate of adaptation compared with healthy controls (drift rate: 19.3 +/− 6.8° vs. 27.4 +/− 11.6°; t(26) = −2.1, p = 0.048, Cohen’s d = −0.8, 95% CI = (−1.7, −0.15)). Conclusions—We suggest that a visuomotor rotation task might be the first step towards developing a useful tool for the detection of alterations in implicit learning among cannabis users., This work was supported by MINECO “Retos Investigacion I+d+i”, Plan Nacional project, SANAR (Gobierno de España)—under agreement TIN2013-44200-REC, FPI grant nr. BES-2014-068791, and by the European Research Council under grant agreement 341196 (CDAC).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

DAC-h3: a proactive robot cognitive architecture to acquire and express knowledge about the world and the self

  • Moulin-Frier, Clément
  • Fischer, Tobias
  • Petit, Maxime
  • Pointeau, Grégoire
  • Puigbò Llobet, Jordi-Ysard
  • Pattacini, Ugo
  • Ching Low, Sock
  • Camilleri, Daniel
  • Nguyen, Phuong
  • Hoffmann, Matej
  • Jin Chang, Hyung
  • Zambelli, Martina
  • Mealier, Anne-Laure
  • Metta, Giorgio
  • Prescott, Tony J.
  • Demiris, Yiannis
  • Ford Dominey, Peter
  • Verschure, Paul F. M. J.
This paper introduces a cognitive architecture for a humanoid robot to engage in a proactive, mixed-initiative exploration and manipulation of its environment, where the initiative can originate from both human and robot. The framework, based on a biologically grounded theory of the brain and mind, integrates a reactive interaction engine, a number of state-of-the-art perceptual and motor learning algorithms, as well as planning abilities and an autobiographical memory. The architecture as a whole drives the robot behavior to solve the symbol grounding problem, acquire language capabilities, execute goal-oriented behavior, and express a verbal narrative of its own experience in the world. We validate our approach in human-robot interaction experiments with the iCub humanoid robot, showing that the proposed cognitive architecture can be applied in real time within a realistic scenario and that it can be used with naive users., This work was supported in part by the European Research Council through the European Union’s Seventh Framework Programme (FP/2007–2013), in part by the ERC through the What You Say Is What You Did project under Grant FP7-ICT-612139, and in part by the ERC’s CDAC Project—Role of Consciousness in Adaptive Behavior under Grant ERC-2013-ADG 341196. The work of D. Camilleri and T. Prescott was supported by the EU Seventh Framework Programme as part of the Human Brain (HBP-SGA1) under Project 720270. The work of P. Nguyen was supported by the ERC’s H2020 under Grant 642667 (SECURE). The work of M. Hoffmann was supported by the Czech Science Foundation under Project GA17-15697Y.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

The why, what, where, when and how of goal-directed choice: neuronal and computational principles

  • Verschure, Paul F. M. J.
  • Pennartz, Cyriel
  • Pezzulo, Giovanni
The central problems that goal-directed animals must solve are: ‘What do I need and Why, Where and When can this be obtained, and How do I get it?' or the H4W problem. Here, we elucidate the principles underlying the neuronal solutions to H4W using a combination of neurobiological and neurorobotic approaches. First, we analyse H4W from a system-level perspective by mapping its objectives onto the Distributed Adaptive Control embodied cognitive architecture which sees the generation of adaptive action in the real world as the primary task of the brain rather than optimally solving abstract problems. We next map this functional decomposition to the architecture of the rodent brain to test its consistency. Following this approach, we propose that the mammalian brain solves the H4W problem on the basis of multiple kinds of outcome predictions, integrating central representations of needs and drives (e.g. hypothalamus), valence (e.g. amygdala), world, self and task state spaces (e.g. neocortex, hippocampus and prefrontal cortex, respectively) combined with multi-modal selection (e.g. basal ganglia). In our analysis, goal-directed behaviour results from a well-structured architecture in which goals are bootstrapped on the basis of predefined needs, valence and multiple learning, memory and planning mechanisms rather than being generated by a singular computation., Research funded by the EU FP7 framework under grant agreements no. FP7-ICT-270108 (Goal-Leaders), FP7-ICT-270490 (EFAA), FP7-ICT-612139 (WYSIWYD), ERC-341196 (CDAC) and FP7-ICT-601167 (CSN II).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

iCub-HRI: a software framework for complex human-robot interaction scenarios on the iCub humanoid robot

  • Fischer, Tobias
  • Puigbò Llobet, Jordi-Ysard
  • Camilleri, Daniel
  • Nguyen, Phuong D.H.
  • Moulin-Frier, Clément
  • Lallée, Stéphane
  • Metta, Giorgio
  • Prescott, Tony J.
  • Demiris, Yiannis
  • Verschure, Paul F. M. J.
Generating complex, human-like behavior in a humanoid robot like the iCub requires the integration of a wide range of open source components and a scalable cognitive architecture. Hence, we present the iCub-HRI library which provides convenience wrappers for components related to perception (object recognition, agent tracking, speech recognition, and touch detection), object manipulation (basic and complex motor actions), and social interaction (speech synthesis and joint attention) exposed as a C++ library with bindings for Java (allowing to use iCub-HRI within Matlab) and Python. In addition to previously integrated components, the library allows for simple extension to new components and rapid prototyping by adapting to changes in interfaces between components. We also provide a set of modules which make use of the library, such as a high-level knowledge acquisition module and an action recognition module. The proposed architecture has been successfully employed for a complex human–robot interaction scenario involving the acquisition of language capabilities, execution of goal-oriented behavior and expression of a verbal narrative of the robot’s experience in the world. Accompanying this paper is a tutorial which allows a subset of this interaction to be reproduced. The architecture is aimed at researchers familiarizing themselves with the iCub ecosystem, as well as expert users, and we expect the library to be widely used in the iCub community., The research leading to these results has received funding under the European Union’s Seventh Framework Programme (FP/2007-2013)/ERC Grant Agreement n. FP7-ICT-612139 (WYSIWYD—What You Say Is What You Did) and FP7-ICT-270490 (EFAA—The Experimental Functional Android Assistant). PN was supported by a Marie Curie Early Stage Researcher Fellowship (H2020-MSCA-ITA, SECURE 642667). PV was supported by the ERC advanced grant 341196 (cDAC—Role of Consciousness in Adaptive Behavior).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Human vicarious trial and error is predictive of spatial navigation performance

  • Santos-Pata, Diogo
  • Verschure, Paul F. M. J.
When learning new environments, rats often pause at decision points and look back and forth over their possible trajectories as if they were imagining the future outcome of their actions, a behavior termed “Vicarious trial and error” (VTE). As the animal learns the environmental configuration, rats change from deliberative to habitual behavior, and VTE tends to disappear, suggesting a functional relevance in the early stages of learning. Despite the extensive research on spatial navigation, learning and VTE in the rat model, fewer studies have focused on humans. Here, we tested whether head-scanning behaviors that humans typically exhibit during spatial navigation are as predictive of spatial learning as in the rat. Subjects performed a goal-oriented virtual navigation task in a symmetric environment. Spatial learning was assessed through the analysis of trajectories, timings, and head orientations, under habitual and deliberative spatial navigation conditions. As expected, we found that trajectory length and duration decreased with the trial number, implying that subjects learned the spatial configuration of the environment over trials. Interestingly, IdPhi (a standard metric of VTE) also decreased with the trial number, suggesting that humans benefit from the same head-orientation scanning behavior as rats at spatial decision-points. Moreover, IdPhi captured exclusively at the first decision-point of each trial, was correlated with trial trajectory duration and length. Our findings demonstrate that in VTE is a signature of the stage of spatial learning in humans, and can be used to predict performance in navigation tasks with high accuracy., The research leading to these results has received funding from the European Research Council under the European Union's Seventh Framework Programme (FP7/20072013)/ERC grant agreement no (341196) cDAC.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

The Global dynamical complexity of the human brain network

  • Arsiwalla, Xerxes D.
  • Verschure, Paul F. M. J.
How much information do large brain networks integrate as a whole over the sum of their parts? Can the dynamical complexity of such networks be globally quantified in an information-theoretic way and be meaningfully coupled to brain function? Recently, measures of dynamical complexity such as integrated information have been proposed. However, problems related to the normalization and Bell number of partitions associated to these measures make these approaches computationally infeasible for large-scale brain networks. Our goal in this work is to address this problem. Our formulation of network integrated information is based on the Kullback-Leibler divergence between the multivariate distribution on the set of network states versus the corresponding factorized distribution over its parts. We find that implementing the maximum information partition optimizes computations. These methods are well-suited for large networks with linear stochastic dynamics. We compute the integrated information for both, the system’s attractor states, as well as non-stationary dynamical states of the network. We then apply this formalism to brain networks to compute the integrated information for the human brain’s connectome. Compared to a randomly re-wired network, we find that the specific topology of the brain generates greater information complexity., This work has been supported by the European Research Council’s CDAC project: “The Role of Consciousness in Adaptive Behavior: A Combined Empirical, Computational and Robot based Approach” (ERC-2013- ADG 341196).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Size matters: How scaling affects the interaction between grid and border cells

  • Santos-Pata, Diogo
  • Zucca, Riccardo
  • Low, Sock Ching
  • Verschure, Paul F. M. J.
Many hippocampal cell types are characterized by a progressive increase in scale along the dorsal-to-ventral axis, such as in the cases of head-direction, grid and place cells. Also located in the medial entorhinal cortex (MEC), border cells would be expected to benefit from such scale modulations. However, this phenomenon has not been experimentally observed. Grid cells in the MEC of mammals integrate velocity related signals to map the environment with characteristic hexagonal tessellation patterns. Due to the noisy nature of these input signals, path integration processes tend to accumulate errors as animals explore the environment, leading to a loss of grid-like activity. It has been suggested that border-to-grid cells' associations minimize the accumulated grid cells' error when rodents explore enclosures. Thus, the border-grid interaction for error minimization is a suitable scenario to study the effects of border cell scaling within the context of spatial representation. In this study, we computationally address the question of (i) border cells' scale from the perspective of their role in maintaining the regularity of grid cells' firing fields, as well as (ii) what are the underlying mechanisms of grid-border associations relative to the scales of both grid and border cells. Our results suggest that for optimal contribution to grid cells' error minimization, border cells should express smaller firing fields relative to those of the associated grid cells, which is consistent with the hypothesis of border cells functioning as spatial anchoring signals., The research leading to these results has received funding from the European Research Council under the European Union's Seventh Framework Programme (FP7/2007–2013)/ERC grant agreement no (341196) cDAC. H2020-SocSMC (socSMC-641321H2020-FETPROACT- 2014).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Self beyond the body: Action-driven and task-relevant purely distal cues modulate performance and body ownership

  • Grechuta, Klaudia
  • Ulysse, Laura
  • Rubio Ballester, Belén
  • Verschure, Paul F. M. J.
Our understanding of body ownership largely relies on the so-called Rubber Hand Illusion (RHI). In this paradigm, synchronous stroking of the real and the rubber hands leads to an illusion of ownership of the rubber hand provided that it is physically, anatomically, and spatially plausible. Self-attribution of an artificial hand also occurs during visuomotor synchrony. In particular, participants experience ownership over a virtual or a rubber hand when the visual feedback of self-initiated movements follows the trajectory of the instantiated motor commands, such as in the Virtual Hand Illusion (VHI) or the moving Rubber Hand Illusion (mRHI). Evidence yields that both when the cues are triggered externally (RHI) and when they result from voluntary actions (VHI and mRHI), the experience of ownership is established through bottom-up integration and top-down prediction of proximodistal cues (visuotactile or visuomotor) within the peripersonal space. It seems, however, that depending on whether the sensory signals are externally (RHI) or self-generated (VHI and mRHI), the top-down expectation signals are qualitatively different. On the one hand, in the RHI the sensory correlations are modulated by top-down influences which constitute empirically induced priors related to the internal (generative) model of the body. On the other hand, in the VHI and mRHI body ownership is actively shaped by processes which allow for continuous comparison between the expected and the actual sensory consequences of the actions. Ample research demonstrates that the differential processing of the predicted and the reafferent information is addressed by the central nervous system via an internal (forward) model or corollary discharge. Indeed, results from the VHI and mRHI suggest that, in action-contexts, the mechanism underlying body ownership could be similar to the forward model. Crucially, forward models integrate across all self-generated sensory signals including not only proximodistal (i.e., visuotactile or visuomotor) but also purely distal sensory cues (i.e., visuoauditory). Thus, if body ownership results from a consistency of a forward model, it will be affected by the (in)congruency of purely distal cues provided that they inform about action-consequences and are relevant to a goal-oriented task. Specifically, they constitute a corrective error signal. Here, we explicitly addressed this question. To test our hypothesis, we devised an embodied virtual reality-based motor task where action outcomes were signaled by distinct auditory cues. By manipulating the cues with respect to their spatial, temporal and semantic congruency, we show that purely distal (visuoauditory) feedback which violates predictions about action outcomes compromises both performance and body ownership. These results demonstrate, for the first time, that body ownership is influenced by not only externally and self-generated cues which pertain to the body within the peripersonal space but also those arising outside of the body. Hence, during goal-oriented tasks body ownership may result from the consistency of forward models., This research has been supported by the MINECO Retos Investigacion I+D+I, Plan Nacional project, SANAR (Gobierno de Espana) under agreement TIN2013–44200–REC, FPI grant nr. BES–2014–068791, and also European Research Council under grant agreement 341196 (CDAC).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

A spatial-context effect in recognition memory

  • Pacheco, Daniel
  • Sánchez Fibla, Martí
  • Duff, Armin
  • Verschure, Paul F. M. J.
We designed a novel experiment to investigate the modulation of human recognition memory by environmental context. Human participants were asked to navigate through a four-arm Virtual Reality (VR) maze in order to find and memorize discrete items presented at specific locations in the environment. They were later on tested on their ability to recognize items as previously presented or new. By manipulating the spatial position of half of the studied items during the testing phase of our experiment, we could assess differences in performance related to the congruency of environmental information at encoding and retrieval. Our results revealed that spatial context had a significant effect on the quality of memory. In particular, we found that recognition performance was significantly better in trials in which contextual information was congruent as opposed to those in which it was different. Our results are in line with previous studies that have reported spatial-context effects in recognition memory, further characterizing their magnitude under ecologically valid experimental conditions., The research leading to these results has received funding from the ERC grant agreement n° 341196 (CDAC).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Challenging the boundaries of the physical self: distal cues impact body ownership

  • Grechuta, Klaudia
  • Torre Costa, Javier de la
  • Rubio Ballester, Belén
  • Verschure, Paul F. M. J.
The unique ability to identify one’s own body and experience it as one’s own is fundamental in goal-oriented behavior and survival. However, the mechanisms underlying the so-called body ownership are yet not fully understood. Evidence based on Rubber Hand Illusion (RHI) paradigms has demonstrated that body ownership is a product of reception and integration of self and externally generated multisensory information, feedforward and feedback processing of sensorimotor signals, and prior knowledge about the body. Crucially, however, these designs commonly involve the processing of proximal modalities while the contribution of distal sensory signals to the experience of ownership remains elusive. Here we propose that, like any robust percept, body ownership depends on the integration and prediction across all sensory modalities, including distal sensory signals pertaining to the environment. To test our hypothesis, we created an embodied goal-oriented Virtual Air Hockey Task, in which participants were to hit a virtual puck into a goal. In two conditions, we manipulated the congruency of distal multisensory cues (auditory and visual) while preserving proximal and action-driven signals entirely predictable. Compared to a fully congruent condition, our results revealed a significant decrease on three dimensions of ownership evaluation when distal signals were incongruent, including the subjective report as well as physiological and kinematic responses to an unexpected threat. Together, these findings support the notion that the way we represent our body is contingent upon all the sensory stimuli, including distal and action-independent signals. The present data extend the current framework of body ownership and may also find applications in rehabilitation scenarios., This study was supported by ReHyb ID 871767 and EIT Health ID 19277 (RGS@HOME) under H2020, cDAC (ERC-2013-ADG-341196), FPI Grant No. BES2014068791.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Spectral modes of network dynamics reveal increased informational complexity near criticality

  • Arsiwalla, Xerxes D.
  • Martinez Mediano, Pedro Antonio
  • Verschure, Paul F. M. J.
What does the informational complexity of dynamical networked systems tell us about intrinsic mechanisms and functions of these complex systems? Recent complexity measures such as integrated information have sought to operationalize this problem taking a whole-versus-parts perspective, wherein one explicitly computes the amount of information generated by a network as a whole over and above that generated by the sum of its parts during state transitions. While several numerical schemes for estimating network integrated information exist, it is instructive to pursue an analytic approach that computes integrated information as a function of network weights. Our formulation of integrated information uses a Kullback-Leibler divergence between the multi-variate distribution on the set of network states versus the corresponding factorized distribution over its parts. Implementing stochastic Gaussian dynamics, we perform computations for several prototypical network topologies. Our findings show increased informational complexity near criticality, which remains consistent across network topologies. Spectral decomposition of the system’s dynamics reveals how informational complexity is governed by eigenmodes of both, the network’s covariance and adjacency matrices. We find that as the dynamics of the system approach criticality, high integrated information is exclusively driven by the eigenmode corresponding to the leading eigenvalue of the covariance matrix, while sub-leading modes get suppressed. The implication of this result is that it might be favorable for complex dynamical networked systems such as the human brain or communication systems to operate near criticality so that efficient information integration might be achieved., This work has been supported by the European Research Council’s CDAC project: ”The Role of Consciousness in Adaptive Behavior: A Combined Empirical, Computational and Robot based Approach” (ERC-2013- ADG 341196).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Effect of specific over nonspecific VR-based rehabilitation on poststroke motor recovery: A systematic meta-analysis

  • Maier, Martina
  • Rubio Ballester, Belén
  • Duff, Armin
  • Duarte Oller, Esther
  • Verschure, Paul
Background. Despite the rise of virtual reality (VR)-based interventions in stroke rehabilitation over the past decade, no consensus has been reached on its efficacy. This ostensibly puzzling outcome might not be that surprising given that VR is intrinsically neutral to its use—that is, an intervention is effective because of its ability to mobilize recovery mechanisms, not its technology. As VR systems specifically built for rehabilitation might capitalize better on the advantages of technology to implement neuroscientifically grounded protocols, they might be more effective than those designed for recreational gaming. Objective. We evaluate the efficacy of specific VR (SVR) and nonspecific VR (NSVR) systems for rehabilitating upper-limb function and activity after stroke. Methods. We conducted a systematic search for randomized controlled trials with adult stroke patients to analyze the effect of SVR or NSVR systems versus conventional therapy (CT). Results. We identified 30 studies including 1473 patients. SVR showed a significant impact on body function (standardized mean difference [SMD] = 0.23; 95% CI = 0.10 to 0.36; P = .0007) versus CT, whereas NSVR did not (SMD = 0.16; 95% CI = −0.14 to 0.47; P = .30). This result was replicated in activity measures. Conclusions. Our results suggest that SVR systems are more beneficial than CT for upper-limb recovery, whereas NSVR systems are not. Additionally, we identified 6 principles of neurorehabilitation that are shared across SVR systems and are possibly responsible for their positive effect. These findings may disambiguate the contradictory results found in the current literature.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Connectomics to semantomics: addressing the brain's big data challenge

  • Arsiwalla, Xerxes D.
  • Dalmazzo, David
  • Zucca, Riccardo
  • Betella, Alberto
  • Brandi Hernández, Santiago
  • Martínez Bueno, Enrique
  • Omedas, Pedro
  • Verschure, Paul F. M. J.
Can semantic corpora be coupled to dynamical simulations in such a way so as to extract new associations from the data that were hitherto unapparent? We attempt to do this within neuroscience as an application domain, by introducing the notion of the semantome and coupling it to the connectome of the human brain network. This is implemented using BrainX3, a virtual reality simulation cum data mining platform that can be used for visualization, analysis and feature extraction of neuroscience data. We use this system to explore anatomical, functional and symptomatic semantics associated to simulated neuronal activity of a healthy brain, one with stroke and one perturbed by transcranial magnetic stimulation. In particular, we find that parietal and occipital lesions in stroke affect the visual processing pathway leading to symptoms such as visual neglect, depression and photo-sensitivity seizures. Integrating semantomics with connectomics thus generates hypotheses about symptoms, functions and brain activity that supplement existing tools for diagnosis of mental illness. Our results suggest a new approach to big data with potential applications to other domains., We thank Olaf Sporns and Chris Honey for sharing the DSI data. Research supported by CEEDS (FP7-ICT-2009-5) & CDAC (ERC-2013-ADG 341196) projects.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Erratum to: the visual amplification of goal-oriented movements counteracts acquired non-use in hemiparetic stroke patients

  • Rubio Ballester, Belén
  • Nirme, Jens
  • Duarte Oller, Esther
  • Cuxart, Ampar
  • Rodriguez, Susana
  • Verschure, Paul F. M. J.
  • Duff, Armin
BACKGROUND: Stroke-induced impairments result from both primary and secondary causes, i.e. damage to the brain and the acquired non-use of the impaired limbs. Indeed, stroke patients often under-utilize their paretic limb despite sufficient residual motor function. We hypothesize that acquired non-use can be overcome by reinforcement-based training strategies. METHODS: Hemiparetic stroke patients (n = 20, 11 males, 9 right-sided hemiparesis) were asked to reach targets appearing in either the real world or in a virtual environment. Sessions were divided into 3 phases: baseline, intervention and washout. During the intervention the movement of the virtual representation of the patients' paretic limb was amplified towards the target. RESULTS: We found that the probability of using the paretic limb during washout was significantly higher in comparison to baseline. Patients showed generalization of these results by displaying a more substantial workspace in real world task. These gains correlated with changes in effector selection patterns. CONCLUSIONS: The amplification of the movement of the paretic limb in a virtual environment promotes the use of the paretic limb in stroke patients. Our findings indicate that reinforcement-based therapies may be an effective approach for counteracting learned non-use and may modulate motor performance in the real world., This project was supported through ERC project cDAC (FP7-IDEAS-ERC 341196), EC H2020 project socSMCs (H2020-EU.1.2.2. 641321) and MINECO project SANAR (Gobierno de España).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

A critical time window for recovery extends beyond one-year post-stroke

  • Rubio Ballester, Belén
  • Maier Martina
  • Duff, Armin
  • Cameirão, Mónica
  • Bermúdez i Badia, Sergi
  • Duarte Oller, Esther
  • Cuxart, Ampar
  • Rodriguez, Susana
  • San Segundo Mozo, Rosa María
  • Verschure, Paul F. M. J.
The impact of rehabilitation on post-stroke motor recovery and its dependency on the patient's chronicity remain unclear. The field has widely accepted the notion of a proportional recovery rule with a "critical window for recovery" within the first 3-6 mo poststroke. This hypothesis justifies the general cessation of physical therapy at chronic stages. However, the limits of this critical window have, so far, been poorly defined. In this analysis, we address this question, and we further explore the temporal structure of motor recovery using individual patient data from a homogeneous sample of 219 individuals with mild to moderate upper-limb hemiparesis. We observed that improvement in body function and structure was possible even at late chronic stages. A bootstrapping analysis revealed a gradient of enhanced sensitivity to treatment that extended beyond 12 mo poststroke. Clinical guidelines for rehabilitation should be revised in the context of this temporal structure. NEW & NOTEWORTHY Previous studies in humans suggest that there is a 3- to 6-mo "critical window" of heightened neuroplasticity poststroke. We analyze the temporal structure of recovery in patients with hemiparesis and uncover a precise gradient of enhanced sensitivity to treatment that expands far beyond the limits of the so-called critical window. These findings highlight the need for providing therapy to patients at the chronic and late chronic stages.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

The morphospace of consciousness: three kinds of complexity for minds and machines

  • Arsiwalla, Xerxes D.
  • Solé Vicente, Ricard, 1962-
  • Moulin-Frier, Clément
  • Herreros, Ivan
  • Sánchez-Fibla, Martí
  • Verschure, Paul F. M. J.
In this perspective article, we show that a morphospace, based on information-theoretic measures, can be a useful construct for comparing biological agents with artificial intelligence (AI) systems. The axes of this space label three kinds of complexity: (i) autonomic, (ii) computational and (iii) social complexity. On this space, we map biological agents such as bacteria, bees, C. elegans, primates and humans; as well as AI technologies such as deep neural networks, multi-agent bots, social robots, Siri and Watson. A complexity-based conceptualization provides a useful framework for identifying defining features and classes of conscious and intelligent systems. Starting with cognitive and clinical metrics of consciousness that assess awareness and wakefulness, we ask how AI and synthetically engineered life-forms would measure on homologous metrics. We argue that awareness and wakefulness stem from computational and autonomic complexity. Furthermore, tapping insights from cognitive robotics, we examine the functional role of consciousness in the context of evolutionary games. This points to a third kind of complexity for describing consciousness, namely, social complexity. Based on these metrics, our morphospace suggests the possibility of additional types of consciousness other than biological; namely, synthetic, group-based and simulated. This space provides a common conceptual framework for comparing traits and highlighting design principles of minds and machines., This research was funded by the European Research Council’s CDAC project: “The Role of Consciousness in Adaptive Behavior: A Combined Empirical, Computational and Robot based Approach” (ERC-2013- ADG 341196).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Measuring the complexity of consciousness

  • Arsiwalla, Xerxes D.
  • Verschure, Paul F. M. J.
The grand quest for a scientific understanding of consciousness has given rise to many new theoretical and empirical paradigms for investigating the phenomenology of consciousness as well as clinical disorders associated to it. A major challenge in this field is to formalize computational measures that can reliably quantify global brain states from data. In particular, information-theoretic complexity measures such as integrated information have been proposed as measures of conscious awareness. This suggests a new framework to quantitatively classify states of consciousness. However, it has proven increasingly difficult to apply these complexity measures to realistic brain networks. In part, this is due to high computational costs incurred when implementing these measures on realistically large network dimensions. Nonetheless, complexity measures for quantifying states of consciousness are important for assisting clinical diagnosis and therapy. This article is meant to serve as a lookup table of measures of consciousness, with particular emphasis on clinical applicability. We consider both, principle-based complexity measures as well as empirical measures tested on patients. We address challenges facing these measures with regard to realistic brain networks, and where necessary, suggest possible resolutions., This work has been supported by the European Research Council's CDAC project: The Role of Consciousness in Adaptive Behavior: A Combined Empirical, Computational and Robot based Approach (ERC-2013- ADG 341196).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Discrepancies between multi-electrode LFP and CSD phase-patterns: A forward modeling study

  • Hindriks, Rikkert
  • Arsiwalla, Xerxes D.
  • Panagiotaropoulos, Theofanis I.
  • Besserve, Michel
  • Verschure, Paul F. M. J.
  • Logothetis, Nikos
  • Deco, Gustavo
Multi-electrode recordings of local field potentials (LFPs) provide the opportunity to investigate the spatiotemporal organization of neural activity on the scale of several millimeters. In particular, the phases of oscillatory LFPs allow studying the coordination of neural oscillations in time and space and to tie it to cognitive processing. Given the computational roles of LFP phases, it is important to know how they relate to the phases of the underlying current source densities (CSDs) that generate them. Although CSDs and LFPs are distinct physical quantities, they are often (implicitly) identified when interpreting experimental observations. That this identification is problematic is clear from the fact that LFP phases change when switching to different electrode montages, while the underlying CSD phases remain unchanged. In this study we use a volume-conductor model to characterize discrepancies between LFP and CSD phase-patterns, to identify the contributing factors, and to assess the effect of different electrode montages. Although we focus on cortical LFPs recorded with two-dimensional (Utah) arrays, our findings are also relevant for other electrode configurations. We found that the main factors that determine the discrepancy between CSD and LFP phase-patterns are the frequency of the neural oscillations and the extent to which the laminar CSD profile is balanced. Furthermore, the presence of laminar phase-differences in cortical oscillations, as commonly observed in experiments, precludes identifying LFP phases with those of the CSD oscillations at a given cortical depth. This observation potentially complicates the interpretation of spike-LFP coherence and spike-triggered LFP averages. With respect to reference strategies, we found that the average-reference montage leads to larger discrepancies between LFP and CSD phases as compared with the referential montage, while the Laplacian montage reduces these discrepancies. We therefore advice to conduct analysis of two-dimensional LFP recordings using the Laplacian montage., RH and GD were funded by the European Research Council (Advanced Grant DYSTRUCTURE No. 295129), the Spanish Research Project PSI2013-42091-P, the CONSOLIDER-INGENIO 2010 Program CSD2007-00012, and the FP7-ICT Brainscales (269921). XA and PV are supported by the European Research Council's CDAC project: “The Role of Consciousness in Adaptive Behavior: A Combined Empirical, Computational and Robot based Approach” (ERC-2013- ADG 341196).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Motor cost influences perceptual decisions

  • Marcos Sanmartín, Encarni
  • Cos Aguilera, Ignasi
  • Girard, Benoît
  • Verschure, Paul F. M. J.
Perceptual decision making has been widely studied using tasks in which subjects are asked to discriminate a visual stimulus and instructed to report their decision with a movement. In these studies, performance is measured by assessing the accuracy of the participants’ choices as a function of the ambiguity of the visual stimulus. Typically, the reporting movement is considered as a mere means of reporting the decision with no influence on the decision-making process. However, recent studies have shown that even subtle differences of biomechanical costs between movements may influence how we select between them. Here we investigated whether this purely motor cost could also influence decisions in a perceptual discrimination task in detriment of accuracy. In other words, are perceptual decisions only dependent on the visual stimulus and entirely orthogonal to motor costs? Here we show the results of a psychophysical experiment in which human subjects were presented with a random dot motion discrimination task and asked to report the perceived motion direction using movements of different biomechanical cost. We found that the pattern of decisions exhibited a significant bias towards the movement of lower cost, even when this bias reduced performance accuracy. This strongly suggests that motor costs influence decision making in visual discrimination tasks for which its contribution is neither instructed nor beneficial., This work was supported by the EU FP7 framework under grant agreements no FP7-ICT-270108 - Goal-Leaders, FP7-ICT-270212 - eSMC and ERC-341196 - CDAC (PV) and Ville de Paris HABOT-Project grant (IC & BG).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Consensus paper: towards a systems-level view of cerebellar function: the interplay between cerebellum, basal ganglia, and cortex

  • Caligiore, Daniele
  • Pezzulo, Giovanni
  • Baldassarre, Gianluca
  • Bostan, Andreea C.
  • Strick, Peter L.
  • Doya, Kenji
  • Helmich, Rick C.
  • Dirkx, Michiel
  • Houk, James
  • Jörntell, Henrik
  • Lago-Rodriguez, Angel
  • Galea, Joseph M.
  • Miall, R. Chris
  • Popa, Traian
  • Kishore, Asha
  • Verschure, Paul F. M. J.
  • Zucca, Riccardo
  • Herreros, Ivan
Despite increasing evidence suggesting the cerebellum works in concert with the cortex and basal ganglia, the nature of the reciprocal interactions between these three brain regions remains unclear. This consensus paper gathers diverse recent views on a variety of important roles played by the cerebellum within the cerebello-basal ganglia-thalamo-cortical system across a range of motor and cognitive functions. The paper includes theoretical and empirical contributions, which cover the following topics: recent evidence supporting the dynamical interplay between cerebellum, basal ganglia, and cortical areas in humans and other animals; theoretical neuroscience perspectives and empirical evidence on the reciprocal influences between cerebellum, basal ganglia, and cortex in learning and control processes; and data suggesting possible roles of the cerebellum in basal ganglia movement disorders. Although starting from different backgrounds and dealing with different topics, all the contributors agree that viewing the cerebellum, basal ganglia, and cortex as an integrated system enables us to understand the function of these areas in radically different ways. In addition, there is unanimous consensus between the authors that future experimental and computational work is needed to understand the function of cerebellar-basal ganglia circuitry in both motor and non-motor functions. The paper reports the most advanced perspectives on the role of the cerebellum within the cerebello-basal ganglia-thalamo-cortical system and illustrates other elements of consensus as well as disagreements and open questions in the field., The present research was supported by the European Commission 7th Framework Programme (FP7/2007-2013), “Challenge 2—Cognitive Systems, Interaction, Robotics,” grant agreement No. ICT IP-231722, project “IM-CLeVeR—Intrinsically Motivated Cumulative Learning Versatile Robots” to D. Caligiore; by the Human Frontier Science Program (HFSP), award number RGY0088/2014 to G. Pezzulo; in parts by funds from the Office of Research and Development, Medical Research Service, Department of Veterans Affairs and National Institutes of Health Grants R01 NS24328, R01 MH56661, P40 OD010996, and P30 NS076405 to P. L. Strick; by the European Research Council project MotMotLearn (637488) to J. Galea; by the MRC (grant R/J012610/1) to R.C. Miall and Wellcome Trust, grant WT087554 to R.C. Miall and A. Lago-Rodriguez; by the European Research Council under the European Union’s Seventh Framework Programme (FP7/2007-2013)/ERC grant agreement no. 341196 to P. F. M. J. Verschure; and by the European Commission’s Horizon 2020 socSMC (under agreement number socSMC-641321H2020-FETPROACT-2014) to I. Herreros. We thank the two anonymous reviewers and Professor Michael A. Arbib who have contributed to enhance the quality of this consensus paper with precious comments.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Coordinated representational reinstatement in the human hippocampus and lateral temporal cortex during episodic memory retrieval

  • Pacheco Estefan, D.
  • Sánchez Fibla, Martí
  • Duff, Armin
  • Principe, Alessandro
  • Rocamora Zúñiga, Rodrigo Alberto
  • Zhang, Hui
  • Axmacher, Nikolai
  • Verschure, Paul F. M. J.
Theoretical models of episodic memory have proposed that retrieval depends on interactions between the hippocampus and neocortex, where hippocampal reinstatement of item-context associations drives neocortical reinstatement of item information. Here, we simultaneously recorded intracranial EEG from hippocampus and lateral temporal cortex (LTC) of epilepsy patients who performed a virtual reality spatial navigation task. We extracted stimulus-specific representations of both item and item-context associations from the time-frequency patterns of activity in hippocampus and LTC. Our results revealed a double dissociation of representational reinstatement across time and space: an early reinstatement of item-context associations in hippocampus preceded a later reinstatement of item information in LTC. Importantly, reinstatement levels in hippocampus and LTC were correlated across trials, and the quality of LTC reinstatement was predicted by the magnitude of phase synchronization between hippocampus and LTC. These findings confirm that episodic memory retrieval in humans relies on coordinated representational interactions within a hippocampal-neocortical network., The research leading to these results has received funding from the ERC grant agreement n° 341196 (CDAC). N.A. received funding by the Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) – Projektnummer 316803389 – SFB 1280 as well as via Projektnummer 122679504 – SFB 874. M.S. received funding by Spanish National Project INSOCO-DPI2016-80116-P.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Estimating upper-extremity function from kinematics in stroke patients following goal-oriented computer-based training

  • Rubio Ballester, Belén
  • Antenucci, Fabrizio
  • Maier, Martina
  • Coolen, Anthony C. C.
  • Verschure, Paul F. M. J.
Introduction: After a stroke, a wide range of deficits can occur with varying onset latencies. As a result, assessing impairment and recovery are enormous challenges in neurorehabilitation. Although several clinical scales are generally accepted, they are time-consuming, show high inter-rater variability, have low ecological validity, and are vulnerable to biases introduced by compensatory movements and action modifications. Alternative methods need to be developed for efficient and objective assessment. In this study, we explore the potential of computer-based body tracking systems and classification tools to estimate the motor impairment of the more affected arm in stroke patients. Methods: We present a method for estimating clinical scores from movement parameters that are extracted from kinematic data recorded during unsupervised computer-based rehabilitation sessions. We identify a number of kinematic descriptors that characterise the patients’ hemiparesis (e.g., movement smoothness, work area), we implement a double-noise model and perform a multivariate regression using clinical data from 98 stroke patients who completed a total of 191 sessions with RGS. Results: Our results reveal a new digital biomarker of arm function, the Total Goal-Directed Movement (TGDM), which relates to the patients work area during the execution of goal-oriented reaching movements. The model’s performance to estimate FM-UE scores reaches an accuracy of R2: 0.38 with an error (σ: 12.8). Next, we evaluate its reliability (r = 0.89 for test-retest), longitudinal external validity (95% true positive rate), sensitivity, and generalisation to other tasks that involve planar reaching movements (R2: 0.39). The model achieves comparable accuracy also for the Chedoke Arm and Hand Activity Inventory (R2: 0.40) and Barthel Index (R2: 0.35). Conclusions: Our results highlight the clinical value of kinematic data collected during unsupervised goal-oriented motor training with the RGS combined with data science techniques, and provide new insight into factors underlying recovery and its biomarkers., This study was supported by the European Commission (EC), the European Research Council under Grant agreement 341196 (cDAC), EC H2020 project socSMCs (H2020EU.1.2.2. 641321), and by the RGS@home, EIT Health project 19277. EIT Health is supported by EIT, a body of the European Union.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

The impact of cortical lesions on thalamo-cortical network dynamics after acute ischaemic stroke: a combined experimental and theoretical study

  • Van Wijngaarden, Joeri B. G.
  • Zucca, Riccardo
  • Finnigan, Simon
  • Verschure, Paul F. M. J.
The neocortex and thalamus provide a core substrate for perception, cognition, and action, and are interconnected through different direct and indirect pathways that maintain specific dynamics associated with functional states including wakefulness and sleep. It has been shown that a lack of excitation, or enhanced subcortical inhibition, can disrupt this system and drive thalamic nuclei into an attractor state of low-frequency bursting and further entrainment of thalamo-cortical circuits, also called thalamo-cortical dysrhythmia (TCD). The question remains however whether similar TCD-like phenomena can arise with a cortical origin. For instance, in stroke, a cortical lesion could disrupt thalamo-cortical interactions through an attenuation of the excitatory drive onto the thalamus, creating an imbalance between excitation and inhibition that can lead to a state of TCD. Here we tested this hypothesis by comparing the resting-state EEG recordings of acute ischaemic stroke patients (N = 21) with those of healthy, age-matched control-subjects (N = 17). We observed that these patients displayed the hallmarks of TCD: a characteristic downward shift of dominant α-peaks in the EEG power spectra, together with increased power over the lower frequencies (δ and θ-range). Contrary to general observations in TCD, the patients also displayed a broad reduction in β-band activity. In order to explain the genesis of this stroke-induced TCD, we developed a biologically constrained model of a general thalamocortical module, allowing us to identify the specific cellular and network mechanisms involved. Our model showed that a lesion in the cortical component leads to sustained cell membrane hyperpolarization in the corresponding thalamic relay neurons, that in turn leads to the de-inactivation of voltage-gated T-type Ca2+-channels, switching neurons from tonic spiking to a pathological bursting regime. This thalamic bursting synchronises activity on a population level through divergent intrathalamic circuits, and entrains thalamo-cortical pathways by means of propagating low-frequency oscillations beyond the restricted region of the lesion. Hence, pathological stroke-induced thalamo-cortical dynamics can be the source of diaschisis, and account for the dissociation between lesion location and non-specific symptoms of stroke such as neuropathic pain and hemispatial neglect., This work was supported by the European Research Council under the European Union's Seventh Framework Programme FP7/2007-2013/ERC grant agreement n. 341196 [CDAC], and the Research and Technological Development Programme FP7-ICT-612139 in the WYSIWYD project to PFMJV. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.