Pasar al contenido principal

Resultados relacionados

Resultados totales (Incluyendo duplicados): 141
Encontrada(s) 2 página(s)

Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

How anatomy shapes dynamics: a semi-analytical study of the brain at rest by a simple spin model

  • Deco, Gustavo
  • Senden, Mario
  • Jirsa, Viktor K.
Resting state networks (RSNs) show a surprisingly coherent and robust spatiotemporal/norganization. Previous theoretical studies demonstrated that these patterns can be/nunderstood as emergent on the basis of the underlying neuroanatomical connectivity/nskeleton. Integrating the biologically realistic DTI/DSI-(Diffusion Tensor Imaging/Diffusion/nSpectrum Imaging)based neuroanatomical connectivity into a brain model of Ising/nspin dynamics, we found a system with multiple attractors, which can be studied/nanalytically. The multistable attract/nor landscape thus defines a functionally meaningful/ndynamic repertoire of the brain network that is inherently present in the neuroanatomical/nconnectivity. We demonstrate that the more entropy of attractors exists, the richer is the/ndynamical repertoire and consequently the brain network displays more capabilities of/ncomputation. We hypothesize therefore tha/nt human brain connectivity developed a scale/nfree type of architecture in order to be able to store a large number of different and flexibly/naccessible brain functions., Gustavo Deco was supported by the Spanish Research/nProject SAF2010-16085 and by the CONSOLIDER-INGENIO/n2010 Programme CSD2007-00012. The research reported/nherein was supported by the ERC Advanced Grant:/nDYSTRUCTURE, by the Brain Network Recovery Group/nthrough the James S. McDonnell Foundation and the FP7-ICT/nBrainScales.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Changes of mind in an attractor network of decision-making

  • Albantakis, Larissa
  • Deco, Gustavo
Attractor networks successfully account for psychophysical and neurophysiological data in various decision-making tasks./nEspecially their ability to model persistent activity, a property of many neurons involved in decision-making, distinguishes/nthem from other approaches. Stable decision attractors are, however, counterintuitive to changes of mind. Here we/ndemonstrate that a biophysically-realistic attractor network with spiking neurons, in its itinerant transients towards the/nchoice attractors, can replicate changes of mind observed recently during a two-alternative random-dot motion (RDM) task./nBased on the assumption that the brain continues to evaluate available evidence after the initiation of a decision, the/nnetwork predicts neural activity during changes of mind and accurately simulates reaction times, performance and/npercentage of changes dependent on difficulty. Moreover, the model suggests a low decision threshold and high incoming/nactivity that drives the brain region involved in the decision-making process into a dynamical regime close to a bifurcation,/nwhich up to now lacked evidence for physiological relevance. Thereby, we further affirmed the general conformance of/nattractor networks with higher level neural processes and offer experimental predictions to distinguish nonlinear attractor/nfrom linear diffusion models., The authors were supported by the Spanish Research Project BFU2007-61710/BFI and CONSOLIDER-INGENIO 2010 Programme CSD2007-00012 (“Bilingualism and Cognitive Neuroscience”). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Perceiving incredulity: the role of intonation and facial gestures

  • Crespo Sendra, Verònica
  • Kaland, Constantijn
  • Swerts, Marc
  • Prieto Vives, Pilar, 1965-
Recently, some studies have revealed that facial gestures can play an important role in teasing out the meaning of interrogative sentence types in a particular language (Srinivasan and Massaro, 2003 and Borràs-Comes and Prieto, 2011; among others). However, less is known about potential cross-linguistic differences. This paper investigates the interaction between facial gestures and intonation in the distinction between information-seeking and incredulity yes/no questions in two languages (i.e., Catalan and Dutch) which use different prosodic strategies to express the distinction between these two types of interrogatives. While Dutch uses two phonologically distinct intonational contours, Catalan uses the same pitch contour with a distinction in pitch range. Twenty listeners of Catalan and twenty listeners of Dutch performed a perception experiment with audio-only, video-only, and audiovisual stimuli in congruent and incongruent intonation and gestural combinations. The results reveal that there is a contrast between Dutch and Catalan listeners in the perceptual processing of these sentences. While Dutch participants rely more on intonational differences, Catalan participants use the facial expression cues to a greater extent. All in all, the results show that both languages express pragmatic contrasts both at the intonation and facial expression levels, and native speakers are highly sensitive to the relative weight of these cues at the perceptual level., Parts of this paper were presented at the Phonetics and Phonology in Iberia Conference, 21–23 June 2011, at Universitat Rovira i Virgili in Tarragona (Spain). We are grateful to the audience at this conference for their helpful comments and discussion, especially Carlos Gussenhoven, and to the GrEP group for their help and comments. This research has been funded by projects FFI2009-07648/FILO and by the CONSOLIDER-INGENIO 2010 Programme CSD2007-00012 (both awarded by the Ministerio de Ciencia e Innovación), by project 2009 SGR 701 (awarded by the Generalitat de Catalunya) and by the Atles interactiu de l’entonació del valencià (awarded by the Acadèmia Valenciana de la Llengua).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Neural network mechanisms underlying stimulus driven variability reduction

  • Deco, Gustavo
  • Hugues, Etienne
It is well established that the variability of the neural activity across trials, as measured by the Fano factor, is elevated. This/nfact poses limits on information encoding by the neural activity. However, a series of recent neurophysiological experiments/nhave changed this traditional view. Single cell recordings across a variety of species, brain areas, brain states and stimulus/nconditions demonstrate a remarkable reduction of the neural variability when an external stimulation is applied and when/nattention is allocated towards a stimulus within a neuron’s receptive field, suggesting an enhancement of information/nencoding. Using an heterogeneously connected neural network model whose dynamics exhibits multiple attractors, we/ndemonstrate here how this variability reduction can arise from a network effect. In the spontaneous state, we show that the/nhigh degree of neural variability is mainly due to fluctuation-driven excursions from attractor to attractor. This occurs when,/nin the parameter space, the network working point is around the bifurcation allowing multistable attractors. The application/nof an external excitatory drive by stimulation or attention stabilizes one specific attractor, eliminating in this way the/ntransitions between the different attractors and resulting in a net decrease in neural variability over trials. Importantly, nonresponsive/nneurons also exhibit a reduction of variability. Finally, this reduced variability is found to arise from an increased/nregularity of the neural spike trains. In conclusion, these results suggest that the variability reduction under stimulation and/nattention is a property of neural circuits., The research leading to these results has received funding from the European Union Seventh Framework Programme (FP7/2007–2013) under grant agreements HEALTH F2 2008 200728 (Brainsync) and no. 269921 (BrainScaleS), from the Spanish Research Project SAF2010-16085 and from the CONSOLIDER-INGENIO 2010 Programme CSD2007-00012. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

The impact of early bilingualism on controlling a language learned late: an ERP study

  • Martin, Clara D.
  • Strijkers, Kristof
  • Santesteban, Mikel
  • Escera, Carles
  • Hartsuiker, Robert J.
  • Costa, Albert, 1970-
This study asks whether early bilingual speakers who have already developed a language control mechanism to handle two languages control a dominant and a late acquired language in the same way as late bilingual speakers. We therefore, compared event-related potentials in a language switching task in two groups of participants switching between a dominant (L1) and a weak late acquired language (L3). Early bilingual late learners of an L3 showed a different ERP pattern (larger N2 mean amplitude) as late bilingual late learners of an L3. Even though the relative strength of languages was similar in both groups (a dominant and a weak late acquired language), they controlled their language output in a different manner. Moreover, the N2 was similar in two groups of early bilinguals tested in languages of different strength. We conclude that early bilingual learners of an L3 do not control languages in the same way as late bilingual L3 learners –who have not achieved native-like proficiency in their L2– do. This difference might explain some of the advantages early bilinguals have when learning new languages., This work was supported by grants from the Spanish Government/n(PSI2011-23033, Consolider Ingenio 2010 CSD2007-00012) and/nthe Catalan Government (Consolidado SGR 2009-1521). Clara/nD. Martin was supported by the Spanish Government (Grant/nJuan de la Cierva) and is now supported by the IKERBASQUE/nfoundation for science and the Basque Center on Cognition,/nBrain and Language. Mikel Santesteban was supported by the/nBasque Government (IT665-13). Carles Escera was awarded by/nthe ICREA Academia Distinguished Professorship.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Effective reduced diffusion-models: a data driven approach to the analysis of neuronal dynamics

  • Deco, Gustavo
  • Martí, Daniel
  • Ledberg, Anders
  • Reig, Ramon
  • Sanchez-Vives, Maria V.
We introduce in this paper a new method for reducing neurodynamical data to an effective diffusion equation, either experimentally or using simulations of biophysically detailed models. The dimensionality of the data is first reduced to the first principal component, and then fitted by the stationary solution of a mean-field-like one-dimensional Langevin equation, which describes the motion of a Brownian particle in a potential. The advantage of such description is that the stationary probability density of the dynamical variable can be easily derived. We applied this method to the analysis of cortical network dynamics during up and down states in an anesthetized animal. During deep anesthesia, intracellularly recorded up and down states transitions occurred with high regularity and could not be adequately described by a onedimensional diffusion equation. Under lighter anesthesia, however, the distributions of the times spent in the up and down states were better fitted by such a model, suggesting a role for noise in determining the time spent in a particular state., This work was supported by the Spanish Ministry of Science (Spanish Research Project BFU2007-61710, and CONSOLIDER CSD2007-00012). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Is prosodic development correlated with grammatical and lexical development?: evidence from emerging intonation in Catalan and Spanish

  • Prieto Vives, Pilar, 1965-
  • Estrella, Ana
  • Thorson, Jill C.
  • Vanrell, Maria del Mar
This investigation focuses on the development of intonation patterns in four Catalan-speaking children and two Spanish-speaking children between 0 ; 11 and 2 ; 4. Pitch contours were prosodically analyzed within the Autosegmental Metrical framework in all meaningful utterances, for a total of 6558 utterances. The pragmatic meaning and communicative function were also assessed. Three main conclusions arise from the results. First, the study shows that the Autosegmental Metrical model can be successfully used to transcribe early intonation contours. Second, results reveal that children's emerging intonation is largely independent of grammatical development, and generally it develops well before the appearance of two-word combinations. As for the relationship between lexical and intonational development, the data show that the emergence of intonational grammar is related to the onset of speech and the presence of a small lexicon. Finally, we discuss the implications of these results for the biological hypothesis of intonational production., This research was supported by grants FFI2009-07648/ FILO and CONSOLIDER-INGENIO 2010 ‘Bilingüismo y Neurociencia Cognitiva CSD2007-00012’ awarded by the Spanish Ministry of Science and Innovation and by project 2009 SGR 701 awarded by the Generalitat de Catalunya.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Age-related sensitive periods influence visual language discrimination in adults

  • Weikum, Whitney M.
  • Vouloumanos, Athena
  • Navarra, Jordi
  • Soto-Faraco, Salvador, 1970-
  • Sebastián Gallés, Núria
  • Werker, Janet F.
Adults as well as infants have the capacity to discriminate languages based on visual speech alone. Here, we investigated whether adults' ability to discriminate languages based on visual speech cues is influenced by the age of language acquisition. Adult participants who had all learned English (as a first or second language) but did not speak French were shown faces of bilingual (French/English) speakers silently reciting sentences in either language. Using only visual speech information, adults who had learned English from birth or as a second language before the age of 6 could discriminate between French and English significantly better than chance. However, adults who had learned English as a second language after age 6 failed to discriminate these two languages, suggesting that early childhood exposure is crucial for using relevant visual speech information to separate languages visually. These findings raise the possibility that lowered sensitivity to non-native visual speech cues may contribute to the difficulties encountered when learning a new language in adulthood., This research was supported by Research grants from the Natural Sciences and Engineering Research Council (NSERC) and the Social Sciences and Humanities Research Council (SSHRC) to Janet F. Werker, by NSERC and SSHRC Fellowships to Whitney M. Weikum, and by grants PSI2009-12859, PSI2012-39149 and RYC-2008-03672 from Ministerio de Economía y Competitividad (Spanish Government), and the European COST action TD0904 to Jordi Navarra. Salvador Soto-Faraco was supported by ERC (StG-2010263145), MICINN (PSI2010-15426 and Consolider INGENIO CSD2007-00012) and AGAUR (SGR2009-092).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Rule learning over consonants and vowels in a non-human animal

  • Martínez de la Mora, Daniela, 1983-
  • Toro Soto, Juan Manuel, 1976-
Perception studies have shown similarities between humans and other animals in a wide array of language-related processes. However, the components of language that make it uniquely human have not been fully identified. Here we show that nonhuman animals extract rules over speech sequences that are difficult for humans. Specifically, animals easily learn rules over both consonants and vowels, while humans do it only over vowels. In Experiment 1, rats learned a rule implemented over vowels in CVCVCV nonsense words. In Experiment 2, rats learned the rule when it was implemented over the consonants. In both experiments, rats generalized such knowledge to novel words they had not heard before. Using the same stimuli, human adults learned the rules over the vowels but not over the consonants. These results suggest differences between humans and animals on speech processing might lie on the constraints they face while extracting information from the signal., This research was supported by grants Consolider Ingenio CSD2007-00012 and PSI2010-20029. Also by a Ramón y Cajal fellowship (RYC-2008-02909) and ERC Starting Grant agreement n. 312519 to JMT.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Bottom up modeling of the connectome: linking structure and function in the resting brain and their changes in aging

  • Nakagawa, Tristan T.
  • Jirsa, Viktor K.
  • Spiegler, Andreas
  • McIntosh, Anthony R.
  • Deco, Gustavo
With the increasing availability of advanced imaging technologies, we are/nentering a new era of neuroscience. Detailed descriptions of the complex brain/nnetwork enable us to map out a structural connectome, characterize it with/ngraph theoretical methods, and compare it to the functional networks with/nincreasing detail. To link these two aspects and understand how dynamics/nand structure interact to form functional brain networks in task and in the/nresting state, we use theoretical models. The advantage of using theoretical/nmodels is that by recreating functional connectivity and time series explicitly/nfrom structure and pre-defined dynamics, we can extract critical mechanisms by/nlinking structure and function in ways not directly accessible in the real brain./nRecently, resting state models with varying local dynamics have reproduced/nempirical functional connectivity patterns, and given support to the view that/nthe brain works at a critical point at the edge of a bifurcation of the system./nHere, we present an overview of a modeling approach of the resting brain network/nand give an application of a neural mass model in the study of complexity/nchanges in aging., GD was supported by the ERC Advanced Grant: DYSTRUCTURE (no. 295129), by the Spanish Research ProjectSAF2010-16085 and by the CONSOLIDER-INGENIO 2010 ProgrammeCSD2007-00012, and the FP7-ICT BrainScales. The research reported herein was supported by the Brain Network Recovery Group through the James S. McDonnell Foundation. TTN was supported by the SUR of the DEC of the Catalan Government and by the FSE.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Resting-state functional Connectivity emerges from structurally and dynamically shaped slow linear fluctuations

  • Deco, Gustavo
  • Ponce-Alvarez, Adrián
  • Mantini, Dante
  • Romani, Gian Luca
  • Hagmann, Patric
  • Corbetta, Maurizio
Brain fluctuations at rest are not random but are structured in spatial patterns of correlated activity across different brain areas. The/nquestion of how resting-state functional connectivity (FC) emerges from the brain’s anatomical connections has motivated several/nexperimental and computational studies to understand structure–function relationships. However, the mechanistic origin of resting/nstate is obscured by large-scale models’ complexity, and a close structure–function relation is still an open problem. Thus, a realistic but/nsimple enough description of relevant brain dynamics is needed. Here, we derived a dynamic mean field model that consistently summarizes/nthe realistic dynamics of a detailed spiking and conductance-based synaptic large-scale network, in which connectivity is/nconstrained by diffusion imaging data from human subjects. The dynamic mean field approximates the ensemble dynamics, whose/ntemporal evolution is dominated by the longest time scale of the system. With this reduction, we demonstrated that FC emerges as/nstructured linear fluctuations around a stable low firing activity state close to destabilization. Moreover, the model can be further and/ncrucially simplified into a set of motion equations for statistical moments, providing a direct analytical link between anatomical structure,/nneural network dynamics, and FC. Our study suggests that FC arises from noise propagation and dynamical slowing down of/nfluctuations in an anatomically constrained dynamical system. Altogether, the reduction from spiking models to statistical moments/npresented here provides a new framework to explicitly understand the building up of FC through neuronal dynamics underpinned by/nanatomical connections and to drive hypotheses in task-evoked studies and for clinical applications., This work was supported by the Brain Network Recovery Group through the James S. McDonnell Foundation. G.D. was supported by the European Research Council Advanced Grant DYSTRUCTURE (295129), the Spanish Research Project SAF2010-16085, the CONSOLIDER-INGENIO 2010 Program CSD2007-00012, the Foundation La Marato (Catalonia), and the FP7-ICT BrainScales. P.H. was supported by the Leenaards Foundation. M.C. was supported by National Institutes of Health Grants R01HD061117 and R01MH096482. We thank E. Hugues, R. Hindriks, and M. Adhikari for critical comments and valuable discussions.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Visual information constrains early and late stages of spoken-word recognition in sentence context

  • Brunellière, Angèle
  • Sánchez García, Carolina, 1984-
  • Ikumi Montserrat, Nara, 1986-
  • Soto-Faraco, Salvador, 1970-
Audiovisual speech perception has been frequently studied considering phoneme, syllable and word processing levels. Here, we examined the constraints that visual speech information might exert during the recognition of words embedded in a natural sentence context. We recorded event-related potentials (ERPs) to words that could be either strongly or weakly predictable on the basis of the prior semantic sentential context and, whose initial phoneme varied in the degree of visual saliency from lip movements. When the sentences were presented audio-visually (Experiment 1), words weakly predicted from semantic context elicited a larger long-lasting N400, compared to strongly predictable words. This semantic effect interacted with the degree of visual saliency over a late part of the N400. When comparing audio-visual versus auditory alone presentation (Experiment 2), the typical amplitude-reduction effect over the auditory-evoked N100 response was observed in the audiovisual modality. Interestingly, a specific benefit of high- versus low-visual saliency constraints occurred over the early N100 response and at the late N400 time window, confirming the result of Experiment 1. Taken together, our results indicate that the saliency of visual speech can exert an influence over both auditory processing and word recognition at relatively late stages, and thus suggest strong interactivity between audio-visual integration and other (arguably higher) stages of information processing during natural speech comprehension., This research was supported by the Spanish Ministry of Science and Innovation (PSI2010-15426 and Consolider INGENIO CSD2007-00012), Comissionat per a Universitats i Recerca del DIUE-Generalitat de Catalunya (SGR2009-092), and the European Research Council (StG-2010263145).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Bilinguals use language-control brain areas more than monolinguals to perform non-linguistic switching tasks

  • Rodríguez Pujadas, Aina
  • Sanjuán, Ana
  • Ventura Campos, Noelia
  • Román, Patricia
  • Martin, Clara D.
  • Barceló-Arroyo, Francisco
  • Costa, Albert, 1970-
  • Ávila, César
We tested the hypothesis that early bilinguals use language-control brain areas more than monolinguals when performing/nnon-linguistic executive control tasks. We do so by exploring the brain activity of early bilinguals and monolinguals in a taskswitching/nparadigm using an embedded critical trial design. Crucially, the task was designed such that the behavioural/nperformance of the two groups was comparable, allowing then to have a safer comparison between the corresponding/nbrain activity in the two groups. Despite the lack of behavioural differences between both groups, early bilinguals used/nlanguage-control areas – such as left caudate, and left inferior and middle frontal gyri – more than monolinguals, when/nperforming the switching task. Results offer direct support for the notion that, early bilingualism exerts an effect in the/nneural circuitry responsible for executive control. This effect partially involves the recruitment of brain areas involved in/nlanguage control when performing domain-general executive control tasks, highlighting the cross-talk between these two/ndomains., This work was supported by two grants of the Spanish Ministry of Science and Technology given to CA (the BrainGlot Project, CSD2007-00012 (funded by the Consolider-Ingenio 2010 programme), and the grant PSI2010-20168) and a grant given to AC (PSI2008 -01191). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Reconciling phonological neighborhood effects in speech production through single trial analysis

  • Sadat Schaffai, Jasmin, 1982-
  • Martin, Clara D.
  • Costa, Albert, 1970-
  • Alario, F.-Xavier (François -Xavier)
A crucial step for understanding how lexical knowledge is represented is to describe the relative similarity of lexical items, and how it influences language processing. Previous studies of the effects of form similarity on word production have reported conflicting results, notably within and across languages. The aim of the present study was to clarify this empirical issue to provide specific constraints for theoretical models of language production. We investigated the role of phonological neighborhood density in a large-scale picture naming experiment using fine-grained statistical models. The results showed that increasing phonological neighborhood density has a detrimental effect on naming latencies, and re-analyses of independently obtained data sets provide supplementary evidence for this effect. Finally, we reviewed a large body of evidence concerning phonological neighborhood density effects in word production, and discussed the occurrence of facilitatory and inhibitory effects in accuracy measures. The overall pattern shows that phonological neighborhood generates two opposite forces, one facilitatory and one inhibitory. In cases where speech production is disrupted (e.g. certain aphasic symptoms), the facilitatory component may emerge, but inhibitory processes dominate in efficient naming by healthy speakers. These findings are difficult to accommodate in terms of monitoring processes, but can be explained within interactive activation accounts combining phonological facilitation and lexical competition., This research was supported by a grant from the European Research Council under the European Community’s Seventh Framework Program (FP7/2007-2013 Grant agreement n◦ 263575), three grants from the Spanish government (PSI2008-01191, PSI2011-23033, Consolider Ingenio 2010 CSD2007-00012), and the Catalan government (Consolidado SGR 2009-1521).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

L’etiquetatge prosòdic Cat_ToBI

  • Prieto Vives, Pilar, 1965-
  • Aguilar Cuevas, Lourdes
  • Mascaró, Ignasi
  • Torres-Tamarit, Francesc
  • Vanrell, Maria del Mar
L’article presenta el primer sistema complet d’etiquetatge prosòdic per al català basat en el model mètric autosegmental: el Catalan ToBI o Cat_ToBI. La proposta es basa en resultats d’estudis anteriors i en una anàlisi qualitativa d’un corpus de diferents dialectes del català. Les unitats fonològiques que formen el sistema són les següents. Pel que fa als accents tonals, H*, L*, L+H*, L+>H*, L*+H, H+L* i l’accent tritonal L+H*+L en alguerès, així com els tons alts amb esglaonament ascendent i descendent (¡H* i !H*). Pel que fa als accents de frontera, es proposa un únic tipus de to de frontera i es prescindeix dels accents de frase. Aquests tons de frontera poden ser alts, mitjans o baixos i poden ser monotonals (H%, M%, L%) o aparèixer en combinacions bitonals (LH%, HH%, MM% i HL%) o tritonals (LHL%). El principal objectiu del sistema Cat_ToBI és que serveixi de referència per a la sistematització fonològica de la prosòdia del català i com a eina per a l’anotació prosòdica de corpus orals., This paper describes the conventions proposed in the first prosodic transcription system within the Tones and Break Indices (ToBI) framework for Catalan: Catalan ToBI or Cat_ToBI. The proposal is based on the previous literature on Catalan intonation and a qualitative analysis of a corpus of spoken Catalan that covers several dialects. In the tone tier, Catalan distinguishes among the following accent types: H*, L*, L+H*, L+>H*, L*+H, H+L*, the tritonal L+H*+L (Alguerese), and the downstepped and upstepped variants of H (¡H* and !H*). The model differs from the English ToBI model in that there is no phrase accent category and that only one type of boundary tone occurs to the right of intermediate and intonational phrase boundaries. Catalan distinguishes among the following boundary tones: H%, M%, L%, which can be monotonal or can group into bitonal (LH%, HH%, MM% and, HL%) or tritonal combinations (LHL%). The main aims of the Cat_ToBI system are to serve to improve our knowledge about Catalan intonation and to provide a tool to prosodically annotate oral corpora., El treball ha estat finançat pels següents projectes: Càtedra Alcover-Moll-Villangómez 2007 (UIB), Euroregió 2007 PRE/3323/2006 i 2005SGR 00753 (Generalitat de Catalunya), HUM2006-01758/FILO, HUM2006-13295-C02-01 (Consolider-C) i CONSOLIDER-INGENIO 2010 CSD2007-00012 (Ministerio de Educación y Ciencia-FEDER).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Foreigner talk through word reduction in native/non-native spoken interactions

  • Rodriguez-Cuadrado, Sara
  • Baus, Cristina
  • Costa, Albert, 1970-
We explore the properties of foreigner talk through word reduction. Word reduction signals that the speaker is referring to the same entity as previously and should be preserved for foreigner talk. However, it leads to intelligibility loss, which works against foreigner talk. Pairs of speakers engaged in a task where native speakers talked either to a native or non-native listener. Natives talking to non-natives performed foreigner talk for duration and intensity. Duration and intensity were reduced for native and non-native listeners equally. These results suggest that word reduction is insensitive to communicative adjustments in the context of foreign talk., This work was supported by grants from the Spanish Government (PSI2011-23033, Consolider Ingenio 2010 CSD2007-00012) and the Catalan government (Consolidat SGR 2009-1521). Sara RodríguezCuadrado was supported by a predoctoral fellowship from the Spanish Government (FPU 2008–2012). Cristina Baus was supported by the People Program (Marie Curie Actions, FP7- PEOPLE 2014–2016) under REA agreement n° 623845.We would like to thank Sumeer Chadha, Joanna Corey and Carlos Romero-Rivas for their assistance during data recruitment and manuscript elaboration.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Cross-modal prediction in speech perception

  • Sánchez García, Carolina, 1984-
  • Alsius, Agnès
  • Enns, James T.
  • Soto-Faraco, Salvador, 1970-
Speech perception often benefits from vision of the speaker's lip movements when they are available. One potential mechanism underlying this reported gain in perception arising from audio-visual integration is on-line prediction. In this study we address whether the preceding speech context in a single modality can improve audiovisual processing and whether this improvement is based on on-line information-transfer across sensory modalities. In the experiments presented here, during each trial, a speech fragment (context) presented in a single sensory modality (voice or lips) was immediately continued by an audiovisual target fragment. Participants made speeded judgments about whether voice and lips were in agreement in the target fragment. The leading single sensory context and the subsequent audiovisual target fragment could be continuous in either one modality only, both (context in one modality continues into both modalities in the target fragment) or neither modalities (i.e., discontinuous). The results showed quicker audiovisual matching responses when context was continuous with the target within either the visual or auditory channel (Experiment 1). Critically, prior visual context also provided an advantage when it was cross-modally continuous (with the auditory channel in the target), but auditory to visual cross-modal continuity resulted in no advantage (Experiment 2). This suggests that visual speech information can provide an on-line benefit for processing the upcoming auditory input through the use of predictive mechanisms. We hypothesize that this benefit is expressed at an early level of speech analysis., This research was supported by the Spanish Ministry of Science and Innovation (PSI2010-15426 and Consolider INGENIO CSD2007-00012), Comissionat per a Universitats i Recerca del DIUE-Generalitat de Catalunya (SRG2009-092 and PIV2009-00122), and the European Research Council (StG-2010 263145).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

How delays matter in an oscillatory whole-brain spiking-neuron network model for MEG alpha-rhythms at rest

  • Nakagawa, Tristan T.
  • Woolrich, Mark W.
  • Luckhoo, Henry
  • Joensson, Morten
  • Mohseni, Hamid
  • Kringelbach, Morten L.
  • Jirsa, Viktor K.
  • Deco, Gustavo
In recent years the study of the intrinsic brain dynamics in a relaxed awake state in the absence of any specific/ntask has gained increasing attention, as spontaneous neural activity has been found to be highly structured at a/nlarge scale. This so called resting-state activity has been found to be comprised by nonrandom spatiotemporal/npatterns and fluctuations, and several Resting-State Networks (RSN) have been found in BOLD-fMRI as well as/nin MEG signal power envelope correlations. The underlying anatomical connectivity structure between areas of/nthe brain has been identified as being a key to the observed functional network connectivity, but the mechanisms/nbehind this are still underdetermined. Theoretical large-scale brain models for fMRI data have corroborated the/nimportance of the connectome in shaping network dynamics,while the importance of delays and noise differ between/nstudies and depend on the models' specific dynamics. In the current study, we present a spiking neuron/nnetworkmodel that is able to produce noisy, distributed alpha-oscillations, matching the power peak in the spectrumof/ngroup resting-stateMEG recordings.We studied howwell the model captured the inter-node correlation/nstructure of the alpha-band power envelopes for different delays between brain areas, and found that the model/nperforms best for propagation delays inside the physiological range (5–10 m/s). Delays also shift the transition/nfrom noisy to bursting oscillations to higher global coupling values in the model. Thus, in contrast to the/nasynchronous fMRI state, delays are important to consider in the presence of oscillation., TTN was supported by the SUR of the DEC of the Catalan Government/nand by the FSE. GD was supported by the ERC Advanced Grant:/nDYSTRUCTURE (n. 295129), by the Spanish Research Project SAF2010-/n16085 and by the CONSOLIDER-INGENIO 2010 Programme CSD2007-/n00012, and the FP7-ICT BrainScales. The research reported herein was/nsupported by the Brain Network Recovery Group through the James S./nMcDonnell Foundation.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

A multiple-choice task with changes of mind

  • Albantakis, Larissa
  • Branzi, Francesca Martina, 1984-
  • Costa, Albert, 1970-
  • Deco, Gustavo
The role of changes of mind and multiple choices has recently received increased attention in the study of perceptual/ndecision-making. Previously, these extensions to standard two-alternative tasks have been studied separately. Here we/nexplored how changes of mind depend on the number of choice-alternatives. To this end, we tested 14 human subjects on/na 2- and 4-alternative direction-discrimination task. Changes of mind in the participants’ movement trajectories could be/nobserved for two and for four choice alternatives. With fewer alternatives, participants responded faster and more/naccurately. The frequency of changes of mind, however, did not significantly differ for the different numbers of choice/nalternatives. Nevertheless, mind-changing improved the participants’ final performance, particularly for intermediate/ndifficulty levels, in both experimental conditions. Moreover, the mean reaction times of individual participants were/nnegatively correlated with their overall tendency to make changes of mind. We further reproduced these findings with a/nmulti-alternative attractor model for decision-making, while a simple race model could not account for the experimental/ndata. Our experiment, combined with the theoretical models allowed us to shed light on: (1) the differences in choice/nbehavior between two and four alternatives, (2) the differences between the data of our human subjects and previous/nmonkey data, (3) individual differences between participants, and (4) the inhibitory interaction between neural/nrepresentations of choice alternatives., This work was supported by the “CONSOLIDER-INGENIO 2010” Programme in the “Brainglot” project (Bilingualism and Cognitive Neuroscience) CSD2007-00012. FMB was supported by a predoctoral fellowship from the Spanish Government (FPU 2009-2013). GD was further supported by the Spanish Ministry of Science in the project “Communication and Information Processing Between Cortical Circuits: Oscillations and Plasticity” SAF2010-16085. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Balanced input allows optimal encoding in a stochastic binary neural network model: an analytical study

  • Deco, Gustavo
  • Hugues, Etienne
Recent neurophysiological experiments have demonstrated a remarkable effect of attention on the underlying neural/nactivity that suggests for the first time that information encoding is indeed actively influenced by attention. Single cell/nrecordings show that attention reduces both the neural variability and correlations in the attended condition with respect/nto the non-attended one. This reduction of variability and redundancy enhances the information associated with the/ndetection and further processing of the attended stimulus. Beyond the attentional paradigm, the local activity in a neural/ncircuit can be modulated in a number of ways, leading to the general question of understanding how the activity of such/ncircuits is sensitive to these relatively small modulations. Here, using an analytically tractable neural network model, we/ndemonstrate how this enhancement of information emerges when excitatory and inhibitory synaptic currents are balanced./nIn particular, we show that the network encoding sensitivity -as measured by the Fisher information- is maximized at the/nexact balance. Furthermore, we find a similar result for a more realistic spiking neural network model. As the regime of/nbalanced inputs has been experimentally observed, these results suggest that this regime is functionally important from an/ninformation encoding standpoint., The research leading to these results has received funding from the European Union Seventh Framework Programme (FP7/2007- 2013) under grant agreements no. 269921(BrainScaleS) and no. 269459 (Coronet), from the Spanish Research Project SAF2010-16085 and from the CONSOLIDER-INGENIO 2010 Programme CSD2007-00012. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Pitch range, gestural information and perceived politeness in Catalan

  • Nadeu, Marianna
  • Prieto Vives, Pilar, 1965-
It is known that certain prosodic aspects of speech play a role in the expression of paralinguistic meaning, yet the concrete mechanisms of how this is implemented have not yet been fleshed out. The present article attempts to explore the contribution of pitch range to the expression of politeness in information-seeking yes–no questions in Catalan. Two perception experiments were carried out with stimuli that contained a gradual increase and decrease of the pitch range at the end of two target intonation contours (rising and falling). The results of the first experiment revealed that, for both contours, increasing the pitch range of the final part of the utterance tone resulted in a decrease of perceived politeness, whereas decreasing the pitch range had no effect. The second perception experiment showed that adding contextual (gestural) information reversed the tendency. Taken together, these results point to the complex interaction between prosodic cues and contextual information (specifically, facial gestures). There is nothing intrinsically polite about using an increased pitch range, unless it is accompanied by consistent contextual information. In sum, when assessing the degree of perceived politeness of an utterance, attention has to be paid to various prosodic aspects together with contextual and gestural information., Parts of this study were presented at the first Cat_ToBI workshop (Barcelona, July 2009). We are grateful to the audience at this workshop, and especially to Eulàlia Bonet, Teresa Cabré, Verònica Crespo, José Ignacio Hualde, Joan C. Mora, Maria del Mar Vanrell, and Anne Wichmann for very useful feedback. We would like to thank the participants in the two experiments, Verònica Crespo for her help running the experiments, Joan C. Mora for his support with the use of DmDx, Romà Rofes for technical support, and Maria del Mar Vanrell for her help with the statistical analysis of the data. This research has been funded by projects FFI2009-07648/FILO and CONSOLIDER-INGENIO 2010 Programme CSD2007-00012 (both awarded by the Ministerio de Ciencia e Innovación) and by project 2009 SGR 701 (awarded by the Generalitat de Catalunya).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Somatosensory saccades reveal the timing of tactile spatial remapping

  • Overvliet, Krista E.
  • Azañón Gracia, Elena
  • Soto-Faraco, Salvador, 1970-
Remapping tactile events from skin to external space is an essential process for human behaviour. It allows us to refer tactile sensations to their actual externally based location, by combining anatomically based somatosensory information with proprioceptive information about the current body posture. We examined the time course of tactile remapping by recording speeded saccadic responses to somatosensory stimuli delivered to the hands. We conducted two experiments in which arm posture varied (crossed or uncrossed), so that anatomical and external frames of reference were either put in spatial conflict or were aligned. The data showed that saccade onset latencies in the crossed hands conditions were slower than in the uncrossed hands condition, suggesting that, in the crossed hands condition, remapping had to be completed before a correct saccade could be executed. Saccades to tactile stimuli when the hands were crossed were sometimes initiated to the wrong direction and then corrected in-flight, resulting in a turn-around saccade. These turn-around saccades were more likely to occur in short-latency responses, compared to onset latencies of saccades that went straight to target. The latter suggests that participants were postponing their saccade until the time the tactile event was represented according to the current body posture. We propose that the difference between saccade onset latencies of crossed and uncrossed hand postures, and between the onset of a turn-around saccade and a straight saccade in the crossed hand posture, reveal the timing of tactile spatial remapping., This research was supported by Spanish Ministry of Science and Innovation (PSI2010-15426 and Consolider INGENIOCSD2007-00012), Comissionat per a Universitats i Recerca del DIUE-Generalitat de Catalunya (SRG2009-092), and European Research Council (StG-2010 263145).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Discrepancies between multi-electrode LFP and CSD phase-patterns: A forward modeling study

  • Hindriks, Rikkert
  • Arsiwalla, Xerxes D.
  • Panagiotaropoulos, Theofanis I.
  • Besserve, Michel
  • Verschure, Paul F. M. J.
  • Logothetis, Nikos
  • Deco, Gustavo
Multi-electrode recordings of local field potentials (LFPs) provide the opportunity to investigate the spatiotemporal organization of neural activity on the scale of several millimeters. In particular, the phases of oscillatory LFPs allow studying the coordination of neural oscillations in time and space and to tie it to cognitive processing. Given the computational roles of LFP phases, it is important to know how they relate to the phases of the underlying current source densities (CSDs) that generate them. Although CSDs and LFPs are distinct physical quantities, they are often (implicitly) identified when interpreting experimental observations. That this identification is problematic is clear from the fact that LFP phases change when switching to different electrode montages, while the underlying CSD phases remain unchanged. In this study we use a volume-conductor model to characterize discrepancies between LFP and CSD phase-patterns, to identify the contributing factors, and to assess the effect of different electrode montages. Although we focus on cortical LFPs recorded with two-dimensional (Utah) arrays, our findings are also relevant for other electrode configurations. We found that the main factors that determine the discrepancy between CSD and LFP phase-patterns are the frequency of the neural oscillations and the extent to which the laminar CSD profile is balanced. Furthermore, the presence of laminar phase-differences in cortical oscillations, as commonly observed in experiments, precludes identifying LFP phases with those of the CSD oscillations at a given cortical depth. This observation potentially complicates the interpretation of spike-LFP coherence and spike-triggered LFP averages. With respect to reference strategies, we found that the average-reference montage leads to larger discrepancies between LFP and CSD phases as compared with the referential montage, while the Laplacian montage reduces these discrepancies. We therefore advice to conduct analysis of two-dimensional LFP recordings using the Laplacian montage., RH and GD were funded by the European Research Council (Advanced Grant DYSTRUCTURE No. 295129), the Spanish Research Project PSI2013-42091-P, the CONSOLIDER-INGENIO 2010 Program CSD2007-00012, and the FP7-ICT Brainscales (269921). XA and PV are supported by the European Research Council's CDAC project: “The Role of Consciousness in Adaptive Behavior: A Combined Empirical, Computational and Robot based Approach” (ERC-2013- ADG 341196).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Do humans and nonhuman animals share the grouping principles of the Iambic-Trochaic Law?

  • Martínez de la Mora, Daniela, 1983-
  • Nespor, Marina
  • Toro Soto, Juan Manuel, 1976-
The Iambic-Trochaic Law describes humans’ tendency to form trochaic groups over sequences varying in pitch or intensity (i.e., the loudest or highest sound marks group beginnings), and iambic groups over sequences varying in duration (i.e., the longest sound marks group endings). The extent to which these perceptual biases are shared by humans and nonhuman animals is yet unclear. In Experiment 1, we trained rats to discriminate pitch-alternating sequences of tones from sequences randomly varying in pitch. In Experiment 2, rats were trained to discriminate duration-alternating sequences of tones from sequences randomly varying in duration. We found that nonhuman animals group as trochees sequences based on pitch variations, but they do not group as iambs sequences varying in duration. Importantly, humans grouped the same stimuli following the principles of the Iambic-Trochaic Law (Experiment 3). These results suggest an early emergence of the trochaic rhythmic grouping bias based on pitch, possibly relying on perceptual abilities shared by humans and other mammals as well, whereas the iambic rhythmic grouping bias based on duration might depend on language experience., This research was supported by grants Consolider Ingenio CSD2007-00012 and PSI2010-20029, as well as by ERC grant agreement n.312519 to JMT, and by (FP7/2007-2013)/ERC grant agreement n.269502 (PASCAL) to MN. We thank Tere Rodrigo and staff from the Laboratorio de Psicología Animal of the Universitat de Barcelona for their help with the experiments, and three anonymous reviewers for their fruitful comments.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Sound-driven enhancement of vision: disentangling detection from decisional level contributions

  • Pérez-Bellido, Alexis
  • Soto-Faraco, Salvador, 1970-
  • López-Moliner, Joan
Cross-modal enhancement can be mediated both by higher-order effects due to attention and decision making and by detection-level stimulus-driven interactions. However, the contribution of each of these sources to behavioral improvements has not been conclusively determined and quantified separately. Here, we apply psychophysical analysis based on Piéron functions in order to separate stimulus-dependent changes from those accounted by decision-level contributions. Participants performed a simple visual speeded detection task on Gabor patches of different spatial frequencies and contrast values, presented with and without accompanying sounds. On one hand, we identified an additive cross-modal improvement in mean reaction times across all types of visual stimuli that would be well explained by interactions not strictly based on stimulus-driven modulations (e.g., due to reduction of temporal uncertainty and motor times). On the other hand, we singled out an audio-visual benefit that strongly depended on stimulus features such as frequency and contrast. This particular enhancement was selective to low-visual spatial frequency stimuli, optimized for magnocellular sensitivity. We therefore conclude that interactions at detection stages and at decisional processes in response selection that contribute to audio-visual enhancement can be separated online and express on partly different aspects of visual processing., This research was supported by the Spanish Ministry of Science and Innovation (PSI2010-15867, PSI2010-15426, and Consolider INGENIO CSD2007-00012), Comissionat per a Universitats i Recerca del DIUE-Generalitat de Catalunya (SGR2009-092, SGR2009-308), and the European Research Council (StG-2010263145).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Slow modulation of ongoing discharge in the auditory cortex during an interval-discrimination task

  • Abolafia, Juan M.
  • Martínez-García, Marina
  • Deco, Gustavo
  • Sanchez-Vives, Maria V.
In this study, we recorded single unit activity from rat auditory cortex while the animals performed an interval-discrimination task. The animals had to decide whether two auditory stimuli were separated by either 150 or 300 ms, and go to the left or right nose poke accordingly. Spontaneous firing in between auditory responses was compared in the attentive versus non-attentive brain states. We describe the firing rate modulation detected during intervals while there was no auditory stimulation. Nearly 18% of neurons (n = 14) showed a prominent neuronal discharge during the interstimulus interval, in the form of an upward or downward ramp towards the second auditory stimulus. These patterns of spontaneous activity were often modulated in the attentive versus passive trials. Modulation of the spontaneous firing rate during the task was observed not only between auditory stimuli, but also in the interval preceding the stimulus. These slow modulatory components could be locally generated or the result of a top-down influence originated in higher associative association areas. Such a neuronal discharge may be related to the computation of the interval time and contribute to the perception of the auditory stimulus., Supported by a grant from the Ministerio de Ciencia e Innovación/n(BFU2008-01371/BFI) to MVS–V. MM–G and GD were supported/nby the European Union grant BRAINSCALES, by the Spanish/nResearch Project SAF2010-16085 and by the CONSOLIDERINGENIO/n2010 Programme CSD2007-00012, and EU FP7/2007-/n2013 under grant agreement 214728-2.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Intonational encoding of double negation in Catalan

  • Espinal i Farré, M. Teresa
  • Prieto Vives, Pilar, 1965-
In this paper we shall explore the phenomenon of double negation (DN) in a negative concord language like Catalan from an inferential perspective. According to recent developments within the generative approach to the theory of sentential grammar, a proper account of this phenomenon requires an analysis of the lexical, syntactic, and semantic conditions involved. Yet this model only attempts to account for the phenomenon of DN if two negative operators or two strong negative quantifiers are involved within a syntactic structure. In order to investigate the syntactic and prosodic conditions that affect DN interpretation in a question–answer (Q–A) dialogue in Catalan, we conducted a set of perception experiments with Central Catalan listeners. Our study supports the hypothesis that different formal conditions in the Q and A utterances (specifically, a command negative wh- Q combined with a contradictory intonational contour in the A) affect the corresponding interpretation, and that intonation encodes procedural restrictions on the proposition expressed. Results from these perception experiments confirm that the intonation contour of the negative word ningú ‘nobody’ is the key factor triggering a DN interpretation. This paper aims to contribute to our current knowledge of the prosody–meaning interface in the interpretation of negative constructions within recent work on the intonational phonology of Catalan and Relevance Theory., An earlier version of this study was presented at the Workshop on Procedural Meaning (October 2009, Madrid), and at the XX Colloquium on Generative Grammar (March 2010, Barcelona). We are grateful to C. Beyssade, B. Clark, V. Escandell, A.M. Falaus, O. Fernández Soriano, T. Fretheim, B. Gili-Fivela, M.P. D’Imperio, M. Leonetti, C. de la Mota, P. Roseano, and D. Wilson, as well as to two reviewers of the Journal of Pragmatics for very insightful comments on some of the topics raised in this article. We would also like to thank the colleagues who participated in the perception experiments, namely: N. Argemí, M. Alemany, A. Bartra, E. Bonet, J. Borràs, T. Cabré, D. Casals, R. Craviotto, V. Crespo, F. Foguet, R. Gauchola, A. Gavarro´ , G. Gómez, P. Huedo, M. Llobet, J. Mascaró, M. Massanell, M. Nadeu, X. Obradors, C. Pons, Meritxell Pons, Miquel Pons, C. Queralto´ , E. Ramírez, D. Recasens, J.M. Serra, J. Solà, X. Torres, I. Vallès, M.M. Vanrell, A. Víctor, and X. Villalba. Michael Kennedy-Scanlon deserves special thanks for improving the English manuscript. This research has been funded by two research grants awarded by the Spanish Ministerio de Ciencia e Innovación, namely HUM2006-13295-C02-01FILO, FFI2009-07648/FILO and CONSOLIDER-INGENIO 2010 Programme CSD2007-00012, and by two grants awarded by the Generalitat de Catalunya to both the Centre de Lingüística Teòrica (2009SGR-1073) and the Grup d’Estudis de Prosòdia (2009SGR-701). The first author also acknowledges an ICREA Acadèmia award.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Exploring the network dynamics underlying brain activity during rest

  • Cabral, Joana
  • Kringelbach, Morten L.
  • Deco, Gustavo
Since the mid 1990s, the intriguing dynamics of the brain at rest has been attracting a growing body of/nresearch in neuroscience. Neuroimaging studies have revealed distinct functional networks that slowly/nactivate and deactivate, pointing to the existence of an underlying network dynamics emerging/nspontaneously during rest, with specific spatial, temporal and spectral characteristics. Several/ntheoretical scenarios have been proposed and tested with the use of large-scale computational models/nof coupled brain areas. However, a mechanistic explanation that encompasses all the phenomena/nobserved in the brain during rest is still to come./nIn this review, we provide an overview of the key findings of resting-state activity covering a range of/nneuroimaging modalities including fMRI, EEG and MEG. We describe how to best define and analyze/nanatomical and functional brain networks and how unbalancing these networks may lead to problems/nwith mental health. Finally, we review existing large-scale models of resting-state dynamics in health/nand disease./nAn important common feature of resting-state models is that the emergence of resting-state/nfunctional networks is obtained when the model parameters are such that the system operates at the/nedge of a bifurcation. At this critical working point, the global network dynamics reveals correlation/npatterns that are spatially shaped by the underlying anatomical structure, leading to an optimal fit with/nthe empirical BOLD functional connectivity. However, new insights coming from recent studies,/nincluding faster oscillatory dynamics and non-stationary functional connectivity, must be taken into/naccount in future models to fully understand the network mechanisms leading to the resting-state/nactivity., The research reported herein was supported by the ERC/nAdvanced Grant DYSTRUCTURE (No. 295129), by the FET Flagship/nHuman Brain Project, by the Spanish Research Project SAF 2010-/n16085, by the CONSOLIDER-INGENIO 2010 Programme CSD2007-/n00012, by the Brain Network Recovery Group through the James S./nMcDonnell Foundation, by the FP7-ICT BrainScales, and by the/nTrygFonden Charitable Foundation.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Searching for audiovisual correspondence in multiple speaker scenarios

  • Alsius, Agnès
  • Soto-Faraco, Salvador, 1970-
A critical question in multisensory processing is how the constant information flow that arrives to our different senses is organized in coherent representations. Some authors claim that pre-attentive detection of inter-sensory correlations supports crossmodal binding, whereas other findings indicate that attention plays a crucial role. We used visual and auditory search tasks for speaking faces to address the role of selective spatial attention in audiovisual binding. Search efficiency amongst faces for the match with a voice declined with the number of faces being monitored concurrently, consistent with an attentive search mechanism. In contrast, search amongst auditory speech streams for the match with a face was independent of the number of streams being monitored concurrently, as long as localization was not required. We suggest that the fundamental differences in the way in which auditory and visual information is encoded play a limiting role in crossmodal binding. Based on these unisensory limitations, we provide a unified explanation for several previous apparently contradictory findings., This work was supported by grants PSI2010-15426 and Consolider INGENIO CSD2007-00012 (MICINN), Generalitat de Catalunya (SRG2009-092), and European Research Council (StG-2010 263145).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

On the temporal and functional origin of L2 disadvantages in speech production: a critical review

  • Runnqvist, Elin
  • Strijkers, Kristof
  • Sadat Schaffai, Jasmin, 1982-
  • Costa, Albert, 1970-
Despite a large amount of psycholinguistic research devoted to the issue of processing differences between a first and a second language, there is no consensus regarding the locus where these emerge or the mechanism behind them. The aim of this article is to briefly examine both the behavioral and neuroscientific evidence in order to critically assess three hypotheses that have been put forward in the literature to explain such differences: the weaker links, executive control, and post-lexical accounts. We conclude that (a) while all stages of processing are likely to be slowed down when speaking in an L2 compared to an L1, the differences seem to originate at a lexical stage; and (b) frequency of use seems to be the variable mainly responsible for these bilingual processing disadvantages., This work was supported by grants from the Spanish government (PSI2008-01191, Consolider Ingenio 2010 CSD2007-00012) and the Catalan government (Consolidado SGR 2009-1521), a predoctoral grant from the Catalan government (FI) to Elin Runnqvist and predoctoral grants from the Spanish government (FPU) to Kristof Strijkers and Jasmin Sadat.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Neural correlates of audiovisual speech processing in a second language

  • Barrós Loscertales, Alfonso
  • Ventura Campos, Noelia
  • Visser, Maya
  • Alsius, Agnès
  • Pallier, Christophe
  • Ávila, César
  • Soto-Faraco, Salvador, 1970-
Neuroimaging studies of audiovisual speech processing have exclusively addressed listeners’ native language (L1). Yet, several behavioural studies now show that AV processing plays an important role in non-native (L2) speech perception. The current fMRI study measured brain activity during auditory, visual, audiovisual congruent and audiovisual incongruent utterances in L1 and L2. BOLD responses to congruent AV speech in the pSTS were stronger than in either unimodal condition in both L1 and L2. Yet no differences in AV processing were expressed according to the language background in this area. Instead, the regions in the bilateral occipital lobe had a stronger congruency effect on the BOLD response (congruent higher than incongruent) in L2 as compared to L1. According to these results, language background differences are predominantly expressed in these unimodal regions, whereas the pSTS is similarly involved in AV integration regardless of language dominance., This research has been supported by the Spanish Ministry of Science and Innovation (PSI2010-15426, PSI2010-20168, and Consolider INGENIO CSD2007-00012), Comissionat per a Universitats i Recerca del DIUE-Generalitat de Catalunya (SRG2009-092), and the European Research Council (StG-2010 263145).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Discrimination of acoustic patterns in rats using the water T-maze

  • Martínez de la Mora, Daniela, 1983-
  • Toro Soto, Juan Manuel, 1976-
The extraction of abstract rules and their generalization to new items has/nbeen proposed to be at the heart of higher cognitive functions such as/nlanguage. Research with animals has shown that various species can extract/nrather complex patterns from the input, as well as establish abstract/nsame/different relations. However, much of these findings have been/nobserved after extensive training procedures. Here, we tested rats’ capacity/nto discriminate and generalize tone triplets that entailed a repetition from/ntriplets that followed an ordinal, non-repeating pattern following a relatively/nshort discrimination training procedure in a water T-maze. Our findings/ndemonstrate that, under this procedure and after only 12 sessions, rats can/nlearn to discriminate both patterns when a reliable difference in pitch/nvariations is present across them (Experiment 1). When differences in pitch/nare eliminated (Experiment 2), no discrimination between patterns is found./nResults suggest a procedure based on a water T-maze might be used to/nexplore discrimination of acoustic patterns in rodents., Discriminación de patrones acústicos en ratas utilizando el laberinto/nacuático en T. Se ha propuesto que la extracción de reglas abstractas y su/ngeneralización a nuevas estancias es la base de funciones cognitivas/nsuperiores, tal como el lenguaje. La investigación con animales ha/ndemostrado que diversas especies pueden extraer y generalizar patrones/nsimples, así como establecer relaciones abstractas de igual-diferente. Sin/nembargo, tales hallazgos se han observado tras procedimientos de/nentrenamiento prolongados. Mediante un entrenamiento relativamente breve/nutilizando un laberinto acuático en T, probamos la capacidad de las ratas/npara discriminar y generalizar tripletes de tonos que implicaban una/nrepetición, de tripletes que seguían una secuencia ordinal y no repetitiva./nNuestros resultados demuestran que bajo este procedimiento y tras sólo 12/nsesiones, las ratas discriminan ambos patrones cuando entre ellos existe una/ndiferencia evidente en variaciones de frecuencia (Experimento 1). Cuando/ntal diferencia se elimina (Experimento 2), no se observa la discriminación./nLos resultados sugieren que un procedimiento basado en un laberinto/nacuático en T puede ser usado para explorar la discriminación de patrones/nacústicos en roedores., This research was supported by grants Consolider CSD2007-00012, and ERC Starting Grant agreement number 312519.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Modeling resting-state functional networks when the cortex falls asleep: local and global changes

  • Deco, Gustavo
  • Hagmann, Patric
  • Hudetz, Anthony G.
  • Tononi, Giulio
The transition from wakefulness to sleep represents the most conspicuous change in behavior and the level of consciousness occurring in the healthy brain. It is accompanied by similarly conspicuous changes in neural dynamics, traditionally exemplified by the change from “desynchronized” electroencephalogram activity in wake to globally synchronized slow wave activity of early sleep. However, unit and local field recordings indicate that the transition is more gradual than it might appear: On one hand, local slow waves already appear during wake; on the other hand, slow sleep waves are only rarely global. Studies with functional magnetic resonance imaging also reveal changes in resting-state functional connectivity (FC) between wake and slow wave sleep. However, it remains unclear how resting-state networks may change during this transition period. Here, we employ large-scale modeling of the human cortico-cortical anatomical connectivity to evaluate changes in resting-state FC when the model “falls asleep” due to the progressive decrease in arousal-promoting neuromodulation. When cholinergic neuromodulation is parametrically decreased, local slow waves appear, while the overall organization of resting-state networks does not change. Furthermore, we show that these local slow waves are structured macroscopically in networks that resemble the resting-state networks. In contrast, when the neuromodulator decrease further to very low levels, slow waves become global and resting-state networks merge into a single undifferentiated, broadly synchronized network., G.D. was supported by the ERC Advanced Grant: DYSTRUCTURE/n(no. 295129), by the Spanish Research Project/nSAF2010-16085, and by the CONSOLIDER-INGENIO 2010/nProgram CSD2007-00012 and the FP7-ICT BrainScales. G.T./nwas supported by the Paul Allen Family Foundation and by the/nMcDonnell Foundation. P.H. was supported by Leenaards/nFoundation. The research reported herein was supported by/nthe Brain Network Recovery Group through the James/nS. McDonnell Foundation.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Synaptic depression and slow oscillatory activity in a biophysical network model of the cerebral cortex

  • Benita, Jose María
  • Guillamon i Grabolosa, Antoni
  • Deco, Gustavo
  • Sanchez-Vives, Maria V.
Short-term synaptic depression (STD) is a form of synaptic plasticity that has a large impact on network computations. Experimental results suggest that STD is modulated by cortical activity, decreasing with activity in the network and increasing during silent states. Here, we explored different activity-modulation protocols in a biophysical network model for which the model displayed less STD when the network was active than when it was silent, in agreement with experimental results. Furthermore, we studied how trains of synaptic potentials had lesser decay during periods of activity (UP states) than during silent periods (DOWN states), providing new experimental predictions. We next tackled the inverse question of what is the impact of modifying STD parameters on the emergent activity of the network, a question difficult to answer experimentally. We found that synaptic depression of cortical connections had a critical role to determine the regime of rhythmic cortical activity. While low STD resulted in an emergent rhythmic activity with short UP states and long DOWN states, increasing STD resulted in longer and more frequent UP states interleaved with short silent periods. A still higher synaptic depression set the network into a non-oscillatory firing regime where DOWN states no longer occurred. The speed of propagation of UP states along the network was not found to be modulated by STD during the oscillatory regime; it remained relatively stable over a range of values of STD. Overall, we found that the mutual interactions between synaptic depression and ongoing network activity are critical to determine the mechanisms that modulate cortical emergent patterns., Jose M. Benita and Antoni Guillamon are supported by the MICINN/FEDER grant MTM2009-06973 (DACOBIAN) and the Generalitat de Catalunya CUR-DIUE grant number 2009SGR-859. GD is supported by the European Union, grant EC005-024 (“STREP Decisions in Motion”), by the Spanish Research Project BFU2007-61710, and CONSOLIDER CSD2007-00012. Maria V. Sanchez-Vives is supported by the MICINN (BFU2008-01371/BFI) and MINECO (BFU2011-27094).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Exploring mechanisms of spontaneous functional connectivity in MEG:/nHow delayed network interactions lead to structured amplitude/nenvelopes of band-pass filtered oscillations

  • Cabral, Joana
  • Luckhoo, Henry
  • Woolrich, Mark W.
  • Joensson, Morten
  • Mohseni, Hamid
  • Baker, Adam
  • Kringelbach, Morten L.
  • Deco, Gustavo
Spontaneous (or resting-state) brain activity has attracted a growing body of neuroimaging research over the last/ndecades.Whole-brain networkmodels have proved helpful to investigate the source of slow(b0.1 Hz) correlated/nhemodynamic fluctuations revealed in fMRI during rest. However, the mechanisms mediating resting-state/nlong-distance correlations and the relationship with the faster neural activity remain unclear. Novel insights/ncoming from MEG studies have shown that the amplitude envelopes of alpha- and beta-frequency oscillations/n(8–30 Hz) display similar correlation patterns as the fMRI signals./nIn thiswork, we combine experimental and theoreticalwork to investigate the mechanisms of spontaneousMEG/nfunctional connectivity. Using a simple model of coupled oscillators adapted to incorporate realisticwhole-brain/nconnectivity and conduction delays, we explore how slow and structured amplitude envelopes of band-pass/nfiltered signals – fairly reproducing MEG data collected from 10 healthy subjects at rest – are generated spontaneously/nin the space-time structure of the brain network./nOur simulation results show that the large-scale neuroanatomical connectivity provides an optimal network/nstructure to support a regimewith metastable synchronization. In this regime, different subsystems may temporarily/nsynchronize at reduced collective frequencies (falling in the 8–30 Hz range due to the delays) while the/nglobal system never fully synchronizes. This mechanism modulates the frequency of the oscillators on a slow/ntime-scale (b0.1 Hz) leading to structured amplitude fluctuations of band-pass filtered signals. Taken overall,/nour results reveal that the structured amplitude envelope fluctuations observed in resting-state MEG data may/noriginate from spontaneous synchronization mechanisms naturally occurring in the space-time structure of/nthe brain., The research reported herein was supported by the ERC Advanced/nGrant: DYSTRUCTURE (n. 295129), by the FET Flagship Human Brain/nProject, by the Spanish Research Project SAF2010-16085, by the/nCONSOLIDER-INGENIO 2010 CSD2007-00012, by the BrainNRG through/nthe James S. McDonnell Foundation, by the FP7-ICT BrainScales, by the/nRCUK Digital Economy – Centre for Doctoral Training in Healthcare/nInnovation, by theMINDLab Investment Capital for University Research/nFund and by the TrygFonden Charitable Foundation.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

When the tail counts: the advantage of bilingualism through the ex-gaussian distribution analysis

  • Calabria, Marco
  • Hernández Pardo, Mireia
  • Martin, Clara D.
  • Costa, Albert, 1970-
Several studies have documented the advantage of bilingualism with respect to the development of the executive control (EC) system. Two effects of bilingualism have been described in conflict resolution tasks: (a) bilinguals tend to perform the tasks faster overall, and (b) bilinguals tend to experience less interference from conflicting information, compared to monolinguals. The precise way in which the bilingual advantage relies on different EC mechanisms is still not well understood. The goal of the present article is to further explore how bilingualism impacts the EC system by performing a new analysis (Ex-Gaussian) of already reported data in which bilinguals and monolinguals performed a flanker task. Ex-Gaussian distribution analysis allows us to partial out the contribution of the normal and the exponential components of the RT distribution of the two groups. The fit of the raw data to the ex-Gaussian distribution showed two main results. First, we found that the bilingualism advantage in the overall speed of processing is captured by group differences in the normal (μ) and the exponential (τ) components of the distribution. Second, the bilingual advantage in the magnitude of the conflict effect is captured by group differences only in the exponential component. The results are discussed in terms of: (a) usefulness of the ex-Gaussian analysis as a tool to better describe the RT distribution, and (b) a new approach to explore the cognitive processes purportedly involved in instantiating the bilingualism advantage with respect to EC., This research was supported by grants from the Spanish/ngovernment (PSI2008-01191, Consolider Ingenio 2010 CSD2007-/n00012) and the Catalan government (Consolidado SGR 2009-/n1521). This research was also supported by a Marie Curie/nInternational Outgoing Fellowship within the 7th European/nCommunity Framework Programme awarded to Mireia Hernández./nMarco Calabria and Clara Martin were supported by a/npostdoctoral fellowship from the Spanish Government (Juan/nde la Cierva fellowship). The authors are grateful to Ian/nFitzpatrick for his comments on previous versions of this/nmanuscript.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Identification of optimal structural connectivity using functional connectivity and neural modeling

  • Deco, Gustavo
  • McIntosh, Anthony R.
  • Shen, Kelly
  • Hutchison, R. Matthew
  • Menon, Ravi S.
  • Everling, Stefan
  • Hagmann, Patric
  • Jirsa, Viktor K.
The complex network dynamics that arise from the interaction of the brain’s structural and functional architectures give rise to mental/nfunction. Theoretical models demonstrate that the structure–function relation is maximal when the global network dynamics operate at/na critical point of state transition. In the present work, we used a dynamic mean-field neural model to fit empirical structural connectivity/n(SC) and functional connectivity (FC) data acquired in humans and macaques and developed a new iterative-fitting algorithm to optimize/nthe SC matrix based on the FC matrix. A dramatic improvement of the fitting of the matrices was obtained with the addition of a small/nnumber of anatomical links, particularly cross-hemispheric connections, and reweighting of existing connections. We suggest that the/nnotion of a critical working point, where the structure–function interplay is maximal, may provide a new way to link behavior and/ncognition, and a new perspective to understand recovery of function in clinical conditions., G.D. was supported by the European Research Council Advanced Grant DYSTRUCTURE (n.295129), by the Spanish/nResearch Project SAF2010-16085, and by the CONSOLIDER-INGENIO 2010 Programme CSD2007-00012. V.K.J. and/nG.D. are supported by FP7-ICT BrainScales. The research reported herein was supported by Collaborative Research/nGrant 220020255 from the James S. McDonnell Foundation. P.H. is supported by the Leenaards Foundation
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Acoustic facilitation of object movement detection during self-motion

  • Calabro, Finnegan
  • Soto-Faraco, Salvador, 1970-
  • Vaina, Lucia M.
In humans, as well as most animal species, perception of object motion is critical to successful interaction with the surrounding environment. Yet, as the observer also moves, the retinal projections of the various motion components add to each other and extracting accurate object motion becomes computationally challenging. Recent psychophysical studies have demonstrated that observers use a flow-parsing mechanism to estimate and subtract self-motion from the optic flow field. We investigated whether concurrent acoustic cues for motion can facilitate visual flow parsing, thereby enhancing the detection of moving objects during simulated self-motion. Participants identified an object (the target) that moved either forward or backward within a visual scene containing nine identical textured objects simulating forward observer translation. We found that spatially co-localized, directionally congruent, moving auditory stimuli enhanced object motion detection. Interestingly, subjects who performed poorly on the visual-only task benefited more from the addition of moving auditory stimuli. When auditory stimuli were not co-localized to the visual target, improvements in detection rates were weak. Taken together, these results suggest that parsing object motion from self-motion-induced optic flow can operate on multisensory object representations., L.M.V. and F.J.C. were supported by NIH grant RO1NS064100 to L.M.V. S.S.F. was supported by grants from the Ministerio de Ciencia e Innovación (PSI2010-15426 and CSD2007-00012), by the Comissionat per a Universitats i Recerca del DIUE (SRG2009-092) and by the European Research Council (StG-2010 263145).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Source-reconstruction of the sensorimotor network from resting-state macaque electrocorticography

  • Hindriks, Rikkert
  • Micheli, C.
  • Bosman, Conrado A.
  • Oostenveld, R.
  • Lewis, C.
  • Mantini, Dante
  • Fries, Pascal
  • Deco, Gustavo
The discovery of hemodynamic (BOLD-fMRI) resting-state networks (RSNs) has brought about a fundamental shift in our thinking about the role of intrinsic brain activity. The electrophysiological underpinnings of RSNs remain largely elusive and it has been shown only recently that electric cortical rhythms are organized into the same RSNs as hemodynamic signals. Most electrophysiological studies into RSNs use magnetoencephalography (MEG) or scalp electroencephalography (EEG), which limits the spatial resolution with which electrophysiological RSNs can be observed. Due to their close proximity to the cortical surface, electrocorticographic (ECoG) recordings can potentially provide a more detailed picture of the functional organization of resting-state cortical rhythms, albeit at the expense of spatial coverage. In this study we propose using source-space spatial independent component analysis (spatial ICA) for identifying generators of resting-state cortical rhythms as recorded with ECoG and for reconstructing their functional connectivity. Network structure is assessed by two kinds of connectivity measures: instantaneous correlations between band-limited amplitude envelopes and oscillatory phase-locking. By simulating rhythmic cortical generators, we find that the reconstruction of oscillatory phase-locking is more challenging than that of amplitude correlations, particularly for low signal-to-noise levels. Specifically, phase-lags can both be over- and underestimated, which troubles the interpretation of lag-based connectivity measures. We illustrate the methodology on somatosensory beta rhythms recorded from a macaque monkey using ECoG. The methodology decomposes the resting-state sensorimotor network into three cortical generators, distributed across primary somatosensory and primary and higher-order motor areas. The generators display significant and reproducible amplitude correlations and phase-locking values with non-zero lags. Our findings illustrate the level of spatial detail attainable with source-projected ECoG and motivates wider use of the methodology for studying resting-state as well as event-related cortical dynamics in macaque and human., RH and GD were funded by the European Research Council (Advanced Grant DYSTRUCTURENo.295129),the Spanish Research Project PSI2013-42091-P, the CONSOLIDER- INGENIO2010 Program CSD2007-00012,and the FP7-ICT Brainscales(269921). DM was funded by the Wellcome Trust (grant 101253/Z/13/Z), KU Leuven Research Office (grant C16/15/070), Research Foundation Flanders (grants G0F76.16N and G0936.16N). PF acknowledges grant support by DFG (SPP 1665, FOR 1847, FR2557/5-1-CORNET, FR 2557/6-1-NeuroTMR), EU (HEALTHF22008200728-BrainSynch, FP7-604102-HBP, FP7-600730-Magnetrodes), a European Young Investigator Award, NIH (1U54MH091657-WU-Minn-Consortium-HCP), and LOEWE (NeFF). The authors declare no competing financial interests.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Structure-function discrepancy: inhomogeneity and/ndelays in synchronized neural networks

  • Ton, Robert
  • Deco, Gustavo
  • Daffertshofer, Andreas
The discrepancy between structural and functional connectivity in neural systems forms the challenge in understanding/ngeneral brain functioning. To pinpoint a mapping between structure and function, we investigated the effects of/n(in)homogeneity in coupling structure and delays on synchronization behavior in networks of oscillatory neural masses by/nderiving the phase dynamics of these generic networks. For homogeneous delays, the structural coupling matrix is largely/npreserved in the coupling between phases, resulting in clustered stationary phase distributions. Accordingly, we found only/na small number of synchronized groups in the network. Distributed delays, by contrast, introduce inhomogeneity in the/nphase coupling so that clustered stationary phase distributions no longer exist. The effect of distributed delays mimicked/nthat of structural inhomogeneity. Hence, we argue that phase (de-)synchronization patterns caused by inhomogeneous/ncoupling cannot be distinguished from those caused by distributed delays, at least not by the naked eye. The here-derived/nanalytical expression for the effective coupling between phases as a function of structural coupling constitutes a direct/nrelationship between structural and functional connectivity. Structural connectivity constrains synchronizability that may be/nmodified by the delay distribution. This explains why structural and functional connectivity bear much resemblance albeit/nnot a one-to-one correspondence. We illustrate this in the context of resting-state activity, using the anatomical/nconnectivity structure reported by Hagmann and others., This work was funded by ERC Advanced Grant: DYSTRUCTURE (n. 295129), by the Spanish Research Project SAF2010-16085 and by the CONSOLIDER-/nINGENIO 2010 Program CSD2007-00012, and the FP7-ICT BrainScale
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

From literal meaning to veracity in two hundred milliseconds

  • Martin, Clara D.
  • García, Xavier, 1967-
  • Breton, Audrey
  • Thierry, Guillaume
  • Costa, Albert, 1970-
Do the integration of semantic information and that of world knowledge occur simultaneously or in sequence during sentence processing? To address this question, we investigated event-related brain potentials elicited by the critical word of English sentences in three conditions: (1) correct; (2) semantic violation; (3) world knowledge violation (semantically correct but factually incorrect). Critically, we opted for low constraint sentence contexts (i.e., whilst being semantically congruent with the sentence context, critical words had low cloze probability). The processing of semantic violations differed from that of correct sentences as early as the P2 time-window. In the N400 time-window, the processing of semantic and world knowledge violations both differed significantly from that of correct sentences and differed significantly from one another. Overall, our results show that the brain needs approximately 200 ms more to detect a world knowledge violation than a semantic one., This work was supported by grants from the Spanish Government (PSI2008- 01191, PSI2011-23033, Consolider Ingenio 2010 CSD2007-00012) and the Catalan Government (Consolidado SGR 2009-1521). CM was supported by the Spanish Government (Grant Juan de la Cierva) and is now supported by the IKERBASQUE foundation for science and the Basque Center on Cognition, Brain and Language. GT was supported by the Economic and Social Research Council (ES/E024556/1) and the European Research Council (ERC-SG-209704)
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

La notación prosódica del español: una revisión del Sp-ToBI

  • Estebas Vilaplana, Eva
  • Prieto Vives, Pilar, 1965-
El principal objetivo de este artículo es presentar una nueva propuesta de etiquetaje prosódico del español mediante el modelo métrico-autosegmental de análisis entonativo, Sp_ToBI (Spanish ToBI). Para esta versión de Sp_ToBI nos hemos basado en 1) trabajos tradicionales sobre la entonación del español, 2) una revisión de artículos anteriores sobre el Sp_ToBI y 3) un análisis sistemático de las variedades de español peninsular de Madrid y Sevilla y de la variedad de Ciudad de México. Las unidades fonológicas que constituyen esta versión del Sp_ToBI son las siguientes. El sistema cuenta con dos acentos tonales monotonales (L* y H*) y cuatro acentos tonales bitonales (L*+H, L+H*, L+>H* y H+L*). Los tonos altos H pueden presentar escalonamiento ascendente o descendente. En cuanto a tonos de frontera destacamos tres tonos monotonales (L%, H%, M%), tres tonos bitonales (LH%, HL% y HH%) y un tono tritonal (LHL%). En línea con estudios anteriores descartamos la presencia de tonos de frase. Las novedades de esta propuesta en relación con la primera versión del Sp_ToBI son básicamente tres: 1) la presencia de L* como acento tonal, 2) el triple contraste de acentos tonales ascendentes (L*+H, L+H* y L+>H*) y 3) la existencia de tonos de frontera bitonales y tritonales., The aim of this paper is to present a new proposal of prosodic transcription for Spanish intonation within the autosegmental-metrical framework, Sp_ToBI (Spanish ToBI). This proposal has been based on 1) traditional descriptions of Spanish intonation, 2) a revision of previous works on Sp_ToBI, and 3) a systematic analysis of the Madrid, Sevilla, and Mexico City accents. The phonological units that we propose in this version of Sp_ToBI are the following ones. The system has two monotonal pitch accents (L* and H*) and four bitonal pitch accents (L*+H, L+H*, L+>H* and H+L*). The H tones can be produced with upstep or downstep. As far as boundary tones are concerned, Spanish has three monotonal tones (L%, H%, M%), three bitonal tones (LH%, HL% y HH%) and a tritonal tone (LHL%). In line with previous studies, no phrase accents are found in Spanish intonation. This version of Sp_ToBI includes three new aspects with respect to the former model: 1) the existance of an L* pitch accent, 2) the three-way contrast of rising accents (L*+H, L+H* and L+>H*) and 3) the presence of bitonal and tritonal boundary tones., Este trabajo ha sido financiado por los siguientes proyectos: 2005SGR-00753 (Generalitat de Catalunya), HUM2006-01758/FILO y CONSOLIDER-INGENIO 2010 CSD2007-00012 (Ministerio de Educación y Ciencia-FEDER).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Acoustic correlates of stress in central Catalan and Castilian Spanish

  • Ortega-Llebaria, Marta
  • Prieto Vives, Pilar, 1965-
The general literature on the phonetic correlates of stress agrees that duration, and in stress accent languages, F0 are consistent correlates of stress. However, the role of amplitude changes in the speech signal is more controversial. In particular, the conflicting results of spectral tilt as a correlate of stress have been attributed to the effects of vowel reduction. We examined the stress correlates of duration, overall intensity and spectral tilt in Catalan and Spanish in both accented and unaccented contexts while controlling for formant frequency differences between morphologically corresponding vowels in stressed and unstressed environments by comparing vowels that maintain the same quality across stress contexts with those that do not. Duration was a consistent stress correlate in all vowels in both languages, regardless of their formant frequency differences across stress contexts and of the absence of pitch accents. In fact, stressrelated formant frequency differences between corresponding vowels amplify the duration cues to the stress contrast. On the other hand, the use speakers made of intensity was not as pervasive as that of duration. Specifically, changes in spectral tilt were significant only in Catalan and in those vowels that alternate a more open and peripheral realization in stressed syllables with a mid-central realization in unstressed syllables, indicating that spectral tilt is related to the formant frequency differences linked to the centralization processes rather than to the stress contrast., We would like to thank the audience at the 2005 PaPI Conference, and also Barbara Bullock, Megan Crowhurst, Sónia Frota, José Ignacio Hualde, Scott Myers, Jacqueline Toribio, Daniel Recasens, and Marina Vigário for very useful feedback. We are also grateful to the 20 informants who kindly participated in the production experiment. Thanks to Tim Mills who kindly sent us the script that measures spectral tilt. Special thanks to John Coleman and two anonymous reviewers, whose insightful comments greatly improved the quality of this article. This research has been funded by grant 2005SGR-00753, awarded by the Generalitat de Catalunya, and by grants HUM2006-01758/FILO “Estructura prosódica y adquisición de la prosodia en catalán y español”, CONSOLIDER-INGENIO 2010 “Bilingüismo y Neurociencia Cognitiva CSD2007-00012” awarded by the Spanish Ministerio de Educación y Ciencia, and URA Program awarded by the College of Liberal Arts, University of Texas.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Prediction of decisions from noise in the brain before the evidence is provided

  • Rolls, Edmund T
  • Deco, Gustavo
Can decisions be predicted from brain activity? It is frequently difficult in neuroimaging studies to determine this, because it is not easy to establish when the decision has been taken. In a rigorous approach to this issue, we show that in a neurally plausible integrate-and-fire attractor-based model of decision-making, the noise generated by the randomness in the spiking times of neurons can be used to predict a decision for 0.5 s or more before the decision cues are applied. The ongoing noise at the time the decision cues are applied influences which decision will be taken. It is possible to predict on a single trial to more than 68% correct which of two decisions will be taken. The prediction is made from the spontaneous firing before the decision cues are applied in the two populations of neurons that represent the decisions. Thus decisions can be partly predicted even before the decision cues are applied, due to noise in the decision-making process. This analysis has interesting implications for decision-making and free will, for it shows that random neuronal firing times can influence a decision before the evidence for the decision has been provided., Gustavo Deco received support from the McDonnell Centre for Cognitive Neuroscience at Oxford University, from European Union grant EC005-024, from the Spanish Research Project SAF2010-16085, and from the CONSOLIDER-INGENIO 2010 Programme CSD2007-00012. The research was supported by the Oxford Centre for Computational Neuroscience.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

The Interplay between semantic and phonological constraints during spoken-word comprehension

  • Soto-Faraco, Salvador, 1970-
  • Brunellière, Angèle
This study addresses how top-down predictions driven by phonological and semantic information interact on spokenword comprehension. To do so, we measured event-related potentials to words embedded in sentences that varied in the degree of semantic constraint (high or low) and in regional accent (congruent or incongruent) with respect to the target word pronunciation. The data showed a negative amplitude shift following phonological mismatch (target pronunciation incongruent with respect to sentence regional accent). Here, we show that this shift is modulated by sentence-level semantic constraints over latencies encompassing auditory (N100) and lexical (N400) components. These findings suggest a fast influence of top-down predictions and the interplay with bottom-up processes at sublexical and lexical levels of analysis, This research was supported by the Spanish Ministry of Science and Innovation (PSI2010-15426 and Consolider INGENIO CSD2007-00012), Comissionat per a Universitats i Recerca del DIUE-Generalitat de/nCatalunya (SGR2009-092), and the European Research Council (StG-2010263145). ERP analyses were performed with the Cartool software (supported by the Center for Biomedical Imaging of Geneva and Lausanne).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Analysis of inter-transcriber consistency in the Cat_ToBI prosodic labeling system

  • Escudero Mancebo, David
  • Aguilar Cuevas, Lourdes
  • Vanrell, Maria del Mar
  • Prieto Vives, Pilar, 1965-
A set of tools to analyze inconsistencies observed in a Cat_ToBI labeling experiment are presented. We formalize and use the metrics that are commonly used in inconsistency tests. The metrics are systematically applied to analyze the robustness of every symbol and every pair of transcribers. The results reveal agreement rates for this study that are comparable to previous ToBI inter-reliability tests. The inter-transcriber confusion rates are transformed into distance matrices to use multidimensional scaling for visualizing the confusion between the different ToBI symbols and the disagreement between the raters. Potential different labeling criteria are identified and subsets of symbols that are candidates to be fused are proposed., The authors are indebted to other researchers of the Grup d’Estudis de Prosòdia GrEP (Departament de Traducció i Ciències del Llenguatge, Universitat Pompeu Fabra) who contributed constructively to the discussion of this work while it was underway. Particular thanks are due to the subjects who performed the annotations of Catalan utterances (J. Borràs-Comes, V. Crespo-Sendra, R. Sichel-Bazin, E. Estebas-Vilaplana and the postgraduate students CA, CR, EP and GV) for their valuable comments and information./n/nThis research has been funded by six research grants awarded by the Spanish Ministerio de Ciencia e Innovación, namely the Glissando project FFI2008-04982-C003-02, FFI2008-04982-C003-03, FFI2011-29559-C02-01, FFI2011-29559-C02-02, FFI2009-07648/FILO and CONSOLIDER-INGENIO 2010 Programme CSD2007-00012, and by a grant awarded by the Generalitat de Catalunya to the Grup d’Estudis de Prosòdia (2009SGR-701).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

The relevance of prosodic structure in tonal articulation. Edge effects at the prosodic word level in Catalan and Spanish

  • Prieto Vives, Pilar, 1965-
  • Estebas Vilaplana, Eva
  • Vanrell, Maria del Mar
We conducted a production experiment with 1600 potentially ambiguous utterances distinguished by word boundary location in Catalan and Spanish (e.g., Cat. mirà batalles ‘(s)he looked at battles’ vs. mirava talles ‘I/(s)he used to look at carvings’; Span. da balazos ‘(s)he fires shots’ vs. daba lazos ‘I/(s)he gave ribbons’; stressed syllables are underlined). Results revealed strong effects of within-word position on H location. Peaks tended to be timed earlier with respect to the end of the syllable when their associated syllables occurred later in the word than when they occurred earlier in the word. These results confirmed previous findings for other languages ( Silverman & Pierrehumbert, 1990 for English; Arvaniti, Ladd, & Mennen, 1998 for Greek; and Ishihara, 2006 for Japanese; and Godjevac, 2000 for Serbo-Croatian) and for Spanish and Catalan (Prieto, van Santen, & Hirschberg, 1995 for Spanish; de la Mota, 2005; Simonet, 2006, Simonet & Torreira, 2005 for Catalan). A set of perception experiments suggested that tonal alignment patterns influence listeners’ judgments of word boundary location both in Catalan and in Spanish. Listeners were able to employ fine allophonic details of H tonal alignment due to within-word position to identify lexical items that are ambiguous for word-boundary position. The data is consistent with the view that prosodic structure plays an essential part in determining the temporal coordination of f0 contours with segmental material., Parts of this study were presented at the ESF International Conference on Tone and Intonation (Santorini, September 2004), the 2nd Phonetics and Phonology in Iberia (Bellaterra, June 2005), the Xth Conference on Laboratory Phonology (Paris, June 2006) and at talks at the Laboratoire Parole et Langage (Aix-en-Provence, April 2005) and Institut de la Communication Parlée (Grenoble, November 2005). We are grateful to the audience at these conferences, and especially to C. de la Mota, G. Elordieta, C. Gussenhoven, J.I. Hualde, D.R. Ladd, H. Lœvenbruck, J. Kingston, C. Petrone, M. Simonet, F. Torreira, P. Welby for very useful feedback. We are grateful to friends and colleagues for their participation in the production and perception experiments. We would like to thank the Associate Editor and the three reviewers (D.R. Ladd, P. Welby, and an anonymous reviewer) for their very thorough reviews which have helped improved the final quality of the paper. Finally, we would like to thank F. Torreira and P. Welby, for their help with the Praat scripts, C. André, M. D’Imperio and C. Petrone for their support with the use of Perceval, and the SEA (Servei d’Estadística de la Universitat Autònoma de Barcelona) for their help with the statistical analysis of the data. This research has been funded by projects FFI2009-07648/FILO and CONSOLIDER-INGENIO 2010 Programme CSD2007-00012 (both awarded by the Ministerio de Ciencia e Innovación) and by project 2009 SGR 701 (awarded by the Generalitat de Catalunya).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Prosodic structure shapes the temporal realization of intonation and manual gesture movements

  • Prieto Vives, Pilar, 1965-
  • Esteve Gibert, Núria
Purpose: Previous work on the temporal coordination between gesture and speech found that the prominence in gesture coordinates with speech prominence. This study investigates the anchoring regions in speech and pointing gesture aligning with each other. Our hypotheses are that (a) in contrastive focus conditions the gesture apex is anchored in the intonation peak, (b) the upcoming prosodic boundary influences the timing of gesture and intonation movements. Method: 15 Catalan speakers pointed at a screen while pronouncing a target word with different metrical patterns in a contrastive focus condition and followed by a phrase boundary. A total of 702 co-speech deictic gestures were acoustically and gesturally analyzed. Results: Intonation peaks and gesture apexes showed parallel behavior with respect to their position within the accented syllable: they occurred at the end of the accented syllable in non-phrase-final position, whereas they occurred well before the end of the accented syllable in phrase-final position. Crucially, the position of intonation peaks and gesture apexes was correlated and was bound by prosodic structure. Conclusions: The results refine the phonological synchronization rule (McNeill, 1992), showing that gesture apexes are anchored in intonation peaks, and that gesture and prosodic movements are bound by prosodic phrasing., This research was funded by two research grants awarded by the Spanish Ministry of Science and Innovation (Grant FFI2009-07648/FILO, “The Role of Tonal Scaling and Tonal Alignment in Distinguishing Intonational Categories in Catalan and Spanish,” and Grant FFI2012-31995, “Gestures, Prosody and Linguistic Structure”); by a grant from the Generalitat de Catalunya (2009SGR-701), awarded to the Grup d’Estudis de Prosòdia; by Grant RECERCAIXA 2012 (for the project “Els Precursors del Llenguatge. Una Guia TIC per a Pares i Educadors” awarded by Obra Social ‘La Caixa’); and by the Consolider-Ingenio 2010 (CSD2007-00012) grant.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

The influence of spatiotemporal structure of noisy stimuli in decision making

  • Insabato, Andrea
  • Dempere-Marco, Laura
  • Pannunzi, Mario
  • Deco, Gustavo
  • Romo, Ranulfo
Decision making is a process of utmost/nimportance in our daily lives, the study of which has/nbeen receiving notable attention for decades. Nevertheless,/nthe neural mechanisms underlying decision making/nare still not fully understood. Computational modeling/nhas revealed itself as a valuable asset to address some of/nthe fundamental questions. Biophysically plausible models,/nin particular, are useful in bridging the different levels/nof description that experimental studies provide, from the/nneural spiking activity recorded at the cellular level to the/nperformance reported at the behavioral level. In this/narticle, we have reviewed some of the recent progress/nmade in the understanding of the neural mechanisms that/nunderlie decision making. We have performed a critical/nevaluation of the available results and address, from a/ncomputational perspective, aspects of both experimentation/nand modeling that so far have eluded comprehension./nTo guide the discussion, we have selected a central/ntheme which revolves around the following question: how/ndoes the spatiotemporal structure of sensory stimuli affect/nthe perceptual decision-making process? This question is a/ntimely one as several issues that still remain unresolved/nstem from this central theme. These include: (i) the role of/nspatiotemporal input fluctuations in perceptual decision/nmaking, (ii) how to extend the current results and models/nderived from two-alternative choice studies to scenarios/nwith multiple competing evidences, and (iii) to establish/nwhether different types of spatiotemporal input fluctuations/naffect decision-making outcomes in distinctive ways./nAnd although we have restricted our discussion mostly to/nvisual decisions, our main conclusions are arguably/ngeneralizable; hence, their possible extension to other/nsensory modalities is one of the points in our discussion., AI acknowledges funding from the SUR, DEC of the Generalitat de/nCatalunya and FSE. LDM is a Ramon y Cajal Fellow and acknowledges funding/nfrom the Ministry of Science and Innovation through the Ramon y Cajal/nprogramme. She also acknowledges financial support from the research project/nTIN2010-21771-C02-02 funded by the Ministry of Science and Innovation. MP was/nsupported by the CONSOLIDER-INGENIO 2010 Program CSD2007-00012. GD was/nsupported by the ERC Advanced Grant: DYSTRUCTURE (n. 295129), by the Spanish/nResearch Project SAF2010-16085 and by the CONSOLIDER-INGENIO 2010 Program/nCSD2007-00012, and the FP7-ICT BrainScales and Coronet. RR was supported by/ngrants from the Dirección de Personal Académico de la Universidad Nacional/nAutónoma de México and the Consejo Nacional de Ciencia y Tecnología.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Cortical microcircuit dynamics mediating binocular rivalry: the role of adaptation in inhibition

  • Theodoni, Panagiota
  • Panagiotaropoulos, Theofanis I.
  • Kapoor, Vishal
  • Logothetis, Nikos
  • Deco, Gustavo
Perceptual bistability arises when two conflicting interpretations of an ambiguous stimulus or images in binocular rivalry (BR) compete for perceptual dominance. From a computational point of view, competition models based on cross-inhibition and adaptation have shown that noise is a crucial force for rivalry, and operates in balance with adaptation. In particular, noise-driven transitions and adaptation-driven oscillations define two dynamical regimes and the system explains the observed alternations in perception when it operates near their boundary. In order to gain insights into the microcircuit dynamics mediating spontaneous perceptual alternations, we used a reduced recurrent attractor-based biophysically realistic spiking network, well known for working memory, attention, and decision making, where a spike-frequency adaptation mechanism is implemented to account for perceptual bistability. We thus derived a consistently reduced four-variable population rate model using mean-field techniques, and we tested it on BR data collected from human subjects. Our model accounts for experimental data parameters such as mean time dominance, coefficient of variation, and gamma distribution fit. In addition, we show that our model operates near the bifurcation that separates the noise-driven transitions regime from the adaptation-driven oscillations regime, and agrees with Levelt’s second revised and fourth propositions. These results demonstrate for the first time that a consistent reduction of a biophysically realistic spiking network of leaky integrate-and-fire neurons with spike-frequency adaptation could account for BR. Moreover, we demonstrate that BR can be explained only through the dynamics of competing neuronal pools, without taking into account the adaptation of inhibitory interneurons. However, the adaptation of interneurons affects the optimal parametric space of the system by decreasing the overall adaptation necessary for the bifurcation to occur, and introduces oscillations in the spontaneous state., The authors would like to thank KongFatt Wong, Antoni Guillamon, James Rankin, Robert Ton, for their useful communications, and Tristan Nakagawa for his comments on the manuscript. The research leading to these results has received funding from the European Community’s Seventh Framework Programme FP7/2007-2013 under grant agreement number 214728-2, and the Max Planck Society. It was also supported by the European Union grant “Brainsynch” and “BrainScaleS” by the Spanish Research Project SAF2010-16085, and by the CONSOLIDER – INGENIO 2010 Programme CSD2007-00012.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

How Local Excitation–Inhibition Ratio Impacts the Whole/nBrain Dynamics

  • Deco, Gustavo
  • Ponce-Alvarez, Adrián
  • Hagmann, Patric
  • Romani, Gian Luca
  • Mantini, Dante
  • Corbetta, Maurizio
The spontaneous activity of the brain shows different features at different scales. On one hand, neuroimaging studies show that long-range correlations are highly structured in spatiotemporal patterns, known as resting-state networks, on the other hand, neurophysiological reports show that short-range correlations between neighboring neurons are low, despite a large amount of shared presynaptic inputs. Different dynamical mechanisms of local decorrelation have been proposed, among which is feedback inhibition. Here, we investigated the effect of locally regulating the feedback inhibition on the global dynamics of a large-scale brain model, in which the long-range connections are given by diffusion imaging data of human subjects. We used simulations and analytical methods to show that locally constraining the feedback inhibition to compensate for the excess of long-range excitatory connectivity, to preserve the asynchronous state, crucially changes the characteristics of the emergent resting and evoked activity. First, it significantly improves the model's prediction of the empirical human functional connectivity. Second, relaxing this constraint leads to an unrealistic network evoked activity, with systematic coactivation of cortical areas which are components of the default-mode network, whereas regulation of feedback inhibition prevents this. Finally, information theoretic analysis shows that regulation of the local feedback inhibition increases both the entropy and the Fisher information of the network evoked responses. Hence, it enhances the information capacity and the discrimination accuracy of the global network. In conclusion, the local excitation–inhibition ratio impacts the structure of the spontaneous activity and the information transmission at the large-scale brain level., G.D. was supported by the ERC Advanced Grant: DYSTRUCTURE (no. 295129), by the Spanish Research Project SAF2010-16085 and by the CONSOLIDER-INGENIO 2010 Program CSD2007-00012, the Foundation “La Marato” (Catalonia), and the FP7-ICT BrainScales and The Human Brain Project FET-Flagship. P.H was supported by Leenaards Foundation. M.C. was supported by NIH Grants R01HD061117 and R01MH096482. The research reported herein was supported by the Brain Network Recovery Group through the James S. McDonnell Foundation. We thank H. Sompolinsky and M. Lechón for critical comments and valuable discussions
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

On the bilingualism effect in task switching

  • Branzi, Francesca Martina, 1984-
  • Calabria, Marco
  • Gade, Miriam
  • Fuentes, Luis J.
  • Costa, Albert, 1970-
In one task-switching experiment, we compared bilinguals and monolinguals to explore the reliability of the bilingualism effect on the n-2 repetition cost. In a second taskswitching experiment, we tested another group of bilinguals and monolinguals and measured both the n-1 shift cost and the n-2 repetition cost to test the hypothesis that bilingualism should confer a general greater efficiency of the executive control functioning. According to this hypothesis, we expected a reduced n-1 shift cost and an enhanced n-2 repetition cost for bilinguals compared to monolinguals. However, we did not observe such results. Our findings suggest that previous results cannot be replicated and that the n-2 repetition cost is another index that shows no reliable bilingualism effect. Finally, we observed a negative correlation between the two switch costs among bilinguals only. This finding may suggest that the two groups employ different strategies to cope with interference in task-switching paradigms., We are grateful to Dr. Kenneth Paap and Dr. Mireia Hernández for their useful comments on the previous versions of this manuscript. This work was supported by grants from the Spanish Government (PSI2014-54500, PSI2008-01191, PSI2011-23033, PSI2014-53427-P, Consolider Ingenio 2010 CSD2007-00012), the Catalan Government (Consolidat SGR 2009-1521 and SGR 2014-1210), by one grant from the European Research Council under the European Community’s Seventh Framework (FP7/2007-2013 Cooperation grant agreement 613465-AThEME), by one grant from Fundación Séneca (19267/PI/14) and by the Severo Ochoa program grant SEV-2015-049. Francesca M. Branzi was supported by a predoctoral fellowship from the Spanish Government (FPU-2009-2013) and by a postdoctoral fellowship from the European Union’s Horizon 2020 research and innovation programme, under the Marie Sklodowska-Curie grant agreement No 658341. Marco Calabria was supported by a postdoctoral fellowship from the Spanish Government (Ramón y Cajal Fellowship).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

On the nature of the word-reduction phenomenon: the contribution of bilingualism

  • Rodriguez-Cuadrado, Sara
  • Baus, Cristina
  • Costa, Albert, 1970-
Word reduction refers to how predictable words are shortened in features such as duration, intensity, or pitch. However, its origin is still unclear: Are words reduced because it is the second time that conceptual representations are activated, or because words are articulated twice? If word reduction is conceptually driven, it would be irrelevant whether the same referent is mentioned twice but using different words. However, if is articulatory, using different words for the same referent could prevent word reduction. In the present work, we use bilingualism to explore the conceptual or articulatory origin of word reduction in language production. Word reduction was compared in two conditions: a non-switch condition, where the two mentions of a referent were uttered in the same language, and a switch condition, where the referent was said in both languages. Dyads of participants completed collaborative maps in which words were uttered twice in Catalan or in Spanish, either repeating or switching the language between mentions. Words were equally reduced in duration, intensity, and pitch in non-switch and in switch conditions. Furthermore, the cognate status of words did not play any role. These findings support the theory that word reduction is conceptually driven., This work was supported by grants from the Spanish Government (PSI2017-84539-P, Consolider Ingenio 2010 CSD2007-00012) and the Catalan government (2017 SGR 268). Sara Rodríguez-Cuadrado was supported by a predoctoral fellowship from the Spanish Government (FPU 2008-2012). Cristina Baus was supported by the Beatriu de Pinòs fellowship (AGAUR).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

The timing of vision - how neural processing links to different temporal dynamics

  • Masquelier, Timothée
  • Albantakis, Larissa
  • Deco, Gustavo
In this review, we describe our recent attempts to model the neural correlates of visual perception with biologically inspired networks of spiking neurons, emphasizing the dynamical aspects. Experimental evidence suggests distinct processing modes depending on the type of task the visual system is engaged in. A first mode, crucial for object recognition, deals with rapidly extracting the glimpse of a visual scene in the first 100 ms after its presentation. The promptness of this process points to mainly feedforward processing, which relies on latency coding, and may be shaped by spike timing-dependent plasticity (STDP). Our simulations confirm the plausibility and efficiency of such a scheme. A second mode can be engaged whenever one needs to perform finer perceptual discrimination through evidence accumulation on the order of 400 ms and above. Here, our simulations, together with theoretical considerations, show how predominantly local recurrent connections and long neural time-constants enable the integration and build-up of firing rates on this timescale. In particular, we review how a non-linear model with attractor states induced by strong recurrent connectivity provides straightforward explanations for several recent experimental observations. A third mode, involving additional top-down attentional signals, is relevant for more complex visual scene processing. In the model, as in the brain, these top-down attentional signals shape visual processing by biasing the competition between different pools of neurons. The winning pools may not only have a higher firing rate, but also more synchronous oscillatory activity. This fourth mode, oscillatory activity, leads to faster reaction times and enhanced information transfers in the model. This has indeed been observed experimentally. Moreover, oscillatory activity can format spike times and encode information in the spike phases with respect to the oscillatory cycle. This phenomenon is referred to as “phase-of-firing coding,” and experimental evidence for it is accumulating in the visual system. Simulations show that this code can again be efficiently decoded by STDP. Future work should focus on continuous natural vision, bio-inspired hardware vision systems, and novel experimental paradigms to further distinguish current modeling approaches., The authors were supported by the Fyssen Foundation, the FP7 European Project Coronet, and the CONSOLIDER-INGENIO 2010 Programme CSD2007-00012.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

On the overlap between bilingual language control and domain-general executive control

  • Branzi, Francesca Martina, 1984-
  • Calabria, Marco
  • Boscarino, Maria Lucrezia
  • Costa, Albert, 1970-
We explored the overlap between bilingual language control (bLC) and domain-general executive control (EC) by focusing on inhibitory control processes. We tested 62 bilinguals in linguistic and non-linguistic switching tasks for two types of costs, such as the n − 1 shift cost and the n − 2 repetition cost. In order to explore the involvement of inhibitory control in bLC and EC, we assessed the pattern of switch costs in the two tasks and then we correlated them between tasks. Results showed reduced n − 2 repetition costs as compared to n − 1 shift costs in the linguistic task only, suggesting that small amount of inhibition were deployed when switching between languages. Importantly, neither the n − 1 shift costs nor the n − 2 repetition costs were correlated between tasks. These results, supported by additional evidence from the ex-Gaussian analysis, suggest that inhibitory control is differently involved in bLC and in EC., This work was supported by grants from the Spanish Government (PSI2014- 54500, PSI2008-01191, PSI2011-23033, PSI2011-23340, Consolider Ingenio 2010 CSD2007-00012), the Catalan Government (Consolidat SGR 2009-1521 and SGR 2014-1210) and by one grant from the European Research Council under the European Community’s Seventh Framework (FP7/2007-2013 Cooperation grant agreement 613465-AThEME). This research received partial financial assistance as a Severo Ochoa Center of Excellence SEV-2015-0490. Francesca M. Branzi was supported by a predoctoral fellowship from the Spanish Government (FPU-2009- 2013) and by a postdoctoral fellowship from the European Union’s Horizon 2020 research and innovation programme, under the Marie Sklodowska-Curie grant agreement No 658341. Marco Calabria was supported by a postdoctoral fellowship from the Spanish Government (Ramón y Cajal Fellowship).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

The acquisition of melodic form and meaning in yes-no interrogatives by Catalan and Spanish speaking children

  • Thorson, Jill C.
  • Borràs Comes, Joan Manel, 1984-
  • Crespo Sendra, Verònica
  • Vanrell, Maria del Mar
  • Prieto Vives, Pilar, 1965-
This study investigates the link between interrogative intonation and meaning in child-directed speech (henceforth CDS) and how this is reflected in the early development of yes-no-interrogatives of Catalan- and Spanish-speaking children. Previous research found that children before the two-word period produce several types of interrogatives and that their productions generally reflect the adult inventory pattern (Lleó & Rakow 2011; Prieto et al. 2012). Yet prior studies have not included an analysis of the pragmatic meanings that are encoded intonationally. This investigation takes an integrated approach to the study of intonational development within the domain of yes-no questions, exploring further the correspondence between intonational form and meaning in early interrogative production and relating it to the pragmatics of interrogative intonation in child-directed speech. A set of 723 interrogative utterances produced by 3 Catalan-and 2 Spanish-acquiring children between the onset of nterrogative production and 2;4 were pragmatically and then prosodically analyzed, as well as a set of 867 utterances from Catalan and Spanish CDS. The data were extracted from the Serra-Solé Catalan Corpus and the Ojea and López-Ornat Spanish Corpora/nin CHILDES. Production results show that all children perform some instance of questioning before the two-word period and that their productions generally reflect the adult inventory patterns. Moreover, the results show a preference relationship between the different types of nuclear pitch configurations and the pragmatic meanings that underlie the yes-no-interrogative forms. Finally, these results highlight the importance of the assessment of form-meaning relationships for the understanding of intonational development., The project was funded by grants FFI2009-07648/FILO, BFU2012-31995, and CONSOLIDER-INGENIO 2010 ‘Bilingüismo y Neurociencia Cognitiva CSD2007-00012’ awarded by the Spanish Ministry of Science and Innovation and by project 2009 SGR 701 awarded by the Generalitat de Catalunya.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Beat gestures modulate auditory integration in speech perception

  • Biau, Emmanuel, 1985-
  • Soto-Faraco, Salvador, 1970-
Spontaneous beat gestures are an integral part of the paralinguistic context during face-to-face conversations. Here we investigated the time course of beat-speech integration in speech perception by measuring ERPs evoked by words pronounced with or without an accompanying beat gesture, while participants watched a spoken discourse. Words accompanied by beats elicited a positive shift in ERPs at an early sensory stage (before 100 ms) and at a later time window coinciding with the auditory component P2. The same word tokens produced no ERP differences when participants listened to the discourse without view of the speaker. We conclude that beat gestures are integrated with speech early on in time and modulate sensory/phonological levels of processing. The present results support the possible role of beats as a highlighter, helping the listener to direct the focus of attention to important information and modulate the parsing of the speech stream., This research was supported by the Spanish Ministry of Science and Innovation (PSI2010-15426 and Consolider INGENIO CSD2007-00012), Comissionat per a Universitats i Recerca del DIUE-Generalitat de Catalunya (SRG2009-092), and the European Research Council (StG-2010 263145).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

The speakers’ accent shapes the listeners’ phonological predictions during speech perception

  • Brunellière, Angèle
  • Soto-Faraco, Salvador, 1970-
This study investigates the specificity of predictive coding in spoken word comprehension using event-related potentials (ERPs). We measured word-evoked ERPs in Catalan speakers listening to semantically constraining sentences produced in their native regional accent (Experiment 1) or in a non-native accent (Experiment 2). Semantically anomalous words produced long-lasting negative shift (N400) starting as early as 250 ms, thus reflecting phonological as well as semantic mismatch. Semantically expected but phonologically unexpected (non-native forms embedded in a native context) produced only an early (∼250 ms) negative difference. In contrast, this phonological expectancy effect failed for native albeit phonologically unexpected target words embedded in a non-native context. These results suggest phonologically precise expectations when operating over native input, whilst phonologically less specified expectations in a non-native context. Our findings shed light on contextual influence during word recognition, suggesting that word form prediction based on context is sensitive and adaptive to phonological variability., his research was supported by the Spanish Ministry of Science and Innovation (PSI2010-15426 and Consolider INGENIO CSD2007-00012), Comissionat per a Universitats i Recerca del DIUE-Generalitat de Catalunya (SGR2009-092), and the European Research Council (StG-2010263145).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Neural plasticity in human brain connectivity: the effects of long term deep brain stimulation of the subthalamic nucleus in Parkinson's disease

  • Van Hartevelt, Tim J.
  • Cabral, Joana
  • Deco, Gustavo
  • Møller, Arne
  • Green, Alex L.
  • Aziz, Tipu Z.
  • Kringelbach, Morten L.
Background: Positive clinical outcomes are now well established for deep brain stimulation, but little is known about the effects of long-term deep brain stimulation on brain structural and functional connectivity. Here, we used the rare opportunity to acquire pre- and postoperative diffusion tensor imaging in a patient undergoing deep brain stimulation in bilateral subthalamic nuclei for Parkinson’s Disease. This allowed us to analyse the differences in structural connectivity before and after deep brain stimulation. Further, a computational model of spontaneous brain activity was used to estimate the changes in functional connectivity arising from the specific changes in structural connectivity./nResults: We found significant localised structural changes as a result of long-term deep brain stimulation. These changes were found in sensory-motor, prefrontal/limbic, and olfactory brain regions which are known to be affected in Parkinson’s Disease. The nature of these changes was an increase of nodal efficiency in most areas and a decrease of nodal efficiency in the precentral sensory-motor area. Importantly, the computational model clearly shows the impact of deep brain stimulation-induced structural alterations on functional brain changes, which is to shift the neural dynamics back towards a healthy regime. The results demonstrate that deep brain stimulation in Parkinson’s Disease leads to a topological reorganisation towards healthy bifurcation of the functional networks measured in controls, which suggests a potential neural mechanism for the alleviation of symptoms./nConclusions: The findings suggest that long-term deep brain stimulation has not only restorative effects on the structural connectivity, but also affects the functional connectivity at a global level. Overall, our results support causal changes in human neural plasticity after long-term deep brain stimulation and may help to identify the underlying mechanisms of deep brain stimulation., MLK and TJVH are funded by the TrygFonden Charitable Foundation. TZA is funded by the Medical Research Council, the Norman Collisson Foundation/nand the Charles Wolfson Charitable Trust. ALG is supported by the NIHR Biomedical Research Centre, Oxford. GD and JC were supported by the ERC Advanced/nGrant: DYSTRUCTURE (n. 295129), by the Spanish Research Project SAF2010-16085 and by the CONSOLIDER-INGENIO 2010 Programme CSD2007-00012, the FP7-/nICT BrainScales and by the Brain Network Recovery Group through the James S. McDonnell Foundation.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Ongoing cortical activity at rest: criticality, multistability,/nand ghost attractors

  • Deco, Gustavo
  • Jirsa, Viktor K.
The ongoing activity of the brain at rest, i.e., under no stimulation and in absence of any task, is astonishingly highly structured into/nspatiotemporal patterns. These spatiotemporal patterns, called resting state networks, display low-frequency characteristics (<0.1 Hz)/nobserved typically in the BOLD-fMRI signal of human subjects. We aim here to understand the origins of resting state activity through/nmodeling via a global spiking attractor network of the brain. This approach offers a realistic mechanistic model at the level of each single/nbrain area based on spiking neurons and realistic AMPA, NMDA, and GABA synapses. Integrating the biologically realistic diffusion/ntensor imaging/diffusion spectrum imaging-based neuroanatomical connectivity into the brain model, the resultant emerging resting/nstate functional connectivity of the brain network fits quantitatively best the experimentally observed functional connectivity in humans/nwhen the brain network operates at the edge of instability. Under these conditions, the slow fluctuating (</n0.1 Hz) resting state networks/nemerge as structured noise fluctuations around a stable low firing activity equilibrium state in the presence of latent “ghost” multistable/nattractors. The multistable attractor landscape defines a functionally meaningful dynamic repertoire of the brain network that is inher-/nently present in the neuroanatomical connectivity., G.D. was supported by the European Union Grant EC005-024, by SAF2010-16085 and the “La Marato”/nFoundation,andbytheCONSOLIDER-INGENIO2010ProgrammeCSD2007-00012.The research reported here in was/nsupported by the Brain Network Recovery Group through the James S. McDonnell Foundation and the FP7-ICT/nBrainScales.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Network bursting dynamics in excitatory cortical neuron cultures results from the combination of different adaptive mechanism

  • Masquelier, Timothée
  • Deco, Gustavo
In the brain, synchronization among cells of an assembly is a common phenomenon, and thought to be functionally /nrelevant. Here we used an in vitro experimental model of cell assemblies, cortical cultures, combined with numerical/nsimulations of a spiking neural network (SNN) to investigate how and why spontaneous synchronization occurs. In order to/ndeal with excitation only, we pharmacologically blocked GABAAergic transmission using bicuculline. Synchronous events in/ncortical cultures tend to involve almost every cell and to display relatively constant durations. We have thus named these/n‘‘network spikes’’ (NS). The inter-NS-intervals (INSIs) proved to be a more interesting phenomenon. In most cortical cultures/nNSs typically come in series or bursts (‘‘bursts of NSs’’, BNS), with short (,1 s) INSIs and separated by long silent intervals/n(tens of s), which leads to bimodal INSI distributions. This suggests that a facilitating mechanism is at work, presumably/nshort-term synaptic facilitation, as well as two fatigue mechanisms: one with a short timescale, presumably short-term/nsynaptic depression, and another one with a longer timescale, presumably cellular adaptation. We thus incorporated these/nthree mechanisms into the SNN, which, indeed, produced realistic BNSs. Next, we systematically varied the recurrent/nexcitation for various adaptation timescales. Strong excitability led to frequent, quasi-periodic BNSs (CV,0), and weak/nexcitability led to rare BNSs, approaching a Poisson process (CV,1). Experimental cultures appear to operate within an/nintermediate weakly-synchronized regime (CV,0.5), with an adaptation timescale in the 2–8 s range, and well described by/na Poisson-with-refractory-period model. Taken together, our results demonstrate that the INSI statistics are indeed/ninformative: they allowed us to infer the mechanisms at work, and many parameters that we cannot access experimentally., This work was funded by the European Union Seventh Framework Program (FP7/2007-2013) under grant agreements no. 269459 (Coronet). GD was/nalso supported by the ERC Advanced Grant: DYSTRUCTURE (n. 295129), by the Spanish Research Project SAF2010-16085, and by the CONSOLIDER-INGENIO 2010/nProgram CSD2007-00012.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Prosody signals the emergence of intentional communication in the first year of life: evidence from Catalan-babbling infants

  • Prieto Vives, Pilar, 1965-
  • Esteve-Gibert, Núria
There is considerable debate about whether early vocalizations mimic the target language and whether prosody signals emergent intentional communication. A longitudinal corpus of four Catalan-babbling infants was analyzed to investigate whether children use different prosodic patterns to distinguish communicative from investigative vocalizations and to express intentionality. A total of 2,701 vocalizations from 0;7 to 0;11 were coded acoustically (by marking pitch range and duration), gesturally, and pragmatically (by marking communicative status and specific pragmatic function). The results showed that communicative vocalizations were shorter and had a wider pitch range than investigative vocalizations and that these patterns in communicative vocalizations depended on the intention of the vocalizations: requests and expressions of discontent displayed wider pitch range and longer duration than responses or statements. These results support the hypothesis that babbling children can successfully use a set of prosodic patterns to signal intentional speech., This research has been funded by the following 5 grants: two research grants awarded by the Spanish Ministry of Science and Innovation, ‘The role of tonal scaling and tonal alignment in distinguishing intonational categories in Catalan and Spanish’ (FFI2009-07648/FILO), and ‘Gestures, prosody and linguistic structure’ (FFI2012-31995); a grant awarded by the Generalitat de Catalunya to the Grup d'Estudis de Prosòdia (2009SGR-701); the grant RECERCAIXA 2012 for the project ‘Els precursors del llenguatge. Una guia TIC per a pares i educadors’ awarded by Obra Social ‘La Caixa’ and the grant Consolider-Ingenio 2010 (CSD2007-00012).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

The acquisition of coda consonants by Catalan and Spanish children: effects of prominence and frequency of exposure

  • Borràs Comes, Joan Manel, 1984-
  • Prieto Vives, Pilar, 1965-
One of the challenges of child language research is to identify the relevant factors that play a role in the acquisition course of a particular linguistic feature. This article analyzes the role of stress, word position, and word length in the acquisition of coda consonants by Catalan and Spanish children. The fact that the two languages differ substantially in their coda distribution (e.g., stressed word-final codas are more frequent in Catalan than in Spanish) will allow us to test the potential effects of coda distribution in the target language on early coda production. Sixteen Catalan-dominant and Spanish-dominant two-year-olds from the Barcelona area participated in two elicitation tasks with both novel and familiar words of different phonological shapes. Coda productions were assessed in stressed vs. unstressed syllables, in word-medial vs. word-final syllables, and in monosyllables vs. polysyllables. Results showed that the distributional difference between coda consonants in the two languages has crucial effects on the children’s coda production. That is, Catalan-dominant children produce significantly more stressed word-final codas than Spanish-dominant children. This result lends support to the idea that when prominence is held equal, as in a controlled experiment, there are still crosslinguistic differences in coda production that are consistent with the frequency distribution of coda consonants in the respective languages, which means that children are very closely attuned to the frequency patterns of prosodic structure in the input language and are aware of their specific distributions across the lexicon., This research has been funded by two research grants awarded by the Spanish Ministerio de Educación y Ciencia, FFI2009-07648/FILO “The role of tonal scaling and tonal alignment in distinguishing intonational categories in Catalan and Spanish” and CONSOLIDER-INGENIO 2010 “Bilingüismo y Neurociencia Cognitiva CSD2007-00012”, and also by a grant awarded by the Generalitat de Catalunya/nto Grup d’Estudis de Prosòdia (2009SGR-701).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Qualitative differences between bilingual language control and executive control: evidence from task-switching

  • Calabria, Marco
  • Hernández Pardo, Mireia
  • Branzi, Francesca Martina, 1984-
  • Costa, Albert, 1970-
Previous research has shown that highly proficient bilinguals have comparable switch costs in both directions when they switch between languages (L1 and L2), the so-called "symmetrical switch cost" effect. Interestingly, the same symmetry is also present when they switch between L1 and a much weaker L3. These findings suggest that highly proficient bilinguals develop a language control system that seems to be insensitive to language proficiency. In the present study, we explore whether the pattern of symmetrical switch costs in language switching tasks generalizes to a non-linguistic switching task in the same group of highly proficient bilinguals. The end goal of this is to assess whether bilingual language control (bLC) can be considered as subsidiary to domain-general executive control (EC). We tested highly proficient Catalan-Spanish bilinguals both in a linguistic switching task and in a non-linguistic switching task. In the linguistic task, participants named pictures in L1 and L2 (Experiment 1) or L3 (Experiment 2) depending on a cue presented with the picture (a flag). In the non-linguistic task, the same participants had to switch between two card sorting rule-sets (color and shape). Overall, participants showed symmetrical switch costs in the linguistic switching task, but not in the non-linguistic switching task. In a further analysis, we observed that in the linguistic switching task the asymmetry of the switch costs changed across blocks, while in the non-linguistic switching task an asymmetrical switch cost was observed throughout the task. The observation of different patterns of switch costs in the linguistic and the non-linguistic switching tasks suggest that the bLC system is not completely subsidiary to the domain-general EC system., This work was supported by grants from the Spanish government (PSI2008-01191, Consolider Ingenio 2010 CSD2007-00012) and the Catalan government (ConsolidatSGR2009-1521)./nMarco Calabria was supported by a postdoctoral fellowship from the Spanish Government (Juan de la Cierva fellowship). Francesca M. Branzi was supported by a predoctoral fellowship from the Spanish Government (FPU-2009-2013). This research was also supported by a Marie Curie International Outgoing Fellowship within the seventh European Community Framework Programme awarded to Mireia Hernández.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Processing changes when listening to foreign-accented speech

  • Romero Rivas, Carlos, 1986-
  • Martin, Clara D.
  • Costa, Albert, 1970-
This study investigates the mechanisms responsible for fast changes in processing foreign-accented speech. Event Related brain Potentials (ERPs) were obtained while native speakers of Spanish listened to native and foreign-accented speakers of Spanish. We observed a less positive P200 component for foreign-accented speech relative to native speech comprehension. This suggests that the extraction of spectral information and other important acoustic features was hampered during foreign-accented speech comprehension. However, the amplitude of the N400 component for foreign-accented speech comprehension decreased across the experiment, suggesting the use of a higher level, lexical mechanism. Furthermore, during native speech comprehension, semantic violations in the critical words elicited an N400 effect followed by a late positivity. During foreign-accented speech comprehension, semantic violations only elicited an N400 effect. Overall, our results suggest that, despite a lack of improvement in phonetic discrimination, native listeners experience changes at lexical-semantic levels of processing after brief exposure to foreign-accented speech. Moreover, these results suggest that lexical access, semantic integration and linguistic re-analysis processes are permeable to external factors, such as the accent of the speaker., This research was funded by an FPI grant (BES-2012-056668) and two project grants (PSI2011-23033 and Consolider INGENIO CSD2007-00012) awarded by the Spanish Government; by one grant from the Catalan Government (SGR 2009-1521); and by one grant from the European Research Council under the European Community's Seventh Framework (FP7/2007-2013 Cooperation grant agreement 613465-AThEME). CM is supported by the IKERBASQUE institution and the Basque Center on Cognition, Brain and Language. AC is supported by the ICREA institution and the Center for Brain and Cognition.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Structural connectivity in schizophrenia and its impact on the dynamics of spontaneous functional networks

  • Cabral, Joana
  • Fernandes, Henrique M.
  • Van Hartevelt, Tim J.
  • James, Anthony C.
  • Kringelbach, Morten L.
  • Deco, Gustavo
The neuropathology of schizophrenia remains unclear. Some insight has come from modern/nneuroimaging techniques, which offer an unparalleled opportunity to explore/nin vivo/nthe structure/nand function of the brain. Using functional magnetic resonance imaging, it has been found that the/nlarge-scale resting-state functional connectivity (rsFC) in schizophrenia — measured as the/ntemporal correlations of the blood-oxygen-level-dependent (BOLD) signal — exhibit altered/nnetwork topology, with lower small-world index. The origin of these rsFC alterations and link with/nthe underlying structural connectivity remain unclear. In this work, we used a computational model/nof spontaneous large-scale brain activity to explore the role of the structural connectivity in the/nlarge-scale dynamics of the brain in health and schizophrenia. The structural connectomes from 15/nadolescent patients with early-onset schizophrenia and 15 age- and gender-matched controls were/nbuilt from diffusion tensor imaging data to detect the white matter tracts between 90 brain areas./nBrain areas, simulated using a reduced dynamic mean-field model, receive excitatory input from/nother areas in proportion to the number of fibre tracts between them. The simulated mean field/nactivity was transformed into BOLD signal, and the properties of the simulated functional networks/nwere analyzed. Our results suggest that the functional alterations observed in schizophrenia are not/ndirectly linked to alterations in the structural topology. Instead, subtly randomized and less/nsmall-world functional networks appear when the brain operates with lower global coupling, which/nshifts the dynamics from the optimal healthy regime., The research reported herein was supported by the ERC/nAdvanced Grant DYSTRUCTURE (No. 295129), by the/nFET Flagship Human Brain Project, by the Spanish Research/nProject SAF2010-16085, by the CONSOLIDER-INGENIO/n2010 Programme CSD2007-00012, by the Brain Network/nRecovery Group through the James S. McDonnell/nFoundation, by the FP7-ICT BrainScales, and by the/nTrygFonden Charitable Foundation. Funding for the scan-/nning was supported by the MRC (G0500092).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Holding multiple items in short term memory: a neural mechanism

  • Rolls, Edmund T
  • Dempere-Marco, Laura
  • Deco, Gustavo
Human short term memory has a capacity of several items maintained simultaneously. We show how the number of short term memory representations that an attractor network modeling a cortical local network can simultaneously maintain active is increased by using synaptic facilitation of the type found in the prefrontal cortex. We have been able to maintain 9 short term memories active simultaneously in integrate-and-fire simulations where the proportion of neurons in each population, the sparseness, is 0.1, and have confirmed the stability of such a system with mean field analyses. Without synaptic facilitation the system can maintain many fewer memories active in the same network. The system operates because of the effectively increased synaptic strengths formed by the synaptic facilitation just for those pools to which the cue is applied, and then maintenance of this synaptic facilitation in just those pools when the cue is removed by the continuing neuronal firing in those pools. The findings have implications for understanding how several items can be maintained simultaneously in short term memory, how this may be relevant to the implementation of language in the brain, and suggest new approaches to understanding and treating the decline in short term memory that can occur with normal aging., This work was supported by the Spanish Research Projects BFU2007-61710, CONSOLIDER CSD2007-00012; the Oxford McDonnell Centre for Cognitive Neuroscience; the Oxford Centre for Computational Neuroscience; MIDECO through the Ramon y Cajal Programme (LDM); and from the TIN2010-21771-C02-02 project (LDM). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Assessment of the influence of navigation control and screen size on the sense of presence in virtual reality using EEG

  • Clemente Bellido, Miriam
  • Rodriguez-Ortega, Alejandro|||0000-0003-4781-6368
  • Rey, Beatriz|||0000-0001-9213-1443
  • Alcañiz Raya, Mariano Luis|||0000-0001-9207-0636
[EN] In the virtual reality field, presence refers to the sense of being there in the virtual world. Our aim in this work is to evaluate the usefulness of the Emotiv EPOC EEG device to measure brain activations due to the sense of presence in a virtual environment (VE), using for the analysis the sLORETA tool. We compare between three experimental conditions: photographs, video and free navigation through a VE. We also compare the differences in the sense of presence due to the visualization of the VE in different screens: a common desktop screen and a high-resolution power wall screen. We monitored 20 healthy subjects, obtaining significant differences between the navigation and video conditions in the activity of the right Insula for the Theta band. We also found a higher activation of the Insula for the Alpha and Theta bands while navigating, when comparing the two screen types. The Insula activation is related to stimulus attention and self-awareness processes, directly related with the sense of presence., This study was funded by Vicerrectorado de Investigacion de la Universitat Politecnica de Valencia, Spain, PAID-06-2011, R.N. 1984; by Ministerio de Educacion y Ciencia Spain, Project Game Teen (TIN2010-20187) and partially by projects Consolider-C (SEJ2006-14301/PSIC), "CIBER of Physiopathology of Obesity and Nutrition, an initiative of ISCIII", the Excellence Research Program PROMETEO (Generalitat Valenciana. Conselleria de Educacion, 2008-157) and the Consolider INGENIO program (CSD2007-00012). The work of Miriam Clemente was supported by the Generalitat Valenciana under a VALi+d Grant. The work of Alejandro Rodriguez was supported by the Spanish MEC under an FPI Grant BES-2011-043316.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

An fMRI Study to Analyze Neural Correlates of Presence during Virtual Reality Experiences

  • Clemente Bellido, Miriam
  • Rodríguez Pujadas, Aina
  • Barros Loscertales, Alfonso
  • Baños, Rosa M.
  • Botella, Cristina
  • Ávila, César
  • Rey, Beatriz|||0000-0001-9213-1443
  • Alcañiz Raya, Mariano Luis|||0000-0001-9207-0636
[EN] In the field of virtual reality (VR), many efforts have been made to analyze presence, the sense of being in the virtual world. However, it is only recently that functional magnetic resonance imaging (fMRI) has been used to study presence during an automatic navigation through a virtual environment. In the present work, our aim was to use fMRI to study the sense of presence during a VR-free navigation task, in comparison with visualization of photographs and videos (automatic navigations through the same environment). The main goal was to analyze the usefulness of fMRI for this purpose, evaluating whether, in this context, the interaction between the subject and the environment is performed naturally, hiding the role of technology in the experience. We monitored 14 right-handed healthy females aged between 19 and 25 years. Frontal, parietal and occipital regions showed their involvement during free virtual navigation. Moreover, activation in the dorsolateral prefrontal cortex was also shown to be negatively correlated to sense of presence and the postcentral parietal cortex and insula showed a parametric increased activation according to the condition-related sense of presence, which suggests that stimulus attention and self-awareness processes related to the insula may be linked to the sense of presence., This study was funded by the Ministerio de Educación y Ciencia Spain, Project Game Teen (TIN2010-20187) and partially by projects Consolider-C (SEJ2006-14301/PSIC), ‘CIBER of Physiopathology of Obesity and Nutrition, an initiative of ISCIII’, the Excellence Research Program PROMETEO (Generalitat Valenciana. Conselleria de Educación, 2008-157) and the Consolider INGENIO program (CSD2007-00012). The work of Miriam Clemente was supported by the Generalitat Valenciana under a VALi+d Grant.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

A Functional Magnetic Resonance Imaging Assessment of Small Animals Phobia Using Virtual Reality as a Stimulus

  • Clemente Bellido, Miriam
  • Rodríguez Pujadas, Aina
  • Breton Lopez, Juani
  • Barros Loscertales, Alfonso
  • Baños, Rosa María
  • Botella, Cristina
  • Ávila, César
  • Rey, Beatriz|||0000-0001-9213-1443
  • Alcañiz Raya, Mariano Luis|||0000-0001-9207-0636
[EN] Background: To date, still images or videos of real animals have been used in functional magnetic resonance imaging protocols to evaluate the brain activations associated with small animals phobia. Objective: The objective of our study was to evaluate the brain activations associated with small animals phobia through the use of virtual environments. This context will have the added benefit of allowing the subject to move and interact with the environment, giving the subject the illusion of being there. Methods: We have analyzed the brain activation in a group of phobic people while they navigated in a virtual environment that included the small animals that were the object of their phobia. Results: We have found brain activation mainly in the left occipital inferior lobe (P<.05 corrected, cluster size=36), related to the enhanced visual attention to the phobic stimuli; and in the superior frontal gyrus (P<.005 uncorrected, cluster size=13), which is an area that has been previously related to the feeling of self-awareness. Conclusions: In our opinion, these results demonstrate that virtual stimulus can enhance brain activations consistent with previous studies with still images, but in an environment closer to the real situation the subject would face in their daily lives., This study was funded by Vicerrectorado de Investigación de la Universitat Politècnica de València, Spain, PAID-06-2011, RN 1984; by the Ministerio de Educación y Ciencia Spain, Project Game Teen (TIN2010-20187); and partially by projects Consolider-C (SEJ2006-14301/PSIC), “CIBER of Physiopathology of Obesity and Nutrition, an initiative of ISCIII”, the Excellence Research Program PROMETEO (Generalitat Valenciana. Conselleria de Educación, 2008-157), and the Consolider INGENIO program (CSD2007-00012). Generalitat Valenciana, under a VALi+d Grant, supported the work of MC.
RiuNet. Repositorio Institucional de la Universitat Politécnica de Valéncia
Publicación Artículo científico (JournalArticle)

Measuring presence during the navigation in a Virtual Environment using EEG

  • Clemente Bellido, Miriam
  • Rodriguez-Ortega, Alejandro|||0000-0003-4781-6368
  • Rey, Beatriz|||0000-0001-9213-1443
  • Alcañiz Raya, Mariano Luis|||0000-0001-9207-0636
[EN] In the Virtual Reality field, presence refers to the sense of being there in the virtual world. Our aim in this work is to evaluate the usefulness of the Emotiv EPOC EEG device to measure the brain activations due to the sense of presence during the navigation in a Virtual Environment (VE), using for the analysis the sLORETA tool. We compare between two experimental conditions: free and automatic navigation through a VE. In this preliminary step, we monitored 9 healthy subjects, obtaining significant differences between the free and automatic navigation conditions in the activity of the right insula for the Theta and Alpha bands. The insula activation is related to stimulus attention and self-awareness processes, directly related with the sense of presence., This study was funded by Vicerrectorado de Investigación de la Universitat Politecnica de Valencia, Spain, PAID-06-2011, R.N. 1984; by Ministerio de Educación y Ciencia Spaill, Ptoject Game Teen (TIN2010- 20187) and partially by projects Consolider-C (SEJ2006-14301/PSIC), "CIBER of Physiopathology of Obesity and Nutrition, an initiative of ISCIII'', the Excellence Research Program PROMETEO (Generalitat Valenciana. Conselleria de Educación, 2008-157) and the Consolider INGENIO progtam (CSD2007-00012). The work ofMiriam Clemente was supported by the Generalitat Valenciana under a V ALi+d Grant.
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publicación Artículo científico (JournalArticle)

Reward sensitivity modulates brain activity in the prefrontal cortex, ACC and striatum during task switching

  • Fuentes Claramonte, Paola
  • Ávila Rivera, César
  • Rodríguez Pujadas, Aina
  • Ventura Campos Noelia
  • Bustamante, Juan Carlos
  • Costumero Ramos, Víctor
  • Rosell Negre, Patricia
  • Barrós Loscertales Alfonso
Current perspectives on cognitive control acknowledge that individual differences in motiva- tional dispositions may modulate cognitive processes in the absence of reward contingen- cies. This work aimed to study the relationship between individual differences in Behavioral Activation System (BAS) sensitivity and the neural underpinnings involved in processing a switching cue in a task-switching paradigm. BAS sensitivity was hypothesized to modulate brain activity in frontal regions, ACC and the striatum. Twenty-eight healthy participants un- derwent fMRI while performing a switching task, which elicited activity in fronto-striatal re- gions during the processing of the switch cue. BAS sensitivity was negatively associated with activity in the lateral prefrontal cortex, anterior cingulate cortex and the ventral striatum. Combined with previous results, our data indicate that BAS sensitivity modulates the neuro- cognitive processes involved in task switching in a complex manner depending on task de- mands. Therefore, individual differences in motivational dispositions may influence cognitive processing in the absence of reward contingencies
Zaguán. Repositorio Digital de la Universidad de Zaragoza
Publicación Artículo científico (JournalArticle)

Reward sensitivity is associated with brain activity during erotic stimulus processing

  • Costumero Ramos, Víctor
  • Barrós Loscertales, Alfonso
  • Bustamante, Juan Carlos
  • Ventura Campos, Noelia
  • Fuentes Claramonte, Paola
  • Rosell Negre, Patricia
  • Ávila Rivera, César
The behavioral approach system (BAS) from Gray’s reinforcement sensitivity theory is a neurobehavioral system involved in the processing of rewarding stimuli that has been related to dopaminergic brain areas. Gray’s theory hypothesizes that the functioning of reward brain areas is modulated by BAS-related traits. To test this hypothesis, we performed an fMRI study where participants viewed erotic and neutral pictures, and cues that predicted their appearance. Forty-five heterosexual men completed the Sensitivity to Reward scale (from the Sensitivity to Punishment and Sensitivity to Reward Questionnaire) to measure BAS-related traits. Results showed that Sensitivity to Reward scores correlated positively with brain activity during reactivity to erotic pictures in the left orbitofrontal cortex, left insula, and right ventral striatum. These results demonstrated a relationship between the BAS and reward sensitivity during the processing of erotic stimuli, filling the gap of previous reports that identified the dopaminergic system as a neural substrate for the BAS during the processing of other rewarding stimuli such as money and food.
O2, repositorio institucional de la UOC
Publicación Artículo científico (JournalArticle)

On the parallel deterioration of lexico-semantic processes in the bilinguals' two languages: evidence from Alzheimer's disease

  • Costa, Albert
  • Calabria, Marco
  • Marne, Paula
  • Hernández, Mireia
  • Juncadella, Montserrat
  • Gascon-Bayarri, Jordi
  • Lleó, Alberto
  • Ortiz-Gil, Jordi
  • UGAS, LIDIA
  • Blesa, Rafael
  • Reñé, Ramon
In this article we aimed to assess how Alzheimer's disease (AD), which is neurodegenerative, affects the linguistic performance of early, high-proficient bilinguals in their two languages. To this end, we compared the Picture Naming and Word Translation performances of two groups of AD patients varying in disease progression (Mild and Moderate) with that of bilingual individuals diagnosed with mild cognitive impairment (MCI). The results revealed that the linguistic deterioration caused by AD affected the two languages similarly. We also found that cognate status and word frequency were two major determinants of language performance in all three groups of participants. These results are consistent with the notion of a common neural substrate recruited to represent and process the two languages of high-proficient bilinguals.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

On the temporal and functional origin of L2 disadvantages in speech production: a critical review

  • Runnqvist, Elin
  • Strijkers, Kristof
  • Sadat Schaffai, Jasmin, 1982-
  • Costa, Albert, 1970-
Despite a large amount of psycholinguistic research devoted to the issue of processing differences between a first and a second language, there is no consensus regarding the locus where these emerge or the mechanism behind them. The aim of this article is to briefly examine both the behavioral and neuroscientific evidence in order to critically assess three hypotheses that have been put forward in the literature to explain such differences: the weaker links, executive control, and post-lexical accounts. We conclude that (a) while all stages of processing are likely to be slowed down when speaking in an L2 compared to an L1, the differences seem to originate at a lexical stage; and (b) frequency of use seems to be the variable mainly responsible for these bilingual processing disadvantages., This work was supported by grants from the Spanish government (PSI2008-01191, Consolider Ingenio 2010 CSD2007-00012) and the Catalan government (Consolidado SGR 2009-1521), a predoctoral grant from the Catalan government (FI) to Elin Runnqvist and predoctoral grants from the Spanish government (FPU) to Kristof Strijkers and Jasmin Sadat.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Structure-function discrepancy: inhomogeneity and/ndelays in synchronized neural networks

  • Ton, Robert
  • Deco, Gustavo
  • Daffertshofer, Andreas
The discrepancy between structural and functional connectivity in neural systems forms the challenge in understanding/ngeneral brain functioning. To pinpoint a mapping between structure and function, we investigated the effects of/n(in)homogeneity in coupling structure and delays on synchronization behavior in networks of oscillatory neural masses by/nderiving the phase dynamics of these generic networks. For homogeneous delays, the structural coupling matrix is largely/npreserved in the coupling between phases, resulting in clustered stationary phase distributions. Accordingly, we found only/na small number of synchronized groups in the network. Distributed delays, by contrast, introduce inhomogeneity in the/nphase coupling so that clustered stationary phase distributions no longer exist. The effect of distributed delays mimicked/nthat of structural inhomogeneity. Hence, we argue that phase (de-)synchronization patterns caused by inhomogeneous/ncoupling cannot be distinguished from those caused by distributed delays, at least not by the naked eye. The here-derived/nanalytical expression for the effective coupling between phases as a function of structural coupling constitutes a direct/nrelationship between structural and functional connectivity. Structural connectivity constrains synchronizability that may be/nmodified by the delay distribution. This explains why structural and functional connectivity bear much resemblance albeit/nnot a one-to-one correspondence. We illustrate this in the context of resting-state activity, using the anatomical/nconnectivity structure reported by Hagmann and others., This work was funded by ERC Advanced Grant: DYSTRUCTURE (n. 295129), by the Spanish Research Project SAF2010-16085 and by the CONSOLIDER-/nINGENIO 2010 Program CSD2007-00012, and the FP7-ICT BrainScale
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Prosody signals the emergence of intentional communication in the first year of life: evidence from Catalan-babbling infants

  • Prieto Vives, Pilar, 1965-
  • Esteve-Gibert, Núria
There is considerable debate about whether early vocalizations mimic the target language and whether prosody signals emergent intentional communication. A longitudinal corpus of four Catalan-babbling infants was analyzed to investigate whether children use different prosodic patterns to distinguish communicative from investigative vocalizations and to express intentionality. A total of 2,701 vocalizations from 0;7 to 0;11 were coded acoustically (by marking pitch range and duration), gesturally, and pragmatically (by marking communicative status and specific pragmatic function). The results showed that communicative vocalizations were shorter and had a wider pitch range than investigative vocalizations and that these patterns in communicative vocalizations depended on the intention of the vocalizations: requests and expressions of discontent displayed wider pitch range and longer duration than responses or statements. These results support the hypothesis that babbling children can successfully use a set of prosodic patterns to signal intentional speech., This research has been funded by the following 5 grants: two research grants awarded by the Spanish Ministry of Science and Innovation, ‘The role of tonal scaling and tonal alignment in distinguishing intonational categories in Catalan and Spanish’ (FFI2009-07648/FILO), and ‘Gestures, prosody and linguistic structure’ (FFI2012-31995); a grant awarded by the Generalitat de Catalunya to the Grup d'Estudis de Prosòdia (2009SGR-701); the grant RECERCAIXA 2012 for the project ‘Els precursors del llenguatge. Una guia TIC per a pares i educadors’ awarded by Obra Social ‘La Caixa’ and the grant Consolider-Ingenio 2010 (CSD2007-00012).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

The acquisition of melodic form and meaning in yes-no interrogatives by Catalan and Spanish speaking children

  • Thorson, Jill C.
  • Borràs Comes, Joan Manel, 1984-
  • Crespo Sendra, Verònica
  • Vanrell, Maria del Mar
  • Prieto Vives, Pilar, 1965-
This study investigates the link between interrogative intonation and meaning in child-directed speech (henceforth CDS) and how this is reflected in the early development of yes-no-interrogatives of Catalan- and Spanish-speaking children. Previous research found that children before the two-word period produce several types of interrogatives and that their productions generally reflect the adult inventory pattern (Lleó & Rakow 2011; Prieto et al. 2012). Yet prior studies have not included an analysis of the pragmatic meanings that are encoded intonationally. This investigation takes an integrated approach to the study of intonational development within the domain of yes-no questions, exploring further the correspondence between intonational form and meaning in early interrogative production and relating it to the pragmatics of interrogative intonation in child-directed speech. A set of 723 interrogative utterances produced by 3 Catalan-and 2 Spanish-acquiring children between the onset of nterrogative production and 2;4 were pragmatically and then prosodically analyzed, as well as a set of 867 utterances from Catalan and Spanish CDS. The data were extracted from the Serra-Solé Catalan Corpus and the Ojea and López-Ornat Spanish Corpora/nin CHILDES. Production results show that all children perform some instance of questioning before the two-word period and that their productions generally reflect the adult inventory patterns. Moreover, the results show a preference relationship between the different types of nuclear pitch configurations and the pragmatic meanings that underlie the yes-no-interrogative forms. Finally, these results highlight the importance of the assessment of form-meaning relationships for the understanding of intonational development., The project was funded by grants FFI2009-07648/FILO, BFU2012-31995, and CONSOLIDER-INGENIO 2010 ‘Bilingüismo y Neurociencia Cognitiva CSD2007-00012’ awarded by the Spanish Ministry of Science and Innovation and by project 2009 SGR 701 awarded by the Generalitat de Catalunya.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Synaptic depression and slow oscillatory activity in a biophysical network model of the cerebral cortex

  • Benita, Jose María
  • Guillamon i Grabolosa, Antoni
  • Deco, Gustavo
  • Sanchez-Vives, Maria V.
Short-term synaptic depression (STD) is a form of synaptic plasticity that has a large impact on network computations. Experimental results suggest that STD is modulated by cortical activity, decreasing with activity in the network and increasing during silent states. Here, we explored different activity-modulation protocols in a biophysical network model for which the model displayed less STD when the network was active than when it was silent, in agreement with experimental results. Furthermore, we studied how trains of synaptic potentials had lesser decay during periods of activity (UP states) than during silent periods (DOWN states), providing new experimental predictions. We next tackled the inverse question of what is the impact of modifying STD parameters on the emergent activity of the network, a question difficult to answer experimentally. We found that synaptic depression of cortical connections had a critical role to determine the regime of rhythmic cortical activity. While low STD resulted in an emergent rhythmic activity with short UP states and long DOWN states, increasing STD resulted in longer and more frequent UP states interleaved with short silent periods. A still higher synaptic depression set the network into a non-oscillatory firing regime where DOWN states no longer occurred. The speed of propagation of UP states along the network was not found to be modulated by STD during the oscillatory regime; it remained relatively stable over a range of values of STD. Overall, we found that the mutual interactions between synaptic depression and ongoing network activity are critical to determine the mechanisms that modulate cortical emergent patterns., Jose M. Benita and Antoni Guillamon are supported by the MICINN/FEDER grant MTM2009-06973 (DACOBIAN) and the Generalitat de Catalunya CUR-DIUE grant number 2009SGR-859. GD is supported by the European Union, grant EC005-024 (“STREP Decisions in Motion”), by the Spanish Research Project BFU2007-61710, and CONSOLIDER CSD2007-00012. Maria V. Sanchez-Vives is supported by the MICINN (BFU2008-01371/BFI) and MINECO (BFU2011-27094).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

The relevance of prosodic structure in tonal articulation. Edge effects at the prosodic word level in Catalan and Spanish

  • Prieto Vives, Pilar, 1965-
  • Estebas Vilaplana, Eva
  • Vanrell, Maria del Mar
We conducted a production experiment with 1600 potentially ambiguous utterances distinguished by word boundary location in Catalan and Spanish (e.g., Cat. mirà batalles ‘(s)he looked at battles’ vs. mirava talles ‘I/(s)he used to look at carvings’; Span. da balazos ‘(s)he fires shots’ vs. daba lazos ‘I/(s)he gave ribbons’; stressed syllables are underlined). Results revealed strong effects of within-word position on H location. Peaks tended to be timed earlier with respect to the end of the syllable when their associated syllables occurred later in the word than when they occurred earlier in the word. These results confirmed previous findings for other languages ( Silverman & Pierrehumbert, 1990 for English; Arvaniti, Ladd, & Mennen, 1998 for Greek; and Ishihara, 2006 for Japanese; and Godjevac, 2000 for Serbo-Croatian) and for Spanish and Catalan (Prieto, van Santen, & Hirschberg, 1995 for Spanish; de la Mota, 2005; Simonet, 2006, Simonet & Torreira, 2005 for Catalan). A set of perception experiments suggested that tonal alignment patterns influence listeners’ judgments of word boundary location both in Catalan and in Spanish. Listeners were able to employ fine allophonic details of H tonal alignment due to within-word position to identify lexical items that are ambiguous for word-boundary position. The data is consistent with the view that prosodic structure plays an essential part in determining the temporal coordination of f0 contours with segmental material., Parts of this study were presented at the ESF International Conference on Tone and Intonation (Santorini, September 2004), the 2nd Phonetics and Phonology in Iberia (Bellaterra, June 2005), the Xth Conference on Laboratory Phonology (Paris, June 2006) and at talks at the Laboratoire Parole et Langage (Aix-en-Provence, April 2005) and Institut de la Communication Parlée (Grenoble, November 2005). We are grateful to the audience at these conferences, and especially to C. de la Mota, G. Elordieta, C. Gussenhoven, J.I. Hualde, D.R. Ladd, H. Lœvenbruck, J. Kingston, C. Petrone, M. Simonet, F. Torreira, P. Welby for very useful feedback. We are grateful to friends and colleagues for their participation in the production and perception experiments. We would like to thank the Associate Editor and the three reviewers (D.R. Ladd, P. Welby, and an anonymous reviewer) for their very thorough reviews which have helped improved the final quality of the paper. Finally, we would like to thank F. Torreira and P. Welby, for their help with the Praat scripts, C. André, M. D’Imperio and C. Petrone for their support with the use of Perceval, and the SEA (Servei d’Estadística de la Universitat Autònoma de Barcelona) for their help with the statistical analysis of the data. This research has been funded by projects FFI2009-07648/FILO and CONSOLIDER-INGENIO 2010 Programme CSD2007-00012 (both awarded by the Ministerio de Ciencia e Innovación) and by project 2009 SGR 701 (awarded by the Generalitat de Catalunya).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Reconciling phonological neighborhood effects in speech production through single trial analysis

  • Sadat Schaffai, Jasmin, 1982-
  • Martin, Clara D.
  • Costa, Albert, 1970-
  • Alario, F.-Xavier (François -Xavier)
A crucial step for understanding how lexical knowledge is represented is to describe the relative similarity of lexical items, and how it influences language processing. Previous studies of the effects of form similarity on word production have reported conflicting results, notably within and across languages. The aim of the present study was to clarify this empirical issue to provide specific constraints for theoretical models of language production. We investigated the role of phonological neighborhood density in a large-scale picture naming experiment using fine-grained statistical models. The results showed that increasing phonological neighborhood density has a detrimental effect on naming latencies, and re-analyses of independently obtained data sets provide supplementary evidence for this effect. Finally, we reviewed a large body of evidence concerning phonological neighborhood density effects in word production, and discussed the occurrence of facilitatory and inhibitory effects in accuracy measures. The overall pattern shows that phonological neighborhood generates two opposite forces, one facilitatory and one inhibitory. In cases where speech production is disrupted (e.g. certain aphasic symptoms), the facilitatory component may emerge, but inhibitory processes dominate in efficient naming by healthy speakers. These findings are difficult to accommodate in terms of monitoring processes, but can be explained within interactive activation accounts combining phonological facilitation and lexical competition., This research was supported by a grant from the European Research Council under the European Community’s Seventh Framework Program (FP7/2007-2013 Grant agreement n◦ 263575), three grants from the Spanish government (PSI2008-01191, PSI2011-23033, Consolider Ingenio 2010 CSD2007-00012), and the Catalan government (Consolidado SGR 2009-1521).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Exploring mechanisms of spontaneous functional connectivity in MEG:/nHow delayed network interactions lead to structured amplitude/nenvelopes of band-pass filtered oscillations

  • Cabral, Joana
  • Luckhoo, Henry
  • Woolrich, Mark W.
  • Joensson, Morten
  • Mohseni, Hamid
  • Baker, Adam
  • Kringelbach, Morten L.
  • Deco, Gustavo
Spontaneous (or resting-state) brain activity has attracted a growing body of neuroimaging research over the last/ndecades.Whole-brain networkmodels have proved helpful to investigate the source of slow(b0.1 Hz) correlated/nhemodynamic fluctuations revealed in fMRI during rest. However, the mechanisms mediating resting-state/nlong-distance correlations and the relationship with the faster neural activity remain unclear. Novel insights/ncoming from MEG studies have shown that the amplitude envelopes of alpha- and beta-frequency oscillations/n(8–30 Hz) display similar correlation patterns as the fMRI signals./nIn thiswork, we combine experimental and theoreticalwork to investigate the mechanisms of spontaneousMEG/nfunctional connectivity. Using a simple model of coupled oscillators adapted to incorporate realisticwhole-brain/nconnectivity and conduction delays, we explore how slow and structured amplitude envelopes of band-pass/nfiltered signals – fairly reproducing MEG data collected from 10 healthy subjects at rest – are generated spontaneously/nin the space-time structure of the brain network./nOur simulation results show that the large-scale neuroanatomical connectivity provides an optimal network/nstructure to support a regimewith metastable synchronization. In this regime, different subsystems may temporarily/nsynchronize at reduced collective frequencies (falling in the 8–30 Hz range due to the delays) while the/nglobal system never fully synchronizes. This mechanism modulates the frequency of the oscillators on a slow/ntime-scale (b0.1 Hz) leading to structured amplitude fluctuations of band-pass filtered signals. Taken overall,/nour results reveal that the structured amplitude envelope fluctuations observed in resting-state MEG data may/noriginate from spontaneous synchronization mechanisms naturally occurring in the space-time structure of/nthe brain., The research reported herein was supported by the ERC Advanced/nGrant: DYSTRUCTURE (n. 295129), by the FET Flagship Human Brain/nProject, by the Spanish Research Project SAF2010-16085, by the/nCONSOLIDER-INGENIO 2010 CSD2007-00012, by the BrainNRG through/nthe James S. McDonnell Foundation, by the FP7-ICT BrainScales, by the/nRCUK Digital Economy – Centre for Doctoral Training in Healthcare/nInnovation, by theMINDLab Investment Capital for University Research/nFund and by the TrygFonden Charitable Foundation.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

The timing of vision - how neural processing links to different temporal dynamics

  • Masquelier, Timothée
  • Albantakis, Larissa
  • Deco, Gustavo
In this review, we describe our recent attempts to model the neural correlates of visual perception with biologically inspired networks of spiking neurons, emphasizing the dynamical aspects. Experimental evidence suggests distinct processing modes depending on the type of task the visual system is engaged in. A first mode, crucial for object recognition, deals with rapidly extracting the glimpse of a visual scene in the first 100 ms after its presentation. The promptness of this process points to mainly feedforward processing, which relies on latency coding, and may be shaped by spike timing-dependent plasticity (STDP). Our simulations confirm the plausibility and efficiency of such a scheme. A second mode can be engaged whenever one needs to perform finer perceptual discrimination through evidence accumulation on the order of 400 ms and above. Here, our simulations, together with theoretical considerations, show how predominantly local recurrent connections and long neural time-constants enable the integration and build-up of firing rates on this timescale. In particular, we review how a non-linear model with attractor states induced by strong recurrent connectivity provides straightforward explanations for several recent experimental observations. A third mode, involving additional top-down attentional signals, is relevant for more complex visual scene processing. In the model, as in the brain, these top-down attentional signals shape visual processing by biasing the competition between different pools of neurons. The winning pools may not only have a higher firing rate, but also more synchronous oscillatory activity. This fourth mode, oscillatory activity, leads to faster reaction times and enhanced information transfers in the model. This has indeed been observed experimentally. Moreover, oscillatory activity can format spike times and encode information in the spike phases with respect to the oscillatory cycle. This phenomenon is referred to as “phase-of-firing coding,” and experimental evidence for it is accumulating in the visual system. Simulations show that this code can again be efficiently decoded by STDP. Future work should focus on continuous natural vision, bio-inspired hardware vision systems, and novel experimental paradigms to further distinguish current modeling approaches., The authors were supported by the Fyssen Foundation, the FP7 European Project Coronet, and the CONSOLIDER-INGENIO 2010 Programme CSD2007-00012.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Neural plasticity in human brain connectivity: the effects of long term deep brain stimulation of the subthalamic nucleus in Parkinson's disease

  • Van Hartevelt, Tim J.
  • Cabral, Joana
  • Deco, Gustavo
  • Møller, Arne
  • Green, Alex L.
  • Aziz, Tipu Z.
  • Kringelbach, Morten L.
Background: Positive clinical outcomes are now well established for deep brain stimulation, but little is known about the effects of long-term deep brain stimulation on brain structural and functional connectivity. Here, we used the rare opportunity to acquire pre- and postoperative diffusion tensor imaging in a patient undergoing deep brain stimulation in bilateral subthalamic nuclei for Parkinson’s Disease. This allowed us to analyse the differences in structural connectivity before and after deep brain stimulation. Further, a computational model of spontaneous brain activity was used to estimate the changes in functional connectivity arising from the specific changes in structural connectivity./nResults: We found significant localised structural changes as a result of long-term deep brain stimulation. These changes were found in sensory-motor, prefrontal/limbic, and olfactory brain regions which are known to be affected in Parkinson’s Disease. The nature of these changes was an increase of nodal efficiency in most areas and a decrease of nodal efficiency in the precentral sensory-motor area. Importantly, the computational model clearly shows the impact of deep brain stimulation-induced structural alterations on functional brain changes, which is to shift the neural dynamics back towards a healthy regime. The results demonstrate that deep brain stimulation in Parkinson’s Disease leads to a topological reorganisation towards healthy bifurcation of the functional networks measured in controls, which suggests a potential neural mechanism for the alleviation of symptoms./nConclusions: The findings suggest that long-term deep brain stimulation has not only restorative effects on the structural connectivity, but also affects the functional connectivity at a global level. Overall, our results support causal changes in human neural plasticity after long-term deep brain stimulation and may help to identify the underlying mechanisms of deep brain stimulation., MLK and TJVH are funded by the TrygFonden Charitable Foundation. TZA is funded by the Medical Research Council, the Norman Collisson Foundation/nand the Charles Wolfson Charitable Trust. ALG is supported by the NIHR Biomedical Research Centre, Oxford. GD and JC were supported by the ERC Advanced/nGrant: DYSTRUCTURE (n. 295129), by the Spanish Research Project SAF2010-16085 and by the CONSOLIDER-INGENIO 2010 Programme CSD2007-00012, the FP7-/nICT BrainScales and by the Brain Network Recovery Group through the James S. McDonnell Foundation.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

The speakers’ accent shapes the listeners’ phonological predictions during speech perception

  • Brunellière, Angèle
  • Soto-Faraco, Salvador, 1970-
This study investigates the specificity of predictive coding in spoken word comprehension using event-related potentials (ERPs). We measured word-evoked ERPs in Catalan speakers listening to semantically constraining sentences produced in their native regional accent (Experiment 1) or in a non-native accent (Experiment 2). Semantically anomalous words produced long-lasting negative shift (N400) starting as early as 250 ms, thus reflecting phonological as well as semantic mismatch. Semantically expected but phonologically unexpected (non-native forms embedded in a native context) produced only an early (∼250 ms) negative difference. In contrast, this phonological expectancy effect failed for native albeit phonologically unexpected target words embedded in a non-native context. These results suggest phonologically precise expectations when operating over native input, whilst phonologically less specified expectations in a non-native context. Our findings shed light on contextual influence during word recognition, suggesting that word form prediction based on context is sensitive and adaptive to phonological variability., his research was supported by the Spanish Ministry of Science and Innovation (PSI2010-15426 and Consolider INGENIO CSD2007-00012), Comissionat per a Universitats i Recerca del DIUE-Generalitat de Catalunya (SGR2009-092), and the European Research Council (StG-2010263145).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Somatosensory saccades reveal the timing of tactile spatial remapping

  • Overvliet, Krista E.
  • Azañón Gracia, Elena
  • Soto-Faraco, Salvador, 1970-
Remapping tactile events from skin to external space is an essential process for human behaviour. It allows us to refer tactile sensations to their actual externally based location, by combining anatomically based somatosensory information with proprioceptive information about the current body posture. We examined the time course of tactile remapping by recording speeded saccadic responses to somatosensory stimuli delivered to the hands. We conducted two experiments in which arm posture varied (crossed or uncrossed), so that anatomical and external frames of reference were either put in spatial conflict or were aligned. The data showed that saccade onset latencies in the crossed hands conditions were slower than in the uncrossed hands condition, suggesting that, in the crossed hands condition, remapping had to be completed before a correct saccade could be executed. Saccades to tactile stimuli when the hands were crossed were sometimes initiated to the wrong direction and then corrected in-flight, resulting in a turn-around saccade. These turn-around saccades were more likely to occur in short-latency responses, compared to onset latencies of saccades that went straight to target. The latter suggests that participants were postponing their saccade until the time the tactile event was represented according to the current body posture. We propose that the difference between saccade onset latencies of crossed and uncrossed hand postures, and between the onset of a turn-around saccade and a straight saccade in the crossed hand posture, reveal the timing of tactile spatial remapping., This research was supported by Spanish Ministry of Science and Innovation (PSI2010-15426 and Consolider INGENIOCSD2007-00012), Comissionat per a Universitats i Recerca del DIUE-Generalitat de Catalunya (SRG2009-092), and European Research Council (StG-2010 263145).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Modeling resting-state functional networks when the cortex falls asleep: local and global changes

  • Deco, Gustavo
  • Hagmann, Patric
  • Hudetz, Anthony G.
  • Tononi, Giulio
The transition from wakefulness to sleep represents the most conspicuous change in behavior and the level of consciousness occurring in the healthy brain. It is accompanied by similarly conspicuous changes in neural dynamics, traditionally exemplified by the change from “desynchronized” electroencephalogram activity in wake to globally synchronized slow wave activity of early sleep. However, unit and local field recordings indicate that the transition is more gradual than it might appear: On one hand, local slow waves already appear during wake; on the other hand, slow sleep waves are only rarely global. Studies with functional magnetic resonance imaging also reveal changes in resting-state functional connectivity (FC) between wake and slow wave sleep. However, it remains unclear how resting-state networks may change during this transition period. Here, we employ large-scale modeling of the human cortico-cortical anatomical connectivity to evaluate changes in resting-state FC when the model “falls asleep” due to the progressive decrease in arousal-promoting neuromodulation. When cholinergic neuromodulation is parametrically decreased, local slow waves appear, while the overall organization of resting-state networks does not change. Furthermore, we show that these local slow waves are structured macroscopically in networks that resemble the resting-state networks. In contrast, when the neuromodulator decrease further to very low levels, slow waves become global and resting-state networks merge into a single undifferentiated, broadly synchronized network., G.D. was supported by the ERC Advanced Grant: DYSTRUCTURE/n(no. 295129), by the Spanish Research Project/nSAF2010-16085, and by the CONSOLIDER-INGENIO 2010/nProgram CSD2007-00012 and the FP7-ICT BrainScales. G.T./nwas supported by the Paul Allen Family Foundation and by the/nMcDonnell Foundation. P.H. was supported by Leenaards/nFoundation. The research reported herein was supported by/nthe Brain Network Recovery Group through the James/nS. McDonnell Foundation.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Source-reconstruction of the sensorimotor network from resting-state macaque electrocorticography

  • Hindriks, Rikkert
  • Micheli, C.
  • Bosman, Conrado A.
  • Oostenveld, R.
  • Lewis, C.
  • Mantini, Dante
  • Fries, Pascal
  • Deco, Gustavo
The discovery of hemodynamic (BOLD-fMRI) resting-state networks (RSNs) has brought about a fundamental shift in our thinking about the role of intrinsic brain activity. The electrophysiological underpinnings of RSNs remain largely elusive and it has been shown only recently that electric cortical rhythms are organized into the same RSNs as hemodynamic signals. Most electrophysiological studies into RSNs use magnetoencephalography (MEG) or scalp electroencephalography (EEG), which limits the spatial resolution with which electrophysiological RSNs can be observed. Due to their close proximity to the cortical surface, electrocorticographic (ECoG) recordings can potentially provide a more detailed picture of the functional organization of resting-state cortical rhythms, albeit at the expense of spatial coverage. In this study we propose using source-space spatial independent component analysis (spatial ICA) for identifying generators of resting-state cortical rhythms as recorded with ECoG and for reconstructing their functional connectivity. Network structure is assessed by two kinds of connectivity measures: instantaneous correlations between band-limited amplitude envelopes and oscillatory phase-locking. By simulating rhythmic cortical generators, we find that the reconstruction of oscillatory phase-locking is more challenging than that of amplitude correlations, particularly for low signal-to-noise levels. Specifically, phase-lags can both be over- and underestimated, which troubles the interpretation of lag-based connectivity measures. We illustrate the methodology on somatosensory beta rhythms recorded from a macaque monkey using ECoG. The methodology decomposes the resting-state sensorimotor network into three cortical generators, distributed across primary somatosensory and primary and higher-order motor areas. The generators display significant and reproducible amplitude correlations and phase-locking values with non-zero lags. Our findings illustrate the level of spatial detail attainable with source-projected ECoG and motivates wider use of the methodology for studying resting-state as well as event-related cortical dynamics in macaque and human., RH and GD were funded by the European Research Council (Advanced Grant DYSTRUCTURENo.295129),the Spanish Research Project PSI2013-42091-P, the CONSOLIDER- INGENIO2010 Program CSD2007-00012,and the FP7-ICT Brainscales(269921). DM was funded by the Wellcome Trust (grant 101253/Z/13/Z), KU Leuven Research Office (grant C16/15/070), Research Foundation Flanders (grants G0F76.16N and G0936.16N). PF acknowledges grant support by DFG (SPP 1665, FOR 1847, FR2557/5-1-CORNET, FR 2557/6-1-NeuroTMR), EU (HEALTHF22008200728-BrainSynch, FP7-604102-HBP, FP7-600730-Magnetrodes), a European Young Investigator Award, NIH (1U54MH091657-WU-Minn-Consortium-HCP), and LOEWE (NeFF). The authors declare no competing financial interests.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Changes of mind in an attractor network of decision-making

  • Albantakis, Larissa
  • Deco, Gustavo
Attractor networks successfully account for psychophysical and neurophysiological data in various decision-making tasks./nEspecially their ability to model persistent activity, a property of many neurons involved in decision-making, distinguishes/nthem from other approaches. Stable decision attractors are, however, counterintuitive to changes of mind. Here we/ndemonstrate that a biophysically-realistic attractor network with spiking neurons, in its itinerant transients towards the/nchoice attractors, can replicate changes of mind observed recently during a two-alternative random-dot motion (RDM) task./nBased on the assumption that the brain continues to evaluate available evidence after the initiation of a decision, the/nnetwork predicts neural activity during changes of mind and accurately simulates reaction times, performance and/npercentage of changes dependent on difficulty. Moreover, the model suggests a low decision threshold and high incoming/nactivity that drives the brain region involved in the decision-making process into a dynamical regime close to a bifurcation,/nwhich up to now lacked evidence for physiological relevance. Thereby, we further affirmed the general conformance of/nattractor networks with higher level neural processes and offer experimental predictions to distinguish nonlinear attractor/nfrom linear diffusion models., The authors were supported by the Spanish Research Project BFU2007-61710/BFI and CONSOLIDER-INGENIO 2010 Programme CSD2007-00012 (“Bilingualism and Cognitive Neuroscience”). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Structural connectivity in schizophrenia and its impact on the dynamics of spontaneous functional networks

  • Cabral, Joana
  • Fernandes, Henrique M.
  • Van Hartevelt, Tim J.
  • James, Anthony C.
  • Kringelbach, Morten L.
  • Deco, Gustavo
The neuropathology of schizophrenia remains unclear. Some insight has come from modern/nneuroimaging techniques, which offer an unparalleled opportunity to explore/nin vivo/nthe structure/nand function of the brain. Using functional magnetic resonance imaging, it has been found that the/nlarge-scale resting-state functional connectivity (rsFC) in schizophrenia — measured as the/ntemporal correlations of the blood-oxygen-level-dependent (BOLD) signal — exhibit altered/nnetwork topology, with lower small-world index. The origin of these rsFC alterations and link with/nthe underlying structural connectivity remain unclear. In this work, we used a computational model/nof spontaneous large-scale brain activity to explore the role of the structural connectivity in the/nlarge-scale dynamics of the brain in health and schizophrenia. The structural connectomes from 15/nadolescent patients with early-onset schizophrenia and 15 age- and gender-matched controls were/nbuilt from diffusion tensor imaging data to detect the white matter tracts between 90 brain areas./nBrain areas, simulated using a reduced dynamic mean-field model, receive excitatory input from/nother areas in proportion to the number of fibre tracts between them. The simulated mean field/nactivity was transformed into BOLD signal, and the properties of the simulated functional networks/nwere analyzed. Our results suggest that the functional alterations observed in schizophrenia are not/ndirectly linked to alterations in the structural topology. Instead, subtly randomized and less/nsmall-world functional networks appear when the brain operates with lower global coupling, which/nshifts the dynamics from the optimal healthy regime., The research reported herein was supported by the ERC/nAdvanced Grant DYSTRUCTURE (No. 295129), by the/nFET Flagship Human Brain Project, by the Spanish Research/nProject SAF2010-16085, by the CONSOLIDER-INGENIO/n2010 Programme CSD2007-00012, by the Brain Network/nRecovery Group through the James S. McDonnell/nFoundation, by the FP7-ICT BrainScales, and by the/nTrygFonden Charitable Foundation. Funding for the scan-/nning was supported by the MRC (G0500092).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

On the overlap between bilingual language control and domain-general executive control

  • Branzi, Francesca Martina, 1984-
  • Calabria, Marco
  • Boscarino, Maria Lucrezia
  • Costa, Albert, 1970-
We explored the overlap between bilingual language control (bLC) and domain-general executive control (EC) by focusing on inhibitory control processes. We tested 62 bilinguals in linguistic and non-linguistic switching tasks for two types of costs, such as the n − 1 shift cost and the n − 2 repetition cost. In order to explore the involvement of inhibitory control in bLC and EC, we assessed the pattern of switch costs in the two tasks and then we correlated them between tasks. Results showed reduced n − 2 repetition costs as compared to n − 1 shift costs in the linguistic task only, suggesting that small amount of inhibition were deployed when switching between languages. Importantly, neither the n − 1 shift costs nor the n − 2 repetition costs were correlated between tasks. These results, supported by additional evidence from the ex-Gaussian analysis, suggest that inhibitory control is differently involved in bLC and in EC., This work was supported by grants from the Spanish Government (PSI2014- 54500, PSI2008-01191, PSI2011-23033, PSI2011-23340, Consolider Ingenio 2010 CSD2007-00012), the Catalan Government (Consolidat SGR 2009-1521 and SGR 2014-1210) and by one grant from the European Research Council under the European Community’s Seventh Framework (FP7/2007-2013 Cooperation grant agreement 613465-AThEME). This research received partial financial assistance as a Severo Ochoa Center of Excellence SEV-2015-0490. Francesca M. Branzi was supported by a predoctoral fellowship from the Spanish Government (FPU-2009- 2013) and by a postdoctoral fellowship from the European Union’s Horizon 2020 research and innovation programme, under the Marie Sklodowska-Curie grant agreement No 658341. Marco Calabria was supported by a postdoctoral fellowship from the Spanish Government (Ramón y Cajal Fellowship).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Ongoing cortical activity at rest: criticality, multistability,/nand ghost attractors

  • Deco, Gustavo
  • Jirsa, Viktor K.
The ongoing activity of the brain at rest, i.e., under no stimulation and in absence of any task, is astonishingly highly structured into/nspatiotemporal patterns. These spatiotemporal patterns, called resting state networks, display low-frequency characteristics (<0.1 Hz)/nobserved typically in the BOLD-fMRI signal of human subjects. We aim here to understand the origins of resting state activity through/nmodeling via a global spiking attractor network of the brain. This approach offers a realistic mechanistic model at the level of each single/nbrain area based on spiking neurons and realistic AMPA, NMDA, and GABA synapses. Integrating the biologically realistic diffusion/ntensor imaging/diffusion spectrum imaging-based neuroanatomical connectivity into the brain model, the resultant emerging resting/nstate functional connectivity of the brain network fits quantitatively best the experimentally observed functional connectivity in humans/nwhen the brain network operates at the edge of instability. Under these conditions, the slow fluctuating (</n0.1 Hz) resting state networks/nemerge as structured noise fluctuations around a stable low firing activity equilibrium state in the presence of latent “ghost” multistable/nattractors. The multistable attractor landscape defines a functionally meaningful dynamic repertoire of the brain network that is inher-/nently present in the neuroanatomical connectivity., G.D. was supported by the European Union Grant EC005-024, by SAF2010-16085 and the “La Marato”/nFoundation,andbytheCONSOLIDER-INGENIO2010ProgrammeCSD2007-00012.The research reported here in was/nsupported by the Brain Network Recovery Group through the James S. McDonnell Foundation and the FP7-ICT/nBrainScales.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

From literal meaning to veracity in two hundred milliseconds

  • Martin, Clara D.
  • García, Xavier, 1967-
  • Breton, Audrey
  • Thierry, Guillaume
  • Costa, Albert, 1970-
Do the integration of semantic information and that of world knowledge occur simultaneously or in sequence during sentence processing? To address this question, we investigated event-related brain potentials elicited by the critical word of English sentences in three conditions: (1) correct; (2) semantic violation; (3) world knowledge violation (semantically correct but factually incorrect). Critically, we opted for low constraint sentence contexts (i.e., whilst being semantically congruent with the sentence context, critical words had low cloze probability). The processing of semantic violations differed from that of correct sentences as early as the P2 time-window. In the N400 time-window, the processing of semantic and world knowledge violations both differed significantly from that of correct sentences and differed significantly from one another. Overall, our results show that the brain needs approximately 200 ms more to detect a world knowledge violation than a semantic one., This work was supported by grants from the Spanish Government (PSI2008- 01191, PSI2011-23033, Consolider Ingenio 2010 CSD2007-00012) and the Catalan Government (Consolidado SGR 2009-1521). CM was supported by the Spanish Government (Grant Juan de la Cierva) and is now supported by the IKERBASQUE foundation for science and the Basque Center on Cognition, Brain and Language. GT was supported by the Economic and Social Research Council (ES/E024556/1) and the European Research Council (ERC-SG-209704)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

How delays matter in an oscillatory whole-brain spiking-neuron network model for MEG alpha-rhythms at rest

  • Nakagawa, Tristan T.
  • Woolrich, Mark W.
  • Luckhoo, Henry
  • Joensson, Morten
  • Mohseni, Hamid
  • Kringelbach, Morten L.
  • Jirsa, Viktor K.
  • Deco, Gustavo
In recent years the study of the intrinsic brain dynamics in a relaxed awake state in the absence of any specific/ntask has gained increasing attention, as spontaneous neural activity has been found to be highly structured at a/nlarge scale. This so called resting-state activity has been found to be comprised by nonrandom spatiotemporal/npatterns and fluctuations, and several Resting-State Networks (RSN) have been found in BOLD-fMRI as well as/nin MEG signal power envelope correlations. The underlying anatomical connectivity structure between areas of/nthe brain has been identified as being a key to the observed functional network connectivity, but the mechanisms/nbehind this are still underdetermined. Theoretical large-scale brain models for fMRI data have corroborated the/nimportance of the connectome in shaping network dynamics,while the importance of delays and noise differ between/nstudies and depend on the models' specific dynamics. In the current study, we present a spiking neuron/nnetworkmodel that is able to produce noisy, distributed alpha-oscillations, matching the power peak in the spectrumof/ngroup resting-stateMEG recordings.We studied howwell the model captured the inter-node correlation/nstructure of the alpha-band power envelopes for different delays between brain areas, and found that the model/nperforms best for propagation delays inside the physiological range (5–10 m/s). Delays also shift the transition/nfrom noisy to bursting oscillations to higher global coupling values in the model. Thus, in contrast to the/nasynchronous fMRI state, delays are important to consider in the presence of oscillation., TTN was supported by the SUR of the DEC of the Catalan Government/nand by the FSE. GD was supported by the ERC Advanced Grant:/nDYSTRUCTURE (n. 295129), by the Spanish Research Project SAF2010-/n16085 and by the CONSOLIDER-INGENIO 2010 Programme CSD2007-/n00012, and the FP7-ICT BrainScales. The research reported herein was/nsupported by the Brain Network Recovery Group through the James S./nMcDonnell Foundation.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Network bursting dynamics in excitatory cortical neuron cultures results from the combination of different adaptive mechanism

  • Masquelier, Timothée
  • Deco, Gustavo
In the brain, synchronization among cells of an assembly is a common phenomenon, and thought to be functionally /nrelevant. Here we used an in vitro experimental model of cell assemblies, cortical cultures, combined with numerical/nsimulations of a spiking neural network (SNN) to investigate how and why spontaneous synchronization occurs. In order to/ndeal with excitation only, we pharmacologically blocked GABAAergic transmission using bicuculline. Synchronous events in/ncortical cultures tend to involve almost every cell and to display relatively constant durations. We have thus named these/n‘‘network spikes’’ (NS). The inter-NS-intervals (INSIs) proved to be a more interesting phenomenon. In most cortical cultures/nNSs typically come in series or bursts (‘‘bursts of NSs’’, BNS), with short (,1 s) INSIs and separated by long silent intervals/n(tens of s), which leads to bimodal INSI distributions. This suggests that a facilitating mechanism is at work, presumably/nshort-term synaptic facilitation, as well as two fatigue mechanisms: one with a short timescale, presumably short-term/nsynaptic depression, and another one with a longer timescale, presumably cellular adaptation. We thus incorporated these/nthree mechanisms into the SNN, which, indeed, produced realistic BNSs. Next, we systematically varied the recurrent/nexcitation for various adaptation timescales. Strong excitability led to frequent, quasi-periodic BNSs (CV,0), and weak/nexcitability led to rare BNSs, approaching a Poisson process (CV,1). Experimental cultures appear to operate within an/nintermediate weakly-synchronized regime (CV,0.5), with an adaptation timescale in the 2–8 s range, and well described by/na Poisson-with-refractory-period model. Taken together, our results demonstrate that the INSI statistics are indeed/ninformative: they allowed us to infer the mechanisms at work, and many parameters that we cannot access experimentally., This work was funded by the European Union Seventh Framework Program (FP7/2007-2013) under grant agreements no. 269459 (Coronet). GD was/nalso supported by the ERC Advanced Grant: DYSTRUCTURE (n. 295129), by the Spanish Research Project SAF2010-16085, and by the CONSOLIDER-INGENIO 2010/nProgram CSD2007-00012.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Searching for audiovisual correspondence in multiple speaker scenarios

  • Alsius, Agnès
  • Soto-Faraco, Salvador, 1970-
A critical question in multisensory processing is how the constant information flow that arrives to our different senses is organized in coherent representations. Some authors claim that pre-attentive detection of inter-sensory correlations supports crossmodal binding, whereas other findings indicate that attention plays a crucial role. We used visual and auditory search tasks for speaking faces to address the role of selective spatial attention in audiovisual binding. Search efficiency amongst faces for the match with a voice declined with the number of faces being monitored concurrently, consistent with an attentive search mechanism. In contrast, search amongst auditory speech streams for the match with a face was independent of the number of streams being monitored concurrently, as long as localization was not required. We suggest that the fundamental differences in the way in which auditory and visual information is encoded play a limiting role in crossmodal binding. Based on these unisensory limitations, we provide a unified explanation for several previous apparently contradictory findings., This work was supported by grants PSI2010-15426 and Consolider INGENIO CSD2007-00012 (MICINN), Generalitat de Catalunya (SRG2009-092), and European Research Council (StG-2010 263145).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

A multiple-choice task with changes of mind

  • Albantakis, Larissa
  • Branzi, Francesca Martina, 1984-
  • Costa, Albert, 1970-
  • Deco, Gustavo
The role of changes of mind and multiple choices has recently received increased attention in the study of perceptual/ndecision-making. Previously, these extensions to standard two-alternative tasks have been studied separately. Here we/nexplored how changes of mind depend on the number of choice-alternatives. To this end, we tested 14 human subjects on/na 2- and 4-alternative direction-discrimination task. Changes of mind in the participants’ movement trajectories could be/nobserved for two and for four choice alternatives. With fewer alternatives, participants responded faster and more/naccurately. The frequency of changes of mind, however, did not significantly differ for the different numbers of choice/nalternatives. Nevertheless, mind-changing improved the participants’ final performance, particularly for intermediate/ndifficulty levels, in both experimental conditions. Moreover, the mean reaction times of individual participants were/nnegatively correlated with their overall tendency to make changes of mind. We further reproduced these findings with a/nmulti-alternative attractor model for decision-making, while a simple race model could not account for the experimental/ndata. Our experiment, combined with the theoretical models allowed us to shed light on: (1) the differences in choice/nbehavior between two and four alternatives, (2) the differences between the data of our human subjects and previous/nmonkey data, (3) individual differences between participants, and (4) the inhibitory interaction between neural/nrepresentations of choice alternatives., This work was supported by the “CONSOLIDER-INGENIO 2010” Programme in the “Brainglot” project (Bilingualism and Cognitive Neuroscience) CSD2007-00012. FMB was supported by a predoctoral fellowship from the Spanish Government (FPU 2009-2013). GD was further supported by the Spanish Ministry of Science in the project “Communication and Information Processing Between Cortical Circuits: Oscillations and Plasticity” SAF2010-16085. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Cortical microcircuit dynamics mediating binocular rivalry: the role of adaptation in inhibition

  • Theodoni, Panagiota
  • Panagiotaropoulos, Theofanis I.
  • Kapoor, Vishal
  • Logothetis, Nikos
  • Deco, Gustavo
Perceptual bistability arises when two conflicting interpretations of an ambiguous stimulus or images in binocular rivalry (BR) compete for perceptual dominance. From a computational point of view, competition models based on cross-inhibition and adaptation have shown that noise is a crucial force for rivalry, and operates in balance with adaptation. In particular, noise-driven transitions and adaptation-driven oscillations define two dynamical regimes and the system explains the observed alternations in perception when it operates near their boundary. In order to gain insights into the microcircuit dynamics mediating spontaneous perceptual alternations, we used a reduced recurrent attractor-based biophysically realistic spiking network, well known for working memory, attention, and decision making, where a spike-frequency adaptation mechanism is implemented to account for perceptual bistability. We thus derived a consistently reduced four-variable population rate model using mean-field techniques, and we tested it on BR data collected from human subjects. Our model accounts for experimental data parameters such as mean time dominance, coefficient of variation, and gamma distribution fit. In addition, we show that our model operates near the bifurcation that separates the noise-driven transitions regime from the adaptation-driven oscillations regime, and agrees with Levelt’s second revised and fourth propositions. These results demonstrate for the first time that a consistent reduction of a biophysically realistic spiking network of leaky integrate-and-fire neurons with spike-frequency adaptation could account for BR. Moreover, we demonstrate that BR can be explained only through the dynamics of competing neuronal pools, without taking into account the adaptation of inhibitory interneurons. However, the adaptation of interneurons affects the optimal parametric space of the system by decreasing the overall adaptation necessary for the bifurcation to occur, and introduces oscillations in the spontaneous state., The authors would like to thank KongFatt Wong, Antoni Guillamon, James Rankin, Robert Ton, for their useful communications, and Tristan Nakagawa for his comments on the manuscript. The research leading to these results has received funding from the European Community’s Seventh Framework Programme FP7/2007-2013 under grant agreement number 214728-2, and the Max Planck Society. It was also supported by the European Union grant “Brainsynch” and “BrainScaleS” by the Spanish Research Project SAF2010-16085, and by the CONSOLIDER – INGENIO 2010 Programme CSD2007-00012.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Perceiving incredulity: the role of intonation and facial gestures

  • Crespo Sendra, Verònica
  • Kaland, Constantijn
  • Swerts, Marc
  • Prieto Vives, Pilar, 1965-
Recently, some studies have revealed that facial gestures can play an important role in teasing out the meaning of interrogative sentence types in a particular language (Srinivasan and Massaro, 2003 and Borràs-Comes and Prieto, 2011; among others). However, less is known about potential cross-linguistic differences. This paper investigates the interaction between facial gestures and intonation in the distinction between information-seeking and incredulity yes/no questions in two languages (i.e., Catalan and Dutch) which use different prosodic strategies to express the distinction between these two types of interrogatives. While Dutch uses two phonologically distinct intonational contours, Catalan uses the same pitch contour with a distinction in pitch range. Twenty listeners of Catalan and twenty listeners of Dutch performed a perception experiment with audio-only, video-only, and audiovisual stimuli in congruent and incongruent intonation and gestural combinations. The results reveal that there is a contrast between Dutch and Catalan listeners in the perceptual processing of these sentences. While Dutch participants rely more on intonational differences, Catalan participants use the facial expression cues to a greater extent. All in all, the results show that both languages express pragmatic contrasts both at the intonation and facial expression levels, and native speakers are highly sensitive to the relative weight of these cues at the perceptual level., Parts of this paper were presented at the Phonetics and Phonology in Iberia Conference, 21–23 June 2011, at Universitat Rovira i Virgili in Tarragona (Spain). We are grateful to the audience at this conference for their helpful comments and discussion, especially Carlos Gussenhoven, and to the GrEP group for their help and comments. This research has been funded by projects FFI2009-07648/FILO and by the CONSOLIDER-INGENIO 2010 Programme CSD2007-00012 (both awarded by the Ministerio de Ciencia e Innovación), by project 2009 SGR 701 (awarded by the Generalitat de Catalunya) and by the Atles interactiu de l’entonació del valencià (awarded by the Acadèmia Valenciana de la Llengua).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Pitch range, gestural information and perceived politeness in Catalan

  • Nadeu, Marianna
  • Prieto Vives, Pilar, 1965-
It is known that certain prosodic aspects of speech play a role in the expression of paralinguistic meaning, yet the concrete mechanisms of how this is implemented have not yet been fleshed out. The present article attempts to explore the contribution of pitch range to the expression of politeness in information-seeking yes–no questions in Catalan. Two perception experiments were carried out with stimuli that contained a gradual increase and decrease of the pitch range at the end of two target intonation contours (rising and falling). The results of the first experiment revealed that, for both contours, increasing the pitch range of the final part of the utterance tone resulted in a decrease of perceived politeness, whereas decreasing the pitch range had no effect. The second perception experiment showed that adding contextual (gestural) information reversed the tendency. Taken together, these results point to the complex interaction between prosodic cues and contextual information (specifically, facial gestures). There is nothing intrinsically polite about using an increased pitch range, unless it is accompanied by consistent contextual information. In sum, when assessing the degree of perceived politeness of an utterance, attention has to be paid to various prosodic aspects together with contextual and gestural information., Parts of this study were presented at the first Cat_ToBI workshop (Barcelona, July 2009). We are grateful to the audience at this workshop, and especially to Eulàlia Bonet, Teresa Cabré, Verònica Crespo, José Ignacio Hualde, Joan C. Mora, Maria del Mar Vanrell, and Anne Wichmann for very useful feedback. We would like to thank the participants in the two experiments, Verònica Crespo for her help running the experiments, Joan C. Mora for his support with the use of DmDx, Romà Rofes for technical support, and Maria del Mar Vanrell for her help with the statistical analysis of the data. This research has been funded by projects FFI2009-07648/FILO and CONSOLIDER-INGENIO 2010 Programme CSD2007-00012 (both awarded by the Ministerio de Ciencia e Innovación) and by project 2009 SGR 701 (awarded by the Generalitat de Catalunya).