Pasar al contenido principal

CONECTANDO PERCEPCION Y CONFLICTO

PID2022-137277NB-I00

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal para Impulsar la Investigación Científico-Técnica y su Transferencia
Subprograma Subprograma Estatal de Generación de Conocimiento
Convocatoria Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Año convocatoria 2022
Plan Estatal 2021-2023 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario UNIVERSITAT POMPEU FABRA CCT

Resultados relacionados

Resultados totales (Incluyendo duplicados): 22
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Sensory stimulation enhances visual working memory capacity

  • Pileckyte, Indre
  • Soto-Faraco, Salvador, 1970-
Visual working memory (vWM) plays a crucial role in visual information processing and higher cognitive functions; however, it has a very limited capacity. Recently, several studies have successfully modulated vWM capacity in humans using entrainment with transcranial alternate current stimulation (tACS) by targeting parietal theta in a frequency-specific manner. In the current study, we aim to expand upon these findings by utilizing sensory instead of electrical stimulation. Across six behavioral experiments (combined N=209), we applied rhythmic visual and auditory sensory stimulation at 4 Hz and 7 Hz, aiming to modulate vWM capacity. Collectively, the results showed an overall robust improvement with sensory stimulation at either frequency, compared to baseline. However, contrary to our prediction, 7 Hz stimulation tended to slightly outperform 4 Hz stimulation. Importantly, the observed facilitatory effect was mainly driven by the low-capacity sub-group of participants. Follow-up experiments using the Attention Network Test (ANT) and pupillometry measures did not find evidence that this effect could be directly attributed to modulation of phasic or tonic arousal. We speculate that our results differed from those obtained with tACS due to targeting functionally different theta oscillations, or the modulation of participants' temporal expectations., This work has been supported by the grant from the Agency for Management of University and Research Grants (2021 SGR 00911), Ministerio de Ciencia e Innovación (PID2022-137277NB-I00 AEI/FEDER), and was part of the PID2022-137277NB-I00 project financed by MICIU/AEI/10.13039/501100011033 and by 'ERDF A way of making Europe'. I.P. was supported by a fellowship from 'la Caixa' Foundation (ID 100010434; fellowship code LCF/BQ/DI18/11660026), which has received funding from the European Unions Horizon 2020 research and innovation program under the Marie Sklodowska-Curie grant agreement No. 713673. The funders had no role in study design, data collection and analysis, decision to publish or preparation of the manuscript. We would also like to thank Pau Castro San Cristóbal, Georgios Chatzopoulos, Balázs Juhász, and Mitchell Walters, who helped with setting up the protocols and the data collection in individual experiments.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Task-related aperiodic EEG (1/f) activity in autism

  • Matyjek, Magdalena
  • Soto-Faraco, Salvador, 1970-
  • Alvarez Martin, Claudia
  • Torralba Cuello, Mireia
Autism has been hypothesized to involve atypicalities in the balance between neural excitation and inhibition (E/I). Aperiodic EEG activity, characterized by the 1/f exponent of the power spectrum, provides a proxy of cortical E/I dynamics. However, prior studies in autism report mixed findings regarding the slope of aperiodic activity. One potentially important modulator of EEG slope is task engagement. Here, we examined variations in aperiodic slopes in autistic (n = 35) and neurotypical (n = 39) adults during passive viewing and an active, goal-directed task. The data revealed that autistic participants exhibited steeper slopes (indicative of increased inhibition vs. excitation) during the active task relative to passive viewing, whereas neurotypical participants showed no significant task-related changes. These findings suggest that aperiodic activity reflects dynamic, task-dependent neural adaptation rather than baseline group differences. Task engagement may reveal compensatory inhibitory processes in autistic adults, underscoring the importance of considering task demands and individual variability when investigating E/I balance in autism., This project has received funding from the European Union's Horizon 2020 research and innovation program under the Marie Skodowska-Curie (grant agreement no 945380), Agencia Estatal de Investigación (grant PID2022-137277NB-I00 MICIU/AEI/10.13039/501100011033) and FEDER, and AGAUR Generalitat de Catalunya (grant 2021 SGR00911).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Audiovisual speech perception in Brazilian Portuguese-speaking children with and without Speech Sound Disorder (SSD)

  • Berti, Larissa
  • Rodrigues Domingues, Isabella
  • Ayo Yamamura, Brenda
  • Soto-Faraco, Salvador, 1970-
Data de publicació electrònica: 25-06-2026, This study compared single-modality and audiovisual (crossmodally congruent and incongruent) speech perception in Brazilian Portuguese-speaking children with and without Speech Sound Disorders (SSD). Thirty-six children (17 with and 19 without SSD; average age = 6;7) participated in an adapted syllable identification test. The auditory and visual stimuli consisted of monosyllabic consonant-vowel utterances involving [p,b,t,d,k,g,f,v,s,z,ʃ,ʒ,m,n,ɲ,l,ʎ,ɾ,χ,w], produced in the context of [a] vowel. The stimuli were presented in different modality conditions: auditory-only (AO), visual-only (VO), audio-visual congruent (AV+), and audio-visual incongruent (AV-). As expected, children with SSD showed lower perceptual accuracy than TD children across all modalities (AO, VO, and AV+), indicating that their difficulties are not restricted to the visual domain. The prediction that SSD children would show reduced audiovisual integration was not confirmed. No differences were observed between groups in terms of visual gain from congruent audiovisual stimuli or susceptibility to the McGurk illusion, although both groups exhibited the effect. Exploratory analyses revealed that age accounts for part of the group differences, particularly in the VO condition, while differences in AO and AV+ remained partially independent of age. Within the SSD group, PCC-R showed no significant multivariate effect, although univariate results indicated positive associations with AO and AV+, but not VO. Although SSD children show reduced accuracy in speech perception across sensory modalities, audiovisual speech integration appears preserved. The variability observed within the SSD group suggests a complex and heterogeneous developmental profile that cannot be fully explained by age or severity, underscoring the need for integrated and individualised intervention approaches., The work was supported by the Conselho Nacional de Desenvolvimento Científico e Tecnológico [14973 - 8/2024 - PIBIC and 306919/2023-0]; Coordenação de Aperfeiçoamento de Pessoal de Nível Superior [Finance Code 001]; Fundação de Amparo à Pesquisa do Estado de São Paulo [2023/10136-9]; AGAUR Generalitat de Catalunya [2021 SGR 00911]; Ministerio de Ciencia e Innovación [PID2022-137277NB-I00 AEI/FEDER].
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Binocular rivalry: evaluating the role of theta power as a neural index of conflict

  • Drew, Alice
  • San-Segundo Gonzalez, Jorge
  • Soto-Faraco, Salvador, 1970-
  • Torralba Cuello, Mireia
Binocular rivalry (BR) occurs when each eye is presented with mutually incompatible images, and the brain alternates between perceiving one image, the other or occasionally a mashup of both. Addressing a decades-old suggestion, it has been shown that the competition between alternative representations in BR induces a pattern of neural activation resembling that occurring in cognitive conflict, eventually leading to fluctuations between different perceptual outcomes in the case of steep competition. This is reflected by known signatures of conflict dynamics, namely, an increase in fronto-medial theta oscillatory power (5–7 Hz) in the EEG right before perceptual transitions and a decrease thereafter, as well as a decrease in parieto-occipital alpha oscillatory power (8–12 Hz) prior to perceptual transitions and an increase thereafter. However, according to a growing body of research, frontal activity during BR might be related to report processes rather than perception processing per se. Such conflation is related to the use of continuous report protocols. To circumvent this confound, here, we present a BR study using an onset rivalry (rather than continuous rivalry) protocol that dissociates the moment of report from the period of stimulus presentation. The findings revealed higher fronto-medial theta power for rivalrous than for non-rivalrous stimuli both resulting in equivalent perceptual classification, despite the absence of a motor confound. In addition, we found greater parieto-occipital alpha suppression for rivalrous stimuli. The results presented here advance our understanding of how cognitive conflict monitoring and resolution may influence perception in the event of competition from incompatible sensory patterns., This research was supported by PID2022-137277NB-I00 funded by MICIU/AEI/10.13039/501100011033 and by ‘ERDF A way of making Europe’, ‘ERDF, EU’ and AGAUR Generalitat de Catalunya (2021 SGR 00911) grants to S.S-F. A.D. was supported by AGAUR Generalitat de Catalunya (FI-DGR 2019). M.T.C. was supported by Grant PDC2022-133859-I00 funded by MICIU/AEI/10.13039/501100011033 and by the European Union NextGenerationEU/PRTR. J.S-S.G. was partly supported by grant PIPF-2022/SAL-GL-25279 from Comunidad de Madrid as well as a grant from Ministerio de Educación y FP (21CO1/013355).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Crossmodal semantics in memory: scoping review and meta-analyses of multisensory effects in short-term and episodic memory systems

  • Soto-Faraco, Salvador, 1970-
  • Spence, Charles
The human brain represents objects and events in the environment by binding together their defining semantic attributes across the senses (e.g., vision, hearing, touch). Semantic relationships between these attributes in different senses, or crossmodal semantic relationships, are fundamental to carving out meaningful categories and to encode and store experiences in the form of memories for later retrieval. Unsurprisingly, the subject of crossmodal semantic interactions in human memory has been on the agenda of researchers interested in multisensory processes for several decades now and there appears to be a renewed wave of interest in the field currently. By and large, the central question has been whether or not memories for events with crossmodally congruent semantic attributes are better remembered. Nevertheless, this research area has been characterized by mixed methodological approaches, inconsistent outcomes, and alternative theoretical interpretations, with few attempts at synthesis. Here, we examine the past 30 years of research on the topic, covering short-term as well as episodic memory systems. First, we garner existing evidence in a systematic scoping review of studies, complemented by meta-analyses. Then, we provide a synthesis highlighting outstanding empirical questions and potential contradictions between competing theoretical interpretations. With some exceptions, there is abundant support for the hypothesis that crossmodally congruent events are better remembered than single-modality or crossmodal but incongruent events. Nevertheless, the mechanisms underlying this multisensory benefit and its theoretical interpretation are still the subject of substantial debates. We propose avenues to resolve these issues and advance current knowledge in this burgeoning research area., Paul Verhaeghen served as action editor.The data sets and scripts used in this review are available on the Open Science Framework project at https://osf.io/35qsf, including (a) a spreadsheet with the detailed Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for scoping reviews article selection process, from initial search output to the final article sample, and (b) the datafiles and scripts used for the meta-analyses.The preparation of the article was supported by Generalitat de Catalunya, Agència de Gestió d'Ajuts Universitaris i de Recerca Grant AGAUR 2021 SGR 00911, Institució Catalana de Recerca i Estudis Avançats, Agencia Española de Investigación (AEI) Grant PID2022-137277NB-I00 AEI/FEDER awarded to Salvador Soto-Faraco, and Arts and Humanities Research Council (AHRC) Grant AH/L007053/1 awarded to Charles Spence. The authors are grateful to Miguel Vadillo for precious advice on conducting meta-analyses and feedback on an earlier version of this article.Salvador Soto-Faraco played a lead role in data curation, methodology, project administration, software, visualization, and writing-original draft and an equal role in conceptualization, funding acquisition, investigation, resources, and writing-review and editing. Charles Spence played a supporting role in visualization and an equal role in conceptualization, funding acquisition, and writing-review and editing.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Addressing the association between action video game playing experience and visual search in naturalistic multisensory scenes

  • Hamzeloo, Mohammad
  • Kvasova, Daria
  • Soto Faraco, Salvador
Includes supplementary materials for the online appendix., Prior studies investigating the effects of routine action video game play have demonstrated improve-ments in a variety of cognitive processes, including improvements in attentional tasks. However, there is little evidence indicating that the cognitive benefits of playing action video games generalize from simplified unisensory stimuli to multisensory scenes — a fundamental characteristic of natural, everyday life environments. The present study addressed if video game experience has an impact on crossmodal congruency effects when searching through such multisensory scenes. We compared the performance of action video game players (AVGPs) and non-video game players (NVGPs) on a visual search task for objects embedded in video clips of realistic scenes. We conducted two identical online experiments with gender-balanced samples, for a total of N = 130. Overall, the data replicated previous findings reporting search benefits when visual targets were accompanied by semantically congruent auditory events, compared to neutral or incongruent ones. However, according to the results, AVGPs did not consistently outperform NVGPs in the overall search task, nor did they use multisensory cues more efficiently than NVGPs. Exploratory analyses with self-reported gender as a variable revealed a potential difference in response strategy between experienced male and female AVGPs when dealing with crossmodal cues. These findings suggest that the generalization of the advantage of AVG experience to realistic, crossmodal situations should be made with caution and considering gender-related issues., Salvador Soto-Faraco has been funded by Ministerio de Ciencia e Innovación (Ref: PID2022-137277NB-I00 AEI/FEDER), and AGAUR Generalitat de Catalunya (2021 SGR 00911). This project has been co-funded for 50% by the European Regional Development Fund under the framework of the ERFD Operative Programme for Catalunya 2014-2020, with a grant of €1.527.637,88. This article was published with financial support from the University of Hildesheim Foundation.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Multisensory integration of naturalistic speech and gestures in autistic adults

  • Matyjek, Magdalena
  • Kita, Sotaro
  • Torralba Cuello, Mireia
  • Soto-Faraco, Salvador, 1970-
Seeing the speaker often facilitates auditory speech comprehension through audio-visual integration. This audio-visual facilitation is stronger under challenging listening conditions, such as in real-life social environments. Autism has been associated with atypicalities in integrating audio-visual information, potentially underlying social difficulties in this population. The present study investigated multisensory integration (MSI) of audio-visual speech information among autistic and neurotypical adults. Participants performed a speech-in-noise task in a realistic multispeaker social scenario with audio-visual, auditory, or visual trials while their brain activity was recorded using EEG. The neurotypical group demonstrated a non-linear audio-visual effect in alpha oscillations, whereas the autistic group showed merely additive processing. Despite these differences in neural correlates, both groups achieved similar behavioral audio-visual facilitation outcomes. These findings suggest that although autistic and neurotypical brains might process multisensory cues differently, they achieve comparable benefits from audio-visual speech. These results contribute to the growing body of literature on MSI atypicalities in autism., This project has received funding from the European Union's Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 945380. Agencia Estatal de Investigación (PID2022-137277NB-I00AEI/FEDER), and AGAUR Generalitat de Catalunya (2021 SGR 00911).
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Crossmodal semantic congruence and rarity improve episodic memory

  • Packard, Pau A.
  • Soto-Faraco, Salvador, 1970-
Semantic congruence across sensory modalities at encoding of information has been shown to improve memory performance over a short time span. However, the beneficial effect of crossmodal congruence is less well established when it comes to episodic memories over longer retention periods. This gap in knowledge is particularly wide for cross-modal semantic congruence under incidental encoding conditions, a process that is especially relevant in everyday life. Here, we present the results of a series of four experiments (total N = 232) using the dual-process signal detection model to examine crossmodal semantic effects on recollection and familiarity. In Experiment 1, we established the beneficial effects of crossmodal semantics in younger adults: hearing congruent compared with incongruent object sounds during the incidental encoding of object images increased recollection and familiarity after 48 h. In Experiment 2 we reproduced and extended the finding to a sample of older participants (50-65 years old): older people displayed a commensurable crossmodal congruence effect, despite a selective decline in recollection compared with younger adults. In Experiment 3, we showed that crossmodal facilitation is resilient to large imbalances between the frequency of congruent versus incongruent events (from 10 to 90%): Albeit rare events are more memorable than frequent ones overall, the impact of this rarity effect on the crossmodal benefit was small, and only affected familiarity. Collectively, these findings reveal a robust crossmodal semantic congruence effect for incidentally encoded visual stimuli over a long retention span, bearing the hallmarks of episodic memory enhancement., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This research was supported by grants from the Ministerio de Ciencia e Innovación (PID2022-137277NB-I00 AEI/FEDER) and from AGAUR Generalitat de Catalunya (2021 SGR 00911) to S.S.-F. P.A.P. was funded by a Juan de la Cierva Fellowship from the Ministerio de Ciencia e Innovación (FJC2018-037782-I).
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Multisensory integration of naturalistic speech and gestures in autistic adults

  • Matyjek, Magdalena
  • Kita, Sotaro
  • Torralba Cuello, Mireia|||0000-0003-3035-3918
  • Soto-Faraco, Salvador
Seeing the speaker often facilitates auditory speech comprehension through audio-visual integration. This audio-visual facilitation is stronger under challenging listening conditions, such as in real-life social environments. Autism has been associated with atypicalities in integrating audio-visual information, potentially underlying social difficulties in this population. The present study investigated multisensory integration (MSI) of audio-visual speech information among autistic and neurotypical adults. Participants performed a speech-in-noise task in a realistic multispeaker social scenario with audio-visual, auditory, or visual trials while their brain activity was recorded using EEG. The neurotypical group demonstrated a non-linear audio-visual effect in alpha oscillations, whereas the autistic group showed merely additive processing. Despite these differences in neural correlates, both groups achieved similar behavioral audio-visual facilitation outcomes. These findings suggest that although autistic and neurotypical brains might process multisensory cues differently, they achieve comparable benefits from audio-visual speech. These results contribute to the growing body of literature on MSI atypicalities in autism., This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska Curie grant agreement No 945380. Agencia Estatal de Investigación (PID2022-137277NB-I00AEI/FEDER), and AGAUR Generalitat de Catalunya (2021 SGR 00911)., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Task-related aperiodic EEG (1/f) activity in autism

  • Matyjek, Magdalena
  • Soto-Faraco, Salvador
  • Álvarez Martín, Claudia
  • Torralba Cuello, Mireia|||0000-0003-3035-3918
Autism has been hypothesized to involve atypicalities in the balance between neural excitation and inhibition (E/I). Aperiodic EEG activity, characterized by the 1/f exponent of the power spectrum, provides a proxy of cortical E/I dynamics. However, prior studies in autism report mixed findings regarding the slope of aperiodic activity. One potentially important modulator of EEG slope is task engagement. Here, we examined variations in aperiodic slopes in autistic ( n = 35) and neurotypical ( n = 39) adults during passive viewing and an active, goal- directed task. The data revealed that autistic participants exhibited steeper slopes (indicative of increased inhibition vs. excitation) during the active task relative to passive viewing, whereas neurotypical participants showed no significant task- related changes. These findings suggest that aperiodic activity reflects dynamic, task- dependent neural adaptation rather than baseline group differences. Task engagement may reveal compensatory inhibitory pro - cesses in autistic adults, underscoring the importance of considering task demands and individual variability when investigating E/I balance in autism., Peer Reviewed
UPCommons. Portal del coneixement obert de la UPC
Publicación Artículo científico (JournalArticle)

Single-trial characterization of frontal theta and parietal alpha oscillatory episodes during spatial navigation in humans

  • Torralba Cuello, Mireia|||0000-0003-3035-3918
  • Marti-Marca, Angela
  • Pápai, Márta Szabina
  • Soto-Faraco, Salvador
Theoretical proposals and empirical findings both highlight the relevance of theta brain oscillations in human spatial navigation. However, whilst the general assumption is that the relevant theta band activity is purely oscillatory, most empirical studies fail to disentangle oscillatory episodes from wide band activity. In addition, experimental approaches often rely on averaged activity across trials and subjects, disregarding moment-to-moment fluctuations in theta activity, contingent on key aspects of the task. Here, we used novel oscillation detection approaches to investigate the dynamics of theta and alpha episodes in human subjects performing a spatial navigation task in a virtual reality environment, resolved at single-trial level. The results suggest that bouts of frontal theta oscillatory activity are related to task difficulty and access to previously encoded information, across different timescales. Parietal alpha episodes, instead, seem to anticipate successful navigational decisions and could be related to shifts in internal attention., This research was supported by grants from the Bial Foundation (Bial 229/20) to M.T.C., and from the Ministerio de Ciencia e Innovación (PID2022-137277NB-I00 AEI/FEDER and PRESP05622—PDC2022-133859-I00), and from AGAUR Generalitat de Catalunya (2021 SGR 00911) to S.S.F. A.M.M. was partially funded by Maria de Maeztu Units of Excellence Programme CEX2021-001195-M (MICIU/AEI/10.13039/501100011033)., Peer Reviewed
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Crossmodal semantic congruence and rarity improve episodic memory

  • Packard, Pau A.
  • Soto-Faraco, Salvador, 1970-
Semantic congruence across sensory modalities at encoding of information has been shown to improve memory performance over a short time span. However, the beneficial effect of crossmodal congruence is less well established when it comes to episodic memories over longer retention periods. This gap in knowledge is particularly wide for cross-modal semantic congruence under incidental encoding conditions, a process that is especially relevant in everyday life. Here, we present the results of a series of four experiments (total N = 232) using the dual-process signal detection model to examine crossmodal semantic effects on recollection and familiarity. In Experiment 1, we established the beneficial effects of crossmodal semantics in younger adults: hearing congruent compared with incongruent object sounds during the incidental encoding of object images increased recollection and familiarity after 48 h. In Experiment 2 we reproduced and extended the finding to a sample of older participants (50-65 years old): older people displayed a commensurable crossmodal congruence effect, despite a selective decline in recollection compared with younger adults. In Experiment 3, we showed that crossmodal facilitation is resilient to large imbalances between the frequency of congruent versus incongruent events (from 10 to 90%): Albeit rare events are more memorable than frequent ones overall, the impact of this rarity effect on the crossmodal benefit was small, and only affected familiarity. Collectively, these findings reveal a robust crossmodal semantic congruence effect for incidentally encoded visual stimuli over a long retention span, bearing the hallmarks of episodic memory enhancement., Open Access funding provided thanks to the CRUE-CSIC agreement with Springer Nature. This research was supported by grants from the Ministerio de Ciencia e Innovación (PID2022-137277NB-I00 AEI/FEDER) and from AGAUR Generalitat de Catalunya (2021 SGR 00911) to S.S.-F. P.A.P. was funded by a Juan de la Cierva Fellowship from the Ministerio de Ciencia e Innovación (FJC2018-037782-I).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Single-trial characterization of frontal theta and parietal alpha oscillatory episodes during spatial navigation in humans

  • Torralba Cuello, Mireia
  • Marti Marca, Angela
  • Pápai, Márta Szabina
  • Soto-Faraco, Salvador
Theoretical proposals and empirical findings both highlight the relevance of theta brain oscillations in human spatial navigation. However, whilst the general assumption is that the relevant theta band activity is purely oscillatory, most empirical studies fail to disentangle oscillatory episodes from wide band activity. In addition, experimental approaches often rely on averaged activity across trials and subjects, disregarding moment-to-moment fluctuations in theta activity, contingent on key aspects of the task. Here, we used novel oscillation detection approaches to investigate the dynamics of theta and alpha episodes in human subjects performing a spatial navigation task in a virtual reality environment, resolved at single-trial level. The results suggest that bouts of frontal theta oscillatory activity are related to task difficulty and access to previously encoded information, across different timescales. Parietal alpha episodes, instead, seem to anticipate successful navigational decisions and could be related to shifts in internal attention., This research was supported by grants from the Bial Foundation (Bial 229/20) to M.T.C., and from the Ministerio de Ciencia e Innovación (PID2022-137277NB-I00 AEI/FEDER and PRESP05622—PDC2022-133859-I00), and from AGAUR Generalitat de Catalunya (2021 SGR 00911) to S.S.F. A.M.M. was partially funded by Maria de Maeztu Units of Excellence Programme CEX2021-001195-M (MICIU/AEI/10.13039/501100011033)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Binocular rivalry: evaluating the role of theta power as a neural index of conflict

  • Drew, Alice
  • San-Segundo Gonzalez, Jorge
  • Soto-Faraco, Salvador, 1970-
  • Torralba Cuello, Mireia
Binocular rivalry (BR) occurs when each eye is presented with mutually incompatible images, and the brain alternates between perceiving one image, the other or occasionally a mashup of both. Addressing a decades-old suggestion, it has been shown that the competition between alternative representations in BR induces a pattern of neural activation resembling that occurring in cognitive conflict, eventually leading to fluctuations between different perceptual outcomes in the case of steep competition. This is reflected by known signatures of conflict dynamics, namely, an increase in fronto-medial theta oscillatory power (5–7 Hz) in the EEG right before perceptual transitions and a decrease thereafter, as well as a decrease in parieto-occipital alpha oscillatory power (8–12 Hz) prior to perceptual transitions and an increase thereafter. However, according to a growing body of research, frontal activity during BR might be related to report processes rather than perception processing per se. Such conflation is related to the use of continuous report protocols. To circumvent this confound, here, we present a BR study using an onset rivalry (rather than continuous rivalry) protocol that dissociates the moment of report from the period of stimulus presentation. The findings revealed higher fronto-medial theta power for rivalrous than for non-rivalrous stimuli both resulting in equivalent perceptual classification, despite the absence of a motor confound. In addition, we found greater parieto-occipital alpha suppression for rivalrous stimuli. The results presented here advance our understanding of how cognitive conflict monitoring and resolution may influence perception in the event of competition from incompatible sensory patterns., This research was supported by PID2022-137277NB-I00 funded by MICIU/AEI/10.13039/501100011033 and by ‘ERDF A way of making Europe’, ‘ERDF, EU’ and AGAUR Generalitat de Catalunya (2021 SGR 00911) grants to S.S-F. A.D. was supported by AGAUR Generalitat de Catalunya (FI-DGR 2019). M.T.C. was supported by Grant PDC2022-133859-I00 funded by MICIU/AEI/10.13039/501100011033 and by the European Union NextGenerationEU/PRTR. J.S-S.G. was partly supported by grant PIPF-2022/SAL-GL-25279 from Comunidad de Madrid as well as a grant from Ministerio de Educación y FP (21CO1/013355).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Multisensory integration of naturalistic speech and gestures in autistic adults

  • Matyjek, Magdalena
  • Kita, Sotaro
  • Torralba Cuello, Mireia
  • Soto-Faraco, Salvador, 1970-
Seeing the speaker often facilitates auditory speech comprehension through audio-visual integration. This audio-visual facilitation is stronger under challenging listening conditions, such as in real-life social environments. Autism has been associated with atypicalities in integrating audio-visual information, potentially underlying social difficulties in this population. The present study investigated multisensory integration (MSI) of audio-visual speech information among autistic and neurotypical adults. Participants performed a speech-in-noise task in a realistic multispeaker social scenario with audio-visual, auditory, or visual trials while their brain activity was recorded using EEG. The neurotypical group demonstrated a non-linear audio-visual effect in alpha oscillations, whereas the autistic group showed merely additive processing. Despite these differences in neural correlates, both groups achieved similar behavioral audio-visual facilitation outcomes. These findings suggest that although autistic and neurotypical brains might process multisensory cues differently, they achieve comparable benefits from audio-visual speech. These results contribute to the growing body of literature on MSI atypicalities in autism., This project has received funding from the European Union's Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 945380. Agencia Estatal de Investigación (PID2022-137277NB-I00AEI/FEDER), and AGAUR Generalitat de Catalunya (2021 SGR 00911).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Task-related aperiodic EEG (1/f) activity in autism

  • Matyjek, Magdalena
  • Soto-Faraco, Salvador, 1970-
  • Alvarez Martin, Claudia
  • Torralba Cuello, Mireia
Autism has been hypothesized to involve atypicalities in the balance between neural excitation and inhibition (E/I). Aperiodic EEG activity, characterized by the 1/f exponent of the power spectrum, provides a proxy of cortical E/I dynamics. However, prior studies in autism report mixed findings regarding the slope of aperiodic activity. One potentially important modulator of EEG slope is task engagement. Here, we examined variations in aperiodic slopes in autistic (n = 35) and neurotypical (n = 39) adults during passive viewing and an active, goal-directed task. The data revealed that autistic participants exhibited steeper slopes (indicative of increased inhibition vs. excitation) during the active task relative to passive viewing, whereas neurotypical participants showed no significant task-related changes. These findings suggest that aperiodic activity reflects dynamic, task-dependent neural adaptation rather than baseline group differences. Task engagement may reveal compensatory inhibitory processes in autistic adults, underscoring the importance of considering task demands and individual variability when investigating E/I balance in autism., This project has received funding from the European Union's Horizon 2020 research and innovation program under the Marie Skodowska-Curie (grant agreement no 945380), Agencia Estatal de Investigación (grant PID2022-137277NB-I00 MICIU/AEI/10.13039/501100011033) and FEDER, and AGAUR Generalitat de Catalunya (grant 2021 SGR00911).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Audiovisual speech perception in Brazilian Portuguese-speaking children with and without Speech Sound Disorder (SSD)

  • Berti, Larissa
  • Rodrigues Domingues, Isabella
  • Ayo Yamamura, Brenda
  • Soto-Faraco, Salvador, 1970-
Data de publicació electrònica: 25-06-2026, This study compared single-modality and audiovisual (crossmodally congruent and incongruent) speech perception in Brazilian Portuguese-speaking children with and without Speech Sound Disorders (SSD). Thirty-six children (17 with and 19 without SSD; average age = 6;7) participated in an adapted syllable identification test. The auditory and visual stimuli consisted of monosyllabic consonant-vowel utterances involving [p,b,t,d,k,g,f,v,s,z,ʃ,ʒ,m,n,ɲ,l,ʎ,ɾ,χ,w], produced in the context of [a] vowel. The stimuli were presented in different modality conditions: auditory-only (AO), visual-only (VO), audio-visual congruent (AV+), and audio-visual incongruent (AV-). As expected, children with SSD showed lower perceptual accuracy than TD children across all modalities (AO, VO, and AV+), indicating that their difficulties are not restricted to the visual domain. The prediction that SSD children would show reduced audiovisual integration was not confirmed. No differences were observed between groups in terms of visual gain from congruent audiovisual stimuli or susceptibility to the McGurk illusion, although both groups exhibited the effect. Exploratory analyses revealed that age accounts for part of the group differences, particularly in the VO condition, while differences in AO and AV+ remained partially independent of age. Within the SSD group, PCC-R showed no significant multivariate effect, although univariate results indicated positive associations with AO and AV+, but not VO. Although SSD children show reduced accuracy in speech perception across sensory modalities, audiovisual speech integration appears preserved. The variability observed within the SSD group suggests a complex and heterogeneous developmental profile that cannot be fully explained by age or severity, underscoring the need for integrated and individualised intervention approaches., The work was supported by the Conselho Nacional de Desenvolvimento Científico e Tecnológico [14973 - 8/2024 - PIBIC and 306919/2023-0]; Coordenação de Aperfeiçoamento de Pessoal de Nível Superior [Finance Code 001]; Fundação de Amparo à Pesquisa do Estado de São Paulo [2023/10136-9]; AGAUR Generalitat de Catalunya [2021 SGR 00911]; Ministerio de Ciencia e Innovación [PID2022-137277NB-I00 AEI/FEDER].
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Sensory stimulation enhances visual working memory capacity

  • Pileckyte, Indre
  • Soto-Faraco, Salvador, 1970-
Visual working memory (vWM) plays a crucial role in visual information processing and higher cognitive functions; however, it has a very limited capacity. Recently, several studies have successfully modulated vWM capacity in humans using entrainment with transcranial alternate current stimulation (tACS) by targeting parietal theta in a frequency-specific manner. In the current study, we aim to expand upon these findings by utilizing sensory instead of electrical stimulation. Across six behavioral experiments (combined N=209), we applied rhythmic visual and auditory sensory stimulation at 4 Hz and 7 Hz, aiming to modulate vWM capacity. Collectively, the results showed an overall robust improvement with sensory stimulation at either frequency, compared to baseline. However, contrary to our prediction, 7 Hz stimulation tended to slightly outperform 4 Hz stimulation. Importantly, the observed facilitatory effect was mainly driven by the low-capacity sub-group of participants. Follow-up experiments using the Attention Network Test (ANT) and pupillometry measures did not find evidence that this effect could be directly attributed to modulation of phasic or tonic arousal. We speculate that our results differed from those obtained with tACS due to targeting functionally different theta oscillations, or the modulation of participants' temporal expectations., This work has been supported by the grant from the Agency for Management of University and Research Grants (2021 SGR 00911), Ministerio de Ciencia e Innovación (PID2022-137277NB-I00 AEI/FEDER), and was part of the PID2022-137277NB-I00 project financed by MICIU/AEI/10.13039/501100011033 and by 'ERDF A way of making Europe'. I.P. was supported by a fellowship from 'la Caixa' Foundation (ID 100010434; fellowship code LCF/BQ/DI18/11660026), which has received funding from the European Unions Horizon 2020 research and innovation program under the Marie Sklodowska-Curie grant agreement No. 713673. The funders had no role in study design, data collection and analysis, decision to publish or preparation of the manuscript. We would also like to thank Pau Castro San Cristóbal, Georgios Chatzopoulos, Balázs Juhász, and Mitchell Walters, who helped with setting up the protocols and the data collection in individual experiments.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Multisensory integration of naturalistic speech and gestures in autistic adults

  • Matyjek, Magdalena
  • Kita, Sotaro
  • Torralba Cuello, Mireia
  • Soto-Faraco, Salvador
Seeing the speaker often facilitates auditory speech comprehension through audio-visual integration. This audio-visual facilitation is stronger under challenging listening conditions, such as in real-life social environments. Autism has been associated with atypicalities in integrating audio-visual information, potentially underlying social difficulties in this population. The present study investigated multisensory integration (MSI) of audio-visual speech information among autistic and neurotypical adults. Participants performed a speech-in-noise task in a realistic multispeaker social scenario with audio-visual, auditory, or visual trials while their brain activity was recorded using EEG. The neurotypical group demonstrated a non-linear audio-visual effect in alpha oscillations, whereas the autistic group showed merely additive processing. Despite these differences in neural correlates, both groups achieved similar behavioral audio-visual facilitation outcomes. These findings suggest that although autistic and neurotypical brains might process multisensory cues differently, they achieve comparable benefits from audio-visual speech. These results contribute to the growing body of literature on MSI atypicalities in autism., This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska Curie grant agreement No 945380. Agencia Estatal de Investigación (PID2022-137277NB-I00AEI/FEDER), and AGAUR Generalitat de Catalunya (2021 SGR 00911)., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Crossmodal semantics in memory: scoping review and meta-analyses of multisensory effects in short-term and episodic memory systems

  • Soto-Faraco, Salvador, 1970-
  • Spence, Charles
The human brain represents objects and events in the environment by binding together their defining semantic attributes across the senses (e.g., vision, hearing, touch). Semantic relationships between these attributes in different senses, or crossmodal semantic relationships, are fundamental to carving out meaningful categories and to encode and store experiences in the form of memories for later retrieval. Unsurprisingly, the subject of crossmodal semantic interactions in human memory has been on the agenda of researchers interested in multisensory processes for several decades now and there appears to be a renewed wave of interest in the field currently. By and large, the central question has been whether or not memories for events with crossmodally congruent semantic attributes are better remembered. Nevertheless, this research area has been characterized by mixed methodological approaches, inconsistent outcomes, and alternative theoretical interpretations, with few attempts at synthesis. Here, we examine the past 30 years of research on the topic, covering short-term as well as episodic memory systems. First, we garner existing evidence in a systematic scoping review of studies, complemented by meta-analyses. Then, we provide a synthesis highlighting outstanding empirical questions and potential contradictions between competing theoretical interpretations. With some exceptions, there is abundant support for the hypothesis that crossmodally congruent events are better remembered than single-modality or crossmodal but incongruent events. Nevertheless, the mechanisms underlying this multisensory benefit and its theoretical interpretation are still the subject of substantial debates. We propose avenues to resolve these issues and advance current knowledge in this burgeoning research area., Paul Verhaeghen served as action editor.The data sets and scripts used in this review are available on the Open Science Framework project at https://osf.io/35qsf, including (a) a spreadsheet with the detailed Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for scoping reviews article selection process, from initial search output to the final article sample, and (b) the datafiles and scripts used for the meta-analyses.The preparation of the article was supported by Generalitat de Catalunya, Agència de Gestió d'Ajuts Universitaris i de Recerca Grant AGAUR 2021 SGR 00911, Institució Catalana de Recerca i Estudis Avançats, Agencia Española de Investigación (AEI) Grant PID2022-137277NB-I00 AEI/FEDER awarded to Salvador Soto-Faraco, and Arts and Humanities Research Council (AHRC) Grant AH/L007053/1 awarded to Charles Spence. The authors are grateful to Miguel Vadillo for precious advice on conducting meta-analyses and feedback on an earlier version of this article.Salvador Soto-Faraco played a lead role in data curation, methodology, project administration, software, visualization, and writing-original draft and an equal role in conceptualization, funding acquisition, investigation, resources, and writing-review and editing. Charles Spence played a supporting role in visualization and an equal role in conceptualization, funding acquisition, and writing-review and editing.
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Task-related aperiodic EEG (1/f) activity in autism

  • Matyjek, Magdalena
  • Soto-Faraco, Salvador
  • Álvarez Martín, Claudia
  • Torralba Cuello, Mireia
Autism has been hypothesized to involve atypicalities in the balance between neural excitation and inhibition (E/I). Aperiodic EEG activity, characterized by the 1/f exponent of the power spectrum, provides a proxy of cortical E/I dynamics. However, prior studies in autism report mixed findings regarding the slope of aperiodic activity. One potentially important modulator of EEG slope is task engagement. Here, we examined variations in aperiodic slopes in autistic ( n = 35) and neurotypical ( n = 39) adults during passive viewing and an active, goal- directed task. The data revealed that autistic participants exhibited steeper slopes (indicative of increased inhibition vs. excitation) during the active task relative to passive viewing, whereas neurotypical participants showed no significant task- related changes. These findings suggest that aperiodic activity reflects dynamic, task- dependent neural adaptation rather than baseline group differences. Task engagement may reveal compensatory inhibitory pro - cesses in autistic adults, underscoring the importance of considering task demands and individual variability when investigating E/I balance in autism., Peer Reviewed, Postprint (published version)
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Addressing the association between action video game playing experience and visual search in naturalistic multisensory scenes

  • Hamzeloo, Mohammad
  • Kvasova, Daria
  • Soto Faraco, Salvador
Includes supplementary materials for the online appendix., Prior studies investigating the effects of routine action video game play have demonstrated improve-ments in a variety of cognitive processes, including improvements in attentional tasks. However, there is little evidence indicating that the cognitive benefits of playing action video games generalize from simplified unisensory stimuli to multisensory scenes — a fundamental characteristic of natural, everyday life environments. The present study addressed if video game experience has an impact on crossmodal congruency effects when searching through such multisensory scenes. We compared the performance of action video game players (AVGPs) and non-video game players (NVGPs) on a visual search task for objects embedded in video clips of realistic scenes. We conducted two identical online experiments with gender-balanced samples, for a total of N = 130. Overall, the data replicated previous findings reporting search benefits when visual targets were accompanied by semantically congruent auditory events, compared to neutral or incongruent ones. However, according to the results, AVGPs did not consistently outperform NVGPs in the overall search task, nor did they use multisensory cues more efficiently than NVGPs. Exploratory analyses with self-reported gender as a variable revealed a potential difference in response strategy between experienced male and female AVGPs when dealing with crossmodal cues. These findings suggest that the generalization of the advantage of AVG experience to realistic, crossmodal situations should be made with caution and considering gender-related issues., Salvador Soto-Faraco has been funded by Ministerio de Ciencia e Innovación (Ref: PID2022-137277NB-I00 AEI/FEDER), and AGAUR Generalitat de Catalunya (2021 SGR 00911). This project has been co-funded for 50% by the European Regional Development Fund under the framework of the ERFD Operative Programme for Catalunya 2014-2020, with a grant of €1.527.637,88. This article was published with financial support from the University of Hildesheim Foundation.