Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 7
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Navigating the semantic space: unraveling the structure of meaning in psychosis using different computational language models

  • He, Rui
  • Palominos Flores, Claudio Antonio
  • Zhang, Han
  • Alonso-Sánchez, Maria Francisca
  • Palaniyappan, Lena
  • Hinzen, Wolfram
Includes supplementary materials for the online appendix., Speech in psychosis has long been ascribed as involving `loosening of associations'. We pursued the aim to elucidate its underlying cognitive mechanisms by analysing picture descriptions from 94 subjects (29 healthy controls, 18 participants at clinical high risk, 29 with first-episode psychosis, and 18 with chronic schizophrenia), using five language models with different computational architectures: FastText, which represents meaning non-contextually/statically; BERT, which represents contextual meaning sensitive to grammar and context; Infersent and SBERT, which provide sentential representations; and CLIP, which evaluates speech relative to a visual stimulus. These models were used to quantify semantic distances crossed between successive tokens/sentences, and semantic perplexity indicating unexpectedness in continuations. Results showed that, among patients, semantic similarity increased when measured with FastText, Infersent, and SBERT, while it decreased with CLIP and BERT. Higher perplexity was observed in first-episode psychosis. Static semantic measures were associated with clinically measured impoverishment of thought and referential semantic measures with disorganization. These patterns indicate a shrinking conceptual semantic space as represented by static language models, which co-occurs with a widening in the referential semantic space as represented by contextual models. This duality underlines the need to separate these two forms of meaning for understanding mechanisms involved in semantic change in psychosis., This research was supported by the Ministerio de Ciencia, Innovación y Universidades (MCIU) and the Agencia Estatal de Investigación (AEI) (grant PID2019-105241GB-I00/AEI/10.13039/501100011033 to WH), the grant TRUSTING, HORIZON-HLTH-2022-STAYHLTH-01, grant nr. 101080251-2 (to WH), China Scholarship Council (grant 202108390062 to RH), the Department of Science and Technology of Guangdong Province (grant 112175605105 to WH and RH), and the National Agency for Research and Development (ANID), Scholarship Program, Becas Chile 2019, Postdoctoral Fellow 74200048 (MA) (to MFAS). The data acquisition for this study was funded by CIHR Foundation Grant (FDN 154296) to LP and was supported by the Canada First Excellence Research Fund to BrainSCAN, Western University (Imaging Core); Innovation fund for Academic Medical Organization of Southwest Ontario; Bucke Family Fund, The Chrysalis Foundation and The Arcangelo Rea Family Foundation (London, Ontario). Compute Canada Resources (Application no. 1530) were used in the storage and analysis of imaging data. LP acknowledges research support from the Canada First Research Excellence Fund, awarded to the Healthy Brains, Healthy Lives initiative at McGill University (New Investigator Supplement); Monique H. Bourgeois Chair in Developmental Disorders and Graham Boeckh Foundation (Douglas Research Centre, McGill University) and a salary award from the Fonds de recherche du Quebec-Sante' (FRQS).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

The 'L-factor': language as a transdiagnostic dimension in psychopathology

  • Hinzen, Wolfram
  • Palaniyappan, Lena
Thoughts and moods constituting our mental life incessantly change. When the steady flow of this dynamics diverges in clinical directions, the possible pathways involved are captured through discrete diagnostic labels. Yet a single vulnerable neurocognitive system may be causally involved in psychopathological deviations transdiagnostically. We argue that language viewed as integrating cortical functions is the best current candidate, whose forms of breakdown along its different dimensions are then manifest as symptoms - from prosodic abnormalities and rumination in depression to distortions of speech perception in verbal hallucinations, distortions of meaning and content in delusions, or disorganized speech in formal thought disorder. Spontaneous connected speech provides continuous objective readouts generating a highly accessible bio-behavioral marker with the potential of revolutionizing neuropsychological measurement. This argument turns language into a transdiagnostic 'L-factor' providing an analytical and mechanistic substrate for previously proposed latent general factors of psychopathology ('p-factor') and cognitive functioning ('c-factor'). Together with immense practical opportunities afforded by rapidly advancing natural language processing (NLP) technologies and abundantly available data, this suggests a new era of translational clinical psychiatry, in which both psychopathology and language may be rethought together., L Palaniyappan's research is supported by the Canada First Research Excellence Fund, awarded to the Healthy Brains, Healthy Lives initiative at McGill University (through New Investigator Supplement to LP) and Monique H. Bourgeois Chair in Developmental Disorders. He receives a salary award from the Fonds de recherche du Quebec-Sante - (FRQS). WH acknowledges the grant TRUSTING, HORIZON-HLTH-2022-STAYHLTH-01, grant nr. 101080251-2.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

What is the retest reliability of computationally extractable speech and language markers?

  • Cokal, Derya
  • Villalba, Martin
  • He, Rui
  • Flores Palominos, Claudio
  • Boke, Annkathrin
  • Homan, Philipp
  • von Heusinger, Klaus
  • Kambeitz, Joseph
  • Hinzen, Wolfram
Speech is a signal rich in information about cognitive and affective states, which can be of high clinical utility for detecting and monitoring mental health conditions. Numerous studies have employed natural language processing (NLP) and AI-based language models to derive potential psychological and neurocognitive insights from spontaneous speech as a marker. However, only few studies have investigated the test-retest reliability of commonly used features, a basic psychometric property crucial to clinical applications. In the present study, we use a crowdsourcing approach to test the reliability of a comprehensive set of speech- and language markers across three speech elicitation tasks (free speech, picture and cartoon descriptions) and four time points, using the intra-class correlation coefficient (ICC). We also explore the underlying factor structure of the feature space through an exploratory factor analysis (EFA). Results indicate that acoustic-prosodic features exhibit high test-retest reliability across all sessions. In contrast, semantic measures (e.g., semantic similarity, information density, and perplexity), speech quantity metrics, and syntactic complexity, exhibit low reliability, even when stimulus materials used for speech elicitation were kept identical. Although semantic features showed strong within-subject variability, EFA across the feature space revealed a latent factor specifically comprising BERT-based semantic features with a moderate-to-high ICC of 0.76. There was some limited evidence of free speech showing lower ICCs across tasks. Demographic, emotional and physical state factors contributed negligibly to ICC variance, indicating that these external factors had minimal impact on the consistency of the acoustic and semantic features. Overall, we find that acoustic-prosodic and text-based features have crucially different psychometric properties, with the latter showing low test-retest reliability individually, though semantic features form intercorrelated clusters that are more stable and capture significant aspects of the variance., This work was supported by the European Union (GA 101080251..÷TRUSTING, PI: Hinzen & PH) and the University of Cologne, Excellence Research Program (PI: D.Ç.; JK; KvH; WH). The Deutsche Forschungsgemeinschaft (DFG, German Research Foundation) 'Project-ID 281511265 -SFB 1252 Prominence in Language -at the University of Cologne, Department of German Language and Literature I, Linguistics. Funding Open Access funding enabled and organized by Projekt DEAL.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Speech-based relapse prediction in psychosis using explainable AI: protocol for the international multicentre observational TRUSTING study

  • Huppi, Roya Melanie
  • Bautista, Lucía
  • Cecere, Giacomo
  • Omlor, Wolfgang
  • Just, Sandra Anna
  • Koops, Sanne
  • Hussain, Musarrat
  • Tedeschi, Enrico
  • Benke-Bruderer, Stephan
  • Bora, Emre
  • Lyne, John
  • Kaiser, Stefan
  • Sprungli-Toffel, Elodie
  • Kirschner, Matthias
  • Mikalsen, Karl Øyvind
  • Bongo, Lars Ailo
  • Van der Eycken, Erik
  • Španiel, Filip
  • Elvevag, Brita
  • Sommer, Iris EC
  • Hinzen, Wolfram
  • Homan, Philipp
INTRODUCTION: The course of psychotic disorders typically involves relapses. Early warning signs vary between individuals and are difficult to detect in clinical practice, especially in outpatient settings. Speech provides a quantitative clinical marker for detecting such early warning signs. The EU Horizon project TRUSTING (A TRUSTworthy speech-based AI monitoring system for the prediction of relapse in individuals with schizophrenia) aims to develop and evaluate a speech-based monitoring system for predicting imminent psychotic relapses. The study will examine the potential for prospective relapse prediction, and feasibility and usability of the monitoring system. METHODS AND ANALYSIS: In this multicentre observational study, n=240 remitted and at-risk-of-relapse adults with psychotic disorders and a comparison group with n=120 healthy participants (matched by age and sex) will be examined at six sites and in six different languages (German, French, Dutch, English, Czech and Turkish). The follow-up period is 6 months. The TRUSTING smartphone app will be used to collect weekly voice recordings through speech tasks; information on medication adherence, substance use, mood, anxiety and sleep quality; and motor data from a tapping task. Primary endpoints encompass model performance for relapse prediction, user adherence, transcription quality, usability of recordings and overall system usability. The primary analysis of user adherence, transcription quality, usability of recordings and overall system usability will be an unadjusted description of the respective proportions using 95% Wilson confidence intervals. Regarding relapse prediction, the predictive value of the risk estimates for relapse occurrence will be assessed using the area under the receiver operating characteristic curve. Exploratory analysis will be performed on potential speech-based markers associated with relapse risk. ETHICS AND DISSEMINATION: This study has been approved by swissethics (Business Administration System for Ethics Committees number: 2025-01177). Findings from this project will be disseminated through peer-reviewed journal publications and presentations at relevant scientific conferences, as well as at public events related to mental health. TRIAL REGISTRATION: ClinicalTrials.gov ID: NCT07397975., The TRUSTING project is supported by the EU¿s Horizon Europe research and innovation programme under grant agreement No 101080251. Views and opinions expressed are, however, those of the author(s) only and do not necessarily reflect those of the European Union or the European Health and Digital Executive Agency (HaDEA). Neither the EU nor the granting authority can be held responsible for them. At the time of funding, Switzerland was not an associated country in Horizon Europe and Switzerland was not automatically eligible for EU funding. Therefore, the budgets for the University of Zurich and the University of Geneva (Geneva, Switzerland) were covered by the Swiss State Secretariat for Education, Research and Innovation (SERI) (ID: 23.00176).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Using AI to detect psychosis relapse: scoping review

  • Ghelfi, Lorenzo
  • Hinzen, Wolfram
  • Lyne, John Paul
Background: Psychotic disorder represents a leading cause of disability worldwide, and relapse in psychosis is common. Artificial intelligence (AI) is increasingly recognized as a method that could aid clinical monitoring for individuals experiencing psychosis. Objective: This review aims to map the existing literature on AI-based approaches-including machine learning, deep learning, and natural language processing-used to detect relapse in individuals with psychotic disorders. Methods: A systematic search strategy was conducted on PubMed, PsycINFO, and Embase up to January 7, 2026. Observational studies, randomized controlled trials, and quasi-experimental studies that used AI methods to detect relapse in psychosis were eligible for inclusion. Screening and data extraction procedures were conducted by at least 2 reviewers working independently. Findings were extracted, charted, and described using narrative synthesis based on data extraction and consensus meetings with the research team. The scoping review was prospectively registered with the Open Science Framework. Results: Relevant studies identified (N=10) included the use of digital tools such as smartphone- and smartwatch-based monitoring, ecological momentary assessment tools, social media activity, and internet searches. Digital phenotyping via smartphones and wearables emerged as the most common method for data collection. The efficacy of AI models varied with sensitivity (or recall) ranging from 0.25 to 0.77 and specificity (or precision) ranging from 0.06 to 0.88. The reported area under the receiver operating characteristic curve for models ranged from 0.63 to 0.78. AI models were heterogeneous across studies, and most study findings were not replicated. Conclusions: This scoping review highlights both the promise and the current limitations of AI in psychosis relapse detection. Passive digital phenotyping research in the detection of psychosis relapse has progressed, and personalized approaches with individual-level modeling show promise; however, further studies need to include larger numbers of participants and should incorporate methods such as large language models. Future studies will require large collaborations aimed at delivering AI methods for use in real-world clinical practice., LG, MC, and DC are supported by the European Union's Horizon Europe Research and Innovation Programme (Youth-GEMs, grant agreement 101057182), funded by the European Health and Digital Executive Agency (HADEA); JH, JPL, SAJ, S Kaiser, S Koops, JdB, EB, WH, PH, IES, DC, and MC are supported by Horizon Europe Health (proposal 101080251-2, HORIZON-HLTH-2022-STAYHLTH-01 two-stage, grant 23209A01). DC is also funded by the Health Research Board (HRB) Psychosis Ireland Structured Training and Research (PSI-STAR) Clinical Doctoral Award CDA 2021-0005 and by a research grant from Science Foundation Ireland (SFI) under grant 16/RC/ 3948, co-funded by the European Regional Development Fund and FutureNeuro industry partners. DC is additionally supported by HRB VISTA project and HRB ILP award. MC is supported by a European Research Council Consolidator Award (iHEAR 724809) and is partly funded by the HRB Investigator Lead Project (ILP-PHR-2019-009). This publication has emanated from research supported in part by a research grant from Research Ireland under grant 21/RC/10294_P2 and co-funded under the European Regional Development Fund. This study received no other financial supports, and research funders had no input to the content of the study. The TRUSTING project has received funding from the European Union's Horizon Europe research and innovation programme under grant agreement 101080251.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Navigating the semantic space: unraveling the structure of meaning in psychosis using different computational language models

  • He, Rui
  • Palominos Flores, Claudio Antonio
  • Zhang, Han
  • Alonso-Sánchez, Maria Francisca
  • Palaniyappan, Lena
  • Hinzen, Wolfram
Includes supplementary materials for the online appendix., Speech in psychosis has long been ascribed as involving `loosening of associations'. We pursued the aim to elucidate its underlying cognitive mechanisms by analysing picture descriptions from 94 subjects (29 healthy controls, 18 participants at clinical high risk, 29 with first-episode psychosis, and 18 with chronic schizophrenia), using five language models with different computational architectures: FastText, which represents meaning non-contextually/statically; BERT, which represents contextual meaning sensitive to grammar and context; Infersent and SBERT, which provide sentential representations; and CLIP, which evaluates speech relative to a visual stimulus. These models were used to quantify semantic distances crossed between successive tokens/sentences, and semantic perplexity indicating unexpectedness in continuations. Results showed that, among patients, semantic similarity increased when measured with FastText, Infersent, and SBERT, while it decreased with CLIP and BERT. Higher perplexity was observed in first-episode psychosis. Static semantic measures were associated with clinically measured impoverishment of thought and referential semantic measures with disorganization. These patterns indicate a shrinking conceptual semantic space as represented by static language models, which co-occurs with a widening in the referential semantic space as represented by contextual models. This duality underlines the need to separate these two forms of meaning for understanding mechanisms involved in semantic change in psychosis., This research was supported by the Ministerio de Ciencia, Innovación y Universidades (MCIU) and the Agencia Estatal de Investigación (AEI) (grant PID2019-105241GB-I00/AEI/10.13039/501100011033 to WH), the grant TRUSTING, HORIZON-HLTH-2022-STAYHLTH-01, grant nr. 101080251-2 (to WH), China Scholarship Council (grant 202108390062 to RH), the Department of Science and Technology of Guangdong Province (grant 112175605105 to WH and RH), and the National Agency for Research and Development (ANID), Scholarship Program, Becas Chile 2019, Postdoctoral Fellow 74200048 (MA) (to MFAS). The data acquisition for this study was funded by CIHR Foundation Grant (FDN 154296) to LP and was supported by the Canada First Excellence Research Fund to BrainSCAN, Western University (Imaging Core); Innovation fund for Academic Medical Organization of Southwest Ontario; Bucke Family Fund, The Chrysalis Foundation and The Arcangelo Rea Family Foundation (London, Ontario). Compute Canada Resources (Application no. 1530) were used in the storage and analysis of imaging data. LP acknowledges research support from the Canada First Research Excellence Fund, awarded to the Healthy Brains, Healthy Lives initiative at McGill University (New Investigator Supplement); Monique H. Bourgeois Chair in Developmental Disorders and Graham Boeckh Foundation (Douglas Research Centre, McGill University) and a salary award from the Fonds de recherche du Quebec-Sante' (FRQS).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

The 'L-factor': language as a transdiagnostic dimension in psychopathology

  • Hinzen, Wolfram
  • Palaniyappan, Lena
Thoughts and moods constituting our mental life incessantly change. When the steady flow of this dynamics diverges in clinical directions, the possible pathways involved are captured through discrete diagnostic labels. Yet a single vulnerable neurocognitive system may be causally involved in psychopathological deviations transdiagnostically. We argue that language viewed as integrating cortical functions is the best current candidate, whose forms of breakdown along its different dimensions are then manifest as symptoms - from prosodic abnormalities and rumination in depression to distortions of speech perception in verbal hallucinations, distortions of meaning and content in delusions, or disorganized speech in formal thought disorder. Spontaneous connected speech provides continuous objective readouts generating a highly accessible bio-behavioral marker with the potential of revolutionizing neuropsychological measurement. This argument turns language into a transdiagnostic 'L-factor' providing an analytical and mechanistic substrate for previously proposed latent general factors of psychopathology ('p-factor') and cognitive functioning ('c-factor'). Together with immense practical opportunities afforded by rapidly advancing natural language processing (NLP) technologies and abundantly available data, this suggests a new era of translational clinical psychiatry, in which both psychopathology and language may be rethought together., L Palaniyappan's research is supported by the Canada First Research Excellence Fund, awarded to the Healthy Brains, Healthy Lives initiative at McGill University (through New Investigator Supplement to LP) and Monique H. Bourgeois Chair in Developmental Disorders. He receives a salary award from the Fonds de recherche du Quebec-Sante - (FRQS). WH acknowledges the grant TRUSTING, HORIZON-HLTH-2022-STAYHLTH-01, grant nr. 101080251-2.