Pasar al contenido principal

EL PAPEL DE LA PROSODIA Y LA GESTUALIDAD EN LA ADQUISICION DE LA PRAGMATICA: POBLACIONES TIPICAS Y ATIPICAS

PID2020-115385GA-I00

•
Nombre agencia financiadora Agencia Estatal de Investigación
Acrónimo agencia financiadora AEI
Programa Programa Estatal de I+D+i Orientado a los Retos de la Sociedad
Convocatoria Proyectos de I+D+i (Generación de Conocimiento y Retos Investigación)
Año convocatoria 2020
Plan Estatal 2017-2020 Plan Estatal de Investigación Científica y Técnica y de Innovación
Centro beneficiario FUNDACIO PER A LA UNIVERSITAT OBERTA DE CATALUNYA

Resultados relacionados

Resultados totales (Incluyendo duplicados): 4
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Preschoolers mark focus types through multimodal prominence: further evidence for the precursor role of gestures

  • Coego, Sara
  • Esteve Gibert, Núria
  • Prieto Vives, Pilar, 1965-
The present cross-sectional study assessed the role of multimodal cues in marking focus types during early childhood, focusing on prosodic prominence, gesture presence, and gestural prominence. A total of 116 Catalan-speaking three-, four- and five-year-olds participated in a semi-controlled interactive task eliciting words in three focus conditions: information, contrastive, and corrective. The data were coded manually using holistic assessments for all three measures. The results indicated, first, that children’s prosodic and gestural behavior was key in marking corrective focus. A significant tendency to use more gestures and increase both prosodic and gestural prominence was found in the corrective focus condition across the three age groups. Second, a developmental difference emerged in the acquisition of contrastive focus. Three-year-olds relied solely on gesture presence to encode contrastive focus, being unable to differentiate it prosodically from information focus. In turn, four- and five-year-olds used both gestures and prosody, with contrastive focus not only receiving more gestures than information focus but also increased prosodic prominence. This finding shows that gesture presence is a precursor to prosodic prominence in marking contrastive focus in Catalan, thus supporting the idea that gesture production can bootstrap the expression of focus type distinctions., This research was funded by grant PID2020-115385GA-I00, financed by MCIN/AEI/10.13039/501100011033 and by the European Regional Development Fund (ERDF), by the European Union. It was also supported by the grant AGAUR-FI Joan Oró 2025FI_B 00342, funded by the Agency for Management of University and Research Grants (Generalitat de Catalunya) together with the European Social Fund (ESF), by the European Union. The APC was funded by grants PID2021-123823NB-I00 and PID2020-115385GA-I00, financed by MCIN/AEI/10.13039/501100011033 and by the European Regional Development Fund (ERDF), by the European Union.
Repositorio Digital de la UPF
Publicación Artículo científico (JournalArticle)

Multidimensional labeling of gesture in communication: the M3D proposal

  • Rohrer, Patrick Louis
  • Tütüncübasi, Ulya
  • Florit-Pons, Júlia
  • Vilà-Giménez, Ingrid
  • Esteve-Gibert, Núria
  • Ren-Mitchell, Ada
  • Shattuck-Hufnagel, Stefanie
  • Prieto Vives, Pilar, 1965-
Communication is multimodal in that speakers use not only their voices, but also co-speech gestures to communicate. Recent insights suggest that gestural behavior has a strong association with prosodic structure and that a single gesture can communicate various semantic and pragmatic meanings. This highlights the importance of developing a comprehensive, flexible, and transparent approach to gesture annotation that accounts for multiple dimensions of gesture, including a gesture's form, prosodic properties, and semantic and pragmatic contributions. To address this need for an increasingly dimensionalized approach to multimodal data annotation, the main goal of this paper is to present and describe a novel labeling system for manual gestures. The MultiModal MultiDimensional (M3D) system consists of an open access package that has been developed in coordination with five different labs working on gesture and its interaction with speech. The package includes a set of reliable annotation guidelines, a validated training program, and two annotated audiovisual corpora that represent over 60 minutes of lecture-style speech., This work was partially funded by the Spanish Ministry of Science, Innovation and Universities (Grants numbers PID2021-123823NB-I00, PID2020-115385GA-I00, PGC2018-097007-B-I00), the Pla de Recerca de Catalunya from the Generalitat de Catalunya (Grant numbers 2017 SGR_971 and 2021 SGR 00922) and the GEHM (Gesture and Head Movements in Language) Research Network, funded by the Independent Research Fund Denmark (grant number 9055-00004B).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Multidimensional labeling of gesture in communication: the M3D proposal

  • Rohrer, Patrick Louis
  • Tütüncübasi, Ulya
  • Florit-Pons, Júlia
  • Vilà-Giménez, Ingrid
  • Esteve-Gibert, Núria
  • Ren-Mitchell, Ada
  • Shattuck-Hufnagel, Stefanie
  • Prieto Vives, Pilar, 1965-
Communication is multimodal in that speakers use not only their voices, but also co-speech gestures to communicate. Recent insights suggest that gestural behavior has a strong association with prosodic structure and that a single gesture can communicate various semantic and pragmatic meanings. This highlights the importance of developing a comprehensive, flexible, and transparent approach to gesture annotation that accounts for multiple dimensions of gesture, including a gesture's form, prosodic properties, and semantic and pragmatic contributions. To address this need for an increasingly dimensionalized approach to multimodal data annotation, the main goal of this paper is to present and describe a novel labeling system for manual gestures. The MultiModal MultiDimensional (M3D) system consists of an open access package that has been developed in coordination with five different labs working on gesture and its interaction with speech. The package includes a set of reliable annotation guidelines, a validated training program, and two annotated audiovisual corpora that represent over 60 minutes of lecture-style speech., This work was partially funded by the Spanish Ministry of Science, Innovation and Universities (Grants numbers PID2021-123823NB-I00, PID2020-115385GA-I00, PGC2018-097007-B-I00), the Pla de Recerca de Catalunya from the Generalitat de Catalunya (Grant numbers 2017 SGR_971 and 2021 SGR 00922) and the GEHM (Gesture and Head Movements in Language) Research Network, funded by the Independent Research Fund Denmark (grant number 9055-00004B).
Recercat. Dipósit de la Recerca de Catalunya
Publicación Artículo científico (JournalArticle)

Preschoolers mark focus types through multimodal prominence: further evidence for the precursor role of gestures

  • Coego, Sara
  • Esteve Gibert, Núria
  • Prieto Vives, Pilar, 1965-
The present cross-sectional study assessed the role of multimodal cues in marking focus types during early childhood, focusing on prosodic prominence, gesture presence, and gestural prominence. A total of 116 Catalan-speaking three-, four- and five-year-olds participated in a semi-controlled interactive task eliciting words in three focus conditions: information, contrastive, and corrective. The data were coded manually using holistic assessments for all three measures. The results indicated, first, that children’s prosodic and gestural behavior was key in marking corrective focus. A significant tendency to use more gestures and increase both prosodic and gestural prominence was found in the corrective focus condition across the three age groups. Second, a developmental difference emerged in the acquisition of contrastive focus. Three-year-olds relied solely on gesture presence to encode contrastive focus, being unable to differentiate it prosodically from information focus. In turn, four- and five-year-olds used both gestures and prosody, with contrastive focus not only receiving more gestures than information focus but also increased prosodic prominence. This finding shows that gesture presence is a precursor to prosodic prominence in marking contrastive focus in Catalan, thus supporting the idea that gesture production can bootstrap the expression of focus type distinctions., This research was funded by grant PID2020-115385GA-I00, financed by MCIN/AEI/10.13039/501100011033 and by the European Regional Development Fund (ERDF), by the European Union. It was also supported by the grant AGAUR-FI Joan Oró 2025FI_B 00342, funded by the Agency for Management of University and Research Grants (Generalitat de Catalunya) together with the European Social Fund (ESF), by the European Union. The APC was funded by grants PID2021-123823NB-I00 and PID2020-115385GA-I00, financed by MCIN/AEI/10.13039/501100011033 and by the European Regional Development Fund (ERDF), by the European Union.