Skip to main content

GESTOS, PROSODIA Y ESTRUCTURA LINGUISTICA

FFI2012-31995

•
Funding agency name Ministerio de Economía y Competitividad
Funding agency acronym MINECO
Program Programa Nacional de Proyectos de Investigación Fundamental
Subprogram Subprograma de Proyectos de Investigación Fundamental no Orientada
Call Proyectos I+D
Call year 2012
State Plan 2008-2011 Plan Nacional de Investigación Científica, Desarrollo e Innovación Tecnológica
Management unit Secretaría de Estado de Investigación, Desarrollo e Innovación
Beneficiary centre UNIVERSITAT POMPEU FABRA CCT

Resultados relacionados

Resultados totales (Incluyendo duplicados): 12
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

Are gesture and prosodic prominences always coordinated?: evidence from perception and production

  • Esteve Gibert, Núria
  • Pons Gimeno, Ferran
  • Bosch, Laura
  • Prieto Vives, Pilar, 1965-
Comunicació presentada a: Speech Prosody 2014, celebrada del 20 al 23 de maig de 2014 a Dublin, Irlanda., This study explores the temporal coordination between gesture and speech by addressing two main questions: (1) Are speakers sensitive to the misalignment between gesture prominence and prosodic prominence? (2) Is this sensitivity modulated by the semantic information conveyed by gesture and speech modalities in production? Experiment 1 tested question (1) and Experiment 2 tested question (2). Results from Experiment 1 revealed that the combinations in which prominences were misaligned were less acceptable than combinations with aligned prominences, and that the metrical pattern of the target word had an effect on the speakers’ sensitivity: unsynchronized trochees (with the gesture prominence at the post-tonic syllable) were frequently accepted, while unsynchronized iambs (with the gesture prominence at the pre-tonic syllable) were rejected. Results from Experiment 2 revealed that when the pointing gesture adds information to speech, i.e. it is supplementary to speech, the prominences are frequently misaligned (with gesture occurring after the speech), as if two different speech acts were produced. These findings suggest that the semantic content of gesture-speech combinations might influence the speakers’ sensitivity of the misalignment between prosodic and gesture prominences., This research has been funded by grants FFI2012-31995, PSI-2011-25376, 2009SGR-701, and by the RECERCAIXA 2012 grant “Els precursors del llenguatge: una guia TIC per a pares i educadors”.
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

The Acquisition of multimodal cues to disbelief

  • Armstrong, Meghan Elizabeth
  • Esteve Gibert, Núria
  • Prieto Vives, Pilar, 1965-
Comunicació presentada a: Speech Prosody 2014, celebrada del 20 al 23 de maig de 2014 a Dublin, Irlanda., In this study, we examine how 3-, 4-, and 5-year-old Catalanacquiring children are able to make use of audio (intonational) and visual (facial gesture) modalities in the comprehension of speaker disbelief, as well as the role of the child’s developing Theory of Mind. Our results suggest that in this case, facial gesture provides children with scaffolding for linguistic meaning, and that explicit belief-reasoning also helps children to infer speaker disbelief. We discuss the implications of these findings for the study of intonational development., The research was funded by a Spanish Ministry of Science and Innovation grant (FFI2012-31995 “Gestures, prosody and linguistic structure”), by a Generalitat de Catalunya grant (2009SGR-701) to the Grup d’Estudis de Prosòdia, and by the the grant RECERCAIXA 2012 for the project “Els precursors del llenguatge.
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

A fine-grained analysis of the acoustic cues involved in verbal irony recognition in French

  • González Fuente, Santiago
  • Prieto Vives, Pilar, 1965-
  • Noveck, Ira A.
Comunicació presentada a: Speech Prosody 2016, celebrada del 31 de maig al 3 de juny de 2016 a Boston, Estats Units., Research on verbal irony has found that prosodic features such as pitch range expansion, syllable lengthening, and specific intonational contours are common prosodic resources that languages use to mark irony in speech. Yet little is known about the relative weight of these prosodic features in the detection of irony in languages that use these three prosodic correlates. In this paper we present the results of two experiments designed to shed light on the relative contribution of the acoustic cues involved in verbal irony detection. The first experiment –a production task- was designed to confirm that these three prosodic features are typical of irony in French. Indeed, we found that these three features revealed themselves when readers produced a just read ironic utterance as opposed to a literal one. The second experiment presented the same stories as Experiment 1’s, but removed a single word from the context that would otherwise determine whether an acoustically presented utterance (which had been based on a literal reading) was ironic or not. The last word in these utterances was manipulated synthetically so as to create five experimental conditions: Not Modified, Modified Pitch Range, Modified Duration, Modified Intonation, and Modified All. Results showed (a) that speakers tended to interpret utterances as ironic when all acoustic modifications (i.e. pitch range expansion, syllable lengthening and marked intonation) were presented together (i.e. Modified_All); and (b) that the Modified_Duration and Modified_Intonation conditions were significantly more likely to encourage ironic readings than the Not_Modified and Modified_Pitch_Range conditions., This research was funded by research grants FFI2012-31995, 2014 SGR 925, and FPU2012/05893.
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

Young children's sensitivity to polite stance expressed through audiovisual prosody in requests

  • Hübscher, Iris
  • Prieto Vives, Pilar, 1965-
  • Wagner, Laura
Comunicació presentada a: Speech Prosody 2016, celebrada del 31 de maig al 3 de juny de 2016 a Boston, Estats Units., While children’s acquisition of lexically encoded politeness formulas has been investigated to a certain extent, little is known about their sensitivity to prosody and facial expressions as cues to politeness. The goal of this paper is to test the ability of 3-year-old American English-speaking children to recognize a speaker’s polite stance in their native language based on prosodic and facial gestural politeness cues. A total of 36 3-year-olds were presented with recordings of an adult performing child-directed polite and non-polite requests, where the videos consisted of either audio-only (AO), visualonly (VO) or audio-visual (AV) modalities. Polite and nonpolite requests differed only in terms of prosody and facial expressions, though all spoken requests followed the same structure and included the word please. Each request asked the child to place a specified object in the bucket in front of the twin that had asked more nicely. Analysis of the results suggests that at age three children are clearly able to access a speaker’s polite stance through both prosody and facial gesture cues., This research has been funded by a research grant awarded by the Spanish Ministry of Science and Innovation (FFI2012-31995 “Gestures, prosody and linguistic structure”), and by a grant awarded by the Generalitat de Catalunya (2014 SGR-925) to the Prosodic Studies Group.
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

The Encoding of epistemic operations in two Romance languages: intonation and pragmatic markers

  • Prieto Vives, Pilar, 1965-
  • Roseano, Paolo
Comunicació presentada a: Speech Prosody 2016, celebrada del 31 de maig al 3 de juny de 2016 a Boston, Estats Units., For years linguists have noted that intonation patterns encode similar meanings as sentence-final discourse particles across languages. A question that arises is what is the division of labor between the two and whether we find a compensatory distribution between the two kinds of systems. In this article, we focus on two languages within the Romance group (Catalan and Friulian) which have been reported to use intonation and discourse particles to different extents to mark epistemic meanings. Thirty speakers were asked to participate in a Discourse Completion Task designed to elicit statements with several degrees of speaker commitment. The results show that Catalan and Friulian display an asymmetry in the marking of epistemically-biased statements: while Catalan uses a greater variety of stance-marking intonation contours, Friulian uses a more varied set of stance modal particles and a more restricted set of intonation contours. However, both languages make use epistemic adverbs together with intonation and place restrictions on how pragmatic particles and intonation are paired, indicating that the relationship between the two systems can be quite complex. Overall, we claim that dynamic semantic models enable us to integrate the study of intonational meaning with other parts of the grammar into a unified approach., This research has been funded by a research grant awarded by the Spanish Ministry of Science and Innovation (FFI2012-31995 “Gestures, prosody, and linguistic structure”), and by a grant awarded by the Generalitat de Catalunya (2014 SGR-925) to the Prosodic Studies Group.
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

The Effects of pitch accentuation and beat gestures on information recall in contrastive discourse

  • Kushch, Olga
  • Prieto Vives, Pilar, 1965-
Comunicació presentada a: Speech Prosody 2016, celebrada del 31 de maig al 3 de juny de 2016 a Boston, Estats Units., Research in audiovisual prosody has shown that typically beat gestures are temporally integrated with prominent positions in speech (e.g., [1, 2]). There is independent evidence that both prosodic prominence (e.g., pitch accents) and gestural prominence associated with words (e.g., beat gestures) facilitate the recall of information (e.g., [3, 4, 5]). However, previous studies did not directly compare the beneficial effects of pitch accentuation without beats with pitch accentuation with beats. This study investigates the role of prosodic prominence (pitch accents) and gesture prominence (beat gestures) on the recall of contrastive information in natural discourse. Twenty Catalan-dominant native speakers were asked to watch 48 short videotaped discourses each containing two contrast sets with two items (e.g., The fish shop and the grocery shop). The critical word in the sequence was presented under two experimental conditions: 1) accompanied by prosodic prominence (L+H* pitch accent); and 2) accompanied by prosodic prominence and gestural prominence (L+H* pitch accent + beat). The results of the recall task revealed that the presence of beat gestures associated with prosodic prominence favored word recall of contrastive information in discourse in comparison with the condition without beat gestures., This research would not have been possible without funding from the Spanish Ministry of Science and Innovation grant FFI2012- 31995 (“Gestures, prosody and linguistic structure”), and a grant awarded by the Generalitat de Catalunya (2014SGR-925) to the Prosodic Studies Group. The first author also acknowledges a grant awarded by the Generalitat de Catalunya AGAUR (2015 FI_B 00094).
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Are gesture and prosodic prominences always coordinated?: evidence from perception and production

  • Esteve Gibert, Núria
  • Pons Gimeno, Ferran
  • Bosch, Laura
  • Prieto Vives, Pilar, 1965-
Comunicació presentada a: Speech Prosody 2014, celebrada del 20 al 23 de maig de 2014 a Dublin, Irlanda., This study explores the temporal coordination between gesture and speech by addressing two main questions: (1) Are speakers sensitive to the misalignment between gesture prominence and prosodic prominence? (2) Is this sensitivity modulated by the semantic information conveyed by gesture and speech modalities in production? Experiment 1 tested question (1) and Experiment 2 tested question (2). Results from Experiment 1 revealed that the combinations in which prominences were misaligned were less acceptable than combinations with aligned prominences, and that the metrical pattern of the target word had an effect on the speakers’ sensitivity: unsynchronized trochees (with the gesture prominence at the post-tonic syllable) were frequently accepted, while unsynchronized iambs (with the gesture prominence at the pre-tonic syllable) were rejected. Results from Experiment 2 revealed that when the pointing gesture adds information to speech, i.e. it is supplementary to speech, the prominences are frequently misaligned (with gesture occurring after the speech), as if two different speech acts were produced. These findings suggest that the semantic content of gesture-speech combinations might influence the speakers’ sensitivity of the misalignment between prosodic and gesture prominences., This research has been funded by grants FFI2012-31995, PSI-2011-25376, 2009SGR-701, and by the RECERCAIXA 2012 grant “Els precursors del llenguatge: una guia TIC per a pares i educadors”.
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

The Effects of pitch accentuation and beat gestures on information recall in contrastive discourse

  • Kushch, Olga
  • Prieto Vives, Pilar, 1965-
Comunicació presentada a: Speech Prosody 2016, celebrada del 31 de maig al 3 de juny de 2016 a Boston, Estats Units., Research in audiovisual prosody has shown that typically beat gestures are temporally integrated with prominent positions in speech (e.g., [1, 2]). There is independent evidence that both prosodic prominence (e.g., pitch accents) and gestural prominence associated with words (e.g., beat gestures) facilitate the recall of information (e.g., [3, 4, 5]). However, previous studies did not directly compare the beneficial effects of pitch accentuation without beats with pitch accentuation with beats. This study investigates the role of prosodic prominence (pitch accents) and gesture prominence (beat gestures) on the recall of contrastive information in natural discourse. Twenty Catalan-dominant native speakers were asked to watch 48 short videotaped discourses each containing two contrast sets with two items (e.g., The fish shop and the grocery shop). The critical word in the sequence was presented under two experimental conditions: 1) accompanied by prosodic prominence (L+H* pitch accent); and 2) accompanied by prosodic prominence and gestural prominence (L+H* pitch accent + beat). The results of the recall task revealed that the presence of beat gestures associated with prosodic prominence favored word recall of contrastive information in discourse in comparison with the condition without beat gestures., This research would not have been possible without funding from the Spanish Ministry of Science and Innovation grant FFI2012- 31995 (“Gestures, prosody and linguistic structure”), and a grant awarded by the Generalitat de Catalunya (2014SGR-925) to the Prosodic Studies Group. The first author also acknowledges a grant awarded by the Generalitat de Catalunya AGAUR (2015 FI_B 00094).
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

The Encoding of epistemic operations in two Romance languages: intonation and pragmatic markers

  • Prieto Vives, Pilar, 1965-
  • Roseano, Paolo
Comunicació presentada a: Speech Prosody 2016, celebrada del 31 de maig al 3 de juny de 2016 a Boston, Estats Units., For years linguists have noted that intonation patterns encode similar meanings as sentence-final discourse particles across languages. A question that arises is what is the division of labor between the two and whether we find a compensatory distribution between the two kinds of systems. In this article, we focus on two languages within the Romance group (Catalan and Friulian) which have been reported to use intonation and discourse particles to different extents to mark epistemic meanings. Thirty speakers were asked to participate in a Discourse Completion Task designed to elicit statements with several degrees of speaker commitment. The results show that Catalan and Friulian display an asymmetry in the marking of epistemically-biased statements: while Catalan uses a greater variety of stance-marking intonation contours, Friulian uses a more varied set of stance modal particles and a more restricted set of intonation contours. However, both languages make use epistemic adverbs together with intonation and place restrictions on how pragmatic particles and intonation are paired, indicating that the relationship between the two systems can be quite complex. Overall, we claim that dynamic semantic models enable us to integrate the study of intonational meaning with other parts of the grammar into a unified approach., This research has been funded by a research grant awarded by the Spanish Ministry of Science and Innovation (FFI2012-31995 “Gestures, prosody, and linguistic structure”), and by a grant awarded by the Generalitat de Catalunya (2014 SGR-925) to the Prosodic Studies Group.
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Young children's sensitivity to polite stance expressed through audiovisual prosody in requests

  • Hübscher, Iris
  • Prieto Vives, Pilar, 1965-
  • Wagner, Laura
Comunicació presentada a: Speech Prosody 2016, celebrada del 31 de maig al 3 de juny de 2016 a Boston, Estats Units., While children’s acquisition of lexically encoded politeness formulas has been investigated to a certain extent, little is known about their sensitivity to prosody and facial expressions as cues to politeness. The goal of this paper is to test the ability of 3-year-old American English-speaking children to recognize a speaker’s polite stance in their native language based on prosodic and facial gestural politeness cues. A total of 36 3-year-olds were presented with recordings of an adult performing child-directed polite and non-polite requests, where the videos consisted of either audio-only (AO), visualonly (VO) or audio-visual (AV) modalities. Polite and nonpolite requests differed only in terms of prosody and facial expressions, though all spoken requests followed the same structure and included the word please. Each request asked the child to place a specified object in the bucket in front of the twin that had asked more nicely. Analysis of the results suggests that at age three children are clearly able to access a speaker’s polite stance through both prosody and facial gesture cues., This research has been funded by a research grant awarded by the Spanish Ministry of Science and Innovation (FFI2012-31995 “Gestures, prosody and linguistic structure”), and by a grant awarded by the Generalitat de Catalunya (2014 SGR-925) to the Prosodic Studies Group.
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

A fine-grained analysis of the acoustic cues involved in verbal irony recognition in French

  • González Fuente, Santiago
  • Prieto Vives, Pilar, 1965-
  • Noveck, Ira A.
Comunicació presentada a: Speech Prosody 2016, celebrada del 31 de maig al 3 de juny de 2016 a Boston, Estats Units., Research on verbal irony has found that prosodic features such as pitch range expansion, syllable lengthening, and specific intonational contours are common prosodic resources that languages use to mark irony in speech. Yet little is known about the relative weight of these prosodic features in the detection of irony in languages that use these three prosodic correlates. In this paper we present the results of two experiments designed to shed light on the relative contribution of the acoustic cues involved in verbal irony detection. The first experiment –a production task- was designed to confirm that these three prosodic features are typical of irony in French. Indeed, we found that these three features revealed themselves when readers produced a just read ironic utterance as opposed to a literal one. The second experiment presented the same stories as Experiment 1’s, but removed a single word from the context that would otherwise determine whether an acoustically presented utterance (which had been based on a literal reading) was ironic or not. The last word in these utterances was manipulated synthetically so as to create five experimental conditions: Not Modified, Modified Pitch Range, Modified Duration, Modified Intonation, and Modified All. Results showed (a) that speakers tended to interpret utterances as ironic when all acoustic modifications (i.e. pitch range expansion, syllable lengthening and marked intonation) were presented together (i.e. Modified_All); and (b) that the Modified_Duration and Modified_Intonation conditions were significantly more likely to encourage ironic readings than the Not_Modified and Modified_Pitch_Range conditions., This research was funded by research grants FFI2012-31995, 2014 SGR 925, and FPU2012/05893.
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

The Acquisition of multimodal cues to disbelief

  • Armstrong, Meghan Elizabeth
  • Esteve Gibert, Núria
  • Prieto Vives, Pilar, 1965-
Comunicació presentada a: Speech Prosody 2014, celebrada del 20 al 23 de maig de 2014 a Dublin, Irlanda., In this study, we examine how 3-, 4-, and 5-year-old Catalanacquiring children are able to make use of audio (intonational) and visual (facial gesture) modalities in the comprehension of speaker disbelief, as well as the role of the child’s developing Theory of Mind. Our results suggest that in this case, facial gesture provides children with scaffolding for linguistic meaning, and that explicit belief-reasoning also helps children to infer speaker disbelief. We discuss the implications of these findings for the study of intonational development., The research was funded by a Spanish Ministry of Science and Innovation grant (FFI2012-31995 “Gestures, prosody and linguistic structure”), by a Generalitat de Catalunya grant (2009SGR-701) to the Grup d’Estudis de Prosòdia, and by the the grant RECERCAIXA 2012 for the project “Els precursors del llenguatge.