Skip to main content

SEMANTICA, PROSODIA Y GESTUALIDAD EN EL LENGUAJE

FFI2015-66533-P

•
Funding agency name Ministerio de Economía y Competitividad
Funding agency acronym MINECO
Program Programa Estatal de Fomento de la Investigación Científica y Técnica de Excelencia
Subprogram Subprograma Estatal de Generación de Conocimiento
Call Proyectos de I+D (Excelencia / Generación de Conocimiento)
Call year 2015
State Plan 2013-2016 Plan Estatal de Investigación Científica y Técnica y de Innovación
Management unit Secretaría de Estado de Educación, Formación Profesional y Universidades
Beneficiary centre UNIVERSITAT POMPEU FABRA CCT

Resultados relacionados

Resultados totales (Incluyendo duplicados): 27
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Effects of encouraging the use of gestures on speech

  • Cravotta, Alice
  • Busà, Maria Grazia
  • Prieto Vives, Pilar, 1965-
Purpose: Previous studies have investigated the effects of the inability to produce hand gestures on speakers' prosodic features of speech; however, the potential effects of encouraging speakers to gesture have received less attention, especially in naturalistic settings. This study aims at investigating the effects of encouraging the production of hand gestures on the following speech correlates: speech discourse length (number of words and discourse length in seconds), disfluencies (filled pauses, self-corrections, repetitions, insertions, interruptions, speech rate), and prosodic properties (measures of fundamental frequency [F0] and intensity). Method: Twenty native Italian speakers took part in a narration task in which they had to describe the content of short comic strips to a confederate listener in 1 of the following 2 conditions: (a) nonencouraging condition (N), that is, no instructions about gesturing were given, and (b) encouraging condition (E), that is, the participants were instructed to gesture while telling the story. Results: Instructing speakers to gesture led effectively to higher gesture rate and salience. Significant differences were found for (a) discourse length (e.g., the narratives had more words in E than in N) and (b) acoustic measures (F0 maximum, maximum intensity, and mean intensity metrics were higher in E than in N). Conclusion: The study shows that asking speakers to use their hands while describing a story can have an effect on narration length and can also impact on F0 and intensity metrics. By showing that enhancing the gesture stream could affect speech prosody, this study provides further evidence that gestures and prosody interact in the process of speech production., This collaborative research was the result of an Erasmus Plus InterInstitutional Mobility Agreement between the University of Padova and the Pompeu Fabra University. The first author is supported by a grant from the University of Padova’s Doctoral School of Linguistic, Philological and Literary Sciences; the third author also acknowledges Grant FFI2015-66533-P from the Spanish Ministry of Science and Innovation and Grant 2014SGR-925 from Generalitat de Catalunya to the Prosodic Studies Group.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Observing and producing durational hand gestures facilitates the pronunciation of novel vowel-length contrasts

  • Li, Peng
  • Baills, Florence
  • Prieto Vives, Pilar, 1965-
While empirical studies have shown the beneficial role of observing and producing hand gestures mimicking pitch features in the learning of L2 tonal or intonational contrasts, mixed results have been obtained for the use of gestures encoding durational contrasts at the perceptual level. This study investigates the potential benefits of horizontal hand-sweep gestures encoding durational features for boosting the perception and production of nonnative vowel-length contrasts. In a between-subjects experiment with a pretest–posttest design, 50 Catalan participants without any knowledge of Japanese practiced perceiving and producing minimal pairs of Japanese disyllabic words featuring vowel-length contrasts in one of two conditions, namely with gestures or without them. Pretest and posttest consisted of the completion of identical vowel-length identification and imitation tasks. The results showed that while participants improved equally at posttest across the two conditions in the identification task, the Gesture group obtained a larger improvement than the No Gesture group in the imitation task. These results corroborate the claim that producing hand gestures encoding prosodic properties of speech may help naïve learners to learn novel phonological contrasts in a foreign language., This research was supported by funding from the Spanish Ministry of Economy and Competitiveness (FFI2015-66533-P) and the Generalitat de Catalunya projects (2014 SGR925 and 2017 SGR-971). The second author has a predoctoral research grant awarded by the Department of Translation and Language Sciences, Universitat Pompeu Fabra.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Hand-clapping to the rhythm of newly learned words improves L2 pronunciation: evidence from training Chinese adolescents with French words

  • Zhang, Yuan
  • Baills, Florence
  • Prieto Vives, Pilar, 1965-
Though research has shown that rhythmic training is beneficial for phonological speech processing, little empirical work has been carried out to assess whether rhythmic training in the classroom can help to improve pronunciation in a second language. This study tests the potential benefits of hand-clapping to the rhythm of newly learned French words for the acquisition of pronunciation patterns by Chinese adolescents. In a between-subjects training experiment with a pretest/posttest design, 50 Chinese adolescents either repeated new French words while clapping out their rhythmic structure (clapping condition) or only repeated the words (non-clapping condition). Participants’ oral production before and after training was (1) perceptually rated for accentedness by two French native speakers and (2) acoustically analysed for final syllable duration. While the results showed an only near-significant improvement from pretest to posttest in accentedness ratings for the clapping group, a significant improvement was obtained for acoustic durational measures. Individual musical abilities did not interact significantly in either of the two analyses, and working memory interacted significantly only with accentedness. These results show that a short training session in which clapping is used to highlight the prosodic structure of words can help improve pronunciation in a foreign language., This research was supported by funding from the Spanish Ministry of Economy and Competitiveness (FFI2015-66533-P) and the Generalitat de Catalunya projects 2014 SGR-925 and 2017 SGR _ 971).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Observing pitch gestures favors the learning of Spanish intonation by Mandarin speakers

  • Yuan, Chenjie
  • González Fuente, Santiago
  • Baills, Florence
  • Prieto Vives, Pilar, 1965-
Recent studies on the learning of L2 prosody have suggested that pitch gestures can enhance the learning of the L2 lexical tones. Yet it remains unclear whether the use of these gestures can aid the learning of L2 intonation, especially by tonal-language speakers. Sixty-four Mandarin speakers with basic-level Spanish were asked to learn three Spanish intonation patterns, all involving a low tone on the nuclear accent. In a pre-post test experimental design, half of the participants received intonation training without the use of pitch gestures (the control group) while the other half received the same training but with pitch gestures representing nuclear intonation contours (the experimental group). Musical (melody, pitch) abilities were also measured. The results revealed that (a) the experimental group significantly improved intonational production outcomes, and (b) even though participants with stronger musical abilities performed better, those with weaker musical abilities benefited more from observing pitch gestures., This research has been funded by two research grants awarded by the Ministry of Science and Innovation (FFI2015-66533-P) and the Generalitat de Catalunya (2014 SGR-925), both to the Prosodic Studies Group. The second author also acknowledges a FPU 2012-05893 grant awarded by the Spanish Ministry of Science and Innovation.
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

Encouraging children to produce rhythmic beat gestures leads to better narrative discourse performances

  • Prieto Vives, Pilar, 1965-
  • Vilà-Giménez, Ingrid
Recent research has shown that when preschoolers listen to a speaker who is simultaneously making beat gestures, this favors their recall and comprehension of what they have heard and also boosts their narrative performance. However, previous studies have not tested the effect of encouraging children to produce beat gestures while retelling narratives— as opposed to merely observing them—on their narrative performances. In this study, a total of 47 five- and six-year-old children participated in a between-subjects brief training study experiment with a pretest and an immediate posttest design. Children were exposed to a training phase with a total of six one-minute stories, presented under two experimental conditions: 1) beat non-encouraging condition, and 2) beat encouraging condition. Video recordings of the pretest and posttest narratives were then scored for narrative structure and fluency. A comparison of scores showed that children in the group that had been encouraged to use beat gestures performed better than the group of children who were simply asked to retell the story without gesture instruction. All in all, this evidence suggests that encouraging the use of beat gestures by children helps to boost their subsequent narrative performance., This study was approved by the ethics committee of the Universitat Pompeu Fabra, and benefited from funding awarded by the Spanish Ministry of Economy and Competitiveness (FFI2015-66533-P) and by the Generalitat de Catalunya (2014 SGR_925) to the Prosodic Studies Group. The first author also acknowledges an FI grant from the Generalitat de Catalunya (ref. 2017FI_B_00297).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Gestural and prosodic development act as sister systems and jointly pave the way for children’s sociopragmatic development

  • Hübscher, Iris
  • Prieto Vives, Pilar, 1965-
Children might combine gesture and prosody to express a pragmatic meaning such as a request, information focus, uncertainty or politeness, before they can convey these meanings in speech. However, little is known about the developmental trajectories of gestural and prosodic patterns and how they relate to a child’s growing understanding and propositional use of these sociopragmatic meanings. Do gesture and prosody act as sister systems in pragmatic development? Do children acquire these components of language before they are able to express themselves through spoken language, thus acting as forerunners in children’s pragmatic development? This review article assesses empirical evidence that demonstrates that gesture and prosody act as intimately related systems and, importantly, pave the way for pragmatic acquisition at different developmental stages. The review goes on to explore how the integration of gesture and prosody with semantics and syntax can impact language acquisition and how multimodal interventions can be used effectively in educational settings. Our review findings support the importance of simultaneously assessing both the prosodic and the gestural components of language in the fields of language development, language learning, and language intervention., This article is partly based on, and was inspired by, the results of research funded by the Spanish Ministry of Science and Innovation (Grant No. FFI2015-66533-P “Intonational and gestural meaning in language” and Grant No. PGC2018-097007-B-I00 “Multimodal Language Learning”) and a grant awarded by the Generalitat de Catalunya (Grant No. 2017SGR-925) to the Prosodic Studies Group.
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

Hand-clapping to the rhythm of newly learned words improves L2 pronunciation: evidence from Catalan and Chinese learners of French

  • Prieto Vives, Pilar, 1965-
  • Baills, Florence
  • Zhang, Yuan
Previous research has shown that rhythmic training enhances phonological speech processing (e.g., [1, 2, 3, 4]). Yet little is known about whether rhythmic training can also help to improve pronunciation in a second language (but see [5, 6, 7]). This study tests the potential benefits of hand-clapping to the rhythm of newly learned French words for the acquisition of pronunciation patterns by Catalan children and Chinese adolescents. In two between-subjects experiments with a pretest and posttest design, participants either repeated words while clapping the rhythmic structure of words or only repeated the words. The French target words were very similar to their lexical counterparts in Catalan, whereas they differed completely from Chinese. Participants’ oral production before and after training was rated for accentedness by three French native speakers. Results showed a significant improvement for the clapping group among the Catalan participants, whereas only a near significant tendency appeared for the Chinese adolescents. Individual musical abilities did not interact significantly with the results in either experiments but working memory played a significant role in Chinese participants’ pronunciation. The results show that a short phonological training session based on highlighting the rhythmic structure of words seems to help improve pronunciation in a foreign language as long as there is little demand placed on semantic processing., This research was supported by funding from the Spanish Ministry of Economy and Competitiveness (FFI2015-66533-P) and the Generalitat de Catalunya (2014 SGR-925). The first author acknowledges a grant awarded by the Dept. of Translation and Language Sciences at UPF.
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

Restraining and encouraging the use of hand gestures: effects on speech

  • Prieto Vives, Pilar, 1965-
  • Cravotta, Alice
  • Busà, Maria Grazia
Previous studies have investigated the effects of the inability to make hand gestures on speakers’ fluency; however, the question of whether encouraging speakers to gesture affects their fluency has received little attention. This study investigates the effect of restraining (Experiment 1) and encouraging (Experiment 2) hand gestures on the following correlates of speech: speech discourse length (number of words and discourse length in seconds), disfluencies (filled pauses, self-corrections, repetitions, insertions, interruptions, silent pauses), and acoustic properties (speech rate, measures of intensity and pitch). In two experiments, 10 native speakers of Italian took part in a narration task where they were asked to describe comic strips. Each experiment compared two conditions. In Experiment 1, subjects first received no instructions as to how to behave when narrating. Then they were told to sit on their hands while speaking. In Experiment 2, subjects first received no instructions and were then actively encouraged to use hand gestures. The results showed that restraining gestures leads to quieter and slower paced speech, while encouraging gestures triggers longer speech discourse, faster speech rate and more fluent and louder speech. Thus, both restraining and encouraging hand gestures seem to clearly affect prosodic properties of speech, particularly speech fluency., Authors acknowledge funding from the University of Padua’s Doctoral School of Linguistic, Philological and Literary Sciences, the Spanish Ministry of Science and Innovation (grant FFI2015-66533-P), and a grant awarded by the Generalitat de Catalunya (2014SGR-925) to the Prosodic Studies Group.
Repositorio Digital de la UPF
Publication Contribución de congreso (ConferenceOutput)

Preschoolers use prosodic mitigation strategies to encode polite stance

  • Prieto Vives, Pilar, 1965-
  • Hübscher, Iris
  • Garufi, Martina
While prosody has been shown to act as a syntactic bootstrapper in early language acquisition, little is known about the role that prosody plays in the later development of a child’s ability to communicate pragmatic information such as the expression of politeness. The goal of this paper is to investigate whether preschool children use prosody earlier and more prominently than lexical and morphosyntactic cues to signal a polite stance. To this end, 64 three- to five-year-old Catalan-dominant children participated in a cross-sectional study involving a request production task under four different conditions, with interlocutors either a classmate or an unfamiliar adult (low/high social distance), and the ‘cost’ to the interlocutor’s face either low or high. The results showed that preschool children tend to use mitigating prosodic strategies to encode a polite stance early on and more markedly than they use lexical or morphosyntactic markers. These findings are consistent with what other research has found regarding the prosodic mitigation strategies used by Catalan-speaking adults to mark polite stance., This research was funded by the Spanish Ministry of Science and Innovation (grant FFI2015-66533-P), and a grant awarded by the Generalitat de Catalunya (2014SGR-925) to the Prosodic Studies Group. The first author also acknowledges an FPI grant from the Spanish Ministry of Science and Innovation (BES-2013-065019).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

The Timing of head movements: the role of prosodic heads and edges

  • Esteve-Gibert, Núria
  • Borràs Comes, Joan Manel, 1984-
  • Asor, Eli
  • Swerts, Marc
  • Prieto Vives, Pilar, 1965-
This study examines the influence of the position of prosodic heads (accented syllables) and prosodic edges (prosodic word and intonational phrase boundaries) on the timing of head movements. Gesture movements and prosodic events tend to be temporally aligned in the discourse, the most prominent part of gestures typically being aligned with prosodically prominent syllables in speech. However, little is known about the impact of the position of intonational phrase boundaries on gesture-speech alignment patterns. Twenty-four Catalan speakers produced spontaneous (experiment 1) and semi-spontaneous head gestures with a confirmatory function (experiment 2), along with phrase-final focused words in different prosodic conditions (stress-initial, stress-medial, and stress-final). Results showed (a) that the scope of head movements is the associated focused prosodic word, (b) that the left edge of the focused prosodic word determines where the interval of gesture prominence starts, and (c) that the speech-anchoring site for the gesture peak (or apex) depends both on the location of the accented syllable and the distance to the upcoming intonational phrase boundary. These results demonstrate that prosodic heads and edges have an impact on the timing of head movements, and therefore that prosodic structure plays a central role in the timing of co-speech gestures., This research has been funded by the Spanish MINECO (grant FFI2015-66533-P), and by the Generalitat de Catalunya to the Prosodic Studies Group (2014SGR-925), by the 2010 BE1 00207 travelling grant awarded to the second author of the study, and by the Labex BLRI (ANR-11-LABX-0036) grant awarded to the first author of the study.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Observing storytellers who use rhythmic beat gestures improves children’s narrative discourse performance

  • Prieto Vives, Pilar, 1965-
  • Vilà-Giménez, Ingrid
  • Igualada Pérez, Alfonso
Iconic and pointing gestures are important precursors of children’s early language and cognitive development. While beat gestures seem to have positive effects on the recall of information by preschoolers, little is known about the potential beneficial effects of observing beat gestures on the development of children’s narrative performance. We tested forty-four 5- and 6-year-old children in a between-subject study with a pretest–posttest design. Following a pretest in which they were asked to retell the story of an animated cartoon they had watched, the children were exposed to a training session in which they observed an adult telling a total of six one-minute stories under two between-subject experimental conditions: 1) a no-beat condition, where focal elements in the narratives were not highlighted by means of beat gestures; and 2) a beat condition, in which focal elements were highlighted by beat gestures. Following the training session, a posttest was administered following the same procedure as the pretest. Narrative structure scores were independently coded from recordings of the pretest and posttest and subjected to statistical comparisons. The results revealed that children who were exposed to the beat condition showed a higher gain in narrative structure scores. This study thus shows for the first time that a brief training session with beat gestures has immediate benefits for children’s narrative discourse performance., The study “Observing storytellers who use rhythmic beat gestures improves children’s narrative discourse performance” obtained ethics approval from the ethics committee at the Universitat Pompeu Fabra, as part of the approval of the Spanish Ministry of Economy and Competitiveness project FFI2015-66533-P “Intonational and gestural meaning in language”.
Repositori Obert UdL
Publication Artículo científico (JournalArticle)

Observing and Producing Durational Hand Gestures Facilitates the Pronunciation of Novel Vowel-Length Contrasts

  • Li, Peng
  • Baills, Florence
  • Prieto, Pilar
While empirical studies have shown the beneficial role of observing and producing hand gestures mimicking pitch features in the learning of L2 tonal or intonational contrasts, mixed results have been obtained for the use of gestures encoding durational contrasts at the perceptual level. This study investigates the potential benefits of horizontal hand-sweep gestures encoding durational features for boosting the perception and production of nonnative vowel-length contrasts. In a between-subjects experiment with a pretest–posttest design, 50 Catalan participants without any knowledge of Japanese practiced perceiving and producing minimal pairs of Japanese disyllabic words featuring vowel-length contrasts in one of two conditions, namely with gestures or without them. Pretest and posttest consisted of the completion of identical vowel-length identification and imitation tasks. The results showed that while participants improved equally at posttest across the two conditions in the identification task, the Gesture group obtained a larger improvement than the No Gesture group in the imitation task. These results corroborate the claim that producing hand gestures encoding prosodic properties of speech may help naïve learners to learn novel phonological contrasts in a foreign language., This research was supported by funding from the Spanish Ministry of Economy and Competitiveness (FFI2015-66533-P) and the Generalitat de Catalunya projects (2014 SGR-925 and 2017 SGR-971).
Repositori Obert UdL
Publication Capítulo o parte de un libro (BookPart)

Hand-clapping to the rhythm of newly learned words improves L2 pronunciation: Evidence from Catalan and Chinese learners of French

  • Baills, Florence
  • Zhang, Yuan
  • Prieto, Pilar
Previous research has shown that rhythmic training enhances phonological speech processing (e.g., [1, 2, 3, 4]). Yet little is known about whether rhythmic training can also help to improve pronunciation in a second language (but see [5, 6, 7]). This study tests the potential benefits of hand-clapping to the rhythm of newly learned French words for the acquisition of pronunciation patterns by Catalan children and Chinese adolescents. In two between-subjects experiments with a pretest and posttest design, participants either repeated words while clapping the rhythmic structure of words or only repeated the words. The French target words were very similar to their lexical counterparts in Catalan, whereas they differed completely from Chinese. Participants’ oral production before and after training was rated for accentedness by three French native speakers. Results showed a significant improvement for the clapping group among the Catalan participants, whereas only a near significant tendency appeared for the Chinese adolescents. Individual musical abilities did not interact significantly with the results in either experiment but working memory played a significant role in Chinese participants’ pronunciation. The results show that a short phonological training session based on highlighting the rhythmic structure of words seems to help improve pronunciation in a foreign language as long as there is little demand placed on semantic processing., This research was supported by funding from the Spanish Ministry of Economy and Competitiveness (FFI2015-66533-P) and the Generalitat de Catalunya (2014 SGR-925).
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Hand-clapping to the rhythm of newly learned words improves L2 pronunciation: evidence from Catalan and Chinese learners of French

  • Prieto Vives, Pilar, 1965-
  • Baills, Florence
  • Zhang, Yuan
Previous research has shown that rhythmic training enhances phonological speech processing (e.g., [1, 2, 3, 4]). Yet little is known about whether rhythmic training can also help to improve pronunciation in a second language (but see [5, 6, 7]). This study tests the potential benefits of hand-clapping to the rhythm of newly learned French words for the acquisition of pronunciation patterns by Catalan children and Chinese adolescents. In two between-subjects experiments with a pretest and posttest design, participants either repeated words while clapping the rhythmic structure of words or only repeated the words. The French target words were very similar to their lexical counterparts in Catalan, whereas they differed completely from Chinese. Participants’ oral production before and after training was rated for accentedness by three French native speakers. Results showed a significant improvement for the clapping group among the Catalan participants, whereas only a near significant tendency appeared for the Chinese adolescents. Individual musical abilities did not interact significantly with the results in either experiments but working memory played a significant role in Chinese participants’ pronunciation. The results show that a short phonological training session based on highlighting the rhythmic structure of words seems to help improve pronunciation in a foreign language as long as there is little demand placed on semantic processing., This research was supported by funding from the Spanish Ministry of Economy and Competitiveness (FFI2015-66533-P) and the Generalitat de Catalunya (2014 SGR-925). The first author acknowledges a grant awarded by the Dept. of Translation and Language Sciences at UPF.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Observing storytellers who use rhythmic beat gestures improves children’s narrative discourse performance

  • Prieto Vives, Pilar, 1965-
  • Vilà-Giménez, Ingrid
  • Igualada Pérez, Alfonso
Iconic and pointing gestures are important precursors of children’s early language and cognitive development. While beat gestures seem to have positive effects on the recall of information by preschoolers, little is known about the potential beneficial effects of observing beat gestures on the development of children’s narrative performance. We tested forty-four 5- and 6-year-old children in a between-subject study with a pretest–posttest design. Following a pretest in which they were asked to retell the story of an animated cartoon they had watched, the children were exposed to a training session in which they observed an adult telling a total of six one-minute stories under two between-subject experimental conditions: 1) a no-beat condition, where focal elements in the narratives were not highlighted by means of beat gestures; and 2) a beat condition, in which focal elements were highlighted by beat gestures. Following the training session, a posttest was administered following the same procedure as the pretest. Narrative structure scores were independently coded from recordings of the pretest and posttest and subjected to statistical comparisons. The results revealed that children who were exposed to the beat condition showed a higher gain in narrative structure scores. This study thus shows for the first time that a brief training session with beat gestures has immediate benefits for children’s narrative discourse performance., The study “Observing storytellers who use rhythmic beat gestures improves children’s narrative discourse performance” obtained ethics approval from the ethics committee at the Universitat Pompeu Fabra, as part of the approval of the Spanish Ministry of Economy and Competitiveness project FFI2015-66533-P “Intonational and gestural meaning in language”.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Gestural and prosodic development act as sister systems and jointly pave the way for children’s sociopragmatic development

  • Hübscher, Iris
  • Prieto Vives, Pilar, 1965-
Children might combine gesture and prosody to express a pragmatic meaning such as a request, information focus, uncertainty or politeness, before they can convey these meanings in speech. However, little is known about the developmental trajectories of gestural and prosodic patterns and how they relate to a child’s growing understanding and propositional use of these sociopragmatic meanings. Do gesture and prosody act as sister systems in pragmatic development? Do children acquire these components of language before they are able to express themselves through spoken language, thus acting as forerunners in children’s pragmatic development? This review article assesses empirical evidence that demonstrates that gesture and prosody act as intimately related systems and, importantly, pave the way for pragmatic acquisition at different developmental stages. The review goes on to explore how the integration of gesture and prosody with semantics and syntax can impact language acquisition and how multimodal interventions can be used effectively in educational settings. Our review findings support the importance of simultaneously assessing both the prosodic and the gestural components of language in the fields of language development, language learning, and language intervention., This article is partly based on, and was inspired by, the results of research funded by the Spanish Ministry of Science and Innovation (Grant No. FFI2015-66533-P “Intonational and gestural meaning in language” and Grant No. PGC2018-097007-B-I00 “Multimodal Language Learning”) and a grant awarded by the Generalitat de Catalunya (Grant No. 2017SGR-925) to the Prosodic Studies Group.
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Preschoolers use prosodic mitigation strategies to encode polite stance

  • Prieto Vives, Pilar, 1965-
  • Hübscher, Iris
  • Garufi, Martina
While prosody has been shown to act as a syntactic bootstrapper in early language acquisition, little is known about the role that prosody plays in the later development of a child’s ability to communicate pragmatic information such as the expression of politeness. The goal of this paper is to investigate whether preschool children use prosody earlier and more prominently than lexical and morphosyntactic cues to signal a polite stance. To this end, 64 three- to five-year-old Catalan-dominant children participated in a cross-sectional study involving a request production task under four different conditions, with interlocutors either a classmate or an unfamiliar adult (low/high social distance), and the ‘cost’ to the interlocutor’s face either low or high. The results showed that preschool children tend to use mitigating prosodic strategies to encode a polite stance early on and more markedly than they use lexical or morphosyntactic markers. These findings are consistent with what other research has found regarding the prosodic mitigation strategies used by Catalan-speaking adults to mark polite stance., This research was funded by the Spanish Ministry of Science and Innovation (grant FFI2015-66533-P), and a grant awarded by the Generalitat de Catalunya (2014SGR-925) to the Prosodic Studies Group. The first author also acknowledges an FPI grant from the Spanish Ministry of Science and Innovation (BES-2013-065019).
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Restraining and encouraging the use of hand gestures: effects on speech

  • Prieto Vives, Pilar, 1965-
  • Cravotta, Alice
  • Busà, Maria Grazia
Previous studies have investigated the effects of the inability to make hand gestures on speakers’ fluency; however, the question of whether encouraging speakers to gesture affects their fluency has received little attention. This study investigates the effect of restraining (Experiment 1) and encouraging (Experiment 2) hand gestures on the following correlates of speech: speech discourse length (number of words and discourse length in seconds), disfluencies (filled pauses, self-corrections, repetitions, insertions, interruptions, silent pauses), and acoustic properties (speech rate, measures of intensity and pitch). In two experiments, 10 native speakers of Italian took part in a narration task where they were asked to describe comic strips. Each experiment compared two conditions. In Experiment 1, subjects first received no instructions as to how to behave when narrating. Then they were told to sit on their hands while speaking. In Experiment 2, subjects first received no instructions and were then actively encouraged to use hand gestures. The results showed that restraining gestures leads to quieter and slower paced speech, while encouraging gestures triggers longer speech discourse, faster speech rate and more fluent and louder speech. Thus, both restraining and encouraging hand gestures seem to clearly affect prosodic properties of speech, particularly speech fluency., Authors acknowledge funding from the University of Padua’s Doctoral School of Linguistic, Philological and Literary Sciences, the Spanish Ministry of Science and Innovation (grant FFI2015-66533-P), and a grant awarded by the Generalitat de Catalunya (2014SGR-925) to the Prosodic Studies Group.
Recercat. Dipósit de la Recerca de Catalunya
Publication Capítulo o parte de un libro (BookPart)

Hand-clapping to the rhythm of newly learned words improves L2 pronunciation: Evidence from Catalan and Chinese learners of French

  • Baills, Florence
  • Zhang, Yuan
  • Prieto, Pilar
Previous research has shown that rhythmic training enhances phonological speech processing (e.g., [1, 2, 3, 4]). Yet little is known about whether rhythmic training can also help to improve pronunciation in a second language (but see [5, 6, 7]). This study tests the potential benefits of hand-clapping to the rhythm of newly learned French words for the acquisition of pronunciation patterns by Catalan children and Chinese adolescents. In two between-subjects experiments with a pretest and posttest design, participants either repeated words while clapping the rhythmic structure of words or only repeated the words. The French target words were very similar to their lexical counterparts in Catalan, whereas they differed completely from Chinese. Participants’ oral production before and after training was rated for accentedness by three French native speakers. Results showed a significant improvement for the clapping group among the Catalan participants, whereas only a near significant tendency appeared for the Chinese adolescents. Individual musical abilities did not interact significantly with the results in either experiment but working memory played a significant role in Chinese participants’ pronunciation. The results show that a short phonological training session based on highlighting the rhythmic structure of words seems to help improve pronunciation in a foreign language as long as there is little demand placed on semantic processing., This research was supported by funding from the Spanish Ministry of Economy and Competitiveness (FFI2015-66533-P) and the Generalitat de Catalunya (2014 SGR-925).
Recercat. Dipósit de la Recerca de Catalunya
Publication Contribución de congreso (ConferenceOutput)

Encouraging children to produce rhythmic beat gestures leads to better narrative discourse performances

  • Prieto Vives, Pilar, 1965-
  • Vilà-Giménez, Ingrid
Recent research has shown that when preschoolers listen to a speaker who is simultaneously making beat gestures, this favors their recall and comprehension of what they have heard and also boosts their narrative performance. However, previous studies have not tested the effect of encouraging children to produce beat gestures while retelling narratives— as opposed to merely observing them—on their narrative performances. In this study, a total of 47 five- and six-year-old children participated in a between-subjects brief training study experiment with a pretest and an immediate posttest design. Children were exposed to a training phase with a total of six one-minute stories, presented under two experimental conditions: 1) beat non-encouraging condition, and 2) beat encouraging condition. Video recordings of the pretest and posttest narratives were then scored for narrative structure and fluency. A comparison of scores showed that children in the group that had been encouraged to use beat gestures performed better than the group of children who were simply asked to retell the story without gesture instruction. All in all, this evidence suggests that encouraging the use of beat gestures by children helps to boost their subsequent narrative performance., This study was approved by the ethics committee of the Universitat Pompeu Fabra, and benefited from funding awarded by the Spanish Ministry of Economy and Competitiveness (FFI2015-66533-P) and by the Generalitat de Catalunya (2014 SGR_925) to the Prosodic Studies Group. The first author also acknowledges an FI grant from the Generalitat de Catalunya (ref. 2017FI_B_00297).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

The Timing of head movements: the role of prosodic heads and edges

  • Esteve-Gibert, Núria
  • Borràs Comes, Joan Manel, 1984-
  • Asor, Eli
  • Swerts, Marc
  • Prieto Vives, Pilar, 1965-
This study examines the influence of the position of prosodic heads (accented syllables) and prosodic edges (prosodic word and intonational phrase boundaries) on the timing of head movements. Gesture movements and prosodic events tend to be temporally aligned in the discourse, the most prominent part of gestures typically being aligned with prosodically prominent syllables in speech. However, little is known about the impact of the position of intonational phrase boundaries on gesture-speech alignment patterns. Twenty-four Catalan speakers produced spontaneous (experiment 1) and semi-spontaneous head gestures with a confirmatory function (experiment 2), along with phrase-final focused words in different prosodic conditions (stress-initial, stress-medial, and stress-final). Results showed (a) that the scope of head movements is the associated focused prosodic word, (b) that the left edge of the focused prosodic word determines where the interval of gesture prominence starts, and (c) that the speech-anchoring site for the gesture peak (or apex) depends both on the location of the accented syllable and the distance to the upcoming intonational phrase boundary. These results demonstrate that prosodic heads and edges have an impact on the timing of head movements, and therefore that prosodic structure plays a central role in the timing of co-speech gestures., This research has been funded by the Spanish MINECO (grant FFI2015-66533-P), and by the Generalitat de Catalunya to the Prosodic Studies Group (2014SGR-925), by the 2010 BE1 00207 travelling grant awarded to the second author of the study, and by the Labex BLRI (ANR-11-LABX-0036) grant awarded to the first author of the study.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Hand-clapping to the rhythm of newly learned words improves L2 pronunciation: evidence from training Chinese adolescents with French words

  • Zhang, Yuan
  • Baills, Florence
  • Prieto Vives, Pilar, 1965-
Though research has shown that rhythmic training is beneficial for phonological speech processing, little empirical work has been carried out to assess whether rhythmic training in the classroom can help to improve pronunciation in a second language. This study tests the potential benefits of hand-clapping to the rhythm of newly learned French words for the acquisition of pronunciation patterns by Chinese adolescents. In a between-subjects training experiment with a pretest/posttest design, 50 Chinese adolescents either repeated new French words while clapping out their rhythmic structure (clapping condition) or only repeated the words (non-clapping condition). Participants’ oral production before and after training was (1) perceptually rated for accentedness by two French native speakers and (2) acoustically analysed for final syllable duration. While the results showed an only near-significant improvement from pretest to posttest in accentedness ratings for the clapping group, a significant improvement was obtained for acoustic durational measures. Individual musical abilities did not interact significantly in either of the two analyses, and working memory interacted significantly only with accentedness. These results show that a short training session in which clapping is used to highlight the prosodic structure of words can help improve pronunciation in a foreign language., This research was supported by funding from the Spanish Ministry of Economy and Competitiveness (FFI2015-66533-P) and the Generalitat de Catalunya projects 2014 SGR-925 and 2017 SGR _ 971).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Observing and Producing Durational Hand Gestures Facilitates the Pronunciation of Novel Vowel-Length Contrasts

  • Li, Peng
  • Baills, Florence
  • Prieto, Pilar
While empirical studies have shown the beneficial role of observing and producing hand gestures mimicking pitch features in the learning of L2 tonal or intonational contrasts, mixed results have been obtained for the use of gestures encoding durational contrasts at the perceptual level. This study investigates the potential benefits of horizontal hand-sweep gestures encoding durational features for boosting the perception and production of nonnative vowel-length contrasts. In a between-subjects experiment with a pretest–posttest design, 50 Catalan participants without any knowledge of Japanese practiced perceiving and producing minimal pairs of Japanese disyllabic words featuring vowel-length contrasts in one of two conditions, namely with gestures or without them. Pretest and posttest consisted of the completion of identical vowel-length identification and imitation tasks. The results showed that while participants improved equally at posttest across the two conditions in the identification task, the Gesture group obtained a larger improvement than the No Gesture group in the imitation task. These results corroborate the claim that producing hand gestures encoding prosodic properties of speech may help naïve learners to learn novel phonological contrasts in a foreign language., This research was supported by funding from the Spanish Ministry of Economy and Competitiveness (FFI2015-66533-P) and the Generalitat de Catalunya projects (2014 SGR-925 and 2017 SGR-971).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Observing pitch gestures favors the learning of Spanish intonation by Mandarin speakers

  • Yuan, Chenjie
  • González Fuente, Santiago
  • Baills, Florence
  • Prieto Vives, Pilar, 1965-
Recent studies on the learning of L2 prosody have suggested that pitch gestures can enhance the learning of the L2 lexical tones. Yet it remains unclear whether the use of these gestures can aid the learning of L2 intonation, especially by tonal-language speakers. Sixty-four Mandarin speakers with basic-level Spanish were asked to learn three Spanish intonation patterns, all involving a low tone on the nuclear accent. In a pre-post test experimental design, half of the participants received intonation training without the use of pitch gestures (the control group) while the other half received the same training but with pitch gestures representing nuclear intonation contours (the experimental group). Musical (melody, pitch) abilities were also measured. The results revealed that (a) the experimental group significantly improved intonational production outcomes, and (b) even though participants with stronger musical abilities performed better, those with weaker musical abilities benefited more from observing pitch gestures., This research has been funded by two research grants awarded by the Ministry of Science and Innovation (FFI2015-66533-P) and the Generalitat de Catalunya (2014 SGR-925), both to the Prosodic Studies Group. The second author also acknowledges a FPU 2012-05893 grant awarded by the Spanish Ministry of Science and Innovation.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Observing and producing durational hand gestures facilitates the pronunciation of novel vowel-length contrasts

  • Li, Peng
  • Baills, Florence
  • Prieto Vives, Pilar, 1965-
While empirical studies have shown the beneficial role of observing and producing hand gestures mimicking pitch features in the learning of L2 tonal or intonational contrasts, mixed results have been obtained for the use of gestures encoding durational contrasts at the perceptual level. This study investigates the potential benefits of horizontal hand-sweep gestures encoding durational features for boosting the perception and production of nonnative vowel-length contrasts. In a between-subjects experiment with a pretest–posttest design, 50 Catalan participants without any knowledge of Japanese practiced perceiving and producing minimal pairs of Japanese disyllabic words featuring vowel-length contrasts in one of two conditions, namely with gestures or without them. Pretest and posttest consisted of the completion of identical vowel-length identification and imitation tasks. The results showed that while participants improved equally at posttest across the two conditions in the identification task, the Gesture group obtained a larger improvement than the No Gesture group in the imitation task. These results corroborate the claim that producing hand gestures encoding prosodic properties of speech may help naïve learners to learn novel phonological contrasts in a foreign language., This research was supported by funding from the Spanish Ministry of Economy and Competitiveness (FFI2015-66533-P) and the Generalitat de Catalunya projects (2014 SGR925 and 2017 SGR-971). The second author has a predoctoral research grant awarded by the Department of Translation and Language Sciences, Universitat Pompeu Fabra.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Effects of encouraging the use of gestures on speech

  • Cravotta, Alice
  • Busà, Maria Grazia
  • Prieto Vives, Pilar, 1965-
Purpose: Previous studies have investigated the effects of the inability to produce hand gestures on speakers' prosodic features of speech; however, the potential effects of encouraging speakers to gesture have received less attention, especially in naturalistic settings. This study aims at investigating the effects of encouraging the production of hand gestures on the following speech correlates: speech discourse length (number of words and discourse length in seconds), disfluencies (filled pauses, self-corrections, repetitions, insertions, interruptions, speech rate), and prosodic properties (measures of fundamental frequency [F0] and intensity). Method: Twenty native Italian speakers took part in a narration task in which they had to describe the content of short comic strips to a confederate listener in 1 of the following 2 conditions: (a) nonencouraging condition (N), that is, no instructions about gesturing were given, and (b) encouraging condition (E), that is, the participants were instructed to gesture while telling the story. Results: Instructing speakers to gesture led effectively to higher gesture rate and salience. Significant differences were found for (a) discourse length (e.g., the narratives had more words in E than in N) and (b) acoustic measures (F0 maximum, maximum intensity, and mean intensity metrics were higher in E than in N). Conclusion: The study shows that asking speakers to use their hands while describing a story can have an effect on narration length and can also impact on F0 and intensity metrics. By showing that enhancing the gesture stream could affect speech prosody, this study provides further evidence that gestures and prosody interact in the process of speech production., This collaborative research was the result of an Erasmus Plus InterInstitutional Mobility Agreement between the University of Padova and the Pompeu Fabra University. The first author is supported by a grant from the University of Padova’s Doctoral School of Linguistic, Philological and Literary Sciences; the third author also acknowledges Grant FFI2015-66533-P from the Spanish Ministry of Science and Innovation and Grant 2014SGR-925 from Generalitat de Catalunya to the Prosodic Studies Group.
Dipòsit Digital de Documents de la UAB
Publication Artículo científico (JournalArticle)

Is Mandarin Chinese a Truth-Based Language? Rejecting Responses to Negative Assertions and Questions

  • Li, Feifei
  • González-Fuente, Santiago|||0000-0002-8273-4424
  • Prieto Vives, Pilar|||0000-0001-8175-1081
  • Espinal, M. Teresa|||0000-0002-8079-7253
This paper addresses the central question of whether Mandarin Chinese (MC) is a canonical truth-based language, a language that is expected to express the speaker's disagreement to a negative proposition by means of a negative particle followed by a positive sentence. Eight native speakers of MC participated in an oral Discourse Completion Task that elicited rejecting responses to negative assertions/questions and broad focus statements (control condition). Results show that MC speakers convey reject by relying on a combination of lexico-syntactic strategies (e.g., negative particles such as bù, méi(yǒu), and positive sentences) together with prosodic (e.g., mean pitch) and gestural strategies (mainly, the use of head nods). Importantly, the use of a negative particle, which was the expected outcome in truth-based languages, only appeared in 52% of the rejecting answers. This system puts into question the macroparametric division between truth-based and polarity-based languages and calls for a more general view of the instantiation of a speech act that integrates lexical and syntactic strategies with prosodic and gestural strategies.