Skip to main content

Resultados relacionados

Resultados totales (Incluyendo duplicados): 6
Encontrada(s) 1 página(s)

Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Effects of task and visual context on referring expressions using natural scenes

  • Mädebach, Andreas
  • Torubarova, Ekaterina
  • Gualdoni, Eleonora
  • Boleda, Gemma
We explore contextual adaptation of referring expressions with respect to referential ambiguity and communicative intention. We focus not only on whether people adapt, but also on how by contrasting lexical specification (e.g., “batter”) and syntactic modification (e.g., “man in white pants”) when discriminating between objects in natural scenes (e.g., a batter wearing white pants and a referee). There are three main results. First, we replicate that speakers adapt their expressions to avoid ambiguity. Second, communicative intention has an effect: participants tended to use more specific names in a discrimination task than in a descriptive task, even without referential ambiguity in the context. Third, when given the choice, participants tended to prefer more specific words over adding modification – that is, using lexical rather than syntactic means to resolve ambiguity. This suggests that it may be less demanding to increase informativity of referring expressions with lexical specification than syntactic modification., This project has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 715154) and the Spanish Research Agency (ref. PID2020-112602GB-I00).
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

What’s in a name? A large-scale computational study on how competition between names affects naming variation

  • Gualdoni, Eleonora
  • Brochhagen, Thomas
  • Mädebach, Andreas
  • Boleda, Gemma
Different speakers often use different names to refer to the same entity (e.g., “woman” vs. “tennis player” for a given woman playing tennis). We study how visual typicality affects variation in naming behavior. We use a novel computational approach to estimate visual typicality from images, and analyze a large dataset containing naming data for realistic images. In contrast to previous work, we take into account the visual properties of both the object and the scene in which it appears; and factor in multiple candidate names. We show that visual typicality mediates competition between candidate names: high competition, induced by the relationship between the visual properties of the object and the visual representations associated to names, predicts higher naming variation. On a methodological level, we demonstrate the potential of using large-scale datasets with realistic images in conjunction with computational methods to shed light on how people name objects., The authors thank the editors Adrian Staub and Kathleen Rastle, the reviewers Fritz Günther and Marc Brysbaert, and the COLT research group for their useful feedback, as well as Carina Silberer for advice regarding Computer Vision models. This project has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 715154) and Ministerio de Ciencia e Innovación and the Agencia Estatal de Investigación (Spain; ref. PID2020-112602GB-I00/MICIN/AEI/10.13039/501100011033). This paper reflects the authors’ view only, and the funding agencies are not responsible for any use that may be made of the information it contains.
Repositorio Digital de la UPF
Publication Artículo científico (JournalArticle)

Woman or tennis player? Visual typicality and lexical frequency affect variation in object naming

  • Gualdoni, Eleonora
  • Brochhagen, Thomas
  • Mädebach, Andreas
  • Boleda, Gemma
Speakers often use different names to refer to the same entity (e.g., “woman” vs. “tennis player”). We here explore factors that affect naming variation for visually presented objects. We analyze a large dataset of object names with realistic images and focus on two factors: visual typicality (of both objects and the contexts they appear in) and name frequency. We develop a novel computational approach to estimate visual typicality, using image representations from Computer Vision models. Specifically, we compute visual typicality as similarity between the representation of an object/context to the average representation of other objects/contexts of its nominal class. In contrast to previous studies, we not only study the name used by most annotators for a given object (top name), but also the second most frequently used (alternative name). Our results show that the top name and the alternative name pull in opposite directions. People’s naming choices are more varied for objects that are less typical for their top name, or more typical for their alternative name. They are also more varied when the top name has relatively low frequency (for alternative names, the opposite effect may be present but the data are not conclusive). Context typicality instead does not show a general effect in our analysis. Overall, our results show that visual and lexical characteristics relating to name candidates beyond the top name are informative for predicting variability in object naming. On a methodological level, we demonstrate the potential of using large scale datasets with realistic images in conjunction with computational methods to inform models of human object naming., This project has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 715154) and the Spanish Research Agency (ref. PID2020-112602GB-I00).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

What’s in a name? A large-scale computational study on how competition between names affects naming variation

  • Gualdoni, Eleonora
  • Brochhagen, Thomas
  • Mädebach, Andreas
  • Boleda, Gemma
Different speakers often use different names to refer to the same entity (e.g., “woman” vs. “tennis player” for a given woman playing tennis). We study how visual typicality affects variation in naming behavior. We use a novel computational approach to estimate visual typicality from images, and analyze a large dataset containing naming data for realistic images. In contrast to previous work, we take into account the visual properties of both the object and the scene in which it appears; and factor in multiple candidate names. We show that visual typicality mediates competition between candidate names: high competition, induced by the relationship between the visual properties of the object and the visual representations associated to names, predicts higher naming variation. On a methodological level, we demonstrate the potential of using large-scale datasets with realistic images in conjunction with computational methods to shed light on how people name objects., The authors thank the editors Adrian Staub and Kathleen Rastle, the reviewers Fritz Günther and Marc Brysbaert, and the COLT research group for their useful feedback, as well as Carina Silberer for advice regarding Computer Vision models. This project has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 715154) and Ministerio de Ciencia e Innovación and the Agencia Estatal de Investigación (Spain; ref. PID2020-112602GB-I00/MICIN/AEI/10.13039/501100011033). This paper reflects the authors’ view only, and the funding agencies are not responsible for any use that may be made of the information it contains.
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Woman or tennis player? Visual typicality and lexical frequency affect variation in object naming

  • Gualdoni, Eleonora
  • Brochhagen, Thomas
  • Mädebach, Andreas
  • Boleda, Gemma
Speakers often use different names to refer to the same entity (e.g., “woman” vs. “tennis player”). We here explore factors that affect naming variation for visually presented objects. We analyze a large dataset of object names with realistic images and focus on two factors: visual typicality (of both objects and the contexts they appear in) and name frequency. We develop a novel computational approach to estimate visual typicality, using image representations from Computer Vision models. Specifically, we compute visual typicality as similarity between the representation of an object/context to the average representation of other objects/contexts of its nominal class. In contrast to previous studies, we not only study the name used by most annotators for a given object (top name), but also the second most frequently used (alternative name). Our results show that the top name and the alternative name pull in opposite directions. People’s naming choices are more varied for objects that are less typical for their top name, or more typical for their alternative name. They are also more varied when the top name has relatively low frequency (for alternative names, the opposite effect may be present but the data are not conclusive). Context typicality instead does not show a general effect in our analysis. Overall, our results show that visual and lexical characteristics relating to name candidates beyond the top name are informative for predicting variability in object naming. On a methodological level, we demonstrate the potential of using large scale datasets with realistic images in conjunction with computational methods to inform models of human object naming., This project has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 715154) and the Spanish Research Agency (ref. PID2020-112602GB-I00).
Recercat. Dipósit de la Recerca de Catalunya
Publication Artículo científico (JournalArticle)

Effects of task and visual context on referring expressions using natural scenes

  • Mädebach, Andreas
  • Torubarova, Ekaterina
  • Gualdoni, Eleonora
  • Boleda, Gemma
We explore contextual adaptation of referring expressions with respect to referential ambiguity and communicative intention. We focus not only on whether people adapt, but also on how by contrasting lexical specification (e.g., “batter”) and syntactic modification (e.g., “man in white pants”) when discriminating between objects in natural scenes (e.g., a batter wearing white pants and a referee). There are three main results. First, we replicate that speakers adapt their expressions to avoid ambiguity. Second, communicative intention has an effect: participants tended to use more specific names in a discrimination task than in a descriptive task, even without referential ambiguity in the context. Third, when given the choice, participants tended to prefer more specific words over adding modification – that is, using lexical rather than syntactic means to resolve ambiguity. This suggests that it may be less demanding to increase informativity of referring expressions with lexical specification than syntactic modification., This project has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 715154) and the Spanish Research Agency (ref. PID2020-112602GB-I00).