The research proposed in this paper focuses on pragmatic interlinks between discourse markers and non-verbal behavior. Although non-verbal behavior is recognized to add non-redundant information and social interaction is not merely recognized as the transmission of words and sentences, the evidence regarding grammatical/linguistic interlinks between verbal and non-verbal concepts are vague and limited to restricted domains. This is even more evident when non-verbal behavior acts in the foreground but contributes to the structure and organization of the discourse. This research focuses on investigating the multimodal nature of discourse markers by observing their linguistic and paralinguistic properties in informal discourse. We perform a quantitative analysis with case studies for representative cases. The results show that discourse markers and background non-verbal behavior tend to follow a similar functionality in interaction. Therefore, by examining them together, one gains more insight into their true intent despite the high multifunctionality of both non-verbal behavior and DMs.
{"title":"Discourse markers in relation tonon-verbal behavior","authors":"I. Mlakar, M. Rojc, Simona Majhenic, D. Verdonik","doi":"10.1075/gest.20018.mla","DOIUrl":"https://doi.org/10.1075/gest.20018.mla","url":null,"abstract":"\u0000 The research proposed in this paper focuses on pragmatic interlinks between discourse markers and non-verbal\u0000 behavior. Although non-verbal behavior is recognized to add non-redundant information and social interaction is not merely\u0000 recognized as the transmission of words and sentences, the evidence regarding grammatical/linguistic interlinks between verbal and\u0000 non-verbal concepts are vague and limited to restricted domains. This is even more evident when non-verbal behavior acts in the\u0000 foreground but contributes to the structure and organization of the discourse. This research focuses on investigating the\u0000 multimodal nature of discourse markers by observing their linguistic and paralinguistic properties in informal discourse. We\u0000 perform a quantitative analysis with case studies for representative cases. The results show that discourse markers and background\u0000 non-verbal behavior tend to follow a similar functionality in interaction. Therefore, by examining them together, one gains more\u0000 insight into their true intent despite the high multifunctionality of both non-verbal behavior and DMs.","PeriodicalId":35125,"journal":{"name":"Gesture","volume":" ","pages":""},"PeriodicalIF":1.0,"publicationDate":"2021-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44251767","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
María Fernández-Flecha, María Blume, A. Junyent, Talía Tijero Neyra
We examine gestural development, and correlations between gesture types, vocalizations and vocabulary at ages 8 to 15 months, employing data from MacArthur-Bates Communicative Development Inventories for Peruvian Spanish, in the first such study with Peruvian children. Results show (1) significant change with age in the production of gesture types, with older children producing more; (2) important correlations between gesture types, and both vocalization types and vocabulary after controlling for age effects; and (3) correlations between the trajectory of the pointing gesture in its two modalities (whole-hand and index-finger) with age, vocalizations, and vocabulary, an effect that persists with respect to vocalizations after controlling for age. Our findings, based on a sample from a non-weird population, support a key role for gesture production in early communicative and linguistic development.
{"title":"Gesture development in Peruvianchildren and its relationship with vocalizations and vocabulary","authors":"María Fernández-Flecha, María Blume, A. Junyent, Talía Tijero Neyra","doi":"10.1075/gest.18010.fer","DOIUrl":"https://doi.org/10.1075/gest.18010.fer","url":null,"abstract":"\u0000 We examine gestural development, and correlations between gesture types, vocalizations and vocabulary at ages 8 to\u0000 15 months, employing data from MacArthur-Bates Communicative Development Inventories for Peruvian Spanish, in the\u0000 first such study with Peruvian children. Results show (1) significant change with age in the production of gesture types, with\u0000 older children producing more; (2) important correlations between gesture types, and both vocalization types and vocabulary after\u0000 controlling for age effects; and (3) correlations between the trajectory of the pointing gesture in its two modalities (whole-hand\u0000 and index-finger) with age, vocalizations, and vocabulary, an effect that persists with respect to vocalizations after controlling\u0000 for age. Our findings, based on a sample from a non-weird population, support a key role for gesture production in early\u0000 communicative and linguistic development.","PeriodicalId":35125,"journal":{"name":"Gesture","volume":" ","pages":""},"PeriodicalIF":1.0,"publicationDate":"2021-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47186260","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Further information and weblinks","authors":"","doi":"10.1075/gest.00055.inf","DOIUrl":"https://doi.org/10.1075/gest.00055.inf","url":null,"abstract":"","PeriodicalId":35125,"journal":{"name":"Gesture","volume":" ","pages":""},"PeriodicalIF":1.0,"publicationDate":"2021-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47097706","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Tommi Jantunen, Danny De Weerdt, Birgitta Burger, Anna Puupponen
This paper investigates, with the help of motion capture data processed on corpus principles, the characteristics of head and upper-torso movements in constructed action and regular narration (i.e., signing without constructed action) in FinSL. Specifically, the paper evaluates the validity of two arguments concerning constructed action: that constructed action forms a continuum with regular narration, and that constructed action divides into three subtypes (i.e., overt, reduced, and subtle). The results presented in the paper support the first argument but not directly the second one. Because of the ambiguous position of reduced constructed action in between subtle and overt constructed action, we argue in the paper that the present three-part typology of constructed action may need revising. As an alternative way of subcategorizing the phenomenon we propose a division between strong and weak constructed action.
{"title":"The more you move, the more action you construct","authors":"Tommi Jantunen, Danny De Weerdt, Birgitta Burger, Anna Puupponen","doi":"10.1075/GEST.19042.JAN","DOIUrl":"https://doi.org/10.1075/GEST.19042.JAN","url":null,"abstract":"\u0000 This paper investigates, with the help of motion capture data processed on corpus principles, the characteristics\u0000 of head and upper-torso movements in constructed action and regular narration (i.e., signing without constructed action) in FinSL.\u0000 Specifically, the paper evaluates the validity of two arguments concerning constructed action: that constructed action forms a\u0000 continuum with regular narration, and that constructed action divides into three subtypes (i.e., overt, reduced, and subtle). The\u0000 results presented in the paper support the first argument but not directly the second one. Because of the ambiguous position of\u0000 reduced constructed action in between subtle and overt constructed action, we argue in the paper that the present three-part\u0000 typology of constructed action may need revising. As an alternative way of subcategorizing the phenomenon we propose a division\u0000 between strong and weak constructed action.","PeriodicalId":35125,"journal":{"name":"Gesture","volume":"19 1","pages":"72-96"},"PeriodicalIF":1.0,"publicationDate":"2021-05-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42487526","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
In this article, I analyse how conventional height-specifier gestures used by speakers of Yucatec Maya become incorporated into Yucatec Maya Sign Languages (YMSLs). Combining video-data from elicitation, narratives, conversations and interviews collected from YMSL signers from four communities as well as from hearing nonsigners from another Yucatec Maya village, I compare form, meaning and distribution of height-specifiers in gesture and sign. Co-speech gestures that depict the height of upright entities – performed with a flat hand, palm facing downwards – come to serve various linguistic functions in YMSLs: a noun for human referents, a verb GROW, a spatial referential device, and an element of name signs. Special attention is paid to how height-specifier gestures fulfil a grammatical purpose as noun-classifiers for human referents in YMSLs. My study demonstrates processes of lexicalisation and grammaticalisation from gesture to sign and discusses the impact of gesture on the emergence of shared sign languages.
{"title":"“When you were that little…”","authors":"J. Safar","doi":"10.1075/GEST.19007.SAF","DOIUrl":"https://doi.org/10.1075/GEST.19007.SAF","url":null,"abstract":"\u0000 In this article, I analyse how conventional height-specifier gestures used by speakers of Yucatec Maya become\u0000 incorporated into Yucatec Maya Sign Languages (YMSLs). Combining video-data from elicitation, narratives, conversations and\u0000 interviews collected from YMSL signers from four communities as well as from hearing nonsigners from another Yucatec Maya village,\u0000 I compare form, meaning and distribution of height-specifiers in gesture and sign. Co-speech gestures that depict the height of\u0000 upright entities – performed with a flat hand, palm facing downwards – come to serve various linguistic functions in YMSLs: a noun\u0000 for human referents, a verb GROW, a spatial referential device, and an element of name signs. Special attention is paid to how\u0000 height-specifier gestures fulfil a grammatical purpose as noun-classifiers for human referents in YMSLs. My study demonstrates\u0000 processes of lexicalisation and grammaticalisation from gesture to sign and discusses the impact of gesture on the emergence of\u0000 shared sign languages.","PeriodicalId":35125,"journal":{"name":"Gesture","volume":"19 1","pages":"1-40"},"PeriodicalIF":1.0,"publicationDate":"2021-05-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45784105","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Culture-specific symbols can prime aspects of identity, like self-esteem, in bilingual-bicultural individuals. The purpose of the present studies was to test whether gestures that are specific to a culture prime self-esteem and, if so, whether it is due to in-group/out-group association. In Study 1, Chinese Canadians had higher self-esteem scores when primed by Chinese number gestures or characters than by English number gestures or words. In Study 2, we taught Chinese number gestures to non-Chinese adults, with half thinking they were Chinese gestures (out-group) and half that they were old fur traders’ gestures (in-group). The self-esteem scores were higher in the in-group condition than the out-group condition. Comparisons with self-esteem scores from previous studies suggest that the out-group conditions were significantly lower than baseline. These results suggest that out-group gesture primes can lower self-esteem.
{"title":"Out-group gestures can lower self-esteem","authors":"E. Nicoladis, Trevor Luk, Shireen Gill","doi":"10.1075/gest.19004.nic","DOIUrl":"https://doi.org/10.1075/gest.19004.nic","url":null,"abstract":"\u0000 Culture-specific symbols can prime aspects of identity, like self-esteem, in bilingual-bicultural individuals. The purpose\u0000 of the present studies was to test whether gestures that are specific to a culture prime self-esteem and, if so, whether it is due to\u0000 in-group/out-group association. In Study 1, Chinese Canadians had higher self-esteem scores when primed by Chinese number gestures or\u0000 characters than by English number gestures or words. In Study 2, we taught Chinese number gestures to non-Chinese adults, with half thinking\u0000 they were Chinese gestures (out-group) and half that they were old fur traders’ gestures (in-group). The self-esteem scores were higher in\u0000 the in-group condition than the out-group condition. Comparisons with self-esteem scores from previous studies suggest that the out-group\u0000 conditions were significantly lower than baseline. These results suggest that out-group gesture primes can lower self-esteem.","PeriodicalId":35125,"journal":{"name":"Gesture","volume":" ","pages":""},"PeriodicalIF":1.0,"publicationDate":"2020-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48870779","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Using data from the Northern Pastaza (qvc) and Upper Napo Quichua (quw) dialects of Amazonian Ecuador, this paper argues that the semantics of ideophones, a highly marked form class of expressive words, is principled and describable with a combination of sensori-semantic features and a fine-grained typology of gestures, based on insights from Streeck (2008) and others. Specifically, ideophones’ sensori-semantics are broken down into a semantic map consisting of 3 super- and 7 subcategorical distinctions. The greater the number of categories encoded by an ideophone’s semantics, the greater are the range of gestures used. Finally, gesture types identified by Streeck (2008) and others, were found among a very different group of people who are not western, educated, industrialized, rich, or democratic. Further research into ideophones and their gestures may find broader significance for ideophone semantics, and more generally, for the interrelations between language and gesture.
{"title":"“How do you even know what ideophones mean?”","authors":"J. Nuckolls","doi":"10.1075/gest.20005.nuc","DOIUrl":"https://doi.org/10.1075/gest.20005.nuc","url":null,"abstract":"\u0000Using data from the Northern Pastaza (qvc) and Upper Napo Quichua (quw) dialects of Amazonian Ecuador, this paper argues that the semantics of ideophones, a highly marked form class of expressive words, is principled and describable with a combination of sensori-semantic features and a fine-grained typology of gestures, based on insights from Streeck (2008) and others. Specifically, ideophones’ sensori-semantics are broken down into a semantic map consisting of 3 super- and 7 subcategorical distinctions. The greater the number of categories encoded by an ideophone’s semantics, the greater are the range of gestures used. Finally, gesture types identified by Streeck (2008) and others, were found among a very different group of people who are not western, educated, industrialized, rich, or democratic. Further research into ideophones and their gestures may find broader significance for ideophone semantics, and more generally, for the interrelations between language and gesture.","PeriodicalId":35125,"journal":{"name":"Gesture","volume":" ","pages":""},"PeriodicalIF":1.0,"publicationDate":"2020-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41887431","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Recent theories and neural models of co-speech gesture have extensively considered its cognitive role in language comprehension but have ignored the emotional function. We investigated the integration of speech and co-speech gestures in memory for verbal information with different emotional connotations (either positive, negative, or neutral). In a surprise cued-recall task, gesture boosted memory for speech with all three emotional valences. Interestingly, gesture was more likely to become integrated into memory of neutrally and positively valenced speech than negatively valenced speech. The results suggest that gesture-speech integration is modulated by emotional valence of speech, which has implications for the emotional function of gesture in language comprehension.
{"title":"Emotion matters","authors":"Rachel S Levy, S. Kelly","doi":"10.1075/GEST.19029.LEV","DOIUrl":"https://doi.org/10.1075/GEST.19029.LEV","url":null,"abstract":"\u0000Recent theories and neural models of co-speech gesture have extensively considered its cognitive role in language comprehension but have ignored the emotional function. We investigated the integration of speech and co-speech gestures in memory for verbal information with different emotional connotations (either positive, negative, or neutral). In a surprise cued-recall task, gesture boosted memory for speech with all three emotional valences. Interestingly, gesture was more likely to become integrated into memory of neutrally and positively valenced speech than negatively valenced speech. The results suggest that gesture-speech integration is modulated by emotional valence of speech, which has implications for the emotional function of gesture in language comprehension.","PeriodicalId":35125,"journal":{"name":"Gesture","volume":" ","pages":""},"PeriodicalIF":1.0,"publicationDate":"2020-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45329442","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The aim of this paper is to explore speech-accompanying gesture use in presentation of medically unexplained symptoms (MUS). The data are 19 video-filmed semi-structured interviews with patients presenting MUS. Four patterns of gestural behaviors are established in symptom presentation: (1) No gesturing; (2) Overall low gesture rate; (3) Overall high gesture rate with low rate for symptoms; (4) Overall high gesture rate with high rate for symptoms. The patients with overall low gesture rate tend to perform deictic gestures, pointing to exact locations of the symptoms; those with overall high gesture rate and low symptom rate produce metaphorics, and those who gesticulate at high rates – mainly iconics and metaphorics. Although exact factors that lead to the four types of gesturing patterns are unclear, the findings encourage medical professionals to attend to the information in gesture use in order to obtain a better understanding of the patient’s experience of MUS.
{"title":"Gestures in patients’ presentation of medically unexplained symptoms (MUS)","authors":"A. Sowińska, Monika Boruta-Żywiczyńska","doi":"10.1075/GEST.17011.SOW","DOIUrl":"https://doi.org/10.1075/GEST.17011.SOW","url":null,"abstract":"\u0000 The aim of this paper is to explore speech-accompanying gesture use in presentation of medically unexplained\u0000 symptoms (MUS). The data are 19 video-filmed semi-structured interviews with patients presenting MUS. Four patterns of gestural\u0000 behaviors are established in symptom presentation: (1) No gesturing; (2) Overall low gesture rate; (3) Overall high gesture rate\u0000 with low rate for symptoms; (4) Overall high gesture rate with high rate for symptoms. The patients with overall low gesture rate\u0000 tend to perform deictic gestures, pointing to exact locations of the symptoms; those with overall high gesture rate and low\u0000 symptom rate produce metaphorics, and those who gesticulate at high rates – mainly iconics and metaphorics. Although exact factors\u0000 that lead to the four types of gesturing patterns are unclear, the findings encourage medical professionals to attend to the\u0000 information in gesture use in order to obtain a better understanding of the patient’s experience of MUS.","PeriodicalId":35125,"journal":{"name":"Gesture","volume":" ","pages":""},"PeriodicalIF":1.0,"publicationDate":"2020-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49272090","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}