{"title":"识别手势和LSF共同发音特征的协议:应用于认识手势","authors":"Fanny CatteauSFL, Claudia S BianchiniFoReLLIS","doi":"arxiv-2409.10079","DOIUrl":null,"url":null,"abstract":"This article focuses on the articulatory characteristics of epistemic\ngestures (i.e., gestures used to express certainty or uncertainty) in co-speech\ngestures (CSG) in French and in French Sign Language (LSF). It presents a new\nmethodology for analysis, which relies on the complementary use of manual\nannotation (using Typannot) and semi-automatic annotation (using AlphaPose) to\nhighlight the kinesiological characteristics of these epistemic gestures. The\npresented methodology allows to analyze the flexion/extension movements of the\nhead in epistemic contexts. The results of this analysis show that in CSG and\nLSF: (1) head nods passing through the neutral position (i.e., head straight\nwith no flexion/extension) and high movement speed are markers of certainty;\nand (2) holding the head position away from the neutral position and low\nmovement speed indicate uncertainty. This study is conducted within the\nframework of the ANR LexiKHuM project, which develops kinesthetic communication\nsolutions for human-machine interaction.","PeriodicalId":501541,"journal":{"name":"arXiv - CS - Human-Computer Interaction","volume":"16 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Protocol for identifying shared articulatory features of gestures and LSF: application to epistemic gesture\",\"authors\":\"Fanny CatteauSFL, Claudia S BianchiniFoReLLIS\",\"doi\":\"arxiv-2409.10079\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This article focuses on the articulatory characteristics of epistemic\\ngestures (i.e., gestures used to express certainty or uncertainty) in co-speech\\ngestures (CSG) in French and in French Sign Language (LSF). It presents a new\\nmethodology for analysis, which relies on the complementary use of manual\\nannotation (using Typannot) and semi-automatic annotation (using AlphaPose) to\\nhighlight the kinesiological characteristics of these epistemic gestures. The\\npresented methodology allows to analyze the flexion/extension movements of the\\nhead in epistemic contexts. The results of this analysis show that in CSG and\\nLSF: (1) head nods passing through the neutral position (i.e., head straight\\nwith no flexion/extension) and high movement speed are markers of certainty;\\nand (2) holding the head position away from the neutral position and low\\nmovement speed indicate uncertainty. This study is conducted within the\\nframework of the ANR LexiKHuM project, which develops kinesthetic communication\\nsolutions for human-machine interaction.\",\"PeriodicalId\":501541,\"journal\":{\"name\":\"arXiv - CS - Human-Computer Interaction\",\"volume\":\"16 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-09-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - CS - Human-Computer Interaction\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2409.10079\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - CS - Human-Computer Interaction","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2409.10079","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Protocol for identifying shared articulatory features of gestures and LSF: application to epistemic gesture
This article focuses on the articulatory characteristics of epistemic
gestures (i.e., gestures used to express certainty or uncertainty) in co-speech
gestures (CSG) in French and in French Sign Language (LSF). It presents a new
methodology for analysis, which relies on the complementary use of manual
annotation (using Typannot) and semi-automatic annotation (using AlphaPose) to
highlight the kinesiological characteristics of these epistemic gestures. The
presented methodology allows to analyze the flexion/extension movements of the
head in epistemic contexts. The results of this analysis show that in CSG and
LSF: (1) head nods passing through the neutral position (i.e., head straight
with no flexion/extension) and high movement speed are markers of certainty;
and (2) holding the head position away from the neutral position and low
movement speed indicate uncertainty. This study is conducted within the
framework of the ANR LexiKHuM project, which develops kinesthetic communication
solutions for human-machine interaction.