This paper proposes the notion of posthuman gesture as a conceptual framework for approaching the increasingly complex notions of agency within digital instrumental system design and performance. Posthuman gesture is a synthesis of Barad's notion of posthuman performativity and current research of gesture in musical and digital instrument design contexts. An overview is provided of an approach to instrumental system design that took place in the context of a larger interactive dance work, followed by a discussion that applies the posthuman gesture framework to this example project.
{"title":"Posthuman Gesture","authors":"Ian Jarvis, D. Nort","doi":"10.1145/3212721.3212807","DOIUrl":"https://doi.org/10.1145/3212721.3212807","url":null,"abstract":"This paper proposes the notion of posthuman gesture as a conceptual framework for approaching the increasingly complex notions of agency within digital instrumental system design and performance. Posthuman gesture is a synthesis of Barad's notion of posthuman performativity and current research of gesture in musical and digital instrument design contexts. An overview is provided of an approach to instrumental system design that took place in the context of a larger interactive dance work, followed by a discussion that applies the posthuman gesture framework to this example project.","PeriodicalId":330867,"journal":{"name":"Proceedings of the 5th International Conference on Movement and Computing","volume":"39 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114228916","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
William Li, Omid Alemi, Jianyu Fan, Philippe Pasquier
Affect estimation consists of building a predictive model of the perceived affect given stimuli. In this study, we are looking at the perceived affect in full-body motion capture data of various movements. There are two parts to this study. In the first part, we conduct groundtruthing on affective labels of motion capture sequences by hosting a survey on a crowdsourcing platform where participants from all over the world ranked the relative valence and arousal of one motion capture sequences to another. In the second part, we present our experiments with training a machine learning model for pairwise ranking of motion capture data using RankNet. Our analysis shows a reasonable strength in the inter-rater agreement between the participants. The evaluation of the RankNet demonstrates that it can learn to rank the motion capture data, with higher confidence in the arousal dimension compared to the valence dimension.
{"title":"Ranking-Based Affect Estimation of Motion Capture Data in the Valence-Arousal Space","authors":"William Li, Omid Alemi, Jianyu Fan, Philippe Pasquier","doi":"10.1145/3212721.3212813","DOIUrl":"https://doi.org/10.1145/3212721.3212813","url":null,"abstract":"Affect estimation consists of building a predictive model of the perceived affect given stimuli. In this study, we are looking at the perceived affect in full-body motion capture data of various movements. There are two parts to this study. In the first part, we conduct groundtruthing on affective labels of motion capture sequences by hosting a survey on a crowdsourcing platform where participants from all over the world ranked the relative valence and arousal of one motion capture sequences to another. In the second part, we present our experiments with training a machine learning model for pairwise ranking of motion capture data using RankNet. Our analysis shows a reasonable strength in the inter-rater agreement between the participants. The evaluation of the RankNet demonstrates that it can learn to rank the motion capture data, with higher confidence in the arousal dimension compared to the valence dimension.","PeriodicalId":330867,"journal":{"name":"Proceedings of the 5th International Conference on Movement and Computing","volume":"86 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115807954","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Joseph W. Newbold, Nicolas E. Gold, N. Bianchi-Berthouze
When designing movement sonification, its effect on peoples' movement must be considered. Recent work has shown that using musical expectancy within movement sonification can impact the way people move. However, this body of work has also found that different types of movements show different effects of these musically-informed sonifications on movement behaviour. This paper addresses this disparity, by exploring how this kind of sonification may be impacted by perceptual cues. We focus on two kinds of target movements: an "open movement", i.e. one with limited perceptual cues (no visual cues from the environment and limited proprioceptive cues) at a target point, and a "closed movement" i.e. one with strong perceptual (visual and proprioceptive) cues at the target point. We present a study that investigates how visual cues may interact with musical expectancy based sonification and discuss what these results mean for musical expectancy based designs and musically-informed sonification overall We show that the effect of expectancy of sonification at a target point is greater when visual cues are removed.
{"title":"Visual cues effect on the impact of sonification on movement","authors":"Joseph W. Newbold, Nicolas E. Gold, N. Bianchi-Berthouze","doi":"10.1145/3212721.3212880","DOIUrl":"https://doi.org/10.1145/3212721.3212880","url":null,"abstract":"When designing movement sonification, its effect on peoples' movement must be considered. Recent work has shown that using musical expectancy within movement sonification can impact the way people move. However, this body of work has also found that different types of movements show different effects of these musically-informed sonifications on movement behaviour. This paper addresses this disparity, by exploring how this kind of sonification may be impacted by perceptual cues. We focus on two kinds of target movements: an \"open movement\", i.e. one with limited perceptual cues (no visual cues from the environment and limited proprioceptive cues) at a target point, and a \"closed movement\" i.e. one with strong perceptual (visual and proprioceptive) cues at the target point. We present a study that investigates how visual cues may interact with musical expectancy based sonification and discuss what these results mean for musical expectancy based designs and musically-informed sonification overall We show that the effect of expectancy of sonification at a target point is greater when visual cues are removed.","PeriodicalId":330867,"journal":{"name":"Proceedings of the 5th International Conference on Movement and Computing","volume":"15 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124894697","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This study aims to explore how musicians experience self-reflection about their movements as they play and develop awareness of their bodies and its possible effect on their playing. Guided by Interpretative Phenomenological Analysis (IPA), qualitative methods were employed examining three case studies. The findings report the musicians' reactions to self-reflection during and after performing two tasks. Further research could combine phenomenological methods with computers and movement interfaces in order to design new paradigms and develop greater well-being in playing.
{"title":"Exploring the effect of simulated movements on body self-awareness and performance","authors":"Annamaria Minafra","doi":"10.1145/3212721.3212875","DOIUrl":"https://doi.org/10.1145/3212721.3212875","url":null,"abstract":"This study aims to explore how musicians experience self-reflection about their movements as they play and develop awareness of their bodies and its possible effect on their playing. Guided by Interpretative Phenomenological Analysis (IPA), qualitative methods were employed examining three case studies. The findings report the musicians' reactions to self-reflection during and after performing two tasks. Further research could combine phenomenological methods with computers and movement interfaces in order to design new paradigms and develop greater well-being in playing.","PeriodicalId":330867,"journal":{"name":"Proceedings of the 5th International Conference on Movement and Computing","volume":"45 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116376850","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
During the last years1, motion sensing technologies have been proven to be a useful mean for movement's analysis in relation to dance and music performances. The case study presented is part of a research project that involves dance pedagogy and new technologies at Nice University. This paper focus on description of an interactive experience based on motion sensing technologies allowing dance students to explore the connection between to relate kinesthesia, sense of touch and listening via interactive sound feedbacks.
{"title":"Listening Touch: A Case Study about Multimodal Awareness in Movement Analysis with Interactive Sound Feedback","authors":"A. Giomi, Federica Fratagnoli","doi":"10.1145/3212721.3212815","DOIUrl":"https://doi.org/10.1145/3212721.3212815","url":null,"abstract":"During the last years1, motion sensing technologies have been proven to be a useful mean for movement's analysis in relation to dance and music performances. The case study presented is part of a research project that involves dance pedagogy and new technologies at Nice University. This paper focus on description of an interactive experience based on motion sensing technologies allowing dance students to explore the connection between to relate kinesthesia, sense of touch and listening via interactive sound feedbacks.","PeriodicalId":330867,"journal":{"name":"Proceedings of the 5th International Conference on Movement and Computing","volume":"6 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131479556","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Erica Volta, Paolo Alborno, M. Gori, Simone Ghisio, Stefano Piana, G. Volpe
Recent results from psychophysics and developmental psychology show that children do not integrate and use the same sensory modalities in the same way, but they rather have a preferential sensory channel to learn specific concepts. In schools, however, the visual channel is often the only one exploited for teaching, whereas the other channels are left to a marginal role. The weDRAW project, an ongoing European two-years project, explores the chance to create and evaluate new methodologies to teaching, grounded on multisensory technologies. In particular, the project targets a deeper understanding of arithmetic and geometry. A major novelty of such a new technology is that it is based on the renewed understanding of what communication between senses is and how it occurs during child development, that is, that specific sensory systems have specific roles for learning specific concepts. Neuroscientific prospectives suggest that it is possible to develop new teaching/learning channels, personalized for each student based on the child's sensory skills. This practice work consists of a demo simulating a set-up in a primary school, where children with any level of previous mathematical knowledge can try the technologies themselves. The demo includes full-body activities to "play" and "draw" arithmetical and geometrical concepts, such as playing a fraction using body rhythms and drawing shapes and symmetries.
{"title":"Enhancing children understanding of mathematics with multisensory technology","authors":"Erica Volta, Paolo Alborno, M. Gori, Simone Ghisio, Stefano Piana, G. Volpe","doi":"10.1145/3212721.3212889","DOIUrl":"https://doi.org/10.1145/3212721.3212889","url":null,"abstract":"Recent results from psychophysics and developmental psychology show that children do not integrate and use the same sensory modalities in the same way, but they rather have a preferential sensory channel to learn specific concepts. In schools, however, the visual channel is often the only one exploited for teaching, whereas the other channels are left to a marginal role. The weDRAW project, an ongoing European two-years project, explores the chance to create and evaluate new methodologies to teaching, grounded on multisensory technologies. In particular, the project targets a deeper understanding of arithmetic and geometry. A major novelty of such a new technology is that it is based on the renewed understanding of what communication between senses is and how it occurs during child development, that is, that specific sensory systems have specific roles for learning specific concepts. Neuroscientific prospectives suggest that it is possible to develop new teaching/learning channels, personalized for each student based on the child's sensory skills. This practice work consists of a demo simulating a set-up in a primary school, where children with any level of previous mathematical knowledge can try the technologies themselves. The demo includes full-body activities to \"play\" and \"draw\" arithmetical and geometrical concepts, such as playing a fraction using body rhythms and drawing shapes and symmetries.","PeriodicalId":330867,"journal":{"name":"Proceedings of the 5th International Conference on Movement and Computing","volume":"40 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2018-06-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127926355","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：