A long lasting problem in the design of auditory displays is how to design audio feedback that is aesthetically appealing and comfortable to listen to. Many systems focus solely on function and do not consider these other factors. This can lead to annoyance for users, or more extremely, abandonment of the system entirely. Instead of communicating information through sound which is built in to the system, an alternative method is to modulate acoustic parameters of a user's own music to encode information. This method - music modulation - has successfully been used in systems for conveying navigational data while walking and listening to music. This paper discusses the potential of applying this method to other contexts and types of data. We present a number of acoustic parameters of music that could be used to encode information and discuss a number of factors affecting the design of sonification systems employing them, with the goal of inciting discussion and further research into this potentially effective method of conveying information through sound.
{"title":"Modulating Personal Audio to Convey Information","authors":"Jamie Ferguson, S. Brewster","doi":"10.1145/3290607.3312988","DOIUrl":"https://doi.org/10.1145/3290607.3312988","url":null,"abstract":"A long lasting problem in the design of auditory displays is how to design audio feedback that is aesthetically appealing and comfortable to listen to. Many systems focus solely on function and do not consider these other factors. This can lead to annoyance for users, or more extremely, abandonment of the system entirely. Instead of communicating information through sound which is built in to the system, an alternative method is to modulate acoustic parameters of a user's own music to encode information. This method - music modulation - has successfully been used in systems for conveying navigational data while walking and listening to music. This paper discusses the potential of applying this method to other contexts and types of data. We present a number of acoustic parameters of music that could be used to encode information and discuss a number of factors affecting the design of sonification systems employing them, with the goal of inciting discussion and further research into this potentially effective method of conveying information through sound.","PeriodicalId":389485,"journal":{"name":"Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems","volume":"80 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-05-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115658527","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Developing affectively aware technologies is a growing industry. To build them effectively, it is important to understand the features involved in discriminating between emotions. While many technologies focus on facial expressions, studies have highlighted the influence of body expressions over other modalities for perceiving some emotions. Eye tracking studies have evaluated the combination of face and body to investigate the influence of each modality, however, few to none have investigated the perception of emotion from body expressions alone. This exploratory study aimed to evaluate the discriminative importance of dynamic body features for decoding emotion. Eye tracking was used to monitor participants' eye gaze behavior while viewing clips of non-acted body movements to which they associated an emotion. Preliminary results indicate that the two primary regions attended to most often and longest were the torso and the arms. Further analysis is ongoing, however initial results independently confirm prior studies without eye tracking.
{"title":"Perception of Emotion in Body Expressions from Gaze Behavior","authors":"A. Kleinsmith, A. Semsar","doi":"10.1145/3290607.3313062","DOIUrl":"https://doi.org/10.1145/3290607.3313062","url":null,"abstract":"Developing affectively aware technologies is a growing industry. To build them effectively, it is important to understand the features involved in discriminating between emotions. While many technologies focus on facial expressions, studies have highlighted the influence of body expressions over other modalities for perceiving some emotions. Eye tracking studies have evaluated the combination of face and body to investigate the influence of each modality, however, few to none have investigated the perception of emotion from body expressions alone. This exploratory study aimed to evaluate the discriminative importance of dynamic body features for decoding emotion. Eye tracking was used to monitor participants' eye gaze behavior while viewing clips of non-acted body movements to which they associated an emotion. Preliminary results indicate that the two primary regions attended to most often and longest were the torso and the arms. Further analysis is ongoing, however initial results independently confirm prior studies without eye tracking.","PeriodicalId":389485,"journal":{"name":"Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems","volume":"21 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-05-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116761155","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
In this paper, we introduced the concept of a hybrid product which combines a digital game with physical experiences and discussed practical recommendations for hybrid products development in the domain of wildlife conservation for children. IPANDA including hardware and software applications with sensing technology was able to gather real-time environmental data and connected to one virtual wildlife experiencing environmental challenges regarding its living habits. Children who play the product can learn about the environment around them and foster wildlife protection awareness. To evaluate our conceptual system, we created a preliminary prototype and conducted user study within the semi-structured interview and Smileyometer. Our striking findings revealed IPANDA as a promising tool to serve as groundwork to encourage children to explore the physical environment and gain potential wildlife protection education.
{"title":"IPANDA","authors":"Yang Chen, Yuyu Lin, Junwu Wang, Lijuan Liu, Cheng Yao, Fangtian Ying","doi":"10.1145/3290607.3312884","DOIUrl":"https://doi.org/10.1145/3290607.3312884","url":null,"abstract":"In this paper, we introduced the concept of a hybrid product which combines a digital game with physical experiences and discussed practical recommendations for hybrid products development in the domain of wildlife conservation for children. IPANDA including hardware and software applications with sensing technology was able to gather real-time environmental data and connected to one virtual wildlife experiencing environmental challenges regarding its living habits. Children who play the product can learn about the environment around them and foster wildlife protection awareness. To evaluate our conceptual system, we created a preliminary prototype and conducted user study within the semi-structured interview and Smileyometer. Our striking findings revealed IPANDA as a promising tool to serve as groundwork to encourage children to explore the physical environment and gain potential wildlife protection education.","PeriodicalId":389485,"journal":{"name":"Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems","volume":"116 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-05-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117229867","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
A. Fedosov, B. Stancu, Elena Di Lascio, D. Eynard, Marc Langheinrich
Collaborative movie viewing with the loved ones increases connectedness and social bonds within family members and friends. Furthermore, with the rapid adoption of personal mobile devices, people often engage in this activity being geographically separated. However, conveying our feelings and emotions about a recently watched movie or a video clip is often limited to a post on social media or a short blurb on an instant messaging app. Drawing on the popular interest in quantified-self, which envisioned one collecting and sharing biophysical information from everyday routines (e.g., workouts), we have designed and developed Movie+, a mobile application, which utilizes personal biophysical data to construct an individual's "emotional fingerprint" while viewing a video clip. Movie+ allows the selective sharing of this information through different visualization options, as well as rendering others' emotional fingerprints over the same clip. In this submission, we outline the design rationale and briefly describe our application prototype.
{"title":"Movie+","authors":"A. Fedosov, B. Stancu, Elena Di Lascio, D. Eynard, Marc Langheinrich","doi":"10.1145/3290607.3313261","DOIUrl":"https://doi.org/10.1145/3290607.3313261","url":null,"abstract":"Collaborative movie viewing with the loved ones increases connectedness and social bonds within family members and friends. Furthermore, with the rapid adoption of personal mobile devices, people often engage in this activity being geographically separated. However, conveying our feelings and emotions about a recently watched movie or a video clip is often limited to a post on social media or a short blurb on an instant messaging app. Drawing on the popular interest in quantified-self, which envisioned one collecting and sharing biophysical information from everyday routines (e.g., workouts), we have designed and developed Movie+, a mobile application, which utilizes personal biophysical data to construct an individual's \"emotional fingerprint\" while viewing a video clip. Movie+ allows the selective sharing of this information through different visualization options, as well as rendering others' emotional fingerprints over the same clip. In this submission, we outline the design rationale and briefly describe our application prototype.","PeriodicalId":389485,"journal":{"name":"Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems","volume":"25 2","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-05-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"120908084","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Hybrid bio-digital games integrate real, biological materials into computer systems. They offer a rich, playful space in which interactions between humans, computers, and non-human organisms can be explored. However, the concept of video game 'glitching' in hybrid bio-digital games, specifically those that result from interactions between the biological and the computer hardware and/or software, have not been explored in great detail. We report two incidences of glitches observed during Mold Rush - a hybrid bio-digital game based on growth patterns of living mold: The creation of an additional game character (Moldy Ghosts), and the gameplay freeze (a Yeasty Invasion). As we interpret our observations, we question the potential for glitches to become valuable tools in framing HCI investigations into designing a productive and meaningful biological-digital interactions. The goal of this paper is to propose three testable routes in which glitches could be implemented. 1) Glitch as a tool for learning 2) Glitch as a precursor for an experience-enhancing game component, and 3) Glitch as an instigator for discourse on ethical implications of bio-digital games.
{"title":"Moldy Ghosts and Yeasty Invasions: Glitches in Hybrid Bio-Digital Games","authors":"Raphael Kim, Roland van Dierendonck, S. Poslad","doi":"10.1145/3290607.3312895","DOIUrl":"https://doi.org/10.1145/3290607.3312895","url":null,"abstract":"Hybrid bio-digital games integrate real, biological materials into computer systems. They offer a rich, playful space in which interactions between humans, computers, and non-human organisms can be explored. However, the concept of video game 'glitching' in hybrid bio-digital games, specifically those that result from interactions between the biological and the computer hardware and/or software, have not been explored in great detail. We report two incidences of glitches observed during Mold Rush - a hybrid bio-digital game based on growth patterns of living mold: The creation of an additional game character (Moldy Ghosts), and the gameplay freeze (a Yeasty Invasion). As we interpret our observations, we question the potential for glitches to become valuable tools in framing HCI investigations into designing a productive and meaningful biological-digital interactions. The goal of this paper is to propose three testable routes in which glitches could be implemented. 1) Glitch as a tool for learning 2) Glitch as a precursor for an experience-enhancing game component, and 3) Glitch as an instigator for discourse on ethical implications of bio-digital games.","PeriodicalId":389485,"journal":{"name":"Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems","volume":"08 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-05-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127219038","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
S. Chivukula, C. Watkins, Lucca McKay, Colin M. Gray
Researchers in HCI and STS are increasingly interested in describing ethics and values relevant for design practice, including the formulation of methods to guide value application. However, little work has addressed ethical considerations as they emerge in everyday conversations about ethics in venues such as social media. In this late breaking work, we describe online conversations about a concept known as "asshole design" on Reddit, and the relationship of this concept to another practitioner-focused concept known as "dark patterns." We analyzed 1002 posts from the subreddit '/r/assholedesign' to identify the types of artifact being shared and the interaction purposes that were perceived to be manipulative or unethical as a type of "asshole design." We identified a subset of these posts relating to dark patterns, quantifying their occurrences using an existing dark patterns typology.
{"title":"\"Nothing Comes Before Profit\": Asshole Design In the Wild","authors":"S. Chivukula, C. Watkins, Lucca McKay, Colin M. Gray","doi":"10.1145/3290607.3312863","DOIUrl":"https://doi.org/10.1145/3290607.3312863","url":null,"abstract":"Researchers in HCI and STS are increasingly interested in describing ethics and values relevant for design practice, including the formulation of methods to guide value application. However, little work has addressed ethical considerations as they emerge in everyday conversations about ethics in venues such as social media. In this late breaking work, we describe online conversations about a concept known as \"asshole design\" on Reddit, and the relationship of this concept to another practitioner-focused concept known as \"dark patterns.\" We analyzed 1002 posts from the subreddit '/r/assholedesign' to identify the types of artifact being shared and the interaction purposes that were perceived to be manipulative or unethical as a type of \"asshole design.\" We identified a subset of these posts relating to dark patterns, quantifying their occurrences using an existing dark patterns typology.","PeriodicalId":389485,"journal":{"name":"Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems","volume":"71 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-05-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127319566","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Orestis Georgiou, Hannah Limerick, Loic Corenthy, Mark J. Perry, M. Maksymenko, Sam Frish, Jörg Müller, Myroslav Bachynskyi, Jin Ryong Kim
Digital signage systems are transitioning from static displays to rich, dynamic interactive experiences while new enabling technologies that support these interactions are also evolving. For instance, advances in computer vision and face, gaze, facial expression, body and hand-gesture recognition have enabled new ways of distal interactivity with digital content. Such possibilities are only just being adopted by advertisers and retailers, yet, they face important challenges e.g. the lack of a commonly accepted gesture, facial expressions or call-to-action set. Another common issue here is the absence of active tactile stimuli. Mid-air haptic interfaces can help alleviate these problems and aid in defining a gesture set, informing users about their interaction via haptic feedback loops, and enhancing the overall user experience. This workshop aims to examine the possibilities opened up by these technologies and discuss opportunities in designing the next generation of interactive digital signage kiosks.
{"title":"Mid-Air Haptic Interfaces for Interactive Digital Signage and Kiosks","authors":"Orestis Georgiou, Hannah Limerick, Loic Corenthy, Mark J. Perry, M. Maksymenko, Sam Frish, Jörg Müller, Myroslav Bachynskyi, Jin Ryong Kim","doi":"10.1145/3290607.3299030","DOIUrl":"https://doi.org/10.1145/3290607.3299030","url":null,"abstract":"Digital signage systems are transitioning from static displays to rich, dynamic interactive experiences while new enabling technologies that support these interactions are also evolving. For instance, advances in computer vision and face, gaze, facial expression, body and hand-gesture recognition have enabled new ways of distal interactivity with digital content. Such possibilities are only just being adopted by advertisers and retailers, yet, they face important challenges e.g. the lack of a commonly accepted gesture, facial expressions or call-to-action set. Another common issue here is the absence of active tactile stimuli. Mid-air haptic interfaces can help alleviate these problems and aid in defining a gesture set, informing users about their interaction via haptic feedback loops, and enhancing the overall user experience. This workshop aims to examine the possibilities opened up by these technologies and discuss opportunities in designing the next generation of interactive digital signage kiosks.","PeriodicalId":389485,"journal":{"name":"Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems","volume":"209 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-05-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"124703333","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Isa Rutten, W. Frier, Lawrence Van den Bogaert, D. Geerts
Mid-air haptic feedback constitutes a new means of system feedback in which tactile sensations are created without contact with an actuator. Though earlier research has already focused on its abilities to enhance our experiences, e.g. by increasing a sense of immersion during art exhibitions, an elaborate study investigating people's abilities to identify different mid-air haptic shapes has not yet been conducted. In this paper, we describe a user study involving 50 participants, with ages between 19 - 77 years old, who completed a mid-air haptic learning experiment involving eight different mid-air haptic shapes. Preliminary results showed no learning effect throughout the task. Age was found to be strongly related to a decline in performance, and interestingly, significant differences in accuracy rates were found for different types of mid-air haptic shapes.
{"title":"Invisible Touch: How Identifiable are Mid-Air Haptic Shapes?","authors":"Isa Rutten, W. Frier, Lawrence Van den Bogaert, D. Geerts","doi":"10.1145/3290607.3313004","DOIUrl":"https://doi.org/10.1145/3290607.3313004","url":null,"abstract":"Mid-air haptic feedback constitutes a new means of system feedback in which tactile sensations are created without contact with an actuator. Though earlier research has already focused on its abilities to enhance our experiences, e.g. by increasing a sense of immersion during art exhibitions, an elaborate study investigating people's abilities to identify different mid-air haptic shapes has not yet been conducted. In this paper, we describe a user study involving 50 participants, with ages between 19 - 77 years old, who completed a mid-air haptic learning experiment involving eight different mid-air haptic shapes. Preliminary results showed no learning effect throughout the task. Age was found to be strongly related to a decline in performance, and interestingly, significant differences in accuracy rates were found for different types of mid-air haptic shapes.","PeriodicalId":389485,"journal":{"name":"Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-05-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125839514","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
K. Potapov, Victor R. Lee, A. Vasalou, P. Marshall
Though some work has looked at the implementation of personal informatics tools with youth and in schools, the approach has been prescriptive; students are pushed toward behaviour change intervention or otherwise use the data for prescribed learning in a particular curriculum area. This has left a gap around how young people may themselves choose to use personal informatics tools in ways relevant to their own concerns. We gave workshops on personal informatics to 13 adolescents at two secondary schools in London, UK. We asked them to use a commercial personal informatics app to track something they chose that they thought might impact their learning. Our participants proved competent and versatile users of personal informatics tools. They tracked their feelings, tech activity, physical activity, and sleep with many using the process as a system for understanding and validating aspects of their own lives, rather than changing them.
{"title":"Youth Concerns and Responses to Self-Tracking Tools and Personal Informatics Systems","authors":"K. Potapov, Victor R. Lee, A. Vasalou, P. Marshall","doi":"10.1145/3290607.3312886","DOIUrl":"https://doi.org/10.1145/3290607.3312886","url":null,"abstract":"Though some work has looked at the implementation of personal informatics tools with youth and in schools, the approach has been prescriptive; students are pushed toward behaviour change intervention or otherwise use the data for prescribed learning in a particular curriculum area. This has left a gap around how young people may themselves choose to use personal informatics tools in ways relevant to their own concerns. We gave workshops on personal informatics to 13 adolescents at two secondary schools in London, UK. We asked them to use a commercial personal informatics app to track something they chose that they thought might impact their learning. Our participants proved competent and versatile users of personal informatics tools. They tracked their feelings, tech activity, physical activity, and sleep with many using the process as a system for understanding and validating aspects of their own lives, rather than changing them.","PeriodicalId":389485,"journal":{"name":"Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems","volume":"31 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-05-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123658956","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Machine learning is being adopted in a wide range of products and services. Despite its adoption, design and research processes for machine learning experiences have yet to be cemented in the user experience community. Prototyping machine learning experiences is noted to be particularly challenging. This paper suggests Wizard of Oz prototyping to help designers incorporate human-centered design processes into the development of machine learning experiences. This paper also surfaces a set of topics to consider in evaluating Wizard of Oz machine learning prototypes.
{"title":"Wizard of Oz Prototyping for Machine Learning Experiences","authors":"Jacob T. Browne","doi":"10.1145/3290607.3312877","DOIUrl":"https://doi.org/10.1145/3290607.3312877","url":null,"abstract":"Machine learning is being adopted in a wide range of products and services. Despite its adoption, design and research processes for machine learning experiences have yet to be cemented in the user experience community. Prototyping machine learning experiences is noted to be particularly challenging. This paper suggests Wizard of Oz prototyping to help designers incorporate human-centered design processes into the development of machine learning experiences. This paper also surfaces a set of topics to consider in evaluating Wizard of Oz machine learning prototypes.","PeriodicalId":389485,"journal":{"name":"Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems","volume":"55 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2019-05-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123666121","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：