We present SpectroPhone, a surface material sensing approach based on the rear camera of a smartphone and external white LED light sources. Warm and cool white LEDs, as used for dual or quad flashlights in smartphones, differ in their spectral distribution in the red and blue range. Warm and cool white LEDs in combination can produce a characteristic spectral response curve, when their light is reflected from a surface. We show that with warm and cool white LEDs and the rear-camera of a smartphone 30 different materials can be distinguished with an accuracy of 99 %. Based on a dataset consisting of 13500 images of material surfaces taken at different LED light intensities, we report recognition rates of support vector machines with different parameters.
{"title":"SpectroPhone: Enabling Material Surface Sensing with Rear Camera and Flashlight LEDs","authors":"M. Schrapel, Philipp Etgeton, M. Rohs","doi":"10.1145/3411763.3451753","DOIUrl":"https://doi.org/10.1145/3411763.3451753","url":null,"abstract":"We present SpectroPhone, a surface material sensing approach based on the rear camera of a smartphone and external white LED light sources. Warm and cool white LEDs, as used for dual or quad flashlights in smartphones, differ in their spectral distribution in the red and blue range. Warm and cool white LEDs in combination can produce a characteristic spectral response curve, when their light is reflected from a surface. We show that with warm and cool white LEDs and the rear-camera of a smartphone 30 different materials can be distinguished with an accuracy of 99 %. Based on a dataset consisting of 13500 images of material surfaces taken at different LED light intensities, we report recognition rates of support vector machines with different parameters.","PeriodicalId":265192,"journal":{"name":"Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"116801354","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Samantha Olinsky, Pooja M. Desai, Selen Turkay, Elizabeth M. Heitkemper, Elliot G. Mitchell, Lena Mamykina, Maria L. Hwang
39.7% of the users changed answers after viewing community responses which resulted in 14% more accuracy across all items. Strong player-avatar-identifcation and increased utilization of the crowdsourced community board were strongly correlated to users’ enjoyment of the app. Findings suggest how lightweight tools can leverage gamifcation and social mechanisms to facilitate engagement and refection on nutrition topics in enjoyable ways.
{"title":"Meals for Monsters: a Mobile Application for the Feasibility of Gaming and Social Mechanisms","authors":"Samantha Olinsky, Pooja M. Desai, Selen Turkay, Elizabeth M. Heitkemper, Elliot G. Mitchell, Lena Mamykina, Maria L. Hwang","doi":"10.1145/3411763.3451789","DOIUrl":"https://doi.org/10.1145/3411763.3451789","url":null,"abstract":"39.7% of the users changed answers after viewing community responses which resulted in 14% more accuracy across all items. Strong player-avatar-identifcation and increased utilization of the crowdsourced community board were strongly correlated to users’ enjoyment of the app. Findings suggest how lightweight tools can leverage gamifcation and social mechanisms to facilitate engagement and refection on nutrition topics in enjoyable ways.","PeriodicalId":265192,"journal":{"name":"Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"117223984","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Companion robots have been suggested as a promising technology for older adults who experience loneliness. However, healthy older adults commonly reject robots designed to be an ”artificial friend”. We follow the approach of ”companionship as a secondary function”, in which a non-humanoid robot is designed with a primary function that older adults perceive as appropriate, and a secondary function of companionship. In a Zoom-based exploratory need-study we unfold how older adults perceive the various aspects of a robot’s ”companionship” as a secondary function. Our qualitative analysis reveals several use cases that older adults find to be appropriate for their daily routine, and classify them into three high-level categories: companionship as ”attentive to me”, companionship as ”looking after me”, and companionship as ”experiencing together with me”. Our findings indicate that robot companionship, when designed as a secondary function, is perceived by older adults as a multifaceted social experience.
{"title":"The Multifaceted Nature of Robotic Companionship when Presented as a Secondary Function","authors":"H. Erel, Omer Dado, Adi Manor, Oren Zuckerman","doi":"10.1145/3411763.3451582","DOIUrl":"https://doi.org/10.1145/3411763.3451582","url":null,"abstract":"Companion robots have been suggested as a promising technology for older adults who experience loneliness. However, healthy older adults commonly reject robots designed to be an ”artificial friend”. We follow the approach of ”companionship as a secondary function”, in which a non-humanoid robot is designed with a primary function that older adults perceive as appropriate, and a secondary function of companionship. In a Zoom-based exploratory need-study we unfold how older adults perceive the various aspects of a robot’s ”companionship” as a secondary function. Our qualitative analysis reveals several use cases that older adults find to be appropriate for their daily routine, and classify them into three high-level categories: companionship as ”attentive to me”, companionship as ”looking after me”, and companionship as ”experiencing together with me”. Our findings indicate that robot companionship, when designed as a secondary function, is perceived by older adults as a multifaceted social experience.","PeriodicalId":265192,"journal":{"name":"Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"127210632","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Tagbly is an acronym for Text Audio Graphics Assem BLY. It is a method and system that synchronizes audio data with image data using an HTML control file. The HTML control file contains references to linked multimedia asset files and timestamps indicating when each of these multimedia assets will be displayed/played. Audiovisual content creators can incorporate interactive content, such as graphic elements (e.g., pictures, 360 images and 3D models), text-based annotations, clickable links and buttons, and zooming in/out of images. Viewers can interact with the interactive features while the multimedia content is being displayed/played. In the viewer's eye, Tagbly's audiovisual content looks like an “interactive video”.
{"title":"Tagbly: Enhanced Multimedia","authors":"Vanessa Figueiredo, Wilter Franceschi","doi":"10.1145/3411763.3451544","DOIUrl":"https://doi.org/10.1145/3411763.3451544","url":null,"abstract":"Tagbly is an acronym for Text Audio Graphics Assem BLY. It is a method and system that synchronizes audio data with image data using an HTML control file. The HTML control file contains references to linked multimedia asset files and timestamps indicating when each of these multimedia assets will be displayed/played. Audiovisual content creators can incorporate interactive content, such as graphic elements (e.g., pictures, 360 images and 3D models), text-based annotations, clickable links and buttons, and zooming in/out of images. Viewers can interact with the interactive features while the multimedia content is being displayed/played. In the viewer's eye, Tagbly's audiovisual content looks like an “interactive video”.","PeriodicalId":265192,"journal":{"name":"Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125965890","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
V. Cannanure, Dilrukshi Gamage, C. Sturm, H. Winschiers-Theophilus, J. F. Maestre, Naveena Karusala, Pedro Reynolds-Cuéllar, Neha Kumar
The HCI Across Borders (HCIxB) community has been growing in recent years, starting with the Development Consortium at CHI 2016 and the HCIxB Symposia at CHI since. This year, we intend to hold an HCIxB workshop that aims to foster the scholarship potential of student and early career HCIxB researchers across the world, particularly those from and in the Global South, engaging on the topic of decoloniality. Through this symposium, we aim to create space for discussions that have been emerging in pockets of the HCI community, but could benefit from greater focus and attention in the interest of demarginalizing members and research areas of the community that have thus far remained on the margins of the discipline. We expect this virtual workshop at CHI 2021 to be an inaugural session for a series of virtual events that will help continue this conversation on decolonizing HCI’s borders.
{"title":"Decolonizing HCI Across Borders","authors":"V. Cannanure, Dilrukshi Gamage, C. Sturm, H. Winschiers-Theophilus, J. F. Maestre, Naveena Karusala, Pedro Reynolds-Cuéllar, Neha Kumar","doi":"10.1145/3411763.3441348","DOIUrl":"https://doi.org/10.1145/3411763.3441348","url":null,"abstract":"The HCI Across Borders (HCIxB) community has been growing in recent years, starting with the Development Consortium at CHI 2016 and the HCIxB Symposia at CHI since. This year, we intend to hold an HCIxB workshop that aims to foster the scholarship potential of student and early career HCIxB researchers across the world, particularly those from and in the Global South, engaging on the topic of decoloniality. Through this symposium, we aim to create space for discussions that have been emerging in pockets of the HCI community, but could benefit from greater focus and attention in the interest of demarginalizing members and research areas of the community that have thus far remained on the margins of the discipline. We expect this virtual workshop at CHI 2021 to be an inaugural session for a series of virtual events that will help continue this conversation on decolonizing HCI’s borders.","PeriodicalId":265192,"journal":{"name":"Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125402126","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
W. Luo, Anke Lehmann, Yushan Yang, Raimund Dachselt
Augmented Reality (AR) has the potential to revolutionize our workspaces, since it considerably extends the limits of current displays while keeping users aware of their collaborators and surroundings. Collective activities like brainstorming and sensemaking often use space for arranging documents and information and thus will likely benefit from AR-enhanced offices. Until now, there has been very little research on how the physical surroundings might affect virtual content placement for collaborative sensemaking. We therefore conducted an initial study with eight participants in which we compared two different room settings for collaborative image categorization regarding content placement, spatiality, and layout. We found that participants tend to utilize the room’s vertical surfaces as well as the room’s furniture, particularly through edges and gaps, for placement and organization. We also identified three different spatial layout patterns (panoramic-strip, semi-cylindrical layout, furniture-based distribution) and observed the usage of temporary storage spaces specifically for collaboration.
{"title":"Investigating Document Layout and Placement Strategies for Collaborative Sensemaking in Augmented Reality","authors":"W. Luo, Anke Lehmann, Yushan Yang, Raimund Dachselt","doi":"10.1145/3411763.3451588","DOIUrl":"https://doi.org/10.1145/3411763.3451588","url":null,"abstract":"Augmented Reality (AR) has the potential to revolutionize our workspaces, since it considerably extends the limits of current displays while keeping users aware of their collaborators and surroundings. Collective activities like brainstorming and sensemaking often use space for arranging documents and information and thus will likely benefit from AR-enhanced offices. Until now, there has been very little research on how the physical surroundings might affect virtual content placement for collaborative sensemaking. We therefore conducted an initial study with eight participants in which we compared two different room settings for collaborative image categorization regarding content placement, spatiality, and layout. We found that participants tend to utilize the room’s vertical surfaces as well as the room’s furniture, particularly through edges and gaps, for placement and organization. We also identified three different spatial layout patterns (panoramic-strip, semi-cylindrical layout, furniture-based distribution) and observed the usage of temporary storage spaces specifically for collaboration.","PeriodicalId":265192,"journal":{"name":"Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"125522777","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Despite the growing interest in Intelligent Personal Assistants in many domains, limited studies have explored this technology’s usage among persons with neurodevelopmental disorders (NDD) and its potential for improving their cognitive skills. This paper presents an exploratory study that investigated the use of Google Home featured with Google Assistant in a therapeutic setting. We provided three therapists with two Google Home devices for 21 days, and they were welcome to use it as they liked at their ordinary one-to-one therapy sessions. During the study, we gathered different data: history logs from Google Assistant and semi-structured observations and comments by the specialists through questionnaires, forms, and a group interview. Our findings give a first glimpse of the usage patterns of Google Assistant within the therapy for children with NDD. Furthermore, our results point out the benefits and challenges for both therapists and children while interacting with conversational technology.
{"title":"Toward the Introduction of Google Assistant in Therapy for Children with Neurodevelopmental Disorders: An Exploratory Study","authors":"Fabio Catania, Micol Spitale, F. Garzotto","doi":"10.1145/3411763.3451666","DOIUrl":"https://doi.org/10.1145/3411763.3451666","url":null,"abstract":"Despite the growing interest in Intelligent Personal Assistants in many domains, limited studies have explored this technology’s usage among persons with neurodevelopmental disorders (NDD) and its potential for improving their cognitive skills. This paper presents an exploratory study that investigated the use of Google Home featured with Google Assistant in a therapeutic setting. We provided three therapists with two Google Home devices for 21 days, and they were welcome to use it as they liked at their ordinary one-to-one therapy sessions. During the study, we gathered different data: history logs from Google Assistant and semi-structured observations and comments by the specialists through questionnaires, forms, and a group interview. Our findings give a first glimpse of the usage patterns of Google Assistant within the therapy for children with NDD. Furthermore, our results point out the benefits and challenges for both therapists and children while interacting with conversational technology.","PeriodicalId":265192,"journal":{"name":"Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"115029051","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Over the past decade, Deep Neural Networks (DNN) applied to eye tracking data have seen tremendous progress in their ability to perform Autism Spectrum Disorder (ASD) diagnosis. Despite their promising accuracy, DNNs are often seen as ’black boxes’ by physicians unfamiliar with the technology. In this paper, we present EyeXplain Autism, an interactive system that enables physicians to analyse eye tracking data, perform automated diagnosis and interpret DNN predictions. Here we discuss the design, development and sample scenario to illustrate the potential of our system to aid in ASD diagnosis. Unlike existing eye tracking software, our system combines traditional eye tracking visualisation and analysis tools with a data-driven knowledge to enhance medical decision-making for physicians.
{"title":"EyeXplain Autism: Interactive System for Eye Tracking Data Analysis and Deep Neural Network Interpretation for Autism Spectrum Disorder Diagnosis","authors":"Ryan Anthony J. de Belen, T. Bednarz, A. Sowmya","doi":"10.1145/3411763.3451784","DOIUrl":"https://doi.org/10.1145/3411763.3451784","url":null,"abstract":"Over the past decade, Deep Neural Networks (DNN) applied to eye tracking data have seen tremendous progress in their ability to perform Autism Spectrum Disorder (ASD) diagnosis. Despite their promising accuracy, DNNs are often seen as ’black boxes’ by physicians unfamiliar with the technology. In this paper, we present EyeXplain Autism, an interactive system that enables physicians to analyse eye tracking data, perform automated diagnosis and interpret DNN predictions. Here we discuss the design, development and sample scenario to illustrate the potential of our system to aid in ASD diagnosis. Unlike existing eye tracking software, our system combines traditional eye tracking visualisation and analysis tools with a data-driven knowledge to enhance medical decision-making for physicians.","PeriodicalId":265192,"journal":{"name":"Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122386194","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Although we extensively use routing services in our daily commutes, such systems are yet to be personalized around the user. It often happens that different routes are close in their estimated time of arrival (ETA) while being very different in how they affect the driver’s states. Using traces of a user’s physiological measures, different candidate routes can be ranked based on how they affect users’ well-being. In this research, we introduce the “empathetic routing” framework for providing human-centered routing based on historical biomarkers of the drivers collected through naturalistic settings and by using smart wearable devices. Through this framework, we rank three specific routes between two points in the city of Charlottesville, based on historical driver heart rate data collected through a three-month naturalistic driving study. Additionally, we demonstrate that the proposed framework is capable of finding infrastructural elements in a route that can potentially affect a driver’s well-being.
{"title":"Leveraging Ubiquitous Computing for Empathetic Routing: A Naturalistic Data-driven Approach","authors":"A. Tavakoli, M. Boukhechba, Arsalan Heydarian","doi":"10.1145/3411763.3451693","DOIUrl":"https://doi.org/10.1145/3411763.3451693","url":null,"abstract":"Although we extensively use routing services in our daily commutes, such systems are yet to be personalized around the user. It often happens that different routes are close in their estimated time of arrival (ETA) while being very different in how they affect the driver’s states. Using traces of a user’s physiological measures, different candidate routes can be ranked based on how they affect users’ well-being. In this research, we introduce the “empathetic routing” framework for providing human-centered routing based on historical biomarkers of the drivers collected through naturalistic settings and by using smart wearable devices. Through this framework, we rank three specific routes between two points in the city of Charlottesville, based on historical driver heart rate data collected through a three-month naturalistic driving study. Additionally, we demonstrate that the proposed framework is capable of finding infrastructural elements in a route that can potentially affect a driver’s well-being.","PeriodicalId":265192,"journal":{"name":"Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122526735","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Task design for crowdsourcing is a key factor limiting the quality of crowd-sourced results. This case study presents our design process for a complex cognitive task: generating Dimension/Values for categorizing ideas. Conveying the task to workers was a formidable design challenge. We present five strategies and lessons learned from testing with workers. Decomposing the cognitive process and testing mastery of each cognitive subprocess enabled us to finally convey the task requirements and obtain useful results.
{"title":"Task Design for Crowdsourcing Complex Cognitive Skills","authors":"Gaoping Huang, Meng-Han Wu, Alexander J. Quinn","doi":"10.1145/3411763.3443447","DOIUrl":"https://doi.org/10.1145/3411763.3443447","url":null,"abstract":"Task design for crowdsourcing is a key factor limiting the quality of crowd-sourced results. This case study presents our design process for a complex cognitive task: generating Dimension/Values for categorizing ideas. Conveying the task to workers was a formidable design challenge. We present five strategies and lessons learned from testing with workers. Decomposing the cognitive process and testing mastery of each cognitive subprocess enabled us to finally convey the task requirements and obtain useful results.","PeriodicalId":265192,"journal":{"name":"Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2021-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122521701","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：