Yu-Jung Ko, Shirin Feiz, I V Ramakrishnan, Aini Putkonen, Yuheng Wang, Antti Oulasvirta, Ali Selman Aydin, Vikas Ashok, Xiaojun Bi
Gliding a finger on touchscreen to reach a target, that is, touch exploration, is a common selection method of blind screen-reader users. This paper investigates their gliding behavior and presents a model for their motor performance. We discovered that the gliding trajectories of blind people are a mixture of two strategies: 1) ballistic movements with iterative corrections relying on non-visual feedback, and 2) multiple sub-movements separated by stops, and concatenated until the target is reached. Based on this finding, we propose the mixture pointing model, a model that relates movement time to distance and width of the target. The model outperforms extant models, improving R2 from 0.65 for Fitts' law to 0.76, and is superior in cross-validation and information criteria. The model advances understanding of gliding-based target selection and serves as a tool for designing interface layouts for screen-reader based touch exploration.
{"title":"Modeling Gliding-based Target Selection for Blind Touchscreen Users.","authors":"Yu-Jung Ko, Shirin Feiz, I V Ramakrishnan, Aini Putkonen, Yuheng Wang, Antti Oulasvirta, Ali Selman Aydin, Vikas Ashok, Xiaojun Bi","doi":"10.1145/3447526.3472022","DOIUrl":"https://doi.org/10.1145/3447526.3472022","url":null,"abstract":"<p><p>Gliding a finger on touchscreen to reach a target, that is, touch exploration, is a common selection method of blind screen-reader users. This paper investigates their gliding behavior and presents a model for their motor performance. We discovered that the gliding trajectories of blind people are a mixture of two strategies: 1) ballistic movements with iterative corrections relying on non-visual feedback, and 2) multiple sub-movements separated by stops, and concatenated until the target is reached. Based on this finding, we propose the mixture pointing model, a model that relates movement time to distance and width of the target. The model outperforms extant models, improving <i>R</i><sup>2</sup> from 0.65 for Fitts' law to 0.76, and is superior in cross-validation and information criteria. The model advances understanding of gliding-based target selection and serves as a tool for designing interface layouts for screen-reader based touch exploration.</p>","PeriodicalId":74207,"journal":{"name":"MobileHCI : proceedings of the ... International Conference on Human Computer Interaction with Mobile Devices and Services. MobileHCI (Conference)","volume":"2021 ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10404023/pdf/nihms-1777365.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9959628","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"MobileHCI '21: 23rd International Conference on Mobile Human-Computer Interaction, Extented Abstracts, Toulouse & Virtual Event, France, 27 September 2021 - 1 October 2021","authors":"","doi":"10.1145/3447527","DOIUrl":"https://doi.org/10.1145/3447527","url":null,"abstract":"","PeriodicalId":74207,"journal":{"name":"MobileHCI : proceedings of the ... International Conference on Human Computer Interaction with Mobile Devices and Services. MobileHCI (Conference)","volume":"174 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76042842","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Elizabeth L Murnane, Saeed Abdullah, Mark Matthews, Matthew Kay, Julie A Kientz, Tanzeem Choudhury, Geri Gay, Dan Cosley
Our body clock causes considerable variations in our behavioral, mental, and physical processes, including alertness, throughout the day. While much research has studied technology usage patterns, the potential impact of underlying biological processes on these patterns is under-explored. Using data from 20 participants over 40 days, this paper presents the first study to connect patterns of mobile application usage with these contributing biological factors. Among other results, we find that usage patterns vary for individuals with different body clock types, that usage correlates with rhythms of alertness, that app use features such as duration and switching can distinguish periods of low and high alertness, and that app use reflects sleep interruptions as well as sleep duration. We conclude by discussing how our findings inform the design of biologically-friendly technology that can better support personal rhythms of performance.
{"title":"Mobile Manifestations of Alertness: Connecting Biological Rhythms with Patterns of Smartphone App Use.","authors":"Elizabeth L Murnane, Saeed Abdullah, Mark Matthews, Matthew Kay, Julie A Kientz, Tanzeem Choudhury, Geri Gay, Dan Cosley","doi":"10.1145/2935334.2935383","DOIUrl":"https://doi.org/10.1145/2935334.2935383","url":null,"abstract":"<p><p>Our body clock causes considerable variations in our behavioral, mental, and physical processes, including alertness, throughout the day. While much research has studied technology usage patterns, the potential impact of underlying biological processes on these patterns is under-explored. Using data from 20 participants over 40 days, this paper presents the first study to connect patterns of mobile application usage with these contributing biological factors. Among other results, we find that usage patterns vary for individuals with different body clock types, that usage correlates with rhythms of alertness, that app use features such as duration and switching can distinguish periods of low and high alertness, and that app use reflects sleep interruptions as well as sleep duration. We conclude by discussing how our findings inform the design of biologically-friendly technology that can better support personal rhythms of performance.</p>","PeriodicalId":74207,"journal":{"name":"MobileHCI : proceedings of the ... International Conference on Human Computer Interaction with Mobile Devices and Services. MobileHCI (Conference)","volume":"2016 ","pages":"465-477"},"PeriodicalIF":0.0,"publicationDate":"2016-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1145/2935334.2935383","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"37106174","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Present input modality researches for the disable person and the elderly having difficulty in using the mobile interface have less focused on their physical and cognitive context. Therefore, the aim of this research is to develop the general architecture of designing multi-input modality convertor for universal accessibility. It would help determining optimal input modality sets and generating interaction grammars based on divers user's context and mobile circumstance.
{"title":"Designing a multi-input modality architecture for universal accessibility","authors":"Cho In-Kyung","doi":"10.1145/2786567.2786932","DOIUrl":"https://doi.org/10.1145/2786567.2786932","url":null,"abstract":"Present input modality researches for the disable person and the elderly having difficulty in using the mobile interface have less focused on their physical and cognitive context. Therefore, the aim of this research is to develop the general architecture of designing multi-input modality convertor for universal accessibility. It would help determining optimal input modality sets and generating interaction grammars based on divers user's context and mobile circumstance.","PeriodicalId":74207,"journal":{"name":"MobileHCI : proceedings of the ... International Conference on Human Computer Interaction with Mobile Devices and Services. MobileHCI (Conference)","volume":"7 1","pages":"890-891"},"PeriodicalIF":0.0,"publicationDate":"2015-08-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79299618","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
M.W.A. Verstappen, Paula Gardner, D. Poon, Tim Bettridge
This paper describes the research and concept development process involved in designing a mobile app for depressed youth learning to practice mindfulness based psychotherapy entitled Acceptance and Commitment Therapy (ACT) program at Trillium Healthcare Centre in Toronto. Our process involved identifying aspects of preexisting mobile applications for mindfulness that may be discouraging for youth with depression and devising strategies to overcome these negative messages within the ACT Application. We propose to present a working prototype of mobile application at the Mobile HCI conference.
{"title":"Off the couch and out of the hospital, mobile applications for acceptance and commitment therapy","authors":"M.W.A. Verstappen, Paula Gardner, D. Poon, Tim Bettridge","doi":"10.1145/2628363.2633573","DOIUrl":"https://doi.org/10.1145/2628363.2633573","url":null,"abstract":"This paper describes the research and concept development process involved in designing a mobile app for depressed youth learning to practice mindfulness based psychotherapy entitled Acceptance and Commitment Therapy (ACT) program at Trillium Healthcare Centre in Toronto. Our process involved identifying aspects of preexisting mobile applications for mindfulness that may be discouraging for youth with depression and devising strategies to overcome these negative messages within the ACT Application. We propose to present a working prototype of mobile application at the Mobile HCI conference.","PeriodicalId":74207,"journal":{"name":"MobileHCI : proceedings of the ... International Conference on Human Computer Interaction with Mobile Devices and Services. MobileHCI (Conference)","volume":"5 1","pages":"431-434"},"PeriodicalIF":0.0,"publicationDate":"2014-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74501499","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Robert Walter, G. Bailly, Nina Valkanova, Jörg Müller
Most of today's public displays only show predefined contents that passers-by are not able to change. We argue that interactive public displays would benefit from immediately usable mid-air techniques for choosing options, expressing opinions or more generally selecting one among several items. We propose a design space for hand-gesture based mid-air selection techniques on interactive public displays, along with four specific techniques that we evaluated at three different locations in the the field. Our findings include: 1) if no hint is provided, people successfully use Point+Dwell for selecting items, 2) the user representation could be switched from Mirror to Cursor after registration without causing confusion, 3) people tend to explore items before confirming one, 4) in a public context, people frequently interact inadvertently (without looking at the screen). We conclude by providing recommendations for designers of interactive public displays to support immediate usability for mid-air selection.
{"title":"Cuenesics: using mid-air gestures to select items on interactive public displays","authors":"Robert Walter, G. Bailly, Nina Valkanova, Jörg Müller","doi":"10.1145/2628363.2628368","DOIUrl":"https://doi.org/10.1145/2628363.2628368","url":null,"abstract":"Most of today's public displays only show predefined contents that passers-by are not able to change. We argue that interactive public displays would benefit from immediately usable mid-air techniques for choosing options, expressing opinions or more generally selecting one among several items. We propose a design space for hand-gesture based mid-air selection techniques on interactive public displays, along with four specific techniques that we evaluated at three different locations in the the field. Our findings include: 1) if no hint is provided, people successfully use Point+Dwell for selecting items, 2) the user representation could be switched from Mirror to Cursor after registration without causing confusion, 3) people tend to explore items before confirming one, 4) in a public context, people frequently interact inadvertently (without looking at the screen). We conclude by providing recommendations for designers of interactive public displays to support immediate usability for mid-air selection.","PeriodicalId":74207,"journal":{"name":"MobileHCI : proceedings of the ... International Conference on Human Computer Interaction with Mobile Devices and Services. MobileHCI (Conference)","volume":"19 1","pages":"299-308"},"PeriodicalIF":0.0,"publicationDate":"2014-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74892564","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Emerging mobile technologies enable new forms of interaction in the context of our everyday life -- this has profound implications for delivering brain injury rehabilitation at a distance through technology, or cognitive telerehabilitation. However, a challenge lies in designing these technologies, as they require both clinical and technical expertise. This research aims to address this challenge through a co-design approach that brings together mobile technology experts and rehabilitation practitioners.
{"title":"Co-design of cognitive telerehabilitation technologies","authors":"T. How","doi":"10.1145/2628363.2634269","DOIUrl":"https://doi.org/10.1145/2628363.2634269","url":null,"abstract":"Emerging mobile technologies enable new forms of interaction in the context of our everyday life -- this has profound implications for delivering brain injury rehabilitation at a distance through technology, or cognitive telerehabilitation. However, a challenge lies in designing these technologies, as they require both clinical and technical expertise. This research aims to address this challenge through a co-design approach that brings together mobile technology experts and rehabilitation practitioners.","PeriodicalId":74207,"journal":{"name":"MobileHCI : proceedings of the ... International Conference on Human Computer Interaction with Mobile Devices and Services. MobileHCI (Conference)","volume":"65 1","pages":"407-408"},"PeriodicalIF":0.0,"publicationDate":"2014-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"84438632","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The explosion of apps for the medical and wellness sectors has been noted by many. Consumer apps, which provide innovative solutions for self management for a range of health problems have flooded the market, due to high consumer demand. More recently we have seen increased presence of truly medical applications for clinical professionals and patients of serious conditions. In the majority of cases consumer based mHealth apps allow people to do old things in new ways, such as recording health measures digitally rather than on paper. Medical apps, aimed at increasing the quality and efficiency of existing health care delivery models, provide clinical staff with convenient tools and easy to access resources and communication mechanisms. Finally, in rare and exciting cases we are seeing mHealth applications that are doing things in entirely new ways to drive real innovation in health care delivery through mobile devices. This tutorial will inform participants about the breadth of mHealth applications that are transforming the Health Services sector and put forward a strong case for HCI and efficacy research.
{"title":"Mobile health: beyond consumer apps","authors":"J. Freyne","doi":"10.1145/2628363.2645670","DOIUrl":"https://doi.org/10.1145/2628363.2645670","url":null,"abstract":"The explosion of apps for the medical and wellness sectors has been noted by many. Consumer apps, which provide innovative solutions for self management for a range of health problems have flooded the market, due to high consumer demand. More recently we have seen increased presence of truly medical applications for clinical professionals and patients of serious conditions. In the majority of cases consumer based mHealth apps allow people to do old things in new ways, such as recording health measures digitally rather than on paper. Medical apps, aimed at increasing the quality and efficiency of existing health care delivery models, provide clinical staff with convenient tools and easy to access resources and communication mechanisms. Finally, in rare and exciting cases we are seeing mHealth applications that are doing things in entirely new ways to drive real innovation in health care delivery through mobile devices. This tutorial will inform participants about the breadth of mHealth applications that are transforming the Health Services sector and put forward a strong case for HCI and efficacy research.","PeriodicalId":74207,"journal":{"name":"MobileHCI : proceedings of the ... International Conference on Human Computer Interaction with Mobile Devices and Services. MobileHCI (Conference)","volume":"87 1","pages":"565-566"},"PeriodicalIF":0.0,"publicationDate":"2014-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78090263","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Today's reference datasets for conducting text entry experiments are only available in English, which may lead to misleading results when testing text entry methods with non-native English speakers. We compared 3 automated phrase sampling methods available in the literature: Random, Ngram, and MemRep. It was found that MemRep performs best according to a statistical analysis and qualitative observations. This resulted in a collection of 30 datasets across 10 major languages, and we wish to share them with the community via this paper.
{"title":"A systematic comparison of 3 phrase sampling methods for text entry experiments in 10 languages","authors":"Germán Sanchis-Trilles, Luis A. Leiva","doi":"10.1145/2628363.2634229","DOIUrl":"https://doi.org/10.1145/2628363.2634229","url":null,"abstract":"Today's reference datasets for conducting text entry experiments are only available in English, which may lead to misleading results when testing text entry methods with non-native English speakers. We compared 3 automated phrase sampling methods available in the literature: Random, Ngram, and MemRep. It was found that MemRep performs best according to a statistical analysis and qualitative observations. This resulted in a collection of 30 datasets across 10 major languages, and we wish to share them with the community via this paper.","PeriodicalId":74207,"journal":{"name":"MobileHCI : proceedings of the ... International Conference on Human Computer Interaction with Mobile Devices and Services. MobileHCI (Conference)","volume":"31 1","pages":"537-542"},"PeriodicalIF":0.0,"publicationDate":"2014-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80419507","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
James Clawson, Thad Starner, Daniel Kohlsdorf, David P. Quigley, Scott M. Gilliland
Interacting with mobile technology while in-motion has become a daily activity for many of us. Common sense leads one to believe that texting with a mini-qwerty keyboard while mobile can be dangerous since users are distracted and not paying attention to the environment. Previous studies have found that mobility negatively impacts text entry performance for novice participants typing on virtual keyboards on touch screen mobile phones. We investigate the impact of mobility on expert users' ability to quickly and accurately input text on mobile phones equipped with fixed-key mini-qwerty keyboards. In total, 36 participants completed 600 minutes of typing on mini-qwerty keyboards (300 minutes training up to expertise) in three mobility conditions (seated, standing, and walking) generating almost 4,000,000 characters across all conditions. Surprisingly, we found that walking has a significant impact on expert typing speeds but does not significantly impact expert accuracy rates.
{"title":"Texting while walking: an evaluation of mini-qwerty text input while on-the-go","authors":"James Clawson, Thad Starner, Daniel Kohlsdorf, David P. Quigley, Scott M. Gilliland","doi":"10.1145/2628363.2628408","DOIUrl":"https://doi.org/10.1145/2628363.2628408","url":null,"abstract":"Interacting with mobile technology while in-motion has become a daily activity for many of us. Common sense leads one to believe that texting with a mini-qwerty keyboard while mobile can be dangerous since users are distracted and not paying attention to the environment. Previous studies have found that mobility negatively impacts text entry performance for novice participants typing on virtual keyboards on touch screen mobile phones. We investigate the impact of mobility on expert users' ability to quickly and accurately input text on mobile phones equipped with fixed-key mini-qwerty keyboards. In total, 36 participants completed 600 minutes of typing on mini-qwerty keyboards (300 minutes training up to expertise) in three mobility conditions (seated, standing, and walking) generating almost 4,000,000 characters across all conditions. Surprisingly, we found that walking has a significant impact on expert typing speeds but does not significantly impact expert accuracy rates.","PeriodicalId":74207,"journal":{"name":"MobileHCI : proceedings of the ... International Conference on Human Computer Interaction with Mobile Devices and Services. MobileHCI (Conference)","volume":"62 1","pages":"339-348"},"PeriodicalIF":0.0,"publicationDate":"2014-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87049858","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}