Dirk R M Lukkien, Sima Ipakchian Askari, Nathalie E Stolwijk, Bob M Hofstede, Henk Herman Nap, Wouter P C Boon, Alexander Peine, Ellen H M Moors, Mirella M N Minkman
Background: Emerging technologies such as artificial intelligence (AI) require an early-stage assessment of potential societal and ethical implications to increase their acceptability, desirability, and sustainability. This paper explores and compares 2 of these assessment approaches: the responsible innovation (RI) framework originating from technology studies and the co-design approach originating from design studies. While the RI framework has been introduced to guide early-stage technology assessment through anticipation, inclusion, reflexivity, and responsiveness, co-design is a commonly accepted approach in the development of technologies to support the care for older adults with frailty. However, there is limited understanding about how co-design contributes to the anticipation of implications.
Objective: This paper empirically explores how the co-design process of an AI-based decision support system (DSS) for dementia caregivers is complemented by explicit anticipation of implications.
Methods: This case study investigated an international collaborative project that focused on the co-design, development, testing, and commercialization of a DSS that is intended to provide actionable information to formal caregivers of people with dementia. In parallel to the co-design process, an RI exploration took place, which involved examining project members' viewpoints on both positive and negative implications of using the DSS, along with strategies to address these implications. Results from the co-design process and RI exploration were analyzed and compared. In addition, retrospective interviews were held with project members to reflect on the co-design process and RI exploration.
Results: Our results indicate that, when involved in exploring requirements for the DSS, co-design participants naturally raised various implications and conditions for responsible design and deployment: protecting privacy, preventing cognitive overload, providing transparency, empowering caregivers to be in control, safeguarding accuracy, and training users. However, when comparing the co-design results with insights from the RI exploration, we found limitations to the co-design results, for instance, regarding the specification, interrelatedness, and context dependency of implications and strategies to address implications.
Conclusions: This case study shows that a co-design process that focuses on opportunities for innovation rather than balancing attention for both positive and negative implications may result in knowledge gaps related to social and ethical implications and how they can be addressed. In the pursuit of responsible outcomes, co-design facilitators could broaden their scope and reconsider the specific implementation of the process-oriented RI principles of anticipation and inclusion.
背景:人工智能(AI)等新兴技术需要对潜在的社会和伦理影响进行早期评估,以提高其可接受性、可取性和可持续性。本文探讨并比较了其中两种评估方法:源于技术研究的负责任创新(RI)框架和源于设计研究的共同设计方法。负责任创新框架通过预测、包容、反思和响应来指导早期阶段的技术评估,而共同设计则是支持照顾体弱老年人的技术开发中普遍接受的方法。然而,人们对共同设计如何促进预期影响的了解还很有限:本文通过实证研究,探讨了在为痴呆症护理人员开发基于人工智能的决策支持系统(DSS)的共同设计过程中,如何通过对影响的明确预期来进行补充:本案例研究调查了一个国际合作项目,其重点是共同设计、开发、测试和商业化一个旨在为痴呆症患者的正式护理人员提供可操作信息的决策支持系统。在共同设计过程的同时,还开展了一项成果转化探索,其中包括研究项目成员对使用 DSS 的积极和消极影响的看法,以及解决这些影响的策略。对共同设计过程和 RI 探索的结果进行了分析和比较。此外,还对项目成员进行了回顾性访谈,以反思共同设计过程和 RI 探索:结果:我们的研究结果表明,在参与探讨 DSS 需求时,共同设计参与者自然而然地提出了负责任设计和部署的各种影响和条件:保护隐私、防止认知超载、提供透明度、赋予护理人员控制权、保障准确性以及培训用户。然而,在将共同设计的结果与 RI 探索的见解进行比较时,我们发现了共同设计结果的局限性,例如,在影响和解决影响的策略的具体化、相互关联性和上下文依赖性方面:本案例研究表明,共同设计过程如果只关注创新机会,而不平衡对积极和消极影响的关注,可能会造成与社会和道德影响以及如何解决这些影响相关的知识缺口。为了追求负责任的结果,共同设计的促进者可以扩大范围,重新考虑如何具体实施以过程为导向的预期和包容的 RI 原则。
{"title":"Making Co-Design More Responsible: Case Study on the Development of an AI-Based Decision Support System in Dementia Care.","authors":"Dirk R M Lukkien, Sima Ipakchian Askari, Nathalie E Stolwijk, Bob M Hofstede, Henk Herman Nap, Wouter P C Boon, Alexander Peine, Ellen H M Moors, Mirella M N Minkman","doi":"10.2196/55961","DOIUrl":"10.2196/55961","url":null,"abstract":"<p><strong>Background: </strong>Emerging technologies such as artificial intelligence (AI) require an early-stage assessment of potential societal and ethical implications to increase their acceptability, desirability, and sustainability. This paper explores and compares 2 of these assessment approaches: the responsible innovation (RI) framework originating from technology studies and the co-design approach originating from design studies. While the RI framework has been introduced to guide early-stage technology assessment through anticipation, inclusion, reflexivity, and responsiveness, co-design is a commonly accepted approach in the development of technologies to support the care for older adults with frailty. However, there is limited understanding about how co-design contributes to the anticipation of implications.</p><p><strong>Objective: </strong>This paper empirically explores how the co-design process of an AI-based decision support system (DSS) for dementia caregivers is complemented by explicit anticipation of implications.</p><p><strong>Methods: </strong>This case study investigated an international collaborative project that focused on the co-design, development, testing, and commercialization of a DSS that is intended to provide actionable information to formal caregivers of people with dementia. In parallel to the co-design process, an RI exploration took place, which involved examining project members' viewpoints on both positive and negative implications of using the DSS, along with strategies to address these implications. Results from the co-design process and RI exploration were analyzed and compared. In addition, retrospective interviews were held with project members to reflect on the co-design process and RI exploration.</p><p><strong>Results: </strong>Our results indicate that, when involved in exploring requirements for the DSS, co-design participants naturally raised various implications and conditions for responsible design and deployment: protecting privacy, preventing cognitive overload, providing transparency, empowering caregivers to be in control, safeguarding accuracy, and training users. However, when comparing the co-design results with insights from the RI exploration, we found limitations to the co-design results, for instance, regarding the specification, interrelatedness, and context dependency of implications and strategies to address implications.</p><p><strong>Conclusions: </strong>This case study shows that a co-design process that focuses on opportunities for innovation rather than balancing attention for both positive and negative implications may result in knowledge gaps related to social and ethical implications and how they can be addressed. In the pursuit of responsible outcomes, co-design facilitators could broaden their scope and reconsider the specific implementation of the process-oriented RI principles of anticipation and inclusion.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"11 ","pages":"e55961"},"PeriodicalIF":2.6,"publicationDate":"2024-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11325107/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141861144","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Thomas Engelsma, Simone Heijmink, Heleen M A Hendriksen, Leonie N C Visser, Afina W Lemstra, Monique W M Jaspers, Linda W P Peute
Background: Dementia-related impairments can cause complex barriers to access, use, and adopt digital health technologies (DHTs). These barriers can contribute to digital health inequities. Therefore, literature-based design principles called DEMIGNED have been developed to support the design and evaluation of DHTs for this rapidly increasing population.
Objective: This study aims to apply the DEMIGNED principles in usability evaluation methods to (1) capture usability problems on a mobile website providing information resources for people visiting a memory clinic, including those living with subjective cognitive decline (SCD), mild cognitive impairment (MCI), or dementia, and (2) investigate the realness of usability problems captured by the DEMIGNED principles in expert testing, specifically for mobile websites that act as a means of providing DHTs.
Methods: First, a heuristic evaluation was conducted, with the DEMIGNED principles serving as domain-specific guidelines, with 3 double experts (experienced in both usability and dementia) and 2 usability engineering experts. Second, think-aloud sessions were conducted with patients visiting a memory clinic who were living with SCD, MCI, or dementia.
Results: The heuristic evaluation resulted in 36 unique usability problems. A representative sample of 7 people visiting a memory clinic participated in a think-aloud session, including 4 (57%) with SCD, 1 (14%) with MCI, and 2 (29%) with dementia. The analysis of the think-aloud sessions revealed 181 encounters with usability problems. Of these encounters, 144 (79.6%) could be mapped to 18 usability problems identified in the heuristic evaluation. The remaining 37 (20.4%) encounters from the user testing revealed another 10 unique usability problems. Usability problems frequently described in the think-aloud sessions encompassed difficulties with using the search function, discrepancies between the user's expectations and the content organization, the need for scrolling, information overload, and unclear system feedback.
Conclusions: By applying the DEMIGNED principles in expert testing, evaluators were able to capture 79.6% (144/181) of all usability problem encounters in the user testing of a mobile website for people visiting a memory clinic, including people living with dementia. Regarding unique usability problems, 50% (18/36) of the unique usability problems identified during the heuristic evaluation were captured by the user-testing sessions. Future research should look into the applicability of the DEMIGNED principles to other digital health functionalities to increase the accessibility of digital health and decrease digital health inequity for this complex and rapidly increasing population.
{"title":"Capturing Usability Problems for People Living With Dementia by Applying the DEMIGNED Principles in Usability Evaluation Methods: Mixed Methods Study.","authors":"Thomas Engelsma, Simone Heijmink, Heleen M A Hendriksen, Leonie N C Visser, Afina W Lemstra, Monique W M Jaspers, Linda W P Peute","doi":"10.2196/54032","DOIUrl":"10.2196/54032","url":null,"abstract":"<p><strong>Background: </strong>Dementia-related impairments can cause complex barriers to access, use, and adopt digital health technologies (DHTs). These barriers can contribute to digital health inequities. Therefore, literature-based design principles called DEMIGNED have been developed to support the design and evaluation of DHTs for this rapidly increasing population.</p><p><strong>Objective: </strong>This study aims to apply the DEMIGNED principles in usability evaluation methods to (1) capture usability problems on a mobile website providing information resources for people visiting a memory clinic, including those living with subjective cognitive decline (SCD), mild cognitive impairment (MCI), or dementia, and (2) investigate the realness of usability problems captured by the DEMIGNED principles in expert testing, specifically for mobile websites that act as a means of providing DHTs.</p><p><strong>Methods: </strong>First, a heuristic evaluation was conducted, with the DEMIGNED principles serving as domain-specific guidelines, with 3 double experts (experienced in both usability and dementia) and 2 usability engineering experts. Second, think-aloud sessions were conducted with patients visiting a memory clinic who were living with SCD, MCI, or dementia.</p><p><strong>Results: </strong>The heuristic evaluation resulted in 36 unique usability problems. A representative sample of 7 people visiting a memory clinic participated in a think-aloud session, including 4 (57%) with SCD, 1 (14%) with MCI, and 2 (29%) with dementia. The analysis of the think-aloud sessions revealed 181 encounters with usability problems. Of these encounters, 144 (79.6%) could be mapped to 18 usability problems identified in the heuristic evaluation. The remaining 37 (20.4%) encounters from the user testing revealed another 10 unique usability problems. Usability problems frequently described in the think-aloud sessions encompassed difficulties with using the search function, discrepancies between the user's expectations and the content organization, the need for scrolling, information overload, and unclear system feedback.</p><p><strong>Conclusions: </strong>By applying the DEMIGNED principles in expert testing, evaluators were able to capture 79.6% (144/181) of all usability problem encounters in the user testing of a mobile website for people visiting a memory clinic, including people living with dementia. Regarding unique usability problems, 50% (18/36) of the unique usability problems identified during the heuristic evaluation were captured by the user-testing sessions. Future research should look into the applicability of the DEMIGNED principles to other digital health functionalities to increase the accessibility of digital health and decrease digital health inequity for this complex and rapidly increasing population.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"11 ","pages":"e54032"},"PeriodicalIF":2.6,"publicationDate":"2024-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11325128/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141861143","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ahmad Mustafa Al-Aboosi, Siti Norul Huda Sheikh Abdullah, Rozmi Ismail, Khairul Nizam Abdul Maulud, Lutfun Nahar, Khairul Akram Zainol Ariffin, Meng Chun Lam, Muhamad Lazim Bin Talib, Suzaily Wahab, Mahadzir Elias
<p><strong>Background: </strong>The enormous consequences of drugs include suicides, traffic accidents, and violence, affecting the individual, family, society, and country. Therefore, it is necessary to constantly identify and monitor the drug abuse rate among school-going youth. A geospatial dashboard is vital for the monitoring of drug abuse and related crime incidence in a decision support system.</p><p><strong>Objective: </strong>This paper mainly focuses on developing MyAsriGeo, a geospatial drug abuse risk assessment and monitoring dashboard tailored for school students. It introduces innovative functionality, seamlessly orchestrating the assessment of drug abuse usage patterns and risks using multivariate student data.</p><p><strong>Methods: </strong>A geospatial drug abuse dashboard for monitoring and analysis was designed and developed in this study based on agile methodology and prototyping. Using focus group and interviews, we first examined and gathered the requirements, feedback, and user approval of the MyAsriGeo dashboard. Experts and stakeholders such as the National Anti-Drugs Agency, police, the Federal Department of Town and Country Planning, school instructors, students, and researchers were among those who responded. A total of 20 specialists were involved in the requirement analysis and acceptance evaluation of the pilot and final version of the dashboard. The evaluation sought to identify various user acceptance aspects, such as ease of use and usefulness, for both the pilot and final versions, and 2 additional factors based on the Post-Study System Usability Questionnaire and Task-Technology Fit models were enlisted to assess the interface quality and dashboard sufficiency for the final version.</p><p><strong>Results: </strong>The MyAsriGeo geospatial dashboard was designed to meet the needs of all user types, as identified through a requirement gathering process. It includes several key functions, such as a geospatial map that shows the locations of high-risk areas for drug abuse, data on drug abuse among students, tools for assessing the risk of drug abuse in different areas, demographic information, and a self-problem test. It also includes the Alcohol, Smoking, and Substance Involvement Screening Test and its risk assessment to help users understand and interpret the results of student risk. The initial prototype and final version of the dashboard were evaluated by 20 experts, which revealed a significant improvement in the ease of use (P=.047) and usefulness (P=.02) factors and showed a high acceptance mean scores for ease of use (4.2), usefulness (4.46), interface quality (4.29), and sufficiency (4.13).</p><p><strong>Conclusions: </strong>The MyAsriGeo geospatial dashboard is useful for monitoring and analyzing drug abuse among school-going youth in Malaysia. It was developed based on the needs of various stakeholders and includes a range of functions. The dashboard was evaluated by a group of experts. Overall, the
{"title":"A Geospatial Drug Abuse Risk Assessment and Monitoring Dashboard Tailored for School Students: Development Study With Requirement Analysis and Acceptance Evaluation.","authors":"Ahmad Mustafa Al-Aboosi, Siti Norul Huda Sheikh Abdullah, Rozmi Ismail, Khairul Nizam Abdul Maulud, Lutfun Nahar, Khairul Akram Zainol Ariffin, Meng Chun Lam, Muhamad Lazim Bin Talib, Suzaily Wahab, Mahadzir Elias","doi":"10.2196/48139","DOIUrl":"10.2196/48139","url":null,"abstract":"<p><strong>Background: </strong>The enormous consequences of drugs include suicides, traffic accidents, and violence, affecting the individual, family, society, and country. Therefore, it is necessary to constantly identify and monitor the drug abuse rate among school-going youth. A geospatial dashboard is vital for the monitoring of drug abuse and related crime incidence in a decision support system.</p><p><strong>Objective: </strong>This paper mainly focuses on developing MyAsriGeo, a geospatial drug abuse risk assessment and monitoring dashboard tailored for school students. It introduces innovative functionality, seamlessly orchestrating the assessment of drug abuse usage patterns and risks using multivariate student data.</p><p><strong>Methods: </strong>A geospatial drug abuse dashboard for monitoring and analysis was designed and developed in this study based on agile methodology and prototyping. Using focus group and interviews, we first examined and gathered the requirements, feedback, and user approval of the MyAsriGeo dashboard. Experts and stakeholders such as the National Anti-Drugs Agency, police, the Federal Department of Town and Country Planning, school instructors, students, and researchers were among those who responded. A total of 20 specialists were involved in the requirement analysis and acceptance evaluation of the pilot and final version of the dashboard. The evaluation sought to identify various user acceptance aspects, such as ease of use and usefulness, for both the pilot and final versions, and 2 additional factors based on the Post-Study System Usability Questionnaire and Task-Technology Fit models were enlisted to assess the interface quality and dashboard sufficiency for the final version.</p><p><strong>Results: </strong>The MyAsriGeo geospatial dashboard was designed to meet the needs of all user types, as identified through a requirement gathering process. It includes several key functions, such as a geospatial map that shows the locations of high-risk areas for drug abuse, data on drug abuse among students, tools for assessing the risk of drug abuse in different areas, demographic information, and a self-problem test. It also includes the Alcohol, Smoking, and Substance Involvement Screening Test and its risk assessment to help users understand and interpret the results of student risk. The initial prototype and final version of the dashboard were evaluated by 20 experts, which revealed a significant improvement in the ease of use (P=.047) and usefulness (P=.02) factors and showed a high acceptance mean scores for ease of use (4.2), usefulness (4.46), interface quality (4.29), and sufficiency (4.13).</p><p><strong>Conclusions: </strong>The MyAsriGeo geospatial dashboard is useful for monitoring and analyzing drug abuse among school-going youth in Malaysia. It was developed based on the needs of various stakeholders and includes a range of functions. The dashboard was evaluated by a group of experts. Overall, the ","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"11 ","pages":"e48139"},"PeriodicalIF":2.6,"publicationDate":"2024-07-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11322689/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141793737","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Wisse M F van den Beuken, Hans van Schuppen, Derya Demirtas, Vokko P van Halm, Patrick van der Geest, Stephan A Loer, Lothar A Schwarte, Patrick Schober
Background: Out-of-hospital cardiac arrest (OHCA) is a leading cause of mortality in the developed world. Timely detection of cardiac arrest and prompt activation of emergency medical services (EMS) are essential, yet challenging. Automated cardiac arrest detection using sensor signals from smartwatches has the potential to shorten the interval between cardiac arrest and activation of EMS, thereby increasing the likelihood of survival.
Objective: This cross-sectional survey study aims to investigate users' perspectives on aspects of continuous monitoring such as privacy and data protection, as well as other implications, and to collect insights into their attitudes toward the technology.
Methods: We conducted a cross-sectional web-based survey in the Netherlands among 2 groups of potential users of automated cardiac arrest technology: consumers who already own a smartwatch and patients at risk of cardiac arrest. Surveys primarily consisted of closed-ended questions with some additional open-ended questions to provide supplementary insight. The quantitative data were analyzed descriptively, and a content analysis of the open-ended questions was conducted.
Results: In the consumer group (n=1005), 90.2% (n=906; 95% CI 88.1%-91.9%) of participants expressed an interest in the technology, and 89% (n=1196; 95% CI 87.3%-90.7%) of the patient group (n=1344) showed interest. More than 75% (consumer group: n= 756; patient group: n=1004) of the participants in both groups indicated they were willing to use the technology. The main concerns raised by participants regarding the technology included privacy, data protection, reliability, and accessibility.
Conclusions: The vast majority of potential users expressed a strong interest in and positive attitude toward automated cardiac arrest detection using smartwatch technology. However, a number of concerns were identified, which should be addressed in the development and implementation process to optimize acceptance and effectiveness of the technology.
背景:在发达国家,院外心脏骤停(OHCA)是导致死亡的主要原因。及时发现心脏骤停并迅速启动紧急医疗服务(EMS)至关重要,但也极具挑战性。利用智能手表的传感器信号自动检测心脏骤停有可能缩短心脏骤停与启动紧急医疗服务之间的时间间隔,从而提高存活的可能性:本横断面调查研究旨在调查用户对隐私和数据保护等持续监测方面的看法以及其他影响,并收集他们对该技术的态度:我们在荷兰对两类心脏骤停自动监测技术的潜在用户进行了横向网络调查:已拥有智能手表的消费者和有心脏骤停风险的患者。调查主要由封闭式问题和一些开放式问题组成,以提供补充见解。对定量数据进行了描述性分析,并对开放式问题进行了内容分析:在消费者组(人数=1005)中,90.2%(人数=906;95% CI 88.1%-91.9%)的参与者表示对该技术感兴趣;在患者组(人数=1344)中,89%(人数=1196;95% CI 87.3%-90.7%)的参与者表示对该技术感兴趣。两组参与者中均有 75% 以上(消费者组:756 人;患者组:1004 人)表示愿意使用该技术。参与者对该技术提出的主要关切包括隐私、数据保护、可靠性和可访问性:绝大多数潜在用户对使用智能手表技术进行心脏骤停自动检测表示出浓厚的兴趣和积极的态度。但也发现了一些问题,应在开发和实施过程中加以解决,以优化该技术的接受度和有效性。
{"title":"Investigating Users' Attitudes Toward Automated Smartwatch Cardiac Arrest Detection: Cross-Sectional Survey Study.","authors":"Wisse M F van den Beuken, Hans van Schuppen, Derya Demirtas, Vokko P van Halm, Patrick van der Geest, Stephan A Loer, Lothar A Schwarte, Patrick Schober","doi":"10.2196/57574","DOIUrl":"10.2196/57574","url":null,"abstract":"<p><strong>Background: </strong>Out-of-hospital cardiac arrest (OHCA) is a leading cause of mortality in the developed world. Timely detection of cardiac arrest and prompt activation of emergency medical services (EMS) are essential, yet challenging. Automated cardiac arrest detection using sensor signals from smartwatches has the potential to shorten the interval between cardiac arrest and activation of EMS, thereby increasing the likelihood of survival.</p><p><strong>Objective: </strong>This cross-sectional survey study aims to investigate users' perspectives on aspects of continuous monitoring such as privacy and data protection, as well as other implications, and to collect insights into their attitudes toward the technology.</p><p><strong>Methods: </strong>We conducted a cross-sectional web-based survey in the Netherlands among 2 groups of potential users of automated cardiac arrest technology: consumers who already own a smartwatch and patients at risk of cardiac arrest. Surveys primarily consisted of closed-ended questions with some additional open-ended questions to provide supplementary insight. The quantitative data were analyzed descriptively, and a content analysis of the open-ended questions was conducted.</p><p><strong>Results: </strong>In the consumer group (n=1005), 90.2% (n=906; 95% CI 88.1%-91.9%) of participants expressed an interest in the technology, and 89% (n=1196; 95% CI 87.3%-90.7%) of the patient group (n=1344) showed interest. More than 75% (consumer group: n= 756; patient group: n=1004) of the participants in both groups indicated they were willing to use the technology. The main concerns raised by participants regarding the technology included privacy, data protection, reliability, and accessibility.</p><p><strong>Conclusions: </strong>The vast majority of potential users expressed a strong interest in and positive attitude toward automated cardiac arrest detection using smartwatch technology. However, a number of concerns were identified, which should be addressed in the development and implementation process to optimize acceptance and effectiveness of the technology.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"11 ","pages":"e57574"},"PeriodicalIF":2.6,"publicationDate":"2024-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11292589/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141761460","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Philip Fei Wu, Charlotte Summers, Arjun Panesar, Amit Kaura, Li Zhang
Background: Artificial intelligence (AI) chatbots have the potential to assist individuals with chronic health conditions by providing tailored information, monitoring symptoms, and offering mental health support. Despite their potential benefits, research on public attitudes toward health care chatbots is still limited. To effectively support individuals with long-term health conditions like long COVID (or post-COVID-19 condition), it is crucial to understand their perspectives and preferences regarding the use of AI chatbots.
Objective: This study has two main objectives: (1) provide insights into AI chatbot acceptance among people with chronic health conditions, particularly adults older than 55 years and (2) explore the perceptions of using AI chatbots for health self-management and long COVID support.
Methods: A web-based survey study was conducted between January and March 2023, specifically targeting individuals with diabetes and other chronic conditions. This particular population was chosen due to their potential awareness and ability to self-manage their condition. The survey aimed to capture data at multiple intervals, taking into consideration the public launch of ChatGPT, which could have potentially impacted public opinions during the project timeline. The survey received 1310 clicks and garnered 900 responses, resulting in a total of 888 usable data points.
Results: Although past experience with chatbots (P<.001, 95% CI .110-.302) and online information seeking (P<.001, 95% CI .039-.084) are strong indicators of respondents' future adoption of health chatbots, they are in general skeptical or unsure about the use of AI chatbots for health care purposes. Less than one-third of the respondents (n=203, 30.1%) indicated that they were likely to use a health chatbot in the next 12 months if available. Most were uncertain about a chatbot's capability to provide accurate medical advice. However, people seemed more receptive to using voice-based chatbots for mental well-being, health data collection, and analysis. Half of the respondents with long COVID showed interest in using emotionally intelligent chatbots.
Conclusions: AI hesitancy is not uniform across all health domains and user groups. Despite persistent AI hesitancy, there are promising opportunities for chatbots to offer support for chronic conditions in areas of lifestyle enhancement and mental well-being, potentially through voice-based user interfaces.
{"title":"AI Hesitancy and Acceptability-Perceptions of AI Chatbots for Chronic Health Management and Long COVID Support: Survey Study.","authors":"Philip Fei Wu, Charlotte Summers, Arjun Panesar, Amit Kaura, Li Zhang","doi":"10.2196/51086","DOIUrl":"10.2196/51086","url":null,"abstract":"<p><strong>Background: </strong>Artificial intelligence (AI) chatbots have the potential to assist individuals with chronic health conditions by providing tailored information, monitoring symptoms, and offering mental health support. Despite their potential benefits, research on public attitudes toward health care chatbots is still limited. To effectively support individuals with long-term health conditions like long COVID (or post-COVID-19 condition), it is crucial to understand their perspectives and preferences regarding the use of AI chatbots.</p><p><strong>Objective: </strong>This study has two main objectives: (1) provide insights into AI chatbot acceptance among people with chronic health conditions, particularly adults older than 55 years and (2) explore the perceptions of using AI chatbots for health self-management and long COVID support.</p><p><strong>Methods: </strong>A web-based survey study was conducted between January and March 2023, specifically targeting individuals with diabetes and other chronic conditions. This particular population was chosen due to their potential awareness and ability to self-manage their condition. The survey aimed to capture data at multiple intervals, taking into consideration the public launch of ChatGPT, which could have potentially impacted public opinions during the project timeline. The survey received 1310 clicks and garnered 900 responses, resulting in a total of 888 usable data points.</p><p><strong>Results: </strong>Although past experience with chatbots (P<.001, 95% CI .110-.302) and online information seeking (P<.001, 95% CI .039-.084) are strong indicators of respondents' future adoption of health chatbots, they are in general skeptical or unsure about the use of AI chatbots for health care purposes. Less than one-third of the respondents (n=203, 30.1%) indicated that they were likely to use a health chatbot in the next 12 months if available. Most were uncertain about a chatbot's capability to provide accurate medical advice. However, people seemed more receptive to using voice-based chatbots for mental well-being, health data collection, and analysis. Half of the respondents with long COVID showed interest in using emotionally intelligent chatbots.</p><p><strong>Conclusions: </strong>AI hesitancy is not uniform across all health domains and user groups. Despite persistent AI hesitancy, there are promising opportunities for chatbots to offer support for chronic conditions in areas of lifestyle enhancement and mental well-being, potentially through voice-based user interfaces.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"11 ","pages":"e51086"},"PeriodicalIF":2.6,"publicationDate":"2024-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11287232/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141753022","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Chung Lam Leung, Jason Alacapa, Bianca Gonçalves Tasca, Andre Daniel Villanueva, Saniata Masulit, Marvin Louie Ignacio, Kathleen Nicole Uy, Christopher Pell, Kristian van Kalmthout, Rachel Powers, Katherine Fielding, Degu Jerene
<p><strong>Background: </strong>Digital adherence technologies (DATs) are being studied to determine their potential to support tuberculosis (TB) treatment and address the shortcomings of directly observed therapy. Previous research has shown inconclusive results on whether DATs can enhance medication adherence among persons with TB.</p><p><strong>Objective: </strong>This study aims to understand the acceptability of DATs, namely, medication labels and smart pillboxes, among persons with TB, health care workers (HCWs), and key informants (KIs) in the Philippines. The objective is to gain valuable insights that can inform the design and implementation of DATs in the Southeast Asian region, which meet the needs and preferences of end users.</p><p><strong>Methods: </strong>Persons with TB, HCWs, and KIs were recruited from intervention facilities to participate in in-depth interviews conducted between March 2022 and January 2023. These interviews were transcribed and translated into English. A thematic analysis was carried out using NVivo software (Lumivero) to identify and analyze themes. Themes were then structured within a modified social-ecological model.</p><p><strong>Results: </strong>A total of 25 persons with drug-sensitive TB and 20 HCWs or KIs were interviewed. Both groups emphasized that users' technology literacy level, financial conditions, and motivation to be cured determined how they interacted with the DAT. They also acknowledged that DATs helped foster their relationship with HCWs and enabled efficient treatment support. Concerning technology, persons with TB found DATs easy to use and able to reduce clinic visits. HCWs mentioned that DATs added to their workload but also allowed them to support users who missed doses. However, both groups experienced technical challenges with DATs. Regarding program implementation, users appreciated the clear explanations and demonstrations provided by HCWs. Yet, some users reported inconsistencies between DAT settings and the information provided. HCWs stressed the importance of comprehensive training and sufficient resources for effective program implementation in the future. At the community level, both groups noted that DATs and program design protected users' privacy and reduced the risk of stigma. Finally, users and HCWs shared various contextual factors that influenced their experience with DAT, including infrastructure challenges and the impact of the COVID-19 pandemic.</p><p><strong>Conclusions: </strong>In the Philippines, persons with TB and HCWs showed a high level of acceptance and satisfaction with the impact of DAT and program design. They expressed a desire for the continuation of DATs. The challenges encountered underscore the need for ongoing technological development to minimize malfunctions, enhance the capacity of health facilities, and improve infrastructure. DATs have demonstrated their ability to strengthen user-HCW relationships and protect users from stigmatization. Addit
背景:目前正在研究数字依从性技术(DATs),以确定其支持结核病(TB)治疗的潜力,并解决直接观察疗法的不足之处。以往的研究表明,数字依从性技术能否提高肺结核患者的服药依从性尚无定论:本研究旨在了解菲律宾肺结核患者、医护人员(HCWs)和关键信息提供者(KIs)对 DATs(即药物标签和智能药盒)的接受程度。目的是获得有价值的见解,为东南亚地区设计和实施符合终端用户需求和偏好的 DATs 提供参考:方法:在 2022 年 3 月至 2023 年 1 月期间,从干预设施中招募肺结核患者、HCW 和 KI 参与深入访谈。这些访谈均已誊写并翻译成英文。使用 NVivo 软件(Lumivero)进行了主题分析,以确定和分析主题。然后根据修改后的社会生态模型对主题进行结构化处理:共采访了 25 名药物敏感型肺结核患者和 20 名医护人员或 KI。两组人都强调,用户的技术知识水平、经济条件和治愈动机决定了他们与 DAT 的互动方式。他们还承认 DAT 有助于促进他们与医护人员之间的关系,并能提供高效的治疗支持。在技术方面,肺结核患者认为 DAT 易于使用,能够减少就诊次数。医护人员提到 DAT 增加了他们的工作量,但也使他们能够为错过服药时间的患者提供支持。不过,这两类人在使用 DAT 时都遇到了技术挑战。在项目实施方面,用户对医护人员提供的清晰解释和示范表示赞赏。然而,一些用户反映 DAT 设置与所提供的信息不一致。医护人员强调了全面培训和充足资源对今后有效实施计划的重要性。在社区层面,两个群体都注意到 DAT 和项目设计保护了使用者的隐私并降低了污名化的风险。最后,使用者和医护人员分享了影响他们使用 DAT 的各种背景因素,包括基础设施挑战和 COVID-19 大流行的影响:在菲律宾,肺结核患者和医护人员对 DAT 的影响和项目设计表现出高度的接受度和满意度。他们表达了继续开展 DAT 的愿望。所遇到的挑战突出表明,需要不断进行技术开发,以最大限度地减少故障、提高医疗机构的能力并改善基础设施。数据采集器已证明其有能力加强用户与保健工作者之间的关系,并保护用户免受污名化。要在菲律宾推广 DAT 计划,还需要做出更多努力。
{"title":"Digital Adherence Technologies and Differentiated Care for Tuberculosis Treatment and Their Acceptability Among Persons With Tuberculosis, Health Care Workers, and Key Informants in the Philippines: Qualitative Interview Study.","authors":"Chung Lam Leung, Jason Alacapa, Bianca Gonçalves Tasca, Andre Daniel Villanueva, Saniata Masulit, Marvin Louie Ignacio, Kathleen Nicole Uy, Christopher Pell, Kristian van Kalmthout, Rachel Powers, Katherine Fielding, Degu Jerene","doi":"10.2196/54117","DOIUrl":"10.2196/54117","url":null,"abstract":"<p><strong>Background: </strong>Digital adherence technologies (DATs) are being studied to determine their potential to support tuberculosis (TB) treatment and address the shortcomings of directly observed therapy. Previous research has shown inconclusive results on whether DATs can enhance medication adherence among persons with TB.</p><p><strong>Objective: </strong>This study aims to understand the acceptability of DATs, namely, medication labels and smart pillboxes, among persons with TB, health care workers (HCWs), and key informants (KIs) in the Philippines. The objective is to gain valuable insights that can inform the design and implementation of DATs in the Southeast Asian region, which meet the needs and preferences of end users.</p><p><strong>Methods: </strong>Persons with TB, HCWs, and KIs were recruited from intervention facilities to participate in in-depth interviews conducted between March 2022 and January 2023. These interviews were transcribed and translated into English. A thematic analysis was carried out using NVivo software (Lumivero) to identify and analyze themes. Themes were then structured within a modified social-ecological model.</p><p><strong>Results: </strong>A total of 25 persons with drug-sensitive TB and 20 HCWs or KIs were interviewed. Both groups emphasized that users' technology literacy level, financial conditions, and motivation to be cured determined how they interacted with the DAT. They also acknowledged that DATs helped foster their relationship with HCWs and enabled efficient treatment support. Concerning technology, persons with TB found DATs easy to use and able to reduce clinic visits. HCWs mentioned that DATs added to their workload but also allowed them to support users who missed doses. However, both groups experienced technical challenges with DATs. Regarding program implementation, users appreciated the clear explanations and demonstrations provided by HCWs. Yet, some users reported inconsistencies between DAT settings and the information provided. HCWs stressed the importance of comprehensive training and sufficient resources for effective program implementation in the future. At the community level, both groups noted that DATs and program design protected users' privacy and reduced the risk of stigma. Finally, users and HCWs shared various contextual factors that influenced their experience with DAT, including infrastructure challenges and the impact of the COVID-19 pandemic.</p><p><strong>Conclusions: </strong>In the Philippines, persons with TB and HCWs showed a high level of acceptance and satisfaction with the impact of DAT and program design. They expressed a desire for the continuation of DATs. The challenges encountered underscore the need for ongoing technological development to minimize malfunctions, enhance the capacity of health facilities, and improve infrastructure. DATs have demonstrated their ability to strengthen user-HCW relationships and protect users from stigmatization. Addit","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"11 ","pages":"e54117"},"PeriodicalIF":2.6,"publicationDate":"2024-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11303897/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141753023","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Background: Technology has significantly reshaped the landscape and accessibility of gambling, creating uncharted territory for researchers and policy makers involved in the responsible gambling (RG) agenda. Digital payment solutions (DPS) are the latest addition of technology-based services in gambling and are now prominently used for deposit and win withdrawal. The seamless collaboration between online gambling operators and DPS, however, has raised concerns regarding the potential role of DPS platforms in facilitating harmful behavior.
Objective: Using a focus group session with problem gamblers, this study describes a preliminary investigation of the role of DPS in the online gambling context and its influence on players' gambling habits, financial behavior, choices of gambling environment, and the overall outcome of gambling subjective experiences.
Methods: A total of 6 problem gamblers participated in a one-and-half-hour focus group session to discuss how DPSs are integrated into their everyday gambling habits, what motivates them to use DPS, and what shifts they observe in their gambling behavior. Thematic analysis was used to analyze the empirical evidence with a mix of inductive and deductive research approaches as a knowledge claim strategy.
Results: Our initial findings revealed that the influence of DPSs in online gambling is multifaced where, on the one hand, their ability to integrate with players' existing habits seamlessly underscores the facilitating role they play in potentially maximizing harm. On the other hand, we find preliminary evidence that DPSs can have a direct influence on gambling outcomes in both subtle and pervasive ways-nudging, institutionalizing, constraining, or triggering players' gambling activities. This study also highlights the increasingly interdisciplinary nature of online gambling, and it proposes a preliminary conceptual framework to illustrate the sociotechnical interplay between DPS and gambling habits that ultimately capture the outcome of gambling's subjective experience.
Conclusions: Disguised as a passive payment enabler, the role of DPS has so far received scant attention; however, this exploratory qualitative study demonstrates that given the technological advantage and access to customer financial data, DPS can become a potent platform to enable and at times trigger harmful gambling. In addition, DPS's bird's-eye view of cross-operator gambling behavior can open up an opportunity for researchers and policy makers to explore harm reduction measures that can be implemented at the digital payment level for gambling customers. Finally, more interdisciplinary studies are needed to formulate the sociotechnical nature of online gambling and holistic harm minimization strategy.
{"title":"Probing the Role of Digital Payment Solutions in Gambling Behavior: Preliminary Results From an Exploratory Focus Group Session With Problem Gamblers.","authors":"Nathan Lakew, Jakob Jonsson, Philip Lindner","doi":"10.2196/54951","DOIUrl":"10.2196/54951","url":null,"abstract":"<p><strong>Background: </strong>Technology has significantly reshaped the landscape and accessibility of gambling, creating uncharted territory for researchers and policy makers involved in the responsible gambling (RG) agenda. Digital payment solutions (DPS) are the latest addition of technology-based services in gambling and are now prominently used for deposit and win withdrawal. The seamless collaboration between online gambling operators and DPS, however, has raised concerns regarding the potential role of DPS platforms in facilitating harmful behavior.</p><p><strong>Objective: </strong>Using a focus group session with problem gamblers, this study describes a preliminary investigation of the role of DPS in the online gambling context and its influence on players' gambling habits, financial behavior, choices of gambling environment, and the overall outcome of gambling subjective experiences.</p><p><strong>Methods: </strong>A total of 6 problem gamblers participated in a one-and-half-hour focus group session to discuss how DPSs are integrated into their everyday gambling habits, what motivates them to use DPS, and what shifts they observe in their gambling behavior. Thematic analysis was used to analyze the empirical evidence with a mix of inductive and deductive research approaches as a knowledge claim strategy.</p><p><strong>Results: </strong>Our initial findings revealed that the influence of DPSs in online gambling is multifaced where, on the one hand, their ability to integrate with players' existing habits seamlessly underscores the facilitating role they play in potentially maximizing harm. On the other hand, we find preliminary evidence that DPSs can have a direct influence on gambling outcomes in both subtle and pervasive ways-nudging, institutionalizing, constraining, or triggering players' gambling activities. This study also highlights the increasingly interdisciplinary nature of online gambling, and it proposes a preliminary conceptual framework to illustrate the sociotechnical interplay between DPS and gambling habits that ultimately capture the outcome of gambling's subjective experience.</p><p><strong>Conclusions: </strong>Disguised as a passive payment enabler, the role of DPS has so far received scant attention; however, this exploratory qualitative study demonstrates that given the technological advantage and access to customer financial data, DPS can become a potent platform to enable and at times trigger harmful gambling. In addition, DPS's bird's-eye view of cross-operator gambling behavior can open up an opportunity for researchers and policy makers to explore harm reduction measures that can be implemented at the digital payment level for gambling customers. Finally, more interdisciplinary studies are needed to formulate the sociotechnical nature of online gambling and holistic harm minimization strategy.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"11 ","pages":"e54951"},"PeriodicalIF":2.6,"publicationDate":"2024-07-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11303895/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141749214","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Emre Sezgin, A Baki Kocaballi, Millie Dolce, Micah Skeens, Lisa Militello, Yungui Huang, Jack Stevens, Alex R Kemper
Background: Health outcomes are significantly influenced by unmet social needs. Although screening for social needs has become common in health care settings, there is often poor linkage to resources after needs are identified. The structural barriers (eg, staffing, time, and space) to helping address social needs could be overcome by a technology-based solution.
Objective: This study aims to present the design and evaluation of a chatbot, DAPHNE (Dialog-Based Assistant Platform for Healthcare and Needs Ecosystem), which screens for social needs and links patients and families to resources.
Methods: This research used a three-stage study approach: (1) an end-user survey to understand unmet needs and perception toward chatbots, (2) iterative design with interdisciplinary stakeholder groups, and (3) a feasibility and usability assessment. In study 1, a web-based survey was conducted with low-income US resident households (n=201). Following that, in study 2, web-based sessions were held with an interdisciplinary group of stakeholders (n=10) using thematic and content analysis to inform the chatbot's design and development. Finally, in study 3, the assessment on feasibility and usability was completed via a mix of a web-based survey and focus group interviews following scenario-based usability testing with community health workers (family advocates; n=4) and social workers (n=9). We reported descriptive statistics and chi-square test results for the household survey. Content analysis and thematic analysis were used to analyze qualitative data. Usability score was descriptively reported.
Results: Among the survey participants, employed and younger individuals reported a higher likelihood of using a chatbot to address social needs, in contrast to the oldest age group. Regarding designing the chatbot, the stakeholders emphasized the importance of provider-technology collaboration, inclusive conversational design, and user education. The participants found that the chatbot's capabilities met expectations and that the chatbot was easy to use (System Usability Scale score=72/100). However, there were common concerns about the accuracy of suggested resources, electronic health record integration, and trust with a chatbot.
Conclusions: Chatbots can provide personalized feedback for families to identify and meet social needs. Our study highlights the importance of user-centered iterative design and development of chatbots for social needs. Future research should examine the efficacy, cost-effectiveness, and scalability of chatbot interventions to address social needs.
{"title":"Chatbot for Social Need Screening and Resource Sharing With Vulnerable Families: Iterative Design and Evaluation Study.","authors":"Emre Sezgin, A Baki Kocaballi, Millie Dolce, Micah Skeens, Lisa Militello, Yungui Huang, Jack Stevens, Alex R Kemper","doi":"10.2196/57114","DOIUrl":"10.2196/57114","url":null,"abstract":"<p><strong>Background: </strong>Health outcomes are significantly influenced by unmet social needs. Although screening for social needs has become common in health care settings, there is often poor linkage to resources after needs are identified. The structural barriers (eg, staffing, time, and space) to helping address social needs could be overcome by a technology-based solution.</p><p><strong>Objective: </strong>This study aims to present the design and evaluation of a chatbot, DAPHNE (Dialog-Based Assistant Platform for Healthcare and Needs Ecosystem), which screens for social needs and links patients and families to resources.</p><p><strong>Methods: </strong>This research used a three-stage study approach: (1) an end-user survey to understand unmet needs and perception toward chatbots, (2) iterative design with interdisciplinary stakeholder groups, and (3) a feasibility and usability assessment. In study 1, a web-based survey was conducted with low-income US resident households (n=201). Following that, in study 2, web-based sessions were held with an interdisciplinary group of stakeholders (n=10) using thematic and content analysis to inform the chatbot's design and development. Finally, in study 3, the assessment on feasibility and usability was completed via a mix of a web-based survey and focus group interviews following scenario-based usability testing with community health workers (family advocates; n=4) and social workers (n=9). We reported descriptive statistics and chi-square test results for the household survey. Content analysis and thematic analysis were used to analyze qualitative data. Usability score was descriptively reported.</p><p><strong>Results: </strong>Among the survey participants, employed and younger individuals reported a higher likelihood of using a chatbot to address social needs, in contrast to the oldest age group. Regarding designing the chatbot, the stakeholders emphasized the importance of provider-technology collaboration, inclusive conversational design, and user education. The participants found that the chatbot's capabilities met expectations and that the chatbot was easy to use (System Usability Scale score=72/100). However, there were common concerns about the accuracy of suggested resources, electronic health record integration, and trust with a chatbot.</p><p><strong>Conclusions: </strong>Chatbots can provide personalized feedback for families to identify and meet social needs. Our study highlights the importance of user-centered iterative design and development of chatbots for social needs. Future research should examine the efficacy, cost-effectiveness, and scalability of chatbot interventions to address social needs.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"11 ","pages":"e57114"},"PeriodicalIF":2.6,"publicationDate":"2024-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11297373/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141727842","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Rebecca E Hasson, Michelle Xie, Dhiraj Tadikamalla, Lexie R Beemer
Background: Web-based physical activity interventions often fail to reach the anticipated public health impact due to insufficient use by the intended audiences.
Objective: The purpose of this study was to use a human-centered design process to optimize the user experience of the Interrupting Prolonged sitting with ACTivity (InPACT) at Home website to promote youth physical activity participation.
Methods: Qualitative interviews were conducted to assess engagement and pain points with the InPACT at Home website. Interview data were used to create affinity maps to identify themes of user responses, conduct a heuristic evaluation according to Nielsen's usability heuristics framework, and complete a competitive analysis to identify the strengths and weaknesses of competitors who offered similar products.
Results: Key themes from end user interviews included liking the website design, finding the website difficult to navigate, and wanting additional features (eg, library of watched videos). The website usability issues identified were lack of labeling and categorization of exercise videos, hidden necessary actions and options hindering users from decision-making, error-prone conditions, and high cognitive load of the website. Competitive analysis results revealed that YouTube received the highest usability ratings followed by the Just Dance and Presidential Youth Fitness Program websites.
Conclusions: Human-centered design approaches are useful for bringing end users and developers together to optimize user experience and impact public health. Future research is needed to examine the effectiveness of the InPACT at Home website redesign to attract new users and retain current users, with the end goal of increasing youth physical activity engagement.
背景基于网络的体育锻炼干预措施往往由于目标受众使用不足而达不到预期的公共健康效果:本研究的目的是采用以人为本的设计流程,优化 "在家通过行动中断久坐"(Interrupting Prolonged sitting with ACTivity,InPACT)网站的用户体验,以促进青少年参与体育活动:方法:我们进行了定性访谈,以评估用户对 "InPACT at Home "网站的参与度和痛点。访谈数据被用来创建亲和图以确定用户反应的主题,根据尼尔森的可用性启发式框架进行启发式评估,并完成竞争分析以确定提供类似产品的竞争对手的优势和劣势:最终用户访谈的关键主题包括:喜欢网站设计、发现网站难以浏览以及希望获得更多功能(如观看过的视频库)。发现的网站可用性问题包括:缺乏对练习视频的标注和分类;隐藏的必要操作和选项阻碍了用户做出决策;容易出错;网站认知负荷高。竞争分析结果显示,YouTube 的可用性评分最高,其次是 Just Dance 和总统青年健身计划网站:结论:以人为本的设计方法有助于将最终用户和开发人员聚集在一起,优化用户体验并影响公众健康。今后需要开展研究,考察重新设计的 "InPACT at Home "网站在吸引新用户和留住现有用户方面的有效性,以实现提高青少年体育活动参与度的最终目标。
{"title":"Using a Human-Centered Design Process to Evaluate and Optimize User Experience of a Website (InPACT at Home) to Promote Youth Physical Activity: Case Study.","authors":"Rebecca E Hasson, Michelle Xie, Dhiraj Tadikamalla, Lexie R Beemer","doi":"10.2196/52496","DOIUrl":"10.2196/52496","url":null,"abstract":"<p><strong>Background: </strong>Web-based physical activity interventions often fail to reach the anticipated public health impact due to insufficient use by the intended audiences.</p><p><strong>Objective: </strong>The purpose of this study was to use a human-centered design process to optimize the user experience of the Interrupting Prolonged sitting with ACTivity (InPACT) at Home website to promote youth physical activity participation.</p><p><strong>Methods: </strong>Qualitative interviews were conducted to assess engagement and pain points with the InPACT at Home website. Interview data were used to create affinity maps to identify themes of user responses, conduct a heuristic evaluation according to Nielsen's usability heuristics framework, and complete a competitive analysis to identify the strengths and weaknesses of competitors who offered similar products.</p><p><strong>Results: </strong>Key themes from end user interviews included liking the website design, finding the website difficult to navigate, and wanting additional features (eg, library of watched videos). The website usability issues identified were lack of labeling and categorization of exercise videos, hidden necessary actions and options hindering users from decision-making, error-prone conditions, and high cognitive load of the website. Competitive analysis results revealed that YouTube received the highest usability ratings followed by the Just Dance and Presidential Youth Fitness Program websites.</p><p><strong>Conclusions: </strong>Human-centered design approaches are useful for bringing end users and developers together to optimize user experience and impact public health. Future research is needed to examine the effectiveness of the InPACT at Home website redesign to attract new users and retain current users, with the end goal of increasing youth physical activity engagement.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"11 ","pages":"e52496"},"PeriodicalIF":2.6,"publicationDate":"2024-07-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11261907/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141735241","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Anna Marcuzzi, Nina Elisabeth Klevanger, Lene Aasdahl, Sigmund Gismervik, Kerstin Bach, Paul Jarle Mork, Anne Lovise Nordstoga
Background: Self-management is endorsed in clinical practice guidelines for the care of musculoskeletal pain. In a randomized clinical trial, we tested the effectiveness of an artificial intelligence-based self-management app (selfBACK) as an adjunct to usual care for patients with low back and neck pain referred to specialist care.
Objective: This study is a process evaluation aiming to explore patients' engagement and experiences with the selfBACK app and specialist health care practitioners' views on adopting digital self-management tools in their clinical practice.
Methods: App usage analytics in the first 12 weeks were used to explore patients' engagement with the SELFBACK app. Among the 99 patients allocated to the SELFBACK interventions, a purposive sample of 11 patients (aged 27-75 years, 8 female) was selected for semistructured individual interviews based on app usage. Two focus group interviews were conducted with specialist health care practitioners (n=9). Interviews were analyzed using thematic analysis.
Results: Nearly one-third of patients never accessed the app, and one-third were low users. Three themes were identified from interviews with patients and health care practitioners: (1) overall impression of the app, where patients discussed the interface and content of the app, reported on usability issues, and described their app usage; (2) perceived value of the app, where patients and health care practitioners described the primary value of the app and its potential to supplement usual care; and (3) suggestions for future use, where patients and health care practitioners addressed aspects they believed would determine acceptance.
Conclusions: Although the app's uptake was relatively low, both patients and health care practitioners had a positive opinion about adopting an app-based self-management intervention for low back and neck pain as an add-on to usual care. Both described that the app could reassure patients by providing trustworthy information, thus empowering them to take actions on their own. Factors influencing app acceptance and engagement, such as content relevance, tailoring, trust, and usability properties, were identified.
{"title":"An Artificial Intelligence-Based App for Self-Management of Low Back and Neck Pain in Specialist Care: Process Evaluation From a Randomized Clinical Trial.","authors":"Anna Marcuzzi, Nina Elisabeth Klevanger, Lene Aasdahl, Sigmund Gismervik, Kerstin Bach, Paul Jarle Mork, Anne Lovise Nordstoga","doi":"10.2196/55716","DOIUrl":"10.2196/55716","url":null,"abstract":"<p><strong>Background: </strong>Self-management is endorsed in clinical practice guidelines for the care of musculoskeletal pain. In a randomized clinical trial, we tested the effectiveness of an artificial intelligence-based self-management app (selfBACK) as an adjunct to usual care for patients with low back and neck pain referred to specialist care.</p><p><strong>Objective: </strong>This study is a process evaluation aiming to explore patients' engagement and experiences with the selfBACK app and specialist health care practitioners' views on adopting digital self-management tools in their clinical practice.</p><p><strong>Methods: </strong>App usage analytics in the first 12 weeks were used to explore patients' engagement with the SELFBACK app. Among the 99 patients allocated to the SELFBACK interventions, a purposive sample of 11 patients (aged 27-75 years, 8 female) was selected for semistructured individual interviews based on app usage. Two focus group interviews were conducted with specialist health care practitioners (n=9). Interviews were analyzed using thematic analysis.</p><p><strong>Results: </strong>Nearly one-third of patients never accessed the app, and one-third were low users. Three themes were identified from interviews with patients and health care practitioners: (1) overall impression of the app, where patients discussed the interface and content of the app, reported on usability issues, and described their app usage; (2) perceived value of the app, where patients and health care practitioners described the primary value of the app and its potential to supplement usual care; and (3) suggestions for future use, where patients and health care practitioners addressed aspects they believed would determine acceptance.</p><p><strong>Conclusions: </strong>Although the app's uptake was relatively low, both patients and health care practitioners had a positive opinion about adopting an app-based self-management intervention for low back and neck pain as an add-on to usual care. Both described that the app could reassure patients by providing trustworthy information, thus empowering them to take actions on their own. Factors influencing app acceptance and engagement, such as content relevance, tailoring, trust, and usability properties, were identified.</p><p><strong>Trial registration: </strong>ClinicalTrials.gov NCT04463043; https://clinicaltrials.gov/study/NCT04463043.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"11 ","pages":"e55716"},"PeriodicalIF":2.6,"publicationDate":"2024-07-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11267091/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141559910","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}