Nyi Nyi Soe, Phyu Mon Latt, Alicia King, David Lee, Tiffany R Phillips, Christopher K Fairley, Lei Zhang, Jason J Ong
{"title":"What Do People Want from an AI-Assisted Screening App for Sexually Transmitted Infection-Related Anogenital Lesions: A Discrete Choice Experiment.","authors":"Nyi Nyi Soe, Phyu Mon Latt, Alicia King, David Lee, Tiffany R Phillips, Christopher K Fairley, Lei Zhang, Jason J Ong","doi":"10.1007/s40271-024-00720-8","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>One of the World Health Organization (WHO) recommendations to achieve its global targets for sexually transmitted infections (STIs) is the increased use of digital technologies. Melbourne Sexual Health Centre (MSHC) has developed an AI-assisted screening application (app) called AiSTi for the detection of common STI-related anogenital skin conditions. This study aims to understand the community's preference for using the AiSTi app.</p><p><strong>Methods: </strong>We used a discrete choice experiment (DCE) to understand community preferences regarding the attributes of the AiSTi app for checking anogenital skin lesions. The DCE design included the attributes: data type; AI accuracy; verification of result by clinician; details of result; speed; professional support; and cost. The anonymous DCE survey was distributed to clients attending MSHC and through social media channels in Australia between January and March 2024. Participant preferences on various app attributes were examined using random parameters logit (RPL) and latent class analysis (LCA) models.</p><p><strong>Results: </strong>The median age of 411 participants was 32 years (interquartile range 26-40 years), with 64% assigned male at birth. Of the participants, 177 (43.1%) identified as same-sex attracted and 137 (33.3%) as heterosexual. In the RPL model, the most influential attribute was the cost of using the app (24.1%), followed by the clinician's verification of results (20.4%), the AI accuracy (19.5%) and the speed of receiving the result (19.1%). The LCA identified two distinct groups: 'all-rounders' (88%), who considered every attribute as important, and a 'cost-focussed' group (12%), who mainly focussed on the price. On the basis of the currently available app attributes, the predicted uptake was 72%. In the short term, a more feasible scenario of improving AI accuracy to 80-89% with clinician verification at a $5 cost could increase uptake to 90%. A long-term optimistic scenario with AI accuracy over 95%, no clinician verification and no cost could increase it to 95%.</p><p><strong>Conclusions: </strong>Preferences for an AI-assisted screening app targeting STI-related anogenital skin lesions are one that is low-cost, clinician-verified, highly accurate and provides results rapidly. An app with these key qualities would substantially improve user uptake.</p>","PeriodicalId":51271,"journal":{"name":"Patient-Patient Centered Outcomes Research","volume":null,"pages":null},"PeriodicalIF":3.4000,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Patient-Patient Centered Outcomes Research","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s40271-024-00720-8","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0
Abstract
Background: One of the World Health Organization (WHO) recommendations to achieve its global targets for sexually transmitted infections (STIs) is the increased use of digital technologies. Melbourne Sexual Health Centre (MSHC) has developed an AI-assisted screening application (app) called AiSTi for the detection of common STI-related anogenital skin conditions. This study aims to understand the community's preference for using the AiSTi app.
Methods: We used a discrete choice experiment (DCE) to understand community preferences regarding the attributes of the AiSTi app for checking anogenital skin lesions. The DCE design included the attributes: data type; AI accuracy; verification of result by clinician; details of result; speed; professional support; and cost. The anonymous DCE survey was distributed to clients attending MSHC and through social media channels in Australia between January and March 2024. Participant preferences on various app attributes were examined using random parameters logit (RPL) and latent class analysis (LCA) models.
Results: The median age of 411 participants was 32 years (interquartile range 26-40 years), with 64% assigned male at birth. Of the participants, 177 (43.1%) identified as same-sex attracted and 137 (33.3%) as heterosexual. In the RPL model, the most influential attribute was the cost of using the app (24.1%), followed by the clinician's verification of results (20.4%), the AI accuracy (19.5%) and the speed of receiving the result (19.1%). The LCA identified two distinct groups: 'all-rounders' (88%), who considered every attribute as important, and a 'cost-focussed' group (12%), who mainly focussed on the price. On the basis of the currently available app attributes, the predicted uptake was 72%. In the short term, a more feasible scenario of improving AI accuracy to 80-89% with clinician verification at a $5 cost could increase uptake to 90%. A long-term optimistic scenario with AI accuracy over 95%, no clinician verification and no cost could increase it to 95%.
Conclusions: Preferences for an AI-assisted screening app targeting STI-related anogenital skin lesions are one that is low-cost, clinician-verified, highly accurate and provides results rapidly. An app with these key qualities would substantially improve user uptake.
期刊介绍:
The Patient provides a venue for scientifically rigorous, timely, and relevant research to promote the development, evaluation and implementation of therapies, technologies, and innovations that will enhance the patient experience. It is an international forum for research that advances and/or applies qualitative or quantitative methods to promote the generation, synthesis, or interpretation of evidence.
The journal has specific interest in receiving original research, reviews and commentaries related to qualitative and mixed methods research, stated-preference methods, patient reported outcomes, and shared decision making.
Advances in regulatory science, patient-focused drug development, patient-centered benefit-risk and health technology assessment will also be considered.
Additional digital features (including animated abstracts, video abstracts, slide decks, audio slides, instructional videos, infographics, podcasts and animations) can be published with articles; these are designed to increase the visibility, readership and educational value of the journal’s content. In addition, articles published in The Patient may be accompanied by plain language summaries to assist readers who have some knowledge of, but not in-depth expertise in, the area to understand important medical advances.
All manuscripts are subject to peer review by international experts.