首页 > 最新文献

Journal of Medical Internet Research最新文献

英文 中文
Enhancing Detection of Message Intents in a Mobile Health Smoking-Cessation Intervention Using Large Language Model Fine-Tuning, Data Downsampling, and Error Correction: Algorithm Development and Validation. 使用大语言模型微调、数据下采样和纠错增强移动健康戒烟干预中信息意图的检测:算法开发和验证。
IF 6 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2026-03-09 DOI: 10.2196/83437
Shagoto Rahman, Cornelia Connie Pechmann, Ian G Harris
<p><strong>Background: </strong>Although smoking-cessation aids such as support groups and nicotine replacement therapy (NRT) can help people quit, quit rates remain low. Mobile health interventions can boost accessibility and engagement, especially with NRT, but require ongoing effort to deliver timely responses. Accurate intent detection is crucial for identifying user needs and delivering timely, appropriate chatbot responses. Recent large language model advancements in natural language processing and artificial intelligence (AI) have shown promise. However, these systems often struggle with many intent categories, complex language, and imbalanced data, reducing recognition accuracy.</p><p><strong>Objective: </strong>The main goal of this study was to develop an AI tool, a large language model that could accurately detect people's message intents, despite dataset imbalances and complexities. In our application, the messages came from a smoking-cessation support-group intervention and often involved the use of NRT provided as part of that intervention.</p><p><strong>Methods: </strong>We consistently used a state-of-the-art public domain large language model, Llama-3 8B (8 billion parameters) from Meta. First, we used the model off-the-shelf. Second, we fine-tuned it on our annotated dataset with 25 intent categories. Third, we also downsampled the predominant intent category to reduce model bias. Finally, we combined downsampling with corrected human annotations, creating a cleaned dataset for a new round of fine-tuning.</p><p><strong>Results: </strong>Without fine-tuning, the model achieved unweighted and weighted F1-scores (overall performance) of 0.41 and 0.38, respectively, on the downsampled corrected test dataset, and 0.29 and 0.35 on the full test dataset. Fine-tuning improved performance to 0.77 and 0.80 on the downsampled corrected dataset, and 0.72 and 0.86 on the full dataset. Fine-tuning with downsampling attained the best F1-scores, 0.88 and 0.91 on the downsampled corrected dataset, though performance dropped on the full test dataset (0.58 unweighted, 0.66 weighted) due to the predominance of the off-topic intent category, while unweighted recall remained high (0.80). The final method combining fine-tuning, downsampling, and error correction achieved 0.86 unweighted and 0.90 weighted F1-scores on the downsampled corrected dataset, and 0.57 and 0.65 on the full dataset with unweighted recall improving to 0.82.</p><p><strong>Conclusions: </strong>Large language models performed poorly without fine-tuning, highlighting the need for domain-specific training. Even with fine-tuning, performance was limited by a highly imbalanced dataset. Downsampling before fine-tuning moderately improved performance but still left room for improvement and concerns about dataset noise. A careful review of model-human disagreement cases helped identify human annotation errors. After error correction, the method without error correction still achieved sli
背景:尽管支持团体和尼古丁替代疗法(NRT)等戒烟辅助工具可以帮助人们戒烟,但戒烟率仍然很低。移动卫生干预措施可以提高可及性和参与度,特别是在NRT方面,但需要不断努力提供及时的应对措施。准确的意图检测对于识别用户需求和提供及时、适当的聊天机器人响应至关重要。最近在自然语言处理和人工智能(AI)方面的大型语言模型进展显示出了希望。然而,这些系统经常与许多意图类别、复杂的语言和不平衡的数据作斗争,从而降低了识别的准确性。目的:本研究的主要目标是开发一种人工智能工具,一种能够准确检测人们信息意图的大型语言模型,尽管数据集不平衡且复杂。在我们的应用程序中,这些信息来自戒烟支持小组干预,并且通常涉及使用NRT作为该干预的一部分。方法:我们始终使用来自Meta的最先进的公共领域大型语言模型llama - 38b(80亿个参数)。首先,我们使用了现成的模型。其次,我们对带有25个意图类别的带注释的数据集进行了微调。第三,我们还降低了主要意图类别的采样,以减少模型偏差。最后,我们将降采样与校正后的人工注释结合起来,为新一轮的微调创建一个干净的数据集。结果:在没有微调的情况下,该模型在下采样校正的测试数据集上分别获得了0.41和0.38的未加权和加权f1分数(总体性能),在完整的测试数据集上分别获得了0.29和0.35。微调将下采样校正数据集的性能提高到0.77和0.80,在完整数据集上提高到0.72和0.86。下采样的微调在下采样校正数据集上获得了最好的f1分数,分别为0.88和0.91,尽管由于偏离主题的意图类别占主导地位,性能在完整测试数据集上下降(0.58未加权,0.66加权),而未加权的召回率仍然很高(0.80)。结合微调、下采样和误差校正的最终方法在下采样校正数据集上实现了0.86和0.90的非加权f1得分,在完整数据集上实现了0.57和0.65,非加权召回率提高到0.82。结论:大型语言模型在没有微调的情况下表现很差,这突出了对特定领域训练的需求。即使进行了微调,性能也会受到高度不平衡数据集的限制。在微调之前的降采样适度提高了性能,但仍然留下了改进的空间和对数据集噪声的担忧。对模型与人类不一致案例的仔细回顾有助于识别人类注释错误。经过误差校正后,不进行误差校正的方法在校正后的测试数据集上仍能获得稍高的精度和f1分。虽然纠错略微提高了噪声数据的召回率,但单靠自动下采样可能就足够了,这使得人工纠错成为一种资源更密集的选择,而且增加的好处有限。
{"title":"Enhancing Detection of Message Intents in a Mobile Health Smoking-Cessation Intervention Using Large Language Model Fine-Tuning, Data Downsampling, and Error Correction: Algorithm Development and Validation.","authors":"Shagoto Rahman, Cornelia Connie Pechmann, Ian G Harris","doi":"10.2196/83437","DOIUrl":"10.2196/83437","url":null,"abstract":"&lt;p&gt;&lt;strong&gt;Background: &lt;/strong&gt;Although smoking-cessation aids such as support groups and nicotine replacement therapy (NRT) can help people quit, quit rates remain low. Mobile health interventions can boost accessibility and engagement, especially with NRT, but require ongoing effort to deliver timely responses. Accurate intent detection is crucial for identifying user needs and delivering timely, appropriate chatbot responses. Recent large language model advancements in natural language processing and artificial intelligence (AI) have shown promise. However, these systems often struggle with many intent categories, complex language, and imbalanced data, reducing recognition accuracy.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Objective: &lt;/strong&gt;The main goal of this study was to develop an AI tool, a large language model that could accurately detect people's message intents, despite dataset imbalances and complexities. In our application, the messages came from a smoking-cessation support-group intervention and often involved the use of NRT provided as part of that intervention.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Methods: &lt;/strong&gt;We consistently used a state-of-the-art public domain large language model, Llama-3 8B (8 billion parameters) from Meta. First, we used the model off-the-shelf. Second, we fine-tuned it on our annotated dataset with 25 intent categories. Third, we also downsampled the predominant intent category to reduce model bias. Finally, we combined downsampling with corrected human annotations, creating a cleaned dataset for a new round of fine-tuning.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Results: &lt;/strong&gt;Without fine-tuning, the model achieved unweighted and weighted F1-scores (overall performance) of 0.41 and 0.38, respectively, on the downsampled corrected test dataset, and 0.29 and 0.35 on the full test dataset. Fine-tuning improved performance to 0.77 and 0.80 on the downsampled corrected dataset, and 0.72 and 0.86 on the full dataset. Fine-tuning with downsampling attained the best F1-scores, 0.88 and 0.91 on the downsampled corrected dataset, though performance dropped on the full test dataset (0.58 unweighted, 0.66 weighted) due to the predominance of the off-topic intent category, while unweighted recall remained high (0.80). The final method combining fine-tuning, downsampling, and error correction achieved 0.86 unweighted and 0.90 weighted F1-scores on the downsampled corrected dataset, and 0.57 and 0.65 on the full dataset with unweighted recall improving to 0.82.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Conclusions: &lt;/strong&gt;Large language models performed poorly without fine-tuning, highlighting the need for domain-specific training. Even with fine-tuning, performance was limited by a highly imbalanced dataset. Downsampling before fine-tuning moderately improved performance but still left room for improvement and concerns about dataset noise. A careful review of model-human disagreement cases helped identify human annotation errors. After error correction, the method without error correction still achieved sli","PeriodicalId":16337,"journal":{"name":"Journal of Medical Internet Research","volume":"28 ","pages":"e83437"},"PeriodicalIF":6.0,"publicationDate":"2026-03-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12978910/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147433737","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Association of Electronic Health Literacy With Self-Care and Health Outcomes Among Patients With Type 2 Diabetes Mellitus: Cross-Sectional Study. 2型糖尿病患者电子健康素养与自我保健和健康结局的关系:横断面研究
IF 6 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2026-03-09 DOI: 10.2196/77856
Phoenix Kit-Han Mo, Alice Ps Kong, Luyao Xie, Virginia Wy Chan, Joseph Tf Lau

Background: Diabetes mellitus (DM) continues to be a critical public health issue in Hong Kong. Although self-care behaviors help promote health among patients with DM, adherence remains suboptimal. More attention should be paid to eHealth literacy with the development of modern technologies.

Objective: This study aims to assess the level of eHealth literacy among patients with DM and examine its association with self-care and health outcomes.

Methods: A cross-sectional study was conducted among patients with type 2 DM from the DM clinic of a public hospital in Hong Kong. Data on eHealth literacy, self-care, self-care self-efficacy, diabetes distress, glycated hemoglobin (HbA1c) control, and sociodemographic information were collected. Multivariable regression analyses were performed, adjusting for relevant sociodemographic and medical variables.

Results: Among the 427 patients with DM recruited, around two-thirds (65.1%) were classified as having a high level of eHealth literacy. Compared to those with lower eHealth literacy, participants with higher eHealth literacy demonstrated significantly higher levels of self-care (P<.001) and self-care self-efficacy (P<.001) and lower levels of diabetes distress (P<.001). Higher eHealth literacy was also associated with greater odds of achieving ideal HbA1c control (<7%) in unadjusted analyses (odds ratio 1.90, 95% CI 1.15-2.81); however, this association was not statistically significant after adjustment for sociodemographic and medical covariates (adjusted odds ratio 1.57, 95% CI 0.99-2.52; P=.07).

Conclusions: This study evaluated eHealth literacy levels among patients with DM and examined the associations between eHealth literacy and health outcomes (eg, self-care, self-care self-efficacy, diabetes distress, and HbA1c control). Assessing eHealth literacy in patients with DM could be useful in identifying those who are vulnerable to poorer health outcomes. Promoting eHealth literacy among patients with DM may be important.

背景:糖尿病(DM)在香港一直是一个严重的公共卫生问题。虽然自我保健行为有助于促进糖尿病患者的健康,但依从性仍然不够理想。随着现代技术的发展,电子健康素养应得到更多的重视。目的:本研究旨在评估糖尿病患者的电子健康素养水平,并研究其与自我保健和健康结果的关系。方法:对香港某公立医院糖尿病门诊的2型糖尿病患者进行横断面研究。收集了电子健康素养、自我保健、自我保健自我效能、糖尿病困扰、糖化血红蛋白(HbA1c)控制和社会人口学信息的数据。进行多变量回归分析,调整相关的社会人口统计学和医学变量。结果:在招募的427名糖尿病患者中,约三分之二(65.1%)被归类为具有高水平的电子健康素养。与电子健康素养较低的参与者相比,电子健康素养较高的参与者表现出明显更高的自我保健水平(结论:本研究评估了糖尿病患者的电子健康素养水平,并检查了电子健康素养与健康结果(如自我保健、自我保健自我效能、糖尿病困扰和HbA1c控制)之间的关系。评估糖尿病患者的电子健康素养可能有助于确定易受较差健康结果影响的人群。促进糖尿病患者的电子健康素养可能很重要。
{"title":"Association of Electronic Health Literacy With Self-Care and Health Outcomes Among Patients With Type 2 Diabetes Mellitus: Cross-Sectional Study.","authors":"Phoenix Kit-Han Mo, Alice Ps Kong, Luyao Xie, Virginia Wy Chan, Joseph Tf Lau","doi":"10.2196/77856","DOIUrl":"10.2196/77856","url":null,"abstract":"<p><strong>Background: </strong>Diabetes mellitus (DM) continues to be a critical public health issue in Hong Kong. Although self-care behaviors help promote health among patients with DM, adherence remains suboptimal. More attention should be paid to eHealth literacy with the development of modern technologies.</p><p><strong>Objective: </strong>This study aims to assess the level of eHealth literacy among patients with DM and examine its association with self-care and health outcomes.</p><p><strong>Methods: </strong>A cross-sectional study was conducted among patients with type 2 DM from the DM clinic of a public hospital in Hong Kong. Data on eHealth literacy, self-care, self-care self-efficacy, diabetes distress, glycated hemoglobin (HbA1c) control, and sociodemographic information were collected. Multivariable regression analyses were performed, adjusting for relevant sociodemographic and medical variables.</p><p><strong>Results: </strong>Among the 427 patients with DM recruited, around two-thirds (65.1%) were classified as having a high level of eHealth literacy. Compared to those with lower eHealth literacy, participants with higher eHealth literacy demonstrated significantly higher levels of self-care (P<.001) and self-care self-efficacy (P<.001) and lower levels of diabetes distress (P<.001). Higher eHealth literacy was also associated with greater odds of achieving ideal HbA1c control (<7%) in unadjusted analyses (odds ratio 1.90, 95% CI 1.15-2.81); however, this association was not statistically significant after adjustment for sociodemographic and medical covariates (adjusted odds ratio 1.57, 95% CI 0.99-2.52; P=.07).</p><p><strong>Conclusions: </strong>This study evaluated eHealth literacy levels among patients with DM and examined the associations between eHealth literacy and health outcomes (eg, self-care, self-care self-efficacy, diabetes distress, and HbA1c control). Assessing eHealth literacy in patients with DM could be useful in identifying those who are vulnerable to poorer health outcomes. Promoting eHealth literacy among patients with DM may be important.</p>","PeriodicalId":16337,"journal":{"name":"Journal of Medical Internet Research","volume":"28 ","pages":"e77856"},"PeriodicalIF":6.0,"publicationDate":"2026-03-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12978935/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147433556","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Digital Twins for Just-in-Time Adaptive Interventions (JITAIs): Framework for Optimizing and Continually Improving JITAIs. 即时自适应干预(JITAIs)的数字孪生:优化和持续改进JITAIs的框架。
IF 6 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2026-03-06 DOI: 10.2196/72830
Asim H Gazi, Daiqi Gao, Susobhan Ghosh, Ziping Xu, Anna L Trella, Predrag Klasnja, Susan A Murphy

Unlabelled: In the context of digital health, just-in-time adaptive interventions (JITAIs) are nascent precision medicine systems that can extend personalized health care support to everyday life. A challenge in designing JITAIs is that personalized support often involves sophisticated decision-making algorithms. These decision-making algorithms can require numerous nontrivial design decisions that must be made between successive JITAI deployments (eg, hyperparameter selection for an artificial intelligence algorithm). Making design decisions between deployments-rather than during deployment-ensures intervention fidelity and enhances the ability to replicate results. Yet, each deployment can be costly, precluding the use of A/B testing for every design decision. How should design decisions be made strategically between JITAI deployments? This paper introduces "digital twins for just-in-time adaptive interventions (JITAI-Twins)" to address this question. JITAI-Twins are "digital twins of a subpopulation" (term used in the 2023 National Academies workshop proceedings on digital twins). JITAI-Twins are used to virtually simulate the potential outcomes of a JITAI's design decisions for an upcoming deployment. Based on simulation results, design decisions are made for the deployed JITAI. To continually improve the JITAI, data collected during deployment are used to update the JITAI-Twin-and this bidirectional feedback between deployments and simulation environments continues. JITAI-Twins are thus "fit-for-purpose" (term used in the National Academies 2024 consensus report on digital twins) instantiations of the digital twin concept. In this paper, we elucidate the specifics and design process of JITAI-Twins, with examples of prior use in clinical settings. JITAI-Twins highlight continuity over the course of a JITAI's optimization and continual improvement, emphasizing the need for bidirectional feedback between versions of a simulation environment and a JITAI's deployments.

未标记:在数字健康的背景下,即时适应性干预(JITAIs)是新兴的精准医疗系统,可以将个性化医疗保健支持扩展到日常生活。设计jitai的一个挑战是个性化支持通常涉及复杂的决策算法。这些决策算法可能需要在连续的JITAI部署之间做出许多重要的设计决策(例如,人工智能算法的超参数选择)。在部署之间(而不是在部署期间)做出设计决策,可以确保干预的保真度,并增强复制结果的能力。然而,每次部署都是昂贵的,这阻碍了对每个设计决策使用A/B测试。在JITAI部署之间应该如何策略性地做出设计决策?本文引入了“即时适应干预的数字双胞胎(JITAI-Twins)”来解决这个问题。JITAI-Twins是“亚群的数字双胞胎”(2023年美国国家科学院数字双胞胎研讨会论文集中使用的术语)。JITAI- twins用于虚拟模拟JITAI设计决策对即将到来的部署的潜在结果。根据仿真结果,对部署的JITAI进行了设计决策。为了不断改进JITAI,部署期间收集的数据用于更新JITAI- twin,并且部署和模拟环境之间的双向反馈将继续进行。因此,JITAI-Twins是数字双胞胎概念的“符合目的”(美国国家科学院2024年关于数字双胞胎的共识报告中使用的术语)实例。在本文中,我们阐述了JITAI-Twins的细节和设计过程,并举例说明了之前在临床环境中的使用。JITAI- twins强调了JITAI优化和持续改进过程中的连续性,强调了模拟环境版本和JITAI部署之间双向反馈的必要性。
{"title":"Digital Twins for Just-in-Time Adaptive Interventions (JITAIs): Framework for Optimizing and Continually Improving JITAIs.","authors":"Asim H Gazi, Daiqi Gao, Susobhan Ghosh, Ziping Xu, Anna L Trella, Predrag Klasnja, Susan A Murphy","doi":"10.2196/72830","DOIUrl":"10.2196/72830","url":null,"abstract":"<p><strong>Unlabelled: </strong>In the context of digital health, just-in-time adaptive interventions (JITAIs) are nascent precision medicine systems that can extend personalized health care support to everyday life. A challenge in designing JITAIs is that personalized support often involves sophisticated decision-making algorithms. These decision-making algorithms can require numerous nontrivial design decisions that must be made between successive JITAI deployments (eg, hyperparameter selection for an artificial intelligence algorithm). Making design decisions between deployments-rather than during deployment-ensures intervention fidelity and enhances the ability to replicate results. Yet, each deployment can be costly, precluding the use of A/B testing for every design decision. How should design decisions be made strategically between JITAI deployments? This paper introduces \"digital twins for just-in-time adaptive interventions (JITAI-Twins)\" to address this question. JITAI-Twins are \"digital twins of a subpopulation\" (term used in the 2023 National Academies workshop proceedings on digital twins). JITAI-Twins are used to virtually simulate the potential outcomes of a JITAI's design decisions for an upcoming deployment. Based on simulation results, design decisions are made for the deployed JITAI. To continually improve the JITAI, data collected during deployment are used to update the JITAI-Twin-and this bidirectional feedback between deployments and simulation environments continues. JITAI-Twins are thus \"fit-for-purpose\" (term used in the National Academies 2024 consensus report on digital twins) instantiations of the digital twin concept. In this paper, we elucidate the specifics and design process of JITAI-Twins, with examples of prior use in clinical settings. JITAI-Twins highlight continuity over the course of a JITAI's optimization and continual improvement, emphasizing the need for bidirectional feedback between versions of a simulation environment and a JITAI's deployments.</p>","PeriodicalId":16337,"journal":{"name":"Journal of Medical Internet Research","volume":"28 ","pages":"e72830"},"PeriodicalIF":6.0,"publicationDate":"2026-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12978917/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147433723","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Artificial Intelligence for Medicines Information: Scoping Review of Clinical Applications and Digital Health Inequalities. 药物信息的人工智能:临床应用和数字健康不平等的范围审查。
IF 6 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2026-03-06 DOI: 10.2196/77747
Shahd Al-Arkee, Josephine Falade, Vibhu Paudyal

Background: Artificial intelligence (AI) has the potential to support medicines information services. However, a comprehensive mapping of its use, particularly within pharmacy practice and in the context of digital health inequalities, is lacking.

Objective: This scoping review mapped existing evidence on AI-driven medicines information, focusing on the accuracy and completeness of AI-generated content, the role of health care professionals (HCPs), particularly pharmacists, and the impact of digital health inequalities on AI adoption.

Methods: This scoping review was informed by the methodological framework proposed by Levac et al, which includes modifications to the original Arksey and O'Malley scoping review framework. A systematic search was conducted across MEDLINE (Ovid), PubMed Central, Cochrane Library, CINAHL Plus (EBSCOhost), International Pharmaceutical Abstracts (IPA), Web of Science, and Google Scholar from inception to January 2025, which served as the search cutoff date. Peer-reviewed studies in English evaluating the role of AI in medicines information across any health care settings (including patient homes) were included. The results are reported in accordance with the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines.

Results: A total of 1911 citations were identified, with 14 studies meeting the inclusion criteria. AI tools showed promise in supporting medicines information services but were found to have limitations in accuracy, particularly when applied to complex clinical queries. Pharmacists were the most engaged HCPs in the evaluation of AI-generated content. Only 3 studies explored digital health inequalities in the context of AI and access to medicines information. Reported barriers included misinformation risks, regulatory gaps, and digital health inequalities, particularly infrastructure limitations and disparities in digital literacy, which affected AI adoption.

Conclusions: AI-driven tools show promise in supporting medicines information services, but concerns remain. HCPs, particularly pharmacists, play a critical role in AI evaluation and validation, yet their involvement remains ill-defined. Addressing digital health inequalities is essential for effective AI integration. Future research should focus on identifying and minimizing digital health inequalities, as well as evidence-informed AI implementation in medicines information services.

背景:人工智能(AI)具有支持药品信息服务的潜力。然而,缺乏对其使用情况的全面测绘,特别是在药房实践和数字卫生不平等的背景下。目的:本范围审查绘制了人工智能驱动的药物信息的现有证据,重点关注人工智能生成内容的准确性和完整性,卫生保健专业人员(HCPs),特别是药剂师的作用,以及数字卫生不平等对人工智能采用的影响。方法:本综述采用Levac等人提出的方法学框架,其中包括对Arksey和O'Malley最初的综述框架的修改。系统检索MEDLINE (Ovid)、PubMed Central、Cochrane Library、CINAHL Plus (EBSCOhost)、International Pharmaceutical Abstracts (IPA)、Web of Science和谷歌Scholar,检索时间从成立到截止日期2025年1月。包括同行评议的英文研究,评估人工智能在任何医疗机构(包括患者家庭)的药物信息中的作用。结果按照PRISMA-ScR(系统评价和荟萃分析扩展范围评价的首选报告项目)指南进行报告。结果:共纳入文献1911篇,符合纳入标准的文献14篇。人工智能工具在支持药物信息服务方面显示出前景,但发现其准确性有限,特别是在应用于复杂的临床查询时。药剂师是最参与评估人工智能生成内容的医务人员。只有3项研究探讨了人工智能和获取药物信息背景下的数字卫生不平等现象。报告的障碍包括错误信息风险、监管缺口和数字卫生不平等,特别是影响人工智能采用的基础设施限制和数字扫盲方面的差距。结论:人工智能驱动的工具在支持药品信息服务方面显示出前景,但问题仍然存在。医护人员,特别是药剂师,在人工智能评估和验证中发挥着关键作用,但他们的参与仍然不明确。解决数字卫生不平等问题对于有效整合人工智能至关重要。未来的研究应侧重于确定和尽量减少数字卫生不平等,以及在药物信息服务中实施循证人工智能。
{"title":"Artificial Intelligence for Medicines Information: Scoping Review of Clinical Applications and Digital Health Inequalities.","authors":"Shahd Al-Arkee, Josephine Falade, Vibhu Paudyal","doi":"10.2196/77747","DOIUrl":"10.2196/77747","url":null,"abstract":"<p><strong>Background: </strong>Artificial intelligence (AI) has the potential to support medicines information services. However, a comprehensive mapping of its use, particularly within pharmacy practice and in the context of digital health inequalities, is lacking.</p><p><strong>Objective: </strong>This scoping review mapped existing evidence on AI-driven medicines information, focusing on the accuracy and completeness of AI-generated content, the role of health care professionals (HCPs), particularly pharmacists, and the impact of digital health inequalities on AI adoption.</p><p><strong>Methods: </strong>This scoping review was informed by the methodological framework proposed by Levac et al, which includes modifications to the original Arksey and O'Malley scoping review framework. A systematic search was conducted across MEDLINE (Ovid), PubMed Central, Cochrane Library, CINAHL Plus (EBSCOhost), International Pharmaceutical Abstracts (IPA), Web of Science, and Google Scholar from inception to January 2025, which served as the search cutoff date. Peer-reviewed studies in English evaluating the role of AI in medicines information across any health care settings (including patient homes) were included. The results are reported in accordance with the PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines.</p><p><strong>Results: </strong>A total of 1911 citations were identified, with 14 studies meeting the inclusion criteria. AI tools showed promise in supporting medicines information services but were found to have limitations in accuracy, particularly when applied to complex clinical queries. Pharmacists were the most engaged HCPs in the evaluation of AI-generated content. Only 3 studies explored digital health inequalities in the context of AI and access to medicines information. Reported barriers included misinformation risks, regulatory gaps, and digital health inequalities, particularly infrastructure limitations and disparities in digital literacy, which affected AI adoption.</p><p><strong>Conclusions: </strong>AI-driven tools show promise in supporting medicines information services, but concerns remain. HCPs, particularly pharmacists, play a critical role in AI evaluation and validation, yet their involvement remains ill-defined. Addressing digital health inequalities is essential for effective AI integration. Future research should focus on identifying and minimizing digital health inequalities, as well as evidence-informed AI implementation in medicines information services.</p>","PeriodicalId":16337,"journal":{"name":"Journal of Medical Internet Research","volume":"28 ","pages":"e77747"},"PeriodicalIF":6.0,"publicationDate":"2026-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12978933/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147433603","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Effectiveness of Virtual Reality-Based Early Rehabilitation Strategies on Pain, Sleep, Anxiety, Balance, Cognition, and Limb Motor Function in Adult Intensive Care Unit Patients: Systematic Review and Meta-Analysis of Randomized Controlled Trials. 基于虚拟现实的早期康复策略对成人重症监护病房患者疼痛、睡眠、焦虑、平衡、认知和肢体运动功能的影响:随机对照试验的系统回顾和meta分析
IF 6 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2026-03-06 DOI: 10.2196/81865
Fei Wu, Yunting Wu, Yana Xing, Weixin Cai, Ran Zhang
<p><strong>Background: </strong>Early rehabilitation is vital for functional recovery in critically ill patients. Virtual reality-based early rehabilitation intervention (VR-ERI) is an emerging strategy, but evidence on its feasibility, safety, and efficacy remains inconsistent and unsynthesized.</p><p><strong>Objective: </strong>We synthesized evidence from randomized controlled trials (RCTs) on the feasibility and safety of VR-ERI in adult critically ill patients and evaluated its effects on functional outcomes during intensive care unit (ICU) stay and at short-term follow-up (≤3 months post ICU).</p><p><strong>Methods: </strong>Following PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) 2020 guidelines, we searched 10 databases (eg, PubMed, Web of Science, Cochrane Library, and Embase) from inception to October 5, 2025, for Chinese and English publications. We included RCTs comparing VR-ERI with control measures initiated early (within 72 h of ICU admission) in adults. FW and YW independently screened studies and extracted data; YW and YX independently conducted the revised Cochrane Risk of Bias tool assessment. Data were synthesized narratively or via meta-analysis in R Studio using a random-effects model (Hartung-Knapp-Sidik-Jonkman adjustment). Effects were expressed as standardized mean differences (SMD; with Hedges g correction) with 95% CIs and 95% prediction intervals (95% PIs). Subgroup and sensitivity analyses were performed to explore heterogeneity and assess robustness. The Grading of Recommendations Assessment, Development, and Evaluation framework was used to assess the quality of evidence.</p><p><strong>Results: </strong>Sixteen RCTs (published 2020-2025) involving 1356 patients were included. Bias assessment found 1 study at low risk, 5 with some concerns, and 10 at high risk. Meta-analysis suggested potential trends for VR-ERI in improving ICU anxiety (SMD -0.86, 95% CI -1.85 to 0.13, 95% PI -3.75 to 2.03; very low certainty) and subjective sleep quality (SMD 3.36, 95% CI 0.77-5.94; very low certainty), with a more pronounced effect in the Richards-Campbell Sleep Questionnaire-assessed subgroup (SMD 5.12, 95% CI 0.54-9.71). At follow-up, VR-ERI showed trends toward improved balance (Berg Balance Scale: SMD 0.97, 95% CI 0.74-1.20, 95% PI 0.37-1.58; moderate certainty), limb motor function (Fugl-Meyer: SMD 1.40, 95% CI -0.23 to 3.02; low certainty), and cognitive function (SMD 0.78, 95% CI 0.16-1.39; low certainty). No significant differences were found for objective sleep measures or ICU pain (low to very low certainty). No serious adverse events were reported; only a few studies mentioned mild reactions, such as dizziness, nausea, and fatigue.</p><p><strong>Conclusions: </strong>This review indicates VR-ERI's potential to improve anxiety, subjective sleep, balance, cognition, and motor function in early ICU rehabilitation, while its effects on pain and objective sleep remain unclear and safety protocol
背景:早期康复对危重患者的功能恢复至关重要。基于虚拟现实的早期康复干预(VR-ERI)是一种新兴的策略,但关于其可行性、安全性和有效性的证据仍然不一致和不综合。目的:我们综合随机对照试验(RCTs)的证据,证明VR-ERI在成人危重患者中的可行性和安全性,并评估其对重症监护病房(ICU)住院期间和短期随访(ICU后≤3个月)功能结局的影响。方法:根据PRISMA (Preferred Reporting Items for Systematic Reviews and meta - analysis) 2020指南,我们检索了10个数据库(如PubMed、Web of Science、Cochrane Library和Embase),检索了从成立到2025年10月5日的中文和英文出版物。我们纳入了比较成人早期(ICU入院72小时内)开始的VR-ERI和控制措施的随机对照试验。FW和YW独立筛选研究和提取数据;YW和YX独立进行了修订后的Cochrane偏倚风险工具评估。使用随机效应模型(Hartung-Knapp-Sidik-Jonkman调整)在R Studio中对数据进行叙述或meta分析。效应表示为标准化平均差异(SMD; Hedges g校正),95% ci和95%预测区间(95% pi)。进行亚组分析和敏感性分析以探索异质性并评估稳健性。采用建议分级评估、发展和评价框架来评估证据的质量。结果:纳入16项随机对照试验(发表于2020-2025年),涉及1356例患者。偏倚评估发现1项研究为低风险,5项研究有一些担忧,10项研究为高风险。meta分析显示VR-ERI在改善ICU焦虑(SMD -0.86, 95% CI -1.85至0.13,95% PI -3.75至2.03,确定性极低)和主观睡眠质量(SMD 3.36, 95% CI 0.77-5.94,确定性极低)方面的潜在趋势,在Richards-Campbell睡眠问卷评估亚组(SMD 5.12, 95% CI 0.54-9.71)中效果更为明显。在随访中,VR-ERI显示出改善平衡(Berg平衡量表:SMD 0.97, 95% CI 0.74-1.20, 95% PI 0.37-1.58,中等确定性)、肢体运动功能(Fugl-Meyer: SMD 1.40, 95% CI -0.23 - 3.02,低确定性)和认知功能(SMD 0.78, 95% CI 0.16-1.39,低确定性)的趋势。客观睡眠测量或ICU疼痛(低至非常低的确定性)没有发现显著差异。无严重不良事件报告;只有少数研究提到轻微的反应,如头晕、恶心和疲劳。结论:本综述表明VR-ERI在ICU早期康复中有改善焦虑、主观睡眠、平衡、认知和运动功能的潜力,但其对疼痛和客观睡眠的影响尚不清楚,安全方案有待完善。考虑到高偏倚风险、大量异质性和不精确性,证据的总体确定性很低。因此,VR-ERI可以作为非药理学辅助药物,但其临床转化需要考虑成本和患者适用性,需要更严格的研究。
{"title":"Effectiveness of Virtual Reality-Based Early Rehabilitation Strategies on Pain, Sleep, Anxiety, Balance, Cognition, and Limb Motor Function in Adult Intensive Care Unit Patients: Systematic Review and Meta-Analysis of Randomized Controlled Trials.","authors":"Fei Wu, Yunting Wu, Yana Xing, Weixin Cai, Ran Zhang","doi":"10.2196/81865","DOIUrl":"10.2196/81865","url":null,"abstract":"&lt;p&gt;&lt;strong&gt;Background: &lt;/strong&gt;Early rehabilitation is vital for functional recovery in critically ill patients. Virtual reality-based early rehabilitation intervention (VR-ERI) is an emerging strategy, but evidence on its feasibility, safety, and efficacy remains inconsistent and unsynthesized.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Objective: &lt;/strong&gt;We synthesized evidence from randomized controlled trials (RCTs) on the feasibility and safety of VR-ERI in adult critically ill patients and evaluated its effects on functional outcomes during intensive care unit (ICU) stay and at short-term follow-up (≤3 months post ICU).&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Methods: &lt;/strong&gt;Following PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) 2020 guidelines, we searched 10 databases (eg, PubMed, Web of Science, Cochrane Library, and Embase) from inception to October 5, 2025, for Chinese and English publications. We included RCTs comparing VR-ERI with control measures initiated early (within 72 h of ICU admission) in adults. FW and YW independently screened studies and extracted data; YW and YX independently conducted the revised Cochrane Risk of Bias tool assessment. Data were synthesized narratively or via meta-analysis in R Studio using a random-effects model (Hartung-Knapp-Sidik-Jonkman adjustment). Effects were expressed as standardized mean differences (SMD; with Hedges g correction) with 95% CIs and 95% prediction intervals (95% PIs). Subgroup and sensitivity analyses were performed to explore heterogeneity and assess robustness. The Grading of Recommendations Assessment, Development, and Evaluation framework was used to assess the quality of evidence.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Results: &lt;/strong&gt;Sixteen RCTs (published 2020-2025) involving 1356 patients were included. Bias assessment found 1 study at low risk, 5 with some concerns, and 10 at high risk. Meta-analysis suggested potential trends for VR-ERI in improving ICU anxiety (SMD -0.86, 95% CI -1.85 to 0.13, 95% PI -3.75 to 2.03; very low certainty) and subjective sleep quality (SMD 3.36, 95% CI 0.77-5.94; very low certainty), with a more pronounced effect in the Richards-Campbell Sleep Questionnaire-assessed subgroup (SMD 5.12, 95% CI 0.54-9.71). At follow-up, VR-ERI showed trends toward improved balance (Berg Balance Scale: SMD 0.97, 95% CI 0.74-1.20, 95% PI 0.37-1.58; moderate certainty), limb motor function (Fugl-Meyer: SMD 1.40, 95% CI -0.23 to 3.02; low certainty), and cognitive function (SMD 0.78, 95% CI 0.16-1.39; low certainty). No significant differences were found for objective sleep measures or ICU pain (low to very low certainty). No serious adverse events were reported; only a few studies mentioned mild reactions, such as dizziness, nausea, and fatigue.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Conclusions: &lt;/strong&gt;This review indicates VR-ERI's potential to improve anxiety, subjective sleep, balance, cognition, and motor function in early ICU rehabilitation, while its effects on pain and objective sleep remain unclear and safety protocol","PeriodicalId":16337,"journal":{"name":"Journal of Medical Internet Research","volume":"28 ","pages":"e81865"},"PeriodicalIF":6.0,"publicationDate":"2026-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12978899/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147433818","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Comparison of Emotional Content in Text Responses From Physicians and AI Chatbots to Patient Health Queries: Cross-Sectional Study. 医生和人工智能聊天机器人对患者健康问题的文本回复中的情感内容的比较:横断面研究。
IF 6 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2026-03-06 DOI: 10.2196/85516
Daniel T Burns, Channing Bice, Paul E Johnson, Nicholas Chia, Timothy Robinson

Background: Surveys show that many people are willing to use generative artificial intelligence (AI) for health questions. Prior research has largely focused on chatbot accuracy, with some studies finding that both physicians and consumers overwhelmingly prefer chatbot-generated text over physician responses.

Objective: This study aimed to characterize and compare the emotional content of responses from physicians and 2 AI chatbots (OpenAI's ChatGPT and Google's Gemini) and to assess differences in reading level and use of medical disclaimers.

Methods: A public, patient-deidentified telehealth website was used to compile 100 physician-answered questions. The same questions were posed to both chatbots between May 18 and 19, 2025. Two coders classified the emotional content of each sentence using a predefined codebook and reviewed for agreement. Emotions were ranked as primary, secondary, and tertiary by the proportion of sentences classified as each emotion per response. Multinomial logistic regression compared emotional rankings using physician responses as the reference. Word count, Flesch Reading Ease, and Flesch-Kincaid Grade Level were analyzed via ANOVA with the Tukey honestly significant difference test. Disclaimer use was compared between chatbots using a χ2 test.

Results: Primary emotions were overwhelmingly neutral, except for one response from each chatbot in which anger was primary. For secondary emotions, the odds ratio of hope was 80.28% (95% CI 37.71%-93.76%) lower for ChatGPT, while the odds ratio of fear was 3.29 (95% CI 1.44-7.49) times higher for Gemini. For tertiary emotions, the odds ratio of compassion was 1.94 (95% CI 1.06-3.54) times higher, and the odds ratio of having no tertiary emotion was 84.33% (95% CI 64.72%-93.04%) lower for Gemini. Gemini responses averaged 889.1 (SD 305.7) words, ChatGPT 476.5 (SD 109.5), and physicians 193.5 (SD 113.6). Gemini had the lowest average Flesch Reading Ease score at 39.9 (SD 8.8), followed by ChatGPT at 45.8 (SD 12.8), while physicians had the highest at 51.9 (SD 13.6). Gemini had the highest average Flesch-Kincaid Grade Level at 11.3 (SD 1.5), followed by ChatGPT at 9.9 (SD 1.9), and physicians at 9.2 (SD 2.4). Gemini was significantly more likely to include a disclaimer than ChatGPT (χ21=49.2; P<.001).

Conclusions: Chatbot responses were significantly (P<.001) longer and more difficult to read than physician responses and were more likely to contain a wider range of emotions. Qualitatively, chatbot responses were more varied in their presentation as well as in the breadth of the emotions themselves. The findings of this study could be used to inform more emotionally connected physician responses to patient message queries.

背景:调查显示,许多人愿意使用生成式人工智能(AI)来解决健康问题。之前的研究主要集中在聊天机器人的准确性上,一些研究发现,医生和消费者绝大多数都更喜欢聊天机器人生成的文本,而不是医生的回答。目的:本研究旨在描述和比较医生和2个人工智能聊天机器人(OpenAI的ChatGPT和b谷歌的Gemini)回答的情感内容,并评估阅读水平和使用医疗免责声明的差异。方法:使用一个公开的、患者身份的远程医疗网站,编制100个医生回答的问题。在2025年5月18日至19日期间,两个聊天机器人都被提出了同样的问题。两名编码员使用预定义的密码本对每个句子的情感内容进行分类,并审查是否一致。根据每个反应中每种情绪所占的句子比例,情绪被划分为第一、第二和第三。多项逻辑回归以医生的反应作为参考来比较情绪排名。字数、Flesch阅读难度、Flesch- kincaid年级水平采用方差分析,采用Tukey诚实显著性差异检验。使用χ2检验比较聊天机器人之间免责声明的使用情况。结果:主要情绪绝大多数是中性的,除了每个聊天机器人的一个反应是愤怒。对于次要情绪,ChatGPT患者希望的比值比低80.28% (95% CI 37.71%-93.76%),而双子座患者恐惧的比值比高3.29倍(95% CI 1.44-7.49)。对于第三情感,同情的比值比高1.94倍(95% CI 1.06-3.54),而双子没有第三情感的比值比低84.33% (95% CI 64.72%-93.04%)。双子座的平均回答是889.1 (SD 305.7), ChatGPT为476.5 (SD 109.5),医生为193.5 (SD 113.6)。双子座的平均阅读轻松得分最低,为39.9 (SD 8.8),其次是ChatGPT,为45.8 (SD 12.8),而医生最高,为51.9 (SD 13.6)。双子座的平均Flesch-Kincaid Grade Level最高,为11.3 (SD 1.5),其次是ChatGPT,为9.9 (SD 1.9),医生为9.2 (SD 2.4)。Gemini比ChatGPT更有可能包含免责声明(χ21=49.2)
{"title":"Comparison of Emotional Content in Text Responses From Physicians and AI Chatbots to Patient Health Queries: Cross-Sectional Study.","authors":"Daniel T Burns, Channing Bice, Paul E Johnson, Nicholas Chia, Timothy Robinson","doi":"10.2196/85516","DOIUrl":"10.2196/85516","url":null,"abstract":"<p><strong>Background: </strong>Surveys show that many people are willing to use generative artificial intelligence (AI) for health questions. Prior research has largely focused on chatbot accuracy, with some studies finding that both physicians and consumers overwhelmingly prefer chatbot-generated text over physician responses.</p><p><strong>Objective: </strong>This study aimed to characterize and compare the emotional content of responses from physicians and 2 AI chatbots (OpenAI's ChatGPT and Google's Gemini) and to assess differences in reading level and use of medical disclaimers.</p><p><strong>Methods: </strong>A public, patient-deidentified telehealth website was used to compile 100 physician-answered questions. The same questions were posed to both chatbots between May 18 and 19, 2025. Two coders classified the emotional content of each sentence using a predefined codebook and reviewed for agreement. Emotions were ranked as primary, secondary, and tertiary by the proportion of sentences classified as each emotion per response. Multinomial logistic regression compared emotional rankings using physician responses as the reference. Word count, Flesch Reading Ease, and Flesch-Kincaid Grade Level were analyzed via ANOVA with the Tukey honestly significant difference test. Disclaimer use was compared between chatbots using a χ<sup>2</sup> test.</p><p><strong>Results: </strong>Primary emotions were overwhelmingly neutral, except for one response from each chatbot in which anger was primary. For secondary emotions, the odds ratio of hope was 80.28% (95% CI 37.71%-93.76%) lower for ChatGPT, while the odds ratio of fear was 3.29 (95% CI 1.44-7.49) times higher for Gemini. For tertiary emotions, the odds ratio of compassion was 1.94 (95% CI 1.06-3.54) times higher, and the odds ratio of having no tertiary emotion was 84.33% (95% CI 64.72%-93.04%) lower for Gemini. Gemini responses averaged 889.1 (SD 305.7) words, ChatGPT 476.5 (SD 109.5), and physicians 193.5 (SD 113.6). Gemini had the lowest average Flesch Reading Ease score at 39.9 (SD 8.8), followed by ChatGPT at 45.8 (SD 12.8), while physicians had the highest at 51.9 (SD 13.6). Gemini had the highest average Flesch-Kincaid Grade Level at 11.3 (SD 1.5), followed by ChatGPT at 9.9 (SD 1.9), and physicians at 9.2 (SD 2.4). Gemini was significantly more likely to include a disclaimer than ChatGPT (χ<sup>2</sup><sub>1</sub>=49.2; P<.001).</p><p><strong>Conclusions: </strong>Chatbot responses were significantly (P<.001) longer and more difficult to read than physician responses and were more likely to contain a wider range of emotions. Qualitatively, chatbot responses were more varied in their presentation as well as in the breadth of the emotions themselves. The findings of this study could be used to inform more emotionally connected physician responses to patient message queries.</p>","PeriodicalId":16337,"journal":{"name":"Journal of Medical Internet Research","volume":"28 ","pages":"e85516"},"PeriodicalIF":6.0,"publicationDate":"2026-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13005063/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147369667","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Correction: Ingroup Favoritism Surrounding COVID-19 Vaccinations in the Hispanic Communities: Experimental Study. 更正:西班牙裔社区围绕COVID-19疫苗接种的群体偏袒:实验研究。
IF 6 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2026-03-06 DOI: 10.2196/90652
Juwon Hwang, Asya Cooley, Skye Cooley, Robert Hinck

[This corrects the article DOI: 10.2196/71188.].

[更正文章DOI: 10.2196/71188]。
{"title":"Correction: Ingroup Favoritism Surrounding COVID-19 Vaccinations in the Hispanic Communities: Experimental Study.","authors":"Juwon Hwang, Asya Cooley, Skye Cooley, Robert Hinck","doi":"10.2196/90652","DOIUrl":"10.2196/90652","url":null,"abstract":"<p><p>[This corrects the article DOI: 10.2196/71188.].</p>","PeriodicalId":16337,"journal":{"name":"Journal of Medical Internet Research","volume":"28 ","pages":"e90652"},"PeriodicalIF":6.0,"publicationDate":"2026-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13005055/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147369690","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Effectiveness of Interventions for Internet, Smartphone, and Gaming Addictions: Umbrella Review and Meta-Meta-Analysis. 干预网络、智能手机和游戏成瘾的有效性:总体回顾和元-元分析。
IF 6 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2026-03-05 DOI: 10.2196/81705
Minggang Zhang, Tong Lan, Tao Song, Xiaochun Wang

Background: Digital addiction, including internet, smartphone, and gaming addiction, has emerged as a significant global health concern. Although a wide range of interventions has been evaluated, the fragmented and siloed nature of existing meta-analyses limits a clear understanding of the comparative effectiveness of different interventions across addiction subtypes.

Objective: This umbrella review and meta-meta-analysis aimed to estimate the overall effectiveness of interventions for digital addiction and examine differential effects according to addiction subtype, intervention modality, study design, and control condition.

Methods: A systematic search of 5 electronic databases (PubMed, Web of Science, Scopus, APA PsycInfo, and the Cochrane Library) was conducted from inception to June 24, 2025. Eligible studies were systematic reviews with meta-analyses evaluating interventions for internet, smartphone, or gaming addiction. Random-effects models were applied to synthesize standardized mean differences (SMDs). Methodological quality and certainty of evidence were assessed using A Measurement Tool to Assess Systematic Reviews 2 and the Grading of Recommendations Assessment, Development, and Evaluation framework.

Results: A total of 29 meta-analyses, comprising 52 effect sizes and 66,530 participants, were included (I2=95.13%). Overall, interventions demonstrated a large and statistically significant effect in reducing digital addiction symptoms (SMD=-1.44, 95% CI -1.67 to -1.21; P=.003). Subgroup analyses indicated that the largest effects were observed for internet addiction (SMD=-1.70, 95% CI -1.99 to -1.42), followed by gaming addiction (SMD=-0.82, 95% CI -1.09 to -0.56) and smartphone addiction (SMD=-0.80, 95% CI -1.39 to -0.21). Exercise-based interventions, particularly those integrated with psychological approaches, showed large effect sizes (SMD=-3.14, 95% CI -4.30 to -1.97); however, this finding was based on a very limited number of effect sizes and should be interpreted cautiously. In addition, randomized controlled trials yielded larger effects than mixed study designs, and no-intervention controls were associated with larger effect sizes than mixed control conditions. The certainty of evidence was generally low.

Conclusions: Interventions for digital addiction are effective, although their magnitude of benefit varies by addiction subtype and intervention modality. These findings support the use of tailored and multimodal intervention strategies while highlighting the need for more rigorous, high-quality, and balanced evidence across different forms of digital addiction.

背景:数字成瘾,包括互联网、智能手机和游戏成瘾,已经成为一个重大的全球健康问题。尽管已经评估了广泛的干预措施,但现有荟萃分析的碎片化和孤立性限制了对不同成瘾亚型干预措施的比较有效性的清晰理解。目的:本综述和meta-meta分析旨在评估数字成瘾干预措施的总体有效性,并根据成瘾亚型、干预方式、研究设计和控制条件检查差异效果。方法:系统检索5个电子数据库(PubMed、Web of Science、Scopus、APA PsycInfo、Cochrane Library),检索时间自成立至2025年6月24日。符合条件的研究是通过荟萃分析评估网络、智能手机或游戏成瘾的干预措施的系统综述。采用随机效应模型综合标准化平均差(SMDs)。使用评估系统评价的测量工具2和建议分级评估、发展和评估框架评估方法学质量和证据的确定性。结果:共纳入29项荟萃分析,包括52个效应量和66,530名参与者(I2=95.13%)。总体而言,干预措施在减少数字成瘾症状方面显示出巨大且具有统计学意义的效果(SMD=-1.44, 95% CI = -1.67至-1.21;P= 0.003)。亚组分析表明,影响最大的是网络成瘾(SMD=-1.70, 95% CI -1.99至-1.42),其次是游戏成瘾(SMD=-0.82, 95% CI -1.09至-0.56)和智能手机成瘾(SMD=-0.80, 95% CI -1.39至-0.21)。以运动为基础的干预,特别是那些与心理学方法相结合的干预,显示出很大的效应量(SMD=-3.14, 95% CI -4.30至-1.97);然而,这一发现是基于非常有限的效应量,应该谨慎解释。此外,随机对照试验比混合研究设计产生更大的效应,无干预对照比混合对照条件产生更大的效应。证据的确定性普遍较低。结论:对数字成瘾的干预是有效的,尽管其益处的大小因成瘾亚型和干预方式而异。这些发现支持使用量身定制的多模式干预策略,同时强调需要针对不同形式的数字成瘾提供更严格、高质量和平衡的证据。
{"title":"Effectiveness of Interventions for Internet, Smartphone, and Gaming Addictions: Umbrella Review and Meta-Meta-Analysis.","authors":"Minggang Zhang, Tong Lan, Tao Song, Xiaochun Wang","doi":"10.2196/81705","DOIUrl":"10.2196/81705","url":null,"abstract":"<p><strong>Background: </strong>Digital addiction, including internet, smartphone, and gaming addiction, has emerged as a significant global health concern. Although a wide range of interventions has been evaluated, the fragmented and siloed nature of existing meta-analyses limits a clear understanding of the comparative effectiveness of different interventions across addiction subtypes.</p><p><strong>Objective: </strong>This umbrella review and meta-meta-analysis aimed to estimate the overall effectiveness of interventions for digital addiction and examine differential effects according to addiction subtype, intervention modality, study design, and control condition.</p><p><strong>Methods: </strong>A systematic search of 5 electronic databases (PubMed, Web of Science, Scopus, APA PsycInfo, and the Cochrane Library) was conducted from inception to June 24, 2025. Eligible studies were systematic reviews with meta-analyses evaluating interventions for internet, smartphone, or gaming addiction. Random-effects models were applied to synthesize standardized mean differences (SMDs). Methodological quality and certainty of evidence were assessed using A Measurement Tool to Assess Systematic Reviews 2 and the Grading of Recommendations Assessment, Development, and Evaluation framework.</p><p><strong>Results: </strong>A total of 29 meta-analyses, comprising 52 effect sizes and 66,530 participants, were included (I2=95.13%). Overall, interventions demonstrated a large and statistically significant effect in reducing digital addiction symptoms (SMD=-1.44, 95% CI -1.67 to -1.21; P=.003). Subgroup analyses indicated that the largest effects were observed for internet addiction (SMD=-1.70, 95% CI -1.99 to -1.42), followed by gaming addiction (SMD=-0.82, 95% CI -1.09 to -0.56) and smartphone addiction (SMD=-0.80, 95% CI -1.39 to -0.21). Exercise-based interventions, particularly those integrated with psychological approaches, showed large effect sizes (SMD=-3.14, 95% CI -4.30 to -1.97); however, this finding was based on a very limited number of effect sizes and should be interpreted cautiously. In addition, randomized controlled trials yielded larger effects than mixed study designs, and no-intervention controls were associated with larger effect sizes than mixed control conditions. The certainty of evidence was generally low.</p><p><strong>Conclusions: </strong>Interventions for digital addiction are effective, although their magnitude of benefit varies by addiction subtype and intervention modality. These findings support the use of tailored and multimodal intervention strategies while highlighting the need for more rigorous, high-quality, and balanced evidence across different forms of digital addiction.</p>","PeriodicalId":16337,"journal":{"name":"Journal of Medical Internet Research","volume":"28 ","pages":"e81705"},"PeriodicalIF":6.0,"publicationDate":"2026-03-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12978896/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147433690","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Interorganizational Mechanisms for Developing and Implementing Clinical Decision Support Systems in Primary Care: Exploratory, Qualitative Case Study. 在初级保健中发展和实施临床决策支持系统的组织间机制:探索性质的案例研究。
IF 6 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2026-03-05 DOI: 10.2196/83084
Jesse J M M Santema, Jeroen D H van Wijngaarden, Eric G Hiddink, Fleur Deken, Maaike Kleinsmann, Hendrikus J A van Os
<p><strong>Background: </strong>Clinical decision support systems (CDSS) have the potential to improve patient safety and reduce costs in primary care. However, CDSS adoption remains limited due to development and implementation challenges. CDSSs are complex interventions involving multiple interacting components that require technological innovation and behavioral and organizational change. Additionally, the primary care context is considered a complex system with high care demand, fragmented structures, and many independent yet interdependent organizations. Established determinant frameworks for implementing and scaling up complex health care interventions support the identification of implementation determinants. However, they offer limited guidance on the underlying processes of these determinants, such as the implementation processes involved in complex interorganizational collaboration in primary care.</p><p><strong>Objective: </strong>This study examined how an interorganizational collaboration in Dutch primary care (Gezonde zorg, Gezonde regio [GzGr]) achieved an iterative CDSS development and implementation. We aimed to identify the mechanisms that supported the collaboration in overcoming challenges.</p><p><strong>Methods: </strong>We performed an exploratory process-level case study. Data were collected through 15 semistructured interviews. The nonadoption, abandonment, scale-up, spread, and sustainability framework was used to ensure comprehensive topic coverage during the interviews, but not as an analytical framework. We triangulated the interviews with internal and external documents and expert input. Using a thematic, inductive approach, we developed a chronological overview of the collaboration and identified mechanisms offering insights into how GzGr navigated complexity in the development and implementation of CDSS.</p><p><strong>Results: </strong>We identified two mechanisms: (1) enacting an interorganizational value model and (2) iterative, co-creative experimentation. First, GzGr was driven by a coalition of the willing (ie, individuals willing to take an extra step), with shared goals that prioritized collective benefit while respecting organizational values. They established shared principles that translated the broad GzGr mission into concrete CDSS development choices, while also guiding strategic expansion by involving mission-aligned, innovative organizations. Second, after initial prototypes, GzGr established an iterative learning and improvement experimentation for both the technology and the collaboration. This process allowed for rapid feedback, validation of added value, and ongoing refinement. Additionally, this experimentation approached the development and implementation phase as a continuous process involving multistakeholders, supporting both the technology and the collaboration.</p><p><strong>Conclusions: </strong>This study identified 2 mechanisms that sustained interorganizational collaboration and CDSS dev
背景:临床决策支持系统(CDSS)具有提高患者安全性和降低初级保健成本的潜力。然而,由于开发和实施方面的挑战,CDSS的采用仍然有限。cdss是复杂的干预措施,涉及多个相互作用的组件,需要技术创新、行为和组织变革。此外,初级保健环境被认为是一个复杂的系统,具有高护理需求,碎片化结构和许多独立但相互依存的组织。实施和扩大复杂卫生保健干预措施的既定决定因素框架有助于确定实施决定因素。然而,它们对这些决定因素的基本过程提供了有限的指导,例如涉及初级保健中复杂的组织间合作的实施过程。目的:本研究考察了荷兰初级保健(Gezonde zorg, Gezonde regio [GzGr])的组织间合作如何实现CDSS的迭代开发和实施。我们的目标是确定支持合作克服挑战的机制。方法:我们进行了一个探索性的过程级案例研究。数据通过15个半结构化访谈收集。不采用、放弃、规模扩大、传播和可持续性框架用于确保访谈期间全面的主题覆盖,但不作为分析框架。我们用内部和外部文件以及专家意见对访谈进行了三角分析。使用主题的归纳方法,我们对合作进行了按时间顺序的概述,并确定了机制,为GzGr如何在CDSS的开发和实施中导航复杂性提供了见解。结果:我们确定了两种机制:(1)制定组织间价值模型(2)迭代,共同创造实验。首先,GzGr是由自愿联盟(即愿意采取额外步骤的个人)驱动的,他们有共同的目标,优先考虑集体利益,同时尊重组织价值观。他们建立了共同的原则,将广泛的GzGr使命转化为具体的CDSS发展选择,同时还通过让使命一致的创新组织参与进来,指导战略扩张。其次,在初始原型之后,GzGr为技术和协作建立了迭代学习和改进实验。这个过程允许快速反馈、附加价值的验证和持续的细化。此外,该实验将开发和实现阶段作为一个涉及多个利益相关者的连续过程,同时支持技术和协作。结论:本研究确定了两种持续组织间协作和CDSS发展的机制。这些机制连接了跨人员、技术和组织级别的协作和技术变更,使技术可行性、涉众价值和多层次支持成为可能。这些机制通过开发和实现的迭代周期在组织内部和组织之间运行。实际影响包括涉及多层次、创新和有影响力的利益相关者;通过协调参与者保持一致性;在开发和实现之间采用迭代方法。我们的研究结果扩展了现有的决定框架,为这些机制如何在组织间合作中帮助克服CDSS开发和实施中的挑战提供了过程级的见解。
{"title":"Interorganizational Mechanisms for Developing and Implementing Clinical Decision Support Systems in Primary Care: Exploratory, Qualitative Case Study.","authors":"Jesse J M M Santema, Jeroen D H van Wijngaarden, Eric G Hiddink, Fleur Deken, Maaike Kleinsmann, Hendrikus J A van Os","doi":"10.2196/83084","DOIUrl":"10.2196/83084","url":null,"abstract":"&lt;p&gt;&lt;strong&gt;Background: &lt;/strong&gt;Clinical decision support systems (CDSS) have the potential to improve patient safety and reduce costs in primary care. However, CDSS adoption remains limited due to development and implementation challenges. CDSSs are complex interventions involving multiple interacting components that require technological innovation and behavioral and organizational change. Additionally, the primary care context is considered a complex system with high care demand, fragmented structures, and many independent yet interdependent organizations. Established determinant frameworks for implementing and scaling up complex health care interventions support the identification of implementation determinants. However, they offer limited guidance on the underlying processes of these determinants, such as the implementation processes involved in complex interorganizational collaboration in primary care.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Objective: &lt;/strong&gt;This study examined how an interorganizational collaboration in Dutch primary care (Gezonde zorg, Gezonde regio [GzGr]) achieved an iterative CDSS development and implementation. We aimed to identify the mechanisms that supported the collaboration in overcoming challenges.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Methods: &lt;/strong&gt;We performed an exploratory process-level case study. Data were collected through 15 semistructured interviews. The nonadoption, abandonment, scale-up, spread, and sustainability framework was used to ensure comprehensive topic coverage during the interviews, but not as an analytical framework. We triangulated the interviews with internal and external documents and expert input. Using a thematic, inductive approach, we developed a chronological overview of the collaboration and identified mechanisms offering insights into how GzGr navigated complexity in the development and implementation of CDSS.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Results: &lt;/strong&gt;We identified two mechanisms: (1) enacting an interorganizational value model and (2) iterative, co-creative experimentation. First, GzGr was driven by a coalition of the willing (ie, individuals willing to take an extra step), with shared goals that prioritized collective benefit while respecting organizational values. They established shared principles that translated the broad GzGr mission into concrete CDSS development choices, while also guiding strategic expansion by involving mission-aligned, innovative organizations. Second, after initial prototypes, GzGr established an iterative learning and improvement experimentation for both the technology and the collaboration. This process allowed for rapid feedback, validation of added value, and ongoing refinement. Additionally, this experimentation approached the development and implementation phase as a continuous process involving multistakeholders, supporting both the technology and the collaboration.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Conclusions: &lt;/strong&gt;This study identified 2 mechanisms that sustained interorganizational collaboration and CDSS dev","PeriodicalId":16337,"journal":{"name":"Journal of Medical Internet Research","volume":"28 ","pages":"e83084"},"PeriodicalIF":6.0,"publicationDate":"2026-03-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12978902/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147433811","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using Epidemiological Test Diagnostics to Select Fraud Detection Methods: Secondary Analysis of Quantitative Cross-Sectional Survey Data. 使用流行病学测试诊断选择欺诈检测方法:定量横断面调查数据的二次分析。
IF 6 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Pub Date : 2026-03-05 DOI: 10.2196/85161
Rachel Willard-Grace, Tali Klima, Mansi Dedhia, Emily Lo, Annie Nisnevich, Allison Gray, Holly Henry
<p><strong>Background: </strong>Survey research has the potential to elevate the experiences and opinions of marginalized populations. The rising number of bot attacks, a method of participant fraud that creates multiple records in survey data using automated software, threatens to drown out those voices and produce inaccurate findings. Rapid identification and mitigation of bot attacks are vital; however, there is limited guidance for researchers on scalable approaches to address this problem.</p><p><strong>Objective: </strong>This study aimed to assess how well recommended methods detect fraud using an epidemiological diagnostic test framework to inform web-based survey researchers on how best to identify and shut down bot attacks.</p><p><strong>Methods: </strong>We analyzed data from a cross-sectional web-based statewide survey on access to pediatric subspecialty care in California that used Qualtrics survey software. Caregivers of children with chronic conditions were recruited through family resource centers (FRCs), nonprofit agencies serving families with developmental delays and chronic medical conditions. The survey was sent out to 17 FRCs, whose staff distributed anonymous links to their clients through listservs and flyers. Respondents who completed the survey received a US $30 gift card. Prior to launch, we designed a protocol to identify and respond to bot attacks and reviewed responses for markers of fraudulent activity. If markers were identified or there was a spike in responses, a senior member of our research team reviewed patterns among all submitted surveys for each FRC to look for signs of bot attacks. We calculated epidemiologic measures of diagnostic test accuracy, such as sensitivity, specificity, positive predictive value, and negative predictive value, which describe a test's ability to distinguish "disease" (in this case, fraudulent records) from normal cases, to better understand the utility of recommended strategies to identify bot attacks.</p><p><strong>Results: </strong>We received 646 valid survey records and 905 fraudulent records resulting from bot attacks. The primary indicator of a bot attack was a sudden spike in responses to the survey. Differences in demographics and outcomes, including wait times for pediatric subspecialty care and use of health care services, between the valid and fraudulent data indicated that failure to remove fraudulent records would have substantially altered the survey results. Most recommended methods in the literature for identifying fraudulent responses had low sensitivity to detect bot attacks, and only 2 were better than chance alone at correctly identifying bot attacks. Combinations of fraud markers and blocks of repeated responses were particularly useful to identify bot attacks.</p><p><strong>Conclusions: </strong>Fraudulent data entry using bots is increasing in survey research. Sharing flexible protocols to identify and mitigate them in a way that is responsive to their ever-
背景:调查研究有可能提升边缘化人群的经验和意见。越来越多的机器人攻击(一种参与者欺诈的方法,使用自动化软件在调查数据中创建多个记录)可能会淹没这些声音,并产生不准确的调查结果。快速识别和减轻僵尸程序攻击至关重要;然而,对于研究人员解决这个问题的可扩展方法的指导有限。目的:本研究旨在评估使用流行病学诊断测试框架检测欺诈的推荐方法,以告知基于网络的调查研究人员如何最好地识别和关闭机器人攻击。方法:我们使用Qualtrics调查软件,分析了加利福尼亚州儿童亚专科护理的横断面网络全州调查数据。患有慢性疾病的儿童的照顾者是通过家庭资源中心(FRCs)招募的,这些非营利机构为患有发育迟缓和慢性疾病的家庭提供服务。这项调查被发送给17个财务汇报中心,这些财务汇报中心的工作人员通过列表服务和传单向客户分发匿名链接。完成调查的受访者收到一张价值30美元的礼品卡。在发布之前,我们设计了一个协议来识别和响应机器人攻击,并审查了欺诈活动标记的响应。如果确定了标记或响应激增,我们研究团队的一名高级成员会审查每个财务报告委员会提交的所有调查的模式,以寻找机器人攻击的迹象。我们计算了诊断测试准确性的流行病学指标,如敏感性、特异性、阳性预测值和阴性预测值,这些指标描述了测试区分“疾病”(在这种情况下是欺诈记录)与正常病例的能力,以更好地理解识别机器人攻击的推荐策略的效用。结果:我们收到了646条有效的调查记录和905条由于bot攻击而导致的欺诈记录。机器人攻击的主要指标是对调查的回应突然激增。有效数据和欺诈数据之间的人口统计数据和结果(包括儿科亚专科护理的等待时间和卫生保健服务的使用)的差异表明,未能删除欺诈记录将大大改变调查结果。大多数文献中推荐的识别欺诈性响应的方法对检测bot攻击的敏感性较低,只有两种方法在正确识别bot攻击方面比单独使用机会更好。欺诈标记和重复响应块的组合对于识别机器人攻击特别有用。结论:在调查研究中,使用机器人的欺诈数据输入越来越多。共享灵活的协议,以对其不断变化的性质作出反应的方式识别和减轻它们,对于确保研究人员在调查研究中提高真实人群的声音,从而为政策和规划讨论提供信息至关重要。
{"title":"Using Epidemiological Test Diagnostics to Select Fraud Detection Methods: Secondary Analysis of Quantitative Cross-Sectional Survey Data.","authors":"Rachel Willard-Grace, Tali Klima, Mansi Dedhia, Emily Lo, Annie Nisnevich, Allison Gray, Holly Henry","doi":"10.2196/85161","DOIUrl":"10.2196/85161","url":null,"abstract":"&lt;p&gt;&lt;strong&gt;Background: &lt;/strong&gt;Survey research has the potential to elevate the experiences and opinions of marginalized populations. The rising number of bot attacks, a method of participant fraud that creates multiple records in survey data using automated software, threatens to drown out those voices and produce inaccurate findings. Rapid identification and mitigation of bot attacks are vital; however, there is limited guidance for researchers on scalable approaches to address this problem.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Objective: &lt;/strong&gt;This study aimed to assess how well recommended methods detect fraud using an epidemiological diagnostic test framework to inform web-based survey researchers on how best to identify and shut down bot attacks.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Methods: &lt;/strong&gt;We analyzed data from a cross-sectional web-based statewide survey on access to pediatric subspecialty care in California that used Qualtrics survey software. Caregivers of children with chronic conditions were recruited through family resource centers (FRCs), nonprofit agencies serving families with developmental delays and chronic medical conditions. The survey was sent out to 17 FRCs, whose staff distributed anonymous links to their clients through listservs and flyers. Respondents who completed the survey received a US $30 gift card. Prior to launch, we designed a protocol to identify and respond to bot attacks and reviewed responses for markers of fraudulent activity. If markers were identified or there was a spike in responses, a senior member of our research team reviewed patterns among all submitted surveys for each FRC to look for signs of bot attacks. We calculated epidemiologic measures of diagnostic test accuracy, such as sensitivity, specificity, positive predictive value, and negative predictive value, which describe a test's ability to distinguish \"disease\" (in this case, fraudulent records) from normal cases, to better understand the utility of recommended strategies to identify bot attacks.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Results: &lt;/strong&gt;We received 646 valid survey records and 905 fraudulent records resulting from bot attacks. The primary indicator of a bot attack was a sudden spike in responses to the survey. Differences in demographics and outcomes, including wait times for pediatric subspecialty care and use of health care services, between the valid and fraudulent data indicated that failure to remove fraudulent records would have substantially altered the survey results. Most recommended methods in the literature for identifying fraudulent responses had low sensitivity to detect bot attacks, and only 2 were better than chance alone at correctly identifying bot attacks. Combinations of fraud markers and blocks of repeated responses were particularly useful to identify bot attacks.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Conclusions: &lt;/strong&gt;Fraudulent data entry using bots is increasing in survey research. Sharing flexible protocols to identify and mitigate them in a way that is responsive to their ever-","PeriodicalId":16337,"journal":{"name":"Journal of Medical Internet Research","volume":"28 ","pages":"e85161"},"PeriodicalIF":6.0,"publicationDate":"2026-03-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12978920/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147433824","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of Medical Internet Research
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1