首页 > 最新文献

JMIR Human Factors最新文献

英文 中文
Prediction of Hearing Help Seeking to Design a Recommendation Module of an mHealth Hearing App: Intensive Longitudinal Study of Feature Importance Assessment. 预测听力求助以设计移动保健听力应用程序的推荐模块:特征重要性评估的深入纵向研究。
IF 2.6 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-08-12 DOI: 10.2196/52310
Giulia Angonese, Mareike Buhl, Inka Kuhlmann, Birger Kollmeier, Andrea Hildebrandt

Background: Mobile health (mHealth) solutions can improve the quality, accessibility, and equity of health services, fostering early rehabilitation. For individuals with hearing loss, mHealth apps might be designed to support the decision-making processes in auditory diagnostics and provide treatment recommendations to the user (eg, hearing aid need). For some individuals, such an mHealth app might be the first contact with a hearing diagnostic service and should motivate users with hearing loss to seek professional help in a targeted manner. However, personalizing treatment recommendations is only possible by knowing the individual's profile regarding the outcome of interest.

Objective: This study aims to characterize individuals who are more or less prone to seeking professional help after the repeated use of an app-based hearing test. The goal was to derive relevant hearing-related traits and personality characteristics for personalized treatment recommendations for users of mHealth hearing solutions.

Methods: In total, 185 (n=106, 57.3% female) nonaided older individuals (mean age 63.8, SD 6.6 y) with subjective hearing loss participated in a mobile study. We collected cross-sectional and longitudinal data on a comprehensive set of 83 hearing-related and psychological measures among those previously found to predict hearing help seeking. Readiness to seek help was assessed as the outcome variable at study end and after 2 months. Participants were classified into help seekers and nonseekers using several supervised machine learning algorithms (random forest, naïve Bayes, and support vector machine). The most relevant features for prediction were identified using feature importance analysis.

Results: The algorithms correctly predicted action to seek help at study end in 65.9% (122/185) to 70.3% (130/185) of cases, reaching 74.8% (98/131) classification accuracy at follow-up. Among the most important features for classification beyond hearing performance were the perceived consequences of hearing loss in daily life, attitude toward hearing aids, motivation to seek help, physical health, sensory sensitivity personality trait, neuroticism, and income.

Conclusions: This study contributes to the identification of individual characteristics that predict help seeking in older individuals with self-reported hearing loss. Suggestions are made for their implementation in an individual-profiling algorithm and for deriving targeted recommendations in mHealth hearing apps.

背景:移动医疗(mHealth)解决方案可以提高医疗服务的质量、可及性和公平性,促进早期康复。对于听力损失患者,移动医疗应用程序的设计可以支持听力诊断的决策过程,并向用户提供治疗建议(如助听器需求)。对某些人来说,这样的移动医疗应用程序可能是与听力诊断服务的第一次接触,应能促使听力损失用户有针对性地寻求专业帮助。然而,只有了解个人在相关结果方面的情况,才有可能提供个性化的治疗建议:本研究旨在了解反复使用基于应用程序的听力测试后,哪些人更倾向于或不太倾向于寻求专业帮助。目的是得出与听力相关的特征和个性特征,为移动医疗听力解决方案的用户提供个性化治疗建议:共有 185 名(n=106,57.3% 为女性)患有主观听力损失的非受助老年人(平均年龄 63.8 岁,标准差 6.6 岁)参与了一项移动研究。我们收集了 83 项听力相关和心理测量的横向和纵向综合数据,其中包括以前发现的可预测听力求助的数据。在研究结束时和 2 个月后,求助意愿作为结果变量进行评估。使用几种有监督的机器学习算法(随机森林、天真贝叶斯和支持向量机)将参与者分为求助者和非求助者。使用特征重要性分析确定了与预测最相关的特征:在研究结束时,这些算法正确预测了65.9%(122/185)至70.3%(130/185)的病例的求助行动,在随访时达到了74.8%(98/131)的分类准确率。除听力表现外,最重要的分类特征包括日常生活中对听力损失后果的感知、对助听器的态度、寻求帮助的动机、身体健康、感觉敏感性人格特质、神经质和收入:本研究有助于确定可预测自述听力损失的老年人寻求帮助的个人特征。结论:本研究有助于确定可预测自述听力损失的老年人寻求帮助的个人特征,并建议将这些特征应用于个人特征描述算法和移动医疗听力应用程序中的针对性建议。
{"title":"Prediction of Hearing Help Seeking to Design a Recommendation Module of an mHealth Hearing App: Intensive Longitudinal Study of Feature Importance Assessment.","authors":"Giulia Angonese, Mareike Buhl, Inka Kuhlmann, Birger Kollmeier, Andrea Hildebrandt","doi":"10.2196/52310","DOIUrl":"10.2196/52310","url":null,"abstract":"<p><strong>Background: </strong>Mobile health (mHealth) solutions can improve the quality, accessibility, and equity of health services, fostering early rehabilitation. For individuals with hearing loss, mHealth apps might be designed to support the decision-making processes in auditory diagnostics and provide treatment recommendations to the user (eg, hearing aid need). For some individuals, such an mHealth app might be the first contact with a hearing diagnostic service and should motivate users with hearing loss to seek professional help in a targeted manner. However, personalizing treatment recommendations is only possible by knowing the individual's profile regarding the outcome of interest.</p><p><strong>Objective: </strong>This study aims to characterize individuals who are more or less prone to seeking professional help after the repeated use of an app-based hearing test. The goal was to derive relevant hearing-related traits and personality characteristics for personalized treatment recommendations for users of mHealth hearing solutions.</p><p><strong>Methods: </strong>In total, 185 (n=106, 57.3% female) nonaided older individuals (mean age 63.8, SD 6.6 y) with subjective hearing loss participated in a mobile study. We collected cross-sectional and longitudinal data on a comprehensive set of 83 hearing-related and psychological measures among those previously found to predict hearing help seeking. Readiness to seek help was assessed as the outcome variable at study end and after 2 months. Participants were classified into help seekers and nonseekers using several supervised machine learning algorithms (random forest, naïve Bayes, and support vector machine). The most relevant features for prediction were identified using feature importance analysis.</p><p><strong>Results: </strong>The algorithms correctly predicted action to seek help at study end in 65.9% (122/185) to 70.3% (130/185) of cases, reaching 74.8% (98/131) classification accuracy at follow-up. Among the most important features for classification beyond hearing performance were the perceived consequences of hearing loss in daily life, attitude toward hearing aids, motivation to seek help, physical health, sensory sensitivity personality trait, neuroticism, and income.</p><p><strong>Conclusions: </strong>This study contributes to the identification of individual characteristics that predict help seeking in older individuals with self-reported hearing loss. Suggestions are made for their implementation in an individual-profiling algorithm and for deriving targeted recommendations in mHealth hearing apps.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"11 ","pages":"e52310"},"PeriodicalIF":2.6,"publicationDate":"2024-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11347899/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141917597","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluating the Construct Validity of the Charité Alarm Fatigue Questionnaire using Confirmatory Factor Analysis. 利用确证因子分析评估 Charité 警报疲劳问卷的结构有效性。
IF 2.6 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-08-08 DOI: 10.2196/57658
Maximilian Markus Wunderlich, Henning Krampe, Kristina Fuest, Dominik Leicht, Moriz Benedikt Probst, Julian Runge, Sebastian Schmid, Claudia Spies, Björn Weiß, Felix Balzer, Akira-Sebastian Poncette

Background: The Charité Alarm Fatigue Questionnaire (CAFQa) is a 9-item questionnaire that aims to standardize how alarm fatigue in nurses and physicians is measured. We previously hypothesized that it has 2 correlated scales, one on the psychosomatic effects of alarm fatigue and the other on staff's coping strategies in working with alarms.

Objective: We aimed to validate the hypothesized structure of the CAFQa and thus underpin the instrument's construct validity.

Methods: We conducted 2 independent studies with nurses and physicians from intensive care units in Germany (study 1: n=265; study 2: n=1212). Responses to the questionnaire were analyzed using confirmatory factor analysis with the unweighted least-squares algorithm based on polychoric covariances. Convergent validity was assessed by participants' estimation of their own alarm fatigue and exposure to false alarms as a percentage.

Results: In both studies, the χ2 test reached statistical significance (study 1: χ226=44.9; P=.01; study 2: χ226=92.4; P<.001). Other fit indices suggested a good model fit (in both studies: root mean square error of approximation <0.05, standardized root mean squared residual <0.08, relative noncentrality index >0.95, Tucker-Lewis index >0.95, and comparative fit index >0.995). Participants' mean scores correlated moderately with self-reported alarm fatigue (study 1: r=0.45; study 2: r=0.53) and weakly with self-perceived exposure to false alarms (study 1: r=0.3; study 2: r=0.33).

Conclusions: The questionnaire measures the construct of alarm fatigue as proposed in our previous study. Researchers and clinicians can rely on the CAFQa to measure the alarm fatigue of nurses and physicians.

背景:Charité 警报疲劳问卷(CAFQa)是一份包含 9 个项目的问卷,旨在规范护士和医生警报疲劳的测量方法。我们之前曾假设它有两个相关量表,一个是关于警报疲劳的心身影响,另一个是关于员工在处理警报时的应对策略:我们旨在验证 CAFQa 的假设结构,从而巩固该工具的结构效度:我们对德国重症监护病房的护士和医生进行了两项独立研究(研究 1:n=265;研究 2:n=1212)。采用基于多变量协方差的非加权最小二乘法确认性因素分析法对问卷进行了分析。通过参与者对自身警报疲劳度和误报率的估计,评估了问卷的收敛效度:在两项研究中,χ2 检验均达到统计学意义(研究 1:χ226=44.9;P=.01;研究 2:χ226=92.4;P0.95,Tucker-Lewis 指数大于 0.95,比较拟合指数大于 0.995)。参与者的平均得分与自我报告的警报疲劳度呈中度相关(研究 1:r=0.45;研究 2:r=0.53),与自我感觉的错误警报暴露度呈弱相关(研究 1:r=0.3;研究 2:r=0.33):该问卷可测量我们之前研究中提出的警报疲劳结构。研究人员和临床医生可以依靠 CAFQa 来测量护士和医生的警报疲劳。
{"title":"Evaluating the Construct Validity of the Charité Alarm Fatigue Questionnaire using Confirmatory Factor Analysis.","authors":"Maximilian Markus Wunderlich, Henning Krampe, Kristina Fuest, Dominik Leicht, Moriz Benedikt Probst, Julian Runge, Sebastian Schmid, Claudia Spies, Björn Weiß, Felix Balzer, Akira-Sebastian Poncette","doi":"10.2196/57658","DOIUrl":"10.2196/57658","url":null,"abstract":"<p><strong>Background: </strong>The Charité Alarm Fatigue Questionnaire (CAFQa) is a 9-item questionnaire that aims to standardize how alarm fatigue in nurses and physicians is measured. We previously hypothesized that it has 2 correlated scales, one on the psychosomatic effects of alarm fatigue and the other on staff's coping strategies in working with alarms.</p><p><strong>Objective: </strong>We aimed to validate the hypothesized structure of the CAFQa and thus underpin the instrument's construct validity.</p><p><strong>Methods: </strong>We conducted 2 independent studies with nurses and physicians from intensive care units in Germany (study 1: n=265; study 2: n=1212). Responses to the questionnaire were analyzed using confirmatory factor analysis with the unweighted least-squares algorithm based on polychoric covariances. Convergent validity was assessed by participants' estimation of their own alarm fatigue and exposure to false alarms as a percentage.</p><p><strong>Results: </strong>In both studies, the χ2 test reached statistical significance (study 1: χ226=44.9; P=.01; study 2: χ226=92.4; P<.001). Other fit indices suggested a good model fit (in both studies: root mean square error of approximation <0.05, standardized root mean squared residual <0.08, relative noncentrality index >0.95, Tucker-Lewis index >0.95, and comparative fit index >0.995). Participants' mean scores correlated moderately with self-reported alarm fatigue (study 1: r=0.45; study 2: r=0.53) and weakly with self-perceived exposure to false alarms (study 1: r=0.3; study 2: r=0.33).</p><p><strong>Conclusions: </strong>The questionnaire measures the construct of alarm fatigue as proposed in our previous study. Researchers and clinicians can rely on the CAFQa to measure the alarm fatigue of nurses and physicians.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"11 ","pages":"e57658"},"PeriodicalIF":2.6,"publicationDate":"2024-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11539858/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141907881","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Application of an Adapted Health Action Process Approach Model to Predict Engagement With a Digital Mental Health Website: Cross-Sectional Study. 应用改编的健康行动过程方法模型预测数字心理健康网站的参与度:横断面研究。
IF 2.6 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-08-07 DOI: 10.2196/57082
Julien Rouvere, Brittany E Blanchard, Morgan Johnson, Isabell Griffith Fillipo, Brittany Mosser, Meghan Romanelli, Theresa Nguyen, Kevin Rushton, John Marion, Tim Althoff, Patricia A Areán, Michael D Pullmann

Background: Digital Mental Health (DMH) tools are an effective, readily accessible, and affordable form of mental health support. However, sustained engagement with DMH is suboptimal, with limited research on DMH engagement. The Health Action Process Approach (HAPA) is an empirically supported theory of health behavior adoption and maintenance. Whether this model also explains DMH tool engagement remains unknown.

Objective: This study examined whether an adapted HAPA model predicted engagement with DMH via a self-guided website.

Methods: Visitors to the Mental Health America (MHA) website were invited to complete a brief survey measuring HAPA constructs. This cross-sectional study tested the adapted HAPA model with data collected using voluntary response sampling from 16,078 sessions (15,619 unique IP addresses from United States residents) on the MHA website from October 2021 through February 2022. Model fit was examined via structural equation modeling in predicting two engagement outcomes: (1) choice to engage with DMH (ie, spending 3 or more seconds on an MHA page, excluding screening pages) and (2) level of engagement (ie, time spent on MHA pages and number of pages visited, both excluding screening pages).

Results: Participants chose to engage with the MHA website in 94.3% (15,161/16,078) of the sessions. Perceived need (β=.66; P<.001), outcome expectancies (β=.49; P<.001), self-efficacy (β=.44; P<.001), and perceived risk (β=.17-.18; P<.001) significantly predicted intention, and intention (β=.77; P<.001) significantly predicted planning. Planning was not significantly associated with choice to engage (β=.03; P=.18). Within participants who chose to engage, the association between planning with level of engagement was statistically significant (β=.12; P<.001). Model fit indices for both engagement outcomes were poor, with the adapted HAPA model accounting for only 0.1% and 1.4% of the variance in choice to engage and level of engagement, respectively.

Conclusions: Our data suggest that the HAPA model did not predict engagement with DMH via a self-guided website. More research is needed to identify appropriate theoretical frameworks and practical strategies (eg, digital design) to optimize DMH tool engagement.

背景:数字心理健康(DMH)工具是一种有效、易于获取且价格合理的心理健康支持形式。然而,人们对数字心理健康工具的持续参与度并不理想,对数字心理健康工具参与度的研究也很有限。健康行动过程方法 (Health Action Process Approach,HAPA) 是一种得到经验支持的健康行为采纳和维持理论。该模型是否也能解释 DMH 工具的参与情况,目前仍是未知数:本研究考察了改编后的 HAPA 模型是否能预测通过自助网站参与 DMH 的情况:方法:邀请美国心理健康协会(MHA)网站的访问者完成一项简短的调查,测量HAPA的构建。这项横断面研究利用从 2021 年 10 月到 2022 年 2 月在美国心理健康协会网站上从 16,078 次会话(15,619 个来自美国居民的唯一 IP 地址)中收集的自愿响应抽样数据,对改编后的 HAPA 模型进行了测试。通过结构方程模型检验了模型在预测两种参与结果方面的拟合度:(1)选择参与 DMH(即在 MHA 页面上花费 3 秒或更多时间,不包括筛选页面)和(2)参与程度(即在 MHA 页面上花费的时间和访问的页面数量,均不包括筛选页面):结果:94.3%(15,161/16,078)的参与者选择访问 MHA 网站。感知需求(β=.66;PC结论:我们的数据表明,HAPA模型能够满足参与者的感知需求:我们的数据表明,HAPA 模型并不能预测通过自助网站参与 DMH 的情况。需要进行更多的研究来确定适当的理论框架和实践策略(如数字设计),以优化 DMH 工具的参与度。
{"title":"Application of an Adapted Health Action Process Approach Model to Predict Engagement With a Digital Mental Health Website: Cross-Sectional Study.","authors":"Julien Rouvere, Brittany E Blanchard, Morgan Johnson, Isabell Griffith Fillipo, Brittany Mosser, Meghan Romanelli, Theresa Nguyen, Kevin Rushton, John Marion, Tim Althoff, Patricia A Areán, Michael D Pullmann","doi":"10.2196/57082","DOIUrl":"10.2196/57082","url":null,"abstract":"<p><strong>Background: </strong>Digital Mental Health (DMH) tools are an effective, readily accessible, and affordable form of mental health support. However, sustained engagement with DMH is suboptimal, with limited research on DMH engagement. The Health Action Process Approach (HAPA) is an empirically supported theory of health behavior adoption and maintenance. Whether this model also explains DMH tool engagement remains unknown.</p><p><strong>Objective: </strong>This study examined whether an adapted HAPA model predicted engagement with DMH via a self-guided website.</p><p><strong>Methods: </strong>Visitors to the Mental Health America (MHA) website were invited to complete a brief survey measuring HAPA constructs. This cross-sectional study tested the adapted HAPA model with data collected using voluntary response sampling from 16,078 sessions (15,619 unique IP addresses from United States residents) on the MHA website from October 2021 through February 2022. Model fit was examined via structural equation modeling in predicting two engagement outcomes: (1) choice to engage with DMH (ie, spending 3 or more seconds on an MHA page, excluding screening pages) and (2) level of engagement (ie, time spent on MHA pages and number of pages visited, both excluding screening pages).</p><p><strong>Results: </strong>Participants chose to engage with the MHA website in 94.3% (15,161/16,078) of the sessions. Perceived need (β=.66; P<.001), outcome expectancies (β=.49; P<.001), self-efficacy (β=.44; P<.001), and perceived risk (β=.17-.18; P<.001) significantly predicted intention, and intention (β=.77; P<.001) significantly predicted planning. Planning was not significantly associated with choice to engage (β=.03; P=.18). Within participants who chose to engage, the association between planning with level of engagement was statistically significant (β=.12; P<.001). Model fit indices for both engagement outcomes were poor, with the adapted HAPA model accounting for only 0.1% and 1.4% of the variance in choice to engage and level of engagement, respectively.</p><p><strong>Conclusions: </strong>Our data suggest that the HAPA model did not predict engagement with DMH via a self-guided website. More research is needed to identify appropriate theoretical frameworks and practical strategies (eg, digital design) to optimize DMH tool engagement.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"11 ","pages":"e57082"},"PeriodicalIF":2.6,"publicationDate":"2024-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11339574/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141903120","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Effects of a Digital Care Pathway for Multiple Sclerosis: Observational Study. 多发性硬化症数字化护理路径的效果:观察研究。
IF 2.6 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-08-07 DOI: 10.2196/51872
Märt Vesinurm, Anna Maunula, Päivi Olli, Paul Lillrank, Petra Ijäs, Paulus Torkki, Laura Mäkitie, Sini M Laakso

Background: Helsinki University Hospital has developed a digital care pathway (DCP) for people with multiple sclerosis (MS) to improve the care quality. DCP was designed for especially newly diagnosed patients to support adaptation to a chronic disease.

Objective: This study investigated the MS DCP user behavior and its impact on patient education-mediated changes in health care use, patient-perceived impact of MS on psychological and physical functional health, and patient satisfaction.

Methods: We collected data from the service launch in March 2020 until the end of 2022 (observation period). The number of users, user logins, and their timing and messages sent were collected. The association of the DCP on health care use was studied in a case-control setting in which patients were allowed to freely select whether they wanted to use the service (DCP group n=63) or not (control group n=112). The number of physical and remote appointments either to a doctor, nurse, or other services were considered in addition to emergency department visits and inpatient days. The follow-up time was 1 year (study period). Furthermore, a subgroup of 36 patients was recruited to fill out surveys on net promoter score (NPS) at 3, 6, and 12 months, and their physical and psychological functional health (Multiple Sclerosis Impact Scale) at 0, 3, 6, and 12 months.

Results: During the observation period, a total of 225 patients had the option to use the service, out of whom 79.1% (178/225) logged into the service. On average, a user of the DCP sent 6.8 messages and logged on 7.4 times, with 72.29% (1182/1635) of logins taking place within 1 year of initiating the service. In case-control cohorts, no statistically significant differences between the groups were found for physical doctors' appointments, remote doctors' contacts, physical nurse appointments, remote nurse contacts, emergency department visits, or inpatient days. However, the MS DCP was associated with a 2.05 (SD 0.48) visit increase in other services, within 1 year from diagnosis. In the prospective DCP-cohort, no clinically significant change was observed in the physical functional health between the 0 and 12-month marks, but psychological functional health was improved between 3 and 6 months. Patient satisfaction improved from the NPS index of 21 (favorable) at the 3-month mark to the NPS index of 63 (excellent) at the 12-month mark.

Conclusions: The MS DCP has been used by a majority of the people with MS as a complementary service to regular operations, and we find high satisfaction with the service. Psychological health was enhanced during the use of MS DCP. Our results indicate that DCPs hold great promise for managing chronic conditions such as MS. Future studies should explore the potential of DCPs in different health care settings and patient subgroups.

背景:赫尔辛基大学医院为多发性硬化症(MS)患者开发了数字护理路径(DCP),以提高护理质量。DCP 专为新确诊患者设计,以帮助他们适应慢性疾病:本研究调查了多发性硬化症 DCP 用户行为及其对以患者教育为中介的医疗保健使用变化、患者感知到的多发性硬化症对心理和身体功能健康的影响以及患者满意度的影响:我们收集了从 2020 年 3 月服务启动到 2022 年底(观察期)的数据。方法:我们收集了从 2020 年 3 月服务推出到 2022 年底(观察期)的数据,收集了用户数量、用户登录、登录时间和发送的信息。在病例对照环境中研究了 DCP 与医疗服务使用的关系,患者可自由选择是否使用该服务(DCP 组 n=63)(对照组 n=112)。除了急诊室就诊次数和住院天数外,还考虑了与医生、护士或其他服务机构的实际预约和远程预约次数。随访时间为 1 年(研究期)。此外,研究人员还招募了 36 名患者,分别在 3 个月、6 个月和 12 个月时填写净促进者得分(NPS)调查表,并在 0 个月、3 个月、6 个月和 12 个月时填写身心功能健康(多发性硬化影响量表)调查表:在观察期间,共有 225 名患者选择使用该服务,其中 79.1%(178/225)的患者登录了该服务。DCP用户平均发送6.8条信息,登录7.4次,72.29%(1182/1635)的登录发生在启动服务后的1年内。在病例对照队列中,各组之间在医生预约、远程医生联系、护士预约、远程护士联系、急诊室就诊或住院天数方面没有发现明显的统计学差异。然而,MS DCP 与确诊后 1 年内其他服务的就诊次数增加 2.05 次(标准差 0.48 次)有关。在前瞻性 DCP 队列中,0 个月和 12 个月之间的身体机能健康没有观察到明显的临床变化,但 3 个月和 6 个月之间的心理机能健康有所改善。患者满意度从 3 个月时的 NPS 指数 21(良好)提高到 12 个月时的 NPS 指数 63(优秀):大多数多发性硬化症患者都将多发性硬化症 DCP 作为常规手术的补充服务,我们发现他们对这项服务的满意度很高。在使用 MS DCP 的过程中,心理健康得到了改善。我们的研究结果表明,DCP 在管理多发性硬化症等慢性疾病方面大有可为。未来的研究应探索 DCP 在不同医疗环境和患者亚群中的潜力。
{"title":"Effects of a Digital Care Pathway for Multiple Sclerosis: Observational Study.","authors":"Märt Vesinurm, Anna Maunula, Päivi Olli, Paul Lillrank, Petra Ijäs, Paulus Torkki, Laura Mäkitie, Sini M Laakso","doi":"10.2196/51872","DOIUrl":"10.2196/51872","url":null,"abstract":"<p><strong>Background: </strong>Helsinki University Hospital has developed a digital care pathway (DCP) for people with multiple sclerosis (MS) to improve the care quality. DCP was designed for especially newly diagnosed patients to support adaptation to a chronic disease.</p><p><strong>Objective: </strong>This study investigated the MS DCP user behavior and its impact on patient education-mediated changes in health care use, patient-perceived impact of MS on psychological and physical functional health, and patient satisfaction.</p><p><strong>Methods: </strong>We collected data from the service launch in March 2020 until the end of 2022 (observation period). The number of users, user logins, and their timing and messages sent were collected. The association of the DCP on health care use was studied in a case-control setting in which patients were allowed to freely select whether they wanted to use the service (DCP group n=63) or not (control group n=112). The number of physical and remote appointments either to a doctor, nurse, or other services were considered in addition to emergency department visits and inpatient days. The follow-up time was 1 year (study period). Furthermore, a subgroup of 36 patients was recruited to fill out surveys on net promoter score (NPS) at 3, 6, and 12 months, and their physical and psychological functional health (Multiple Sclerosis Impact Scale) at 0, 3, 6, and 12 months.</p><p><strong>Results: </strong>During the observation period, a total of 225 patients had the option to use the service, out of whom 79.1% (178/225) logged into the service. On average, a user of the DCP sent 6.8 messages and logged on 7.4 times, with 72.29% (1182/1635) of logins taking place within 1 year of initiating the service. In case-control cohorts, no statistically significant differences between the groups were found for physical doctors' appointments, remote doctors' contacts, physical nurse appointments, remote nurse contacts, emergency department visits, or inpatient days. However, the MS DCP was associated with a 2.05 (SD 0.48) visit increase in other services, within 1 year from diagnosis. In the prospective DCP-cohort, no clinically significant change was observed in the physical functional health between the 0 and 12-month marks, but psychological functional health was improved between 3 and 6 months. Patient satisfaction improved from the NPS index of 21 (favorable) at the 3-month mark to the NPS index of 63 (excellent) at the 12-month mark.</p><p><strong>Conclusions: </strong>The MS DCP has been used by a majority of the people with MS as a complementary service to regular operations, and we find high satisfaction with the service. Psychological health was enhanced during the use of MS DCP. Our results indicate that DCPs hold great promise for managing chronic conditions such as MS. Future studies should explore the potential of DCPs in different health care settings and patient subgroups.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"11 ","pages":"e51872"},"PeriodicalIF":2.6,"publicationDate":"2024-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11339567/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141903121","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Patients' Attitudes Toward the Use of Artificial Intelligence as a Diagnostic Tool in Radiology in Saudi Arabia: Cross-Sectional Study. 沙特阿拉伯患者对在放射学中使用人工智能作为诊断工具的态度:横断面研究。
IF 2.6 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-08-07 DOI: 10.2196/53108
Leena R Baghdadi, Arwa A Mobeirek, Dania R Alhudaithi, Fatimah A Albenmousa, Leen S Alhadlaq, Maisa S Alaql, Sarah A Alhamlan

Background: Artificial intelligence (AI) is widely used in various medical fields, including diagnostic radiology as a tool for greater efficiency, precision, and accuracy. The integration of AI as a radiological diagnostic tool has the potential to mitigate delays in diagnosis, which could, in turn, impact patients' prognosis and treatment outcomes. The literature shows conflicting results regarding patients' attitudes to AI as a diagnostic tool. To the best of our knowledge, no similar study has been conducted in Saudi Arabia.

Objective: The objectives of this study are to examine patients' attitudes toward the use of AI as a tool in diagnostic radiology at King Khalid University Hospital, Saudi Arabia. Additionally, we sought to explore potential associations between patients' attitudes and various sociodemographic factors.

Methods: This descriptive-analytical cross-sectional study was conducted in a tertiary care hospital. Data were collected from patients scheduled for radiological imaging through a validated self-administered questionnaire. The main outcome was to measure patients' attitudes to the use of AI in radiology by calculating mean scores of 5 factors, distrust and accountability (factor 1), procedural knowledge (factor 2), personal interaction and communication (factor 3), efficiency (factor 4), and methods of providing information to patients (factor 5). Data were analyzed using the student t test, one-way analysis of variance followed by post hoc and multivariable analysis.

Results: A total of 382 participants (n=273, 71.5% women and n=109, 28.5% men) completed the surveys and were included in the analysis. The mean age of the respondents was 39.51 (SD 13.26) years. Participants favored physicians over AI for procedural knowledge, personal interaction, and being informed. However, the participants demonstrated a neutral attitude for distrust and accountability and for efficiency. Marital status was found to be associated with distrust and accountability, procedural knowledge, and personal interaction. Associations were also found between self-reported health status and being informed and between the field of specialization and distrust and accountability.

Conclusions: Patients were keen to understand the work of AI in radiology but favored personal interaction with a radiologist. Patients were impartial toward AI replacing radiologists and the efficiency of AI, which should be a consideration in future policy development and integration. Future research involving multicenter studies in different regions of Saudi Arabia is required.

背景:人工智能(AI)被广泛应用于各个医疗领域,包括放射诊断,作为一种提高效率、精确度和准确性的工具。将人工智能整合为放射诊断工具有可能减少诊断延误,进而影响患者的预后和治疗效果。文献显示,患者对人工智能作为诊断工具的态度并不一致。据我们所知,沙特阿拉伯尚未开展过类似的研究:本研究旨在探讨沙特阿拉伯哈立德国王大学医院的患者对使用人工智能作为放射诊断工具的态度。此外,我们还试图探讨患者的态度与各种社会人口因素之间的潜在关联:这项描述性分析横断面研究在一家三级医院进行。通过一份经过验证的自填式调查问卷收集了计划接受放射成像检查的患者的数据。主要结果是通过计算不信任和责任感(因子 1)、程序知识(因子 2)、个人互动和沟通(因子 3)、效率(因子 4)以及向患者提供信息的方法(因子 5)这 5 个因子的平均得分,来衡量患者对放射科使用人工智能的态度。数据分析采用学生 t 检验、单因素方差分析、事后分析和多变量分析:共有 382 名参与者(女性 273 人,占 71.5%;男性 109 人,占 28.5%)完成了调查并纳入分析。受访者的平均年龄为 39.51 岁(标准差为 13.26 岁)。在程序知识、个人互动和知情方面,受访者更倾向于选择医生而非人工智能。然而,在不信任、问责和效率方面,受访者持中立态度。婚姻状况与不信任和责任感、程序知识和人际交往有关。此外,还发现自我报告的健康状况与知情程度之间以及专业领域与不信任和问责之间存在关联:结论:患者渴望了解人工智能在放射学中的应用,但更倾向于与放射科医生进行个人互动。患者对人工智能取代放射科医生和人工智能的效率持中立态度,这也是未来政策制定和整合时应考虑的因素。未来需要在沙特阿拉伯不同地区开展多中心研究。
{"title":"Patients' Attitudes Toward the Use of Artificial Intelligence as a Diagnostic Tool in Radiology in Saudi Arabia: Cross-Sectional Study.","authors":"Leena R Baghdadi, Arwa A Mobeirek, Dania R Alhudaithi, Fatimah A Albenmousa, Leen S Alhadlaq, Maisa S Alaql, Sarah A Alhamlan","doi":"10.2196/53108","DOIUrl":"10.2196/53108","url":null,"abstract":"<p><strong>Background: </strong>Artificial intelligence (AI) is widely used in various medical fields, including diagnostic radiology as a tool for greater efficiency, precision, and accuracy. The integration of AI as a radiological diagnostic tool has the potential to mitigate delays in diagnosis, which could, in turn, impact patients' prognosis and treatment outcomes. The literature shows conflicting results regarding patients' attitudes to AI as a diagnostic tool. To the best of our knowledge, no similar study has been conducted in Saudi Arabia.</p><p><strong>Objective: </strong>The objectives of this study are to examine patients' attitudes toward the use of AI as a tool in diagnostic radiology at King Khalid University Hospital, Saudi Arabia. Additionally, we sought to explore potential associations between patients' attitudes and various sociodemographic factors.</p><p><strong>Methods: </strong>This descriptive-analytical cross-sectional study was conducted in a tertiary care hospital. Data were collected from patients scheduled for radiological imaging through a validated self-administered questionnaire. The main outcome was to measure patients' attitudes to the use of AI in radiology by calculating mean scores of 5 factors, distrust and accountability (factor 1), procedural knowledge (factor 2), personal interaction and communication (factor 3), efficiency (factor 4), and methods of providing information to patients (factor 5). Data were analyzed using the student t test, one-way analysis of variance followed by post hoc and multivariable analysis.</p><p><strong>Results: </strong>A total of 382 participants (n=273, 71.5% women and n=109, 28.5% men) completed the surveys and were included in the analysis. The mean age of the respondents was 39.51 (SD 13.26) years. Participants favored physicians over AI for procedural knowledge, personal interaction, and being informed. However, the participants demonstrated a neutral attitude for distrust and accountability and for efficiency. Marital status was found to be associated with distrust and accountability, procedural knowledge, and personal interaction. Associations were also found between self-reported health status and being informed and between the field of specialization and distrust and accountability.</p><p><strong>Conclusions: </strong>Patients were keen to understand the work of AI in radiology but favored personal interaction with a radiologist. Patients were impartial toward AI replacing radiologists and the efficiency of AI, which should be a consideration in future policy development and integration. Future research involving multicenter studies in different regions of Saudi Arabia is required.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"11 ","pages":"e53108"},"PeriodicalIF":2.6,"publicationDate":"2024-08-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11339559/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141903122","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Older Adults' Acceptance of a Virtual Reality Group Intervention in Nursing Homes: Pre-Post Study Under Naturalistic Conditions. 养老院中老年人对虚拟现实小组干预的接受程度:自然条件下的岗前研究
IF 2.6 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-08-06 DOI: 10.2196/56278
Yijun Li, Irina Shiyanov, Beate Muschalla

Background: Virtual reality (VR) group activities can act as interventions against inactivity and lack of meaningful activities in nursing homes. The acceptance of VR among older adults has been explored from different perspectives. However, research on the impact of older adults' individual characteristics on the acceptance of VR group activities in nursing homes is necessary.

Objective: This study investigates the impact of individual characteristics (eg, psychosocial capacities) on VR acceptance among older adults in nursing homes, as well as this group's perceptions of VR after participating in a VR intervention.

Methods: In this pre-post study conducted in nursing homes, we applied a VR group intervention with 113 older adult participants. These participants were categorized into two groups based on their naturalistic choice to join the intervention: a higher VR acceptance group (n=90) and a lower VR acceptance group (n=23). We compared the two groups with respect to their sociodemographic characteristics, psychosocial capacities, and attitudes toward new technologies. Additionally, we examined the participants' perceptions of VR.

Results: The results show that those with lower acceptance of VR initially reported higher capacities in organizing daily activities and stronger interpersonal relationships compared to older adults with higher VR acceptance. The VR group activity might hold limited significance for the latter group, but it offers the chance to activate older adults with lower proactivity. Openness to new technology was associated with a favorable perception of VR. After the VR intervention, the acceptance of VR remained high.

Conclusions: This study investigates the acceptance of VR group events as meaningful activities for older adults in nursing homes under naturalistic conditions. The results indicate that the VR group intervention effectively addressed low proactivity and interpersonal relationship issues among older adults in nursing homes. Older adults should be encouraged to experience VR if the opportunity to participate is offered, potentially facilitated by caregivers or trusted individuals.

背景:虚拟现实(VR)小组活动可以作为一种干预措施,防止养老院中的老年人不活动和缺乏有意义的活动。人们从不同角度探讨了老年人对虚拟现实的接受程度。然而,有必要研究老年人的个体特征对养老院接受 VR 集体活动的影响:本研究调查了个人特征(如社会心理能力)对养老院老年人接受虚拟现实的影响,以及该群体在参与虚拟现实干预后对虚拟现实的看法:在这项在养老院进行的前后期研究中,我们对 113 名老年人进行了 VR 小组干预。这些参与者根据其参加干预的自然选择被分为两组:VR接受度较高组(90人)和VR接受度较低组(23人)。我们对两组的社会人口特征、社会心理能力和对新技术的态度进行了比较。此外,我们还考察了参与者对 VR 的看法:结果表明,与对 VR 接受度较高的老年人相比,最初对 VR 接受度较低的老年人在组织日常活动方面的能力更强,人际关系也更融洽。VR小组活动对后一类人的意义可能有限,但它为活跃主动性较低的老年人提供了机会。对新技术的开放性与对 VR 的好感有关。在 VR 干预之后,老年人对 VR 的接受度仍然很高:本研究调查了在自然条件下,养老院老年人对 VR 小组活动作为有意义活动的接受程度。结果表明,VR 小组干预有效地解决了养老院老年人的低主动性和人际关系问题。如果有机会参与,应鼓励老年人体验虚拟现实,并可能由护理人员或可信赖的人提供便利。
{"title":"Older Adults' Acceptance of a Virtual Reality Group Intervention in Nursing Homes: Pre-Post Study Under Naturalistic Conditions.","authors":"Yijun Li, Irina Shiyanov, Beate Muschalla","doi":"10.2196/56278","DOIUrl":"10.2196/56278","url":null,"abstract":"<p><strong>Background: </strong>Virtual reality (VR) group activities can act as interventions against inactivity and lack of meaningful activities in nursing homes. The acceptance of VR among older adults has been explored from different perspectives. However, research on the impact of older adults' individual characteristics on the acceptance of VR group activities in nursing homes is necessary.</p><p><strong>Objective: </strong>This study investigates the impact of individual characteristics (eg, psychosocial capacities) on VR acceptance among older adults in nursing homes, as well as this group's perceptions of VR after participating in a VR intervention.</p><p><strong>Methods: </strong>In this pre-post study conducted in nursing homes, we applied a VR group intervention with 113 older adult participants. These participants were categorized into two groups based on their naturalistic choice to join the intervention: a higher VR acceptance group (n=90) and a lower VR acceptance group (n=23). We compared the two groups with respect to their sociodemographic characteristics, psychosocial capacities, and attitudes toward new technologies. Additionally, we examined the participants' perceptions of VR.</p><p><strong>Results: </strong>The results show that those with lower acceptance of VR initially reported higher capacities in organizing daily activities and stronger interpersonal relationships compared to older adults with higher VR acceptance. The VR group activity might hold limited significance for the latter group, but it offers the chance to activate older adults with lower proactivity. Openness to new technology was associated with a favorable perception of VR. After the VR intervention, the acceptance of VR remained high.</p><p><strong>Conclusions: </strong>This study investigates the acceptance of VR group events as meaningful activities for older adults in nursing homes under naturalistic conditions. The results indicate that the VR group intervention effectively addressed low proactivity and interpersonal relationship issues among older adults in nursing homes. Older adults should be encouraged to experience VR if the opportunity to participate is offered, potentially facilitated by caregivers or trusted individuals.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"11 ","pages":"e56278"},"PeriodicalIF":2.6,"publicationDate":"2024-08-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11468973/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142381858","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Assessing Patient Trust in Automation in Health Care Systems: Within-Subjects Experimental Study. 评估患者对医疗系统自动化的信任:主体内实验研究
IF 2.6 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-08-06 DOI: 10.2196/48584
Matthew Nare, Katherina Jurewicz

Background: Health care technology has the ability to change patient outcomes for the betterment when designed appropriately. Automation is becoming smarter and is increasingly being integrated into health care work systems.

Objective: This study focuses on investigating trust between patients and an automated cardiac risk assessment tool (CRAT) in a simulated emergency department setting.

Methods: A within-subjects experimental study was performed to investigate differences in automation modes for the CRAT: (1) no automation, (2) automation only, and (3) semiautomation. Participants were asked to enter their simulated symptoms for each scenario into the CRAT as instructed by the experimenter, and they would automatically be classified as high, medium, or low risk depending on the symptoms entered. Participants were asked to provide their trust ratings for each combination of risk classification and automation mode on a scale of 1 to 10 (1=absolutely no trust and 10=complete trust).

Results: Results from this study indicate that the participants significantly trusted the semiautomation condition more compared to the automation-only condition (P=.002), and they trusted the no automation condition significantly more than the automation-only condition (P=.03). Additionally, participants significantly trusted the CRAT more in the high-severity scenario compared to the medium-severity scenario (P=.004).

Conclusions: The findings from this study emphasize the importance of the human component of automation when designing automated technology in health care systems. Automation and artificially intelligent systems are becoming more prevalent in health care systems, and this work emphasizes the need to consider the human element when designing automation into care delivery.

背景:如果设计得当,医疗保健技术有能力改善患者的治疗效果。自动化正变得越来越智能,并越来越多地融入到医疗保健工作系统中:本研究的重点是在模拟急诊室环境中调查患者与自动心脏风险评估工具(CRAT)之间的信任度:方法:进行了一项受试者内实验研究,以调查 CRAT 自动化模式的差异:(1) 无自动化;(2) 仅自动化;(3) 半自动化。参与者需要按照实验人员的指示,在 CRAT 中输入每个场景下的模拟症状,并根据输入的症状自动将其分为高风险、中风险和低风险。参与者需要对每种风险分类和自动化模式的组合进行信任度评分,评分标准为 1 到 10 分(1 分=绝对不信任,10 分=完全信任):研究结果表明,参与者对半自动化条件的信任度明显高于纯自动化条件(P=.002),对无自动化条件的信任度明显高于纯自动化条件(P=.03)。此外,与中度严重性情景相比,参与者在高度严重性情景下对 CRAT 的信任度明显更高(P=.004):本研究的结论强调了在医疗保健系统中设计自动化技术时,自动化中人的因素的重要性。自动化和人工智能系统在医疗保健系统中正变得越来越普遍,这项研究强调了在设计医疗保健服务自动化时考虑人的因素的必要性。
{"title":"Assessing Patient Trust in Automation in Health Care Systems: Within-Subjects Experimental Study.","authors":"Matthew Nare, Katherina Jurewicz","doi":"10.2196/48584","DOIUrl":"10.2196/48584","url":null,"abstract":"<p><strong>Background: </strong>Health care technology has the ability to change patient outcomes for the betterment when designed appropriately. Automation is becoming smarter and is increasingly being integrated into health care work systems.</p><p><strong>Objective: </strong>This study focuses on investigating trust between patients and an automated cardiac risk assessment tool (CRAT) in a simulated emergency department setting.</p><p><strong>Methods: </strong>A within-subjects experimental study was performed to investigate differences in automation modes for the CRAT: (1) no automation, (2) automation only, and (3) semiautomation. Participants were asked to enter their simulated symptoms for each scenario into the CRAT as instructed by the experimenter, and they would automatically be classified as high, medium, or low risk depending on the symptoms entered. Participants were asked to provide their trust ratings for each combination of risk classification and automation mode on a scale of 1 to 10 (1=absolutely no trust and 10=complete trust).</p><p><strong>Results: </strong>Results from this study indicate that the participants significantly trusted the semiautomation condition more compared to the automation-only condition (P=.002), and they trusted the no automation condition significantly more than the automation-only condition (P=.03). Additionally, participants significantly trusted the CRAT more in the high-severity scenario compared to the medium-severity scenario (P=.004).</p><p><strong>Conclusions: </strong>The findings from this study emphasize the importance of the human component of automation when designing automated technology in health care systems. Automation and artificially intelligent systems are becoming more prevalent in health care systems, and this work emphasizes the need to consider the human element when designing automation into care delivery.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"11 ","pages":"e48584"},"PeriodicalIF":2.6,"publicationDate":"2024-08-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11336498/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141894517","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Perceived Benefit and Satisfaction With a Tablet Computer and an Emergency Smartwatch by Older Adults and Their Relatives: Prospective Real-World Pilot Study. 老年人及其亲属对平板电脑和应急智能手表的认知效益和满意度:前瞻性真实世界试点研究。
IF 2.6 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-08-02 DOI: 10.2196/53811
Patrick Wiegel, Marina Liselotte Fotteler, Brigitte Kohn, Sarah Mayer, Filippo Maria Verri, Dhayana Dallmeier, Michael Denkinger
<p><strong>Background: </strong>Assistive technologies (ATs) have the potential to promote the quality of life and independent living of older adults and, further, to relieve the burden of formal and informal caregivers and relatives. Technological developments over the last decades have led to a boost of available ATs. However, evidence on the benefits and satisfaction with ATs in real-world applications remains scarce.</p><p><strong>Objective: </strong>This prospective, real-world, pilot study tested the perceived benefit and satisfaction with different ATs in the real-world environment.</p><p><strong>Methods: </strong>Community-dwelling adults aged ≥65 and their relatives tested a tablet computer with a simplified interface or a smartwatch with programmable emergency contacts for 8 weeks in their everyday life. Perceived benefits and satisfaction with ATs were assessed by all older adults and their relatives using different assessment tools before and after the intervention. Outcome measures included the Technology Usage Inventory, Quebec User Evaluation of Satisfaction with Assistive Technology 2.0, and Canadian Occupational Performance Measure.</p><p><strong>Results: </strong>A total of 17 older adults (tablet computer: n=8, 47% and smartwatch: n=9, 53%) and 16 relatives (tablet computer: n=7, 44% and smartwatch: n=9, 56%) were included in the study. The number of participants that were frail (according to the Clinical Frailty Scale) and received care was higher in the smartwatch group than in the tablet computer group. Older adults of the smartwatch group reported higher technology acceptance (Technology Usage Inventory) and satisfaction (Quebec User Evaluation of Satisfaction with Assistive Technology 2.0) scores than those of the tablet computer group, although the differences were not significant (all P>.05). In the tablet computer group, relatives had significantly higher ratings on the item intention to use than older adults (t12.3=3.3, P=.006). Identified everyday issues with the Canadian Occupational Performance Measure included contact/communication and entertainment/information for the tablet computer, safety and getting help in emergency situations for the smartwatch, and the usability of the AT for both devices. While the performance (t8=3.5, P=.008) and satisfaction (t8=3.2, P=.01) in these domains significantly improved in the smartwatch group, changes in the tablet computer group were inconsistent (all P>.05).</p><p><strong>Conclusions: </strong>This study highlights the remaining obstacles for the widespread and effective application of ATs in the everyday life of older adults and their relatives. While the results do not provide evidence for a positive effect regarding communication deficits, perceived benefits could be shown for the area of safety. Future research and technical developments need to consider not only the preferences, problems, and goals of older adults but also their relatives and caregivers to improve the a
背景:辅助技术(ATs)有可能提高老年人的生活质量和独立生活能力,并进一步减轻正式和非正式护理人员及亲属的负担。过去几十年来的技术发展使可用的辅助技术越来越多。然而,在实际应用中,有关自动辅助工具的益处和满意度的证据仍然很少:这项前瞻性、真实世界的试点研究测试了在真实世界环境中使用不同自动辅助工具的益处和满意度:方法:年龄≥65 岁、居住在社区的成年人及其亲属在日常生活中对带有简化界面的平板电脑或带有可编程紧急联系人功能的智能手表进行了为期 8 周的测试。在干预前后,所有老年人及其亲属使用不同的评估工具评估了对智能辅助工具的感知益处和满意度。结果测量包括技术使用清单、魁北克用户对辅助技术满意度评估 2.0 和加拿大职业表现测量:共有 17 名老年人(平板电脑:8 人,占 47%;智能手表:9 人,占 53%)和 16 名亲属(平板电脑:7 人,占 44%;智能手表:9 人,占 56%)参与了研究。智能手表组中身体虚弱(根据临床虚弱量表)并接受护理的参与者人数高于平板电脑组。与平板电脑组相比,智能手表组老年人的技术接受度(技术使用情况量表)和满意度(魁北克用户对辅助技术满意度评估 2.0)得分更高,但差异不显著(均大于 P.05)。在平板电脑组中,亲属在使用意向项目上的评分明显高于老年人(t12.3=3.3,P=.006)。在加拿大职业表现测量中发现的日常问题包括:平板电脑的联系/沟通和娱乐/信息,智能手表的安全和紧急情况下的求助,以及两种设备的辅助工具的可用性。虽然智能手表组在这些领域的表现(t8=3.5,P=.008)和满意度(t8=3.2,P=.01)都有显著提高,但平板电脑组的变化并不一致(均为P>.05):本研究强调了在老年人及其亲属的日常生活中广泛而有效地应用智能辅助工具仍然存在的障碍。虽然研究结果没有提供证据证明在沟通障碍方面有积极的效果,但在安全方面可以显示出明显的益处。未来的研究和技术发展不仅需要考虑老年人的偏好、问题和目标,还需要考虑他们的亲属和照顾者,以提高辅助工具的可接受性和有效性。
{"title":"Perceived Benefit and Satisfaction With a Tablet Computer and an Emergency Smartwatch by Older Adults and Their Relatives: Prospective Real-World Pilot Study.","authors":"Patrick Wiegel, Marina Liselotte Fotteler, Brigitte Kohn, Sarah Mayer, Filippo Maria Verri, Dhayana Dallmeier, Michael Denkinger","doi":"10.2196/53811","DOIUrl":"10.2196/53811","url":null,"abstract":"&lt;p&gt;&lt;strong&gt;Background: &lt;/strong&gt;Assistive technologies (ATs) have the potential to promote the quality of life and independent living of older adults and, further, to relieve the burden of formal and informal caregivers and relatives. Technological developments over the last decades have led to a boost of available ATs. However, evidence on the benefits and satisfaction with ATs in real-world applications remains scarce.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Objective: &lt;/strong&gt;This prospective, real-world, pilot study tested the perceived benefit and satisfaction with different ATs in the real-world environment.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Methods: &lt;/strong&gt;Community-dwelling adults aged ≥65 and their relatives tested a tablet computer with a simplified interface or a smartwatch with programmable emergency contacts for 8 weeks in their everyday life. Perceived benefits and satisfaction with ATs were assessed by all older adults and their relatives using different assessment tools before and after the intervention. Outcome measures included the Technology Usage Inventory, Quebec User Evaluation of Satisfaction with Assistive Technology 2.0, and Canadian Occupational Performance Measure.&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Results: &lt;/strong&gt;A total of 17 older adults (tablet computer: n=8, 47% and smartwatch: n=9, 53%) and 16 relatives (tablet computer: n=7, 44% and smartwatch: n=9, 56%) were included in the study. The number of participants that were frail (according to the Clinical Frailty Scale) and received care was higher in the smartwatch group than in the tablet computer group. Older adults of the smartwatch group reported higher technology acceptance (Technology Usage Inventory) and satisfaction (Quebec User Evaluation of Satisfaction with Assistive Technology 2.0) scores than those of the tablet computer group, although the differences were not significant (all P&gt;.05). In the tablet computer group, relatives had significantly higher ratings on the item intention to use than older adults (t12.3=3.3, P=.006). Identified everyday issues with the Canadian Occupational Performance Measure included contact/communication and entertainment/information for the tablet computer, safety and getting help in emergency situations for the smartwatch, and the usability of the AT for both devices. While the performance (t8=3.5, P=.008) and satisfaction (t8=3.2, P=.01) in these domains significantly improved in the smartwatch group, changes in the tablet computer group were inconsistent (all P&gt;.05).&lt;/p&gt;&lt;p&gt;&lt;strong&gt;Conclusions: &lt;/strong&gt;This study highlights the remaining obstacles for the widespread and effective application of ATs in the everyday life of older adults and their relatives. While the results do not provide evidence for a positive effect regarding communication deficits, perceived benefits could be shown for the area of safety. Future research and technical developments need to consider not only the preferences, problems, and goals of older adults but also their relatives and caregivers to improve the a","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"11 ","pages":"e53811"},"PeriodicalIF":2.6,"publicationDate":"2024-08-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11310738/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141894518","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Understanding the Use of Mobility Data in Disasters: Exploratory Qualitative Study of COVID-19 User Feedback. 了解移动数据在灾害中的应用:COVID-19 用户反馈的定性探索研究。
IF 2.6 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-08-01 DOI: 10.2196/52257
Jennifer Lisa Chan, Sarah Tsay, Sraavya Sambara, Sarah B Welch

Background: Human mobility data have been used as a potential novel data source to guide policies and response planning during the COVID-19 global pandemic. The COVID-19 Mobility Data Network (CMDN) facilitated the use of human mobility data around the world. Both researchers and policy makers assumed that mobility data would provide insights to help policy makers and response planners. However, evidence that human mobility data were operationally useful and provided added value for public health response planners remains largely unknown.

Objective: This exploratory study focuses on advancing the understanding of the use of human mobility data during the early phase of the COVID-19 pandemic. The study explored how researchers and practitioners around the world used these data in response planning and policy making, focusing on processing data and human factors enabling or hindering use of the data.

Methods: Our project was based on phenomenology and used an inductive approach to thematic analysis. Transcripts were open-coded to create the codebook that was then applied by 2 team members who blind-coded all transcripts. Consensus coding was used for coding discrepancies.

Results: Interviews were conducted with 45 individuals during the early period of the COVID-19 pandemic. Although some teams used mobility data for response planning, few were able to describe their uses in policy making, and there were no standardized ways that teams used mobility data. Mobility data played a larger role in providing situational awareness for government partners, helping to understand where people were moving in relation to the spread of COVID-19 variants and reactions to stay-at-home orders. Interviewees who felt they were more successful using mobility data often cited an individual who was able to answer general questions about mobility data; provide interactive feedback on results; and enable a 2-way communication exchange about data, meaning, value, and potential use.

Conclusions: Human mobility data were used as a novel data source in the COVID-19 pandemic by a network of academic researchers and practitioners using privacy-preserving and anonymized mobility data. This study reflects the processes in analyzing and communicating human mobility data, as well as how these data were used in response planning and how the data were intended for use in policy making. The study reveals several valuable use cases. Ultimately, the role of a data translator was crucial in understanding the complexities of this novel data source. With this role, teams were able to adapt workflows, visualizations, and reports to align with end users and decision makers while communicating this information meaningfully to address the goals of responders and policy makers.

背景:在 COVID-19 全球大流行期间,人员流动数据被用作指导政策和应对规划的潜在新数据源。COVID-19 人员流动数据网络 (CMDN) 促进了世界各地人员流动数据的使用。研究人员和政策制定者都认为,流动性数据将为政策制定者和应对规划者提供帮助。然而,是否有证据表明人员流动数据在操作上有用并为公共卫生响应规划人员提供了附加值,这一点在很大程度上仍不为人所知:本探索性研究的重点是加深对 COVID-19 大流行早期阶段人员流动数据使用情况的了解。这项研究探讨了世界各地的研究人员和从业人员如何在应对规划和政策制定中使用这些数据,重点关注数据处理以及促进或阻碍数据使用的人为因素:我们的项目以现象学为基础,采用归纳法进行专题分析。对记录誊本进行开放式编码以创建编码手册,然后由两名团队成员对所有记录誊本进行盲码。对编码差异采用共识编码法:结果:在 COVID-19 大流行初期,我们对 45 人进行了访谈。尽管一些团队在应对计划中使用了流动性数据,但很少有团队能够描述其在政策制定中的用途,而且各团队使用流动性数据的方式也不尽相同。流动性数据在为政府合作伙伴提供态势感知方面发挥了更大的作用,有助于了解与 COVID-19 变体传播相关的人员流动情况以及对留在家中的命令的反应。受访者认为他们在使用流动性数据方面比较成功的,往往是那些能够回答有关流动性数据的一般问题、就结果提供互动反馈、就数据、意义、价值和潜在用途进行双向交流的人:由学术研究人员和从业人员组成的网络利用保护隐私和匿名的移动数据,将人类移动数据作为 COVID-19 大流行病中的新型数据源。本研究反映了分析和交流人员流动数据的过程,以及这些数据如何用于应对计划和如何用于政策制定。研究揭示了几个有价值的使用案例。最终,数据翻译者的角色对于理解这种新型数据源的复杂性至关重要。有了这个角色,团队就能够调整工作流程、可视化和报告,以便与最终用户和决策者保持一致,同时有意义地传达这些信息,以实现响应者和决策者的目标。
{"title":"Understanding the Use of Mobility Data in Disasters: Exploratory Qualitative Study of COVID-19 User Feedback.","authors":"Jennifer Lisa Chan, Sarah Tsay, Sraavya Sambara, Sarah B Welch","doi":"10.2196/52257","DOIUrl":"10.2196/52257","url":null,"abstract":"<p><strong>Background: </strong>Human mobility data have been used as a potential novel data source to guide policies and response planning during the COVID-19 global pandemic. The COVID-19 Mobility Data Network (CMDN) facilitated the use of human mobility data around the world. Both researchers and policy makers assumed that mobility data would provide insights to help policy makers and response planners. However, evidence that human mobility data were operationally useful and provided added value for public health response planners remains largely unknown.</p><p><strong>Objective: </strong>This exploratory study focuses on advancing the understanding of the use of human mobility data during the early phase of the COVID-19 pandemic. The study explored how researchers and practitioners around the world used these data in response planning and policy making, focusing on processing data and human factors enabling or hindering use of the data.</p><p><strong>Methods: </strong>Our project was based on phenomenology and used an inductive approach to thematic analysis. Transcripts were open-coded to create the codebook that was then applied by 2 team members who blind-coded all transcripts. Consensus coding was used for coding discrepancies.</p><p><strong>Results: </strong>Interviews were conducted with 45 individuals during the early period of the COVID-19 pandemic. Although some teams used mobility data for response planning, few were able to describe their uses in policy making, and there were no standardized ways that teams used mobility data. Mobility data played a larger role in providing situational awareness for government partners, helping to understand where people were moving in relation to the spread of COVID-19 variants and reactions to stay-at-home orders. Interviewees who felt they were more successful using mobility data often cited an individual who was able to answer general questions about mobility data; provide interactive feedback on results; and enable a 2-way communication exchange about data, meaning, value, and potential use.</p><p><strong>Conclusions: </strong>Human mobility data were used as a novel data source in the COVID-19 pandemic by a network of academic researchers and practitioners using privacy-preserving and anonymized mobility data. This study reflects the processes in analyzing and communicating human mobility data, as well as how these data were used in response planning and how the data were intended for use in policy making. The study reveals several valuable use cases. Ultimately, the role of a data translator was crucial in understanding the complexities of this novel data source. With this role, teams were able to adapt workflows, visualizations, and reports to align with end users and decision makers while communicating this information meaningfully to address the goals of responders and policy makers.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"11 ","pages":"e52257"},"PeriodicalIF":2.6,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11327621/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141861145","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The Impact of Information Relevancy and Interactivity on Intensivists' Trust in a Machine Learning-Based Bacteremia Prediction System: Simulation Study. 信息相关性和交互性对重症监护医生信任基于机器学习的菌血症预测系统的影响:模拟研究。
IF 2.6 Q2 HEALTH CARE SCIENCES & SERVICES Pub Date : 2024-08-01 DOI: 10.2196/56924
Omer Katzburg, Michael Roimi, Amit Frenkel, Roy Ilan, Yuval Bitan

Background: The exponential growth in computing power and the increasing digitization of information have substantially advanced the machine learning (ML) research field. However, ML algorithms are often considered "black boxes," and this fosters distrust. In medical domains, in which mistakes can result in fatal outcomes, practitioners may be especially reluctant to trust ML algorithms.

Objective: The aim of this study is to explore the effect of user-interface design features on intensivists' trust in an ML-based clinical decision support system.

Methods: A total of 47 physicians from critical care specialties were presented with 3 patient cases of bacteremia in the setting of an ML-based simulation system. Three conditions of the simulation were tested according to combinations of information relevancy and interactivity. Participants' trust in the system was assessed by their agreement with the system's prediction and a postexperiment questionnaire. Linear regression models were applied to measure the effects.

Results: Participants' agreement with the system's prediction did not differ according to the experimental conditions. However, in the postexperiment questionnaire, higher information relevancy ratings and interactivity ratings were associated with higher perceived trust in the system (P<.001 for both). The explicit visual presentation of the features of the ML algorithm on the user interface resulted in lower trust among the participants (P=.05).

Conclusions: Information relevancy and interactivity features should be considered in the design of the user interface of ML-based clinical decision support systems to enhance intensivists' trust. This study sheds light on the connection between information relevancy, interactivity, and trust in human-ML interaction, specifically in the intensive care unit environment.

背景:计算能力的指数级增长和信息的日益数字化极大地推动了机器学习(ML)研究领域的发展。然而,机器学习算法通常被视为 "黑盒子",这就造成了不信任。在医疗领域,错误可能导致致命后果,因此从业人员可能尤其不愿意相信 ML 算法:本研究旨在探讨用户界面设计特征对重症监护医生信任基于 ML 的临床决策支持系统的影响:方法:在基于 ML 的模拟系统中,向来自重症监护专业的 47 名医生展示了 3 个菌血症患者病例。根据信息相关性和互动性的组合测试了三种模拟条件。参与者对系统预测的认同度和实验后的问卷调查评估了他们对系统的信任度。采用线性回归模型来衡量效果:结果:实验条件不同,参与者对系统预测的认同度也不同。然而,在实验后的问卷调查中,较高的信息相关性评分和互动性评分与较高的系统感知信任度有关(结论:信息相关性和互动性特征与系统感知信任度的关系是线性相关的):在设计基于 ML 的临床决策支持系统的用户界面时,应考虑信息相关性和交互性特征,以提高重症监护医生的信任度。本研究揭示了人机交互(特别是在重症监护室环境中)中信息相关性、交互性和信任之间的联系。
{"title":"The Impact of Information Relevancy and Interactivity on Intensivists' Trust in a Machine Learning-Based Bacteremia Prediction System: Simulation Study.","authors":"Omer Katzburg, Michael Roimi, Amit Frenkel, Roy Ilan, Yuval Bitan","doi":"10.2196/56924","DOIUrl":"10.2196/56924","url":null,"abstract":"<p><strong>Background: </strong>The exponential growth in computing power and the increasing digitization of information have substantially advanced the machine learning (ML) research field. However, ML algorithms are often considered \"black boxes,\" and this fosters distrust. In medical domains, in which mistakes can result in fatal outcomes, practitioners may be especially reluctant to trust ML algorithms.</p><p><strong>Objective: </strong>The aim of this study is to explore the effect of user-interface design features on intensivists' trust in an ML-based clinical decision support system.</p><p><strong>Methods: </strong>A total of 47 physicians from critical care specialties were presented with 3 patient cases of bacteremia in the setting of an ML-based simulation system. Three conditions of the simulation were tested according to combinations of information relevancy and interactivity. Participants' trust in the system was assessed by their agreement with the system's prediction and a postexperiment questionnaire. Linear regression models were applied to measure the effects.</p><p><strong>Results: </strong>Participants' agreement with the system's prediction did not differ according to the experimental conditions. However, in the postexperiment questionnaire, higher information relevancy ratings and interactivity ratings were associated with higher perceived trust in the system (P<.001 for both). The explicit visual presentation of the features of the ML algorithm on the user interface resulted in lower trust among the participants (P=.05).</p><p><strong>Conclusions: </strong>Information relevancy and interactivity features should be considered in the design of the user interface of ML-based clinical decision support systems to enhance intensivists' trust. This study sheds light on the connection between information relevancy, interactivity, and trust in human-ML interaction, specifically in the intensive care unit environment.</p>","PeriodicalId":36351,"journal":{"name":"JMIR Human Factors","volume":"11 ","pages":"e56924"},"PeriodicalIF":2.6,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11310737/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141876243","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
JMIR Human Factors
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1