Background: Generative artificial intelligence (AI), particularly in the form of large language models, has rapidly developed. The LLaMA series are popular and recently updated from LLaMA2 to LLaMA3. However, the impacts of the update on diagnostic performance have not been well documented.
Objective: We conducted a comparative evaluation of the diagnostic performance in differential diagnosis lists generated by LLaMA3 and LLaMA2 for case reports.
Methods: We analyzed case reports published in the American Journal of Case Reports from 2022 to 2023. After excluding nondiagnostic and pediatric cases, we input the remaining cases into LLaMA3 and LLaMA2 using the same prompt and the same adjustable parameters. Diagnostic performance was defined by whether the differential diagnosis lists included the final diagnosis. Multiple physicians independently evaluated whether the final diagnosis was included in the top 10 differentials generated by LLaMA3 and LLaMA2.
Results: In our comparative evaluation of the diagnostic performance between LLaMA3 and LLaMA2, we analyzed differential diagnosis lists for 392 case reports. The final diagnosis was included in the top 10 differentials generated by LLaMA3 in 79.6% (312/392) of the cases, compared to 49.7% (195/392) for LLaMA2, indicating a statistically significant improvement (P<.001). Additionally, LLaMA3 showed higher performance in including the final diagnosis in the top 5 differentials, observed in 63% (247/392) of cases, compared to LLaMA2's 38% (149/392, P<.001). Furthermore, the top diagnosis was accurately identified by LLaMA3 in 33.9% (133/392) of cases, significantly higher than the 22.7% (89/392) achieved by LLaMA2 (P<.001). The analysis across various medical specialties revealed variations in diagnostic performance with LLaMA3 consistently outperforming LLaMA2.
Conclusions: The results reveal that the LLaMA3 model significantly outperforms LLaMA2 per diagnostic performance, with a higher percentage of case reports having the final diagnosis listed within the top 10, top 5, and as the top diagnosis. Overall diagnostic performance improved almost 1.5 times from LLaMA2 to LLaMA3. These findings support the rapid development and continuous refinement of generative AI systems to enhance diagnostic processes in medicine. However, these findings should be carefully interpreted for clinical application, as generative AI, including the LLaMA series, has not been approved for medical applications such as AI-enhanced diagnostics.
{"title":"Comparative Analysis of Diagnostic Performance: Differential Diagnosis Lists by LLaMA3 Versus LLaMA2 for Case Reports.","authors":"Takanobu Hirosawa, Yukinori Harada, Kazuki Tokumasu, Tatsuya Shiraishi, Tomoharu Suzuki, Taro Shimizu","doi":"10.2196/64844","DOIUrl":"https://doi.org/10.2196/64844","url":null,"abstract":"<p><strong>Background: </strong>Generative artificial intelligence (AI), particularly in the form of large language models, has rapidly developed. The LLaMA series are popular and recently updated from LLaMA2 to LLaMA3. However, the impacts of the update on diagnostic performance have not been well documented.</p><p><strong>Objective: </strong>We conducted a comparative evaluation of the diagnostic performance in differential diagnosis lists generated by LLaMA3 and LLaMA2 for case reports.</p><p><strong>Methods: </strong>We analyzed case reports published in the American Journal of Case Reports from 2022 to 2023. After excluding nondiagnostic and pediatric cases, we input the remaining cases into LLaMA3 and LLaMA2 using the same prompt and the same adjustable parameters. Diagnostic performance was defined by whether the differential diagnosis lists included the final diagnosis. Multiple physicians independently evaluated whether the final diagnosis was included in the top 10 differentials generated by LLaMA3 and LLaMA2.</p><p><strong>Results: </strong>In our comparative evaluation of the diagnostic performance between LLaMA3 and LLaMA2, we analyzed differential diagnosis lists for 392 case reports. The final diagnosis was included in the top 10 differentials generated by LLaMA3 in 79.6% (312/392) of the cases, compared to 49.7% (195/392) for LLaMA2, indicating a statistically significant improvement (P<.001). Additionally, LLaMA3 showed higher performance in including the final diagnosis in the top 5 differentials, observed in 63% (247/392) of cases, compared to LLaMA2's 38% (149/392, P<.001). Furthermore, the top diagnosis was accurately identified by LLaMA3 in 33.9% (133/392) of cases, significantly higher than the 22.7% (89/392) achieved by LLaMA2 (P<.001). The analysis across various medical specialties revealed variations in diagnostic performance with LLaMA3 consistently outperforming LLaMA2.</p><p><strong>Conclusions: </strong>The results reveal that the LLaMA3 model significantly outperforms LLaMA2 per diagnostic performance, with a higher percentage of case reports having the final diagnosis listed within the top 10, top 5, and as the top diagnosis. Overall diagnostic performance improved almost 1.5 times from LLaMA2 to LLaMA3. These findings support the rapid development and continuous refinement of generative AI systems to enhance diagnostic processes in medicine. However, these findings should be carefully interpreted for clinical application, as generative AI, including the LLaMA series, has not been approved for medical applications such as AI-enhanced diagnostics.</p>","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":"8 ","pages":"e64844"},"PeriodicalIF":2.0,"publicationDate":"2024-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142675877","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
<p><strong>Background: </strong>Poststroke cognitive impairment (PSCI) is a common and debilitating complication that affects stroke survivors, impacting memory, attention, and executive function. Despite its prevalence, the factors contributing to PSCI remain unclear, with limited insights into how demographic and clinical variables influence cognitive outcomes.</p><p><strong>Objective: </strong>This study investigates the incidence of cognitive impairment in patients with stroke and examines key demographic and clinical factors, such as age, gender, and education level, which contribute to cognitive decline. The aim is to provide a deeper understanding of PSCI to inform early intervention strategies for improving patient outcomes.</p><p><strong>Methods: </strong>A cross-sectional study was conducted on 305 patients with ischemic stroke admitted to Zhongda Hospital, Southeast University, from January 2019 to September 2022. Cognitive function was assessed using the Mini-Mental State Examination (MMSE) within 72 hours of hospital admission. Demographic information, including age, gender, and education level, were collected. Statistical analyses were performed using chi-square tests, independent t tests, and multivariate regression to assess the relationship between cognitive function and key variables. Pearson correlation analysis explored associations among age, education, and MMSE scores.</p><p><strong>Results: </strong>Among the 305 patients with stroke, 16.7% (n=51) were diagnosed with cognitive impairment based on MMSE scores. The prevalence of cognitive impairment was slightly higher in males (17.6%, n=159) than females (15.8%, n=146), but this difference was not statistically significant. A strong negative correlation was found between MMSE scores and age (r=-0.32; P<.01), indicating that older patients had lower cognitive function. Education level showed a positive correlation with MMSE scores (r=0.41; P<.01), with patients with higher educational attainment demonstrating better cognitive outcomes. Cognitive function showed a marked decline in patients older than 60 years, particularly in domains such as memory, attention, and language skills.</p><p><strong>Conclusions: </strong>This study confirms that age and education are significant factors in determining cognitive outcomes after stroke. The results align with existing literature showing that cognitive function declines with age, while higher educational attainment serves as a protective factor. The findings suggest that individuals with greater cognitive reserve, often linked to higher education, are better equipped to cope with the impact of brain injury. However, the study's reliance on MMSE may have limited its ability to detect domain-specific impairments. Future studies should consider using more sensitive cognitive tools, such as the Montreal Cognitive Assessment (MoCA), to provide a more comprehensive evaluation of PSCI. Cognitive impairment is prevalent among stroke survivors
{"title":"Factors Influencing Poststroke Cognitive Dysfunction: Cross-Sectional Analysis.","authors":"Wu Zhou, HaiXia Feng, Hua Tao, Hui Sun, TianTian Zhang, QingXia Wang, Li Zhang","doi":"10.2196/59572","DOIUrl":"10.2196/59572","url":null,"abstract":"<p><strong>Background: </strong>Poststroke cognitive impairment (PSCI) is a common and debilitating complication that affects stroke survivors, impacting memory, attention, and executive function. Despite its prevalence, the factors contributing to PSCI remain unclear, with limited insights into how demographic and clinical variables influence cognitive outcomes.</p><p><strong>Objective: </strong>This study investigates the incidence of cognitive impairment in patients with stroke and examines key demographic and clinical factors, such as age, gender, and education level, which contribute to cognitive decline. The aim is to provide a deeper understanding of PSCI to inform early intervention strategies for improving patient outcomes.</p><p><strong>Methods: </strong>A cross-sectional study was conducted on 305 patients with ischemic stroke admitted to Zhongda Hospital, Southeast University, from January 2019 to September 2022. Cognitive function was assessed using the Mini-Mental State Examination (MMSE) within 72 hours of hospital admission. Demographic information, including age, gender, and education level, were collected. Statistical analyses were performed using chi-square tests, independent t tests, and multivariate regression to assess the relationship between cognitive function and key variables. Pearson correlation analysis explored associations among age, education, and MMSE scores.</p><p><strong>Results: </strong>Among the 305 patients with stroke, 16.7% (n=51) were diagnosed with cognitive impairment based on MMSE scores. The prevalence of cognitive impairment was slightly higher in males (17.6%, n=159) than females (15.8%, n=146), but this difference was not statistically significant. A strong negative correlation was found between MMSE scores and age (r=-0.32; P<.01), indicating that older patients had lower cognitive function. Education level showed a positive correlation with MMSE scores (r=0.41; P<.01), with patients with higher educational attainment demonstrating better cognitive outcomes. Cognitive function showed a marked decline in patients older than 60 years, particularly in domains such as memory, attention, and language skills.</p><p><strong>Conclusions: </strong>This study confirms that age and education are significant factors in determining cognitive outcomes after stroke. The results align with existing literature showing that cognitive function declines with age, while higher educational attainment serves as a protective factor. The findings suggest that individuals with greater cognitive reserve, often linked to higher education, are better equipped to cope with the impact of brain injury. However, the study's reliance on MMSE may have limited its ability to detect domain-specific impairments. Future studies should consider using more sensitive cognitive tools, such as the Montreal Cognitive Assessment (MoCA), to provide a more comprehensive evaluation of PSCI. Cognitive impairment is prevalent among stroke survivors","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":"8 ","pages":"e59572"},"PeriodicalIF":2.0,"publicationDate":"2024-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142667790","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Ghadah Alnooh, Jozaa Z AlTamimi, Elizabeth A Williams, Mark S Hawley
<p><strong>Background: </strong>The use of smartphone apps for dietary self-management among patients with high blood pressure is becoming increasingly common. Few commercially available DASH (Dietary Approaches to Stop Hypertension) diet apps have the potential to be effective, and only a few of these have adequate security and privacy measures. In previous studies, we identified 2 high-quality apps that are likely effective and safe. One of these, the Noom app, was selected as the most suitable app for use in the Saudi Arabian context based on health care professionals' and patients' preferences.</p><p><strong>Objective: </strong>This study aims to determine the feasibility and acceptability of using the Noom app to support DASH diet self-management among people with high blood pressure in Saudi Arabia.</p><p><strong>Methods: </strong>This mixed methods study evaluated the feasibility and acceptability of using the Noom app among people with high blood pressure in Riyadh, Saudi Arabia. Fourteen participants with high blood pressure were recruited and asked to use the app for 8 weeks. The quantitative outcome measures were DASH diet adherence and self-efficacy. Feasibility and acceptability were assessed during and after the intervention via the Noom diet-tracking engagement questionnaire, the System Usability Scale, and semistructured interviews.</p><p><strong>Results: </strong>Most participants (8/13, 62%) logged their meals for 3 to 5 days a week; the frequency of logging increased over time. Snacks were the foods they most often forgot to log. The interviews revealed four main themes: (1) acceptance, (2) app usability, (3) technical issues, and (4) suggestions for improvement. Most participants found the Noom app acceptable, and most had no difficulties integrating it into their daily routines. The results of this feasibility study provided insights into the app's educational content, some of which was deemed unsuitable for Saudi Arabian users. App usability was identified as a critical theme: the app and its database were easy to use, convenient, and valuable to most of the participants. Despite this, some of the participants reported difficulties in identifying some foods because of a lack of local options on the app. Technical issues included the app freezing or responding slowly. Most participants also suggested developing an Arabic version of the app and simplifying the method of food logging. The participants showed some improvement in self-efficacy and adherence to the DASH diet, although these improvements were not statistically significant. The mean self-efficacy score increased from 18 (SD 4.7) to 20 (SD 6.3), and the mean DASH diet score increased from 3.4 (SD 1.4) to 4.3 (SD 1.1).</p><p><strong>Conclusions: </strong>The app was feasible and acceptable among the participants who completed the study. Further studies are needed to examine the potential of smartphone apps in promoting adherence to the DASH diet and their impact on bl
{"title":"An Investigation of the Feasibility and Acceptability of Using a Commercial DASH (Dietary Approaches to Stop Hypertension) App in People With High Blood Pressure: Mixed Methods Study.","authors":"Ghadah Alnooh, Jozaa Z AlTamimi, Elizabeth A Williams, Mark S Hawley","doi":"10.2196/60037","DOIUrl":"https://doi.org/10.2196/60037","url":null,"abstract":"<p><strong>Background: </strong>The use of smartphone apps for dietary self-management among patients with high blood pressure is becoming increasingly common. Few commercially available DASH (Dietary Approaches to Stop Hypertension) diet apps have the potential to be effective, and only a few of these have adequate security and privacy measures. In previous studies, we identified 2 high-quality apps that are likely effective and safe. One of these, the Noom app, was selected as the most suitable app for use in the Saudi Arabian context based on health care professionals' and patients' preferences.</p><p><strong>Objective: </strong>This study aims to determine the feasibility and acceptability of using the Noom app to support DASH diet self-management among people with high blood pressure in Saudi Arabia.</p><p><strong>Methods: </strong>This mixed methods study evaluated the feasibility and acceptability of using the Noom app among people with high blood pressure in Riyadh, Saudi Arabia. Fourteen participants with high blood pressure were recruited and asked to use the app for 8 weeks. The quantitative outcome measures were DASH diet adherence and self-efficacy. Feasibility and acceptability were assessed during and after the intervention via the Noom diet-tracking engagement questionnaire, the System Usability Scale, and semistructured interviews.</p><p><strong>Results: </strong>Most participants (8/13, 62%) logged their meals for 3 to 5 days a week; the frequency of logging increased over time. Snacks were the foods they most often forgot to log. The interviews revealed four main themes: (1) acceptance, (2) app usability, (3) technical issues, and (4) suggestions for improvement. Most participants found the Noom app acceptable, and most had no difficulties integrating it into their daily routines. The results of this feasibility study provided insights into the app's educational content, some of which was deemed unsuitable for Saudi Arabian users. App usability was identified as a critical theme: the app and its database were easy to use, convenient, and valuable to most of the participants. Despite this, some of the participants reported difficulties in identifying some foods because of a lack of local options on the app. Technical issues included the app freezing or responding slowly. Most participants also suggested developing an Arabic version of the app and simplifying the method of food logging. The participants showed some improvement in self-efficacy and adherence to the DASH diet, although these improvements were not statistically significant. The mean self-efficacy score increased from 18 (SD 4.7) to 20 (SD 6.3), and the mean DASH diet score increased from 3.4 (SD 1.4) to 4.3 (SD 1.1).</p><p><strong>Conclusions: </strong>The app was feasible and acceptable among the participants who completed the study. Further studies are needed to examine the potential of smartphone apps in promoting adherence to the DASH diet and their impact on bl","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":"8 ","pages":"e60037"},"PeriodicalIF":2.0,"publicationDate":"2024-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142675876","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Sharon Hoi Lam Pak, Chanchan Wu, Kitty Wai Ying Choi, Edmond Pui Hang Choi
<p><strong>Background: </strong>Technology-facilitated sexual violence and abuse (TFSVA) encompasses a range of behaviors where digital technologies are used to enable both virtual and in-person sexual violence. Given that TFSVA is an emerging and continually evolving form of sexual abuse, it has been challenging to establish a universally accepted definition or to develop standardized measures for its assessment.</p><p><strong>Objective: </strong>This study aimed to address the significant gap in research on TFSVA within the Chinese context. Specifically, it sought to develop a TFSVA measurement tool with robust content validity, tailored for use in subsequent epidemiological studies within the Chinese context.</p><p><strong>Methods: </strong>The first step in developing the measurement approach for TFSVA victimization and perpetration was to conduct a thorough literature review of existing empirical research on TFSVA and relevant measurement tools. After the initial generation of items, all the items were reviewed by an expert panel to assess the face validity. The measurement items were further reviewed by potential research participants, who were recruited through snowball sampling via online platforms. The assessment results were quantified by computing the content validity index (CVI). The participants were asked to rate each scale item in terms of its relevance, appropriateness, and clarity regarding the topic.</p><p><strong>Results: </strong>The questionnaire was reviewed by 24 lay experts, with a mean age of 27.96 years. They represented different genders and sexual orientations. The final questionnaire contained a total of 89 items. Three key domains were identified to construct the questionnaire, which included image-based sexual abuse, nonimage-based TFSVA, and online-initiated physical sexual violence. The overall scale CVI values of relevance, appropriateness, and clarity for the scale were 0.90, 0.96, and 0.97, respectively, which indicated high content validity for all the instrument items. To ensure the measurement accurately reflects the experiences of diverse demographic groups, the content validity was further analyzed by gender and sexual orientation. This analysis revealed variations in item validity among participants from different genders and sexual orientations. For instance, heterosexual male respondents showed a particularly low CVI for relevance of 0.20 in the items related to nudity, including "male's chest/nipples are visible" and "the person is sexually suggestive." This underscored the importance of an inclusive approach when developing a measurement for TFSVA.</p><p><strong>Conclusions: </strong>This study greatly advances the assessment of TFSVA by examining the content validity of our newly developed measurement. The findings revealed that our measurement tool demonstrated adequate content validity, thereby providing a strong foundation for assessing TFSVA within the Chinese context. Implementing this tool is a
{"title":"Measuring Technology-Facilitated Sexual Violence and Abuse in the Chinese Context: Development Study and Content Validity Analysis.","authors":"Sharon Hoi Lam Pak, Chanchan Wu, Kitty Wai Ying Choi, Edmond Pui Hang Choi","doi":"10.2196/65199","DOIUrl":"https://doi.org/10.2196/65199","url":null,"abstract":"<p><strong>Background: </strong>Technology-facilitated sexual violence and abuse (TFSVA) encompasses a range of behaviors where digital technologies are used to enable both virtual and in-person sexual violence. Given that TFSVA is an emerging and continually evolving form of sexual abuse, it has been challenging to establish a universally accepted definition or to develop standardized measures for its assessment.</p><p><strong>Objective: </strong>This study aimed to address the significant gap in research on TFSVA within the Chinese context. Specifically, it sought to develop a TFSVA measurement tool with robust content validity, tailored for use in subsequent epidemiological studies within the Chinese context.</p><p><strong>Methods: </strong>The first step in developing the measurement approach for TFSVA victimization and perpetration was to conduct a thorough literature review of existing empirical research on TFSVA and relevant measurement tools. After the initial generation of items, all the items were reviewed by an expert panel to assess the face validity. The measurement items were further reviewed by potential research participants, who were recruited through snowball sampling via online platforms. The assessment results were quantified by computing the content validity index (CVI). The participants were asked to rate each scale item in terms of its relevance, appropriateness, and clarity regarding the topic.</p><p><strong>Results: </strong>The questionnaire was reviewed by 24 lay experts, with a mean age of 27.96 years. They represented different genders and sexual orientations. The final questionnaire contained a total of 89 items. Three key domains were identified to construct the questionnaire, which included image-based sexual abuse, nonimage-based TFSVA, and online-initiated physical sexual violence. The overall scale CVI values of relevance, appropriateness, and clarity for the scale were 0.90, 0.96, and 0.97, respectively, which indicated high content validity for all the instrument items. To ensure the measurement accurately reflects the experiences of diverse demographic groups, the content validity was further analyzed by gender and sexual orientation. This analysis revealed variations in item validity among participants from different genders and sexual orientations. For instance, heterosexual male respondents showed a particularly low CVI for relevance of 0.20 in the items related to nudity, including \"male's chest/nipples are visible\" and \"the person is sexually suggestive.\" This underscored the importance of an inclusive approach when developing a measurement for TFSVA.</p><p><strong>Conclusions: </strong>This study greatly advances the assessment of TFSVA by examining the content validity of our newly developed measurement. The findings revealed that our measurement tool demonstrated adequate content validity, thereby providing a strong foundation for assessing TFSVA within the Chinese context. Implementing this tool is a","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":"8 ","pages":"e65199"},"PeriodicalIF":2.0,"publicationDate":"2024-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142675878","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Huitong Ding, Katherine Gifford, Ludy C Shih, Kristi Ho, Salman Rahman, Akwaugo Igwe, Spencer Low, Zachary Popp, Edward Searls, Zexu Li, Sanskruti Madan, Alexa Burk, Phillip H Hwang, Ileana De Anda-Duran, Vijaya B Kolachalama, Rhoda Au, Honghuang Lin
Background: Although digital technology represents a growing field aiming to revolutionize early Alzheimer disease risk prediction and monitoring, the perspectives of older adults on an integrated digital brain health platform have not been investigated.
Objective: This study aims to understand the perspectives of older adults on a digital brain health platform by conducting semistructured interviews and analyzing their transcriptions by natural language processing.
Methods: The study included 28 participants from the Boston University Alzheimer's Disease Research Center, all of whom engaged with a digital brain health platform over an initial assessment period of 14 days. Semistructured interviews were conducted to collect data on participants' experiences with the digital brain health platform. The transcripts generated from these interviews were analyzed using natural language processing techniques. The frequency of positive and negative terms was evaluated through word count analysis. A sentiment analysis was used to measure the emotional tone and subjective perceptions of the participants toward the digital platform.
Results: Word count analysis revealed a generally positive sentiment toward the digital platform, with "like," "well," and "good" being the most frequently mentioned positive terms. However, terms such as "problem" and "hard" indicated certain challenges faced by participants. Sentiment analysis showed a slightly positive attitude with a median polarity score of 0.13 (IQR 0.08-0.15), ranging from -1 (completely negative) to 1 (completely positive), and a median subjectivity score of 0.51 (IQR 0.47-0.53), ranging from 0 (completely objective) to 1 (completely subjective). These results suggested an overall positive attitude among the study cohort.
Conclusions: The study highlights the importance of understanding older adults' attitudes toward digital health platforms amid the comprehensive evolution of the digitalization era. Future research should focus on refining digital solutions to meet the specific needs of older adults, fostering a more personalized approach to brain health.
{"title":"Exploring the Perspectives of Older Adults on a Digital Brain Health Platform Using Natural Language Processing: Cohort Study.","authors":"Huitong Ding, Katherine Gifford, Ludy C Shih, Kristi Ho, Salman Rahman, Akwaugo Igwe, Spencer Low, Zachary Popp, Edward Searls, Zexu Li, Sanskruti Madan, Alexa Burk, Phillip H Hwang, Ileana De Anda-Duran, Vijaya B Kolachalama, Rhoda Au, Honghuang Lin","doi":"10.2196/60453","DOIUrl":"10.2196/60453","url":null,"abstract":"<p><strong>Background: </strong>Although digital technology represents a growing field aiming to revolutionize early Alzheimer disease risk prediction and monitoring, the perspectives of older adults on an integrated digital brain health platform have not been investigated.</p><p><strong>Objective: </strong>This study aims to understand the perspectives of older adults on a digital brain health platform by conducting semistructured interviews and analyzing their transcriptions by natural language processing.</p><p><strong>Methods: </strong>The study included 28 participants from the Boston University Alzheimer's Disease Research Center, all of whom engaged with a digital brain health platform over an initial assessment period of 14 days. Semistructured interviews were conducted to collect data on participants' experiences with the digital brain health platform. The transcripts generated from these interviews were analyzed using natural language processing techniques. The frequency of positive and negative terms was evaluated through word count analysis. A sentiment analysis was used to measure the emotional tone and subjective perceptions of the participants toward the digital platform.</p><p><strong>Results: </strong>Word count analysis revealed a generally positive sentiment toward the digital platform, with \"like,\" \"well,\" and \"good\" being the most frequently mentioned positive terms. However, terms such as \"problem\" and \"hard\" indicated certain challenges faced by participants. Sentiment analysis showed a slightly positive attitude with a median polarity score of 0.13 (IQR 0.08-0.15), ranging from -1 (completely negative) to 1 (completely positive), and a median subjectivity score of 0.51 (IQR 0.47-0.53), ranging from 0 (completely objective) to 1 (completely subjective). These results suggested an overall positive attitude among the study cohort.</p><p><strong>Conclusions: </strong>The study highlights the importance of understanding older adults' attitudes toward digital health platforms amid the comprehensive evolution of the digitalization era. Future research should focus on refining digital solutions to meet the specific needs of older adults, fostering a more personalized approach to brain health.</p>","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":"8 ","pages":"e60453"},"PeriodicalIF":2.0,"publicationDate":"2024-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142667786","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Annina Fahr, Andrina Kläy, Larissa S Coka, Hubertus J A van Hedel
<p><strong>Background: </strong>Selective voluntary motor control (SVMC) is the ability to control joint movements independently. Impairments in SVMC can affect functional activities, but only a few interventions directly target SVMC. Therefore, we developed a game-based intervention for children with upper motor neuron lesions to improve SVMC. The intervention trained selective activation of a muscle or joint movement while providing immediate feedback about involuntarily occurring muscle activations or movements in another joint. The intervention was provided in a playful manner with a custom-made game environment and a technology-based interface to capture muscle activation or joint movements.</p><p><strong>Objective: </strong>This study aimed to investigate the effectiveness of this game-based intervention and explore treatment response-related factors in children with impaired SVMC undergoing inpatient neurorehabilitation.</p><p><strong>Methods: </strong>We conducted a single-case research study with a randomized, nonconcurrent, multiple baseline design. The study consisted of a random-length baseline phase where no SVMC-specific intervention was provided and an intervention phase with additional SVMC training. Concurrently in both phases, children attended their individual multimodal rehabilitation program at our clinic, Swiss Children's Rehab. During the intervention phase, participants completed ten 45-minute sessions with our game-based SVMC training. SVMC was measured repeatedly throughout both phases and at the 3-month follow-up with a short custom-made assessment.</p><p><strong>Results: </strong>Eighteen children with reduced SVMC from upper motor neuron lesions participated in the study. The mean age of the children was 12.7 (SD 2.9) years, and they mostly had spastic cerebral palsy. A linear mixed-effects model revealed a significant trend (P<.001) for improved SVMC already in the baseline phase. This trend did not change significantly (P=.15) when the game-based SVMC training was introduced in the intervention phase, suggesting no additional improvements due to the SVMC training. Although we could not find an overall treatment effect, we could explain 89.4% of the total random variation of the treatment effect by patient and therapy characteristics. Children with spasticity in the trained movement (20.1%), and those who trained the more affected side (23.5%) benefited most from the intervention. At the 3-month follow-up, SVMC had deteriorated compared to the end of the intervention but was still better than at the beginning of the study.</p><p><strong>Conclusions: </strong>The regular concomitant rehabilitation program already yielded improvements in SVMC, while the game-based SVMC training showed no additional effects. Although the intervention did not show a group effect, we could identify patient and therapy characteristics that determine who is likely to profit from the intervention.</p><p><strong>Trial registration: </strong>G
{"title":"Effectiveness of Game-Based Training of Selective Voluntary Motor Control in Children With Upper Motor Neuron Lesions: Randomized Multiple Baseline Design Study.","authors":"Annina Fahr, Andrina Kläy, Larissa S Coka, Hubertus J A van Hedel","doi":"10.2196/47754","DOIUrl":"10.2196/47754","url":null,"abstract":"<p><strong>Background: </strong>Selective voluntary motor control (SVMC) is the ability to control joint movements independently. Impairments in SVMC can affect functional activities, but only a few interventions directly target SVMC. Therefore, we developed a game-based intervention for children with upper motor neuron lesions to improve SVMC. The intervention trained selective activation of a muscle or joint movement while providing immediate feedback about involuntarily occurring muscle activations or movements in another joint. The intervention was provided in a playful manner with a custom-made game environment and a technology-based interface to capture muscle activation or joint movements.</p><p><strong>Objective: </strong>This study aimed to investigate the effectiveness of this game-based intervention and explore treatment response-related factors in children with impaired SVMC undergoing inpatient neurorehabilitation.</p><p><strong>Methods: </strong>We conducted a single-case research study with a randomized, nonconcurrent, multiple baseline design. The study consisted of a random-length baseline phase where no SVMC-specific intervention was provided and an intervention phase with additional SVMC training. Concurrently in both phases, children attended their individual multimodal rehabilitation program at our clinic, Swiss Children's Rehab. During the intervention phase, participants completed ten 45-minute sessions with our game-based SVMC training. SVMC was measured repeatedly throughout both phases and at the 3-month follow-up with a short custom-made assessment.</p><p><strong>Results: </strong>Eighteen children with reduced SVMC from upper motor neuron lesions participated in the study. The mean age of the children was 12.7 (SD 2.9) years, and they mostly had spastic cerebral palsy. A linear mixed-effects model revealed a significant trend (P<.001) for improved SVMC already in the baseline phase. This trend did not change significantly (P=.15) when the game-based SVMC training was introduced in the intervention phase, suggesting no additional improvements due to the SVMC training. Although we could not find an overall treatment effect, we could explain 89.4% of the total random variation of the treatment effect by patient and therapy characteristics. Children with spasticity in the trained movement (20.1%), and those who trained the more affected side (23.5%) benefited most from the intervention. At the 3-month follow-up, SVMC had deteriorated compared to the end of the intervention but was still better than at the beginning of the study.</p><p><strong>Conclusions: </strong>The regular concomitant rehabilitation program already yielded improvements in SVMC, while the game-based SVMC training showed no additional effects. Although the intervention did not show a group effect, we could identify patient and therapy characteristics that determine who is likely to profit from the intervention.</p><p><strong>Trial registration: </strong>G","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":"8 ","pages":"e47754"},"PeriodicalIF":2.0,"publicationDate":"2024-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142667782","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
<p><strong>Background: </strong>Deterioration rates after enhanced cognitive behavioral therapy (CBT-E) for patients with bulimia-spectrum eating disorders (BN-EDs) remain high, and decreased posttreatment skill use might be a particularly relevant contributor. Digital interventions could be an ideal option to improve skill use after treatment ends but they have yet to be investigated for BN-EDs.</p><p><strong>Objective: </strong>This study used a user-centered design approach to explore patients' interest in a digital intervention to prevent deterioration after CBT-E and their desired features.</p><p><strong>Methods: </strong>A total of 12 participants who previously received CBT-E for BN-EDs and experienced at least a partial response to treatment completed a qualitative interview asking about their interests and needs for an app designed to prevent deterioration after treatment ended. Participants were also presented with features commonly used in digital interventions for EDs and were asked to provide feedback.</p><p><strong>Results: </strong>All 12 participants expressed interest in using an app to prevent deterioration after treatment ended. In total, 11 participants thought the proposed feature of setting a goal focusing on skill use weekly would help improve self-accountability for skill use, and 6 participants supported the idea of setting goals related to specific triggers because they would know what skills to use in high-risk situations. A total of 10 participants supported the self-monitoring ED behaviors feature because it could increase their awareness levels. Participants also reported wanting to track mood (n=6) and food intake (n=5) besides the proposed tracking feature. A total of 10 participants reported wanting knowledge-based content in the app, including instructions on skill practice (n=6), general mental health strategies outside of EDs (n=4), guided mindfulness exercises (n=3), and nutrition recommendations (n=3). Eight participants reported a desire for the app to send targeted push notifications, including reminders of skill use (n=7) and inspirational quotes for encouragement (n=3). Finally, 8 participants reported wanting a human connection in the app, 6 participants wishing to interact with other users to support and learn from each other, and 4 participants wanting to connect with professionals as needed. Overall, participants thought that having an app targeting skill use could provide continued support and improve self-accountability, thus lowering the risk of decreased skill use after treatment ended.</p><p><strong>Conclusions: </strong>Insights from participants highlighted the perceived importance of continued support for continued skill use after treatment ended. This study also provided valuable design implications regarding potential features focusing on facilitating posttreatment skill use to include in digital deterioration prevention programs. Future research should examine the optimal approaches to deli
{"title":"Understanding Patients' Preferences for a Digital Intervention to Prevent Posttreatment Deterioration for Bulimia-Spectrum Eating Disorders: User-Centered Design Study.","authors":"Jianyi Liu, Alyssa Giannone, Hailing Wang, Lucy Wetherall, Adrienne Juarascio","doi":"10.2196/60865","DOIUrl":"10.2196/60865","url":null,"abstract":"<p><strong>Background: </strong>Deterioration rates after enhanced cognitive behavioral therapy (CBT-E) for patients with bulimia-spectrum eating disorders (BN-EDs) remain high, and decreased posttreatment skill use might be a particularly relevant contributor. Digital interventions could be an ideal option to improve skill use after treatment ends but they have yet to be investigated for BN-EDs.</p><p><strong>Objective: </strong>This study used a user-centered design approach to explore patients' interest in a digital intervention to prevent deterioration after CBT-E and their desired features.</p><p><strong>Methods: </strong>A total of 12 participants who previously received CBT-E for BN-EDs and experienced at least a partial response to treatment completed a qualitative interview asking about their interests and needs for an app designed to prevent deterioration after treatment ended. Participants were also presented with features commonly used in digital interventions for EDs and were asked to provide feedback.</p><p><strong>Results: </strong>All 12 participants expressed interest in using an app to prevent deterioration after treatment ended. In total, 11 participants thought the proposed feature of setting a goal focusing on skill use weekly would help improve self-accountability for skill use, and 6 participants supported the idea of setting goals related to specific triggers because they would know what skills to use in high-risk situations. A total of 10 participants supported the self-monitoring ED behaviors feature because it could increase their awareness levels. Participants also reported wanting to track mood (n=6) and food intake (n=5) besides the proposed tracking feature. A total of 10 participants reported wanting knowledge-based content in the app, including instructions on skill practice (n=6), general mental health strategies outside of EDs (n=4), guided mindfulness exercises (n=3), and nutrition recommendations (n=3). Eight participants reported a desire for the app to send targeted push notifications, including reminders of skill use (n=7) and inspirational quotes for encouragement (n=3). Finally, 8 participants reported wanting a human connection in the app, 6 participants wishing to interact with other users to support and learn from each other, and 4 participants wanting to connect with professionals as needed. Overall, participants thought that having an app targeting skill use could provide continued support and improve self-accountability, thus lowering the risk of decreased skill use after treatment ended.</p><p><strong>Conclusions: </strong>Insights from participants highlighted the perceived importance of continued support for continued skill use after treatment ended. This study also provided valuable design implications regarding potential features focusing on facilitating posttreatment skill use to include in digital deterioration prevention programs. Future research should examine the optimal approaches to deli","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":"8 ","pages":"e60865"},"PeriodicalIF":2.0,"publicationDate":"2024-11-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142667796","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Yesica Albor, Noé González, Corina Benjet, Alicia Salamanca-Sanabria, Cristiny Hernández-de la Rosa, Viridiana Eslava-Torres, María Carolina García-Alfaro, Andrés Melchor-Audirac, Laura Itzel Montoya-Montero, Karla Suárez
<p><strong>Background: </strong>To scale up mental health care in low-resource settings, digital interventions must consider cultural fit. Despite the findings that culturally adapted digital interventions have greater effectiveness, there is a lack of empirical evidence of interventions that have been culturally adapted or their adaptation documented.</p><p><strong>Objective: </strong>This study aimed to document the cultural adaptation of the SilverCloud Health Space from Depression and Anxiety program for university students in Colombia and Mexico and evaluate user satisfaction with the adapted program.</p><p><strong>Methods: </strong>A mixed methods process was based on Cultural Sensitivity and Ecological Validity frameworks. In phase 1, the research team added culturally relevant content (eg, expressions, personal stories, photos) for the target population to the intervention. In phase 2, potential users (9 university students) first evaluated the vignettes and photos used throughout the program. We calculated median and modal responses. They then participated in focus groups to evaluate and assess the cultural appropriateness of the materials. Their comments were coded into the 8 dimensions of the Ecological Validity Framework. Phase 3 consisted of choosing the vignettes most highly rated by the potential users and making modifications to the materials based on the student feedback. In the final phase, 765 actual users then engaged with the culturally adapted program and rated their satisfaction with the program. We calculated the percentage of users who agreed or strongly agreed that the modules were interesting, relevant, useful, and helped them attain their goals.</p><p><strong>Results: </strong>The potential users perceived the original vignettes as moderately genuine, or true, which were given median scores between 2.5 and 3 (out of a possible 4) and somewhat identified with the situations presented in the vignettes given median scores between 1.5 and 3. The majority of comments or suggestions for modification concerned language (126/218, 57.5%), followed by concepts (50/218, 22.8%). Much less concerned methods (22/218, 10%), persons (9/218, 4.1%), context (5/218, 2.3%), or content (2/218, 0.9%). There were no comments about metaphors or goals. Intervention materials were modified based on these results. Of the actual users who engaged with the adapted version of the program, 87.7%-96.2% of them agreed or strongly agreed that the modules were interesting, relevant, useful, and helped them to attain their goals.</p><p><strong>Conclusions: </strong>We conclude that the adapted version is satisfactory for this population based on the focus group discussions and the satisfaction scores. Conducting and documenting such cultural adaptations and involving the users in the cultural adaptation process will likely improve the effectiveness of digital mental health interventions in low- and middle-income countries and culturally diverse contexts.
背景：要在资源匮乏的环境中推广心理健康护理，数字干预措施必须考虑文化适应性。尽管研究结果表明，经过文化适应性调整的数字化干预措施具有更高的有效性，但目前缺乏经过文化适应性调整的干预措施的实证证据，也缺乏对其适应性的记录：本研究旨在记录针对哥伦比亚和墨西哥大学生的银云健康空间（SilverCloud Health Space from Depression and Anxiety）项目的文化适应性，并评估用户对适应性项目的满意度：方法：根据文化敏感性和生态有效性框架，采用混合方法进行研究。在第一阶段，研究小组为干预措施添加了与目标人群文化相关的内容（如表达方式、个人故事、照片）。在第 2 阶段，潜在用户（9 名大学生）首先对整个程序中使用的小故事和照片进行了评估。我们计算了回答的中位数和模数。然后，他们参加了焦点小组，对材料的文化适宜性进行评价和评估。他们的意见被编入生态有效性框架的 8 个维度。第三阶段包括选择潜在用户评价最高的小故事，并根据学生的反馈意见对教材进行修改。在最后阶段，765 名实际用户参与了经过文化调整的程序，并对程序的满意度进行了评分。我们计算了同意或非常同意这些模块有趣、相关、有用并能帮助他们实现目标的用户百分比：潜在用户认为原版小故事的真实性一般，中位数在 2.5 到 3 分之间（满分 4 分），对小故事中的情境有一定认同感，中位数在 1.5 到 3 分之间。大多数意见或修改建议涉及语言（126/218，57.5%），其次是概念（50/218，22.8%）。与方法（22/218，10%）、人物（9/218，4.1%）、语境（5/218，2.3%）或内容（2/218，0.9%）有关的意见或建议要少得多。没有人对隐喻或目标提出意见。根据这些结果对干预材料进行了修改。在参与改编版项目的实际使用者中，87.7%-96.2%的人同意或非常同意这些模块有趣、相关、有用，并有助于他们实现目标：根据焦点小组讨论和满意度评分，我们得出结论，改编版课程对这一人群来说是令人满意的。在中低收入国家和多元文化背景下，进行此类文化适应性调整并将其记录在案，让用户参与到文化适应性调整过程中，将有可能提高数字心理健康干预措施的有效性。
{"title":"Cultural Adaptation and User Satisfaction of an Internet-Delivered Cognitive Behavioral Program for Depression and Anxiety Among College Students in Two Latin American Countries: Focus Group Study With Potential Users and a Cross-Sectional Questionnaire Study With Actual Users.","authors":"Yesica Albor, Noé González, Corina Benjet, Alicia Salamanca-Sanabria, Cristiny Hernández-de la Rosa, Viridiana Eslava-Torres, María Carolina García-Alfaro, Andrés Melchor-Audirac, Laura Itzel Montoya-Montero, Karla Suárez","doi":"10.2196/63298","DOIUrl":"10.2196/63298","url":null,"abstract":"<p><strong>Background: </strong>To scale up mental health care in low-resource settings, digital interventions must consider cultural fit. Despite the findings that culturally adapted digital interventions have greater effectiveness, there is a lack of empirical evidence of interventions that have been culturally adapted or their adaptation documented.</p><p><strong>Objective: </strong>This study aimed to document the cultural adaptation of the SilverCloud Health Space from Depression and Anxiety program for university students in Colombia and Mexico and evaluate user satisfaction with the adapted program.</p><p><strong>Methods: </strong>A mixed methods process was based on Cultural Sensitivity and Ecological Validity frameworks. In phase 1, the research team added culturally relevant content (eg, expressions, personal stories, photos) for the target population to the intervention. In phase 2, potential users (9 university students) first evaluated the vignettes and photos used throughout the program. We calculated median and modal responses. They then participated in focus groups to evaluate and assess the cultural appropriateness of the materials. Their comments were coded into the 8 dimensions of the Ecological Validity Framework. Phase 3 consisted of choosing the vignettes most highly rated by the potential users and making modifications to the materials based on the student feedback. In the final phase, 765 actual users then engaged with the culturally adapted program and rated their satisfaction with the program. We calculated the percentage of users who agreed or strongly agreed that the modules were interesting, relevant, useful, and helped them attain their goals.</p><p><strong>Results: </strong>The potential users perceived the original vignettes as moderately genuine, or true, which were given median scores between 2.5 and 3 (out of a possible 4) and somewhat identified with the situations presented in the vignettes given median scores between 1.5 and 3. The majority of comments or suggestions for modification concerned language (126/218, 57.5%), followed by concepts (50/218, 22.8%). Much less concerned methods (22/218, 10%), persons (9/218, 4.1%), context (5/218, 2.3%), or content (2/218, 0.9%). There were no comments about metaphors or goals. Intervention materials were modified based on these results. Of the actual users who engaged with the adapted version of the program, 87.7%-96.2% of them agreed or strongly agreed that the modules were interesting, relevant, useful, and helped them to attain their goals.</p><p><strong>Conclusions: </strong>We conclude that the adapted version is satisfactory for this population based on the focus group discussions and the satisfaction scores. Conducting and documenting such cultural adaptations and involving the users in the cultural adaptation process will likely improve the effectiveness of digital mental health interventions in low- and middle-income countries and culturally diverse contexts.","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":"8 ","pages":"e63298"},"PeriodicalIF":2.0,"publicationDate":"2024-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142638865","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Shirley Dumassais, Karl Singh Grewal, Gabrielle Aubin, Megan O'Connell, Natalie A Phillips, Walter Wittich
Background: The COVID-19 pandemic caused a drastic shift in the practice of research and clinical services. It has been noted that cognition measured via in-person versus remote methods differ substantially, and it is possible that subjective and experiential differences exist between modalities.
Objective: The aim of the study is to explore the perceptions of both researchers and older adult participants on the experience of remotely conducted research using a cognitive screener.
Methods: We conducted a thematic analysis of the experience of engaging in remote research from both the participant (n=10) and researcher (n=4) perspectives. The research interaction was framed through teleadministration of the Montreal Cognitive Assessment-Blind (suitable for telephone administration) and administration of a subsequent semistructured debriefing interview. Participant perspectives were garnered during debriefing interviews, while researcher insights were collected via self-reported qualitative field notes completed following each research session.
Results: Data aggregated into themes of barriers and facilitators from the lenses of both participants and researchers. Participants noted facilitators including short instrument length, convenience, and presession contact; barriers included the length of the interaction, some tasks being more challenging on the phone, and the potential for participant dishonesty. Research assistants noted several facilitators: instrument length, rapport building, ability to prepare for and record sessions, and comfort with the protocol; barriers were items with too many response options, telephone issues (eg, response delays), and concerns about participant comprehension.
Conclusions: These results suggest remote telephone-delivered cognitive screening tools as a feasible and acceptable method of research inquiry. The findings provide a starting point for the inclusion of diverse populations in research to capture underrepresented groups whose input would immensely benefit our understanding of remotely delivered cognitive screening measures. Further, we offer materials (eg, checklists), which can be used in future investigations to promote future inclusive research and increase generalizability.
{"title":"Exploring the Qualitative Experiences of Administering and Participating in Remote Research via Telephone Using the Montreal Cognitive Assessment-Blind: Cross-Sectional Study of Older Adults.","authors":"Shirley Dumassais, Karl Singh Grewal, Gabrielle Aubin, Megan O'Connell, Natalie A Phillips, Walter Wittich","doi":"10.2196/58537","DOIUrl":"10.2196/58537","url":null,"abstract":"<p><strong>Background: </strong>The COVID-19 pandemic caused a drastic shift in the practice of research and clinical services. It has been noted that cognition measured via in-person versus remote methods differ substantially, and it is possible that subjective and experiential differences exist between modalities.</p><p><strong>Objective: </strong>The aim of the study is to explore the perceptions of both researchers and older adult participants on the experience of remotely conducted research using a cognitive screener.</p><p><strong>Methods: </strong>We conducted a thematic analysis of the experience of engaging in remote research from both the participant (n=10) and researcher (n=4) perspectives. The research interaction was framed through teleadministration of the Montreal Cognitive Assessment-Blind (suitable for telephone administration) and administration of a subsequent semistructured debriefing interview. Participant perspectives were garnered during debriefing interviews, while researcher insights were collected via self-reported qualitative field notes completed following each research session.</p><p><strong>Results: </strong>Data aggregated into themes of barriers and facilitators from the lenses of both participants and researchers. Participants noted facilitators including short instrument length, convenience, and presession contact; barriers included the length of the interaction, some tasks being more challenging on the phone, and the potential for participant dishonesty. Research assistants noted several facilitators: instrument length, rapport building, ability to prepare for and record sessions, and comfort with the protocol; barriers were items with too many response options, telephone issues (eg, response delays), and concerns about participant comprehension.</p><p><strong>Conclusions: </strong>These results suggest remote telephone-delivered cognitive screening tools as a feasible and acceptable method of research inquiry. The findings provide a starting point for the inclusion of diverse populations in research to capture underrepresented groups whose input would immensely benefit our understanding of remotely delivered cognitive screening measures. Further, we offer materials (eg, checklists), which can be used in future investigations to promote future inclusive research and increase generalizability.</p>","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":"8 ","pages":"e58537"},"PeriodicalIF":2.0,"publicationDate":"2024-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142638871","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
<p><strong>Background: </strong>Studying illicit drug circulation and its effects on population health is complicated due to the criminalization of trade and consumption. Illicit drug markets have evolved with IT, moving digital to the "darknet." Previous research has analyzed darknet market listings and customer reviews. Research tools include public health surveys and medical reports but lack neutral data on drugs' spread and impact. This study fills this gap with an analysis of the volume of drugs traded on the darknet market.</p><p><strong>Objective: </strong>We aimed to use the dark web data and officially published indicators to identify the most vulnerable regions of Russia and the correlations between the pairs of variables to measure how illicit drug trade can affect population well-being.</p><p><strong>Methods: </strong>We web-parsed the Hydra darknet drug marketplace using Python code. The dataset encompassed 3045 individual sellers marketing 6721 unique products via 58,563 distinct postings, each representing specific quantities sold in different Russian regions during 2019. In the second stage, we collected 31 variables from official sources to compare officially collected data with darknet data about amounts and types of selling drugs in every 85 regions of Russia. The health-related data were obtained from official published sources-statistical yearbooks. Maps, diagrams, correlation matrixes, and applied observational statistical methods were used.</p><p><strong>Results: </strong>In 2019, a minimum of 124 kilograms of drugs circulated daily in small batches on the Russian darknet. Cannabis dominated the market, being 10 times more prevalent than opiates, and cannabis products' higher availability in the region is correlated with a lower incidence of opiate overdoses. The "grams of opiates in the region" variable is significantly correlated with drug overdose deaths (r=.41; P=.003), HIV-positive cases due to drug use (r=.51; P=.002), and drug court convictions in Russia (r=.39; P=.004). The study identified significant correlations between opiate sales on the darknet and higher rates of HIV among injection drug users (r=.47; P=.003). Conversely, regions with higher cannabis sales exhibited significant negative correlations with indicators of harmful drug use (r=-.52; P=.002) and its prevalence (r=-.49; P=.001). These findings suggest regional variations in drug sales on the darknet may be associated with differing public health outcomes. These indicators accurately reflect regional drug issues, though some official statistics may be incomplete or biased.</p><p><strong>Conclusions: </strong>Our findings point to varying levels of risk associated with different types of drugs sold on the darknet, but further research is needed to explore these relationships in greater depth. The study's findings highlight the importance of considering regional variations in darknet drug sales when developing public health strategies. The significant c
{"title":"Association of Drugs for Sale on the Internet and Official Health Indicators: Darknet Parsing and Correlational Study.","authors":"Sergey Soshnikov, Svetlana Bekker, Bulat Idrisov, Vasiliy Vlassov","doi":"10.2196/56006","DOIUrl":"https://doi.org/10.2196/56006","url":null,"abstract":"<p><strong>Background: </strong>Studying illicit drug circulation and its effects on population health is complicated due to the criminalization of trade and consumption. Illicit drug markets have evolved with IT, moving digital to the \"darknet.\" Previous research has analyzed darknet market listings and customer reviews. Research tools include public health surveys and medical reports but lack neutral data on drugs' spread and impact. This study fills this gap with an analysis of the volume of drugs traded on the darknet market.</p><p><strong>Objective: </strong>We aimed to use the dark web data and officially published indicators to identify the most vulnerable regions of Russia and the correlations between the pairs of variables to measure how illicit drug trade can affect population well-being.</p><p><strong>Methods: </strong>We web-parsed the Hydra darknet drug marketplace using Python code. The dataset encompassed 3045 individual sellers marketing 6721 unique products via 58,563 distinct postings, each representing specific quantities sold in different Russian regions during 2019. In the second stage, we collected 31 variables from official sources to compare officially collected data with darknet data about amounts and types of selling drugs in every 85 regions of Russia. The health-related data were obtained from official published sources-statistical yearbooks. Maps, diagrams, correlation matrixes, and applied observational statistical methods were used.</p><p><strong>Results: </strong>In 2019, a minimum of 124 kilograms of drugs circulated daily in small batches on the Russian darknet. Cannabis dominated the market, being 10 times more prevalent than opiates, and cannabis products' higher availability in the region is correlated with a lower incidence of opiate overdoses. The \"grams of opiates in the region\" variable is significantly correlated with drug overdose deaths (r=.41; P=.003), HIV-positive cases due to drug use (r=.51; P=.002), and drug court convictions in Russia (r=.39; P=.004). The study identified significant correlations between opiate sales on the darknet and higher rates of HIV among injection drug users (r=.47; P=.003). Conversely, regions with higher cannabis sales exhibited significant negative correlations with indicators of harmful drug use (r=-.52; P=.002) and its prevalence (r=-.49; P=.001). These findings suggest regional variations in drug sales on the darknet may be associated with differing public health outcomes. These indicators accurately reflect regional drug issues, though some official statistics may be incomplete or biased.</p><p><strong>Conclusions: </strong>Our findings point to varying levels of risk associated with different types of drugs sold on the darknet, but further research is needed to explore these relationships in greater depth. The study's findings highlight the importance of considering regional variations in darknet drug sales when developing public health strategies. The significant c","PeriodicalId":14841,"journal":{"name":"JMIR Formative Research","volume":"8 ","pages":"e56006"},"PeriodicalIF":2.0,"publicationDate":"2024-11-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142638854","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
扫码关注我们
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号