首页 > 最新文献

Healthcare Informatics Research最新文献

英文 中文
Deep Learning Model-Based Detection of Anemia from Conjunctiva Images. 基于深度学习模型的结膜图像贫血检测。
IF 2.3 Q3 MEDICAL INFORMATICS Pub Date : 2025-01-01 Epub Date: 2025-01-31 DOI: 10.4258/hir.2025.31.1.57
Najmus Sehar, Nirmala Krishnamoorthi, C Vinoth Kumar

Objectives: Anemia is characterized by a reduction in red blood cells, leading to insufficient levels of hemoglobin, the molecule responsible for carrying oxygen. The current standard method for diagnosing anemia involves analyzing blood samples, a process that is time-consuming and can cause discomfort to participants. This study offers a comprehensive analysis of non-invasive anemia detection using conjunctiva images processed through various machine learning and deep learning models. The focus is on the palpebral conjunctiva, which is highly vascular and unaffected by melanin content.

Methods: Conjunctiva images from both anemic and non-anemic participants were captured using a smartphone. A total of 764 conjunctiva images were augmented to 4,315 images using the deep convolutional generative adversarial network model to prevent overfitting and enhance model robustness. These processed and augmented images were then utilized to train and test multiple models, including statistical regression, machine learning algorithms, and deep learning frameworks.

Results: The stacking ensemble framework, which includes the models VGG16, ResNet-50, and InceptionV3, achieved a high area under the curve score of 0.97. This score demonstrates the framework's exceptional capability in detecting anemia through a noninvasive approach.

Conclusions: This study introduces a noninvasive method for detecting anemia using conjunctiva images obtained with a smartphone and processed using advanced deep learning techniques.

目的:贫血的特点是红细胞减少,导致血红蛋白(负责携带氧气的分子)水平不足。目前诊断贫血的标准方法包括分析血液样本,这个过程很耗时,而且会给参与者带来不适。本研究通过各种机器学习和深度学习模型处理结膜图像,对无创贫血检测进行了全面分析。重点是眼睑结膜,这是高度血管和不受黑色素含量的影响。方法:使用智能手机捕捉贫血和非贫血参与者的结膜图像。使用深度卷积生成对抗网络模型将764张结膜图像增强到4,315张,以防止过拟合并增强模型的鲁棒性。然后利用这些经过处理和增强的图像来训练和测试多个模型,包括统计回归、机器学习算法和深度学习框架。结果:包括VGG16、ResNet-50和InceptionV3模型在内的叠加集成框架获得了较高的曲线下面积得分0.97。这个分数证明了该框架在通过无创方法检测贫血方面的卓越能力。结论:本研究介绍了一种无创检测贫血的方法,该方法使用智能手机获取结膜图像,并使用先进的深度学习技术进行处理。
{"title":"Deep Learning Model-Based Detection of Anemia from Conjunctiva Images.","authors":"Najmus Sehar, Nirmala Krishnamoorthi, C Vinoth Kumar","doi":"10.4258/hir.2025.31.1.57","DOIUrl":"10.4258/hir.2025.31.1.57","url":null,"abstract":"<p><strong>Objectives: </strong>Anemia is characterized by a reduction in red blood cells, leading to insufficient levels of hemoglobin, the molecule responsible for carrying oxygen. The current standard method for diagnosing anemia involves analyzing blood samples, a process that is time-consuming and can cause discomfort to participants. This study offers a comprehensive analysis of non-invasive anemia detection using conjunctiva images processed through various machine learning and deep learning models. The focus is on the palpebral conjunctiva, which is highly vascular and unaffected by melanin content.</p><p><strong>Methods: </strong>Conjunctiva images from both anemic and non-anemic participants were captured using a smartphone. A total of 764 conjunctiva images were augmented to 4,315 images using the deep convolutional generative adversarial network model to prevent overfitting and enhance model robustness. These processed and augmented images were then utilized to train and test multiple models, including statistical regression, machine learning algorithms, and deep learning frameworks.</p><p><strong>Results: </strong>The stacking ensemble framework, which includes the models VGG16, ResNet-50, and InceptionV3, achieved a high area under the curve score of 0.97. This score demonstrates the framework's exceptional capability in detecting anemia through a noninvasive approach.</p><p><strong>Conclusions: </strong>This study introduces a noninvasive method for detecting anemia using conjunctiva images obtained with a smartphone and processed using advanced deep learning techniques.</p>","PeriodicalId":12947,"journal":{"name":"Healthcare Informatics Research","volume":"31 1","pages":"57-65"},"PeriodicalIF":2.3,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11854623/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143457614","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Extreme Prototyping for a Community Health Worker Medical Application. 社区卫生工作者医疗应用程序的极限原型。
IF 2.3 Q3 MEDICAL INFORMATICS Pub Date : 2025-01-01 Epub Date: 2025-01-31 DOI: 10.4258/hir.2025.31.1.88
Jan Noel Molon

Objectives: Noncommunicable diseases (NCDs) pose a significant burden, especially in low- and middle-income countries such as the Philippines. To tackle this issue, the Department of Health launched the Philippine Package of Essential Non-Communicable Disease Interventions (PhilPEN), which includes the use of the Noncommunicable Disease Risk Assessment Form. However, healthcare workers have encountered difficulties due to the form's complexity and the lengthy process required. This study aimed to create a mobile medical app for community health workers by adapting the PhilPEN Noncommunicable Disease Risk Assessment Form using the extreme prototyping framework. The focus was on simplifying data collection and improving the usability of health technology solutions.

Methods: The study employed a qualitative research methodology, which included key informant interviews, linguistic validation, and cognitive debriefing. The extreme prototyping framework was utilized for app development, comprising static prototype, dynamic prototype, and service implementation phases. The app was developed with HTML5, CSS3, JavaScript, and Apache Cordova, adhering to World Health Organization (WHO) guidelines and PhilHealth Circular.

Results: The development process involved three prototype cycles, each consisting of multiple mini-cycles of feedback, system design, coding, and testing. Version 1.xx was aligned with WHO guidelines, Version 2.xx integrated the Department of Health NCD Risk Assessment Form, and Version 3.xx adapted to the updated form with expanded requirements.

Conclusions: The extreme prototyping framework was effectively applied in the development of a medical mobile app, facilitating the integration of health science and information technology. Future research should continue to validate the effectiveness of this approach and identify specific nuances related to health science applications.

目标:非传染性疾病造成了重大负担,特别是在菲律宾等低收入和中等收入国家。为了解决这一问题,卫生部启动了菲律宾非传染性疾病基本干预措施一揽子计划,其中包括使用非传染性疾病风险评估表。然而,由于表格的复杂性和所需的漫长过程,卫生保健工作者遇到了困难。本研究旨在通过使用极限原型框架改编PhilPEN非传染性疾病风险评估表,为社区卫生工作者创建一个移动医疗应用程序。重点是简化数据收集和改进卫生技术解决方案的可用性。方法:本研究采用定性研究方法,包括关键信息提供者访谈、语言验证和认知汇报。应用程序开发使用了极端原型框架,包括静态原型、动态原型和服务实现阶段。该应用程序是根据世界卫生组织(WHO)指南和PhilHealth Circular,使用HTML5、CSS3、JavaScript和Apache Cordova开发的。结果:开发过程包括三个原型周期,每个周期由多个反馈、系统设计、编码和测试的小周期组成。版本1。xx与世卫组织指南第2版保持一致。xx整合了卫生署非传染性疾病风险评估表格,和第三版。Xx适应了更新后的形式和扩展后的需求。结论:将极限原型框架有效应用于医疗移动app的开发,促进了健康科学与信息技术的融合。未来的研究应该继续验证这种方法的有效性,并确定与健康科学应用相关的具体细微差别。
{"title":"Extreme Prototyping for a Community Health Worker Medical Application.","authors":"Jan Noel Molon","doi":"10.4258/hir.2025.31.1.88","DOIUrl":"10.4258/hir.2025.31.1.88","url":null,"abstract":"<p><strong>Objectives: </strong>Noncommunicable diseases (NCDs) pose a significant burden, especially in low- and middle-income countries such as the Philippines. To tackle this issue, the Department of Health launched the Philippine Package of Essential Non-Communicable Disease Interventions (PhilPEN), which includes the use of the Noncommunicable Disease Risk Assessment Form. However, healthcare workers have encountered difficulties due to the form's complexity and the lengthy process required. This study aimed to create a mobile medical app for community health workers by adapting the PhilPEN Noncommunicable Disease Risk Assessment Form using the extreme prototyping framework. The focus was on simplifying data collection and improving the usability of health technology solutions.</p><p><strong>Methods: </strong>The study employed a qualitative research methodology, which included key informant interviews, linguistic validation, and cognitive debriefing. The extreme prototyping framework was utilized for app development, comprising static prototype, dynamic prototype, and service implementation phases. The app was developed with HTML5, CSS3, JavaScript, and Apache Cordova, adhering to World Health Organization (WHO) guidelines and PhilHealth Circular.</p><p><strong>Results: </strong>The development process involved three prototype cycles, each consisting of multiple mini-cycles of feedback, system design, coding, and testing. Version 1.xx was aligned with WHO guidelines, Version 2.xx integrated the Department of Health NCD Risk Assessment Form, and Version 3.xx adapted to the updated form with expanded requirements.</p><p><strong>Conclusions: </strong>The extreme prototyping framework was effectively applied in the development of a medical mobile app, facilitating the integration of health science and information technology. Future research should continue to validate the effectiveness of this approach and identify specific nuances related to health science applications.</p>","PeriodicalId":12947,"journal":{"name":"Healthcare Informatics Research","volume":"31 1","pages":"88-95"},"PeriodicalIF":2.3,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11854624/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143457529","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Era of Digital Healthcare: Emergence of the Smart Patient. 数字医疗时代:智能患者的出现。
IF 2.3 Q3 MEDICAL INFORMATICS Pub Date : 2025-01-01 Epub Date: 2025-01-31 DOI: 10.4258/hir.2025.31.1.107
Dooyoung Huhh, Kwangsoo Shin, Miyeong Kim, Jisan Lee, Hana Kim, Jinho Choi, Suyeon Ban
{"title":"Era of Digital Healthcare: Emergence of the Smart Patient.","authors":"Dooyoung Huhh, Kwangsoo Shin, Miyeong Kim, Jisan Lee, Hana Kim, Jinho Choi, Suyeon Ban","doi":"10.4258/hir.2025.31.1.107","DOIUrl":"10.4258/hir.2025.31.1.107","url":null,"abstract":"","PeriodicalId":12947,"journal":{"name":"Healthcare Informatics Research","volume":"31 1","pages":"107-110"},"PeriodicalIF":2.3,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11854612/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143457566","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Weightage Identified Network of Keywords Technique: A Structured Approach in Identifying Keywords for Systematic Reviews. 关键词权重识别网络技术:系统评价中识别关键词的结构化方法。
IF 2.3 Q3 MEDICAL INFORMATICS Pub Date : 2025-01-01 Epub Date: 2025-01-31 DOI: 10.4258/hir.2025.31.1.48
Sasidharan Sivakumar, Gowardhan Sivakumar

Objectives: The objective of this study was to develop the weightage identified network of keywords (WINK) technique for selecting and utilizing keywords to perform systematic reviews more efficiently. This technique aims to improve the thoroughness and precision of evidence synthesis by employing a more rigorous approach to keyword selection.

Methods: The WINK methodology involves generating network visualization charts to analyze the interconnections among keywords within a specific domain. This process integrates both computational analysis and subject expert insights to enhance the accuracy and relevance of the findings. In the example considered, the networking strength between the contexts of environmental pollutants with endocrine function as Q1 and systemic health with oral health-related terms as Q2 was examined, and keywords with limited networking strength were excluded. Utilizing the Medical Subject Headings (MeSH) terms identified from the WINK technique, a search string was built and compared to an initial search with fewer keywords.

Results: The application of the WINK technique in building the search string yielded 69.81% and 26.23% more articles for Q1 and Q2, respectively, compared to conventional approaches. This significant increase demonstrates the technique's effectiveness in identifying relevant studies and ensuring comprehensive evidence synthesis.

Conclusions: By prioritizing keywords with higher weightage and utilizing network visualization charts, the WINK technique ensures comprehensive evidence synthesis and enhances accuracy in systematic reviews. Its effectiveness in identifying relevant studies marks a significant advancement in systematic review methodology, offering a more robust and efficient approach to keyword selection.

目的:本研究的目的是发展关键字权重识别网络(WINK)技术,以选择和利用关键字来更有效地进行系统评价。该技术旨在通过采用更严格的关键字选择方法来提高证据合成的彻全性和准确性。方法:WINK方法包括生成网络可视化图表来分析特定领域内关键字之间的相互联系。这个过程整合了计算分析和主题专家的见解,以提高结果的准确性和相关性。在所考虑的示例中,研究了以内分泌功能为Q1的环境污染物和以口腔健康相关术语为Q2的系统健康背景之间的网络强度,排除了网络强度有限的关键词。利用从WINK技术中识别的医学主题词(MeSH)术语,构建了一个搜索字符串,并与具有较少关键字的初始搜索进行了比较。结果:与传统方法相比,WINK技术在第一季度和第二季度的搜索结果分别增加了69.81%和26.23%。这一显著增长表明该技术在识别相关研究和确保全面证据合成方面的有效性。结论:WINK技术通过对权重较高的关键词进行优先排序,并利用网络可视化图表,确保了证据综合的全面性,提高了系统评价的准确性。它在识别相关研究方面的有效性标志着系统综述方法的重大进步,为关键词选择提供了更可靠和有效的方法。
{"title":"Weightage Identified Network of Keywords Technique: A Structured Approach in Identifying Keywords for Systematic Reviews.","authors":"Sasidharan Sivakumar, Gowardhan Sivakumar","doi":"10.4258/hir.2025.31.1.48","DOIUrl":"10.4258/hir.2025.31.1.48","url":null,"abstract":"<p><strong>Objectives: </strong>The objective of this study was to develop the weightage identified network of keywords (WINK) technique for selecting and utilizing keywords to perform systematic reviews more efficiently. This technique aims to improve the thoroughness and precision of evidence synthesis by employing a more rigorous approach to keyword selection.</p><p><strong>Methods: </strong>The WINK methodology involves generating network visualization charts to analyze the interconnections among keywords within a specific domain. This process integrates both computational analysis and subject expert insights to enhance the accuracy and relevance of the findings. In the example considered, the networking strength between the contexts of environmental pollutants with endocrine function as Q1 and systemic health with oral health-related terms as Q2 was examined, and keywords with limited networking strength were excluded. Utilizing the Medical Subject Headings (MeSH) terms identified from the WINK technique, a search string was built and compared to an initial search with fewer keywords.</p><p><strong>Results: </strong>The application of the WINK technique in building the search string yielded 69.81% and 26.23% more articles for Q1 and Q2, respectively, compared to conventional approaches. This significant increase demonstrates the technique's effectiveness in identifying relevant studies and ensuring comprehensive evidence synthesis.</p><p><strong>Conclusions: </strong>By prioritizing keywords with higher weightage and utilizing network visualization charts, the WINK technique ensures comprehensive evidence synthesis and enhances accuracy in systematic reviews. Its effectiveness in identifying relevant studies marks a significant advancement in systematic review methodology, offering a more robust and efficient approach to keyword selection.</p>","PeriodicalId":12947,"journal":{"name":"Healthcare Informatics Research","volume":"31 1","pages":"48-56"},"PeriodicalIF":2.3,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11854614/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143457717","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Development and Usability Evaluation of COVID-Iran: A Mobile Application for Mitigating COVID-19 Misinformation. COVID-Iran 的开发和可用性评估:减少 COVID-19 误报的移动应用程序。
IF 2.3 Q3 MEDICAL INFORMATICS Pub Date : 2024-10-01 Epub Date: 2024-10-31 DOI: 10.4258/hir.2024.30.4.312
Raheleh Salari, Farhad Fatehi, Hamed Mehdizadeh

Objectives: The spread of misinformation through the internet can lead to dangerous behavioral changes and erode trust in reliable sources, especially during public health crises like coronavirus disease 2019 (COVID-19). To combat this issue, innovative strategies that leverage information technology are essential. This study focused on developing and evaluating a mobile application (app), COVID-Iran, aimed at countering COVID-19 misinformation by delivering accurate, reliable, and credible information.

Methods: The development of the app involved a multi-step, user-centered approach that integrated qualitative expert consultations with quantitative survey research to pinpoint and validate key features. The app was initially prototyped using Enterprise Architect software and subsequently developed using Android Studio and MySQL. We conducted a usability evaluation using the System Usability Scale (SUS), where participants engaged in various tasks related to information seeking, self-assessment, and health management. Data were analyzed using descriptive statistics in SPSS version 19.

Results: The findings revealed a high usability level (SUS score of 81.35), with participants reporting ease of use and learnability. The app effectively countered misinformation by providing access to trusted sources and evidence-based counterarguments. User feedback emphasized the app's strengths in clarity, accuracy, trustworthiness, and its comprehensive approach. Plans for future improvements include the integration of artificial intelligence to deliver personalized content.

Conclusions: Despite limitations such as the small sample size and potential self-selection bias, this study highlights the significant potential of mHealth apps to provide reliable health information and combat misinformation.

目的:通过互联网传播错误信息会导致危险的行为改变,并削弱人们对可靠信息来源的信任,尤其是在 2019 年冠状病毒病(COVID-19)等公共卫生危机期间。要解决这一问题,利用信息技术的创新战略至关重要。本研究的重点是开发和评估一款名为 "COVID-伊朗 "的移动应用程序(App),旨在通过提供准确、可靠和可信的信息来抵制COVID-19的错误信息:该应用程序的开发采用了多步骤、以用户为中心的方法,将定性专家咨询与定量调查研究相结合,以确定并验证关键功能。该应用程序最初使用 Enterprise Architect 软件制作原型,随后使用 Android Studio 和 MySQL 进行开发。我们使用系统可用性量表(SUS)进行了可用性评估,参与者参与了与信息搜索、自我评估和健康管理相关的各种任务。我们使用 SPSS 19 版本的描述性统计对数据进行了分析:研究结果表明,该应用程序的可用性水平较高(SUS 得分为 81.35),参与者表示该应用程序易于使用和学习。该应用程序通过提供可信来源和基于证据的反驳,有效地抵制了错误信息。用户反馈强调了该应用程序在清晰度、准确性、可信度和综合方法方面的优势。未来的改进计划包括整合人工智能,提供个性化内容:尽管存在样本量小和潜在的自我选择偏差等局限性,但本研究强调了移动医疗应用程序在提供可靠的健康信息和打击错误信息方面的巨大潜力。
{"title":"Development and Usability Evaluation of COVID-Iran: A Mobile Application for Mitigating COVID-19 Misinformation.","authors":"Raheleh Salari, Farhad Fatehi, Hamed Mehdizadeh","doi":"10.4258/hir.2024.30.4.312","DOIUrl":"10.4258/hir.2024.30.4.312","url":null,"abstract":"<p><strong>Objectives: </strong>The spread of misinformation through the internet can lead to dangerous behavioral changes and erode trust in reliable sources, especially during public health crises like coronavirus disease 2019 (COVID-19). To combat this issue, innovative strategies that leverage information technology are essential. This study focused on developing and evaluating a mobile application (app), COVID-Iran, aimed at countering COVID-19 misinformation by delivering accurate, reliable, and credible information.</p><p><strong>Methods: </strong>The development of the app involved a multi-step, user-centered approach that integrated qualitative expert consultations with quantitative survey research to pinpoint and validate key features. The app was initially prototyped using Enterprise Architect software and subsequently developed using Android Studio and MySQL. We conducted a usability evaluation using the System Usability Scale (SUS), where participants engaged in various tasks related to information seeking, self-assessment, and health management. Data were analyzed using descriptive statistics in SPSS version 19.</p><p><strong>Results: </strong>The findings revealed a high usability level (SUS score of 81.35), with participants reporting ease of use and learnability. The app effectively countered misinformation by providing access to trusted sources and evidence-based counterarguments. User feedback emphasized the app's strengths in clarity, accuracy, trustworthiness, and its comprehensive approach. Plans for future improvements include the integration of artificial intelligence to deliver personalized content.</p><p><strong>Conclusions: </strong>Despite limitations such as the small sample size and potential self-selection bias, this study highlights the significant potential of mHealth apps to provide reliable health information and combat misinformation.</p>","PeriodicalId":12947,"journal":{"name":"Healthcare Informatics Research","volume":"30 4","pages":"312-323"},"PeriodicalIF":2.3,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11570658/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142647910","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Mobile Application for Digital Health Coaching in the Self-Management of Older Adults with Multiple Chronic Conditions: A Development and Usability Study. 在患有多种慢性疾病的老年人的自我管理中,数字健康指导的移动应用程序:开发与可用性研究
IF 2.3 Q3 MEDICAL INFORMATICS Pub Date : 2024-10-01 Epub Date: 2024-10-31 DOI: 10.4258/hir.2024.30.4.344
Ga Eun Park, Yeon-Hwan Park, Kwang Gi Kim, Jeong Yun Park, Minhwa Hwang, Seonghyeon Lee

Objectives: This study was conducted to develop a mobile application for digital health coaching to support self-management in older adults with multiple chronic conditions. Additionally, the usability of this application was evaluated.

Methods: The HAHA2022 mobile application was developed through a multidisciplinary team approach, incorporating digital health coaching strategies targeting community-dwelling older adults with multiple chronic conditions. Usability was assessed with the Korean version of the Mobile Application Rating Scale. The usability tests involved eight expert panel members and 10 older adults (mean age, 74 ± 3 years; 90% women) from one senior welfare center.

Results: HAHA2022 is an Android-based mobile application that is also integrated into wearable devices to track physical activity. It features an age-friendly design and includes five main menus: Home, Action Plan, Education, Health Log, and Community. The average overall usability test scores-covering engagement, functionality, aesthetics, and information-were 4.27 of 5 for the expert panel and 4.53 of 5 for the older adults.

Conclusions: The HAHA2022 application was developed to improve self-management among communitydwelling older adults with multiple chronic conditions. Usability tests indicate that the application is highly acceptable and feasible for use by this population. Consequently, HAHA2022 is anticipated to be widely implemented. Nonetheless, further research is required to confirm its effectiveness through digital health intervention.

研究目的本研究旨在开发一款用于数字健康指导的移动应用程序,以支持患有多种慢性疾病的老年人进行自我管理。此外,还对该应用程序的可用性进行了评估:方法:HAHA2022 移动应用程序是通过多学科团队方法开发的,其中纳入了针对患有多种慢性疾病的社区老年人的数字健康指导策略。可用性采用韩国版移动应用评分量表进行评估。参与可用性测试的有八位专家小组成员和来自一家老年福利中心的十位老年人(平均年龄为 74 ± 3 岁;90% 为女性):HAHA2022是一款基于安卓系统的移动应用程序,也可集成到可穿戴设备中以跟踪身体活动。它采用了对老年人友好的设计,包括五个主菜单:主页、行动计划、教育、健康日志和社区。在参与度、功能性、美观性和信息方面,专家小组的平均总体可用性测试分数为 4.27 分(满分 5 分),老年人的平均总体可用性测试分数为 4.53 分(满分 5 分):结论:HAHA2022 应用程序的开发旨在改善社区中患有多种慢性疾病的老年人的自我管理。可用性测试表明,该应用程序在这一人群中的可接受性和可行性很高。因此,HAHA2022 预计将得到广泛应用。不过,还需要进一步研究,以确认其通过数字健康干预的有效性。
{"title":"Mobile Application for Digital Health Coaching in the Self-Management of Older Adults with Multiple Chronic Conditions: A Development and Usability Study.","authors":"Ga Eun Park, Yeon-Hwan Park, Kwang Gi Kim, Jeong Yun Park, Minhwa Hwang, Seonghyeon Lee","doi":"10.4258/hir.2024.30.4.344","DOIUrl":"10.4258/hir.2024.30.4.344","url":null,"abstract":"<p><strong>Objectives: </strong>This study was conducted to develop a mobile application for digital health coaching to support self-management in older adults with multiple chronic conditions. Additionally, the usability of this application was evaluated.</p><p><strong>Methods: </strong>The HAHA2022 mobile application was developed through a multidisciplinary team approach, incorporating digital health coaching strategies targeting community-dwelling older adults with multiple chronic conditions. Usability was assessed with the Korean version of the Mobile Application Rating Scale. The usability tests involved eight expert panel members and 10 older adults (mean age, 74 ± 3 years; 90% women) from one senior welfare center.</p><p><strong>Results: </strong>HAHA2022 is an Android-based mobile application that is also integrated into wearable devices to track physical activity. It features an age-friendly design and includes five main menus: Home, Action Plan, Education, Health Log, and Community. The average overall usability test scores-covering engagement, functionality, aesthetics, and information-were 4.27 of 5 for the expert panel and 4.53 of 5 for the older adults.</p><p><strong>Conclusions: </strong>The HAHA2022 application was developed to improve self-management among communitydwelling older adults with multiple chronic conditions. Usability tests indicate that the application is highly acceptable and feasible for use by this population. Consequently, HAHA2022 is anticipated to be widely implemented. Nonetheless, further research is required to confirm its effectiveness through digital health intervention.</p>","PeriodicalId":12947,"journal":{"name":"Healthcare Informatics Research","volume":"30 4","pages":"344-354"},"PeriodicalIF":2.3,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11570659/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142646638","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Service Design and Evaluation of OpenNotes for Craniofacial Deformity Management in Patients and their Caregivers. 针对颅面畸形患者及其护理人员管理的 OpenNotes 服务设计与评估。
IF 2.3 Q3 MEDICAL INFORMATICS Pub Date : 2024-10-01 Epub Date: 2024-10-31 DOI: 10.4258/hir.2024.30.4.333
Hana Kim, Jisan Lee, Sukwha Kim, Deok-Yeol Kim

Objectives: This study aimed to assess the feasibility of implementing OpenNotes in Korea. It involved developing and evaluating the Open-CHA service, which provides clinical summary information to patients diagnosed with craniofacial deformities and their caregivers following outpatient visits.

Methods: The study included 109 patients diagnosed with craniofacial deformities, along with their caregivers. The Open-CHA service was developed by referencing OpenNotes and involved a user needs assessment, a pilot test, and an evaluation of its effectiveness. Data were analyzed using descriptive statistics and the paired t-test.

Results: Short message service templates for the Open-CHA service based on a user needs assessment conducted with patients, caregivers, and healthcare professionals. These templates were refined and improved following a pilot test. After the implementation of the Open-CHA service, most participants evaluated OpenNotes positively. Additionally, there were observed increases in health knowledge and efficacy in patient-physician interactions. A statistically significant improvement in mobile health literacy was also confirmed.

Conclusions: The implementation of the Open-CHA service significantly enhanced mobile health literacy among patients with craniofacial deformities and their caregivers, indicating positive outcomes for the potential adoption of OpenNotes in Korea. This suggests that introducing OpenNotes into the Korean healthcare system is appropriate.

研究目的本研究旨在评估在韩国实施 OpenNotes 的可行性。该服务为颅面畸形患者及其护理人员提供门诊就诊后的临床摘要信息:研究对象包括 109 名确诊为颅面畸形的患者及其护理人员。Open-CHA 服务是参照 OpenNotes 开发的,包括用户需求评估、试点测试和效果评估。数据分析采用描述性统计和配对 t 检验:根据对患者、护理人员和医护人员进行的用户需求评估,为 Open-CHA 服务开发了短信服务模板。经过试点测试后,这些模板得到了改进和完善。实施 Open-CHA 服务后,大多数参与者对 OpenNotes 给予了积极评价。此外,在患者与医生的互动中,还观察到了健康知识和效率的提高。移动医疗知识的提高在统计学上也得到了证实:结论:Open-CHA 服务的实施极大地提高了颅面畸形患者及其护理人员的移动健康知识水平,这表明 OpenNotes 有可能在韩国得到积极的应用。这表明将 OpenNotes 引入韩国医疗系统是合适的。
{"title":"Service Design and Evaluation of OpenNotes for Craniofacial Deformity Management in Patients and their Caregivers.","authors":"Hana Kim, Jisan Lee, Sukwha Kim, Deok-Yeol Kim","doi":"10.4258/hir.2024.30.4.333","DOIUrl":"10.4258/hir.2024.30.4.333","url":null,"abstract":"<p><strong>Objectives: </strong>This study aimed to assess the feasibility of implementing OpenNotes in Korea. It involved developing and evaluating the Open-CHA service, which provides clinical summary information to patients diagnosed with craniofacial deformities and their caregivers following outpatient visits.</p><p><strong>Methods: </strong>The study included 109 patients diagnosed with craniofacial deformities, along with their caregivers. The Open-CHA service was developed by referencing OpenNotes and involved a user needs assessment, a pilot test, and an evaluation of its effectiveness. Data were analyzed using descriptive statistics and the paired t-test.</p><p><strong>Results: </strong>Short message service templates for the Open-CHA service based on a user needs assessment conducted with patients, caregivers, and healthcare professionals. These templates were refined and improved following a pilot test. After the implementation of the Open-CHA service, most participants evaluated OpenNotes positively. Additionally, there were observed increases in health knowledge and efficacy in patient-physician interactions. A statistically significant improvement in mobile health literacy was also confirmed.</p><p><strong>Conclusions: </strong>The implementation of the Open-CHA service significantly enhanced mobile health literacy among patients with craniofacial deformities and their caregivers, indicating positive outcomes for the potential adoption of OpenNotes in Korea. This suggests that introducing OpenNotes into the Korean healthcare system is appropriate.</p>","PeriodicalId":12947,"journal":{"name":"Healthcare Informatics Research","volume":"30 4","pages":"333-343"},"PeriodicalIF":2.3,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11570661/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142647244","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Implementation of the Digital Health Approach to Support Learning for Health Students Based on Bloom's Taxonomy: A Systematic Review. 基于布卢姆分类法的 "数字健康方法 "实施情况,以支持健康专业学生的学习:系统回顾
IF 2.3 Q3 MEDICAL INFORMATICS Pub Date : 2024-10-01 Epub Date: 2024-10-31 DOI: 10.4258/hir.2024.30.4.387
Savitri Citra Budi, Divi Galih Prasertyo Putri, Kintan Puspitasari, Al Razi Sena

Objectives: Health students' ability to utilize technology effectively is vital for improving the quality of future healthcare services. Relevant digital health education must be comprehensively integrated into training programs, continuing professional development activities, and school curricula to keep them current. This study investigated the most effective digital health approaches to enhance health students' cognitive, affective, and psychomotor skills, thereby preparing them for the workforce.

Methods: A literature review was conducted by searching for articles from 2013 to 2023 in PubMed, Science Direct, ERIC, and Scopus. The search used the PICO model, focusing on experimental studies and digital learning.

Results: The review identified 26 studies, categorizing digital education methods into platform-based (46.2%), tools-based (30.7%), and training-based approaches (23.1%). Participants included health students (57.7%), healthcare professionals (34.6%), and a combination of both (7.7%). The content materials primarily targeted curriculum objectives (65.4%) and clinical applications (34.6%). The outcomes, classified according to Bloom's taxonomy, were divided into cognitive (84.6%), affective (76.9%), and psychomotor (46.1%) domains.

Conclusions: Digital health education benefits from a variety of approaches. A platformbased approach is recommended for delivering theoretical and methodological materials, a tools-based approach for simulations, and a training-based approach for practical skills to enhance the cognitive domain. Both platform-based and trainingbased approaches are advised to improve the affective and psychomotor dimensions of learning. This study underscores the importance of an integrated digital learning system in health educational institutions to prepare students for evolving health systems and to improve learning outcomes and skill transfer.

目标:医学生有效利用技术的能力对于提高未来医疗保健服务的质量至关重要。必须将相关的数字健康教育全面纳入培训计划、继续职业发展活动和学校课程,使其与时俱进。本研究调查了最有效的数字医疗方法,以提高医学生的认知、情感和心理运动技能,从而为就业做好准备:通过在 PubMed、Science Direct、ERIC 和 Scopus 中搜索 2013 年至 2023 年的文章,进行了文献综述。搜索采用了 PICO 模式,重点关注实验研究和数字化学习:综述确定了 26 项研究,将数字教育方法分为基于平台的方法(46.2%)、基于工具的方法(30.7%)和基于培训的方法(23.1%)。参与者包括医学生(57.7%)、医护人员(34.6%)以及两者的结合(7.7%)。内容材料主要针对课程目标(65.4%)和临床应用(34.6%)。根据布卢姆分类法,结果分为认知领域(84.6%)、情感领域(76.9%)和精神运动领域(46.1%):数字健康教育得益于多种方法。建议采用基于平台的方法来提供理论和方法材料,采用基于工具的方法来进行模拟,采用基于培训的方法来提高认知领域的实用技能。建议采用基于平台和基于培训的方法来提高学习的情感和心理运动层面。这项研究强调了在卫生教育机构中建立综合数字学习系统的重要性,以便让学生为不断发展的卫生系统做好准备,并改善学习成果和技能转移。
{"title":"Implementation of the Digital Health Approach to Support Learning for Health Students Based on Bloom's Taxonomy: A Systematic Review.","authors":"Savitri Citra Budi, Divi Galih Prasertyo Putri, Kintan Puspitasari, Al Razi Sena","doi":"10.4258/hir.2024.30.4.387","DOIUrl":"10.4258/hir.2024.30.4.387","url":null,"abstract":"<p><strong>Objectives: </strong>Health students' ability to utilize technology effectively is vital for improving the quality of future healthcare services. Relevant digital health education must be comprehensively integrated into training programs, continuing professional development activities, and school curricula to keep them current. This study investigated the most effective digital health approaches to enhance health students' cognitive, affective, and psychomotor skills, thereby preparing them for the workforce.</p><p><strong>Methods: </strong>A literature review was conducted by searching for articles from 2013 to 2023 in PubMed, Science Direct, ERIC, and Scopus. The search used the PICO model, focusing on experimental studies and digital learning.</p><p><strong>Results: </strong>The review identified 26 studies, categorizing digital education methods into platform-based (46.2%), tools-based (30.7%), and training-based approaches (23.1%). Participants included health students (57.7%), healthcare professionals (34.6%), and a combination of both (7.7%). The content materials primarily targeted curriculum objectives (65.4%) and clinical applications (34.6%). The outcomes, classified according to Bloom's taxonomy, were divided into cognitive (84.6%), affective (76.9%), and psychomotor (46.1%) domains.</p><p><strong>Conclusions: </strong>Digital health education benefits from a variety of approaches. A platformbased approach is recommended for delivering theoretical and methodological materials, a tools-based approach for simulations, and a training-based approach for practical skills to enhance the cognitive domain. Both platform-based and trainingbased approaches are advised to improve the affective and psychomotor dimensions of learning. This study underscores the importance of an integrated digital learning system in health educational institutions to prepare students for evolving health systems and to improve learning outcomes and skill transfer.</p>","PeriodicalId":12947,"journal":{"name":"Healthcare Informatics Research","volume":"30 4","pages":"387-397"},"PeriodicalIF":2.3,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11570657/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142645999","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
AminoApp: The First Brazilian Application for Dietary Monitoring of Inborn Errors of Metabolism in Patients on a Low-Protein Diet. AminoApp:巴西首款用于低蛋白饮食患者先天性代谢异常膳食监测的应用程序。
IF 2.3 Q3 MEDICAL INFORMATICS Pub Date : 2024-10-01 Epub Date: 2024-10-31 DOI: 10.4258/hir.2024.30.4.409
Bianca Fasolo Franceschetto, Júlia Montim Orlandi, Wanessa de Carvalho Rosa, Mariana Lima Scortegagna, Lilia Farret, Ida V D Schwartz, Soraia Poloni

Objectives: Disorders of amino acid metabolism fall under the category of inborn errors of metabolism that can be managed with a protein-restricted diet. However, adherence to such a diet often poses challenges, leading to low treatment engagement. Consequently, there is a pressing need for new resources to aid in dietary self-monitoring. The goal is to develop and implement "AminoApp," an application tailored for dietary self-monitoring in patients with inborn errors of metabolism who are on a low-protein diet.

Methods: The design and development of the application adhered to the user-centered design method. This approach emphasizes active participation and collaboration between users and designers/researchers throughout all stages of product development, including requirement gathering, prototype development, and evaluation. Usability was evaluated using the System Usability Scale, which has been validated in Portuguese.

Results: The application's features include a food diary, a food consultation area, exam records, a recipe calculator, and reports on diet composition and metabolic control. The usability test included four patients on a low-protein diet, three caregivers, and three healthcare professionals. The average usability score was 84.9, with averages of 77.5 for patients, 85.8 for caregivers, and 91.6 for professionals, indicating that the application is user-friendly.

Conclusions: AminoApp is the first application developed in Brazil designed to assist in managing inborn errors of metabolism that require a protein-restricted diet. It was found to be easy to use, and the initial results are promising. Further research is necessary to evaluate the impact of the application on metabolic control and treatment adherence.

目的:氨基酸代谢紊乱属于先天性代谢错误,可以通过限制蛋白质饮食来控制。然而,坚持这种饮食往往会带来挑战,导致治疗参与度低。因此,迫切需要新的资源来帮助进行饮食自我监控。我们的目标是开发并实施 "AminoApp",这是一款专为低蛋白饮食的先天性代谢异常患者量身定制的饮食自我监控应用程序:该应用程序的设计和开发遵循了以用户为中心的设计方法。这种方法强调在产品开发的各个阶段,包括需求收集、原型开发和评估,用户和设计者/研究人员都要积极参与和合作。可用性采用系统可用性量表进行评估,该量表已在葡萄牙语中得到验证:该应用程序的功能包括食物日记、食物咨询区、检查记录、食谱计算器以及饮食组成和代谢控制报告。参加可用性测试的包括四名低蛋白饮食患者、三名护理人员和三名医护人员。平均可用性得分为 84.9 分,其中患者的平均得分为 77.5 分,护理人员的平均得分为 85.8 分,专业人员的平均得分为 91.6 分,表明该应用程序对用户友好:AminoApp 是巴西开发的第一款应用程序,旨在协助管理需要限制蛋白质饮食的先天性代谢错误。该应用程序易于使用,初步效果良好。有必要开展进一步研究,以评估该应用程序对代谢控制和治疗依从性的影响。
{"title":"AminoApp: The First Brazilian Application for Dietary Monitoring of Inborn Errors of Metabolism in Patients on a Low-Protein Diet.","authors":"Bianca Fasolo Franceschetto, Júlia Montim Orlandi, Wanessa de Carvalho Rosa, Mariana Lima Scortegagna, Lilia Farret, Ida V D Schwartz, Soraia Poloni","doi":"10.4258/hir.2024.30.4.409","DOIUrl":"10.4258/hir.2024.30.4.409","url":null,"abstract":"<p><strong>Objectives: </strong>Disorders of amino acid metabolism fall under the category of inborn errors of metabolism that can be managed with a protein-restricted diet. However, adherence to such a diet often poses challenges, leading to low treatment engagement. Consequently, there is a pressing need for new resources to aid in dietary self-monitoring. The goal is to develop and implement \"AminoApp,\" an application tailored for dietary self-monitoring in patients with inborn errors of metabolism who are on a low-protein diet.</p><p><strong>Methods: </strong>The design and development of the application adhered to the user-centered design method. This approach emphasizes active participation and collaboration between users and designers/researchers throughout all stages of product development, including requirement gathering, prototype development, and evaluation. Usability was evaluated using the System Usability Scale, which has been validated in Portuguese.</p><p><strong>Results: </strong>The application's features include a food diary, a food consultation area, exam records, a recipe calculator, and reports on diet composition and metabolic control. The usability test included four patients on a low-protein diet, three caregivers, and three healthcare professionals. The average usability score was 84.9, with averages of 77.5 for patients, 85.8 for caregivers, and 91.6 for professionals, indicating that the application is user-friendly.</p><p><strong>Conclusions: </strong>AminoApp is the first application developed in Brazil designed to assist in managing inborn errors of metabolism that require a protein-restricted diet. It was found to be easy to use, and the initial results are promising. Further research is necessary to evaluate the impact of the application on metabolic control and treatment adherence.</p>","PeriodicalId":12947,"journal":{"name":"Healthcare Informatics Research","volume":"30 4","pages":"409-415"},"PeriodicalIF":2.3,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11570656/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142647886","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Mapping Drug Terms via Integration of a Retrieval-Augmented Generation Algorithm with a Large Language Model. 通过整合检索增强生成算法与大型语言模型来映射药物术语。
IF 2.3 Q3 MEDICAL INFORMATICS Pub Date : 2024-10-01 Epub Date: 2024-10-31 DOI: 10.4258/hir.2024.30.4.355
Eizen Kimura, Yukinobu Kawakami, Shingo Inoue, Ai Okajima

Objectives: This study evaluated the efficacy of integrating a retrieval-augmented generation (RAG) model and a large language model (LLM) to improve the accuracy of drug name mapping across international vocabularies.

Methods: Drug ingredient names were translated into English using the Japanese Accepted Names for Pharmaceuticals. Drug concepts were extracted from the standard vocabulary of OHDSI, and the accuracy of mappings between translated terms and RxNorm was assessed by vector similarity, using the BioBERT-generated embedded vectors as the baseline. Subsequently, we developed LLMs with RAG that distinguished the final candidates from the baseline. We assessed the efficacy of the LLM with RAG in candidate selection by comparing it with conventional methods based on vector similarity.

Results: The evaluation metrics demonstrated the superior performance of the combined LLM + RAG over traditional vector similarity methods. Notably, the hit rates of the Mixtral 8x7b and GPT-3.5 models exceeded 90%, significantly outperforming the baseline rate of 64% across stratified groups of PO drugs, injections, and all interventions. Furthermore, the r-precision metric, which measures the alignment between model judgment and human evaluation, revealed a notable improvement in LLM performance, ranging from 41% to 50% compared to the baseline of 23%.

Conclusions: Integrating an RAG and an LLM outperformed conventional string comparison and embedding vector similarity techniques, offering a more refined approach to global drug information mapping.

研究目的本研究评估了整合检索增强生成(RAG)模型和大语言模型(LLM)以提高跨国际词汇表药物名称映射准确性的效果:方法:使用日语药品公认名称将药品成分名称翻译成英语。以 BioBERT 生成的嵌入向量为基准,通过向量相似性评估翻译术语与 RxNorm 之间映射的准确性。随后,我们利用 RAG 开发了 LLM,将最终候选词与基线词区分开来。通过与基于向量相似性的传统方法进行比较,我们评估了带有 RAG 的 LLM 在候选者选择方面的功效:评估指标表明,LLM + RAG 组合的性能优于传统的向量相似性方法。值得注意的是,Mixtral 8x7b 和 GPT-3.5 模型的命中率超过了 90%,在 PO 药物、注射剂和所有干预措施的分层组中,明显优于 64% 的基线命中率。此外,衡量模型判断与人类评估之间一致性的 r 精确度指标显示,LLM 的性能有了显著提高,与 23% 的基线相比,提高了 41% 至 50%:结论:将 RAG 和 LLM 相结合,其性能优于传统的字符串比较和嵌入向量相似性技术,为全球药物信息映射提供了一种更精细的方法。
{"title":"Mapping Drug Terms via Integration of a Retrieval-Augmented Generation Algorithm with a Large Language Model.","authors":"Eizen Kimura, Yukinobu Kawakami, Shingo Inoue, Ai Okajima","doi":"10.4258/hir.2024.30.4.355","DOIUrl":"10.4258/hir.2024.30.4.355","url":null,"abstract":"<p><strong>Objectives: </strong>This study evaluated the efficacy of integrating a retrieval-augmented generation (RAG) model and a large language model (LLM) to improve the accuracy of drug name mapping across international vocabularies.</p><p><strong>Methods: </strong>Drug ingredient names were translated into English using the Japanese Accepted Names for Pharmaceuticals. Drug concepts were extracted from the standard vocabulary of OHDSI, and the accuracy of mappings between translated terms and RxNorm was assessed by vector similarity, using the BioBERT-generated embedded vectors as the baseline. Subsequently, we developed LLMs with RAG that distinguished the final candidates from the baseline. We assessed the efficacy of the LLM with RAG in candidate selection by comparing it with conventional methods based on vector similarity.</p><p><strong>Results: </strong>The evaluation metrics demonstrated the superior performance of the combined LLM + RAG over traditional vector similarity methods. Notably, the hit rates of the Mixtral 8x7b and GPT-3.5 models exceeded 90%, significantly outperforming the baseline rate of 64% across stratified groups of PO drugs, injections, and all interventions. Furthermore, the r-precision metric, which measures the alignment between model judgment and human evaluation, revealed a notable improvement in LLM performance, ranging from 41% to 50% compared to the baseline of 23%.</p><p><strong>Conclusions: </strong>Integrating an RAG and an LLM outperformed conventional string comparison and embedding vector similarity techniques, offering a more refined approach to global drug information mapping.</p>","PeriodicalId":12947,"journal":{"name":"Healthcare Informatics Research","volume":"30 4","pages":"355-363"},"PeriodicalIF":2.3,"publicationDate":"2024-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11570653/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142646343","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Healthcare Informatics Research
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1