Pub Date : 2025-07-01Epub Date: 2025-09-19DOI: 10.1177/14604582251381260
Aleksandra Ignjatović, Marija Anđelković Apostolović, Lazar Stevanović, Pavle Radovanović, Marija Topalović, Tamara Filipović, Suzana Otašević
Objective: ChatGPT has been recognised as a potentially transformative tool in higher education by enhancing the teaching and learning process. Cross-sectional evaluations have acknowledged this potential. This study evaluates ChatGPT's performance in solving specific biostatistical problems, focusing on accuracy, stability, and reproducibility, and explores its potential as a reliable educational tool in medical education. Methods: The correlation analysis task from Statistics at Square One by Swinscow and Campbell was chosen for its foundational role in biostatistics. Between October 2023 and March 2024, and July 2024, GPT-3.5 and GPT-4 were tested for accuracy in 12 parameters. Results: A statistically significant change in correct response rates was established in repeated measurements in the period October 2023, March 2024, and July 2024 for GPT-3.5 (Q = 100.99, p < 0.001), GPT-4.0 (Q = 89.55, p < 0.001), respectively. The significant GPT-3.5 improvement was established between March 2024/July 2024 (p = 0.004), and between October 2023 and July 2024 (p = 0.008). The significant GPT-4.0 improvement was established between October 2023 and March 2024 (p = 0.004), and between October 2023 and July 2024 (p = 0.026). Conclusion: Over 9 months, GPT-4 demonstrated rapid and consistent improvements, achieving perfect accuracy by March 2024. Although this study documented ChatGPT's advancement within 9 months, ChatGPT should be positioned as a supplementary tool in higher education classrooms, in the presence of educators, to enhance the learning process.
{"title":"ChatGPT's progress over time: A longitudinal enhancing biostatistical problem-solving in medical education.","authors":"Aleksandra Ignjatović, Marija Anđelković Apostolović, Lazar Stevanović, Pavle Radovanović, Marija Topalović, Tamara Filipović, Suzana Otašević","doi":"10.1177/14604582251381260","DOIUrl":"https://doi.org/10.1177/14604582251381260","url":null,"abstract":"<p><p><b>Objective:</b> ChatGPT has been recognised as a potentially transformative tool in higher education by enhancing the teaching and learning process. Cross-sectional evaluations have acknowledged this potential. This study evaluates ChatGPT's performance in solving specific biostatistical problems, focusing on accuracy, stability, and reproducibility, and explores its potential as a reliable educational tool in medical education. <b>Methods:</b> The correlation analysis task from <i>Statistics at Square One</i> by Swinscow and Campbell was chosen for its foundational role in biostatistics. Between October 2023 and March 2024, and July 2024, GPT-3.5 and GPT-4 were tested for accuracy in 12 parameters. <b>Results:</b> A statistically significant change in correct response rates was established in repeated measurements in the period October 2023, March 2024, and July 2024 for GPT-3.5 (Q = 100.99, <i>p</i> < 0.001), GPT-4.0 (Q = 89.55, <i>p</i> < 0.001), respectively. The significant GPT-3.5 improvement was established between March 2024/July 2024 (<i>p</i> = 0.004), and between October 2023 and July 2024 (<i>p</i> = 0.008). The significant GPT-4.0 improvement was established between October 2023 and March 2024 (<i>p</i> = 0.004), and between October 2023 and July 2024 (<i>p</i> = 0.026). <b>Conclusion:</b> Over 9 months, GPT-4 demonstrated rapid and consistent improvements, achieving perfect accuracy by March 2024. Although this study documented ChatGPT's advancement within 9 months, ChatGPT should be positioned as a supplementary tool in higher education classrooms, in the presence of educators, to enhance the learning process.</p>","PeriodicalId":55069,"journal":{"name":"Health Informatics Journal","volume":"31 3","pages":"14604582251381260"},"PeriodicalIF":2.3,"publicationDate":"2025-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145088355","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Background: The widespread availability of smartphones has created new opportunities for engaging pregnant women and enhancing their self-management abilities to promote maternal and fetal health through mobile interventions. This study focuses on the design and development of a gamification-based mobile health (mHealth) application aimed at providing nutritional support to pregnant women.Methods: An iterative, user-centered design approach and Agile development method were employed to create the application. The developmental stages included identifying the application's features, the design and development process, and evaluation. End users assessed usability using the System Usability Scale (SUS), while experts evaluated quality using the Mobile Application Rating Scale (MARS).Results: Feedback from experts and end users categorized the application's functionalities into general, specific, and gamification-related functions. Pregnant women rated the application's usability as acceptable (68.25 ± 10.86), and experts rated its quality as acceptable (mean 3.89 out of 5, SD 0.25).Conclusions: The positive evaluation results support the use of this application as a tool for managing gestational nutrition and enhancing self-awareness. Future research should investigate its impact on the nutritional status of pregnant women and their infants.
{"title":"Enhancing maternal nutrition: The development of Doojan, a gamified mHealth app for pregnant women.","authors":"Lida Moghaddam-Banaem, Rezvan Rahimi, Sabereh Ahmadi, Somayeh Hossainpour","doi":"10.1177/14604582251335182","DOIUrl":"https://doi.org/10.1177/14604582251335182","url":null,"abstract":"<p><p><b>Background:</b> The widespread availability of smartphones has created new opportunities for engaging pregnant women and enhancing their self-management abilities to promote maternal and fetal health through mobile interventions. This study focuses on the design and development of a gamification-based mobile health (mHealth) application aimed at providing nutritional support to pregnant women.<b>Methods:</b> An iterative, user-centered design approach and Agile development method were employed to create the application. The developmental stages included identifying the application's features, the design and development process, and evaluation. End users assessed usability using the System Usability Scale (SUS), while experts evaluated quality using the Mobile Application Rating Scale (MARS).<b>Results:</b> Feedback from experts and end users categorized the application's functionalities into general, specific, and gamification-related functions. Pregnant women rated the application's usability as acceptable (68.25 ± 10.86), and experts rated its quality as acceptable (mean 3.89 out of 5, SD 0.25).<b>Conclusions:</b> The positive evaluation results support the use of this application as a tool for managing gestational nutrition and enhancing self-awareness. Future research should investigate its impact on the nutritional status of pregnant women and their infants.</p>","PeriodicalId":55069,"journal":{"name":"Health Informatics Journal","volume":"31 3","pages":"14604582251335182"},"PeriodicalIF":2.2,"publicationDate":"2025-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144602297","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-07-01Epub Date: 2025-09-17DOI: 10.1177/14604582251381194
Yu-Hsiang Su, Chih-Fong Tsai
Objective: Accurately predicting functional outcomes after acute ischemic stroke is essential for healthcare institutions to optimize staffing and resource allocation. Although text mining has been applied to build such models, most prior studies emphasize traditional machine learning, with limited comparison to deep learning methods. Methods: Clinical text notes were collected from a Taiwanese hospital to build the experimental dataset. Four textual feature representation techniques were evaluated: bag-of-words (BOW), term frequency-inverse document frequency (TF-IDF), embeddings from language models (ELMo), and bidirectional encoder representations from transformers (BERT). Correspondingly, four predictive models were tested: k-nearest neighbor (KNN), support vector machine (SVM), convolutional neural network (CNN), and long short-term memory (LSTM). Results: The best performance was obtained using BOW features with an SVM classifier. Feature fusion strategies, combining representations such as BOW + TF-IDF and BOW + BERT, also yielded strong performance. Notably, the BOW + TF-IDF combination with SVM achieved the lowest type I error, effectively minimizing the misclassification of patients with poor outcomes. Conclusion: Traditional machine learning methods outperformed deep learning models in this study. Among all combinations, BOW + TF-IDF features with SVM provided the most accurate predictions and lowest risk of false positives in stroke outcome prediction.
{"title":"Predicting functional outcomes after a stroke event by clinical text notes: A comparative study of traditional machine learning and deep learning methods.","authors":"Yu-Hsiang Su, Chih-Fong Tsai","doi":"10.1177/14604582251381194","DOIUrl":"https://doi.org/10.1177/14604582251381194","url":null,"abstract":"<p><p><b>Objective:</b> Accurately predicting functional outcomes after acute ischemic stroke is essential for healthcare institutions to optimize staffing and resource allocation. Although text mining has been applied to build such models, most prior studies emphasize traditional machine learning, with limited comparison to deep learning methods. <b>Methods:</b> Clinical text notes were collected from a Taiwanese hospital to build the experimental dataset. Four textual feature representation techniques were evaluated: bag-of-words (BOW), term frequency-inverse document frequency (TF-IDF), embeddings from language models (ELMo), and bidirectional encoder representations from transformers (BERT). Correspondingly, four predictive models were tested: k-nearest neighbor (KNN), support vector machine (SVM), convolutional neural network (CNN), and long short-term memory (LSTM). <b>Results:</b> The best performance was obtained using BOW features with an SVM classifier. Feature fusion strategies, combining representations such as BOW + TF-IDF and BOW + BERT, also yielded strong performance. Notably, the BOW + TF-IDF combination with SVM achieved the lowest type I error, effectively minimizing the misclassification of patients with poor outcomes. <b>Conclusion:</b> Traditional machine learning methods outperformed deep learning models in this study. Among all combinations, BOW + TF-IDF features with SVM provided the most accurate predictions and lowest risk of false positives in stroke outcome prediction.</p>","PeriodicalId":55069,"journal":{"name":"Health Informatics Journal","volume":"31 3","pages":"14604582251381194"},"PeriodicalIF":2.3,"publicationDate":"2025-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145082493","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-07-01Epub Date: 2025-09-24DOI: 10.1177/14604582251381271
Florian Albrecht, Ruslan Talpa, Raphael Scheible-Schmitt
Objective: Accessing reliable medical information online in Germany is often hindered by misinformation and low health literacy. Tala-med, an ad-free search engine, was developed to provide curated, expert-reviewed content with filters for trustworthiness, recency, user-friendliness, and comprehensibility. This study re-engineered the original system to overcome technical limitations while maintaining result consistency. Methods: A modular architecture was designed using Elasticsearch, a fastText-based synonym system, and a subZero-powered admin interface. The system was evaluated using 214 unique queries to compare performance and result similarity with the legacy version. Results: The new implementation improved query processing speed while preserving result consistency. Synonym handling was enhanced using fastText, and system maintainability increased via a centralized database and modular backend. The administrative interface simplified data updates and configuration tasks. Conclusion: The re-engineered tala-med search engine maintains the original system's strengths while enabling greater scalability, flexibility, and future extensibility. The open-source platform offers a foundation for advancing domain-specific search systems and supports applications beyond the medical field.
{"title":"Enhancing medical information retrieval: Re-engineering the tala-med search engine for improved performance and flexibility.","authors":"Florian Albrecht, Ruslan Talpa, Raphael Scheible-Schmitt","doi":"10.1177/14604582251381271","DOIUrl":"https://doi.org/10.1177/14604582251381271","url":null,"abstract":"<p><p><b>Objective:</b> Accessing reliable medical information online in Germany is often hindered by misinformation and low health literacy. Tala-med, an ad-free search engine, was developed to provide curated, expert-reviewed content with filters for trustworthiness, recency, user-friendliness, and comprehensibility. This study re-engineered the original system to overcome technical limitations while maintaining result consistency. <b>Methods:</b> A modular architecture was designed using Elasticsearch, a fastText-based synonym system, and a subZero-powered admin interface. The system was evaluated using 214 unique queries to compare performance and result similarity with the legacy version. <b>Results:</b> The new implementation improved query processing speed while preserving result consistency. Synonym handling was enhanced using fastText, and system maintainability increased via a centralized database and modular backend. The administrative interface simplified data updates and configuration tasks. <b>Conclusion:</b> The re-engineered tala-med search engine maintains the original system's strengths while enabling greater scalability, flexibility, and future extensibility. The open-source platform offers a foundation for advancing domain-specific search systems and supports applications beyond the medical field.</p>","PeriodicalId":55069,"journal":{"name":"Health Informatics Journal","volume":"31 3","pages":"14604582251381271"},"PeriodicalIF":2.3,"publicationDate":"2025-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145139287","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-07-01Epub Date: 2025-09-18DOI: 10.1177/14604582251381262
Jibril Bashir Adem, Anas Ali Alhur, Agmasie Damtew Walle, Daniel Niguse Mamo, Shimels Derso Kebede, Siraj Muhidin Degefa
Introduction: Non-communicable diseases are a global health concern endangering public health as well as social and economic progress worldwide. Although Ethiopia's healthcare delivery system has seen tremendous advancements in the use of digital health technology (DHT) for disease management, no major changes have been made. Thus, this study aims to assess barriers and facilitators of DHT intervention for chronic disease management in Ethiopia. Method: A systematic review of literatures was conducted following PRISMA guidelines and using the PICOS approach. Studies were identified through PubMed, Cochrane, HINARI search and other gray literature between March and April 2024. Data was extracted and organized using a standardized Excel sheet, and a descriptive thematic analysis was performed to categorize and summarize the findings and presented in tables and diagrams. Results and conclusion: This review included 12 articles that fulfilled inclusion criteria. The review revealed barriers to DHTs such as lack of technological understanding, negative attitudes, and limited access to necessary resources and facilitators like, perceived usefulness, positive attitudes towards DHTs, and good access to necessary technological tools. This review highlights the need for promotion of facilitators and addressing barriers with targeted strategies to improve the design, implementation, scaling, and sustainability of DHTs.
{"title":"Systematic review of barriers and facilitators to digital health technology interventions for chronic disease management in Ethiopia: Insights for implementing digital health in developing countries.","authors":"Jibril Bashir Adem, Anas Ali Alhur, Agmasie Damtew Walle, Daniel Niguse Mamo, Shimels Derso Kebede, Siraj Muhidin Degefa","doi":"10.1177/14604582251381262","DOIUrl":"10.1177/14604582251381262","url":null,"abstract":"<p><p><b>Introduction:</b> Non-communicable diseases are a global health concern endangering public health as well as social and economic progress worldwide. Although Ethiopia's healthcare delivery system has seen tremendous advancements in the use of digital health technology (DHT) for disease management, no major changes have been made. Thus, this study aims to assess barriers and facilitators of DHT intervention for chronic disease management in Ethiopia. <b>Method:</b> A systematic review of literatures was conducted following PRISMA guidelines and using the PICOS approach. Studies were identified through PubMed, Cochrane, HINARI search and other gray literature between March and April 2024. Data was extracted and organized using a standardized Excel sheet, and a descriptive thematic analysis was performed to categorize and summarize the findings and presented in tables and diagrams. <b>Results and conclusion:</b> This review included 12 articles that fulfilled inclusion criteria. The review revealed barriers to DHTs such as lack of technological understanding, negative attitudes, and limited access to necessary resources and facilitators like, perceived usefulness, positive attitudes towards DHTs, and good access to necessary technological tools. This review highlights the need for promotion of facilitators and addressing barriers with targeted strategies to improve the design, implementation, scaling, and sustainability of DHTs.</p>","PeriodicalId":55069,"journal":{"name":"Health Informatics Journal","volume":"31 3","pages":"14604582251381262"},"PeriodicalIF":2.3,"publicationDate":"2025-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145088329","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Background: Large language models (LLM) still face challenges in accurately extracting and summarizing medical information from EHR and EMR. The variability in EHR and EMR formats across institutions further complicates information integration. Moreover, doctors need to spend a lot of time reviewing patient information, which affects the efficiency and effectiveness of clinical decision-making. Objective: This study aims to develop a medical record summarization system that uses the innovative X-RAG technique with GPT-4o to extract medical information from EHR and EMR and convert them into structured FHIR format. The system ultimately generates a doctor-friendly report to improve the efficiency and effectiveness of clinical decision-making. Methods: We propose an innovative X-RAG, which adds page-based chunking, chunk filtering, and guided extraction prompting to the basic framework of RAG and combines it with GPT-4o to extract medical measurement data, diagnostic reports, and medication history records from EHR and EMR with high accuracy. Results: The system achieved 96.5% accuracy in medical data extraction and reduced approximately 40% of the time doctors spend reviewing patient information in clinical applications. Conclusion: The proposed system improves the efficiency and effectiveness of clinical decision-making and provides a valuable tool to optimize medical information management and clinical workflows.
{"title":"An innovative X-RAG technique combined with GPT-4o for summarizing medical information from EHR and EMR to assist doctors in clinical decision-making effectively and efficiently.","authors":"Jhing-Fa Wang, Che-Chuan Chang, Te-Ming Chiang, Tzu-Chun Yeh, Eric Cheng, Yuan-Teh Lee, Hong-I Chen","doi":"10.1177/14604582251381233","DOIUrl":"https://doi.org/10.1177/14604582251381233","url":null,"abstract":"<p><p><b>Background:</b> Large language models (LLM) still face challenges in accurately extracting and summarizing medical information from EHR and EMR. The variability in EHR and EMR formats across institutions further complicates information integration. Moreover, doctors need to spend a lot of time reviewing patient information, which affects the efficiency and effectiveness of clinical decision-making. <b>Objective:</b> This study aims to develop a medical record summarization system that uses the innovative X-RAG technique with GPT-4o to extract medical information from EHR and EMR and convert them into structured FHIR format. The system ultimately generates a doctor-friendly report to improve the efficiency and effectiveness of clinical decision-making. <b>Methods:</b> We propose an innovative X-RAG, which adds page-based chunking, chunk filtering, and guided extraction prompting to the basic framework of RAG and combines it with GPT-4o to extract medical measurement data, diagnostic reports, and medication history records from EHR and EMR with high accuracy. <b>Results:</b> The system achieved 96.5% accuracy in medical data extraction and reduced approximately 40% of the time doctors spend reviewing patient information in clinical applications. <b>Conclusion:</b> The proposed system improves the efficiency and effectiveness of clinical decision-making and provides a valuable tool to optimize medical information management and clinical workflows.</p>","PeriodicalId":55069,"journal":{"name":"Health Informatics Journal","volume":"31 3","pages":"14604582251381233"},"PeriodicalIF":2.3,"publicationDate":"2025-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145082432","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-07-01Epub Date: 2025-07-04DOI: 10.1177/14604582251356208
Miroslav Kendrišić, Branka Rodić, Aleksandra Labus, Milica Simić, Vukašin Despotović
The study had two primary goals: (1) to propose a methodological approach for introducing crowdsourced e-health services within healthcare institutions, and (2) to evaluate the readiness of citizens to adopt the proposed services. The proposed methodological approach addresses the essential infrastructural elements required for introducing crowdsourced e-health services, including their integration into institutional web portals and alignment with broader national digital health systems. By enabling structured citizen participation and facilitating dynamic data exchange among key stakeholders, the approach supports the modernization of healthcare service delivery. This research examined young citizens' readiness to use crowdsourced e-health services to assess the potential for adopting the proposed method. The findings indicate that perceived value is positively influenced by trust, while both perceived value and perceived behavioral control have a significant impact on the intention to contribute. This research introduces an original methodological approach tailored to support the implementation of crowdsourced e-health services within healthcare institutions. The proposed model stands out for its adaptability, as it combines communication, collaboration, crowdsourcing, and payment services within a unified structure. Its flexibility allows integration across different institutional levels, promoting citizen participation and enabling more transparent, efficient, and needs-driven healthcare delivery.
{"title":"Exploring the potential for introducing crowdsourced e-health services.","authors":"Miroslav Kendrišić, Branka Rodić, Aleksandra Labus, Milica Simić, Vukašin Despotović","doi":"10.1177/14604582251356208","DOIUrl":"https://doi.org/10.1177/14604582251356208","url":null,"abstract":"<p><p>The study had two primary goals: (1) to propose a methodological approach for introducing crowdsourced e-health services within healthcare institutions, and (2) to evaluate the readiness of citizens to adopt the proposed services. The proposed methodological approach addresses the essential infrastructural elements required for introducing crowdsourced e-health services, including their integration into institutional web portals and alignment with broader national digital health systems. By enabling structured citizen participation and facilitating dynamic data exchange among key stakeholders, the approach supports the modernization of healthcare service delivery. This research examined young citizens' readiness to use crowdsourced e-health services to assess the potential for adopting the proposed method. The findings indicate that perceived value is positively influenced by trust, while both perceived value and perceived behavioral control have a significant impact on the intention to contribute. This research introduces an original methodological approach tailored to support the implementation of crowdsourced e-health services within healthcare institutions. The proposed model stands out for its adaptability, as it combines communication, collaboration, crowdsourcing, and payment services within a unified structure. Its flexibility allows integration across different institutional levels, promoting citizen participation and enabling more transparent, efficient, and needs-driven healthcare delivery.</p>","PeriodicalId":55069,"journal":{"name":"Health Informatics Journal","volume":"31 3","pages":"14604582251356208"},"PeriodicalIF":2.2,"publicationDate":"2025-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144562007","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Objective: With the growing burden of type 2 diabetes and its associated healthcare costs, the factors influencing future expenditures, particularly among long-term care insurance (LTCI) users, must be identified. Few studies have addressed the prediction of multiple cost domains, including medical, LTC, and dental expenditures. This study predicted medical, dental, and LTC costs in the following year for patients with type 2 diabetes and identified key predictors based on health information from the previous year. Methods: We applied three machine learning models-random forest, boosted trees, and neural networks-to LTCI users' data in Japan and incorporated prior-year healthcare costs, service usage patterns, and diabetes status. Results: In the 2019 medical cost model, boosted trees showed the best performance for those aged 74 or younger (R2 = 0.46, RMSE = 151,804 JPY). LTC costs were influenced by prior LTC spending (∼40%) and facility service use (30-50%), while dental costs were predicted by prior dental expenditures. Conclusions: Prior-year medical costs strongly influenced later medical expenditures, while LTC costs reflected prior LTC spending and facility use. These quantified relationships provide insights for healthcare cost optimization and support policymakers in designing preventive strategies and care systems for aging populations with chronic diseases.
{"title":"Impact of health information on medical, dental, and long-term care costs for patients with type 2 diabetes utilizing care insurance.","authors":"Teppei Suzuki, Hiroshi Saito, Hisashi Enomoto, Takeshi Aoyama, Wataru Nagai, Katsuhiko Ogasawara","doi":"10.1177/14604582251382033","DOIUrl":"https://doi.org/10.1177/14604582251382033","url":null,"abstract":"<p><p><b>Objective:</b> With the growing burden of type 2 diabetes and its associated healthcare costs, the factors influencing future expenditures, particularly among long-term care insurance (LTCI) users, must be identified. Few studies have addressed the prediction of multiple cost domains, including medical, LTC, and dental expenditures. This study predicted medical, dental, and LTC costs in the following year for patients with type 2 diabetes and identified key predictors based on health information from the previous year. <b>Methods:</b> We applied three machine learning models-random forest, boosted trees, and neural networks-to LTCI users' data in Japan and incorporated prior-year healthcare costs, service usage patterns, and diabetes status. <b>Results:</b> In the 2019 medical cost model, boosted trees showed the best performance for those aged 74 or younger (R<sup>2</sup> = 0.46, RMSE = 151,804 JPY). LTC costs were influenced by prior LTC spending (∼40%) and facility service use (30-50%), while dental costs were predicted by prior dental expenditures. <b>Conclusions:</b> Prior-year medical costs strongly influenced later medical expenditures, while LTC costs reflected prior LTC spending and facility use. These quantified relationships provide insights for healthcare cost optimization and support policymakers in designing preventive strategies and care systems for aging populations with chronic diseases.</p>","PeriodicalId":55069,"journal":{"name":"Health Informatics Journal","volume":"31 3","pages":"14604582251382033"},"PeriodicalIF":2.3,"publicationDate":"2025-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145193950","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2025-07-01Epub Date: 2025-09-15DOI: 10.1177/14604582251381156
Kaifeng Liu, Qinyue Li, Da Tao
Objective: While smart healthcare services have shown potential in improving healthcare efficiency and effectiveness, significant barriers remain for consumers' long-term engagement in such services. The study sought to propose and validate a theoretical framework to investigate the continuous use of smart healthcare services. Methods: The research model integrates commitment-trust theory with the information system success model, empirically validated through partial least squares structural equation modeling. Data were collected via a Chinese online survey platform, targeting 355 active users of smart health services. Results: The proposed model explained 61.4% of the variance in continuous usage intention. Affective commitment, trust, and satisfaction significantly affected continuous usage intention (p's < 0.01). Trust and satisfaction were found to significantly influence affective commitment (p's < 0.001). Satisfaction and perceived value were found to be significant determinants of trust (p's < 0.05). Perceived value also significantly influenced satisfaction (p < 0.001). The relationships were also moderated by age, gender, and AI literacy. Conclusion: This study represents rare attempts to explore continuous usage intention of smart healthcare services from the commitment-trust theory perspective. Practitioners should prioritize trust-building measures (e.g., transparent data usage policies) and personalized features (e.g., adaptive health recommendations) to enhance long-term engagement. Demographic characteristics should also be considered when designing such services.
{"title":"Determinants of continuous use intention of smart healthcare services: Evidence from a commitment-trust theory perspective.","authors":"Kaifeng Liu, Qinyue Li, Da Tao","doi":"10.1177/14604582251381156","DOIUrl":"10.1177/14604582251381156","url":null,"abstract":"<p><p><b>Objective</b>: While smart healthcare services have shown potential in improving healthcare efficiency and effectiveness, significant barriers remain for consumers' long-term engagement in such services. The study sought to propose and validate a theoretical framework to investigate the continuous use of smart healthcare services. <b>Methods</b>: The research model integrates commitment-trust theory with the information system success model, empirically validated through partial least squares structural equation modeling. Data were collected via a Chinese online survey platform, targeting 355 active users of smart health services. <b>Results</b>: The proposed model explained 61.4% of the variance in continuous usage intention. Affective commitment, trust, and satisfaction significantly affected continuous usage intention (<i>p's</i> < 0.01). Trust and satisfaction were found to significantly influence affective commitment (<i>p's</i> < 0.001). Satisfaction and perceived value were found to be significant determinants of trust (<i>p's</i> < 0.05). Perceived value also significantly influenced satisfaction (<i>p</i> < 0.001). The relationships were also moderated by age, gender, and AI literacy. <b>Conclusion</b>: This study represents rare attempts to explore continuous usage intention of smart healthcare services from the commitment-trust theory perspective. Practitioners should prioritize trust-building measures (e.g., transparent data usage policies) and personalized features (e.g., adaptive health recommendations) to enhance long-term engagement. Demographic characteristics should also be considered when designing such services.</p>","PeriodicalId":55069,"journal":{"name":"Health Informatics Journal","volume":"31 3","pages":"14604582251381156"},"PeriodicalIF":2.3,"publicationDate":"2025-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145066268","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
BackgroundAI tools are becoming primary information sources for patients with chronic kidney disease (CKD). However, as AI sometimes generates factual or inaccurate information, the reliability of information must be assessed.MethodsThis study assessed the AI-generated responses to frequently asked questions on CKD. We entered Japanese prompts with top CKD-related keywords into ChatGPT, Copilot, and Gemini. The Quality Analysis of Medical Artificial Intelligence (QAMAI) tool was used to evaluate the reliability of the information.ResultsWe included 207 AI responses from 23 prompts. The AI tools generated reliable information, with a median QAMAI score of 23 (interquartile range: 7) out of 30. However, information accuracy and resource availability varied (median (IQR): ChatGPT versus Copilot versus Gemini = 18 (2) versus 25 (3) versus 24 (5), p < 0.01). Among AI tools, ChatGPT provided the least accurate information and did not provide any resources.ConclusionThe quality of AI responses on CKD was generally acceptable. While most information provided was reliable and comprehensive, some information lacked accuracy and references.
dai工具正在成为慢性肾脏疾病(CKD)患者的主要信息来源。然而,由于人工智能有时会产生真实或不准确的信息,因此必须评估信息的可靠性。方法本研究评估了人工智能对CKD常见问题的回答。我们在ChatGPT、Copilot和Gemini中输入了与ckd相关的热门关键词的日语提示。使用医疗人工智能质量分析(QAMAI)工具评估信息的可靠性。结果我们从23个提示中纳入了207个AI响应。人工智能工具生成了可靠的信息,QAMAI得分中位数为23分(四分位数范围为7分)。然而,信息准确性和资源可用性各不相同(中位数(IQR): ChatGPT vs Copilot vs Gemini = 18 (2) vs 25 (3) vs 24 (5), p < 0.01)。在人工智能工具中,ChatGPT提供的信息最不准确,没有提供任何资源。结论人工智能治疗CKD的质量总体上可以接受。虽然所提供的大多数信息是可靠和全面的,但有些信息缺乏准确性和参考价值。
{"title":"Reliability of AI-generated responses on frequently-posed questions by patients with chronic kidney disease.","authors":"Emi Furukawa, Tsuyoshi Okuhara, Hiroko Okada, Yuriko Nishiie, Takahiro Kiuchi","doi":"10.1177/14604582251381996","DOIUrl":"https://doi.org/10.1177/14604582251381996","url":null,"abstract":"<p><p>BackgroundAI tools are becoming primary information sources for patients with chronic kidney disease (CKD). However, as AI sometimes generates factual or inaccurate information, the reliability of information must be assessed.MethodsThis study assessed the AI-generated responses to frequently asked questions on CKD. We entered Japanese prompts with top CKD-related keywords into ChatGPT, Copilot, and Gemini. The Quality Analysis of Medical Artificial Intelligence (QAMAI) tool was used to evaluate the reliability of the information.ResultsWe included 207 AI responses from 23 prompts. The AI tools generated reliable information, with a median QAMAI score of 23 (interquartile range: 7) out of 30. However, information accuracy and resource availability varied (median (IQR): ChatGPT versus Copilot versus Gemini = 18 (2) versus 25 (3) versus 24 (5), <i>p</i> < 0.01). Among AI tools, ChatGPT provided the least accurate information and did not provide any resources.ConclusionThe quality of AI responses on CKD was generally acceptable. While most information provided was reliable and comprehensive, some information lacked accuracy and references.</p>","PeriodicalId":55069,"journal":{"name":"Health Informatics Journal","volume":"31 3","pages":"14604582251381996"},"PeriodicalIF":2.3,"publicationDate":"2025-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145132695","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}