{"title":"临终关怀患者信息手册--人工智能生成内容在可读性、情感、准确性、完整性和适用性方面的比较评估:ChatGPT 与谷歌双子星。","authors":"Prakash G Gondode, Puneet Khanna, Pradeep Sharma, Sakshi Duggal, Neha Garg","doi":"10.5005/jp-journals-10071-24725","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>End-of-life care (EOLC) is a critical aspect of healthcare, yet accessing reliable information remains challenging, particularly in culturally diverse contexts like India.</p><p><strong>Objective: </strong>This study investigates the potential of artificial intelligence (AI) in addressing the informational gap by analyzing patient information leaflets (PILs) generated by AI chatbots on EOLC.</p><p><strong>Methodology: </strong>Using a comparative research design, PILs generated by ChatGPT and Google Gemini were evaluated for readability, sentiment, accuracy, completeness, and suitability. Readability was assessed using established metrics, sentiment analysis determined emotional tone, accuracy, and completeness were rated by subject experts, and suitability was evaluated using the Patient Education Materials Assessment Tool (PEMAT).</p><p><strong>Results: </strong>Google Gemini PILs exhibited superior readability and actionability compared to ChatGPT PILs. Both conveyed positive sentiments and high levels of accuracy and completeness, with Google Gemini PILs showing slightly lower accuracy scores.</p><p><strong>Conclusion: </strong>The findings highlight the promising role of AI in enhancing patient education in EOLC, with implications for improving care outcomes and promoting informed decision-making in diverse cultural settings. Ongoing refinement and innovation in AI-driven patient education strategies are needed to ensure compassionate and culturally sensitive EOLC.</p><p><strong>How to cite this article: </strong>Gondode PG, Khanna P, Sharma P, Duggal S, Garg N. End-of-life Care Patient Information Leaflets-A Comparative Evaluation of Artificial Intelligence-generated Content for Readability, Sentiment, Accuracy, Completeness, and Suitability: ChatGPT vs Google Gemini. Indian J Crit Care Med 2024;28(6):561-568.</p>","PeriodicalId":47664,"journal":{"name":"Indian Journal of Critical Care Medicine","volume":"28 6","pages":"561-568"},"PeriodicalIF":1.5000,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11310687/pdf/","citationCount":"0","resultStr":"{\"title\":\"End-of-life Care Patient Information Leaflets-A Comparative Evaluation of Artificial Intelligence-generated Content for Readability, Sentiment, Accuracy, Completeness, and Suitability: ChatGPT vs Google Gemini.\",\"authors\":\"Prakash G Gondode, Puneet Khanna, Pradeep Sharma, Sakshi Duggal, Neha Garg\",\"doi\":\"10.5005/jp-journals-10071-24725\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>End-of-life care (EOLC) is a critical aspect of healthcare, yet accessing reliable information remains challenging, particularly in culturally diverse contexts like India.</p><p><strong>Objective: </strong>This study investigates the potential of artificial intelligence (AI) in addressing the informational gap by analyzing patient information leaflets (PILs) generated by AI chatbots on EOLC.</p><p><strong>Methodology: </strong>Using a comparative research design, PILs generated by ChatGPT and Google Gemini were evaluated for readability, sentiment, accuracy, completeness, and suitability. Readability was assessed using established metrics, sentiment analysis determined emotional tone, accuracy, and completeness were rated by subject experts, and suitability was evaluated using the Patient Education Materials Assessment Tool (PEMAT).</p><p><strong>Results: </strong>Google Gemini PILs exhibited superior readability and actionability compared to ChatGPT PILs. Both conveyed positive sentiments and high levels of accuracy and completeness, with Google Gemini PILs showing slightly lower accuracy scores.</p><p><strong>Conclusion: </strong>The findings highlight the promising role of AI in enhancing patient education in EOLC, with implications for improving care outcomes and promoting informed decision-making in diverse cultural settings. Ongoing refinement and innovation in AI-driven patient education strategies are needed to ensure compassionate and culturally sensitive EOLC.</p><p><strong>How to cite this article: </strong>Gondode PG, Khanna P, Sharma P, Duggal S, Garg N. End-of-life Care Patient Information Leaflets-A Comparative Evaluation of Artificial Intelligence-generated Content for Readability, Sentiment, Accuracy, Completeness, and Suitability: ChatGPT vs Google Gemini. Indian J Crit Care Med 2024;28(6):561-568.</p>\",\"PeriodicalId\":47664,\"journal\":{\"name\":\"Indian Journal of Critical Care Medicine\",\"volume\":\"28 6\",\"pages\":\"561-568\"},\"PeriodicalIF\":1.5000,\"publicationDate\":\"2024-06-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11310687/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Indian Journal of Critical Care Medicine\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.5005/jp-journals-10071-24725\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"CRITICAL CARE MEDICINE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Indian Journal of Critical Care Medicine","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.5005/jp-journals-10071-24725","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"CRITICAL CARE MEDICINE","Score":null,"Total":0}
引用次数: 0
摘要
背景:临终关怀(EOLC)是医疗保健的一个重要方面,但获取可靠的信息仍具有挑战性,尤其是在印度这样的文化多样性背景下:本研究通过分析人工智能聊天机器人生成的临终关怀患者信息传单(PIL),探讨人工智能(AI)在解决信息鸿沟方面的潜力:采用比较研究设计,对 ChatGPT 和 Google Gemini 生成的 PIL 进行了可读性、情感、准确性、完整性和适用性评估。可读性使用既定指标进行评估,情感分析确定情感基调,准确性和完整性由主题专家评定,适宜性使用患者教育材料评估工具(PEMAT)进行评估:结果:与 ChatGPT PIL 相比,Google Gemini PIL 的可读性和可操作性更胜一筹。两者都传达了积极的情感,准确性和完整性都很高,但谷歌双子座 PIL 的准确性得分略低:研究结果凸显了人工智能在加强 EOLC 患者教育方面的重要作用,对改善护理效果和促进不同文化背景下的知情决策具有重要意义。需要不断完善和创新人工智能驱动的患者教育策略,以确保提供富有同情心和文化敏感性的临终关怀:Gondode PG, Khanna P, Sharma P, Duggal S, Garg N. End-of-life Care Patient Information Leaflets-A Comparative Evaluation of Artificial Intelligence-generated Content for Readability, Sentiment, Accuracy, Completeness, and Suitability:ChatGPT vs Google Gemini。Indian J Crit Care Med 2024;28(6):561-568.
End-of-life Care Patient Information Leaflets-A Comparative Evaluation of Artificial Intelligence-generated Content for Readability, Sentiment, Accuracy, Completeness, and Suitability: ChatGPT vs Google Gemini.
Background: End-of-life care (EOLC) is a critical aspect of healthcare, yet accessing reliable information remains challenging, particularly in culturally diverse contexts like India.
Objective: This study investigates the potential of artificial intelligence (AI) in addressing the informational gap by analyzing patient information leaflets (PILs) generated by AI chatbots on EOLC.
Methodology: Using a comparative research design, PILs generated by ChatGPT and Google Gemini were evaluated for readability, sentiment, accuracy, completeness, and suitability. Readability was assessed using established metrics, sentiment analysis determined emotional tone, accuracy, and completeness were rated by subject experts, and suitability was evaluated using the Patient Education Materials Assessment Tool (PEMAT).
Results: Google Gemini PILs exhibited superior readability and actionability compared to ChatGPT PILs. Both conveyed positive sentiments and high levels of accuracy and completeness, with Google Gemini PILs showing slightly lower accuracy scores.
Conclusion: The findings highlight the promising role of AI in enhancing patient education in EOLC, with implications for improving care outcomes and promoting informed decision-making in diverse cultural settings. Ongoing refinement and innovation in AI-driven patient education strategies are needed to ensure compassionate and culturally sensitive EOLC.
How to cite this article: Gondode PG, Khanna P, Sharma P, Duggal S, Garg N. End-of-life Care Patient Information Leaflets-A Comparative Evaluation of Artificial Intelligence-generated Content for Readability, Sentiment, Accuracy, Completeness, and Suitability: ChatGPT vs Google Gemini. Indian J Crit Care Med 2024;28(6):561-568.
期刊介绍:
Indian Journal of Critical Care Medicine (ISSN 0972-5229) is specialty periodical published under the auspices of Indian Society of Critical Care Medicine. Journal encourages research, education and dissemination of knowledge in the fields of critical and emergency medicine.