{"title":"Evaluating ChatGPT-4omni in paediatric developmental screening: direct versus sequential prompts.","authors":"Pathrada Traipidok, Papichaya Srisombundit, Nattaporn Tassanakijpanich, Pattra Charleowsak, Therdpong Thongseiratch","doi":"10.1136/bmjpo-2024-002809","DOIUrl":null,"url":null,"abstract":"<p><p>Integrating Large Language Models like ChatGPT-4omni (ChatGPT-4o) into paediatric healthcare could revolutionise developmental screening. This study evaluated ChatGPT-4o's efficacy in paediatric developmental screening using Direct and Sequential Prompting methods compared with the Bayley Scales of Infant Development, Third Edition. Among 106 paediatric cases, Direct Prompting showed a sensitivity of 73.42% and overall accuracy of 69.81%, while Sequential Prompting had a specificity of 62.96% and overall accuracy of 67.92%. Both methods demonstrate potential for improving the efficiency and accessibility of paediatric developmental screening, with Direct Prompts being more sensitive and Sequential Prompts more specific.</p>","PeriodicalId":9069,"journal":{"name":"BMJ Paediatrics Open","volume":"9 1","pages":""},"PeriodicalIF":2.0000,"publicationDate":"2025-03-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMJ Paediatrics Open","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1136/bmjpo-2024-002809","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"PEDIATRICS","Score":null,"Total":0}
引用次数: 0
Abstract
Integrating Large Language Models like ChatGPT-4omni (ChatGPT-4o) into paediatric healthcare could revolutionise developmental screening. This study evaluated ChatGPT-4o's efficacy in paediatric developmental screening using Direct and Sequential Prompting methods compared with the Bayley Scales of Infant Development, Third Edition. Among 106 paediatric cases, Direct Prompting showed a sensitivity of 73.42% and overall accuracy of 69.81%, while Sequential Prompting had a specificity of 62.96% and overall accuracy of 67.92%. Both methods demonstrate potential for improving the efficiency and accessibility of paediatric developmental screening, with Direct Prompts being more sensitive and Sequential Prompts more specific.