{"title":"GPT-4o 的马匹诊断和分诊准确性。","authors":"Laura Haase, Dagmar Monett, Martin Sedlmayr","doi":"10.3233/SHTI241092","DOIUrl":null,"url":null,"abstract":"<p><p>Animal owners may increasingly rely on large language models for gathering animal health information alongside internet sources in the future. This study therefore aims to provide initial results on the accuracy of ChatGPT-4o in triage and tentative diagnostics, using horses as a case study. Ten test vignettes were used to prompt situation assessments from the tool, which were then compared to original assessments made by a veterinary specialist for horses. The most probable diagnosis suggested by ChatGPT-4o was found to be quite accurate in most cases, with the urgency to contact a veterinarian sometimes assessed as higher than necessary. When provided with all relevant information, the tool does not seem to compromise horse health by recommending excessively long waiting times, although there is still potential for improving the relief of veterinarians' workload.</p>","PeriodicalId":94357,"journal":{"name":"Studies in health technology and informatics","volume":"321 ","pages":"200-204"},"PeriodicalIF":0.0000,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Horse Diagnosis and Triage Accuracy of GPT-4o.\",\"authors\":\"Laura Haase, Dagmar Monett, Martin Sedlmayr\",\"doi\":\"10.3233/SHTI241092\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Animal owners may increasingly rely on large language models for gathering animal health information alongside internet sources in the future. This study therefore aims to provide initial results on the accuracy of ChatGPT-4o in triage and tentative diagnostics, using horses as a case study. Ten test vignettes were used to prompt situation assessments from the tool, which were then compared to original assessments made by a veterinary specialist for horses. The most probable diagnosis suggested by ChatGPT-4o was found to be quite accurate in most cases, with the urgency to contact a veterinarian sometimes assessed as higher than necessary. When provided with all relevant information, the tool does not seem to compromise horse health by recommending excessively long waiting times, although there is still potential for improving the relief of veterinarians' workload.</p>\",\"PeriodicalId\":94357,\"journal\":{\"name\":\"Studies in health technology and informatics\",\"volume\":\"321 \",\"pages\":\"200-204\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-11-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Studies in health technology and informatics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.3233/SHTI241092\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Studies in health technology and informatics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3233/SHTI241092","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Animal owners may increasingly rely on large language models for gathering animal health information alongside internet sources in the future. This study therefore aims to provide initial results on the accuracy of ChatGPT-4o in triage and tentative diagnostics, using horses as a case study. Ten test vignettes were used to prompt situation assessments from the tool, which were then compared to original assessments made by a veterinary specialist for horses. The most probable diagnosis suggested by ChatGPT-4o was found to be quite accurate in most cases, with the urgency to contact a veterinarian sometimes assessed as higher than necessary. When provided with all relevant information, the tool does not seem to compromise horse health by recommending excessively long waiting times, although there is still potential for improving the relief of veterinarians' workload.