A simplified retriever to improve accuracy of phenotype normalizations by large language models.

IF 3.2 Q1 HEALTH CARE SCIENCES & SERVICES Frontiers in digital health Pub Date : 2025-03-04 eCollection Date: 2025-01-01 DOI:10.3389/fdgth.2025.1495040
Daniel B Hier, Thanh Son Do, Tayo Obafemi-Ajayi
{"title":"A simplified retriever to improve accuracy of phenotype normalizations by large language models.","authors":"Daniel B Hier, Thanh Son Do, Tayo Obafemi-Ajayi","doi":"10.3389/fdgth.2025.1495040","DOIUrl":null,"url":null,"abstract":"<p><p>Large language models have shown improved accuracy in phenotype term normalization tasks when augmented with retrievers that suggest candidate normalizations based on term definitions. In this work, we introduce a simplified retriever that enhances large language model accuracy by searching the Human Phenotype Ontology (HPO) for candidate matches using contextual word embeddings from BioBERT without the need for explicit term definitions. Testing this method on terms derived from the clinical synopses of Online Mendelian Inheritance in Man (OMIM<sup>®</sup>), we demonstrate that the normalization accuracy of GPT-4o increases from a baseline of 62% without augmentation to 85% with retriever augmentation. This approach is potentially generalizable to other biomedical term normalization tasks and offers an efficient alternative to more complex retrieval methods.</p>","PeriodicalId":73078,"journal":{"name":"Frontiers in digital health","volume":"7 ","pages":"1495040"},"PeriodicalIF":3.2000,"publicationDate":"2025-03-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11913805/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Frontiers in digital health","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3389/fdgth.2025.1495040","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/1 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0

Abstract

Large language models have shown improved accuracy in phenotype term normalization tasks when augmented with retrievers that suggest candidate normalizations based on term definitions. In this work, we introduce a simplified retriever that enhances large language model accuracy by searching the Human Phenotype Ontology (HPO) for candidate matches using contextual word embeddings from BioBERT without the need for explicit term definitions. Testing this method on terms derived from the clinical synopses of Online Mendelian Inheritance in Man (OMIM®), we demonstrate that the normalization accuracy of GPT-4o increases from a baseline of 62% without augmentation to 85% with retriever augmentation. This approach is potentially generalizable to other biomedical term normalization tasks and offers an efficient alternative to more complex retrieval methods.

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
一种简化的检索器,通过大型语言模型提高表型规范化的准确性。
当使用基于术语定义的候选规范化检索器进行增强时,大型语言模型在表型术语规范化任务中显示出更高的准确性。在这项工作中,我们引入了一个简化的检索器,通过使用BioBERT的上下文词嵌入搜索人类表型本体(HPO)中的候选匹配来提高大型语言模型的准确性,而不需要明确的术语定义。通过对人类在线孟德尔遗传临床概要(OMIM®)衍生的术语进行测试,我们证明gpt - 40的归一化准确性从基线的62%增加到检索犬增加的85%。该方法可推广到其他生物医学术语规范化任务,并为更复杂的检索方法提供了一种有效的替代方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
CiteScore
4.20
自引率
0.00%
发文量
0
审稿时长
13 weeks
期刊最新文献
Structuring medication safety narratives: development and evaluation of the medication-related incident reports annotation scheme. Use of digital patients in clinical simulation for nursing education: a scoping review protocol. From memorization to generalization: fine-tuning large language models for biomedical term-to-identifier normalization. Identifying needs in adult rehabilitation to support the clinical implementation of robotics and allied technologies: an Italian national survey. Single-item measures in digital mental healthcare: a mini narrative review of challenges and opportunities.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1