Rafik Rhouma , Christopher McMahon , Donald Mcgillivray , Hassan Massood , Safia Kanwal , Meraj Khan , Thomas Lo , Jean-Paul Lam , Christopher Smith
{"title":"Leveraging mobile NER for real-time capture of symptoms, diagnoses, and treatments from clinical dialogues","authors":"Rafik Rhouma , Christopher McMahon , Donald Mcgillivray , Hassan Massood , Safia Kanwal , Meraj Khan , Thomas Lo , Jean-Paul Lam , Christopher Smith","doi":"10.1016/j.imu.2024.101519","DOIUrl":null,"url":null,"abstract":"<div><p>In the dynamic world of healthcare technology, efficiently and accurately extracting medical data from physician–patient conversations is vital. This paper presents a new approach in healthcare technology, employing Natural Language Processing (NLP) to identify and extract critical information from doctor–patient conversations on mobile devices. Unlike traditional methods that rely on Electronic Health Records, our novel application enables the extraction of symptoms, diagnoses, and treatments directly on a mobile device during medical consultations, significantly enhancing patient privacy. We managed to integrate both Bidirectional Encoder Representations from Transformers (BERT) models and optimized Large Language Models (LLMs) on a mobile device without compromising performance significantly. Our findings reveal that the BERT model attained an F1-score of 85.1%, while FLERT and its compressed variant DistilFLERT showed superior performance. The FLAN-T5 model outperformed all models we tested with scores up to 92.7%. These results highlight the efficacy of leveraging advanced NLP and LLM technologies in healthcare environments on a mobile device, offering a promising direction for accessible and efficient patient care.</p></div>","PeriodicalId":13953,"journal":{"name":"Informatics in Medicine Unlocked","volume":"48 ","pages":"Article 101519"},"PeriodicalIF":0.0000,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2352914824000753/pdfft?md5=dcf02a1406246b404d5d886e23c7d375&pid=1-s2.0-S2352914824000753-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Informatics in Medicine Unlocked","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2352914824000753","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"Medicine","Score":null,"Total":0}
引用次数: 0
Abstract
In the dynamic world of healthcare technology, efficiently and accurately extracting medical data from physician–patient conversations is vital. This paper presents a new approach in healthcare technology, employing Natural Language Processing (NLP) to identify and extract critical information from doctor–patient conversations on mobile devices. Unlike traditional methods that rely on Electronic Health Records, our novel application enables the extraction of symptoms, diagnoses, and treatments directly on a mobile device during medical consultations, significantly enhancing patient privacy. We managed to integrate both Bidirectional Encoder Representations from Transformers (BERT) models and optimized Large Language Models (LLMs) on a mobile device without compromising performance significantly. Our findings reveal that the BERT model attained an F1-score of 85.1%, while FLERT and its compressed variant DistilFLERT showed superior performance. The FLAN-T5 model outperformed all models we tested with scores up to 92.7%. These results highlight the efficacy of leveraging advanced NLP and LLM technologies in healthcare environments on a mobile device, offering a promising direction for accessible and efficient patient care.
期刊介绍:
Informatics in Medicine Unlocked (IMU) is an international gold open access journal covering a broad spectrum of topics within medical informatics, including (but not limited to) papers focusing on imaging, pathology, teledermatology, public health, ophthalmological, nursing and translational medicine informatics. The full papers that are published in the journal are accessible to all who visit the website.