Ta-Chuan Yu , Cheng-Kun Yang , Wei-Han Hsu , Cheng-An Hsu , Hsiao-Chun Wang , Hsin-Jung Hsiao , Hsiao-Ling Chao , Han-Peng Hsieh , Jia-Rong Wu , Yen-Chun Tsai , Yi-Mei Chiang , Poshing Lee , Che-Pin Lin , Ling-Ping Chen , Yung-Chuan Sung , Ya-Yun Yang , Chin-Ling Yu , Chih-Kang Lin , Chia-Pin Kang , Che-Wei Chang , Wen-Chien Chou
{"title":"A machine-learning-based algorithm for bone marrow cell differential counting","authors":"Ta-Chuan Yu , Cheng-Kun Yang , Wei-Han Hsu , Cheng-An Hsu , Hsiao-Chun Wang , Hsin-Jung Hsiao , Hsiao-Ling Chao , Han-Peng Hsieh , Jia-Rong Wu , Yen-Chun Tsai , Yi-Mei Chiang , Poshing Lee , Che-Pin Lin , Ling-Ping Chen , Yung-Chuan Sung , Ya-Yun Yang , Chin-Ling Yu , Chih-Kang Lin , Chia-Pin Kang , Che-Wei Chang , Wen-Chien Chou","doi":"10.1016/j.ijmedinf.2024.105692","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><div>Differential counting (DC) of different cell types in bone marrow (BM) aspiration smears is crucial for diagnosing hematological diseases. However, a clinically applicable method for automatic DC has yet to be developed.</div></div><div><h3>Objective</h3><div>This study developed and validated an artificial intelligence (AI)-based algorithm for identifying and classifying nucleated cells in BM smears.</div></div><div><h3>Methods</h3><div>In the development phase, a mask region–based convolutional neural network (Mask R-CNN)-based AI model was trained to detect and classify individual BM cells. We used a large data set of expert-annotated images representing a variety of disease categories. The BM slides were stained with Liu’s stain or Wright–Giemsa stain. Consensus meetings were held to ensure experts from different institutes applied consistent criteria in classifying cells. Subsequently, the performance of the AI algorithm in identifying cell images and determining cell ratios was evaluated using a multinational clinical dataset.</div></div><div><h3>Results</h3><div>The AI model was trained on 542 slides (85.1 % stained with Liu’s stain and 14.9 % with Wright–Giemsa stain) containing 597,222 annotated cells. It achieved an accuracy of 0.94 for the testing dataset containing 26,170 cells. The performance of the AI model was further validated using another multinational real-world dataset (data obtained from three centers in Taiwan and one in the United States) comprising 200,639 cells. The AI model achieved an accuracy of 0.881 in classifying individual cells and demonstrated high precision in classifying blasts (0.927), bands and polymorphonuclear neutrophils (0.955), plasma cells (0.930), and lymphocytes (0.789). When the differential counting percentage of each cell type was assessed, a strong correlation (ρ > 0.8) between the AI and manual methods was observed for most cell categories.</div></div><div><h3>Conclusions</h3><div>In this study, an AI algorithm was developed and clinically validated using large, multinational datasets. Our algorithm can locate and classify BM cells simultaneously and has potential clinical applicability for automating BM differential counting.</div></div>","PeriodicalId":54950,"journal":{"name":"International Journal of Medical Informatics","volume":"194 ","pages":"Article 105692"},"PeriodicalIF":3.7000,"publicationDate":"2024-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Medical Informatics","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1386505624003551","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
Background
Differential counting (DC) of different cell types in bone marrow (BM) aspiration smears is crucial for diagnosing hematological diseases. However, a clinically applicable method for automatic DC has yet to be developed.
Objective
This study developed and validated an artificial intelligence (AI)-based algorithm for identifying and classifying nucleated cells in BM smears.
Methods
In the development phase, a mask region–based convolutional neural network (Mask R-CNN)-based AI model was trained to detect and classify individual BM cells. We used a large data set of expert-annotated images representing a variety of disease categories. The BM slides were stained with Liu’s stain or Wright–Giemsa stain. Consensus meetings were held to ensure experts from different institutes applied consistent criteria in classifying cells. Subsequently, the performance of the AI algorithm in identifying cell images and determining cell ratios was evaluated using a multinational clinical dataset.
Results
The AI model was trained on 542 slides (85.1 % stained with Liu’s stain and 14.9 % with Wright–Giemsa stain) containing 597,222 annotated cells. It achieved an accuracy of 0.94 for the testing dataset containing 26,170 cells. The performance of the AI model was further validated using another multinational real-world dataset (data obtained from three centers in Taiwan and one in the United States) comprising 200,639 cells. The AI model achieved an accuracy of 0.881 in classifying individual cells and demonstrated high precision in classifying blasts (0.927), bands and polymorphonuclear neutrophils (0.955), plasma cells (0.930), and lymphocytes (0.789). When the differential counting percentage of each cell type was assessed, a strong correlation (ρ > 0.8) between the AI and manual methods was observed for most cell categories.
Conclusions
In this study, an AI algorithm was developed and clinically validated using large, multinational datasets. Our algorithm can locate and classify BM cells simultaneously and has potential clinical applicability for automating BM differential counting.
期刊介绍:
International Journal of Medical Informatics provides an international medium for dissemination of original results and interpretative reviews concerning the field of medical informatics. The Journal emphasizes the evaluation of systems in healthcare settings.
The scope of journal covers:
Information systems, including national or international registration systems, hospital information systems, departmental and/or physician''s office systems, document handling systems, electronic medical record systems, standardization, systems integration etc.;
Computer-aided medical decision support systems using heuristic, algorithmic and/or statistical methods as exemplified in decision theory, protocol development, artificial intelligence, etc.
Educational computer based programs pertaining to medical informatics or medicine in general;
Organizational, economic, social, clinical impact, ethical and cost-benefit aspects of IT applications in health care.