Rafiqul Islam Maruf , Saori Tou , Rieko Izukura , Yoko Sato , Mariko Nishikitani , Kimiyo Kikuchi , Fumihiko Yokota , Subaru Ikeda , Rakibul Islam , Ashir Ahmed , Masashi Miyazaki , Naoki Nakashima
{"title":"An evaluation of the commonly used portable medical sensors performance in comparison to clinical test results for telehealth systems","authors":"Rafiqul Islam Maruf , Saori Tou , Rieko Izukura , Yoko Sato , Mariko Nishikitani , Kimiyo Kikuchi , Fumihiko Yokota , Subaru Ikeda , Rakibul Islam , Ashir Ahmed , Masashi Miyazaki , Naoki Nakashima","doi":"10.1016/j.cmpbup.2024.100147","DOIUrl":null,"url":null,"abstract":"<div><h3>Background and Objective</h3><p>One of the primary challenges faced by telehealth systems is the accurate transmission of patient information to remote doctors. In this context, portable medical sensors deployed at the remote patients' end play a crucial role in measuring vital information. There are many sensors available in the market. However, the accuracy of the sensors has been always a concern. The objective of this study is to verify different sensors and create awareness for using accurate sensors to avoid misdiagnosis for the patients’ safety.</p></div><div><h3>Methods</h3><p>This study considered the test result of a Japanese clinical pathology laboratory as the reference gold standard. The clinical pathology laboratory uses 1) Hexokinase UV method for blood glucose, 2) Enzymatic Determination method for cholesterol, 3) Automatic Analyzer (EDTA-2 K) of Hemoglobin, and 4) Uricase POD method for uric acid. To assess the performance of a medical sensor, its test results were compared to the gold standard test results obtained from the laboratory using the same sample. A Normalized Root Mean Square Error (NRMSE) threshold of less than 0.2 was established as the criterion for determining whether the medical sensor's performance fell within an acceptable range.</p></div><div><h3>Results</h3><p>Among the eight most commonly used blood glucose devices in the Asian market, only one device was deemed acceptable with NRMSE less than 0.2. However, all four devices found in the Japanese market showed their acceptability. In the case of cholesterol, hemoglobin, and uric acid devices, only a limited number of items were available in Asian markets. Some of the hemoglobin and uric acid devices were found to be somewhat acceptable, while all the cholesterol sensors were found erroneous.</p></div><div><h3>Conclusions</h3><p>This study has clearly shown the issues with the portable medical sensors and recommends the device approval authority of each country to approve sales of the quality sensors only for patients’ safety.</p></div>","PeriodicalId":72670,"journal":{"name":"Computer methods and programs in biomedicine update","volume":"5 ","pages":"Article 100147"},"PeriodicalIF":0.0000,"publicationDate":"2024-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666990024000144/pdfft?md5=6cb858a0f60b29a1fc21629928f765b9&pid=1-s2.0-S2666990024000144-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computer methods and programs in biomedicine update","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666990024000144","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Background and Objective
One of the primary challenges faced by telehealth systems is the accurate transmission of patient information to remote doctors. In this context, portable medical sensors deployed at the remote patients' end play a crucial role in measuring vital information. There are many sensors available in the market. However, the accuracy of the sensors has been always a concern. The objective of this study is to verify different sensors and create awareness for using accurate sensors to avoid misdiagnosis for the patients’ safety.
Methods
This study considered the test result of a Japanese clinical pathology laboratory as the reference gold standard. The clinical pathology laboratory uses 1) Hexokinase UV method for blood glucose, 2) Enzymatic Determination method for cholesterol, 3) Automatic Analyzer (EDTA-2 K) of Hemoglobin, and 4) Uricase POD method for uric acid. To assess the performance of a medical sensor, its test results were compared to the gold standard test results obtained from the laboratory using the same sample. A Normalized Root Mean Square Error (NRMSE) threshold of less than 0.2 was established as the criterion for determining whether the medical sensor's performance fell within an acceptable range.
Results
Among the eight most commonly used blood glucose devices in the Asian market, only one device was deemed acceptable with NRMSE less than 0.2. However, all four devices found in the Japanese market showed their acceptability. In the case of cholesterol, hemoglobin, and uric acid devices, only a limited number of items were available in Asian markets. Some of the hemoglobin and uric acid devices were found to be somewhat acceptable, while all the cholesterol sensors were found erroneous.
Conclusions
This study has clearly shown the issues with the portable medical sensors and recommends the device approval authority of each country to approve sales of the quality sensors only for patients’ safety.