{"title":"Using Bland-Altman plot-based harmonization algorithm to optimize the harmonization for immunoassays.","authors":"Huiling Fang, Ruifeng Yang, Jiayue Guo, Xinxin Ren, Xin Chang, Lan Kang, Yuqing Zhu","doi":"10.1515/cclm-2024-0187","DOIUrl":null,"url":null,"abstract":"<p><strong>Objectives: </strong>Harmonization has been recommended by the International Organization for Standard (ISO) to achieve equivalent results across <i>in vitro</i> diagnostic measurement devices (IVD-MDs). We aim to evaluate the effectiveness of Bland-Altman plot-based harmonization algorithm (BA-BHA) created in this study and compare it with weighted Deming regression-based harmonization algorithm (WD-BHA) proposed in ISO 21151:2020.</p><p><strong>Methods: </strong>Eighty patient sera were used as the harmonization reference material (HRM) to develop IVD-MD-specific harmonization algorithms. Another panel of 40 patient sera was used to validate the effectiveness of harmonization algorithms. We compared regression slopes, intercepts, Bland-Altman plot layouts, percent differences, limits of agreement (LoAs), between-method coefficients of variation (CV) before and after harmonization.</p><p><strong>Results: </strong>After harmonization by WD-BHA, acceptable slopes and intercepts between measured values and HRM targets were observed in weighted Deming regression, but not in Passing-Bablok analysis. Mean differences were -5.5 to 5.0 % and differences at specific levels were -33.9 to 23.9 %. LoAs were -64.6 to 74.6 %. Between-method CV was 22.9 % (±12.9 %). However, after harmonization by BA-BHA, both weighted Deming and Passing-Bablok regressions equations presented harmonized results. Mean differences were -0.3 to 0.2 % and differences at specific levels were -1.1 to 1.6 %. LoAs were -23.3 to 23.2 %. Between-method CV was 8.4 % (±4.0 %). The data points were evenly distributed at both sides of the mean in Bland-Altman plots.</p><p><strong>Conclusions: </strong>The inequivalence of test results between different methods can be improved but unacceptable analytical differences at specific levels may be hidden in terms of an acceptable slope and intercept on WD-BHA. The new protocol BA-BHA may be a viable alternative to optimize the harmonization for immunoassays.</p>","PeriodicalId":10390,"journal":{"name":"Clinical chemistry and laboratory medicine","volume":null,"pages":null},"PeriodicalIF":3.8000,"publicationDate":"2024-05-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinical chemistry and laboratory medicine","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1515/cclm-2024-0187","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/10/28 0:00:00","PubModel":"Print","JCR":"Q1","JCRName":"MEDICAL LABORATORY TECHNOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Objectives: Harmonization has been recommended by the International Organization for Standard (ISO) to achieve equivalent results across in vitro diagnostic measurement devices (IVD-MDs). We aim to evaluate the effectiveness of Bland-Altman plot-based harmonization algorithm (BA-BHA) created in this study and compare it with weighted Deming regression-based harmonization algorithm (WD-BHA) proposed in ISO 21151:2020.
Methods: Eighty patient sera were used as the harmonization reference material (HRM) to develop IVD-MD-specific harmonization algorithms. Another panel of 40 patient sera was used to validate the effectiveness of harmonization algorithms. We compared regression slopes, intercepts, Bland-Altman plot layouts, percent differences, limits of agreement (LoAs), between-method coefficients of variation (CV) before and after harmonization.
Results: After harmonization by WD-BHA, acceptable slopes and intercepts between measured values and HRM targets were observed in weighted Deming regression, but not in Passing-Bablok analysis. Mean differences were -5.5 to 5.0 % and differences at specific levels were -33.9 to 23.9 %. LoAs were -64.6 to 74.6 %. Between-method CV was 22.9 % (±12.9 %). However, after harmonization by BA-BHA, both weighted Deming and Passing-Bablok regressions equations presented harmonized results. Mean differences were -0.3 to 0.2 % and differences at specific levels were -1.1 to 1.6 %. LoAs were -23.3 to 23.2 %. Between-method CV was 8.4 % (±4.0 %). The data points were evenly distributed at both sides of the mean in Bland-Altman plots.
Conclusions: The inequivalence of test results between different methods can be improved but unacceptable analytical differences at specific levels may be hidden in terms of an acceptable slope and intercept on WD-BHA. The new protocol BA-BHA may be a viable alternative to optimize the harmonization for immunoassays.
期刊介绍:
Clinical Chemistry and Laboratory Medicine (CCLM) publishes articles on novel teaching and training methods applicable to laboratory medicine. CCLM welcomes contributions on the progress in fundamental and applied research and cutting-edge clinical laboratory medicine. It is one of the leading journals in the field, with an impact factor over 3. CCLM is issued monthly, and it is published in print and electronically.
CCLM is the official journal of the European Federation of Clinical Chemistry and Laboratory Medicine (EFLM) and publishes regularly EFLM recommendations and news. CCLM is the official journal of the National Societies from Austria (ÖGLMKC); Belgium (RBSLM); Germany (DGKL); Hungary (MLDT); Ireland (ACBI); Italy (SIBioC); Portugal (SPML); and Slovenia (SZKK); and it is affiliated to AACB (Australia) and SFBC (France).
Topics:
- clinical biochemistry
- clinical genomics and molecular biology
- clinical haematology and coagulation
- clinical immunology and autoimmunity
- clinical microbiology
- drug monitoring and analysis
- evaluation of diagnostic biomarkers
- disease-oriented topics (cardiovascular disease, cancer diagnostics, diabetes)
- new reagents, instrumentation and technologies
- new methodologies
- reference materials and methods
- reference values and decision limits
- quality and safety in laboratory medicine
- translational laboratory medicine
- clinical metrology
Follow @cclm_degruyter on Twitter!