Calibration improves the agreement in grading oral epithelial dysplasia—Findings from a National Workshop in Malaysia

IF 4.6 Q2 MATERIALS SCIENCE, BIOMATERIALS ACS Applied Bio Materials Pub Date : 2023-12-11 DOI:10.1111/jop.13501

Thomas George Kallarakkal, Zuraiza Mohamad Zaini, Wan Maria Nabillah Ghani, Lee Peng Karen-Ng, B. S. M. S. Siriwardena, Sok Ching Cheong, Wanninayake Mudiyanselage Tilakaratne

{"title":"Calibration improves the agreement in grading oral epithelial dysplasia—Findings from a National Workshop in Malaysia","authors":"Thomas George Kallarakkal, Zuraiza Mohamad Zaini, Wan Maria Nabillah Ghani, Lee Peng Karen-Ng, B. S. M. S. Siriwardena, Sok Ching Cheong, Wanninayake Mudiyanselage Tilakaratne","doi":"10.1111/jop.13501","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Introduction</h3>\n \n <p>A major pitfall of many of the established oral epithelial dysplasia (OED) grading criteria is their lack of reproducibility and accuracy to predict malignant transformation. The main objective of this study was to determine whether calibration of practicing oral pathologists on OED grading could improve the reproducibility of the WHO 2017 and the binary OED grading systems.</p>\n </section>\n \n <section>\n \n <h3> Methods</h3>\n \n <p>A nationwide online exercise was carried out to determine the influence of calibration on the reproducibility of the WHO 2017 and the binary OED grading systems.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>A significant improvement was observed in the inter-observer agreement for the WHO 2017 OED grading system (<i>K</i> 0.196 vs. 0.448; <i>K</i><sub><i>w</i></sub> 0.357 vs. 0.562) after the calibration exercise. The significant difference (<i>p</i> = 0.027) in the level of agreement between those with five or more years and less than 5 years of experience was no more observed (<i>p</i> = 0.426) after the calibration exercise. The percent agreement for binary grading was significantly higher (91.8%) for buccal mucosal lesions as compared to lesions on the tongue after the calibration exercise.</p>\n </section>\n \n <section>\n \n <h3> Conclusion</h3>\n \n <p>This study validates the significance of calibration in improving the reproducibility of OED grading. The nationwide exercise resulted in a statistically significant improvement in the inter-observer agreement for the WHO 2017 OED grading system among a large number of oral pathologists. It is highly recommended that similar exercises should be organized periodically by professional bodies responsible for continuing education among oral pathologists to improve the reliability of OED grading for optimal treatment of oral potentially malignant disorders.</p>\n </section>\n </div>","PeriodicalId":2,"journal":{"name":"ACS Applied Bio Materials","volume":null,"pages":null},"PeriodicalIF":4.6000,"publicationDate":"2023-12-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Bio Materials","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/jop.13501","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATERIALS SCIENCE, BIOMATERIALS","Score":null,"Total":0}

引用次数: 0

Abstract

Introduction

A major pitfall of many of the established oral epithelial dysplasia (OED) grading criteria is their lack of reproducibility and accuracy to predict malignant transformation. The main objective of this study was to determine whether calibration of practicing oral pathologists on OED grading could improve the reproducibility of the WHO 2017 and the binary OED grading systems.

Methods

A nationwide online exercise was carried out to determine the influence of calibration on the reproducibility of the WHO 2017 and the binary OED grading systems.

Results

A significant improvement was observed in the inter-observer agreement for the WHO 2017 OED grading system (K 0.196 vs. 0.448; K_w 0.357 vs. 0.562) after the calibration exercise. The significant difference (p = 0.027) in the level of agreement between those with five or more years and less than 5 years of experience was no more observed (p = 0.426) after the calibration exercise. The percent agreement for binary grading was significantly higher (91.8%) for buccal mucosal lesions as compared to lesions on the tongue after the calibration exercise.

Conclusion

This study validates the significance of calibration in improving the reproducibility of OED grading. The nationwide exercise resulted in a statistically significant improvement in the inter-observer agreement for the WHO 2017 OED grading system among a large number of oral pathologists. It is highly recommended that similar exercises should be organized periodically by professional bodies responsible for continuing education among oral pathologists to improve the reliability of OED grading for optimal treatment of oral potentially malignant disorders.

查看原文