Objectives: Microlaryngoscopy and bronchoscopy (MLB) are essential tools for evaluating airway inflammation, but the reliability of endoscopic assessments for this purpose remains unclear. The aim of this study was to assess surgeons' interrater reliability during endoscopic assessment of airway inflammation. The endoscopic factors used to determine overall airway inflammation were also assessed.
Methods: We conducted a cross-sectional study involving 24 pediatric patients who underwent MLB and arytenoid biopsy. Surgeons rated airway inflammation based on endoscopic images, and interrater reliability was assessed using Fleiss' Kappa.
Results: Fleiss's Kappa demonstrated poor interrater reliability among all surgeons (0.111) and experienced surgeons (0.117). Surgeons varied in prioritizing visual features for assessing inflammation.
Conclusion: Current subjective assessments of airway inflammation during MLB exhibit poor interrater reliability, necessitating further research for improved diagnostic accuracy and informed treatment decisions in pediatric airway interventions.
Level of evidence: Level 3 Laryngoscope, 2024.