William T Malouf, Geeth Kondaveeti, Jacline G Phillips, Kunjan Patel, Justin A Hall, Torrey L Fourrier, Nelson May, Nuwan T Meegalla, Kevin J Reger, Christopher M Runyan, Kevin D Hiatt
{"title":"Facial trauma education in radiology: using surgeon feedback as the benchmark for success.","authors":"William T Malouf, Geeth Kondaveeti, Jacline G Phillips, Kunjan Patel, Justin A Hall, Torrey L Fourrier, Nelson May, Nuwan T Meegalla, Kevin J Reger, Christopher M Runyan, Kevin D Hiatt","doi":"10.1007/s10140-024-02288-0","DOIUrl":null,"url":null,"abstract":"<p><strong>Rationale and objectives: </strong>Interpreting CT studies of facial trauma is challenging, and there are often substantial differences in the characterization of complex facial trauma between radiologists and surgeons. We designed a collaborative multidisciplinary project to reconcile differences in facial fracture interpretation through an educational intervention. The effectiveness of this intervention was evaluated through surgeon feedback on radiology reports.</p><p><strong>Materials and methods: </strong>Radiology residents, neuroradiology fellows, and neuroradiology attendings were recruited as participants at a single tertiary care academic center. Otolaryngology residents were recruited as evaluators. Participants completed surveys and provided preliminary reports for example cases of facial trauma before and after attending an educational session. Evaluators performed a blinded review of these preliminary reports based on ideal reports developed by surgical and neuroradiology attendings.</p><p><strong>Results: </strong>26 participants (20 residents, 1 neuroradiology fellow, 5 neuroradiology attendings) completed the study. Six otolaryngology residents participated as evaluators. To assess interrater reliability, three evaluators graded a shared set of 15 reports and demonstrated substantial agreement with a Kendall's W of 0.71. Participants demonstrated significant improvement in overall report accuracy, clarity, and organization. In subunit analysis, there were significant improvements in reporting Le Fort, nasoseptal, and nasoorbitoethmoid fractures. No significant improvements occurred in the reporting of upper face, zygomaticomaxillary complex, or mandibular fractures. In contrast, survey analysis demonstrated significantly improved confidence in interpreting trauma involving all facial subunits.</p><p><strong>Conclusion: </strong>Compared with survey results, surgeon assessment of radiology reports better demonstrated areas of improvement after an educational intervention. A multidisciplinary approach to assessing educational efforts may better evaluate the practical effectiveness of educational interventions.</p>","PeriodicalId":11623,"journal":{"name":"Emergency Radiology","volume":" ","pages":""},"PeriodicalIF":1.7000,"publicationDate":"2024-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Emergency Radiology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/s10140-024-02288-0","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
引用次数: 0
Abstract
Rationale and objectives: Interpreting CT studies of facial trauma is challenging, and there are often substantial differences in the characterization of complex facial trauma between radiologists and surgeons. We designed a collaborative multidisciplinary project to reconcile differences in facial fracture interpretation through an educational intervention. The effectiveness of this intervention was evaluated through surgeon feedback on radiology reports.
Materials and methods: Radiology residents, neuroradiology fellows, and neuroradiology attendings were recruited as participants at a single tertiary care academic center. Otolaryngology residents were recruited as evaluators. Participants completed surveys and provided preliminary reports for example cases of facial trauma before and after attending an educational session. Evaluators performed a blinded review of these preliminary reports based on ideal reports developed by surgical and neuroradiology attendings.
Results: 26 participants (20 residents, 1 neuroradiology fellow, 5 neuroradiology attendings) completed the study. Six otolaryngology residents participated as evaluators. To assess interrater reliability, three evaluators graded a shared set of 15 reports and demonstrated substantial agreement with a Kendall's W of 0.71. Participants demonstrated significant improvement in overall report accuracy, clarity, and organization. In subunit analysis, there were significant improvements in reporting Le Fort, nasoseptal, and nasoorbitoethmoid fractures. No significant improvements occurred in the reporting of upper face, zygomaticomaxillary complex, or mandibular fractures. In contrast, survey analysis demonstrated significantly improved confidence in interpreting trauma involving all facial subunits.
Conclusion: Compared with survey results, surgeon assessment of radiology reports better demonstrated areas of improvement after an educational intervention. A multidisciplinary approach to assessing educational efforts may better evaluate the practical effectiveness of educational interventions.
期刊介绍:
To advance and improve the radiologic aspects of emergency careTo establish Emergency Radiology as an area of special interest in the field of diagnostic imagingTo improve methods of education in Emergency RadiologyTo provide, through formal meetings, a mechanism for presentation of scientific papers on various aspects of Emergency Radiology and continuing educationTo promote research in Emergency Radiology by clinical and basic science investigators, including residents and other traineesTo act as the resource body on Emergency Radiology for those interested in emergency patient care Members of the American Society of Emergency Radiology (ASER) receive the Emergency Radiology journal as a benefit of membership!