{"title":"Inter-observer agreement on levels of evidence in radiology articles","authors":"C. García-Villar , J.M. Plasencia-Martínez , M.T. Gutiérrez-Amares , J.M. García-Santos","doi":"10.1016/j.rxeng.2023.08.001","DOIUrl":null,"url":null,"abstract":"<div><p><span>Levels of evidence (LE) are established through a hierarchical classification of studies according to their design. At present, there are many heterogeneous LE classifications, and this hampers their applicability. Our study aims to identify which LE classification has the best interobserver concordance for radiology<span> articles. For this purpose, an interobserver agreement analysis were performed on 105 original articles applying two NE scales (Oxford Center of Evidence Based Medicine<span> (OCEBM) y National Health and Medical Research Council (NHMRC)). The inter-rater agreement of the LE assigned after reading the abstracts was good when using the OCEBM scale (</span></span></span><em>K</em> = 0.679), and somewhat lower with the NHMRC (<em>K</em> = 0.577 -moderate-). All differences were statistically significant (<em>P</em> < .000). So, in conclusion, of the two scales analysed (OCEBM and NHMRC), the OCEBM led to the strongest level of inter-rater agreement.</p></div>","PeriodicalId":94185,"journal":{"name":"Radiologia","volume":"65 6","pages":"Pages 573-576"},"PeriodicalIF":0.0000,"publicationDate":"2023-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Radiologia","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2173510723001325","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Levels of evidence (LE) are established through a hierarchical classification of studies according to their design. At present, there are many heterogeneous LE classifications, and this hampers their applicability. Our study aims to identify which LE classification has the best interobserver concordance for radiology articles. For this purpose, an interobserver agreement analysis were performed on 105 original articles applying two NE scales (Oxford Center of Evidence Based Medicine (OCEBM) y National Health and Medical Research Council (NHMRC)). The inter-rater agreement of the LE assigned after reading the abstracts was good when using the OCEBM scale (K = 0.679), and somewhat lower with the NHMRC (K = 0.577 -moderate-). All differences were statistically significant (P < .000). So, in conclusion, of the two scales analysed (OCEBM and NHMRC), the OCEBM led to the strongest level of inter-rater agreement.