{"title":"Use of the MERSQI to Evaluate ABFM Journal Club Articles","authors":"Katherine Wright, S. Wheat, Zahra Qasem","doi":"10.1370/afm.21.s1.4073","DOIUrl":null,"url":null,"abstract":"Context: To augment our research curriculum, our three family medicine residency programs participated in the American Board of Family Medicine (ABFM) Journal Club Pilot. We implemented the Medical Education Research Study Quality Instrument (MERSQI) to score journal articles and identify potential curriculum gaps. Objective: 1) summarize the body of literature included in the ABFM Journal Club Pilot by scoring each article for methodological quality; 2) identify research curriculum strengths and areas for growth Study Design: A bibliometric analysis was conducted to examine the methodologic quality of research studies included in the ABFM Journal Club Pilot. Additionally, we surveyed residents to document their confidence critically appraising journal articles. Dataset: MERSQI quality scores were calculated for 40 studies published in 25 journals selected by the ABFM. Intervention/Instrument: The 10-item MERSQI was used to assess methodological quality across six domains: study design, sampling (number of institutions and response rate), type of data, validity (internal structure, content, and relationships to other variables), data analysis (appropriateness and complexity), and outcomes. Previous studies document strong validity evidence for the MERSQI. The resident survey included 12 Likert scale items measuring confidence appraising different elements of journal club articles (e.g. interpreting confidence intervals, statistical power, etc.). Results: MERSQI scores ranged from 13 to 18, with the average being 16.31 (higher scores indicate higher quality). A majority of articles (80%) implemented a randomized control trial. Most articles (82%) with a survey had a response rate of 75% or above. Most studies were multi-institutional (90%) and presented objective measurements (87.2%) as opposed to self-assessment data alone (12.8%). At baseline before implementing the journal club pilot, a majority of residents indicated they had none or minimal experience evaluating journal articles (n=22, 52.4%). Conclusions: On average, ABFM journal club articles had relatively high MERSQI scores compared to other bibliometric","PeriodicalId":47994,"journal":{"name":"Education and Training","volume":null,"pages":null},"PeriodicalIF":3.2000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Education and Training","FirstCategoryId":"91","ListUrlMain":"https://doi.org/10.1370/afm.21.s1.4073","RegionNum":3,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0
Abstract
Context: To augment our research curriculum, our three family medicine residency programs participated in the American Board of Family Medicine (ABFM) Journal Club Pilot. We implemented the Medical Education Research Study Quality Instrument (MERSQI) to score journal articles and identify potential curriculum gaps. Objective: 1) summarize the body of literature included in the ABFM Journal Club Pilot by scoring each article for methodological quality; 2) identify research curriculum strengths and areas for growth Study Design: A bibliometric analysis was conducted to examine the methodologic quality of research studies included in the ABFM Journal Club Pilot. Additionally, we surveyed residents to document their confidence critically appraising journal articles. Dataset: MERSQI quality scores were calculated for 40 studies published in 25 journals selected by the ABFM. Intervention/Instrument: The 10-item MERSQI was used to assess methodological quality across six domains: study design, sampling (number of institutions and response rate), type of data, validity (internal structure, content, and relationships to other variables), data analysis (appropriateness and complexity), and outcomes. Previous studies document strong validity evidence for the MERSQI. The resident survey included 12 Likert scale items measuring confidence appraising different elements of journal club articles (e.g. interpreting confidence intervals, statistical power, etc.). Results: MERSQI scores ranged from 13 to 18, with the average being 16.31 (higher scores indicate higher quality). A majority of articles (80%) implemented a randomized control trial. Most articles (82%) with a survey had a response rate of 75% or above. Most studies were multi-institutional (90%) and presented objective measurements (87.2%) as opposed to self-assessment data alone (12.8%). At baseline before implementing the journal club pilot, a majority of residents indicated they had none or minimal experience evaluating journal articles (n=22, 52.4%). Conclusions: On average, ABFM journal club articles had relatively high MERSQI scores compared to other bibliometric
期刊介绍:
Education + Training addresses the increasingly complex relationships between education, training and employment and the impact of these relationships on national and global labour markets. The journal gives specific consideration to young people, looking at how the transition from school/college to employment is achieved and how the nature of partnerships between the worlds of education and work continues to evolve. The journal explores vocationalism in learning and efforts to address employability within the curriculum, together with coverage of innovative themes and initiatives within vocational education and training. The journal is read by policy makers, educators and academics working in a wide range of fields including education, learning and skills development, enterprise and entrepreneurship education and training, induction and career development. Coverage: Managing the transition from school/college to work New initiatives in post 16 vocational education and training Education-Business partnerships and collaboration Links between education and industry The graduate labour market Work experience and placements The recruitment, induction and development of school leavers and graduates Young person employability and career development E learning in further and higher education Research news Reviews of recent publications.