{"title":"生物化学蓝图:本科医学教育的系统评估","authors":"Y. Pawade, Anita Chalak, D. Pawade","doi":"10.34172/rdme.2022.022","DOIUrl":null,"url":null,"abstract":"Background: The traditional pattern of theory assessment may not address the principles of assessment due to faulty paper-setting practices. This interventional study aimed to sensitize the faculty in designing a test blueprint template to set question papers (QPs). The set QPs were reviewed by experts to evaluate the effectiveness of blueprinting in the quality of the QPs. Methods: Based on the validated weightage of the biochemistry syllabus, each of the 10 faculty prepared a test blueprint, and set theory QPs without and with those test blueprints. The QPs were blinded and randomly allocated to 9 experts for evaluation. The test paper review score and feedback from both faculty and subject experts were statistically analyzed. Results: Reliability check of faculty feedback and review checklist of test papers validated its internal consistency. In all, 95% of participants expressed their agreement with various attributes of blueprinting and its future application in assessment. Statistically significant improvement (P<0.005) was observed in the overall quality of the QPs with blueprinting. Conclusion: It was determined that blueprinting aligns objectives, content areas, and curriculum with assessment, thus improving reliability and content validity. Validated weightage of the biochemistry syllabus and blueprints for written examination were systematized.","PeriodicalId":21087,"journal":{"name":"Research and Development in Medical Education","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2022-12-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Blueprints in biochemistry: Systematic assessment in undergraduate medical education\",\"authors\":\"Y. Pawade, Anita Chalak, D. Pawade\",\"doi\":\"10.34172/rdme.2022.022\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Background: The traditional pattern of theory assessment may not address the principles of assessment due to faulty paper-setting practices. This interventional study aimed to sensitize the faculty in designing a test blueprint template to set question papers (QPs). The set QPs were reviewed by experts to evaluate the effectiveness of blueprinting in the quality of the QPs. Methods: Based on the validated weightage of the biochemistry syllabus, each of the 10 faculty prepared a test blueprint, and set theory QPs without and with those test blueprints. The QPs were blinded and randomly allocated to 9 experts for evaluation. The test paper review score and feedback from both faculty and subject experts were statistically analyzed. Results: Reliability check of faculty feedback and review checklist of test papers validated its internal consistency. In all, 95% of participants expressed their agreement with various attributes of blueprinting and its future application in assessment. Statistically significant improvement (P<0.005) was observed in the overall quality of the QPs with blueprinting. Conclusion: It was determined that blueprinting aligns objectives, content areas, and curriculum with assessment, thus improving reliability and content validity. Validated weightage of the biochemistry syllabus and blueprints for written examination were systematized.\",\"PeriodicalId\":21087,\"journal\":{\"name\":\"Research and Development in Medical Education\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-12-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Research and Development in Medical Education\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.34172/rdme.2022.022\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Research and Development in Medical Education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.34172/rdme.2022.022","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Blueprints in biochemistry: Systematic assessment in undergraduate medical education
Background: The traditional pattern of theory assessment may not address the principles of assessment due to faulty paper-setting practices. This interventional study aimed to sensitize the faculty in designing a test blueprint template to set question papers (QPs). The set QPs were reviewed by experts to evaluate the effectiveness of blueprinting in the quality of the QPs. Methods: Based on the validated weightage of the biochemistry syllabus, each of the 10 faculty prepared a test blueprint, and set theory QPs without and with those test blueprints. The QPs were blinded and randomly allocated to 9 experts for evaluation. The test paper review score and feedback from both faculty and subject experts were statistically analyzed. Results: Reliability check of faculty feedback and review checklist of test papers validated its internal consistency. In all, 95% of participants expressed their agreement with various attributes of blueprinting and its future application in assessment. Statistically significant improvement (P<0.005) was observed in the overall quality of the QPs with blueprinting. Conclusion: It was determined that blueprinting aligns objectives, content areas, and curriculum with assessment, thus improving reliability and content validity. Validated weightage of the biochemistry syllabus and blueprints for written examination were systematized.