Using Mantel-Haenszel, Distractor Response, and Logical Data Analyses in Detecting Differential Item Functioning in a Senior Science High School Entrance Examination

Abstract

ABSTRACT Diana Lou E. Sipalay University of the Philippines Diliman, College of Education Diliman, Quezon City, NCR, Philippines desipalay@up.edu.ph Jose Q. Pedrajita University of the Philippines Diliman, College of Education Diliman, Quezon City, NCR, Philippines jqpedrajita@up.edu.ph This study detected Differential Item Functioning (DIF) and its causes (gender-based, curriculum-based and school-based) in a Senior Science High School Entrance Examination using Mantel Haenszel, Distractor Response and Logical Data Analyses employing focus group discussions, semi-structured interviews and questionnaires. The DIF detecting methods revealed the presence of gender, curriculum and school biases across subtests. The causes of DIF were difference in the span of focus and interest, test sophistication, use of jargon, availability of materials in school, activity exposure, curriculum difference and teacher quality. Items with DIF, regardless of the group membership of examinees, with unreasonable difficulty that unfavorably affected the test performance of the students, were recommended for replacement or revision; for students to be assessed properly using tests with reviewed, evaluated and improved items. KEYWORDS: Mantel-Haenszel Procedure, Distractor Response Analysis, Logical Data Analysis, Entrance Examination, Science High School, Senior High School