Citation
Mok, J. C. H., & Toh, A. A. L. (2015). Improving the Ability of Qualitative Assessments to Discriminate Student Achievement Levels. Journal of International Education in Business, 8(1), 49–58. https://doi.org/10.1108/JIEB-12-2013-0048
Abstract
Purpose: This paper aims to investigate the use of blind marking to increase the ability of criterion-referenced marking to discriminate students' varied levels of knowledge and skill mastery in a business communication skills course. Design/methodology/approach: The business communication course in this study involved more than 10 teachers and 350 students each semester. Data were collected from four semesters of assignment grades to compare the distribution of grades in semesters that used blind marking and in the one that did not (the control group). The standard deviations of marks for each assignment were calculated and compared. Findings: Findings show that blind marking contributed to a wider spread of marks. The study concludes that blind marking, when implemented together with criterion-referenced marking rubrics, can improve the ability of qualitative assessments to discriminate student achievement levels. Originality/value: Research in the use of criterion-referenced marking rubrics has revealed that assessing with marking rubrics resulted in a wider range of marks awarded because assessors felt that the rubrics helped them make more objective judgments of students' work (Kuisma, 1999). By this token, it could be argued that because blind marking allows more objective judgment of students' work (by reducing rater bias), it seems to reason that marks might be awarded on a wider range of the marking scale. However, current literature on blind marking and grade/mark dispersion has yet to reveal a study on whether blind marking is able to increase the spread of marks, and therefore, indicate that an assessment instrument is effective is discriminating a range of student achievement levels. This paper should add to the current research on higher quality of educational assessments.