To Scale or not to Scale: Insights from a Study of Grade Comparability in CXC Examinations
Keywords:Academic Achievement, CXC, Grade Comparability, Standards
This study sought to ascertain the extent to which the use of statistical scaling procedures to establish comparable Grade III/IV cut scores for different examinations of the same subject resulted in cut scores that were comparable to those obtained when judgmental procedures are used. The study used data from three subjects of the Caribbean Examinations Council (CXC) where the same Grade III/IV cut scores were retained over a five-year period. Through linear transformation, the Grade III/IV cut scores for each subject were converted to scale scores on a base form. The extent to which scaling procedures validated CXC’s maintenance of the same Grade III/IV cut scores across years was considered. For all but one of the 11 cut scores considered in this study, the calculated scale scores were dissimilar from those retained by CXC. The calculated scale scores, therefore, could not be regarded as comparable to the cut scores established by CXC through the use of its judgmental procedures. However, it was found that the direction of change in the proportion candidates obtaining Grades I to III with the CXC judgmental procedures was consistent with the outcome of scaling.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).