Comparative Judgment for Summative Assessment in Legal Education
2023 (English)In: Assessment Reform Journeys. Intentsions, Enactment and Evaluation: Book of Abstracts, Malta, 2023, p. 75-Conference paper, Oral presentation with published abstract (Refereed)
Abstract [en]
The poster will present the outline of an ongoing findings from a study on the use of adaptive comparative judgment by examiners as a method for assessing, ranking, and grading student exams. The study aims to investigate if and how this method may support examiners in making better judgments when assessing student works for grading. In this study, approximately 300 essays will be assessed by 8 examiners using adaptive comparative judgment. These essays have already been assessed and graded using a traditional criteria-based approach with one examiner per 30 essays. These grades will serve as a point of reference for the study. The examiners using comparative judgment will use the same assessment criteria as in the traditional approach, but the essays will be assessed in pairs. In this pairwise comparison, the examiners chose which essay is better and justify their choice based on assessment criteria for each pair. Using learning analytics, the judgment of all essays will be ranked in terms of quality. The professors will then read through the ranking and try to identify the benchmarks for the lowest quality work for each grade. The benchmarking will be based on the professor’s assessment of quality considering the assessment criteria, not on a normal distribution.
Place, publisher, year, edition, pages
Malta, 2023. p. 75-
Keywords [en]
Summative Assessment, Assessment, Comparative judgment, Comparative Judgement, Adaptive Comparative Judgment, Adaptive Comparative Judgment, Legal Education, Higher education, Practitioner Based Research
Keywords [sv]
summation bedömning, bedömning, juristutbildningen, komparativ bedömning, praktiknära forskning
Keywords [no]
vurdering
National Category
Educational Sciences
Research subject
Technology and Learning
Identifiers
URN: urn:nbn:se:kth:diva-339209OAI: oai:DiVA.org:kth-339209DiVA, id: diva2:1809605
Conference
AEA-Europe '23 Association for Education Assessment Europe, 1–4 November, 2023, Malta.
Note
QC 20240208
2023-11-052023-11-052024-02-08Bibliographically approved