kth.sePublications KTH
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Exploring the Practicality of Adaptive Comparative Judgment as a Summative Assessment Method in Legal Education
Universitetet i Bergen.ORCID iD: 0000-0003-2301-4563
KTH, School of Industrial Engineering and Management (ITM), Learning, Learning in Stem. (Leeap, K-ULF)ORCID iD: 0000-0002-8889-2562
Universitetet i Bergen.
2024 (English)In: Advances in Educational Assessment Practices:: Considering the use of Technology, Artificial Intelligence, and Process Data for Assessment in the 21st Century / [ed] Hopfenbeck, T.N., Association for Educational Assessment– Europe , 2024Conference paper, Published paper (Refereed)
Abstract [en]

This paper presents a study on the practical application of Adaptive Comparative Judgment (ACJ) in assessing student exams within legal education at the University of Bergen, Norway. ACJ is a method used to evaluate and compare the quality of qualitative work, involves assessors judging pairs of items relative to each other. Unlike traditional assessment methods, which rely on absolute judgments, ACJ requires assessors to assess items in pairs, determining relative quality rather than absolute quality. The study examines the feasibility of integrating ACJ into existing educational frameworks, addressing key challenges such as resource allocation, grading transparency, and assessing exams with multiple tasks. Specifically, the research focuses on assessing student exams within an undergraduate course on Property and Intellectual Property Law, with a total of 300 exam papers and eight examiners participating in the study. Utilizing RM Compare as the ACJ software, each assessor was instructed to dedicate 35 hours to comparative judgment, aiming to establish a reliable rank order of the exam papers. The findings reveal several challenges associated with the practical implementation of ACJ, including issues of resource allocation, grading transparency, and the assessment of exams with multiple tasks. Potential solutions to these challenges will be discussed.

Place, publisher, year, edition, pages
Association for Educational Assessment– Europe , 2024.
Keywords [en]
assessment, comparative judgement, adaptive comparative judgement, legal education, higher education, practitioner based research
Keywords [sv]
bedömning, högre utbildning, juristutbildningen, praktiknära forskning
Keywords [no]
vurdering
National Category
Educational Sciences
Research subject
Technology and Learning; Education and Communication in the Technological Sciences
Identifiers
URN: urn:nbn:se:kth:diva-358096OAI: oai:DiVA.org:kth-358096DiVA, id: diva2:1924582
Conference
AEA Europe 2024. Paphos, Cyprus. 6–9 November 2024
Note

QC 20250114

Available from: 2025-01-07 Created: 2025-01-07 Last updated: 2025-01-14Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

AEA2024 Book of Abstracts

Authority records

Hartell, Eva

Search in DiVA

By author/editor
Egelandsdal, KjetilHartell, Eva
By organisation
Learning in Stem
Educational Sciences

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 95 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf