kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Comparative Judgment for Summative Assessment in Legal Education
Universitetet i Bergen, Bergen, Norway.ORCID iD: 0000-0003-2301-4563
KTH, School of Industrial Engineering and Management (ITM), Learning, Learning in Stem.ORCID iD: 0000-0002-8889-2562
2023 (English)In: Assessment Reform Journeys. Intentsions, Enactment and Evaluation: Book of Abstracts, Malta, 2023, p. 75-Conference paper, Oral presentation with published abstract (Refereed)
Abstract [en]

The poster will present the outline of an ongoing findings from a study on the use of adaptive comparative judgment by examiners as a method for assessing, ranking, and grading student exams. The study aims to investigate if and how this method may support examiners in making better judgments when assessing student works for grading. In this study, approximately 300 essays will be assessed by 8 examiners using adaptive comparative judgment. These essays have already been assessed and graded using a traditional criteria-based approach with one examiner per 30 essays. These grades will serve as a point of reference for the study. The examiners using comparative judgment will use the same assessment criteria as in the traditional approach, but the essays will be assessed in pairs. In this pairwise comparison, the examiners chose which essay is better and justify their choice based on assessment criteria for each pair. Using learning analytics, the judgment of all essays will be ranked in terms of quality. The professors will then read through the ranking and try to identify the benchmarks for the lowest quality work for each grade. The benchmarking will be based on the professor’s assessment of quality considering the assessment criteria, not on a normal distribution. 

Place, publisher, year, edition, pages
Malta, 2023. p. 75-
Keywords [en]
Summative Assessment, Assessment, Comparative judgment, Comparative Judgement, Adaptive Comparative Judgment, Adaptive Comparative Judgment, Legal Education, Higher education, Practitioner Based Research
Keywords [sv]
summation bedömning, bedömning, juristutbildningen, komparativ bedömning, praktiknära forskning
Keywords [no]
vurdering
National Category
Educational Sciences
Research subject
Technology and Learning
Identifiers
URN: urn:nbn:se:kth:diva-339209OAI: oai:DiVA.org:kth-339209DiVA, id: diva2:1809605
Conference
AEA-Europe '23 Association for Education Assessment Europe, 1–4 November, 2023, Malta.
Note

QC 20240208

Available from: 2023-11-05 Created: 2023-11-05 Last updated: 2024-02-08Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

AEA Europe 2023 Book of Abstracts

Authority records

Hartell, Eva

Search in DiVA

By author/editor
Egelandsdal, KjetilHartell, Eva
By organisation
Learning in Stem
Educational Sciences

Search outside of DiVA

GoogleGoogle Scholar

urn-nbn

Altmetric score

urn-nbn
Total: 66 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf