kth.sePublications KTH
Change search
Link to record
Permanent link

Direct link
Publications (10 of 92) Show all publications
Bjursten, E. L., Gumaelius, L. & Hartell, E. (2025). Assessing Students’ Computer Programming Skills: How Technology Teachers in Sweden Evaluate Learning in Grades 4–6. Design and Technology Education: An International Journal, 30(3), 49-71
Open this publication in new window or tab >>Assessing Students’ Computer Programming Skills: How Technology Teachers in Sweden Evaluate Learning in Grades 4–6
2025 (English)In: Design and Technology Education: An International Journal, ISSN 1360-1431, E-ISSN 2040-8633, Vol. 30, no 3, p. 49-71Article in journal (Refereed) Published
Abstract [en]

This study aims to deepen the understanding of how computer programming is taught and assessed in Swedish schools by focusing on teachers’ perspectives. It explores how technology teachers (teaching years 4–6, students aged 10-12) perceive their roles and responsibilities in teaching computer programming, primarily within the technology subject, and examines what computer programming content is taught and assessed. The research is based on a survey and interviews with seven experienced teachers who taught computer programming before it became mandatory. The findings reveal similar views among the teachers but also significant variation in assessment practices, categorized into four distinct personas, ranging from a strong disciplinary content and product focus to a weaker disciplinary content and process orientation. The discussion reflects upon how these variations may be influenced by teachers’ backgrounds, computer programming knowledge, and unclear policy documents. The conclusions suggest that, due to this variety, Swedish students may not be equally equipped with the digital skills needed for participating in a digitalized society. To enhance equity, we argue that teachers need better preparation to effectively integrate computer programming skills across subjects. Additionally, we recommend clearer national guidelines on how to teach computer programming and how to assess this subject content in compulsory education.

Place, publisher, year, edition, pages
The Design and Technology Association, 2025
Keywords
assessment, Computer programming, pedagogical content knowledge, teacher perspective, technology education
National Category
Didactics
Identifiers
urn:nbn:se:kth:diva-375699 (URN)10.24377/DTEIJ.article3377 (DOI)2-s2.0-105026587433 (Scopus ID)
Note

QC 20260119

Available from: 2026-01-19 Created: 2026-01-19 Last updated: 2026-01-19Bibliographically approved
Egelandsdal, K., Hartell, E. & Færstad, J.-O. (2025). Exploring the practical feasibility of adaptive comparative judgment as a summative assessment method. Assessment & Evaluation in Higher Education, 50(8), 1277-1292
Open this publication in new window or tab >>Exploring the practical feasibility of adaptive comparative judgment as a summative assessment method
2025 (English)In: Assessment & Evaluation in Higher Education, ISSN 0260-2938, E-ISSN 1469-297X, Vol. 50, no 8, p. 1277-1292Article in journal (Refereed) Published
Abstract [en]

This study explores the practical feasibility of Adaptive Comparative Judgment (ACJ) as a summative assessment method in legal education, focusing on a Property and Intellectual Property Law course at a Norwegian university. Eight examiners assessed 300 student responses using ACJ within traditional time constraints, performing pairwise comparisons to rank submissions by quality. Findings reveal that examiners completed fewer comparisons than required for reliable rankings, primarily due to time management issues and workload variability. The study highlights differences in assessment strategies based on examiner experience, with less experienced examiners focusing on structural elements, such as organization and readability, and experienced examiners prioritizing legal reasoning and argument development. We critically examine the challenges inherent in translating ACJ rankings into grades and providing legally compliant justifications, given ACJ’s dependence on relative comparisons, raising important concerns about transparency, fairness, and consistency in high-stakes assessments.

Place, publisher, year, edition, pages
Taylor & Francis, 2025
Keywords
adaptive comparative judgment, summative assessment, legal education, examiner experience, bedömning, summativ bedömning, examinationer, alternativa examinationer, bedömningsformer, juristutbildning
National Category
Law Other Educational Sciences
Research subject
Technology and Learning; Education and Communication in the Technological Sciences
Identifiers
urn:nbn:se:kth:diva-364177 (URN)10.1080/02602938.2025.2511787 (DOI)001503008800001 ()2-s2.0-105007463997 (Scopus ID)
Projects
Bedre Læring, Bedre Jurister [Better Learning. Better Practicing Lawers]
Note

This work is part of the project ‘Better learning, better legal practitioners’ that was supported by the Norwegian Directorate for Higher Education and Skills under grant [AKTIV-2019/10212] at the University of Bergen, Norway.

QC 20260126

Available from: 2025-06-05 Created: 2025-06-05 Last updated: 2026-01-26Bibliographically approved
Hartell, E. (2025). Opportunities won: Unexpected encounters: Narratives from practitioner-based research.. In: John R. Dakers (Ed.), A Collection of Dreams about the Future of Technology Education.: A Festschrift in the Honour for Marc J. de Vries.. Brill Academic Publishers
Open this publication in new window or tab >>Opportunities won: Unexpected encounters: Narratives from practitioner-based research.
2025 (English)In: A Collection of Dreams about the Future of Technology Education.: A Festschrift in the Honour for Marc J. de Vries. / [ed] John R. Dakers, Brill Academic Publishers, 2025Chapter in book (Refereed)
Place, publisher, year, edition, pages
Brill Academic Publishers, 2025
Series
International Technology Education Studies ; 21
Keywords
technology education, STEM education, practitioner-based research, participatory practitioner-based research, teknikämnet, teknikdidaktik, STEM, STEM utbildning, undervisning, praktiknära, praktiknära forskning, ULF, K-ULF
National Category
Educational Sciences
Research subject
Technology and Learning; Education and Communication in the Technological Sciences
Identifiers
urn:nbn:se:kth:diva-358243 (URN)
Projects
K-ULF
Note

Part of ISBN 978-90-04-71093-1, 978-90-04-71092-4, 978-90-04-71094-8

QC 20250114

Available from: 2025-01-07 Created: 2025-01-07 Last updated: 2025-01-14Bibliographically approved
Hartell, E., Ampadu, E., Lennholm, H. & Buckley, J. (2025). Status, trends and issues of education for sustainable development (ESD) in Sweden. In: Yi-Fang Lee, Lung-Sheng Lee, Shan-Yuan Chuang (Ed.), Status, Trends and Issues ofEducation for Sustainable Development (ESD)in Highly Competitive Countries: Country Reports and International Comparison (pp. 367-414). Taiwan: Technological and Vocational Education Research Center (TVERC), National Taiwan Normal University, Taiwan
Open this publication in new window or tab >>Status, trends and issues of education for sustainable development (ESD) in Sweden
2025 (English)In: Status, Trends and Issues ofEducation for Sustainable Development (ESD)in Highly Competitive Countries: Country Reports and International Comparison / [ed] Yi-Fang Lee, Lung-Sheng Lee, Shan-Yuan Chuang, Taiwan: Technological and Vocational Education Research Center (TVERC), National Taiwan Normal University, Taiwan , 2025, p. 367-414Chapter in book (Refereed)
Abstract [en]

Sweden has established itself as a global leader in Education for Sustainable Development (ESD), integrating sustainability principles across all levels of education. The national curriculum for compulsory and higher education emphasizes key ESD competencies, including systems thinking, critical evaluation, future-oriented decision-making, collaboration, ethical awareness, and sustainable action. Sustainability is embedded across subjects and is reflected in the general approach of schools and society, with the three dimensions of sustainable development—environment, economy, and society—woven into educational practices. This is achieved through interdisciplinary curriculum integration, active student participation in sustainability projects, global and local perspectives, and continuous teacher professional development. Swedish schools have autonomy in implementing ESD, allowing educators to integrate sustainability in diverse ways. However, while initiatives such as the Whole School Approach and the Eco-School model have helped foster sustainability competencies, challenges remain. Reports indicate that ESD implementation is inconsistent, with many schools not fully utilizing the extensive support materials provided by the Swedish National Agency for Education and other stakeholders. Additionally, some ESD approaches may inadvertently reinforce gender disparities, with boys demonstrating lower engagement in sustainability topics. Despite Sweden’s strong policy framework and student-led movements such as Fridays for Future, many young Swedes do not view sustainability as a viable career pathway. This disconnect highlights the need for stronger links between sustainability education and future professional opportunities, ensuring that sustainability is not only an academic priority but a long-term societal commitment.

Place, publisher, year, edition, pages
Taiwan: Technological and Vocational Education Research Center (TVERC), National Taiwan Normal University, Taiwan, 2025
Keywords
education for sustainable development, sustainability competencies, curriculum integration, sustainability policy, student engagement, hållbar utveckling, undervisning för hållbar utveckling, ämnesintegrerad undervisning, undervisning, STEM
National Category
Social Sciences Educational Sciences Science and Technology Studies
Research subject
Education and Communication in the Technological Sciences; Technology and Learning
Identifiers
urn:nbn:se:kth:diva-368568 (URN)
Note

Part of ISBN 978-626-7545-68-3

QC 20250820

Available from: 2025-08-19 Created: 2025-08-19 Last updated: 2025-08-20Bibliographically approved
Egelandsdal, K., Hartell, E. & Færstad, J.-O. (2024). Exploring the Practicality of Adaptive Comparative Judgment as a Summative Assessment Method in Legal Education. In: Hopfenbeck, T.N. (Ed.), Advances in Educational Assessment Practices:: Considering the use of Technology, Artificial Intelligence, and Process Data for Assessment in the 21st Century. Paper presented at AEA Europe 2024. Paphos, Cyprus. 6–9 November 2024. Association for Educational Assessment– Europe
Open this publication in new window or tab >>Exploring the Practicality of Adaptive Comparative Judgment as a Summative Assessment Method in Legal Education
2024 (English)In: Advances in Educational Assessment Practices:: Considering the use of Technology, Artificial Intelligence, and Process Data for Assessment in the 21st Century / [ed] Hopfenbeck, T.N., Association for Educational Assessment– Europe , 2024Conference paper, Published paper (Refereed)
Abstract [en]

This paper presents a study on the practical application of Adaptive Comparative Judgment (ACJ) in assessing student exams within legal education at the University of Bergen, Norway. ACJ is a method used to evaluate and compare the quality of qualitative work, involves assessors judging pairs of items relative to each other. Unlike traditional assessment methods, which rely on absolute judgments, ACJ requires assessors to assess items in pairs, determining relative quality rather than absolute quality. The study examines the feasibility of integrating ACJ into existing educational frameworks, addressing key challenges such as resource allocation, grading transparency, and assessing exams with multiple tasks. Specifically, the research focuses on assessing student exams within an undergraduate course on Property and Intellectual Property Law, with a total of 300 exam papers and eight examiners participating in the study. Utilizing RM Compare as the ACJ software, each assessor was instructed to dedicate 35 hours to comparative judgment, aiming to establish a reliable rank order of the exam papers. The findings reveal several challenges associated with the practical implementation of ACJ, including issues of resource allocation, grading transparency, and the assessment of exams with multiple tasks. Potential solutions to these challenges will be discussed.

Place, publisher, year, edition, pages
Association for Educational Assessment– Europe, 2024
Keywords
assessment, comparative judgement, adaptive comparative judgement, legal education, higher education, practitioner based research, bedömning, högre utbildning, juristutbildningen, praktiknära forskning, vurdering
National Category
Educational Sciences
Research subject
Technology and Learning; Education and Communication in the Technological Sciences
Identifiers
urn:nbn:se:kth:diva-358096 (URN)
Conference
AEA Europe 2024. Paphos, Cyprus. 6–9 November 2024
Note

QC 20250114

Available from: 2025-01-07 Created: 2025-01-07 Last updated: 2025-01-14Bibliographically approved
Doyle, A., Seery, N., Gumaelius, L., Canty, D. & Hartell, E. (2024). Subject(s) matter: a grounded theory of technology teachers’ conceptions of the purpose of teaching technology. International journal of technology and design education, 34(4), 1351-1371
Open this publication in new window or tab >>Subject(s) matter: a grounded theory of technology teachers’ conceptions of the purpose of teaching technology
Show others...
2024 (English)In: International journal of technology and design education, ISSN 0957-7572, E-ISSN 1573-1804, Vol. 34, no 4, p. 1351-1371Article in journal (Refereed) Published
Abstract [en]

Technology education internationally has for some time struggled to achieve continuity between what is depicted in policy and curricular documents and the reality of day-to-day practices. With its focus often articulated through the nature of activity students are to engage with, technology teachers are recognised as having significant autonomy in the design and implementation of their practices. From this, it is important to understand teachers’ beliefs about technology education, as their conceptions of the subject will inform practice. As such, this study sought to investigate teachers’ conceptions of the purpose of teaching technology through reflection on their enacted practices. A constructivist grounded theory methodology was employed for the design of the study and analysis of data. According to our analysis, despite similarities between the nature of student activity that teachers designed and implemented, teachers represented the purpose of the subject in different ways. Three different conceptions of the purpose of teaching technology were identified; obtaining knowledge and skills for application, ability to act in a technological way, and ability to think in a technological way. Central to the three conceptions were contentions in the representations of what constituted subject matter knowledge in the subject, and the role that different application cases played in teaching technology. Without consideration and explicit articulation of the purposes for teaching technology, this lack of clarity and differences in rationale for teaching technology are likely to continue.

Place, publisher, year, edition, pages
Springer Nature, 2024
Keywords
technology education, engineering education
National Category
Educational Sciences
Research subject
Technology and Learning
Identifiers
urn:nbn:se:kth:diva-338808 (URN)10.1007/s10798-023-09859-1 (DOI)001088119700001 ()2-s2.0-85174545347 (Scopus ID)
Note

QC 20260108

Available from: 2023-10-26 Created: 2023-10-26 Last updated: 2026-01-08Bibliographically approved
Hartell, E. (2023). Assessing: Getting feedback back on track in technology education (1ed.). In: Gill, D., Irving-Bell, D., McLain, M., Wooff, D. (Ed.), The Bloomsbury Handbook of Technology Education: (pp. 170-187). London: Bloomsbury Academic
Open this publication in new window or tab >>Assessing: Getting feedback back on track in technology education
2023 (English)In: The Bloomsbury Handbook of Technology Education / [ed] Gill, D., Irving-Bell, D., McLain, M., Wooff, D., London: Bloomsbury Academic, 2023, 1, p. 170-187Chapter in book (Refereed)
Place, publisher, year, edition, pages
London: Bloomsbury Academic, 2023 Edition: 1
Keywords
technology education, feedback, engineering education, formative assessment, educational assessment, assessment, assessing, teknikdidaktik, feedback, återkoppling, respons, formativ bedömning, bedömning, pedagogisk bedömning
National Category
Educational Sciences
Research subject
Technology and Learning; Education and Communication in the Technological Sciences
Identifiers
urn:nbn:se:kth:diva-328171 (URN)10.5040/9781350238442.0021 (DOI)
Note

Part of book: ISBN 978-1-3502-3841-1, QC 20230612

Available from: 2023-06-02 Created: 2023-06-02 Last updated: 2023-06-12Bibliographically approved
Hartell, E. (2023). Assessing: How to Get Feedback Back on Track in Technology Education. In: The Bloomsbury Handbook of Technology Education: (pp. 170-187). Bloomsbury Publishing Plc.
Open this publication in new window or tab >>Assessing: How to Get Feedback Back on Track in Technology Education
2023 (English)In: The Bloomsbury Handbook of Technology Education, Bloomsbury Publishing Plc. , 2023, p. 170-187Chapter in book (Other academic)
Place, publisher, year, edition, pages
Bloomsbury Publishing Plc., 2023
National Category
Pedagogy
Identifiers
urn:nbn:se:kth:diva-350010 (URN)2-s2.0-85188370281 (Scopus ID)
Note

Part of ISBN 9781350238428, 9781350238411

QC 20240704

Available from: 2024-07-04 Created: 2024-07-04 Last updated: 2024-07-04Bibliographically approved
Egelandsdal, K. & Hartell, E. (2023). Comparative Judgment for Summative Assessment in Legal Education. In: Assessment Reform Journeys. Intentsions, Enactment and Evaluation: Book of Abstracts. Paper presented at AEA-Europe '23 Association for Education Assessment Europe, 1–4 November, 2023, Malta. (pp. 75). Malta
Open this publication in new window or tab >>Comparative Judgment for Summative Assessment in Legal Education
2023 (English)In: Assessment Reform Journeys. Intentsions, Enactment and Evaluation: Book of Abstracts, Malta, 2023, p. 75-Conference paper, Oral presentation with published abstract (Refereed)
Abstract [en]

The poster will present the outline of an ongoing findings from a study on the use of adaptive comparative judgment by examiners as a method for assessing, ranking, and grading student exams. The study aims to investigate if and how this method may support examiners in making better judgments when assessing student works for grading. In this study, approximately 300 essays will be assessed by 8 examiners using adaptive comparative judgment. These essays have already been assessed and graded using a traditional criteria-based approach with one examiner per 30 essays. These grades will serve as a point of reference for the study. The examiners using comparative judgment will use the same assessment criteria as in the traditional approach, but the essays will be assessed in pairs. In this pairwise comparison, the examiners chose which essay is better and justify their choice based on assessment criteria for each pair. Using learning analytics, the judgment of all essays will be ranked in terms of quality. The professors will then read through the ranking and try to identify the benchmarks for the lowest quality work for each grade. The benchmarking will be based on the professor’s assessment of quality considering the assessment criteria, not on a normal distribution. 

Place, publisher, year, edition, pages
Malta: , 2023
Keywords
Summative Assessment, Assessment, Comparative judgment, Comparative Judgement, Adaptive Comparative Judgment, Adaptive Comparative Judgment, Legal Education, Higher education, Practitioner Based Research, summation bedömning, bedömning, juristutbildningen, komparativ bedömning, praktiknära forskning, vurdering
National Category
Educational Sciences
Research subject
Technology and Learning
Identifiers
urn:nbn:se:kth:diva-339209 (URN)
Conference
AEA-Europe '23 Association for Education Assessment Europe, 1–4 November, 2023, Malta.
Note

QC 20240208

Available from: 2023-11-05 Created: 2023-11-05 Last updated: 2024-02-08Bibliographically approved
Egelandsdal, K. & Hartell, E. (2023). Comparative Judgment vs. Criteria-based Assessment in Legal Education. In: Assessment Reform Journeys. Intentions, Enactment and Evaluation: Book of Abstracts. Paper presented at aea-Europe '23 Association for Educational Assessment, 1–4 November 2023, Malta (pp. 74). Malta: Association for Educational Assessment Europe
Open this publication in new window or tab >>Comparative Judgment vs. Criteria-based Assessment in Legal Education
2023 (English)In: Assessment Reform Journeys. Intentions, Enactment and Evaluation: Book of Abstracts, Malta: Association for Educational Assessment Europe , 2023, p. 74-Conference paper, Oral presentation with published abstract (Refereed)
Abstract [en]

The poster will present findings on the formative use of comparative judgment and criteria-based assessment in a course on administrative law as part of a master's program in legal education. Students used the two assessment approaches to assess the quality of administrative decisions. A student population of 300 was divided into two cohorts and given six administrative decisions of varying quality to assess. One cohort assessed the decisions using a comparative judgment approach, and the other used a criteria-based assessment. In both cases, the students assessed the legal decisions focusing on a) method, b) language, and c) content and ranked them from best to worst. Before the assessment activity, the students had practiced writing administrative decisions on their own and participated in a lecture that prepared them for the assessment activities. After the assessment activity, the students discussed the quality of the decisions they had assessed in groups with participants from both cohorts. The focus of the study was to investigate whether and how the students experienced the two assessment approaches contributed to developing their understanding of quality in administrative decisions. Data was collected through a student survey and the student ranking of the legal decisions.

Place, publisher, year, edition, pages
Malta: Association for Educational Assessment Europe, 2023
Keywords
Formative Assessment, Assessment, Comparative judgment, Comparative Judgement, Adaptive Comparative Judgment, Adaptive Comparative Judgment, Legal Education, Higher education, Practitioner Based Research, Formativ bedömning, bedömning, juristutbildningen, praktiknära forskning, vurdering, formativ vurdering, jurist
National Category
Educational Sciences
Research subject
Technology and Learning
Identifiers
urn:nbn:se:kth:diva-339208 (URN)
Conference
aea-Europe '23 Association for Educational Assessment, 1–4 November 2023, Malta
Note

QC 20231106

Available from: 2023-11-05 Created: 2023-11-05 Last updated: 2023-11-06Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-8889-2562

Search in DiVA

Show all publications