kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
A Qualitative Study of Experienced Course Coordinators’ Perspectives on Assessment in Introductory Programming Courses for Non-CS Majors
KTH, School of Electrical Engineering and Computer Science (EECS), Computer Science, Theoretical Computer Science, TCS.ORCID iD: 0000-0002-4525-3568
KTH, School of Electrical Engineering and Computer Science (EECS), Human Centered Technology, Media Technology and Interaction Design, MID.ORCID iD: 0000-0001-5626-1187
2022 (English)In: ACM Transactions on Computing Education, E-ISSN 1946-6226, Vol. 22, no 4, p. 1-29, article id 45Article in journal (Refereed) Published
Abstract [en]

Assessment plays an important role in education, and can both guide and motivate learning. Assessment can, however, be carried out with different aims; providing the students with feedback that supports the learning (formative assessment) and judging to which degree the students have fulfilled the intended learning outcomes (summative assessment). In this study, we explore the instructors’ perspective on assessment within the context of introductory programming courses offered to non-computer science majors at a public tuition-free state-funded university in a Nordic country. These courses are given to a large number of students and also employ several teaching assistants (TAs). We used constructivism as a basis for our study and investigated how instructors implement formative and summative assessments, how they view their role, and what expectations they have of their TAs in these assessments. We interviewed seven course coordinators (main instructors for introductory programming courses with additional administrative duties but without formal responsibility of the grading) and analyzed 205 course artifacts, such as syllabi, lab assignment instructions and course material from the cross-department TA training course. The results showed that course coordinators use formative and summative assessments both separately and within the same activity. They view themselves as responsible for the assessments, as the planners and material developers, as the organizers and administrators, as well as monitors of the assessments. However, the results also showed that these course coordinators delegate much of the responsibility for the assessments to their TAs, and expect TAs to both grade the students and provide them with feedback and guidance. In addition, the TAs are also expected to act as informants about their students’ performance. The course coordinators’ role entails many different aspects, where communicating through instructions to both students and TAs are essential. We see that this implementation of assessment, with lots of responsibility distributed to the TAs, could be difficult to manage for a single faculty member who is not necessarily responsible for the grading. Based on the results, we outline some recommendations, such as offering TA training.

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM) , 2022. Vol. 22, no 4, p. 1-29, article id 45
Keywords [en]
Assessment, instructors' perceptions, CS1
National Category
Didactics
Identifiers
URN: urn:nbn:se:kth:diva-310309DOI: 10.1145/3517134ISI: 000903441500008Scopus ID: 2-s2.0-85146441570OAI: oai:DiVA.org:kth-310309DiVA, id: diva2:1647636
Note

QC 20230206

Available from: 2022-03-28 Created: 2022-03-28 Last updated: 2024-04-23Bibliographically approved
In thesis
1. Perspectives on Assessment in Introductory Computer Science Courses: Exploring and Comparing Experiences of Students, Teaching Assistants, and Course Coordinators
Open this publication in new window or tab >>Perspectives on Assessment in Introductory Computer Science Courses: Exploring and Comparing Experiences of Students, Teaching Assistants, and Course Coordinators
2022 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

Assessments of students' performances, including providing the students with feedback, are central parts of course design in higher education. These assessments can be carried out in different ways and with different purposes. The introductory programming courses (CS1) are often given to a large group of students, many of whom are non-computer science majors. To conduct the assessments and provide the students with individual feedback, teaching assistants (TAs, students with prior experience of the subject) are often employed to assist the course coordinators (main instructors) in these courses.

The practice-based research aim of this thesis is to give recommendations to course coordinators and TAs on how to integrate assessment situations in CS1 courses, aiming to be experienced as fair and valid examinations and opportunities to provide the students with useful feedback. To do so, the experiences and use of assessments within CS1 courses given to non-computer science majors, are explored from the perspective of students, TAs, and course coordinators. The three stakeholders' experiences are also compared, and to further understand the experiences, the TAs' and course coordinators' perceptions of their roles in relation to the assessments are explored. The studied assessment types include lab assignments, midterm exams, and individual final projects. 

By using a mixed-method approach with a qualitative starting point, each of the stakeholders' perspectives has been studied in detail, mostly within a Swedish context. The research uncovers the complex role of the TAs and the other stakeholders' strong dependency on them. The results suggest that each of the three studied assessment types has weaknesses and strengths that often are experienced differently by the stakeholders. This includes pitfalls with how assessment situations, designed by course coordinators to be both learning activities and graded, are challenging for the TAs to conduct. The assessments then risk being experienced by the students as unfair or dependent on the TA. Further, the results suggest that TAs face challenges related to the student-TA relationship, specifically how to handle being friends with the students they teach. The large group of students limits the course coordinators' role in the assessments, and they have a monitoring role not always visible to the students.

Recommendations for TAs and course coordinators, grounded in the research results, are presented in the thesis. Further implications from the research, in the form of TA training initiatives, are also described and evaluated as part of this thesis work.

Abstract [sv]

Bedömningar av studenters prestationer, inklusive att ge studenterna återkoppling, är centrala delar av kursutformningen inom högre utbildning. Bedömningar kan dock göras på olika sätt och med olika syften. Inledande programmeringskurser (CS1) ges ofta till en stor grupp studenter där många valt ett annat huvudämne än datavetenskap. För att kunna genomföra bedömningarna och ge studenterna individuell återkoppling, anlitas ofta lärarassistenter (studenter med tidigare erfarenhet av ämnet) som hjälper kursansvariga (huvudlärarna).

Det praktiknära forskningssyftet med denna avhandling är att ge rekommendationer till kursansvariga och assistenter om hur bedömningssituationer kan integreras i CS1-kurser, med en strävan att upplevas som både rättvisa och relevanta examinationer samt utgöra möjligheter att ge studenterna användbar återkoppling. För att kunna göra det utforskas erfarenheter och användning av bedömning i CS1-kurser, som ges till studenter som inte har valt datavetenskap som sitt huvudämne, ur studenters, assistenters och kursansvarigas perspektiv. De tre intressenternas erfarenheter jämförs också med varandra och för att ytterligare förstå erfarenheterna undersöks även assistenters och kursansvarigas syn på sina roller i relation till bedömningarna. De studerade bedömningstyperna inkluderar labbuppgifter, mittkursprov och individuella slutprojekt. 

Genom att kombinera kvalitativa och kvantitativa metoder, med en utgångspunkt i det kvalitativa, har var och en av dessa intressenters perspektiv studerats i detalj, främst i en svensk kontext. Forskningsresultaten belyser assistenternas komplexa roll och hur beroende de andra intressenterna är av dem. Resultaten tyder på att var och en av de tre studerade bedömningstyperna har svagheter och styrkor som ofta upplevs olika av intressenterna. Detta inkluderar fallgropar där bedömningssituationer, som är utformade av kursansvariga för att vara både lärandeaktiviteter och betygsätts, är utmanande för assistenterna att genomföra. Bedömningarna riskerar då att upplevas av studenterna som orättvisa eller beroende av vilken assistent som genomför dem. Vidare tyder resultaten på att assistenterna ställs inför utmaningar som är relaterade till relationen mellan student och assistent, särskilt hur assistenterna hanterar situationer där de också ser sig som vänner till studenterna. Den stora gruppen studenter begränsar kursansvarigas roll i bedömningarna och de har en mer övervakande roll som inte alltid är synlig för studenterna. 

Rekommendationer för assistenter och kursansvariga, grundade i forskningsresultaten, presenteras i avhandlingen. Ytterligare implikationer av forskningen, i form av assistentutbildningsinsatser, beskrivs och utvärderas också.

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2022. p. xix, 92
Series
TRITA-EECS-AVL ; 2022:20
Keywords
Assessment, introductory programming, CS1, teaching assistants, TAs, students, course coordinators, TA training
National Category
Didactics
Research subject
Computer Science
Identifiers
urn:nbn:se:kth:diva-310330 (URN)978-91-8040-182-1 (ISBN)
Public defence
2022-04-25, https://kth-se.zoom.us/j/66681112295, F3, Lindstedtsvägen 26, Stockholm, 14:00 (English)
Opponent
Supervisors
Note

QC 20220330

Available from: 2022-03-30 Created: 2022-03-30 Last updated: 2022-09-20Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Riese, EmmaBälter, Olle

Search in DiVA

By author/editor
Riese, EmmaBälter, Olle
By organisation
Theoretical Computer Science, TCSMedia Technology and Interaction Design, MID
In the same journal
ACM Transactions on Computing Education
Didactics

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 187 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf