Understanding peer feedback contributions using natural language processingShow others and affiliations
2023 (English)In: Responsive and sustainable educational futures: 18th european conference on technology enhanced learning, EC-TEL 2023, proceedings, Springer Nature , 2023, p. 399-414Conference paper, Published paper (Refereed)
Abstract [en]
Peer feedback has been widely used in computer-supported collaborative learning (CSCL) setting to improve students’ engagement with massive courses. Although the peer feedback process increases students’ self-regulatory practice, metacognition, and academic achievement, instructors need to go through large amounts of feedback text data which is much more time-consuming. To address this challenge, the present study proposes an automated content analysis approach to identify relevant categories in peer feedback based on traditional and sequence-based classifiers using TF-IDF and content-independent features. We use a data set from an extensive course (N = 231 students) in the setting of engineering higher education. In particular, a total of 2,444 peer feedback messages were analyzed. The CRF classification model based on the TF-IDF features achieved the best performance. The results illustrate that the ability to scale up the automatic analysis of peer feedback provides new opportunities for student-improved learning and improved teacher support in higher education at scale.
Place, publisher, year, edition, pages
Springer Nature , 2023. p. 399-414
Keywords [en]
Computer Supported Collaborative Learning, Content Analysis, Higher Education, Natural Language Processing, Peer Feedback
National Category
Pedagogy
Identifiers
URN: urn:nbn:se:kth:diva-337822DOI: 10.1007/978-3-031-42682-7_27ISI: 001351067800027Scopus ID: 2-s2.0-85172010223OAI: oai:DiVA.org:kth-337822DiVA, id: diva2:1803576
Conference
Proceedings of the 18th European Conference on Technology Enhanced Learning, ECTEL 2023, Aveiro, Portugal, Sep 4 - Sep 8 2023
Note
Part of ISBN 978-303142681-0
QC 20241209
2023-10-092023-10-092024-12-09Bibliographically approved