kth.sePublications
System disruptions
We are currently experiencing disruptions on the search portals due to high traffic. We are working to resolve the issue, you may temporarily encounter an error message.
Change search
Link to record
Permanent link

Direct link
Publications (10 of 32) Show all publications
Izu, C., Mirolo, C., Börstler, J., Connamacher, H., Crosby, R., Glassey, R., . . . Shah, A. (2025). Introducing Code Quality at CS1 Level: Examples and Activities. In: ITiCSE WGR 2024 - Publication of the 2024 Working Group Reports on Innovation and Technology in Computer Science Education: . Paper presented at 29th Working Group Reports on Innovation and Technology in Computer Science Education, ITiCSE WGR 2024, Milan, Italy, Jul 8 2024 - Jul 10 2024 (pp. 339-377). Association for Computing Machinery (ACM)
Open this publication in new window or tab >>Introducing Code Quality at CS1 Level: Examples and Activities
Show others...
2025 (English)In: ITiCSE WGR 2024 - Publication of the 2024 Working Group Reports on Innovation and Technology in Computer Science Education, Association for Computing Machinery (ACM) , 2025, p. 339-377Conference paper, Published paper (Refereed)
Abstract [en]

Characterising code quality is a challenge that was addressed by a previous ITiCSE Working Group (Börstler et al., 2017). As emerged from that study, educators, developers, and students have different perceptions of the aspects involved. The perception of code quality by CS1 students develops from the feedback they receive when submitting practical work. As a consequence of increasingly large classes and the widespread use of autograders, student code is predominantly assessed based on functional correctness, emphasising a machine-oriented perspective with scarce or no feedback given about human-oriented aspects of code quality. Such limited perception of code quality may negatively impact how students understand, create, and interact with code artefacts. Although Börstler et al. concluded that "code quality should be discussed more thoroughly in educational programs", the lack of materials and time constraints have slowed down progress in that regard. The goal of this Working Group is to support CS1 instructors who want to introduce a broader perspective on code quality in their classroom, by providing a curated list of examples and activities suitable for novices. In order to achieve this goal, we have extracted from the CS education literature a range of examples and activities, which have then been analysed and organised in terms of code quality dimensions. We have also mapped the topics covered in those materials to existing taxonomies relevant to code quality in CS1. Based on this work, we provide: (1) a catalogue of examples that illustrates the range of quality defects that could be addressed at CS1 level; and (2) a sample set of activities devised to introduce code quality to CS1 students. These materials have the potential to help educators address the subject in more depth.

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM), 2025
Keywords
activities, code quality, CS1, examples, readability, refactoring, style
National Category
Software Engineering Didactics Computer Sciences
Identifiers
urn:nbn:se:kth:diva-361148 (URN)10.1145/3689187.3709615 (DOI)2-s2.0-85219525965 (Scopus ID)
Conference
29th Working Group Reports on Innovation and Technology in Computer Science Education, ITiCSE WGR 2024, Milan, Italy, Jul 8 2024 - Jul 10 2024
Note

Part of ISBN 9798400712081

QC 20250313

Available from: 2025-03-12 Created: 2025-03-12 Last updated: 2025-03-13Bibliographically approved
Glassey, R. & Baltatzis, A. (2024). Active Repos: Integrating Generative AI Workflows into GitHub. In: ITiCSE 2024 - Proceedings of the 2024 Conference Innovation and Technology in Computer Science Education: . Paper presented at 29th Conference Innovation and Technology in Computer Science Education, ITiCSE 2024, Milan, Italy, Jul 8 2024 - Jul 10 2024 (pp. 777-778). Association for Computing Machinery (ACM)
Open this publication in new window or tab >>Active Repos: Integrating Generative AI Workflows into GitHub
2024 (English)In: ITiCSE 2024 - Proceedings of the 2024 Conference Innovation and Technology in Computer Science Education, Association for Computing Machinery (ACM) , 2024, p. 777-778Conference paper, Published paper (Refereed)
Abstract [en]

The aim of this work is to describe a simple and cost effective way to integrate generative AI into GitHub to support course specific scenarios. We are motivated by helping teachers realise their creative AI use cases in spite of technical barriers and also to ensure that students have a blessed and fair way to access AI services without needing to sign-up, prompt or pay. First we will describe a scenario that we have implemented for our own CS1 course, then we will describe the technical requirements for implementation. We finish off with our early thoughts on where these types of scenarios might be heading in terms of supporting computing education.

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM), 2024
Keywords
Automation, CS1, Generative AI, GitHub Actions
National Category
Pedagogical Work Computer Sciences
Identifiers
urn:nbn:se:kth:diva-351001 (URN)10.1145/3649405.3659517 (DOI)001265872800012 ()2-s2.0-85198647223 (Scopus ID)
Conference
29th Conference Innovation and Technology in Computer Science Education, ITiCSE 2024, Milan, Italy, Jul 8 2024 - Jul 10 2024
Note

Part of ISBN 9798400706035

QC 20240724

Available from: 2024-07-24 Created: 2024-07-24 Last updated: 2024-09-03Bibliographically approved
Izu, C., Connamacher, H., Haldeman, G., Liu, D., Carneiro de Oliveira, E., Mirolo, C., . . . Shah, A. (2024). Introducing Code Quality in the CS1 Classroom. In: ITiCSE 2024 - Proceedings of the 2024 Conference Innovation and Technology in Computer Science Education: . Paper presented at 29th Conference Innovation and Technology in Computer Science Education, ITiCSE 2024, Milan, Italy, Jul 8 2024 - Jul 10 2024 (pp. 773-774). Association for Computing Machinery (ACM)
Open this publication in new window or tab >>Introducing Code Quality in the CS1 Classroom
Show others...
2024 (English)In: ITiCSE 2024 - Proceedings of the 2024 Conference Innovation and Technology in Computer Science Education, Association for Computing Machinery (ACM) , 2024, p. 773-774Conference paper, Published paper (Refereed)
Abstract [en]

Characterising code quality is a challenge that was addressed by Börstler et al.’s working group in 2017. As emerged from their study, educators, developers and students have different perceptions of the manifold aspects involved, and a major conclusion of that WG was that “code quality should be discussed more thoroughly in educational programs” [2, p. 70]. However, the lack of materials and the time constraints have slowed down progress in that regard. The goal of this working group is to propose manageable ways to address code quality in the CS1 classroom, with a particular focus on activities that help students become aware of and improve the quality of their code. To achieve this goal, we will (a) extract from the literature a comprehensive set of quality issues which will then be classified according to the appropriate strategies to fix them; and (b) circulate a survey to explore the instructors’ views on code quality issues and the way they deal with (or ignore) them. Based on this work we aim to produce: (1) a taxonomy of code quality issues with associated examples, as well as (2) a sample set of teaching materials to introduce those issues to CS1 students.

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM), 2024
Keywords
code quality, CS1, readability, refactoring, style
National Category
Computer Sciences
Identifiers
urn:nbn:se:kth:diva-351002 (URN)10.1145/3649405.3659535 (DOI)001265872800010 ()2-s2.0-85198638608 (Scopus ID)
Conference
29th Conference Innovation and Technology in Computer Science Education, ITiCSE 2024, Milan, Italy, Jul 8 2024 - Jul 10 2024
Note

Part of ISBN 9798400706035

QC 20240725

Available from: 2024-07-24 Created: 2024-07-24 Last updated: 2024-09-05Bibliographically approved
Jemstedt, A., Bälter, O., Gavel, A., Glassey, R. & Bosk, D. (2024). Less to produce and less to consume: the advantage of pure question-based learning. Interactive Learning Environments, 1-22
Open this publication in new window or tab >>Less to produce and less to consume: the advantage of pure question-based learning
Show others...
2024 (English)In: Interactive Learning Environments, ISSN 1049-4820, E-ISSN 1744-5191, p. 1-22Article in journal (Refereed) Epub ahead of print
Abstract [en]

This study is the first to investigate how an online course consisting solely of multiple-choice questions and detailed formative feedback comparesto an online course format that was previously shown to be highlyeffective. Specifically, a pure question-based learning (pQBL) version ofa course was compared to a question-based learning course (QBL)which consisted of the same questions and feedback as the pQBLcourse, but also included ordinary texts about the subject. To explorehow pQBL and QBL compared in terms of learning outcomes andcompletion time, 492 employees at the Swedish Employment Agencywere randomized to either a pQBL or a QBL version of a course aboutIT security. The results indicate that the pQBL course resulted in equallygood or better learning outcomes compared to the QBL course. Thisresult was robust to changes in how course quality was defined. Inaddition, participants completed the pQBL course slightly faster.Because a pQBL course requires less resources to produce, there arebenefits to relying on the pQBL method when teachers or studentshave limited time. Further benefits that come with the flexibility of thepQBL method are discussed

Place, publisher, year, edition, pages
Taylor & Francis Group, 2024
Keywords
Question-based learning, active learning, formativefeedback, doer effect
National Category
Educational Sciences
Research subject
Education and Communication in the Technological Sciences
Identifiers
urn:nbn:se:kth:diva-360341 (URN)10.1080/10494820.2024.2362830 (DOI)001247707400001 ()2-s2.0-85195687874 (Scopus ID)
Note

QC 20250225

Available from: 2025-02-25 Created: 2025-02-25 Last updated: 2025-02-25Bibliographically approved
Bälter, O., Glassey, R., Jemstedt, A. & Bosk, D. (2024). Pure Question-Based Learning. Education Sciences, 14(8), Article ID 882.
Open this publication in new window or tab >>Pure Question-Based Learning
2024 (English)In: Education Sciences, E-ISSN 2227-7102, Vol. 14, no 8, article id 882Article in journal (Refereed) Published
Abstract [en]

We have evaluated a new pedagogical approach, pure question-based learning, or rather, a modern, digitized version of a really old approach: the Socratic method of learning. The pedagogical approach was evaluated and improved using a design-based research methodology. An online course was developed with pure question-based learning to explain its predecessor: question-based learning. The course was successively taken by students, researchers, and practitioners, and discussed in four group seminars. Feedback from each iteration was integrated into the next version and the course is still in use, see link below. Results from the design-based research process were positive ((Formula presented.) participants, over four iterations) with the main negative results coming from the unfamiliarity of the format and feelings of exam-like stress during the first encounter. While pure question-based learning is new, it builds upon well-tested pedagogical methods. The method has several potential advantages: learning can be broken down into smaller modules, there is less passive learning for the students, less learning material needs to be created and AI could be used for this creation.

Place, publisher, year, edition, pages
MDPI AG, 2024
Keywords
active learning, effective learning, formative feedback, question-based learning
National Category
Educational Sciences
Identifiers
urn:nbn:se:kth:diva-353464 (URN)10.3390/educsci14080882 (DOI)001305456100001 ()2-s2.0-85202611902 (Scopus ID)
Note

QC 20240923

Available from: 2024-09-19 Created: 2024-09-19 Last updated: 2025-02-18Bibliographically approved
Bobadilla, S., Glassey, R., Bergel, A. & Monperrus, M. (2024). SOBO: A Feedback Bot to Nudge Code Quality in Programming Courses. IEEE Software, 41(2), 68-76
Open this publication in new window or tab >>SOBO: A Feedback Bot to Nudge Code Quality in Programming Courses
2024 (English)In: IEEE Software, ISSN 0740-7459, E-ISSN 1937-4194, Vol. 41, no 2, p. 68-76Article in journal (Refereed) Published
Abstract [en]

This paper presents SOBO, a bot we designed to automatically provide feedback on code quality to undergraduate students. SOBO has been deployed in a course at the KTH Royal Institute of Technology in Sweden with more than 130 students.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2024
Keywords
Codes, Chatbots, Education, Task analysis, Software development management, Programming profession, Software engineering
National Category
Computer Sciences
Identifiers
urn:nbn:se:kth:diva-345010 (URN)10.1109/MS.2023.3298729 (DOI)001179020800007 ()2-s2.0-85165868698 (Scopus ID)
Funder
Wallenberg AI, Autonomous Systems and Software Program (WASP)
Note

QC 20240701

Available from: 2024-04-09 Created: 2024-04-09 Last updated: 2024-07-01Bibliographically approved
Östlund, L., Wicklund, N. & Glassey, R. (2023). It's Never too Early to Learn about Code Quality: A Longitudinal Study of Code Quality in First-year Computer Science Students. In: SIGCSE 2023: Proceedings of the 54th ACM Technical Symposium on Computer Science Education. Paper presented at 54th ACM Technical Symposium on Computer Science Education, SIGCSE 2023, Toronto, Canada, Mar 15 2023 - Mar 18 2023 (pp. 792-798). Association for Computing Machinery (ACM)
Open this publication in new window or tab >>It's Never too Early to Learn about Code Quality: A Longitudinal Study of Code Quality in First-year Computer Science Students
2023 (English)In: SIGCSE 2023: Proceedings of the 54th ACM Technical Symposium on Computer Science Education, Association for Computing Machinery (ACM) , 2023, p. 792-798Conference paper, Published paper (Refereed)
Abstract [en]

Low code quality incurs a significant cost upon the software industry. Despite this, little serious effort has been devoted to the topic at the most basic levels of computing science education. Where studies have been conducted, the results are disappointing in terms of code quality. In this work, four iterations of a medium to large CS1 and CS2 course (n=200 students) were analyzed through the lens of code violations to better understand (1) what code violations occur most frequently, (2) how does their occurrence vary throughout the course, and (3) to what extent do teaching assistants have an effect upon code quality. Results showed a statistically significant improvement in code quality over 19 assignments in all four course iterations. In particular, when a single violation was the focus of a learning outcome, the effects were both a dramatic fall and sustained low occurrence. However, this improvement was mostly focused on the three most frequently occurring violations (> 70%), which masked an increase in lesser occurring violations throughout the course. Finally, the effects from different teaching assistants were found to be random at best, contradicting expectations that their influence would be easily detected. Given that explicit learning outcomes targeted at code quality had an effect and teaching assistant influence had no effect, a path forward to improving code quality might combine these forces without creating too many additional demands upon the already stretched teaching resources with CS1 and CS2 courses.

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM), 2023
Keywords
code violations, cs1, programming, teaching assistants
National Category
Computer Sciences Educational Sciences
Identifiers
urn:nbn:se:kth:diva-333384 (URN)10.1145/3545945.3569829 (DOI)001117817800114 ()2-s2.0-85149859120 (Scopus ID)
Conference
54th ACM Technical Symposium on Computer Science Education, SIGCSE 2023, Toronto, Canada, Mar 15 2023 - Mar 18 2023
Note

Part of ISBN 978-1-4503-9431-4

QC 20230801

Available from: 2023-08-01 Created: 2023-08-01 Last updated: 2025-02-18Bibliographically approved
Glassey, R. & Bälter, O. (2023). Learnersourcing analytics. In: Practicable Learning Analytics: (pp. 155-175). Springer International Publishing
Open this publication in new window or tab >>Learnersourcing analytics
2023 (English)In: Practicable Learning Analytics, Springer International Publishing , 2023, p. 155-175Chapter in book (Other academic)
Abstract [en]

A good source of data for learning analytics is the online questions and answers posed to the learners during the course. However, there are several reports on the challenges of question construction as these questions are time consuming to construct and verify, especially if you go beyond multiple-choice questions. One remedy to this is learnersourcing that includes the learners in the generation and verification of these questions for both pedagogical reasons and resource conservation. Learnersourcing is one solution to producing and improving learning activities at scale by leveraging student effort. It also creates a new layer of learner data to analyse: first, in terms of the behaviour traces from producing learning activities; and second in terms of the impressions that other learners and teachers have from taking or reviewing those activities. This chapter will introduce basic concepts and examples of learnersourcing along with examples and approaches to applying a learning analytics lens upon the data traces that are produced.

Place, publisher, year, edition, pages
Springer International Publishing, 2023
National Category
Computer Sciences
Identifiers
urn:nbn:se:kth:diva-327845 (URN)10.1007/978-3-031-27646-0_9 (DOI)
Note

QC 20230612

Available from: 2023-05-31 Created: 2023-05-31 Last updated: 2023-06-12Bibliographically approved
Wiggberg, M., Gobena, E., Kaulio, M., Glassey, R., Bälter, O., Hussain, D., . . . Haller, P. (2022). Effective Reskilling of Foreign-Born People at Universities-The Software Development Academy. IEEE Access, 10, 24556-24565
Open this publication in new window or tab >>Effective Reskilling of Foreign-Born People at Universities-The Software Development Academy
Show others...
2022 (English)In: IEEE Access, E-ISSN 2169-3536, Vol. 10, p. 24556-24565Article in journal (Refereed) Published
Abstract [en]

Contribution: An intensive three-month educational program can be used for rapid integration of foreign-born people into the IT industry. A novel method for integrating industrial needs with the practical parts of a bachelor's Computer Science program. Background: The program was motivated by (1) the societal need to increase the meaningful integration of immigrants into the workforce, and (2) the demand for IT specialists in the IT labor market. Intended outcomes: An effective intensive software developer program with a high level of industrial integration and a working matching model for employment. Application design: The program consists of three different phases; recruitment of participants, training and job matching. The training is divided into six modules using five different teaching methods. An evaluation model, based on passive and active data, is implemented with fast learning loops for teachers and participants. Findings: The program has been run seven times with 263 unemployed participants of different nationalities. On average 82.6 percent of the participants found employment in the IT industry within 5 months of the course ending. Female participants are in the majority and are more successful in securing employment. The findings suggest that it was possible to rapidly prototype and deliver an advanced reskilling program within a university setting and use it as a positive method to support newcomers find meaningful work that has a direct benefit for the local IT industry, as well as for the wider society.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2022
Keywords
Education, Training, Employment, Recruitment, Companies, Software, Industries, Accelerated learning, career development, computer-aided instruction, computer science education, curricula development, lifelong learning
National Category
Economics
Identifiers
urn:nbn:se:kth:diva-310257 (URN)10.1109/ACCESS.2022.3152194 (DOI)000766542100001 ()2-s2.0-85124834709 (Scopus ID)
Note

QC 20220325

Available from: 2022-03-25 Created: 2022-03-25 Last updated: 2022-06-25Bibliographically approved
Berg, A., Osnes, S. & Glassey, R. (2022). If in Doubt, Try Three: Developing Better Version Control Commit Behaviour with First Year Students. In: SIGCSE 2022 - Proceedings of the 53rd ACM Technical Symposium on Computer Science Education: . Paper presented at 53rd Annual ACM Technical Symposium on Computer Science Education, SIGCSE 2022, 3-5 March 2022 (pp. 362-368). Association for Computing Machinery (ACM)
Open this publication in new window or tab >>If in Doubt, Try Three: Developing Better Version Control Commit Behaviour with First Year Students
2022 (English)In: SIGCSE 2022 - Proceedings of the 53rd ACM Technical Symposium on Computer Science Education, Association for Computing Machinery (ACM) , 2022, p. 362-368Conference paper, Published paper (Refereed)
Abstract [en]

Developing good version control skills is important for students to master. This work focuses on helping students integrate good commit behaviour using a scaffolding process that happens with their regular assignments. A test group of students (n=30) was required to make a minimum of three commits in the first week. In the second week, students were trained to write better commit messages and worked together on a commit plan. In the final week, students worked alone on their commit plan. Commit behaviour was analysed for assignments occurring before, during and after the process. Results showed that students improved their commit behaviour in terms of number of commits, starting earlier with their assignments and writing more meaningful commit messages when compared to the rest of their cohort and the previous year's cohort (m=350). Qualitative results showed that students were mostly positive towards developing better commit behaviour and felt that the extra effort to think in commits delivered proportionally more benefits for their work.

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM), 2022
Keywords
commit behaviour, cs1/cs2, git, version control systems, Information management, Scaffolds, Commit behavior, First year students, Previous year, Version control, Version control system, Students
National Category
Educational Sciences
Identifiers
urn:nbn:se:kth:diva-321874 (URN)10.1145/3478431.3499371 (DOI)000884263800053 ()2-s2.0-85126146076 (Scopus ID)
Conference
53rd Annual ACM Technical Symposium on Computer Science Education, SIGCSE 2022, 3-5 March 2022
Note

Part of proceedings: ISBN 978-1-4503-9070-5

QC 20221125

Available from: 2022-11-25 Created: 2022-11-25 Last updated: 2025-02-18Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-8996-0221

Search in DiVA

Show all publications