kth.sePublications KTH
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Comparing lesson plan-driven and ask-me-anything chatbots: teaching a UNIX Shell course
KTH, School of Electrical Engineering and Computer Science (EECS), Computer Science, Theoretical Computer Science, TCS. College of IT (Affiliation During Data Collection), UAE University, Abu Dhabi, UAE.ORCID iD: 0000-0001-8572-7898
2025 (English)In: Discover Education, E-ISSN 2731-5525, Vol. 4, no 1, article id 93Article in journal (Refereed) Published
Abstract [en]

GPT-based models have enabled the creation of natural language chatbots that support both Inquiry-Based and Structured Learning approaches. This study offers a direct comparison of these two paradigms within a UNIX Shell scripting course by means of two chatbots: a Lesson Plan-Driven chatbot that ensures all students cover the same topics systematically, and an Ask-Me-Anything (AMA) chatbot more suited to exploratory learning. We compared two particular chatbots—Harvard’s CS50 (as an AMA chatbot) and OS315 (ours), as a lesson plan-driven chatbot—through four surveys. Results show a Net Promoter Score (NPS) of + 45 CI[25, 66] (N = 55) for the least performing lesson plan-driven chatbot and + 35 CI[11, 58.5] (N = 40) for the AMA chatbot. The majority of students favored a blend of human and chatbot instruction. Additionally, we discuss factors such as cost, accessibility, and why the same chatbot architecture, when applied to a Data Visualization course yields a lower NPS of + 9 CI[−6, + 23].

Place, publisher, year, edition, pages
Discover , 2025. Vol. 4, no 1, article id 93
Keywords [en]
AI tutor, Automated tutor, Hybrid paradigm, Survey
National Category
Human Computer Interaction Information Systems
Identifiers
URN: urn:nbn:se:kth:diva-363422DOI: 10.1007/s44217-025-00492-9Scopus ID: 2-s2.0-105004181294OAI: oai:DiVA.org:kth-363422DiVA, id: diva2:1958517
Note

QC 20250516

Available from: 2025-05-15 Created: 2025-05-15 Last updated: 2025-05-16Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Berengueres, Jose

Search in DiVA

By author/editor
Berengueres, Jose
By organisation
Theoretical Computer Science, TCS
Human Computer InteractionInformation Systems

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 62 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf