kth.sePublications KTH
System disruptions
There are recurring service disruptions on some of the search portals due to high traffic. We are working to resolve the issue, you may temporarily encounter an error message.
Change search
Link to record
Permanent link

Direct link
Maffei, Antonio, Associate ProfessorORCID iD iconorcid.org/0000-0002-0723-1712
Biography [eng]

Antonio Maffei is an Associate Professor specializing in production systems with a focus on business models at KTH, Sweden. His roles have included leadership positions in major research initiatives and he is currently a member of a prominent steering group at the institution. He coordinates interdisciplinary research efforts, particularly focusing on industrial transformation through digitalization and sustainable energy systems.

He earned his PhD in production systems from KTH in 2012, after receiving an MSc and a BSc from the University of Pisa in 2004 and 2007, respectively. He also holds a PhD in pedagogy for higher education from Bologna, Italy, obtained in 2021. With substantial international experience, he has served as a visiting researcher and lecturer at various global institutions.

His research interests lie in developing sustainable business models for advanced automation technologies, including autonomous systems, assembly technologies, and cybersecurity. He is actively engaged in educational research and development, emphasizing constructive alignment, phenomenography, and blended learning. He has been recognized as a future leader in strategic educational development at KTH starting in 2022.

Associate Professor Maffei has contributed to numerous national and international research initiatives and has authored over 60 scientific publications. He is also affiliated with key networks in the Swedish production sector and holds professional engineering certification in Italy.

Biography [swe]

Antonio Maffei är docent i produktionssystem med inriktning på affärsmodeller vid KTH, Sverige. Hans roller har inkluderat ledande positioner inom större forskningsinitiativ och han är för närvarande medlem i en framstående styrgrupp vid institutionen. Han koordinerar tvärvetenskapliga forskningsinsatser, särskilt med fokus på industriell omvandling genom digitalisering och hållbara energisystem.

Han erhöll sin doktorsexamen i produktionssystem från KTH år 2012, efter att ha tagit en MSc och en BSc från universitetet i Pisa 2004 respektive 2007. Han innehar också en doktorsexamen i pedagogik för högre utbildning från Bologna, Italien, som erhölls 2021. Med omfattande internationell erfarenhet har han varit gästforskare och föreläsare vid olika globala institutioner.

Hans forskningsintressen ligger i att utveckla hållbara affärsmodeller för avancerade automatiseringsteknologier, inklusive autonoma system, monteringsteknik och cybersäkerhet. Han är aktivt engagerad i pedagogisk forskning och utveckling, med betoning på konstruktiv anpassning, fenomenografi och blandat lärande. Han har erkänts som framtida ledare för strategisk pedagogisk utveckling vid KTH från och med 2022.

Docent Maffei har bidragit till många nationella och internationella forskningsinitiativ och har författat över 60 vetenskapliga publikationer. Han är också ansluten till nyckelnätverk inom den svenska produktionssektorn och innehar yrkesmässig ingenjörscertifiering i Italien.

Publications (10 of 115) Show all publications
Lombardi, D., Traetta, L., Podržaj, P. & Maffei, A. (2027). Socratic AI: Rethinking Inclusion Through Dialogic Intelligence. In: Higher Education Learning Methodologies and Technologies Online - 7th International Conference, HELMeTO 2025, Revised Selected Papers: . Paper presented at 7th International Conference on Higher Education Learning Methodologies and Technologies Online, HELMeTO 2025, Naples, Italy, September 23-25, 2025 (pp. 227-245). Springer Nature, 2959 CCIS
Open this publication in new window or tab >>Socratic AI: Rethinking Inclusion Through Dialogic Intelligence
2027 (English)In: Higher Education Learning Methodologies and Technologies Online - 7th International Conference, HELMeTO 2025, Revised Selected Papers, Springer Nature , 2027, Vol. 2959 CCIS, p. 227-245Conference paper, Published paper (Refereed)
Abstract [en]

This study examines how Socratic and Generative AI tools can support inclusive instructional design and foster critical pedagogical engagement among educators. A two-phase intervention was conducted with 152 in-service teachers enrolled in the Italian national specialization program for inclusive education (TFA Sostegno), using the Socratic AI system EULER and the large language model ChatGPT. Drawing on the Unified Theory of Acceptance and Use of Technology (UTAUT), the study assessed teachers’ perceptions of pedagogical value, usability, and institutional feasibility. In the first phase, participants used EULER to design inclusive lesson plans through question-driven dialogue, promoting metacognitive reflection and instructional revision. In the second phase, teachers co-constructed lesson plans by combining EULER with ChatGPT, integrating critical interrogation with generative ideation. Across both phases, UTAUT scores improved, with participants reporting higher performance expectancy, effort expectancy, and social influence when using the dual-tool approach. Findings indicate that teachers perceived AI not as a passive assistant, but as an epistemic collaborator capable of deepening pedagogical reasoning and reinforcing professional identity. Qualitative data reveal a conceptual shift from viewing AI as a task-automation tool toward embracing it as a medium for dialogic and cognitive augmentation. Participants also identified institutional support, ongoing professional development, and equitable access as critical conditions for sustainable adoption. These results suggest that Socratic AI, when embedded within structured and ethically responsible educational contexts, can serve as a catalyst for reflective, inclusive, and professionally empowering pedagogical innovation.

Place, publisher, year, edition, pages
Springer Nature, 2027
Keywords
Artificial Intelligence in Education (AIEd), EULER, Inclusive Education, Instructional Design, Reflective Teaching, Socratic Dialogue
National Category
Information Systems, Social aspects
Identifiers
urn:nbn:se:kth:diva-388177 (URN)10.1007/978-3-032-31853-4_15 (DOI)2-s2.0-105048729263 (Scopus ID)
Conference
7th International Conference on Higher Education Learning Methodologies and Technologies Online, HELMeTO 2025, Naples, Italy, September 23-25, 2025
Note

Part of ISBN 9783032318527

QC 20260915

Available from: 2026-09-15 Created: 2026-09-15 Last updated: 2026-09-15Bibliographically approved
Pacini, A., Rea Minango, N., Lupi, F., Lanzetta, M. & Maffei, A. (2026). Digital thread in fixture design: leveraging model-based definition for seamless information flow. International journal of computer integrated manufacturing (Print), 39(10), 1505-1534
Open this publication in new window or tab >>Digital thread in fixture design: leveraging model-based definition for seamless information flow
Show others...
2026 (English)In: International journal of computer integrated manufacturing (Print), ISSN 0951-192X, E-ISSN 1362-3052, Vol. 39, no 10, p. 1505-1534Article in journal (Refereed) Published
Abstract [en]

Configure-to-Order (CTO) assembly systems are becoming pivotal in meeting the rising demand for mass customization. However, enabling rapid and cost-effective system reconfiguration remains a major challenge in manufacturing. Despite the flexibility of general-purpose machines, fixture design introduces significant bottlenecks, often requiring extensive manual effort to access, organize, and interpret fragmented or incomplete data. This leads to inefficient design pipelines that can compromise product functionality and result in costly redesign iterations, even when using advanced Computer-Aided Fixture Design (CAFD) tools. Although the Model-Based Definition (MBD) paradigm offers a promising response to these information-related challenges, its adoption within the CAFD domain remains limited. This work aims to support the broader adoption of MBD in this field through a multi-level contribution. First, a structured literature review identifies the essential semantic information required in an MBD dataset tailored to CAFD. Second, this content is structured in a machine-readable form using the ISO standard STEP AP242. Third, an MBD-driven CAFD framework is proposed. Finally, a proof-of-concept CAFD tool is developed by integrating established methodologies with commercial software to automate non-value-added tasks, such as configuring Computer-Aided Technologies (CAx). The results demonstrate the potential of this approach to streamline CAFD processes and establish a fully connected digital thread.

Place, publisher, year, edition, pages
Informa UK Limited, 2026
Keywords
CAD, digital thread, FEM, fixture design, Model-based definition, reconfigurable manufacturing
National Category
Production Engineering, Human Work Science and Ergonomics Computer Systems
Identifiers
urn:nbn:se:kth:diva-372038 (URN)10.1080/0951192X.2025.2558831 (DOI)001583375300001 ()2-s2.0-105018010315 (Scopus ID)
Note

Not duplicate with DiVA 1937568

QC 20251105

Available from: 2025-11-05 Created: 2025-11-05 Last updated: 2026-10-02Bibliographically approved
Monetti, F. M., Lundstrom, A., de Kwant, C., Gyllenskepp, M. & Maffei, A. (2026). Establishing assembly-oriented modular product architectures through a design for assembly expanded modular function deployment. Journal of engineering design (Print)
Open this publication in new window or tab >>Establishing assembly-oriented modular product architectures through a design for assembly expanded modular function deployment
Show others...
2026 (English)In: Journal of engineering design (Print), ISSN 0954-4828, E-ISSN 1466-1837Article in journal (Refereed) Epub ahead of print
Abstract [en]

Modular product design has become a strategic enabler for companies seeking to balance product variety, operational efficiency, and market responsiveness, making alignment between modular architecture and manufacturing considerations increasingly critical. Modular Function Deployment (MFD) is a widely adopted method for defining modular product architectures, yet it lacks systematic support for assembly considerations during early concept and system-level development. This limitation increases the risk of delayed production ramp-up and life cycle inefficiencies. This paper proposes a set of enhancements to MFD that integrate Design for Assembly (DfA) logic into architectural synthesis. The extended method introduces structured heuristics, assembly-oriented module drivers, a coded interface taxonomy, and quantitative metrics for assessing assembly feasibility and automation readiness. These additions preserve compatibility with standard MFD workflows while enriching decision-making with traceable, production-informed reasoning. An illustrative case study involving a handheld leaf blower demonstrates the method's usability and effectiveness. The redesigned architecture shows reduced assembly effort, simplified interfaces, and increased automation potential. By supporting early-stage evaluation of architectural alternatives through an assembly lens, the method enables faster transition to efficient volume production and provides a foundation for continuous improvement throughout the product life cycle.

Place, publisher, year, edition, pages
Informa UK Limited, 2026
Keywords
Modular function deployment (MFD), design for assembly (DfA), product architecture, concept selection, interface design
National Category
Production Engineering, Human Work Science and Ergonomics Industrial engineering and management
Identifiers
urn:nbn:se:kth:diva-387376 (URN)10.1080/09544828.2026.2680613 (DOI)001814805800001 ()2-s2.0-105044222356 (Scopus ID)
Note

QC 20260821

Available from: 2026-08-21 Created: 2026-08-21 Last updated: 2026-08-21Bibliographically approved
Bondin, A., Zammit, J. P., Francalanza, E., Borg, J. C., Dallasega, P., Lanzone, M., . . . Batistic, L. (2026). Immersive Technologies in Engineering Education: A Systematic Review Through the Lens of Constructive Alignment and Bloom's Taxonomy. Computer applications in engineering education, 34(3), Article ID e70201.
Open this publication in new window or tab >>Immersive Technologies in Engineering Education: A Systematic Review Through the Lens of Constructive Alignment and Bloom's Taxonomy
Show others...
2026 (English)In: Computer applications in engineering education, ISSN 1061-3773, E-ISSN 1099-0542, Vol. 34, no 3, article id e70201Article, review/survey (Refereed) Published
Abstract [en]

The engineering profession faces global challenges that require graduates with strong practical and cognitive skills, yet traditional curricula often lack real-world and interdisciplinary preparation. Immersive Reality (IR) technologies, including Virtual, Augmented, and Mixed Reality, are increasingly explored in engineering education to bridge this gap. This systematic literature review examines how IR supports learning outcomes, categorising studies by technology, instructional design, and assessment methods. Using Bloom's Taxonomy, the findings reveal that most interventions target the 'Apply' level, with limited focus on higher-order cognitive skills. A key gap identified is the limited use of pedagogical frameworks such as Bloom's Taxonomy and Constructive Alignment (CA), which hinders evaluation of instructional depth. To address this, the paper presents two illustrative designs that demonstrate how immersive Teaching and Learning Activities and Assessment Tasks (ATs) can be designed using CA principles. These cases offer practical guidance for embedding IR into engineering curricula in a pedagogically coherent and outcome-aligned manner.

Place, publisher, year, edition, pages
Wiley, 2026
Keywords
constructive alignment, curriculum design, engineering education, mixed reality, technology-enhanced learning
National Category
Human Computer Interaction
Identifiers
urn:nbn:se:kth:diva-385945 (URN)10.1002/cae.70201 (DOI)001761715100001 ()2-s2.0-105038371216 (Scopus ID)
Note

QC 20260723

Available from: 2026-07-23 Created: 2026-07-23 Last updated: 2026-07-23Bibliographically approved
Bondin, A., Zammit, J. P., Francalanza, E., Borg, J., Dallasega, P., Lanzone, M., . . . Abdoli, S. (2026). Rethinking Engineering Education in Light of Mixed Reality Opportunities - Results from a European Survey. In: 7th International Conference on Industry of the Future and Smart Manufacturing, former International Conference on Industry 4.0 and Smart Manufacturing: . Paper presented at 7th International Conference on Industry of the Future and Smart Manufacturing, former International Conference on Industry 4.0 and Smart Manufacturing, Malta, MLT, Nov 12 2025 - Nov 14 2025 (pp. 2554-2563). Elsevier BV, 277
Open this publication in new window or tab >>Rethinking Engineering Education in Light of Mixed Reality Opportunities - Results from a European Survey
Show others...
2026 (English)In: 7th International Conference on Industry of the Future and Smart Manufacturing, former International Conference on Industry 4.0 and Smart Manufacturing, Elsevier BV , 2026, Vol. 277, p. 2554-2563Conference paper, Published paper (Refereed)
Abstract [en]

Technology-driven manufacturing has been a transformative force, reshaping not only industrial processes but society at large. The integration of smart systems has enabled companies to reduce production costs, improve efficiency, and enhance product quality. Yet, competitive advantage increasingly depends on human capital, and many engineering graduates lack the competencies to operate effectively in digitally advanced environments. This study draws on a cross-sectional European survey capturing responses from 217 engineering students and 63 educators/mentors across multiple countries. Results reveal strong overall satisfaction with engineering education (60% satisfied, 35% neutral), but highlight systemic weaknesses: lack of hands-on training, limited industry collaboration, and passive delivery models. Students emphasised low engagement and motivation, while educators stressed barriers in content development and limited access to advanced technologies. Both groups recognised the potential of Mixed Reality (MR) to address these gaps, with over three-quarters of respondents reporting at least some familiarity with MR. However, adoption remains minimal, with only 22% of educators having integrated MR in their teaching. The findings indicate that MR-based Virtual Learning Environments could help bridge the persistent theory-practice divide by increasing engagement, reducing reliance on physical equipment, and enhancing inclusivity through flexible and multilingual design. These insights underscore the urgent need for scalable infrastructure and educator training to support integration. MR, when combined with gamification and microlearning, offers a promising pathway to align engineering education more closely with Industry 4.0/5.0 skill demands.

Place, publisher, year, edition, pages
Elsevier BV, 2026
Keywords
Engineering Education, Immersive Learning, Mixed Reality, Skills Gap, Technology-Integrated Pedagogy
National Category
Production Engineering, Human Work Science and Ergonomics
Identifiers
urn:nbn:se:kth:diva-383412 (URN)10.1016/j.procs.2026.02.292 (DOI)2-s2.0-105040207733 (Scopus ID)
Conference
7th International Conference on Industry of the Future and Smart Manufacturing, former International Conference on Industry 4.0 and Smart Manufacturing, Malta, MLT, Nov 12 2025 - Nov 14 2025
Note

QC 20260623

Available from: 2026-06-23 Created: 2026-06-23 Last updated: 2026-06-23Bibliographically approved
Antonelli, D., Podržaj, P. & Maffei, A. (2026). Task Planning and Execution for Industrial Automation: A Comprehensive Analysis of Traditional and Emerging Methods. In: 7th International Conference on Industry of the Future and Smart Manufacturing, former International Conference on Industry 4.0 and Smart Manufacturing: . Paper presented at 7th International Conference on Industry of the Future and Smart Manufacturing, former International Conference on Industry 4.0 and Smart Manufacturing, Malta, MLT, Nov 12 2025 - Nov 14 2025 (pp. 3257-3266). Elsevier BV, 277
Open this publication in new window or tab >>Task Planning and Execution for Industrial Automation: A Comprehensive Analysis of Traditional and Emerging Methods
2026 (English)In: 7th International Conference on Industry of the Future and Smart Manufacturing, former International Conference on Industry 4.0 and Smart Manufacturing, Elsevier BV , 2026, Vol. 277, p. 3257-3266Conference paper, Published paper (Refereed)
Abstract [en]

This study provides a comprehensive analysis of task planning paradigms in industrial automation, evaluating different active and reactive methods like: Finite State Machines (FSMs), Behavior Trees, Hierarchical Task Networks, Symbolic Planning (PDDL), and Reinforcement Learning. It assesses the trade-offs of each method concerning scalability, reactivity, and verifiability. The core focus is the transformative role of generative AI, not as a standalone solution, but as an enabling technology that augments existing frameworks. Key generative AI applications include generating plans from natural language and creating synthetic training environments. The conclusive statement of the study is that the future of automation lies in hybrid deliberative-reactive architectures, such as combining PDDL and BTs, where AI enhances human expertise under rigorous verification.

Place, publisher, year, edition, pages
Elsevier BV, 2026
Keywords
Generative AI, Hybrid Deliberative-Reactive Architecture, Industrial Automation, Task Planning
National Category
Computer Sciences Production Engineering, Human Work Science and Ergonomics
Identifiers
urn:nbn:se:kth:diva-383411 (URN)10.1016/j.procs.2026.02.362 (DOI)2-s2.0-105040199905 (Scopus ID)
Conference
7th International Conference on Industry of the Future and Smart Manufacturing, former International Conference on Industry 4.0 and Smart Manufacturing, Malta, MLT, Nov 12 2025 - Nov 14 2025
Note

QC 20260623

Available from: 2026-06-23 Created: 2026-06-23 Last updated: 2026-06-23Bibliographically approved
De Giorgio, A. & Maffei, A. (2026). Venture Builders for Smart Manufacturing Tech Startups: A Comprehensive Literature Survey of an Emerging Trend. In: 7th International Conference on Industry of the Future and Smart Manufacturing, former International Conference on Industry 4.0 and Smart Manufacturing: . Paper presented at 7th International Conference on Industry of the Future and Smart Manufacturing, former International Conference on Industry 4.0 and Smart Manufacturing, Malta, MLT, Nov 12 2025 - Nov 14 2025 (pp. 3606-3615). Elsevier BV, 277
Open this publication in new window or tab >>Venture Builders for Smart Manufacturing Tech Startups: A Comprehensive Literature Survey of an Emerging Trend
2026 (English)In: 7th International Conference on Industry of the Future and Smart Manufacturing, former International Conference on Industry 4.0 and Smart Manufacturing, Elsevier BV , 2026, Vol. 277, p. 3606-3615Conference paper, Published paper (Refereed)
Abstract [en]

As corporate venture builders (VBs) gain traction in various industries, their adoption within the manufacturing sector remains largely underexplored. This scoping literature review investigates the hypothesis of a lack of scientific articles focusing on VBs in manufacturing. By reviewing several types of publications among multidisciplinary topics linked to manufacturing, we ensured ourselves to capture all the relevant literature. Key findings include the role of smart manufacturing technologies and the emerging trend of "shared factories,"where manufacturing tech VBs enable collaborative, cost-effective solutions. We highlight the advantages and challenges of VBs, with a particular focus on their potential to externalize RandD, drive innovation, and reduce costs. While promising, the adoption of VBs in manufacturing remains nascent, with opportunities for further research to explore their strategic impact. Our study underscores the transformative potential of VBs in accelerating manufacturing innovation and reshaping industry practices.

Place, publisher, year, edition, pages
Elsevier BV, 2026
Keywords
Builder, Capital, Knowledge, Manufacturing, Smart, Startup, Studio, Technology, Venture
National Category
Business Administration Production Engineering, Human Work Science and Ergonomics
Identifiers
urn:nbn:se:kth:diva-383407 (URN)10.1016/j.procs.2026.02.395 (DOI)2-s2.0-105040153329 (Scopus ID)
Conference
7th International Conference on Industry of the Future and Smart Manufacturing, former International Conference on Industry 4.0 and Smart Manufacturing, Malta, MLT, Nov 12 2025 - Nov 14 2025
Note

QC 20260623

Available from: 2026-06-23 Created: 2026-06-23 Last updated: 2026-06-23Bibliographically approved
Lombardi, D., Traetta, L., Mo, F. & Maffei, A. (2025). Artificial Intelligence in Special Education: Enhancing IEP Design with CONALI & ChatGPT. In: Ardimento, P DiFuccio, R Fulantelli, G Limone, P Pecori, R Raviolo, P Rondonotti, M Schicchi, D Taibi, D Zaza, G (Ed.), HIGHER EDUCATION LEARNING METHODOLOGIES AND TECHNOLOGIES ONLINE, HELMETO 2024, PT II: . Paper presented at 6th International Conference on Higher Education Learning Methodologies and Technologies Online-HELMeTO, SEP 25-27, 2024, Rome, ITALY (pp. 3-27). Springer Nature, 2468
Open this publication in new window or tab >>Artificial Intelligence in Special Education: Enhancing IEP Design with CONALI & ChatGPT
2025 (English)In: HIGHER EDUCATION LEARNING METHODOLOGIES AND TECHNOLOGIES ONLINE, HELMETO 2024, PT II / [ed] Ardimento, P DiFuccio, R Fulantelli, G Limone, P Pecori, R Raviolo, P Rondonotti, M Schicchi, D Taibi, D Zaza, G, Springer Nature , 2025, Vol. 2468, p. 3-27Conference paper, Published paper (Refereed)
Abstract [en]

Artificial intelligence (AI) has demonstrated significant utility in education, particularly in providing feedback, personalised learning paths, and reducing costs [1]. Despite its potential [2, 3], there is a notable gap in the literature on AI's role in inclusive educational planning and IEP (Individualised Education Plan) compilation [4]. This study presents the results of interventions aimed at assessing the perceived usefulness of AI and the CONALI Ontology by trainee special education teachers during IEP compilation. Conducted with teachers across all educational levels, the study investigates whether AI and CONALI are beneficial for IEPs for students of all ages. The research verifies the effectiveness of AI combined with the CONALI Ontological framework by Maffei [5-7], guiding teachers to identify Specific, Measurable, Achievable, Realistic, and Timebound (SMART) educational goals. Exercises and validated questionnaires were administered to 391 teachers from early childhood, primary, lower secondary, and upper secondary education. Initially, teachers were introduced to the IEP's Section 5, emphasising SMART objectives. They then completed this section for a hypothetical student with disabilities. Next, the CONALI Ontology was introduced, showing its utility in aligning educational objectives with teaching activities and assessment methods. Teachers then completed a second IEP with CONALI support and evaluated their design experience via a questionnaire. Finally, they used the AI tool ChatGPT, in conjunction with CONALI, to compile a final IEP. Results showed that teachers perceived ChatGPT and CONALI as useful and effective. The Ontology was confirmed as a valuable tool for identifying SMART objectives aligned with intervention strategies and assessment methods. AI, supported by CONALI, effectively accelerated the IEP compilation process, enhancing engagement, motivation, and learning quality.

Place, publisher, year, edition, pages
Springer Nature, 2025
Series
Communications in Computer and Information Science, ISSN 1865-0929
Keywords
AIEd, ChatGPT, IEP, CONALI
National Category
Educational Sciences
Identifiers
urn:nbn:se:kth:diva-378286 (URN)10.1007/978-3-031-93999-0_1 (DOI)001591539300001 ()2-s2.0-105014354572 (Scopus ID)
Conference
6th International Conference on Higher Education Learning Methodologies and Technologies Online-HELMeTO, SEP 25-27, 2024, Rome, ITALY
Note

Part of ISBN 978-3-031-93998-3; 978-3-031-93999-0

QC 20260319

Available from: 2026-03-19 Created: 2026-03-19 Last updated: 2026-03-19Bibliographically approved
Lombardi, D., Traetta, L. & Maffei, A. (2025). ChatGPT and Instructional Design: An Ally for Inclusion?. In: Inclusion, Communication, and Social Engagement - 1st International Conference, ICS exchange 2024, Proceedings: . Paper presented at 1st International Conference on Inclusion, Communication and Social Engagement, ICS exchange 2024, Foggia, Italy, April 18-20, 2024 (pp. 124-135). Springer Nature
Open this publication in new window or tab >>ChatGPT and Instructional Design: An Ally for Inclusion?
2025 (English)In: Inclusion, Communication, and Social Engagement - 1st International Conference, ICS exchange 2024, Proceedings, Springer Nature , 2025, p. 124-135Conference paper, Published paper (Refereed)
Abstract [en]

Artificial Intelligence (AI) is gaining importance in the field of education (Chen et al., 2020). Despite its widespread use to assist teachers (Pratama et al., 2023; Baidoo-Anu Ansah, 2023), there’s a gap in literature on AI’s role in instructional design, particularly for students with disabilities. This study explores the perceptions of 114 support teachers on using ChatGPT and the CONALI Ontology (Maffei et al., 2016) for creating Individualized Education Plans (IEPs). In the first phase of the study, teachers were trained on how to identify objectives, teaching and learning activities and assessment methods within the IEP, following the CONALI ontological framework and constructive alignment (CA) (Maffei et al., 2022). After verifying their perceptions of the experience through an initial validated questionnaire, a second exercise was conducted, in which the experimental group applied the CONALI framework in combination with ChatGPT to fill in the IEP. At the end of the exercise, a second questionnaire was handed out to collect participants’ perceptions of the experience and to assess the effectiveness of ChatGPT and CONALI in designing the IEP. Descriptive analysis revealed that the combination of ChatGPT and CONALI was perceived as useful in IEP design. Ontology was confirmed as a useful tool for identifying SMART training objectives and aligning them with intervention strategies and assessment methods in the IEP. AI, supported by CONALI, was seen as an effective tool for instructional design, speeding up IEP completion and promoting engagement, motivation, and learning quality.

Place, publisher, year, edition, pages
Springer Nature, 2025
Keywords
AIEd, ChatGPT, IEP
National Category
Human Computer Interaction Production Engineering, Human Work Science and Ergonomics
Identifiers
urn:nbn:se:kth:diva-370821 (URN)10.1007/978-3-032-03021-4_9 (DOI)001591421300009 ()2-s2.0-105015532682 (Scopus ID)
Conference
1st International Conference on Inclusion, Communication and Social Engagement, ICS exchange 2024, Foggia, Italy, April 18-20, 2024
Note

Part of ISBN 9783032030207

QC 20251003

Available from: 2025-10-03 Created: 2025-10-03 Last updated: 2026-05-29Bibliographically approved
De Giorgio, A., Matrone, G. & Maffei, A. (2025). Detecting Large Language Models in Exam Essays. In: EDUNINE 2025 - 9th IEEE Engineering Education World Conference: Education in the Age of Generative AI: Embracing Digital Transformation - Proceedings: . Paper presented at 9th IEEE Engineering Education World Conference, EDUNINE 2025, Montevideo, Uruguay, Mar 23 2025 - Mar 26 2025. Institute of Electrical and Electronics Engineers (IEEE)
Open this publication in new window or tab >>Detecting Large Language Models in Exam Essays
2025 (English)In: EDUNINE 2025 - 9th IEEE Engineering Education World Conference: Education in the Age of Generative AI: Embracing Digital Transformation - Proceedings, Institute of Electrical and Electronics Engineers (IEEE) , 2025Conference paper, Published paper (Refereed)
Abstract [en]

There is a widespread fear that large language models (LLMs) produce content that is indistinguishable from an original human work. Can students use LLM-based tools for their exam essays without being spotted? We performed experiments on a publicly available dataset that we produced, containing thirty answers provided by ChatGPT and thirty-six answers from university students, for each of six anonymized exam essay traces from a scientific methodology course for engineers. We applied term frequency-inverse document frequency (TF-IDF), a state-of-the-art machine learning algorithm for natural language processing, and the cosine similarity metric, in order to produce two LLM detectors. One is based on one-class support vector machine anomaly detection, and the other is based on multi-class random forest classification. The results show that it is possible to spot when LLMs are involved, provided that the source LLM is known. Education institutions can follow our guidelines to prevent cheating and improve education.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2025
Keywords
ChatGPT, detector, education, essay, exam, large language model
National Category
Computer Sciences Natural Language Processing
Identifiers
urn:nbn:se:kth:diva-368620 (URN)10.1109/EDUNINE62377.2025.10981412 (DOI)001514396100095 ()2-s2.0-105007413156 (Scopus ID)
Conference
9th IEEE Engineering Education World Conference, EDUNINE 2025, Montevideo, Uruguay, Mar 23 2025 - Mar 26 2025
Note

Part of ISBN 9798331542788

QC 20250826

Available from: 2025-08-26 Created: 2025-08-26 Last updated: 2025-11-04Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-0723-1712