Multimodal Human–Robot Interaction for Human-Centric Smart Manufacturing: A Survey
2024 (English)In: Advanced Intelligent Systems, E-ISSN 2640-4567, Vol. 6, no 3, article id 2300359Article, review/survey (Refereed) Published
Abstract [en]
Human–robot interaction (HRI) has escalated in notability in recent years, and multimodal communication and control strategies are necessitated to guarantee a secure, efficient, and intelligent HRI experience. In spite of the considerable focus on multimodal HRI, comprehensive disquisitions delineating various modalities and intricately analyzing their combinations remain elusive, consequently limiting holistic understanding and future advancements. This article aspires to bridge this inadequacy by conducting a profound exploration of multimodal HRI, predominantly concentrating on four principal modalities: vision, auditory and language, haptics, and physiological sensing. An extensive review encapsulating algorithmic dissection, interface devices, and applicative dimensions forms part of this discourse. This manuscript distinctively combines multimodal HRI with cognitive science, deeply probing into the three dimensions, perception, cognition, and action, thereby demystifying algorithms intrinsic to multimodal HRI. Finally, it accentuates the empirical challenges and contours preemptive trajectories for multimodal HRI in human-centric smart manufacturing.
Place, publisher, year, edition, pages
Wiley , 2024. Vol. 6, no 3, article id 2300359
Keywords [en]
auditory, haptics, human–robot interactions, languages, multimodals, physiological sensing, vision
National Category
Human Computer Interaction Production Engineering, Human Work Science and Ergonomics
Identifiers
URN: urn:nbn:se:kth:diva-367108DOI: 10.1002/aisy.202300359ISI: 001111881300001Scopus ID: 2-s2.0-85178415089OAI: oai:DiVA.org:kth-367108DiVA, id: diva2:1984209
Note
QC 20250715
2025-07-152025-07-152025-07-15Bibliographically approved