"Pilot" to "Embodier": Brain-Controlled Robotic Arm With the E-VEP Paradigm in 3-D Manufacturing Scenarios for IoTShow others and affiliations
2025 (English)In: IEEE Internet of Things Journal, ISSN 2327-4662, Vol. 12, no 11, p. 17210-17222Article in journal (Refereed) Published
Abstract [en]
Robotic arm operation based on human-machine collaboration in manufacturing scenarios for the Internet of Things (IoT) has become an important research direction, especially in three-dimensional (3-D) scenarios that require high precision and flexible operation. However, owing to the complexity of operating robotic arms in 3-D scenarios, it is challenging for humans to perform tasks in pilot mode, leading to unnatural human-machine interactions. In this study, an embodied visual evoked potential (E-VEP) paradigm is proposed that can be used to control robotic arms in manufacturing scenarios in embodier mode. In addition, an incremental self-learning intention decoding (ISLID) algorithm is established to address the temporal variability in electroencephalography (EEG) signals. A brain-controlled robotic arm system was developed on the basis of the E-VEP paradigm and the ISLID algorithm. Online free grasping experiments revealed that the task time cost, output delay, and intention output ratio of the proposed system were 89.04 s, 2.22 s, and 46.59%, respectively. Compared with those of brain-controlled robotic arm systems based on the dynamic visual evoked potential (D-VEP) and SSVEP paradigms, the system based on the E-VEP paradigm achieved reductions in the average task time cost of 13.44% and 24.54%, respectively, and reductions in the average intention output ratio of 17.01% and 26.65%, respectively. The proposed brain-controlled robotic arm system holds significant application value in intelligent manufacturing scenarios for the IoT, advancing the integration of brain-machine interfaces and IoT technologies. The video (https://youtu.be/WtRHew4WGyo) demonstrates the utilization process of the proposed brain-controlled robotic arm.
Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE) , 2025. Vol. 12, no 11, p. 17210-17222
Keywords [en]
Brain-controlled robotic arm, brain-machine interface (BMI), embodied visual evoked potential (E-VEP) paradigm, human-machine interactions, Internet of Things (IoT), motion planner
National Category
Robotics and automation
Identifiers
URN: urn:nbn:se:kth:diva-367926DOI: 10.1109/JIOT.2025.3535560ISI: 001492137800003Scopus ID: 2-s2.0-85218801904OAI: oai:DiVA.org:kth-367926DiVA, id: diva2:1987514
Note
QC 20250806
2025-08-062025-08-062025-08-06Bibliographically approved