kth.sePublications
Change search
Link to record
Permanent link

Direct link
Publications (10 of 583) Show all publications
Zhang, Z., Wang, Y., Zhang, Z., Wang, L., Huang, H. & Cao, Q. (2024). A residual reinforcement learning method for robotic assembly using visual and force information. Journal of manufacturing systems, 72, 245-262
Open this publication in new window or tab >>A residual reinforcement learning method for robotic assembly using visual and force information
Show others...
2024 (English)In: Journal of manufacturing systems, ISSN 0278-6125, E-ISSN 1878-6642, Vol. 72, p. 245-262Article in journal (Refereed) Published
Abstract [en]

Robotic autonomous assembly is critical in intelligent manufacturing and has always been a research hotspot. Most previous approaches rely on prior knowledge, such as geometric parameters and pose information of the assembled parts, which are hard to estimate in unstructured environments. This paper proposes a residual reinforcement learning (RL) policy for robotic assembly via combining visual and force information. The residual RL policy, which consists of a visual-based policy and a force-based policy, is trained and tested in an end-to-end manner. In the assembly procedure, the visual-based policy focuses on spatial search, while the force-based policy handles the interactive behaviors. The experimental results reveal the high sample efficiency of our approach, which exhibits the ability to generalize across diverse assembly tasks involving variations in geometries, clearances, and configurations. The validation experiments are conducted both in simulation and on a real robot.

Place, publisher, year, edition, pages
Elsevier BV, 2024
Keywords
Compliance control, Residual reinforcement learning, Robotic assembly, Visual and force perception
National Category
Robotics
Identifiers
urn:nbn:se:kth:diva-341697 (URN)10.1016/j.jmsy.2023.11.008 (DOI)001140126900001 ()2-s2.0-85179753333 (Scopus ID)
Note

QC 20231229

Available from: 2023-12-29 Created: 2023-12-29 Last updated: 2024-02-01Bibliographically approved
Li, X., Yue, C., Liu, X., Zhou, J. & Wang, L. (2024). ACWGAN-GP for milling tool breakage monitoring with imbalanced data. Robotics and Computer-Integrated Manufacturing, 85, Article ID 102624.
Open this publication in new window or tab >>ACWGAN-GP for milling tool breakage monitoring with imbalanced data
Show others...
2024 (English)In: Robotics and Computer-Integrated Manufacturing, ISSN 0736-5845, E-ISSN 1879-2537, Vol. 85, article id 102624Article in journal (Refereed) Published
Abstract [en]

Tool breakage monitoring (TBM) during milling operations is crucial for ensuring workpiece quality and mini-mizing economic losses. Under the premise of sufficient training data with a balanced distribution, TBM methods based on statistical analysis and artificial intelligence enable accurate recognition of tool breakage conditions. However, considering the actual manufacturing safety, cutting tools usually work in normal wear conditions, and acquiring tool breakage signals is extremely difficult. The data imbalance problem seriously affects the recog-nition accuracy and robustness of the TBM model. This paper proposes a TBM method based on the auxiliary classier Wasserstein generative adversarial network with gradient penalty (ACWGAN-GP) from the perspective of data generation. By introducing Wasserstein distance and gradient penalty terms into the loss function of ACGAN, ACWGAN-GP can generate multi-class fault samples while improving the network's stability during adversarial training. A sample filter based on multiple statistical indicators is designed to ensure the quality and diversity of the generated data. Qualified samples after quality assessment are added to the original imbalanced dataset to improve the tool breakage classifier's performance. Artificially controlled face milling experiments for TBM are carried out on a five-axis CNC machine to verify the effectiveness of the proposed method. Experimental results reveal that the proposed method outperforms other popular imbalance fault diagnosis methods in terms of data generation quality and TBM accuracy, and can meet the real-time requirements of TBMs.

Place, publisher, year, edition, pages
Elsevier BV, 2024
Keywords
Tool breakage monitoring, Milling tool, Imbalanced data, Generative adversarial network, ACWGAN-GP, Deep learning
National Category
Other Civil Engineering
Identifiers
urn:nbn:se:kth:diva-335183 (URN)10.1016/j.rcim.2023.102624 (DOI)001051111800001 ()2-s2.0-85166476791 (Scopus ID)
Note

QC 20230901

Available from: 2023-09-01 Created: 2023-09-01 Last updated: 2023-09-04Bibliographically approved
Urgo, M., Berardinucci, F., Zheng, P. & Wang, L. (2024). AI-Based Pose Estimation of Human Operators in Manufacturing Environments. In: Lecture Notes in Mechanical Engineering: (pp. 3-38). Springer Nature, Part F2256
Open this publication in new window or tab >>AI-Based Pose Estimation of Human Operators in Manufacturing Environments
2024 (English)In: Lecture Notes in Mechanical Engineering, Springer Nature , 2024, Vol. Part F2256, p. 3-38Chapter in book (Other academic)
Abstract [en]

The fast development of AI-based approaches for image recognition has driven the availability of fast and reliable tools for identifying the human body in captured videos (both 2D and 3D). This has increased the feasibility and effectiveness of approaches for human pose estimation in industrial environments. This essay will cover different approaches for estimating the human pose based on neural networks (e.g., CNN, LSTM, etc.), addressing the workflow and requirements for their implementation and use. A brief analysis and comparison of the existing AI-based frameworks and approaches will be carried out (e.g. OpenPose, MediaPipe) together with a listing of the related hardware and software requirements. Finally, two case studies presenting applications in the manufacturing sector are provided.

Place, publisher, year, edition, pages
Springer Nature, 2024
Keywords
Computer vision, Human pose estimation, Manual processes, Monitoring
National Category
Software Engineering
Identifiers
urn:nbn:se:kth:diva-344039 (URN)10.1007/978-3-031-54034-9_1 (DOI)2-s2.0-85185519584 (Scopus ID)
Note

QC 20240229

Available from: 2024-02-28 Created: 2024-02-28 Last updated: 2024-02-29Bibliographically approved
Li, D., Li, Y., Liu, C., Liu, X. & Wang, L. (2024). An online inference method for condition identification of workpieces with complex residual stress distributions. Journal of manufacturing systems, 73, 192-204
Open this publication in new window or tab >>An online inference method for condition identification of workpieces with complex residual stress distributions
Show others...
2024 (English)In: Journal of manufacturing systems, ISSN 0278-6125, E-ISSN 1878-6642, Vol. 73, p. 192-204Article in journal (Refereed) Published
Abstract [en]

The residual stress field of structural components significantly influences their comprehensive performance and service life. Due to the lack of effective representation means and inference methods, existing methods are confined to inspecting local residual stress rather than the entire residual stress field, rendering the inference of complex residual stress fields quite difficult. In response to the challenges associated with the requirement for extensive sets of deformation force data from the current workpiece and the inherent difficulty in establishing a stable relationship between deformation forces and residual stress fields, this paper introduces a novel inference method of residual stress field is proposed based on a data-causal knowledge fusion model, where causal knowledge is introduced to eliminate the coupling effect of geometric change on residual stress, which can make up the drawback of pure data driven model. The proposed approach can accurately inference the residual stress within the workpieces, which provides an important basis for deformation control and part property improvement.

Place, publisher, year, edition, pages
Elsevier BV, 2024
Keywords
Condition identification, Coupling effect, Data-causal knowledge fusion model, Residual stress field, Stable relationship
National Category
Materials Engineering
Identifiers
urn:nbn:se:kth:diva-343673 (URN)10.1016/j.jmsy.2024.01.012 (DOI)2-s2.0-85184522579 (Scopus ID)
Note

QC 20240222

Available from: 2024-02-22 Created: 2024-02-22 Last updated: 2024-02-22Bibliographically approved
Liu, S., Wang, L. & Gao, R. X. (2024). Cognitive neuroscience and robotics: Advancements and future research directions. Robotics and Computer-Integrated Manufacturing, 85, Article ID 102610.
Open this publication in new window or tab >>Cognitive neuroscience and robotics: Advancements and future research directions
2024 (English)In: Robotics and Computer-Integrated Manufacturing, ISSN 0736-5845, E-ISSN 1879-2537, Vol. 85, article id 102610Article, review/survey (Refereed) Published
Abstract [en]

In recent years, brain-based technologies that capitalise on human abilities to facilitate human–system/robot interactions have been actively explored, especially in brain robotics. Brain–computer interfaces, as applications of this conception, have set a path to convert neural activities recorded by sensors from the human scalp via electroencephalography into valid commands for robot control and task execution. Thanks to the advancement of sensor technologies, non-invasive and invasive sensor headsets have been designed and developed to achieve stable recording of brainwave signals. However, robust and accurate extraction and interpretation of brain signals in brain robotics are critical to reliable task-oriented and opportunistic applications such as brainwave-controlled robotic interactions. In response to this need, pervasive technologies and advanced analytical approaches to translating and merging critical brain functions, behaviours, tasks, and environmental information have been a focus in brain-controlled robotic applications. These methods are composed of signal processing, feature extraction, representation of neural activities, command conversion and robot control. Artificial intelligence algorithms, especially deep learning, are used for the classification, recognition, and identification of patterns and intent underlying brainwaves as a form of electroencephalography. Within the context, this paper provides a comprehensive review of the past and the current status at the intersection of robotics, neuroscience, and artificial intelligence and highlights future research directions.

Place, publisher, year, edition, pages
Elsevier BV, 2024
Keywords
Brain robotics, Brainwave/electroencephalography, Brain–computer interface, Deep learning, Robot control, Signal processing
National Category
Production Engineering, Human Work Science and Ergonomics
Identifiers
urn:nbn:se:kth:diva-333952 (URN)10.1016/j.rcim.2023.102610 (DOI)001049545100001 ()2-s2.0-85165534271 (Scopus ID)
Note

QC 20230818

Available from: 2023-08-18 Created: 2023-08-18 Last updated: 2023-09-01Bibliographically approved
Huang, Z., Li, W., Zhu, J. & Wang, L. (2024). Cross-domain tool wear condition monitoring via residual attention hybrid adaptation network. Journal of manufacturing systems, 72, 406-423
Open this publication in new window or tab >>Cross-domain tool wear condition monitoring via residual attention hybrid adaptation network
2024 (English)In: Journal of manufacturing systems, ISSN 0278-6125, E-ISSN 1878-6642, Vol. 72, p. 406-423Article in journal (Refereed) Published
Abstract [en]

Intelligent models for tool wear condition monitoring (TWCM) have been extensively researched. However, in industrial scenarios, limited acquired monitoring signals and variations of machining parameters lead to insufficient training samples and data distribution shifts for the models. To address the issues, this research presents a novel residual attention hybrid adaptation network (RAHAN) model based on a residual attention network (ResAttNet) and a hybrid adaptation strategy. In the RAHAN model, by integrating a channel attention mechanism and deep residual modules, ResAttNet is designed as a feature extractor to acquire features from monitoring signals for tool wear conditions. Embedding subdomain adaptation into a condition recognizer while establishing separate adversarial learning in a domain obfuscator, the hybrid adaptation strategy is developed to eliminate global distribution shifts and align local distributions of each tool wear phase simultaneously. Six migration tasks under a laboratory and two factory machining platforms were conducted to evaluate the effectiveness of the RAHAN model. Compared with a baseline model, four ablation models, and six state-of-the-art transfer learning models, the RAHAN model achieved the highest average accuracy of 92.70% on six migration tasks. Furthermore, the RAHAN model shows clearer feature representations of each tool wear condition than other compared models. The comparative results demonstrate that the RAHAN model has superior transferability and therefore can be considered as a good potential solution to support cross-domain TWCM under different machining processes.

Place, publisher, year, edition, pages
Elsevier BV, 2024
Keywords
Adversarial domain adaptation, Deep transfer learning, Subdomain adaptation, Tool wear condition monitoring
National Category
Computer Systems
Identifiers
urn:nbn:se:kth:diva-342196 (URN)10.1016/j.jmsy.2023.12.003 (DOI)001146008200001 ()2-s2.0-85180983978 (Scopus ID)
Note

QC 20240115

Available from: 2024-01-15 Created: 2024-01-15 Last updated: 2024-02-06Bibliographically approved
Li, X., Liu, X., Yue, C., Wang, L. & Liang, S. Y. (2024). Data-model linkage prediction of tool remaining useful life based on deep feature fusion and Wiener process. Journal of manufacturing systems, 73, 19-38
Open this publication in new window or tab >>Data-model linkage prediction of tool remaining useful life based on deep feature fusion and Wiener process
Show others...
2024 (English)In: Journal of manufacturing systems, ISSN 0278-6125, E-ISSN 1878-6642, Vol. 73, p. 19-38Article in journal (Refereed) Published
Abstract [en]

Accurately predicting the tool remaining useful life (RUL) is critical for maximizing tool utilization and saving machining costs. Various physical model-based or data-driven prediction methods have been developed and successfully applied in different machining operations. However, many uncertain factors affect tool RUL during the cutting process, making it challenging to create a precise physical model to characterize the degradation of tool performance. The success of the purely data-driven technique depends on the amount and quality of the training samples, it does not consider the physical law of tool wear, and the interpretability of the prediction results is poor. This paper presents a data-model linkage approach for tool RUL prediction based on deep feature fusion and Wiener process to address the above limitations. A convolutional stacked bidirectional long short-term memory network with time-space attention mechanism (CSBLSTM-TSAM) is developed in the data-driven module to fuse the multi-sensor signals collected during the cutting process and then obtain the mapping relationship between signal features and tool wear values. In the physical modeling module, a three-stage tool RUL prediction model based on the nonlinear Wiener process is established by considering the evolution law of different wear stages and multi-layer uncertainty, and the corresponding probability density function is derived. The real-time estimated tool wear of the data-driven module is used as the observed value of the physical model, and the model parameters are dynamically updated by the weight-optimized particle filter (WOPF) algorithm under a Bayesian framework, thereby realizing the data-model linkage tool RUL prediction. Milling experiments demonstrate that the proposed method not only improves RUL prediction accuracy, but also has good generalization ability and robustness for prediction tasks under different working conditions.

Place, publisher, year, edition, pages
Elsevier BV, 2024
Keywords
Data-model linkage, Feature fusion, Remaining useful life prediction, Tool wear, Weight-optimized particle filter, Wiener process
National Category
Bioinformatics (Computational Biology)
Identifiers
urn:nbn:se:kth:diva-342827 (URN)10.1016/j.jmsy.2024.01.008 (DOI)2-s2.0-85183028791 (Scopus ID)
Note

QC 20240201

Available from: 2024-01-31 Created: 2024-01-31 Last updated: 2024-02-01Bibliographically approved
Wang, B., Zhou, H., Li, X., Yang, G., Zheng, P., Song, C., . . . Wang, L. (2024). Human Digital Twin in the context of Industry 5.0. Robotics and Computer-Integrated Manufacturing, 85, Article ID 102626.
Open this publication in new window or tab >>Human Digital Twin in the context of Industry 5.0
Show others...
2024 (English)In: Robotics and Computer-Integrated Manufacturing, ISSN 0736-5845, E-ISSN 1879-2537, Vol. 85, article id 102626Article, review/survey (Refereed) Published
Abstract [en]

Human-centricity, a core value of Industry 5.0, places humans in the center of production. It leads to the prioritization of human needs, spanning from health and safety to self-actualization and personal growth. The concept of the Human Digital Twin (HDT) is proposed as a critical method to realize human-centricity in smart manufacturing systems towards Industry 5.0. HDTs are digital representations of humans, aiming to change the practice of human-system integration by coupling humans’ characteristics directly to the system design and its performance. In-depth analysis, critical insights, and application guidelines of HDT are essential to realize the concept of Industry 5.0 in practice and evolve the smart manufacturing paradigm in modern factories. However, the investigation on the development of HDT to evolve humans’ roles and develop humans to their full potential is limited to date. Recent studies are rarely geared towards designing a standardized framework and architecture of HDT for diverse real-world applications. Thus, this work aims to close this research gap by carrying out a comprehensive survey on HDT in the context of Industry 5.0, summarizing the ongoing evolution, and proposing a proper connotation of HDT, before discussing the conceptual framework and system architecture of HDT and analyzing enabling technologies and industrial applications. This work provides guidance on possible avenues as well as challenges for the further development of HDT and its related concepts, allowing humans to reach their potential and accommodating their diverse needs in the futuristic smart manufacturing systems shaped by Industry 5.0.

Place, publisher, year, edition, pages
Elsevier Ltd, 2024
Keywords
Human Digital Twin, Human-centricity, Industry 5.0, Smart manufacturing
National Category
Production Engineering, Human Work Science and Ergonomics
Identifiers
urn:nbn:se:kth:diva-334927 (URN)10.1016/j.rcim.2023.102626 (DOI)001051239100001 ()2-s2.0-85166028251 (Scopus ID)
Note

QC 20230830

Available from: 2023-08-30 Created: 2023-08-30 Last updated: 2023-09-21Bibliographically approved
Zhang, X., Zheng, L., Fan, W., Ji, W., Mao, L. & Wang, L. (2024). Knowledge graph and function block based Digital Twin modeling for robotic machining of large-scale components. Robotics and Computer-Integrated Manufacturing, 85, 102609, Article ID 102609.
Open this publication in new window or tab >>Knowledge graph and function block based Digital Twin modeling for robotic machining of large-scale components
Show others...
2024 (English)In: Robotics and Computer-Integrated Manufacturing, ISSN 0736-5845, E-ISSN 1879-2537, Vol. 85, p. 102609-, article id 102609Article in journal (Refereed) Published
Abstract [en]

Robotic machining is a potential method for machining large-scale components (LSCs) due to its low cost and high flexibility. However, the low stiffness of robots and complex machining process of LSCs result in a lack of alignment between the physical process and digital models, making it difficult to realize the robotic machining of LSCs. The recent Digital Twin (DT) concept shows potential in terms of representing and modeling physical processes. Therefore, this study proposes a robotic machining DT for LSCs. However, the current DT is not capable of knowledge representation, multi-source data integration, optimization algorithm implementation, and real-time control. To address these issues, Knowledge Graph (KG) and Function Block (FB) are employed in the proposed robotic machining DT. Here, robotic machining related information, such as the machining parameters and errors, is represented in the virtual space by building the KG, whereas the FBs are responsible for integrating and applying the algorithms for process execution and optimization based on real-world events. Moreover, a novel adaptive process adjustment strategy is proposed to improve the efficiency of the process execution. Finally, a prototype system of the robotic machining DT is developed and validated by an experiment on robotic milling of the assembly interface for an LSC. The results demonstrate that the robotic machining is successfully optimized and improved by the proposed method.

Place, publisher, year, edition, pages
Elsevier BV, 2024
Keywords
Digital Twin, Function block, Knowledge graph, Large-scale components, Process planning and execution, Robotic machining
National Category
Robotics Production Engineering, Human Work Science and Ergonomics
Identifiers
urn:nbn:se:kth:diva-334956 (URN)10.1016/j.rcim.2023.102609 (DOI)001048681300001 ()2-s2.0-85167999619 (Scopus ID)
Note

QC 20230830

Available from: 2023-08-30 Created: 2023-08-30 Last updated: 2023-09-04Bibliographically approved
Mourtzis, D., Ong, S. K., Wang, X. V., Panopoulos, N., Stark, R. & Wang, L. (2024). Modelling, Design and Simulation as-a-Service Based on Extended Reality (XR) in Industry 4.0. In: CIRP Novel Topics in Production Engineering: Volume 1: (pp. 99-143). Springer Nature, Part F2256
Open this publication in new window or tab >>Modelling, Design and Simulation as-a-Service Based on Extended Reality (XR) in Industry 4.0
Show others...
2024 (English)In: CIRP Novel Topics in Production Engineering: Volume 1, Springer Nature , 2024, Vol. Part F2256, p. 99-143Chapter in book (Other academic)
Abstract [en]

Modelling and Simulation (M&S) are critical capabilities for Cloud Computing. M&S products and services are valuable resources that have to be easily accessible and available on demand in a cost-effective way to users; they provide the required level of agility so that capabilities can be integrated quickly and easily. To address new design and manufacturing challenges in Industry 4.0, digital-driven technologies use simulation tools, Computer Aided Design (CAD), Product Lifecycle Management (PLM) systems and Extended Reality (XR) services to support digital design and information flow throughout a product lifecycle. Thus, XR creates new business value by improving the customer journey, optimizing employee performance, and developing new content and services. The vision of Modelling and Simulation as a Service (MSaaS) aims to make products, data, and processes easily accessible and available on-demand to all users to improve operational effectiveness. The scope of this essay is to provide a comprehensive vision of MSaaS for products, data, and processes in combination with XR services to improve operational effectiveness under the framework of Industry 4.0.

Place, publisher, year, edition, pages
Springer Nature, 2024
Series
Lecture Notes in Mechanical Engineering, ISSN 2195-4356, E-ISSN 2195-4364
National Category
Production Engineering, Human Work Science and Ergonomics
Identifiers
urn:nbn:se:kth:diva-344040 (URN)10.1007/978-3-031-54034-9_4 (DOI)2-s2.0-85185493095 (Scopus ID)
Note

Part of ISBN 978-3-031-54034-9

QC 20240304

Available from: 2024-02-28 Created: 2024-02-28 Last updated: 2024-03-04Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0001-8679-8049

Search in DiVA

Show all publications