kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Out-of-order execution enabled deep reinforcement learning for dynamic additive manufacturing scheduling
Department of Industrial and Systems Engineering, The Hong Kong Polytechnic University, Hong Kong, China.
Research Institute for Advanced Manufacturing, The Hong Kong Polytechnic University, Hong Kong, China.
Department of Industrial and Systems Engineering, The Hong Kong Polytechnic University, Hong Kong, China; Research Institute for Advanced Manufacturing, The Hong Kong Polytechnic University, Hong Kong, China; State Key Laboratory of Intelligent Manufacturing Equipment and Technology, Huazhong University of Science and Technology, Wuhan, China.
Department of Economics and Management, Nanjing University of Aeronautics and Astronautics, Nanjing, China.
Show others and affiliations
2025 (English)In: Robotics and Computer-Integrated Manufacturing, ISSN 0736-5845, E-ISSN 1879-2537, Vol. 91, article id 102841Article in journal (Refereed) Published
Abstract [en]

Additive Manufacturing (AM) has revolutionized the production landscape by enabling on-demand customized manufacturing. However, the efficient management of dynamic AM orders poses significant challenges for production planning and scheduling. This paper addresses the dynamic scheduling problem considering batch processing, random order arrival and machine eligibility constraints, aiming to minimize total tardiness in a parallel non-identical AM machine environment. To tackle this problem, we propose the out-of-order enabled dueling deep Q network (O3-DDQN) approach. In the proposed approach, the problem is formulated as a Markov decision process (MDP). Three-dimensional features, encompassing dynamic orders, AM machines, and delays, are extracted using a ‘look around’ method to represent the production status at a rescheduling point. Additionally, five novel composite scheduling rules based on the out-of-order principle are introduced for selection when an AM machine completes processing or a new order arrives. Moreover, we design a reward function that is strongly correlated with the objective to evaluate the agent's chosen action. Experimental results demonstrate the superiority of the O3-DDQN approach over single scheduling rules, randomly selected rules, and the classic DQN method. The average improvement rate of performance reaches 13.09% compared to composite scheduling rules and random rules. Additionally, the O3-DDQN outperforms the classic DQN agent with a 6.54% improvement rate. The O3-DDQN algorithm improves scheduling in dynamic AM environments, enhancing productivity and on-time delivery. This research contributes to advancing AM production and offers insights into efficient resource allocation.

Place, publisher, year, edition, pages
Elsevier BV , 2025. Vol. 91, article id 102841
Keywords [en]
Additive manufacturing, Dueling DQN, Dynamic order arrival, Dynamic scheduling, Out-of-order
National Category
Computer Sciences Production Engineering, Human Work Science and Ergonomics
Identifiers
URN: urn:nbn:se:kth:diva-351700DOI: 10.1016/j.rcim.2024.102841ISI: 001285855300001Scopus ID: 2-s2.0-85199899989OAI: oai:DiVA.org:kth-351700DiVA, id: diva2:1888663
Note

QC 20240823

Available from: 2024-08-13 Created: 2024-08-13 Last updated: 2024-08-29Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Wang, Lihui

Search in DiVA

By author/editor
Wang, Lihui
By organisation
Industrial Production Systems
In the same journal
Robotics and Computer-Integrated Manufacturing
Computer SciencesProduction Engineering, Human Work Science and Ergonomics

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 39 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf