kth.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Two-Timescale Synchronization and Migration for Digital Twin Networks: A Multi-Agent Deep Reinforcement Learning Approach
Hong Kong Metropolitan Univ, Sch Sci & Technol, Hong Kong, Peoples R China..
Hong Kong Metropolitan Univ, Sch Sci & Technol, Hong Kong, Peoples R China..
KTH, School of Electrical Engineering and Computer Science (EECS), Computer Science, Network and Systems Engineering. Hong Kong Metropolitan Univ, Sch Sci & Technol, Hong Kong, Peoples R China.;KTH Royal Inst Technol, Sch Elect Engn & Comp Sci, S-11428 Stockholm, Sweden..
Hong Kong Metropolitan Univ, Sch Sci & Technol, Hong Kong, Peoples R China..ORCID iD: 0000-0002-3976-0053
Show others and affiliations
2024 (English)In: IEEE Transactions on Wireless Communications, ISSN 1536-1276, E-ISSN 1558-2248, Vol. 23, no 11, p. 17294-17309Article in journal (Refereed) Published
Abstract [en]

Digital twins (DTs) have emerged as a promising enabler for representing the real-time states of physical worlds and realizing self-sustaining systems. In practice, DTs of physical devices, such as mobile users (MUs), are commonly deployed in multi-access edge computing (MEC) networks for the sake of reducing latency. To ensure the accuracy and fidelity of DTs, it is essential for MUs to regularly synchronize their status with their DTs. However, MU mobility introduces significant challenges to DT synchronization. Firstly, MU mobility triggers DT migration which could cause synchronization failures. Secondly, MUs require frequent synchronization with their DTs to ensure DT fidelity. Nonetheless, DT migration among MEC servers, caused by MU mobility, may occur infrequently. Accordingly, we propose a two-timescale DT synchronization and migration framework with reliability consideration by establishing a non-convex stochastic problem to minimize the long-term average energy consumption of MUs. We use Lyapunov theory to convert the reliability constraints and reformulate the new problem as a partially observable Markov decision-making process (POMDP). Furthermore, we develop a heterogeneous agent proximal policy optimization with Beta distribution (Beta-HAPPO) method to solve it. Numerical results show that our proposed Beta-HAPPO method achieves significant improvements in energy savings when compared with other benchmarks.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE) , 2024. Vol. 23, no 11, p. 17294-17309
Keywords [en]
Synchronization, Real-time systems, Wireless communication, Reliability, Optimization, Servers, Resource management, Digital twin (DT), heterogeneous agent proximal policy optimization (HAPPO), DT migration, multi-access edge computing (MEC), resource allocation, DT synchronization
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:kth:diva-357227DOI: 10.1109/TWC.2024.3452689ISI: 001355813300094Scopus ID: 2-s2.0-85204248889OAI: oai:DiVA.org:kth-357227DiVA, id: diva2:1919509
Note

QC 20241209

Available from: 2024-12-09 Created: 2024-12-09 Last updated: 2024-12-09Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Search in DiVA

By author/editor
Guo, YongnaWang, Fu LeeZhang, Yan
By organisation
Network and Systems Engineering
In the same journal
IEEE Transactions on Wireless Communications
Computer Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 16 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf