kth.sePublications KTH
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Satellite-Based ITS Data Offloading & Computation in 6G Networks: A Cooperative Multi-Agent Proximal Policy Optimization DRL With Attention Approach
Kyung Hee University, Department of Computer Science and Engineering, Yongin, Gyeonggi-do, Republic of Korea.
Kyung Hee University, Department of Computer Science and Engineering, Yongin, Gyeonggi-do, Republic of Korea.
KTH, School of Electrical Engineering and Computer Science (EECS), Computer Science, Network and Systems Engineering.ORCID iD: 0000-0002-8557-0082
Virginia Tech, Department of Electrical and Computer Engineering, Blacksburg, VA, USA.
Show others and affiliations
2024 (English)In: IEEE Transactions on Mobile Computing, ISSN 1536-1233, E-ISSN 1558-0660, Vol. 23, no 5, p. 4956-4974Article in journal (Refereed) Published
Abstract [en]

The proliferation of intelligent transportation systems (ITS) has led to increasing demand for diverse network applications. However, conventional terrestrial access networks (TANs) are inadequate in accommodating various applications for remote ITS nodes, i.e., airplanes and ships. In contrast, satellite access networks (SANs) offer supplementary support for TANs, in terms of coverage flexibility and availability. In this study, we propose a novel approach to ITS data offloading and computation services based on SANs. We use low-Earth orbit (LEO) and cube satellites (CubeSats) as independent mobile edge computing (MEC) servers that schedule the processing of data generated by ITS nodes. To optimize offloading task selection, computing, and bandwidth resource allocation for different satellite servers, we formulate a joint delay and rental price minimization problem that is mixed-integer non-linear programming (MINLP) and NP-hard. We propose a cooperative multi-agent proximal policy optimization (Co-MAPPO) deep reinforcement learning (DRL) approach with an attention mechanism to deal with intelligent offloading decisions. We also decompose the remaining subproblem into three independent subproblems for resource allocation and use convex optimization techniques to obtain their optimal closed-form analytical solutions. We conduct extensive simulations and compare our proposed approach to baselines, resulting in performance improvements of 9.9%, 5.2%, and 4.2%, respectively.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE) , 2024. Vol. 23, no 5, p. 4956-4974
Keywords [en]
attention mechanism, cooperative multi-agent proximal policy optimization, deep reinforcement learning, intelligent transportation systems, mobile edge computing, Satellite access networks
National Category
Telecommunications Communication Systems Computer Sciences
Identifiers
URN: urn:nbn:se:kth:diva-366938DOI: 10.1109/TMC.2023.3300314ISI: 001198016900036Scopus ID: 2-s2.0-85166772430OAI: oai:DiVA.org:kth-366938DiVA, id: diva2:1983550
Note

QC 20250711

Available from: 2025-07-11 Created: 2025-07-11 Last updated: 2025-12-05Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Tun, Yan Kyaw

Search in DiVA

By author/editor
Tun, Yan Kyaw
By organisation
Network and Systems Engineering
In the same journal
IEEE Transactions on Mobile Computing
TelecommunicationsCommunication SystemsComputer Sciences

Search outside of DiVA

GoogleGoogle Scholar

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 53 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf