Please use this identifier to cite or link to this item: http://hdl.handle.net/10397/109475
PIRA download icon_1.1View/Download Full Text
Title: Computation offloading and resource allocation in LEO satellite-terrestrial integrated networks with system state delay
Authors: Xie, B
Cui, H
Ho, IWH 
He, Y
Guizani, M
Issue Date: Mar-2025
Source: IEEE transactions on mobile computing, Mar. 2025, v. 24, no. 3, p. 1372-1385
Abstract: Computing offloading optimization for energy saving is becoming increasingly important in low-Earth orbit (LEO) satellite-terrestrial integrated networks (STINs) since battery techniques has not kept up with the demand of ground terminal devices. In this paper, we design a delay-based deep reinforcement learning (DRL) framework specifically for computation offloading decisions, which can effectively reduce the energy consumption. Additionally, we develop a multi-level feedback queue for computing allocation (RAMLFQ), which can effectively enhance the CPU's efficiency in task scheduling. We initially formulate the computation offloading problem with the system delay as Delay Markov Decision Processes (DMDPs), and then transform them into the equivalent standard Markov Decision Processes (MDPs). To solve the optimization problem effectively, we employ a double deep Q-network (DDQN) method, enhancing it with an augmented state space to better handle the unique challenges posed by system delays. Simulation results demonstrate that the proposed learning-based computing offloading algorithm achieves high levels of performance efficiency and attains a lower total cost compared to other existing offloading methods.
Keywords: Computing offloading
Deep reinforcement learning
Satellite-terrestrial integrated networks
System state delays in learning
Publisher: Institute of Electrical and Electronics Engineers
Journal: IEEE transactions on mobile computing 
ISSN: 1536-1233
EISSN: 1558-0660
DOI: 10.1109/TMC.2024.3479243
Rights: © 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
The following publication B. Xie, H. Cui, I. W. -H. Ho, Y. He and M. Guizani, "Computation Offloading and Resource Allocation in LEO Satellite-Terrestrial Integrated Networks With System State Delay," in IEEE Transactions on Mobile Computing, vol. 24, no. 3, pp. 1372-1385, March 2025 is available at https://doi.org/10.1109/TMC.2024.3479243.
Appears in Collections:Journal/Magazine Article

Files in This Item:
File Description SizeFormat 
Xie_Computation_Offloading_Resource.pdfPre-Published version6.22 MBAdobe PDFView/Open
Open Access Information
Status open access
File Version Final Accepted Manuscript
Access
View full-text via PolyU eLinks SFX Query
Show full item record

Page views

62
Citations as of Apr 1, 2025

Google ScholarTM

Check

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.