Please use this identifier to cite or link to this item:
http://hdl.handle.net/10397/109475
Title: | Computation offloading and resource allocation in LEO satellite-terrestrial integrated networks with system state delay | Authors: | Xie, B Cui, H Ho, IWH He, Y Guizani, M |
Issue Date: | Mar-2025 | Source: | IEEE transactions on mobile computing, Mar. 2025, v. 24, no. 3, p. 1372-1385 | Abstract: | Computing offloading optimization for energy saving is becoming increasingly important in low-Earth orbit (LEO) satellite-terrestrial integrated networks (STINs) since battery techniques has not kept up with the demand of ground terminal devices. In this paper, we design a delay-based deep reinforcement learning (DRL) framework specifically for computation offloading decisions, which can effectively reduce the energy consumption. Additionally, we develop a multi-level feedback queue for computing allocation (RAMLFQ), which can effectively enhance the CPU's efficiency in task scheduling. We initially formulate the computation offloading problem with the system delay as Delay Markov Decision Processes (DMDPs), and then transform them into the equivalent standard Markov Decision Processes (MDPs). To solve the optimization problem effectively, we employ a double deep Q-network (DDQN) method, enhancing it with an augmented state space to better handle the unique challenges posed by system delays. Simulation results demonstrate that the proposed learning-based computing offloading algorithm achieves high levels of performance efficiency and attains a lower total cost compared to other existing offloading methods. | Keywords: | Computing offloading Deep reinforcement learning Satellite-terrestrial integrated networks System state delays in learning |
Publisher: | Institute of Electrical and Electronics Engineers | Journal: | IEEE transactions on mobile computing | ISSN: | 1536-1233 | EISSN: | 1558-0660 | DOI: | 10.1109/TMC.2024.3479243 | Rights: | © 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The following publication B. Xie, H. Cui, I. W. -H. Ho, Y. He and M. Guizani, "Computation Offloading and Resource Allocation in LEO Satellite-Terrestrial Integrated Networks With System State Delay," in IEEE Transactions on Mobile Computing, vol. 24, no. 3, pp. 1372-1385, March 2025 is available at https://doi.org/10.1109/TMC.2024.3479243. |
Appears in Collections: | Journal/Magazine Article |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
Xie_Computation_Offloading_Resource.pdf | Pre-Published version | 6.22 MB | Adobe PDF | View/Open |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.