• Complex
  • Title
  • Keyword
  • Abstract
  • Scholars
  • Journal
  • ISSN
  • Conference
成果搜索

author:

Zhang, Xiaoqi (Zhang, Xiaoqi.) [1] | Cheng, Hongju (Cheng, Hongju.) [2] (Scholars:程红举) | Yu, Zhiyong (Yu, Zhiyong.) [3] (Scholars:於志勇) | Xiong, Neal N. (Xiong, Neal N..) [4]

Indexed by:

EI Scopus SCIE

Abstract:

By migrating tasks from the end devices to the edge or cloud, cooperative computing in the Internet of Things can support time-sensitive, high-dimensional, and complex applications while utilizing existing resources, such as the network bandwidth, computing resources, and storage capacity. How to design the multiresource allocation system efficiently is a significant research problem. In this article, we design a multiresource allocation system for cooperative computing in the Internet of Things based on deep reinforcement learning by redefining latency calculation models for communication, computation, and caching with the consideration of practical interference factors, such as the Gaussian noise and data loss. The proposed system uses actor-critic as the base model for rapidly approximating the optimal policy by updating parameters of the actor and critic in respective gradient directions. The balance control parameter is introduced to fit the desired learning rate and actual learning rate. At the same time, we use the method of double experience pool to limit the exploration direction of the optimal policy, which reduces the time complexity and space complexity of the problem solution and improves the adaptability and reliability of the scheme. Experiments have demonstrated that multiresource allocation algorithm based on deep reinforcement learning (DRL-MRA) performs well in terms of the average service latency under resource-constrained conditions, and the improvement is significant with the increase of network size.

Keyword:

Cloud computing Computational modeling Cooperative computing deep reinforcement learning (DRL) Internet of Things Optimization Reinforcement learning resource allocation Resource management Task analysis

Community:

  • [ 1 ] [Zhang, Xiaoqi]Fuzhou Univ, Dept Comp Sci, Fuzhou 350116, Peoples R China
  • [ 2 ] [Cheng, Hongju]Fuzhou Univ, Dept Comp Sci, Fuzhou 350116, Peoples R China
  • [ 3 ] [Yu, Zhiyong]Fuzhou Univ, Dept Comp Sci, Fuzhou 350116, Peoples R China
  • [ 4 ] [Zhang, Xiaoqi]Fuzhou Univ, Fujian Prov Key Lab Network Comp & Intelligent In, Fuzhou 350116, Peoples R China
  • [ 5 ] [Cheng, Hongju]Fuzhou Univ, Fujian Prov Key Lab Network Comp & Intelligent In, Fuzhou 350116, Peoples R China
  • [ 6 ] [Yu, Zhiyong]Fuzhou Univ, Fujian Prov Key Lab Network Comp & Intelligent In, Fuzhou 350116, Peoples R China
  • [ 7 ] [Xiong, Neal N.]Ningxia Univ, Sch Informat Engn, Yinchuan 750000, Ningxia, Peoples R China
  • [ 8 ] [Xiong, Neal N.]Northeastern State Univ, Dept Math & Comp Sci, Tahlequah, OK 74464 USA

Reprint 's Address:

Show more details

Related Keywords:

Source :

IEEE INTERNET OF THINGS JOURNAL

ISSN: 2327-4662

Year: 2022

Issue: 16

Volume: 9

Page: 14463-14477

1 0 . 6

JCR@2022

8 . 2 0 0

JCR@2023

ESI Discipline: COMPUTER SCIENCE;

ESI HC Threshold:61

JCR Journal Grade:1

CAS Journal Grade:1

Cited Count:

WoS CC Cited Count: 6

SCOPUS Cited Count: 3

ESI Highly Cited Papers on the List: 0 Unfold All

WanFang Cited Count:

Chinese Cited Count:

30 Days PV: 1

Online/Total:27/10041936
Address:FZU Library(No.2 Xuyuan Road, Fuzhou, Fujian, PRC Post Code:350116) Contact Us:0591-22865326
Copyright:FZU Library Technical Support:Beijing Aegean Software Co., Ltd. 闽ICP备05005463号-1