Distributed DDPG-Based Resource Allocation for Age of Information Minimization in Mobile Wireless-Powered Internet of Things

As a vital metric of information timeliness, Age of Information (AoI) is important for real-time applications in Internet of Things (IoT), such as health monitoring. To satisfy these requirements, we study a wireless-powered IoT (WPIoT), where a static hybrid access point (HAP) coordinates wireless...

Full description

Saved in:
Bibliographic Details
Published inIEEE internet of things journal Vol. 11; no. 17; pp. 29102 - 29115
Main Authors Zheng, Kechen, Luo, Rongwei, Liu, Xiaoying, Qiu, Jiefan, Liu, Jia
Format Journal Article
LanguageEnglish
Japanese
Published Piscataway IEEE 01.09.2024
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects
Age of Information (AoI)
Algorithms
Data transmission
deep deterministic policy gradient (DDPG)
Energy consumption
Heuristic algorithms
Internet of Things
Minimization
mobility
Mobility models
Nodes
Optimization
Polynomials
Real time
Remote monitoring
Resource allocation
Resource management
Wireless sensor networks
wireless-powered Internet of Things (WPIoT)
Online AccessGet full text

Cover

Abstract As a vital metric of information timeliness, Age of Information (AoI) is important for real-time applications in Internet of Things (IoT), such as health monitoring. To satisfy these requirements, we study a wireless-powered IoT (WPIoT), where a static hybrid access point (HAP) coordinates wireless energy transfer to mobile IoT nodes, and mobile IoT nodes transmit data to the HAP or static IoT nodes. We minimize the AoI of mobile IoT nodes by optimizing the selection of the HAP or static IoT node for transmission, the channel selection, the duration of data transmission, and the transmit power, and prove the AoI minimization problem as nondeterministic polynomial hard. To tackle it, we propose a deep deterministic policy gradient (DDPG)-based distributed multinode resource allocation (DDMRA) algorithm, which combines the advantages of the distributed algorithms and centralized algorithms, and combines the selection of discrete actions in the deep Q-network algorithm into the DDPG algorithm. In the DDMRA algorithm, mobile IoT nodes save the energy consumption of transmitting state information to the HAP. Numerical results validate the superior performance of the DDMRA algorithm compared with the baseline algorithms.
AbstractList As a vital metric of information timeliness, Age of Information (AoI) is important for real-time applications in Internet of Things (IoT), such as health monitoring. To satisfy these requirements, we study a wireless-powered IoT (WPIoT), where a static hybrid access point (HAP) coordinates wireless energy transfer to mobile IoT nodes, and mobile IoT nodes transmit data to the HAP or static IoT nodes. We minimize the AoI of mobile IoT nodes by optimizing the selection of the HAP or static IoT node for transmission, the channel selection, the duration of data transmission, and the transmit power, and prove the AoI minimization problem as nondeterministic polynomial hard. To tackle it, we propose a deep deterministic policy gradient (DDPG)-based distributed multinode resource allocation (DDMRA) algorithm, which combines the advantages of the distributed algorithms and centralized algorithms, and combines the selection of discrete actions in the deep Q-network algorithm into the DDPG algorithm. In the DDMRA algorithm, mobile IoT nodes save the energy consumption of transmitting state information to the HAP. Numerical results validate the superior performance of the DDMRA algorithm compared with the baseline algorithms.
Author Luo, Rongwei
Liu, Xiaoying
Liu, Jia
Qiu, Jiefan
Zheng, Kechen
Author_xml – sequence: 1
  givenname: Kechen
  orcidid: 0000-0003-3886-4288
  surname: Zheng
  fullname: Zheng, Kechen
  email: kechenzheng@zjut.edu.cn
  organization: School of Computer Science and Technology, Zhejiang University of Technology, Hangzhou, China
– sequence: 2
  givenname: Rongwei
  surname: Luo
  fullname: Luo, Rongwei
  email: 2112112048@zjut.edu.cn
  organization: School of Computer Science and Technology, Zhejiang University of Technology, Hangzhou, China
– sequence: 3
  givenname: Xiaoying
  orcidid: 0000-0002-4592-0631
  surname: Liu
  fullname: Liu, Xiaoying
  email: xiaoyingliu@zjut.edu.cn
  organization: School of Computer Science and Technology, Zhejiang University of Technology, Hangzhou, China
– sequence: 4
  givenname: Jiefan
  orcidid: 0000-0003-2198-1875
  surname: Qiu
  fullname: Qiu, Jiefan
  email: qiujiefan@zjut.edu.cn
  organization: School of Computer Science and Technology, Zhejiang University of Technology, Hangzhou, China
– sequence: 5
  givenname: Jia
  orcidid: 0000-0002-3424-050X
  surname: Liu
  fullname: Liu, Jia
  email: jliu@nii.ac.jp
  organization: Center for Strategic Cyber Resilience Research and Development, National Institute of Informatics, Tokyo, Japan
BookMark eNp9kEFLAzEQhYMoqLU_QPCw4Hlrsslms8dqtVYqLVLxuCTb2RrZJpqkiOKPN3V7EA-e5r1hvhnmHaN9Yw0gdErwgBBcXtxNZotBhjM2oAxzzNgeOspoVqSM82z_lz5Efe9fMMYRy0nJj9DXSPvgtNoEWCaj0XycXkof5QN4u3E1JMO2tbUM2pqksS4ZriCxTTIx0ay79r02eq0_O6Ojt0q3kDxpBy14n87tO7i4cmICOANhyy-etVn5E3TQyNZDf1d76PHmenF1m05n48nVcJrWVJQhLeNnaqlUqbgoJaeCs4LSIirORa1YkRMFQuaQN01dciU4BUlJLSTGLGOS9tB5t_fV2bcN-FC9xOdMPFlRXHJaiCLDcYp0U7Wz3jtoqlen19J9VARX25yrbc7VNudql3Nkij9MrcNPEsFJ3f5LnnWkBoBfl3KGcUHoN65EjQI
CODEN IITJAU
CitedBy_id crossref_primary_10_3390_app142210256
crossref_primary_10_1109_TVT_2024_3461333
crossref_primary_10_3390_a17100463
crossref_primary_10_3390_s25030624
crossref_primary_10_1109_ACCESS_2024_3469581
crossref_primary_10_1109_ACCESS_2025_3537988
crossref_primary_10_3390_s24175548
crossref_primary_10_3390_s25020396
crossref_primary_10_3390_s24196218
crossref_primary_10_1109_ACCESS_2024_3476471
crossref_primary_10_1049_cmu2_12860
crossref_primary_10_3390_s24144518
crossref_primary_10_1109_ACCESS_2025_3544962
crossref_primary_10_3390_s25020309
crossref_primary_10_3390_drones9020153
crossref_primary_10_1049_cmu2_12852
crossref_primary_10_1109_ACCESS_2025_3550518
crossref_primary_10_3390_app142411720
crossref_primary_10_3390_math13020216
crossref_primary_10_3390_s24227294
crossref_primary_10_1109_ACCESS_2025_3549450
crossref_primary_10_3390_app15010428
crossref_primary_10_3390_s24247980
crossref_primary_10_3390_s24175558
crossref_primary_10_3390_s24227111
Cites_doi 10.1109/JIOT.2020.3005946
10.1109/TWC.2020.3031436
10.1109/TMC.2019.2959774
10.1109/JIOT.2023.3234582
10.1109/TWC.2021.3112568
10.1109/TMC.2018.2885268
10.1109/TCOMM.2021.3073952
10.1109/JIOT.2023.3296437
10.1109/JIOT.2022.3182160
10.1109/JIOT.2023.3326440
10.1109/TCOMM.2023.3274143
10.1109/TVT.2021.3098170
10.1109/GLOBECOM42002.2020.9322415
10.1109/TCOMM.2019.2912605
10.1109/TCOMM.2021.3126626
10.1109/TNET.2010.2048719
10.1109/TCOMM.2020.3014939
10.1109/TCOMM.2022.3226188
10.1109/JSAC.2021.3065057
10.1109/TVT.2020.3029018
10.1109/TWC.2021.3086762
10.1109/TWC.2020.3041750
10.1109/TVT.2021.3095943
10.1109/JIOT.2023.3273521
10.1109/TVT.2016.2582778
10.1109/TWC.2023.3259721
10.1109/TNET.2021.3135494
10.1109/INFCOM.2012.6195689
10.1109/TCOMM.2020.2973629
10.1109/TCOMM.2019.2961083
10.1109/TWC.2022.3225085
10.1109/JIOT.2021.3051418
10.1109/JIOT.2022.3229741
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2024
DBID 97E
RIA
RIE
AAYXX
CITATION
7SC
8FD
JQ2
L7M
L~C
L~D
DOI 10.1109/JIOT.2024.3406044
DatabaseName IEEE Xplore (IEEE)
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Electronic Library (IEL)
CrossRef
Computer and Information Systems Abstracts
Technology Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DatabaseTitle CrossRef
Computer and Information Systems Abstracts
Technology Research Database
Computer and Information Systems Abstracts – Academic
Advanced Technologies Database with Aerospace
ProQuest Computer Science Collection
Computer and Information Systems Abstracts Professional
DatabaseTitleList Computer and Information Systems Abstracts
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Computer Science
EISSN 2327-4662
EndPage 29115
ExternalDocumentID 10_1109_JIOT_2024_3406044
10540071
Genre orig-research
GrantInformation_xml – fundername: Fundamental Research Funds for the Provincial Universities of Zhejiang
  grantid: RF-A2022005
  funderid: 10.13039/100022955
– fundername: National Natural Science Foundation of China
  grantid: 62372413; 62372412
  funderid: 10.13039/501100001809
– fundername: JSPS KAKENHI
  grantid: JP23K16877
– fundername: Project of Cyber Security Establishment with Inter-University Cooperation
GroupedDBID 0R~
6IK
97E
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABJNI
ABQJQ
ABVLG
AGQYO
AHBIQ
AKJIK
AKQYR
ALMA_UNASSIGNED_HOLDINGS
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
EBS
IFIPE
IPLJI
JAVBF
M43
OCL
PQQKQ
RIA
RIE
AAYXX
CITATION
7SC
8FD
JQ2
L7M
L~C
L~D
ID FETCH-LOGICAL-c389t-9024bdbb9b689a638647337a63668cb4751be8a5e5ffc96b863ea31c8a00424a3
IEDL.DBID RIE
ISSN 2327-4662
IngestDate Mon Jun 30 16:55:13 EDT 2025
Thu Apr 24 23:08:02 EDT 2025
Tue Jul 01 00:38:09 EDT 2025
Wed Aug 27 01:55:09 EDT 2025
IsPeerReviewed false
IsScholarly true
Issue 17
Language English
Japanese
License https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
https://doi.org/10.15223/policy-029
https://doi.org/10.15223/policy-037
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c389t-9024bdbb9b689a638647337a63668cb4751be8a5e5ffc96b863ea31c8a00424a3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0003-3886-4288
0000-0002-3424-050X
0000-0002-4592-0631
0000-0003-2198-1875
PQID 3096378720
PQPubID 2040421
PageCount 14
ParticipantIDs crossref_primary_10_1109_JIOT_2024_3406044
ieee_primary_10540071
crossref_citationtrail_10_1109_JIOT_2024_3406044
proquest_journals_3096378720
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2024-09-01
PublicationDateYYYYMMDD 2024-09-01
PublicationDate_xml – month: 09
  year: 2024
  text: 2024-09-01
  day: 01
PublicationDecade 2020
PublicationPlace Piscataway
PublicationPlace_xml – name: Piscataway
PublicationTitle IEEE internet of things journal
PublicationTitleAbbrev JIoT
PublicationYear 2024
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References ref13
ref12
ref34
ref15
ref14
ref31
ref11
ref33
ref10
ref32
ref2
ref1
ref17
ref16
ref19
ref18
Rappaport (ref30) 2002
ref24
ref23
ref26
ref25
ref20
ref22
ref21
ref28
ref27
ref29
ref8
ref7
ref9
ref4
ref3
ref6
ref5
References_xml – ident: ref24
  doi: 10.1109/JIOT.2020.3005946
– ident: ref19
  doi: 10.1109/TWC.2020.3031436
– ident: ref8
  doi: 10.1109/TMC.2019.2959774
– ident: ref33
  doi: 10.1109/JIOT.2023.3234582
– ident: ref12
  doi: 10.1109/TWC.2021.3112568
– ident: ref21
  doi: 10.1109/TMC.2018.2885268
– volume-title: Wireless Communications: Principles and Practice
  year: 2002
  ident: ref30
– ident: ref32
  doi: 10.1109/TCOMM.2021.3073952
– ident: ref15
  doi: 10.1109/JIOT.2023.3296437
– ident: ref14
  doi: 10.1109/JIOT.2022.3182160
– ident: ref22
  doi: 10.1109/JIOT.2023.3326440
– ident: ref4
  doi: 10.1109/TCOMM.2023.3274143
– ident: ref3
  doi: 10.1109/TVT.2021.3098170
– ident: ref27
  doi: 10.1109/GLOBECOM42002.2020.9322415
– ident: ref31
  doi: 10.1109/TCOMM.2019.2912605
– ident: ref34
  doi: 10.1109/TCOMM.2021.3126626
– ident: ref16
  doi: 10.1109/TNET.2010.2048719
– ident: ref18
  doi: 10.1109/TCOMM.2020.3014939
– ident: ref6
  doi: 10.1109/TCOMM.2022.3226188
– ident: ref28
  doi: 10.1109/JSAC.2021.3065057
– ident: ref10
  doi: 10.1109/TVT.2020.3029018
– ident: ref26
  doi: 10.1109/TWC.2021.3086762
– ident: ref11
  doi: 10.1109/TWC.2020.3041750
– ident: ref20
  doi: 10.1109/TVT.2021.3095943
– ident: ref7
  doi: 10.1109/JIOT.2023.3273521
– ident: ref17
  doi: 10.1109/TVT.2016.2582778
– ident: ref29
  doi: 10.1109/TWC.2023.3259721
– ident: ref13
  doi: 10.1109/TNET.2021.3135494
– ident: ref5
  doi: 10.1109/INFCOM.2012.6195689
– ident: ref23
  doi: 10.1109/TCOMM.2020.2973629
– ident: ref9
  doi: 10.1109/TCOMM.2019.2961083
– ident: ref25
  doi: 10.1109/TWC.2022.3225085
– ident: ref1
  doi: 10.1109/JIOT.2021.3051418
– ident: ref2
  doi: 10.1109/JIOT.2022.3229741
SSID ssj0001105196
Score 2.4816103
Snippet As a vital metric of information timeliness, Age of Information (AoI) is important for real-time applications in Internet of Things (IoT), such as health...
SourceID proquest
crossref
ieee
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 29102
SubjectTerms Age of Information (AoI)
Algorithms
Data transmission
deep deterministic policy gradient (DDPG)
Energy consumption
Heuristic algorithms
Internet of Things
Minimization
mobility
Mobility models
Nodes
Optimization
Polynomials
Real time
Remote monitoring
Resource allocation
Resource management
Wireless sensor networks
wireless-powered Internet of Things (WPIoT)
Title Distributed DDPG-Based Resource Allocation for Age of Information Minimization in Mobile Wireless-Powered Internet of Things
URI https://ieeexplore.ieee.org/document/10540071
https://www.proquest.com/docview/3096378720
Volume 11
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV3JTsMwELWAExfKKsomHzghpWSxsxwLZZVYDq3UW-RxHFRRWgTpBfHxzDgOq0Dcksi2rDzPZnvmMbYvQ6kzjJQ90FJ6ItTgKYFyBSZF7yHNwLdZrlfX8flAXA7l0CWr21wYY4y9fGY69GjP8oupntFWGUq4JBpvDHbmMXKrk7U-NlQC8kZid3IZ-Nnh5cVNHyPAUHQiQTVixBfbY8lUfmhga1ZOW-y6mVB9m-S-M6ugo1--1Wr894yX2ZJzMHm3XhErbM5MVlmrIW_gTpbX2GuPSuYS25UpeK93e-YdoUEreLOfz7tjsnOEG0fHlnfvDJ-W3KUv2c9Xo8noweVx8hG-TwF1DKcLtWNUoN4tMbDhkPWuo6mof80Tus4Gpyf943PPUTF4Gj2aysvwL0IBkAHip1BmY5FEUYJPcZxqEIkMEF0ljSxLncWQxpFRUaBTZc9WVbTBFibTidlkXIWlVkR8ZhItCqGULCEOIPEzAL9Ups38BqRcuzrlRJcxzm284mc54ZoTrrnDtc0O3rs81kU6_mq8Tjh9alhD1GY7zVLInRw_5xFGeBHqtNDf-qXbNluk0etrZztsoXqamV30UyrYs-vzDYSD5X0
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwzV1Lb9QwEB6VcoAL5VHUhQI-wAUpSx52HgcOC0vZbbulh63UW_A4Dlqx7CKaFQL1r_Sv9Ld1xnHKS3CrxC2JbCdyPs_DnpkP4KmKlSnIUw7QKBXI2GCgJa0rtDlZD3mBoctynRykoyO5e6yO1-DsMhfGWuuCz2yfL91ZfrU0K94qoxWumMY78jGUe_bbV_LQTl6Oh_Q7n8Xxzpvp61HgSQQCQ7q4CQpSQlghFkhv1oS2VGZJktFVmuYGZaYi-i6trKprU6SYp4nVSWRy7U4FdULjXoPrZGiouE0P-7GFE7H9k_qz0igsXuyO303J54xlP5FclUb-ou0cfcsfMt8psp0NOO-moI1f-dhfNdg333-rDvnfztFtuOVNaDFoMX8H1uziLmx09BTCS6t7cDrkosDM52UrMRwevg1ekcquRHdiIQZz1uSMTEGmuxh8sGJZC5-g5R5PZovZJ5-pKmZ0v0SSooJDhuekIoJD5pijIdt9Vdtw_5YJdROOrmQO7sP6YrmwWyB0XBvN1G42M7KSWqsa0wizsEAMa217EHagKI2vxM6EIPPSeWRhUTKOSsZR6XHUg-eXXT63ZUj-1XiTcfFTwxYSPdjuoFd6SXVSJuTDJiS14_DBX7o9gRuj6WS_3B8f7D2Em_ymNshuG9abLyv7iKyyBh-7tSHg_VUD7QJQDUHQ
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Distributed+DDPG-Based+Resource+Allocation+for+Age+of+Information+Minimization+in+Mobile+Wireless-Powered+Internet+of+Things&rft.jtitle=IEEE+internet+of+things+journal&rft.au=Zheng%2C+Kechen&rft.au=Luo%2C+Rongwei&rft.au=Liu%2C+Xiaoying&rft.au=Qiu%2C+Jiefan&rft.date=2024-09-01&rft.pub=IEEE&rft.eissn=2327-4662&rft.volume=11&rft.issue=17&rft.spage=29102&rft.epage=29115&rft_id=info:doi/10.1109%2FJIOT.2024.3406044&rft.externalDocID=10540071
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=2327-4662&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=2327-4662&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=2327-4662&client=summon