Online Learning for Distributed Computation Offloading in Wireless Powered Mobile Edge Computing Networks

A novel paradigm named Wireless Powered Mobile Edge Computing (WP-MEC) emerges recently, which integrates Mobile Edge Computing (MEC) and Wireless Power Transfer (WPT) technologies. It enables mobile clients to both extend their computing capacities by task offloading, and charge from edge servers v...

Full description

Saved in:
Bibliographic Details
Published inIEEE transactions on parallel and distributed systems Vol. 33; no. 8; pp. 1841 - 1855
Main Authors Wang, Xiaojie, Ning, Zhaolong, Guo, Lei, Guo, Song, Gao, Xinbo, Wang, Guoyin
Format Journal Article
LanguageEnglish
Published New York IEEE 01.08.2022
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subjects
Online AccessGet full text
ISSN1045-9219
1558-2183
DOI10.1109/TPDS.2021.3129618

Cover

Loading…
Abstract A novel paradigm named Wireless Powered Mobile Edge Computing (WP-MEC) emerges recently, which integrates Mobile Edge Computing (MEC) and Wireless Power Transfer (WPT) technologies. It enables mobile clients to both extend their computing capacities by task offloading, and charge from edge servers via energy transmission. Existing studies generally focus on the centralized design of task scheduling and energy charging in WP-MEC networks. To meet the decentralization requirement of the near-coming 6G network, we propose an online learning algorithm for computation offloading in WP-MEC networks with a distributed execution manner. Specifically, we first define the delay minimization problem by considering task deadline and energy constraints. Then, we transform it into a primal-dual optimization problem based on the Bellman equation. After that, we design a novel neural model that learns both offloading and time division decisions in each time slot to solve the formulated optimization problem. To train and execute the designed algorithm distributivity, we form multiple learning models decentralized on edge servers and they work coordinately to achieve parameter synchronization. At last, both theoretical and performance analyses show that the designed algorithm has significant advantages in comparison with other representative schemes.
AbstractList A novel paradigm named Wireless Powered Mobile Edge Computing (WP-MEC) emerges recently, which integrates Mobile Edge Computing (MEC) and Wireless Power Transfer (WPT) technologies. It enables mobile clients to both extend their computing capacities by task offloading, and charge from edge servers via energy transmission. Existing studies generally focus on the centralized design of task scheduling and energy charging in WP-MEC networks. To meet the decentralization requirement of the near-coming 6G network, we propose an online learning algorithm for computation offloading in WP-MEC networks with a distributed execution manner. Specifically, we first define the delay minimization problem by considering task deadline and energy constraints. Then, we transform it into a primal-dual optimization problem based on the Bellman equation. After that, we design a novel neural model that learns both offloading and time division decisions in each time slot to solve the formulated optimization problem. To train and execute the designed algorithm distributivity, we form multiple learning models decentralized on edge servers and they work coordinately to achieve parameter synchronization. At last, both theoretical and performance analyses show that the designed algorithm has significant advantages in comparison with other representative schemes.
Author Guo, Lei
Wang, Guoyin
Gao, Xinbo
Wang, Xiaojie
Guo, Song
Ning, Zhaolong
Author_xml – sequence: 1
  givenname: Xiaojie
  orcidid: 0000-0003-4098-6399
  surname: Wang
  fullname: Wang, Xiaojie
  email: xiaojie.kara.wang@ieee.org
  organization: School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China
– sequence: 2
  givenname: Zhaolong
  orcidid: 0000-0002-7870-5524
  surname: Ning
  fullname: Ning, Zhaolong
  email: z.ning@ieee.org
  organization: School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China
– sequence: 3
  givenname: Lei
  orcidid: 0000-0001-5860-0082
  surname: Guo
  fullname: Guo, Lei
  email: guolei@cqupt.edu.cn
  organization: School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China
– sequence: 4
  givenname: Song
  orcidid: 0000-0001-9831-2202
  surname: Guo
  fullname: Guo, Song
  email: song.guo@polyu.edu.hk
  organization: Department of Computing, The Hong Kong Polytechnic University, Kowloon, Hong Kong, China
– sequence: 5
  givenname: Xinbo
  orcidid: 0000-0002-7985-0037
  surname: Gao
  fullname: Gao, Xinbo
  email: gaoxb@cqupt.edu.cn
  organization: Chongqing Key Laboratory of Image Cognition, Chongqing University of Posts and Telecommunications, Chongqing, China
– sequence: 6
  givenname: Guoyin
  orcidid: 0000-0002-8521-5232
  surname: Wang
  fullname: Wang, Guoyin
  email: wanggy@cqupt.edu.cn
  organization: Chongqing Key Laboratory of Computational Intelligence, Chongqing University of Posts and Telecommunications, Chongqing, China
BookMark eNp9kE1Lw0AQQBepYFv9AeIl4Dl1P7JJ9iht_YBqC1Y8hk0zW7amu3V3Q_Hfm5DiwYOnmcN7M_BGaGCsAYSuCZ4QgsXdejV7m1BMyYQRKlKSn6Eh4TyPKcnZoN1xwmNBibhAI-93GJOE42SI9NLU2kC0AOmMNttIWRfNtA9Ol02AKpra_aEJMmhroqVStZVVh2kTfWgHNXgfrewRXIu-2FLXEM2rLZy0jnyFcLTu01-icyVrD1enOUbvD_P19CleLB-fp_eLeMO4CDGkPKV5QkpVlRhUwiUGRkuZEFICZYzLTKQZx2mlWC4FE7mklawqVSpaUqXYGN32dw_OfjXgQ7GzjTPty4KmOOc8wylvKdJTG2e9d6CKg9N76b4LgouuaNEVLbqixalo62R_nI3uywQndf2vedObGgB-P4mUsiRL2A8R1Icz
CODEN ITDSEO
CitedBy_id crossref_primary_10_1007_s10586_024_04893_7
crossref_primary_10_1109_TITS_2022_3224320
crossref_primary_10_1109_ACCESS_2022_3192846
crossref_primary_10_1109_TVT_2023_3236327
crossref_primary_10_1109_TVT_2024_3365476
crossref_primary_10_1109_TMC_2024_3502004
crossref_primary_10_1016_j_iot_2023_100826
crossref_primary_10_1109_JIOT_2022_3176408
crossref_primary_10_1109_TMC_2024_3443868
crossref_primary_10_1155_2024_9571987
crossref_primary_10_1109_JIOT_2024_3486619
crossref_primary_10_1109_TWC_2023_3330868
crossref_primary_10_1145_3659946
crossref_primary_10_3390_info13060271
crossref_primary_10_3390_app132212184
crossref_primary_10_1007_s11227_024_06596_7
crossref_primary_10_3390_app14167190
crossref_primary_10_1109_JIOT_2023_3238329
crossref_primary_10_1016_j_comcom_2022_05_004
crossref_primary_10_3390_s22166002
crossref_primary_10_1016_j_comnet_2025_111231
crossref_primary_10_1109_TMC_2023_3243161
crossref_primary_10_1002_dac_5388
crossref_primary_10_14201_adcaij_31509
crossref_primary_10_1002_dac_5389
crossref_primary_10_1002_dac_5261
crossref_primary_10_1109_TPDS_2024_3406027
crossref_primary_10_1109_TCE_2024_3365198
crossref_primary_10_1002_dac_5407
crossref_primary_10_1109_TNET_2024_3423316
crossref_primary_10_1109_JIOT_2023_3311916
crossref_primary_10_1145_3579992
crossref_primary_10_32604_cmes_2022_021648
crossref_primary_10_1109_COMST_2023_3305312
crossref_primary_10_1109_TPDS_2024_3403883
crossref_primary_10_1109_JSAC_2023_3345433
crossref_primary_10_1109_TCOMM_2023_3241176
crossref_primary_10_1109_TSC_2023_3320674
crossref_primary_10_1049_cmu2_12676
crossref_primary_10_1007_s12083_024_01796_7
crossref_primary_10_1016_j_future_2023_06_014
crossref_primary_10_1049_cmu2_12658
crossref_primary_10_1109_TSC_2023_3296601
Cites_doi 10.1109/TCOMM.2020.3011990
10.1109/TMC.2016.2538227
10.1109/TWC.2014.2315211
10.1109/TWC.2018.2821664
10.1109/TMC.2020.3025116
10.1109/TWC.2019.2959300
10.1109/COMST.2017.2745201
10.1109/GLOCOM.2016.7842069
10.1109/TPDS.2020.3023936
10.1109/INFOCOM41043.2020.9155418
10.1109/TWC.2018.2794345
10.1109/JSAC.2018.2864426
10.1109/TMC.2020.3012509
10.1109/LWC.2019.2915618
10.2140/pjm.1966.16.1
10.1109/TWC.2020.2964765
10.1109/RTEICT46194.2019.9016893
10.1109/TWC.2020.2970920
10.1109/TWC.2017.2785305
10.1109/TVT.2019.2945037
10.1007/s11432-020-2955-6
10.1109/TVT.2018.2881191
10.1109/WCNC45663.2020.9120540
10.1109/JIOT.2018.2880812
10.1109/TMC.2019.2928811
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022
DBID 97E
RIA
RIE
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
DOI 10.1109/TPDS.2021.3129618
DatabaseName IEEE All-Society Periodicals Package (ASPP) 2005–Present
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Electronic Library (IEL)
CrossRef
Computer and Information Systems Abstracts
Electronics & Communications Abstracts
Technology Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
DatabaseTitle CrossRef
Technology Research Database
Computer and Information Systems Abstracts – Academic
Electronics & Communications Abstracts
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts Professional
DatabaseTitleList
Technology Research Database
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Xplore
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
Computer Science
EISSN 1558-2183
EndPage 1855
ExternalDocumentID 10_1109_TPDS_2021_3129618
9623474
Genre orig-research
GrantInformation_xml – fundername: Chongqing Municipal Education Commission
  grantid: HZ2021008; CXQT21019
  funderid: 10.13039/501100007957
– fundername: National Natural Science Foundation of China
  grantid: 61872310; 61971084; 62025105; 62001073
  funderid: 10.13039/501100001809
– fundername: Natural Science Foundation of Chongqing
  grantid: cstc2019jcyj-cxttX0002; cstc2021ycjh-bgzxm0013; cstc2021ycjh-bgzxm0039; cstc2021jcyj-msxmX0031
  funderid: 10.13039/501100005230
– fundername: Hong Kong RGC Research Impact Fund
  grantid: R5060-19
– fundername: Science, Technology and Innovation Commission of Shenzhen Municipality; Shenzhen Science and Technology Innovation Commission
  grantid: R2020A045
  funderid: 10.13039/501100010877
– fundername: General Research Fund
  grantid: 152221/19E; 15220320/20E
– fundername: Support Program for Overseas Students to Return to China for Entrepreneurship and Innovation
  grantid: cx2021003; cx2021053
GroupedDBID --Z
-~X
.DC
0R~
29I
4.4
5GY
6IK
97E
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABQJQ
ABVLG
ACGFO
ACIWK
AENEX
AGQYO
AHBIQ
AKJIK
AKQYR
ALMA_UNASSIGNED_HOLDINGS
ASUFR
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CS3
DU5
EBS
EJD
HZ~
IEDLZ
IFIPE
IPLJI
JAVBF
LAI
M43
MS~
O9-
OCL
P2P
PQQKQ
RIA
RIE
RNS
TN5
TWZ
UHB
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
ID FETCH-LOGICAL-c359t-e6562841bfdb0ef45a0e32ba411be2335a7967506df38a9398a2daddfbf2b2ff3
IEDL.DBID RIE
ISSN 1045-9219
IngestDate Sun Jun 29 13:24:36 EDT 2025
Tue Jul 01 03:58:40 EDT 2025
Thu Apr 24 23:03:33 EDT 2025
Wed Aug 27 05:11:50 EDT 2025
IsPeerReviewed true
IsScholarly true
Issue 8
Language English
License https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
https://doi.org/10.15223/policy-029
https://doi.org/10.15223/policy-037
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c359t-e6562841bfdb0ef45a0e32ba411be2335a7967506df38a9398a2daddfbf2b2ff3
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0003-4098-6399
0000-0001-9831-2202
0000-0002-7985-0037
0000-0001-5860-0082
0000-0002-7870-5524
0000-0002-8521-5232
PQID 2608557065
PQPubID 85437
PageCount 15
ParticipantIDs proquest_journals_2608557065
crossref_primary_10_1109_TPDS_2021_3129618
crossref_citationtrail_10_1109_TPDS_2021_3129618
ieee_primary_9623474
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2022-08-01
PublicationDateYYYYMMDD 2022-08-01
PublicationDate_xml – month: 08
  year: 2022
  text: 2022-08-01
  day: 01
PublicationDecade 2020
PublicationPlace New York
PublicationPlace_xml – name: New York
PublicationTitle IEEE transactions on parallel and distributed systems
PublicationTitleAbbrev TPDS
PublicationYear 2022
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
References ref13
ref12
ref15
ref14
ref31
ref11
ref10
ref2
ref1
dai (ref23) 2018
ref17
ref16
ref19
ref18
ilya (ref25) 2013
qu (ref24) 2019
ref20
ref21
ref28
ref27
ref29
ref8
ref7
ref9
ref4
ref3
ref6
ref5
nachum (ref22) 2017
asadi (ref30) 2017
kingma (ref26) 2015
References_xml – ident: ref8
  doi: 10.1109/TCOMM.2020.3011990
– start-page: 2775
  year: 2017
  ident: ref22
  article-title: Bridging the gap between value and policy based reinforcement learning
  publication-title: Proc Advances Neural Inf Process Syst
– ident: ref31
  doi: 10.1109/TMC.2016.2538227
– ident: ref7
  doi: 10.1109/TWC.2014.2315211
– ident: ref2
  doi: 10.1109/TWC.2018.2821664
– ident: ref17
  doi: 10.1109/TMC.2020.3025116
– ident: ref3
  doi: 10.1109/TWC.2019.2959300
– ident: ref1
  doi: 10.1109/COMST.2017.2745201
– start-page: 1184
  year: 2019
  ident: ref24
  article-title: Value propagation for decentralized networked deep multi-agent reinforcement learning
  publication-title: Proc Advances Neural Inf Process Syst
– ident: ref12
  doi: 10.1109/GLOCOM.2016.7842069
– ident: ref28
  doi: 10.1109/TPDS.2020.3023936
– ident: ref15
  doi: 10.1109/INFOCOM41043.2020.9155418
– ident: ref18
  doi: 10.1109/TWC.2018.2794345
– ident: ref5
  doi: 10.1109/JSAC.2018.2864426
– ident: ref20
  doi: 10.1109/TMC.2020.3012509
– ident: ref10
  doi: 10.1109/LWC.2019.2915618
– start-page: 1125
  year: 2018
  ident: ref23
  article-title: SBEED: Convergent reinforcement learning with nonlinear function approximation
  publication-title: Proc Int Conf Mach Learn
– ident: ref27
  doi: 10.2140/pjm.1966.16.1
– start-page: 1139
  year: 2013
  ident: ref25
  article-title: On the importance of initialization and momentum in deep learning
  publication-title: Proc Int Conf Mach Learn
– ident: ref4
  doi: 10.1109/TWC.2020.2964765
– ident: ref29
  doi: 10.1109/RTEICT46194.2019.9016893
– ident: ref11
  doi: 10.1109/TWC.2020.2970920
– ident: ref19
  doi: 10.1109/TWC.2017.2785305
– start-page: 243
  year: 2017
  ident: ref30
  article-title: An alternative softmax operator for reinforcement learning
  publication-title: Proc Int Conf Mach Learn
– ident: ref13
  doi: 10.1109/TVT.2019.2945037
– ident: ref6
  doi: 10.1007/s11432-020-2955-6
– ident: ref16
  doi: 10.1109/TVT.2018.2881191
– ident: ref9
  doi: 10.1109/WCNC45663.2020.9120540
– ident: ref21
  doi: 10.1109/JIOT.2018.2880812
– start-page: 1
  year: 2015
  ident: ref26
  article-title: Adam: A method for stochastic optimization
  publication-title: Proc Int Conf Learn Representations
– ident: ref14
  doi: 10.1109/TMC.2019.2928811
SSID ssj0014504
Score 2.564662
Snippet A novel paradigm named Wireless Powered Mobile Edge Computing (WP-MEC) emerges recently, which integrates Mobile Edge Computing (MEC) and Wireless Power...
SourceID proquest
crossref
ieee
SourceType Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 1841
SubjectTerms Algorithms
Computation offloading
delay minimization
Delays
Design
Distance learning
distributed execution
Edge computing
Machine learning
Mobile computing
Multi-access edge computing
Networks
online learning
Optimization
Processor scheduling
Resource management
Servers
Synchronism
Task analysis
Task scheduling
Wireless power transmission
Wireless powered mobile edge computing
Title Online Learning for Distributed Computation Offloading in Wireless Powered Mobile Edge Computing Networks
URI https://ieeexplore.ieee.org/document/9623474
https://www.proquest.com/docview/2608557065
Volume 33
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV3fS8MwED7UJ31wuilOp-TBJ7GzbZo2eRSniOAc6MC30jSJiGMVt73413tJ0-EvxLdSLqFwyd19vbvvAI65zW2hawmY5gwBiqaBzJQKaMIRx_G0oHW1xTC9Hic3j-xxBU6XvTBaa1d8pvv20eXyVVUu7K-yM4G-OsmSVVhF4Fb3ai0zBglzowIRXbBA4DX0GcwoFGcPo8E9IsE4QoAa2wknX3yQG6rywxI793LVgtvmw-qqkpf-Yi775fs3zsb_fvkWbPo4k5zXB2MbVvS0Da1mhgPxV7oNG58ICTvwXDOPEs-6-kQwpCUDy61rx2JpReoNnDbJnTGTypXgk-cpsWW0EzSbZGTnrqHobSXR4pBL9aT9Mis5rMvOZzswvrp8uLgO_DCGoKRMzAONgR-6skgaJUNtElagXmNZJFEkdUwpKzKB4CNMlaG8EFTwIlZoPI00sYyNobuwNq2meg8IRhBSppkRytg22JRL3FZxrViq8S3rQtioJy89U7kdmDHJHWIJRW41mluN5l6jXThZLnmtaTr-Eu5YDS0FvXK60GvOQO4v8ixHuMctS1nK9n9fdQDrse2IcDWBPVibvy30IcYpc3nkDugHK4HkvA
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1JT-swEB6xHIAD-xNl9YETIiWJ49Q-IhaVpQWJInGL4tpG6FUtgvbCr2fGcSs2IW5RNLYijT1LZub7APYl1bbQtUTCSoEJiuWRbhgT8UxiHifzklfdFu28eZ9dPoiHKTiczMJYa33zma3To6_lm0F3RL_KjhT66qyRTcOsoGHcalprUjPIhCcLxPxCRAovYqhhJrE66tye3mEumCaYoqbEcfLJC3lalW-22DuY8yVojT-t6iv5Xx8Ndb379gW18a_fvgyLIdJkx9XRWIEp21-FpTGLAwuXehUWPkASrsFThT3KAu7qI8Oglp0Sui4RY1nDqg28PtmNc72Bb8JnT31GjbQ9NJzslpjXULQ10Ghz2Jl5tGEZSbarxvPXdbg_P-ucNKNAxxB1uVDDyGLoh84s0c7o2LpMlKjZVJdZkmibci7KhsL0I86N47JUXMkyNWg-nXapTp3j_2CmP-jbDWAYQ2idN5wyjgZhc6lxWyOtEbnFt6IG8Vg9RTdglRNlRq_wOUusCtJoQRotgkZrcDBZ8lwBdfwmvEYamggG5dRge3wGinCVXwtM-CThlOVi8-dVezDX7LSui-uL9tUWzKc0H-E7BLdhZvgysjsYtQz1rj-s7zvq6AQ
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Online+Learning+for+Distributed+Computation+Offloading+in+Wireless+Powered+Mobile+Edge+Computing+Networks&rft.jtitle=IEEE+transactions+on+parallel+and+distributed+systems&rft.au=Wang%2C+Xiaojie&rft.au=Ning%2C+Zhaolong&rft.au=Guo%2C+Lei&rft.au=Guo%2C+Song&rft.date=2022-08-01&rft.issn=1045-9219&rft.eissn=1558-2183&rft.volume=33&rft.issue=8&rft.spage=1841&rft.epage=1855&rft_id=info:doi/10.1109%2FTPDS.2021.3129618&rft.externalDBID=n%2Fa&rft.externalDocID=10_1109_TPDS_2021_3129618
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1045-9219&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1045-9219&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1045-9219&client=summon