Online Learning for Distributed Computation Offloading in Wireless Powered Mobile Edge Computing Networks
A novel paradigm named Wireless Powered Mobile Edge Computing (WP-MEC) emerges recently, which integrates Mobile Edge Computing (MEC) and Wireless Power Transfer (WPT) technologies. It enables mobile clients to both extend their computing capacities by task offloading, and charge from edge servers v...
Saved in:
Published in | IEEE transactions on parallel and distributed systems Vol. 33; no. 8; pp. 1841 - 1855 |
---|---|
Main Authors | , , , , , |
Format | Journal Article |
Language | English |
Published |
New York
IEEE
01.08.2022
The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
Subjects | |
Online Access | Get full text |
ISSN | 1045-9219 1558-2183 |
DOI | 10.1109/TPDS.2021.3129618 |
Cover
Loading…
Abstract | A novel paradigm named Wireless Powered Mobile Edge Computing (WP-MEC) emerges recently, which integrates Mobile Edge Computing (MEC) and Wireless Power Transfer (WPT) technologies. It enables mobile clients to both extend their computing capacities by task offloading, and charge from edge servers via energy transmission. Existing studies generally focus on the centralized design of task scheduling and energy charging in WP-MEC networks. To meet the decentralization requirement of the near-coming 6G network, we propose an online learning algorithm for computation offloading in WP-MEC networks with a distributed execution manner. Specifically, we first define the delay minimization problem by considering task deadline and energy constraints. Then, we transform it into a primal-dual optimization problem based on the Bellman equation. After that, we design a novel neural model that learns both offloading and time division decisions in each time slot to solve the formulated optimization problem. To train and execute the designed algorithm distributivity, we form multiple learning models decentralized on edge servers and they work coordinately to achieve parameter synchronization. At last, both theoretical and performance analyses show that the designed algorithm has significant advantages in comparison with other representative schemes. |
---|---|
AbstractList | A novel paradigm named Wireless Powered Mobile Edge Computing (WP-MEC) emerges recently, which integrates Mobile Edge Computing (MEC) and Wireless Power Transfer (WPT) technologies. It enables mobile clients to both extend their computing capacities by task offloading, and charge from edge servers via energy transmission. Existing studies generally focus on the centralized design of task scheduling and energy charging in WP-MEC networks. To meet the decentralization requirement of the near-coming 6G network, we propose an online learning algorithm for computation offloading in WP-MEC networks with a distributed execution manner. Specifically, we first define the delay minimization problem by considering task deadline and energy constraints. Then, we transform it into a primal-dual optimization problem based on the Bellman equation. After that, we design a novel neural model that learns both offloading and time division decisions in each time slot to solve the formulated optimization problem. To train and execute the designed algorithm distributivity, we form multiple learning models decentralized on edge servers and they work coordinately to achieve parameter synchronization. At last, both theoretical and performance analyses show that the designed algorithm has significant advantages in comparison with other representative schemes. |
Author | Guo, Lei Wang, Guoyin Gao, Xinbo Wang, Xiaojie Guo, Song Ning, Zhaolong |
Author_xml | – sequence: 1 givenname: Xiaojie orcidid: 0000-0003-4098-6399 surname: Wang fullname: Wang, Xiaojie email: xiaojie.kara.wang@ieee.org organization: School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China – sequence: 2 givenname: Zhaolong orcidid: 0000-0002-7870-5524 surname: Ning fullname: Ning, Zhaolong email: z.ning@ieee.org organization: School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China – sequence: 3 givenname: Lei orcidid: 0000-0001-5860-0082 surname: Guo fullname: Guo, Lei email: guolei@cqupt.edu.cn organization: School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China – sequence: 4 givenname: Song orcidid: 0000-0001-9831-2202 surname: Guo fullname: Guo, Song email: song.guo@polyu.edu.hk organization: Department of Computing, The Hong Kong Polytechnic University, Kowloon, Hong Kong, China – sequence: 5 givenname: Xinbo orcidid: 0000-0002-7985-0037 surname: Gao fullname: Gao, Xinbo email: gaoxb@cqupt.edu.cn organization: Chongqing Key Laboratory of Image Cognition, Chongqing University of Posts and Telecommunications, Chongqing, China – sequence: 6 givenname: Guoyin orcidid: 0000-0002-8521-5232 surname: Wang fullname: Wang, Guoyin email: wanggy@cqupt.edu.cn organization: Chongqing Key Laboratory of Computational Intelligence, Chongqing University of Posts and Telecommunications, Chongqing, China |
BookMark | eNp9kE1Lw0AQQBepYFv9AeIl4Dl1P7JJ9iht_YBqC1Y8hk0zW7amu3V3Q_Hfm5DiwYOnmcN7M_BGaGCsAYSuCZ4QgsXdejV7m1BMyYQRKlKSn6Eh4TyPKcnZoN1xwmNBibhAI-93GJOE42SI9NLU2kC0AOmMNttIWRfNtA9Ol02AKpra_aEJMmhroqVStZVVh2kTfWgHNXgfrewRXIu-2FLXEM2rLZy0jnyFcLTu01-icyVrD1enOUbvD_P19CleLB-fp_eLeMO4CDGkPKV5QkpVlRhUwiUGRkuZEFICZYzLTKQZx2mlWC4FE7mklawqVSpaUqXYGN32dw_OfjXgQ7GzjTPty4KmOOc8wylvKdJTG2e9d6CKg9N76b4LgouuaNEVLbqixalo62R_nI3uywQndf2vedObGgB-P4mUsiRL2A8R1Icz |
CODEN | ITDSEO |
CitedBy_id | crossref_primary_10_1007_s10586_024_04893_7 crossref_primary_10_1109_TITS_2022_3224320 crossref_primary_10_1109_ACCESS_2022_3192846 crossref_primary_10_1109_TVT_2023_3236327 crossref_primary_10_1109_TVT_2024_3365476 crossref_primary_10_1109_TMC_2024_3502004 crossref_primary_10_1016_j_iot_2023_100826 crossref_primary_10_1109_JIOT_2022_3176408 crossref_primary_10_1109_TMC_2024_3443868 crossref_primary_10_1155_2024_9571987 crossref_primary_10_1109_JIOT_2024_3486619 crossref_primary_10_1109_TWC_2023_3330868 crossref_primary_10_1145_3659946 crossref_primary_10_3390_info13060271 crossref_primary_10_3390_app132212184 crossref_primary_10_1007_s11227_024_06596_7 crossref_primary_10_3390_app14167190 crossref_primary_10_1109_JIOT_2023_3238329 crossref_primary_10_1016_j_comcom_2022_05_004 crossref_primary_10_3390_s22166002 crossref_primary_10_1016_j_comnet_2025_111231 crossref_primary_10_1109_TMC_2023_3243161 crossref_primary_10_1002_dac_5388 crossref_primary_10_14201_adcaij_31509 crossref_primary_10_1002_dac_5389 crossref_primary_10_1002_dac_5261 crossref_primary_10_1109_TPDS_2024_3406027 crossref_primary_10_1109_TCE_2024_3365198 crossref_primary_10_1002_dac_5407 crossref_primary_10_1109_TNET_2024_3423316 crossref_primary_10_1109_JIOT_2023_3311916 crossref_primary_10_1145_3579992 crossref_primary_10_32604_cmes_2022_021648 crossref_primary_10_1109_COMST_2023_3305312 crossref_primary_10_1109_TPDS_2024_3403883 crossref_primary_10_1109_JSAC_2023_3345433 crossref_primary_10_1109_TCOMM_2023_3241176 crossref_primary_10_1109_TSC_2023_3320674 crossref_primary_10_1049_cmu2_12676 crossref_primary_10_1007_s12083_024_01796_7 crossref_primary_10_1016_j_future_2023_06_014 crossref_primary_10_1049_cmu2_12658 crossref_primary_10_1109_TSC_2023_3296601 |
Cites_doi | 10.1109/TCOMM.2020.3011990 10.1109/TMC.2016.2538227 10.1109/TWC.2014.2315211 10.1109/TWC.2018.2821664 10.1109/TMC.2020.3025116 10.1109/TWC.2019.2959300 10.1109/COMST.2017.2745201 10.1109/GLOCOM.2016.7842069 10.1109/TPDS.2020.3023936 10.1109/INFOCOM41043.2020.9155418 10.1109/TWC.2018.2794345 10.1109/JSAC.2018.2864426 10.1109/TMC.2020.3012509 10.1109/LWC.2019.2915618 10.2140/pjm.1966.16.1 10.1109/TWC.2020.2964765 10.1109/RTEICT46194.2019.9016893 10.1109/TWC.2020.2970920 10.1109/TWC.2017.2785305 10.1109/TVT.2019.2945037 10.1007/s11432-020-2955-6 10.1109/TVT.2018.2881191 10.1109/WCNC45663.2020.9120540 10.1109/JIOT.2018.2880812 10.1109/TMC.2019.2928811 |
ContentType | Journal Article |
Copyright | Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022 |
Copyright_xml | – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022 |
DBID | 97E RIA RIE AAYXX CITATION 7SC 7SP 8FD JQ2 L7M L~C L~D |
DOI | 10.1109/TPDS.2021.3129618 |
DatabaseName | IEEE All-Society Periodicals Package (ASPP) 2005–Present IEEE All-Society Periodicals Package (ASPP) 1998–Present IEEE Electronic Library (IEL) CrossRef Computer and Information Systems Abstracts Electronics & Communications Abstracts Technology Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional |
DatabaseTitle | CrossRef Technology Research Database Computer and Information Systems Abstracts – Academic Electronics & Communications Abstracts ProQuest Computer Science Collection Computer and Information Systems Abstracts Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Professional |
DatabaseTitleList | Technology Research Database |
Database_xml | – sequence: 1 dbid: RIE name: IEEE Xplore url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/ sourceTypes: Publisher |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Engineering Computer Science |
EISSN | 1558-2183 |
EndPage | 1855 |
ExternalDocumentID | 10_1109_TPDS_2021_3129618 9623474 |
Genre | orig-research |
GrantInformation_xml | – fundername: Chongqing Municipal Education Commission grantid: HZ2021008; CXQT21019 funderid: 10.13039/501100007957 – fundername: National Natural Science Foundation of China grantid: 61872310; 61971084; 62025105; 62001073 funderid: 10.13039/501100001809 – fundername: Natural Science Foundation of Chongqing grantid: cstc2019jcyj-cxttX0002; cstc2021ycjh-bgzxm0013; cstc2021ycjh-bgzxm0039; cstc2021jcyj-msxmX0031 funderid: 10.13039/501100005230 – fundername: Hong Kong RGC Research Impact Fund grantid: R5060-19 – fundername: Science, Technology and Innovation Commission of Shenzhen Municipality; Shenzhen Science and Technology Innovation Commission grantid: R2020A045 funderid: 10.13039/501100010877 – fundername: General Research Fund grantid: 152221/19E; 15220320/20E – fundername: Support Program for Overseas Students to Return to China for Entrepreneurship and Innovation grantid: cx2021003; cx2021053 |
GroupedDBID | --Z -~X .DC 0R~ 29I 4.4 5GY 6IK 97E AAJGR AARMG AASAJ AAWTH ABAZT ABQJQ ABVLG ACGFO ACIWK AENEX AGQYO AHBIQ AKJIK AKQYR ALMA_UNASSIGNED_HOLDINGS ASUFR ATWAV BEFXN BFFAM BGNUA BKEBE BPEOZ CS3 DU5 EBS EJD HZ~ IEDLZ IFIPE IPLJI JAVBF LAI M43 MS~ O9- OCL P2P PQQKQ RIA RIE RNS TN5 TWZ UHB AAYXX CITATION 7SC 7SP 8FD JQ2 L7M L~C L~D |
ID | FETCH-LOGICAL-c359t-e6562841bfdb0ef45a0e32ba411be2335a7967506df38a9398a2daddfbf2b2ff3 |
IEDL.DBID | RIE |
ISSN | 1045-9219 |
IngestDate | Sun Jun 29 13:24:36 EDT 2025 Tue Jul 01 03:58:40 EDT 2025 Thu Apr 24 23:03:33 EDT 2025 Wed Aug 27 05:11:50 EDT 2025 |
IsPeerReviewed | true |
IsScholarly | true |
Issue | 8 |
Language | English |
License | https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html https://doi.org/10.15223/policy-029 https://doi.org/10.15223/policy-037 |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-c359t-e6562841bfdb0ef45a0e32ba411be2335a7967506df38a9398a2daddfbf2b2ff3 |
Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
ORCID | 0000-0003-4098-6399 0000-0001-9831-2202 0000-0002-7985-0037 0000-0001-5860-0082 0000-0002-7870-5524 0000-0002-8521-5232 |
PQID | 2608557065 |
PQPubID | 85437 |
PageCount | 15 |
ParticipantIDs | proquest_journals_2608557065 crossref_primary_10_1109_TPDS_2021_3129618 crossref_citationtrail_10_1109_TPDS_2021_3129618 ieee_primary_9623474 |
ProviderPackageCode | CITATION AAYXX |
PublicationCentury | 2000 |
PublicationDate | 2022-08-01 |
PublicationDateYYYYMMDD | 2022-08-01 |
PublicationDate_xml | – month: 08 year: 2022 text: 2022-08-01 day: 01 |
PublicationDecade | 2020 |
PublicationPlace | New York |
PublicationPlace_xml | – name: New York |
PublicationTitle | IEEE transactions on parallel and distributed systems |
PublicationTitleAbbrev | TPDS |
PublicationYear | 2022 |
Publisher | IEEE The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
Publisher_xml | – name: IEEE – name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE) |
References | ref13 ref12 ref15 ref14 ref31 ref11 ref10 ref2 ref1 dai (ref23) 2018 ref17 ref16 ref19 ref18 ilya (ref25) 2013 qu (ref24) 2019 ref20 ref21 ref28 ref27 ref29 ref8 ref7 ref9 ref4 ref3 ref6 ref5 nachum (ref22) 2017 asadi (ref30) 2017 kingma (ref26) 2015 |
References_xml | – ident: ref8 doi: 10.1109/TCOMM.2020.3011990 – start-page: 2775 year: 2017 ident: ref22 article-title: Bridging the gap between value and policy based reinforcement learning publication-title: Proc Advances Neural Inf Process Syst – ident: ref31 doi: 10.1109/TMC.2016.2538227 – ident: ref7 doi: 10.1109/TWC.2014.2315211 – ident: ref2 doi: 10.1109/TWC.2018.2821664 – ident: ref17 doi: 10.1109/TMC.2020.3025116 – ident: ref3 doi: 10.1109/TWC.2019.2959300 – ident: ref1 doi: 10.1109/COMST.2017.2745201 – start-page: 1184 year: 2019 ident: ref24 article-title: Value propagation for decentralized networked deep multi-agent reinforcement learning publication-title: Proc Advances Neural Inf Process Syst – ident: ref12 doi: 10.1109/GLOCOM.2016.7842069 – ident: ref28 doi: 10.1109/TPDS.2020.3023936 – ident: ref15 doi: 10.1109/INFOCOM41043.2020.9155418 – ident: ref18 doi: 10.1109/TWC.2018.2794345 – ident: ref5 doi: 10.1109/JSAC.2018.2864426 – ident: ref20 doi: 10.1109/TMC.2020.3012509 – ident: ref10 doi: 10.1109/LWC.2019.2915618 – start-page: 1125 year: 2018 ident: ref23 article-title: SBEED: Convergent reinforcement learning with nonlinear function approximation publication-title: Proc Int Conf Mach Learn – ident: ref27 doi: 10.2140/pjm.1966.16.1 – start-page: 1139 year: 2013 ident: ref25 article-title: On the importance of initialization and momentum in deep learning publication-title: Proc Int Conf Mach Learn – ident: ref4 doi: 10.1109/TWC.2020.2964765 – ident: ref29 doi: 10.1109/RTEICT46194.2019.9016893 – ident: ref11 doi: 10.1109/TWC.2020.2970920 – ident: ref19 doi: 10.1109/TWC.2017.2785305 – start-page: 243 year: 2017 ident: ref30 article-title: An alternative softmax operator for reinforcement learning publication-title: Proc Int Conf Mach Learn – ident: ref13 doi: 10.1109/TVT.2019.2945037 – ident: ref6 doi: 10.1007/s11432-020-2955-6 – ident: ref16 doi: 10.1109/TVT.2018.2881191 – ident: ref9 doi: 10.1109/WCNC45663.2020.9120540 – ident: ref21 doi: 10.1109/JIOT.2018.2880812 – start-page: 1 year: 2015 ident: ref26 article-title: Adam: A method for stochastic optimization publication-title: Proc Int Conf Learn Representations – ident: ref14 doi: 10.1109/TMC.2019.2928811 |
SSID | ssj0014504 |
Score | 2.564662 |
Snippet | A novel paradigm named Wireless Powered Mobile Edge Computing (WP-MEC) emerges recently, which integrates Mobile Edge Computing (MEC) and Wireless Power... |
SourceID | proquest crossref ieee |
SourceType | Aggregation Database Enrichment Source Index Database Publisher |
StartPage | 1841 |
SubjectTerms | Algorithms Computation offloading delay minimization Delays Design Distance learning distributed execution Edge computing Machine learning Mobile computing Multi-access edge computing Networks online learning Optimization Processor scheduling Resource management Servers Synchronism Task analysis Task scheduling Wireless power transmission Wireless powered mobile edge computing |
Title | Online Learning for Distributed Computation Offloading in Wireless Powered Mobile Edge Computing Networks |
URI | https://ieeexplore.ieee.org/document/9623474 https://www.proquest.com/docview/2608557065 |
Volume | 33 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV3fS8MwED7UJ31wuilOp-TBJ7GzbZo2eRSniOAc6MC30jSJiGMVt73413tJ0-EvxLdSLqFwyd19vbvvAI65zW2hawmY5gwBiqaBzJQKaMIRx_G0oHW1xTC9Hic3j-xxBU6XvTBaa1d8pvv20eXyVVUu7K-yM4G-OsmSVVhF4Fb3ai0zBglzowIRXbBA4DX0GcwoFGcPo8E9IsE4QoAa2wknX3yQG6rywxI793LVgtvmw-qqkpf-Yi775fs3zsb_fvkWbPo4k5zXB2MbVvS0Da1mhgPxV7oNG58ICTvwXDOPEs-6-kQwpCUDy61rx2JpReoNnDbJnTGTypXgk-cpsWW0EzSbZGTnrqHobSXR4pBL9aT9Mis5rMvOZzswvrp8uLgO_DCGoKRMzAONgR-6skgaJUNtElagXmNZJFEkdUwpKzKB4CNMlaG8EFTwIlZoPI00sYyNobuwNq2meg8IRhBSppkRytg22JRL3FZxrViq8S3rQtioJy89U7kdmDHJHWIJRW41mluN5l6jXThZLnmtaTr-Eu5YDS0FvXK60GvOQO4v8ixHuMctS1nK9n9fdQDrse2IcDWBPVibvy30IcYpc3nkDugHK4HkvA |
linkProvider | IEEE |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1JT-swEB6xHIAD-xNl9YETIiWJ49Q-IhaVpQWJInGL4tpG6FUtgvbCr2fGcSs2IW5RNLYijT1LZub7APYl1bbQtUTCSoEJiuWRbhgT8UxiHifzklfdFu28eZ9dPoiHKTiczMJYa33zma3To6_lm0F3RL_KjhT66qyRTcOsoGHcalprUjPIhCcLxPxCRAovYqhhJrE66tye3mEumCaYoqbEcfLJC3lalW-22DuY8yVojT-t6iv5Xx8Ndb379gW18a_fvgyLIdJkx9XRWIEp21-FpTGLAwuXehUWPkASrsFThT3KAu7qI8Oglp0Sui4RY1nDqg28PtmNc72Bb8JnT31GjbQ9NJzslpjXULQ10Ghz2Jl5tGEZSbarxvPXdbg_P-ucNKNAxxB1uVDDyGLoh84s0c7o2LpMlKjZVJdZkmibci7KhsL0I86N47JUXMkyNWg-nXapTp3j_2CmP-jbDWAYQ2idN5wyjgZhc6lxWyOtEbnFt6IG8Vg9RTdglRNlRq_wOUusCtJoQRotgkZrcDBZ8lwBdfwmvEYamggG5dRge3wGinCVXwtM-CThlOVi8-dVezDX7LSui-uL9tUWzKc0H-E7BLdhZvgysjsYtQz1rj-s7zvq6AQ |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Online+Learning+for+Distributed+Computation+Offloading+in+Wireless+Powered+Mobile+Edge+Computing+Networks&rft.jtitle=IEEE+transactions+on+parallel+and+distributed+systems&rft.au=Wang%2C+Xiaojie&rft.au=Ning%2C+Zhaolong&rft.au=Guo%2C+Lei&rft.au=Guo%2C+Song&rft.date=2022-08-01&rft.issn=1045-9219&rft.eissn=1558-2183&rft.volume=33&rft.issue=8&rft.spage=1841&rft.epage=1855&rft_id=info:doi/10.1109%2FTPDS.2021.3129618&rft.externalDBID=n%2Fa&rft.externalDocID=10_1109_TPDS_2021_3129618 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1045-9219&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1045-9219&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1045-9219&client=summon |