Communication Efficient Asynchronous ADMM for General Form Consensus Optimization
The distributed alternating direction method of multipliers(ADMM) is one of the most widely used methods for solving large-scale machine learning applications.However, most distributed ADMM algorithms are based on full model updates.With the increasing of system scale and data volume, the communicat...
Saved in:
Published in | Ji suan ji ke xue Vol. 49; no. 11; pp. 309 - 315 |
---|---|
Main Authors | , , |
Format | Journal Article |
Language | Chinese |
Published |
Chongqing
Guojia Kexue Jishu Bu
01.11.2022
Editorial office of Computer Science |
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | The distributed alternating direction method of multipliers(ADMM) is one of the most widely used methods for solving large-scale machine learning applications.However, most distributed ADMM algorithms are based on full model updates.With the increasing of system scale and data volume, the communication cost has become the bottleneck for the distributed ADMM when big data are involved.In order to reduce the communication cost in a distributed environment, a general form consensus asynchronous distributed alternating direction method of multipliers(GFC-ADADMM) is proposed in this paper.First, in the GFC-ADADMM,the associated model parameters rather than full model parameters are transmitted among nodes to reduce the transmission load, and the associated model parameters are filtered according to the characteristics of high-dimensional sparse data sets to further reduce the transmission load.Second, the GFC-ADMM is implemented by an asynchronous allreduce framework, which combines the advantage of the asynchrono |
---|---|
AbstractList | The distributed alternating direction method of multipliers(ADMM) is one of the most widely used methods for solving large-scale machine learning applications.However, most distributed ADMM algorithms are based on full model updates.With the increasing of system scale and data volume, the communication cost has become the bottleneck for the distributed ADMM when big data are involved.In order to reduce the communication cost in a distributed environment, a general form consensus asynchronous distributed alternating direction method of multipliers(GFC-ADADMM) is proposed in this paper.First, in the GFC-ADADMM,the associated model parameters rather than full model parameters are transmitted among nodes to reduce the transmission load, and the associated model parameters are filtered according to the characteristics of high-dimensional sparse data sets to further reduce the transmission load.Second, the GFC-ADMM is implemented by an asynchronous allreduce framework, which combines the advantage of the asynchrono The distributed alternating direction method of multipliers(ADMM) is one of the most widely used methods for solving large-scale machine learning applications.However,most distributed ADMM algorithms are based on full model updates.With the increasing of system scale and data volume,the communication cost has become the bottleneck for the distributed ADMM when big data are involved.In order to reduce the communication cost in a distributed environment,a general form consensus asynchronous distributed alternating direction method of multipliers(GFC-ADADMM) is proposed in this paper.First,in the GFC-ADADMM,the associated model parameters rather than full model parameters are transmitted among nodes to reduce the transmission load,and the associated model parameters are filtered according to the characteristics of high-dimensional sparse data sets to further reduce the transmission load.Second,the GFC-ADMM is implemented by an asynchronous allreduce framework,which combines the advantage of the asynchronous comm |
Author | Lei, Yong-Mei Wang, Dong-Xia Zhang, Ze-Yu |
Author_xml | – sequence: 1 givenname: Dong-Xia surname: Wang fullname: Wang, Dong-Xia – sequence: 2 givenname: Yong-Mei surname: Lei fullname: Lei, Yong-Mei – sequence: 3 givenname: Ze-Yu surname: Zhang fullname: Zhang, Ze-Yu |
BookMark | eNotkM1rAjEQxXOwUGu997jQszbJ5vMoW7WCIgUPvS3ZbLbN1k1ssgu1f71BO-8w8N7w4zEPYOS8MwA8IThHSEj20sb2-3eOEcIwDRuBMYIQz1DOP-7BNEZbQZwzkoTG4L3wXTc4q1VvvcuWTWO1Na7PFvHs9Ffwzg8xW7zudlnjQ7Y2zgR1zFY-dFnhXTQupnx_6m1n_66MR3DXqGM00_89AYfV8lC8zbb79aZYbGe1JKkNRVJrqitaE5gLWNW65hISShHVjUASCaVJJRtDOdaMwZooAWGOpOGCSJVPwOaGrb1qy1OwnQrn0itbXg0fPksVequPpiQMUlg1XMDcEGNMpThhhmLGOSaU68R6vrFOwf8MJvZl64fgUvsScyLSDU8vuwDgCWrP |
ContentType | Journal Article |
Copyright | Copyright Guojia Kexue Jishu Bu 2022 |
Copyright_xml | – notice: Copyright Guojia Kexue Jishu Bu 2022 |
DBID | 7SC 8FD JQ2 L7M L~C L~D DOA |
DOI | 10.11896/jsjkx.211200006 |
DatabaseName | Computer and Information Systems Abstracts Technology Research Database ProQuest Computer Science Collection Advanced Technologies Database with Aerospace Computer and Information Systems Abstracts Academic Computer and Information Systems Abstracts Professional Directory of Open Access Journals |
DatabaseTitle | Computer and Information Systems Abstracts Technology Research Database Computer and Information Systems Abstracts – Academic Advanced Technologies Database with Aerospace ProQuest Computer Science Collection Computer and Information Systems Abstracts Professional |
DatabaseTitleList | Computer and Information Systems Abstracts |
Database_xml | – sequence: 1 dbid: DOA name: Directory of Open Access Journals url: https://www.doaj.org/ sourceTypes: Open Website |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Computer Science |
EndPage | 315 |
ExternalDocumentID | oai_doaj_org_article_46050bf7803e4eeeba746e526772457c |
GroupedDBID | -0Y 2B. 2C0 5XA 5XJ 7SC 8FD 92H 92I ACGFS ALMA_UNASSIGNED_HOLDINGS CCEZO CUBFJ CW9 GROUPED_DOAJ JQ2 L7M L~C L~D TCJ TGT U1G U5S |
ID | FETCH-LOGICAL-d942-1519cc5cb5d40380bdcd79045515cf81918ac4b9fe572c660d4a800319e7849a3 |
IEDL.DBID | DOA |
ISSN | 1002-137X |
IngestDate | Thu Jul 04 21:09:38 EDT 2024 Fri Sep 13 07:57:36 EDT 2024 |
IsDoiOpenAccess | true |
IsOpenAccess | true |
IsPeerReviewed | false |
IsScholarly | true |
Issue | 11 |
Language | Chinese |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-d942-1519cc5cb5d40380bdcd79045515cf81918ac4b9fe572c660d4a800319e7849a3 |
OpenAccessLink | https://doaj.org/article/46050bf7803e4eeeba746e526772457c |
PQID | 2748457702 |
PQPubID | 2048282 |
PageCount | 7 |
ParticipantIDs | doaj_primary_oai_doaj_org_article_46050bf7803e4eeeba746e526772457c proquest_journals_2748457702 |
PublicationCentury | 2000 |
PublicationDate | 2022-11-01 |
PublicationDateYYYYMMDD | 2022-11-01 |
PublicationDate_xml | – month: 11 year: 2022 text: 2022-11-01 day: 01 |
PublicationDecade | 2020 |
PublicationPlace | Chongqing |
PublicationPlace_xml | – name: Chongqing |
PublicationTitle | Ji suan ji ke xue |
PublicationYear | 2022 |
Publisher | Guojia Kexue Jishu Bu Editorial office of Computer Science |
Publisher_xml | – name: Guojia Kexue Jishu Bu – name: Editorial office of Computer Science |
SSID | ssib023646461 ssib017479302 ssib051375750 ssib001164759 ssj0057673 |
Score | 2.3252678 |
Snippet | The distributed alternating direction method of multipliers(ADMM) is one of the most widely used methods for solving large-scale machine learning... The distributed alternating direction method of multipliers(ADMM) is one of the most widely used methods for solving large-scale machine learning... |
SourceID | doaj proquest |
SourceType | Open Website Aggregation Database |
StartPage | 309 |
SubjectTerms | Algorithms Big Data Communication distributed alternating direction method of multipliers|general form consensus optimization|sparse allreduce|hybrid programming model|logistic regression Machine learning Mathematical models Multipliers Optimization Parameters |
Title | Communication Efficient Asynchronous ADMM for General Form Consensus Optimization |
URI | https://www.proquest.com/docview/2748457702/abstract/ https://doaj.org/article/46050bf7803e4eeeba746e526772457c |
Volume | 49 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwrZ1NSwMxEIaD9OTFb7FaJQeva7ObZJMcq7YUoYpQobclX4tUbMVtQf31TrJbWvHgxeseNmSSmXlCMu8gdEl1Hm6vdGJT4hLGuEiUlGniiKFSGGKsDdXIo_t8-MTuJnyy0eorvAmr5YFrw3XDvR0xpZCEeua9N1qw3PMsByyEP9sYfVO-cZiKIBBkstaJGrAb9uFa6CqopucbQmo8pQK4haxiOEC4qJ_mh9YfVExWF5xS5d1pNX35uIJBsxjsG7H_X7E8JqjBHtppyBL36hnto62v5wO0u-ragBsnPkSPP2pCcD9qSEDqwb3qc2aDVu58WeHe7WiEAWhxo0uNBwC3OLT3DL0xKvwAoea1qeE8QuNBf3wzTJrGColTDCYE1GYtt4Y7RqgkxlknFLAdsI0twwlOasuMKj0Xmc1z4piWwfuVF5IpTY9Razaf-ROEtdelsM57lSrmJOCGJ96pkqbWslTYNroOxineaumMIohZxw-wxEWzxMVfS9xGnZVpi8bDqiILIqhcCJKd_scYZ2g7C4UNscqwg1qL96U_B9xYmIu4s74BNKLKVw |
link.rule.ids | 315,786,790,870,2115,27957,27958 |
linkProvider | Directory of Open Access Journals |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Communication+Efficient+Asynchronous+ADMM+for+General+Form+Consensus+Optimization&rft.jtitle=Ji+suan+ji+ke+xue&rft.au=Wang%2C+Dong-Xia&rft.au=Lei%2C+Yong-Mei&rft.au=Zhang%2C+Ze-Yu&rft.date=2022-11-01&rft.pub=Guojia+Kexue+Jishu+Bu&rft.issn=1002-137X&rft.volume=49&rft.issue=11&rft.spage=309&rft_id=info:doi/10.11896%2Fjsjkx.211200006&rft.externalDBID=NO_FULL_TEXT |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1002-137X&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1002-137X&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1002-137X&client=summon |