Multitask Diffusion Adaptation Over Asynchronous Networks

The multitask diffusion LMS is an efficient strategy to simultaneously infer, in a collaborative manner, multiple parameter vectors. Existing works on multitask problems assume that all agents respond to data synchronously. In several applications, agents may not be able to act synchronously because...

Full description

Saved in:
Bibliographic Details
Published inIEEE transactions on signal processing Vol. 64; no. 11; pp. 2835 - 2850
Main Authors Nassif, Roula, Richard, Cedric, Ferrari, Andre, Sayed, Ali H.
Format Journal Article
LanguageEnglish
Published New York IEEE 01.06.2016
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Institute of Electrical and Electronics Engineers
Subjects
Astrophysics
asynchronous networks
Context
Correlation
diffusion adaptation
Distributed optimization
Engineering Sciences
Estimation
Instrumentation and Methods for Astrophysic
Machine Learning
Mean square error methods
mean-square performance analysis
multitask learning
Network topology
Optimization
Sciences of the Universe
Signal and Image processing
Statistics
Topology
Online AccessGet full text

Cover

Abstract The multitask diffusion LMS is an efficient strategy to simultaneously infer, in a collaborative manner, multiple parameter vectors. Existing works on multitask problems assume that all agents respond to data synchronously. In several applications, agents may not be able to act synchronously because networks can be subject to several sources of uncertainties such as changing topology, random link failures, or agents turning on and off for energy conservation. In this paper, we describe a model for the solution of multitask problems over asynchronous networks and carry out a detailed mean and mean-square error analysis. Results show that sufficiently small step-sizes can still ensure both stability and performance. Simulations and illustrative examples are provided to verify the theoretical findings.
AbstractList The multitask diffusion LMS is an efficient strategy to simultaneously infer, in a collaborative manner, multiple parameter vectors. Existing works on multitask problems assume that all agents respond to data synchronously. In several applications, agents may not be able to act synchronously because networks can be subject to several sources of uncertainties such as changing topology, random link failures, or agents turning on and off for energy conservation. In this paper, we describe a model for the solution of multitask problems over asynchronous networks and carry out a detailed mean and mean-square error analysis. Results show that sufficiently small step-sizes can still ensure both stability and performance. Simulations and illustrative examples are provided to verify the theoretical findings.
Author Richard, Cedric
Ferrari, Andre
Nassif, Roula
Sayed, Ali H.
Author_xml – sequence: 1
  givenname: Roula
  surname: Nassif
  fullname: Nassif, Roula
  email: roula.nassif@oca.eu
  organization: Univ. de Nice Sophia-Antipolis, Nice, France
– sequence: 2
  givenname: Cedric
  surname: Richard
  fullname: Richard, Cedric
  email: cedric.richard@unice.fr
  organization: Univ. de Nice Sophia-Antipolis, Nice, France
– sequence: 3
  givenname: Andre
  surname: Ferrari
  fullname: Ferrari, Andre
  email: andre.ferrari@unice.fr
  organization: Univ. de Nice Sophia-Antipolis, Nice, France
– sequence: 4
  givenname: Ali H.
  surname: Sayed
  fullname: Sayed, Ali H.
  email: sayed@ee.ucla.edu
  organization: Dept. of Electr. Eng., Univ. of California, Los Angeles, Los Angeles, CA, USA
BackLink https://hal.science/hal-03434463$$DView record in HAL
BookMark eNp9kM1LwzAYxoMouE3vgpeCJw-d-WqSHsv8mDCd4ARvIWsT1q02M0kn--9t6fTgwdP78PJ7Xp73GYLj2tYagAsExwjB9Gbx-jLGELExTpBIU3QEBiilKIaUs-NWw4TEieDvp2Do_RpCRGnKBiB9aqpQBuU30W1pTONLW0dZobZBhU7Od9pFmd_X-crZ2jY-etbhy7qNPwMnRlVenx_mCLzd3y0m03g2f3icZLM4J4yHGGNoNCpMDpnWNIeYJtoUnFGiIE6W2BimiCiSRAlkqBKpEWqZME5pUaiUcjIC1_3dlark1pUfyu2lVaWcZjPZ7SChhFJGdqhlr3p26-xno32Qa9u4uo0nERccCQwxaSnWU7mz3jttZF727wanykoiKLtKZVup7CqVh0pbI_xj_Mnzj-Wyt5Ra61-cE0F5G_kbDSyCiQ
CODEN ITPRED
CitedBy_id crossref_primary_10_1016_j_sigpro_2021_108207
crossref_primary_10_1109_LSP_2020_2999883
crossref_primary_10_1109_TCSII_2021_3103868
crossref_primary_10_1109_TSP_2016_2601282
crossref_primary_10_1016_j_automatica_2021_110134
crossref_primary_10_1109_JSTSP_2017_2679339
crossref_primary_10_1109_TCSII_2022_3146935
crossref_primary_10_1002_acs_3703
crossref_primary_10_1109_JSTSP_2017_2676468
crossref_primary_10_1016_j_isatra_2023_06_012
crossref_primary_10_1109_TSIPN_2021_3124362
crossref_primary_10_1109_TSP_2020_3021247
crossref_primary_10_1016_j_dsp_2021_103199
crossref_primary_10_1016_j_sigpro_2019_01_015
crossref_primary_10_1109_TCNS_2020_3029992
crossref_primary_10_1016_j_sigpro_2020_107954
crossref_primary_10_1109_TCSII_2018_2874090
crossref_primary_10_1109_TSP_2017_2721930
crossref_primary_10_1016_j_sigpro_2024_109570
crossref_primary_10_1109_TCSI_2020_2997677
crossref_primary_10_1109_TSP_2017_2750110
crossref_primary_10_1109_TSP_2020_2997394
crossref_primary_10_1080_21642583_2020_1784808
crossref_primary_10_1109_LSP_2020_2990086
crossref_primary_10_1016_j_automatica_2023_111363
crossref_primary_10_1109_TSP_2017_2771731
crossref_primary_10_1109_TSIPN_2020_3038017
crossref_primary_10_1109_TSP_2017_2695451
crossref_primary_10_1109_TSIPN_2020_2964214
crossref_primary_10_1109_TSP_2022_3180202
crossref_primary_10_1016_j_sigpro_2019_01_004
crossref_primary_10_1109_TIT_2020_3046191
crossref_primary_10_1016_j_sigpro_2022_108672
crossref_primary_10_1002_acs_2839
crossref_primary_10_1007_s00034_022_02140_1
crossref_primary_10_1109_TCSII_2021_3050725
crossref_primary_10_1109_TSIPN_2018_2863218
crossref_primary_10_1049_iet_spr_2016_0727
crossref_primary_10_1109_TCSI_2019_2957342
crossref_primary_10_1109_ACCESS_2017_2733766
Cites_doi 10.1109/TSP.2012.2198470
10.1109/TSP.2014.2385046
10.1109/JSTSP.2013.2246763
10.1109/JPROC.2014.2306253
10.1109/ICASSP.2015.7178625
10.1109/MSP.2012.2231991
10.1109/TIT.2006.874516
10.1109/TSP.2015.2412918
10.1109/ACSSC.2014.7094557
10.1109/TSP.2007.896034
10.1007/978-1-84996-290-2
10.1109/TSP.2011.2108290
10.1016/j.sysconle.2004.02.022
10.1109/TSP.2009.2036046
10.1109/TSP.2010.2052612
10.1109/TSP.2013.2289888
10.1016/0024-3795(91)90332-Q
10.1109/JSAC.2005.843546
10.1109/TAC.1986.1104412
10.1109/TSP.2014.2385037
10.1109/CIP.2012.6232902
10.1109/TSP.2015.2415755
10.1137/040615961
10.1109/TSP.2009.2033729
10.1137/S1052623499362111
10.1561/2200000051
10.1109/TAC.1984.1103385
10.1109/ICASSP.2014.6855002
10.1109/TAC.2008.2009515
10.1109/TSP.2010.2046635
10.1109/TSP.2009.2016247
10.1109/JSTSP.2011.2118740
10.1109/MLSP.2014.6958929
10.1137/S1052623495287022
10.1109/TSP.2014.2333560
10.1109/JSTSP.2011.2127446
10.1109/TSP.2008.920143
10.1109/TSP.2014.2385041
10.1002/9780470374122
10.2307/1911749
10.1109/TSP.2008.2007111
10.1109/TSP.2008.917383
10.1109/TSP.2011.2146776
ContentType Journal Article
Copyright Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2016
Distributed under a Creative Commons Attribution 4.0 International License
Copyright_xml – notice: Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2016
– notice: Distributed under a Creative Commons Attribution 4.0 International License
DBID 97E
RIA
RIE
AAYXX
CITATION
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
1XC
VOOES
DOI 10.1109/TSP.2016.2518991
DatabaseName IEEE All-Society Periodicals Package (ASPP) 2005–Present
IEEE All-Society Periodicals Package (ASPP) 1998–Present
IEEE Electronic Library (IEL)
CrossRef
Computer and Information Systems Abstracts
Electronics & Communications Abstracts
Technology Research Database
ProQuest Computer Science Collection
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts – Academic
Computer and Information Systems Abstracts Professional
Hyper Article en Ligne (HAL)
Hyper Article en Ligne (HAL) (Open Access)
DatabaseTitle CrossRef
Technology Research Database
Computer and Information Systems Abstracts – Academic
Electronics & Communications Abstracts
ProQuest Computer Science Collection
Computer and Information Systems Abstracts
Advanced Technologies Database with Aerospace
Computer and Information Systems Abstracts Professional
DatabaseTitleList Technology Research Database
Database_xml – sequence: 1
  dbid: RIE
  name: IEEE Electronic Library (IEL)
  url: https://proxy.k.utb.cz/login?url=https://ieeexplore.ieee.org/
  sourceTypes: Publisher
DeliveryMethod fulltext_linktorsrc
Discipline Engineering
Statistics
EISSN 1941-0476
EndPage 2850
ExternalDocumentID oai_HAL_hal_03434463v1
4047111311
10_1109_TSP_2016_2518991
7384746
Genre orig-research
GrantInformation_xml – fundername: NSF
  grantid: CIF-1524250; ECCS-1407712
– fundername: ANR and DGA
  grantid: ANR-13-ASTR-0030
GroupedDBID -~X
.DC
0R~
29I
4.4
5GY
6IK
85S
97E
AAJGR
AARMG
AASAJ
AAWTH
ABAZT
ABQJQ
ABVLG
ACGFO
ACIWK
ACNCT
AENEX
AGQYO
AGSQL
AHBIQ
AJQPL
AKQYR
ALMA_UNASSIGNED_HOLDINGS
ASUFR
ATWAV
BEFXN
BFFAM
BGNUA
BKEBE
BPEOZ
CS3
EBS
EJD
F5P
HZ~
IFIPE
IPLJI
JAVBF
LAI
MS~
O9-
OCL
P2P
RIA
RIE
RNS
TAE
TN5
3EH
53G
5VS
AAYOK
AAYXX
ABFSI
ACKIV
AETIX
AI.
AIBXA
AKJIK
ALLEH
CITATION
E.L
H~9
ICLAB
IFJZH
RIG
VH1
7SC
7SP
8FD
JQ2
L7M
L~C
L~D
1XC
VOOES
ID FETCH-LOGICAL-c367t-220fe1dfc06ee4c0245efd7643a025b2ff6a38d55a81f4a89f8ab56744dda9473
IEDL.DBID RIE
ISSN 1053-587X
IngestDate Tue Jun 24 07:03:11 EDT 2025
Mon Jun 30 10:14:19 EDT 2025
Tue Jul 01 02:53:10 EDT 2025
Thu Apr 24 22:51:13 EDT 2025
Tue Aug 26 16:43:03 EDT 2025
IsDoiOpenAccess true
IsOpenAccess true
IsPeerReviewed true
IsScholarly true
Issue 11
Language English
License https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html
Distributed under a Creative Commons Attribution 4.0 International License: http://creativecommons.org/licenses/by/4.0
LinkModel DirectLink
MergedId FETCHMERGED-LOGICAL-c367t-220fe1dfc06ee4c0245efd7643a025b2ff6a38d55a81f4a89f8ab56744dda9473
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0003-2890-141X
0000-0002-7297-7625
0000-0002-5125-5519
0000-0001-9663-8559
OpenAccessLink https://hal.science/hal-03434463
PQID 1787182023
PQPubID 85478
PageCount 16
ParticipantIDs crossref_citationtrail_10_1109_TSP_2016_2518991
ieee_primary_7384746
hal_primary_oai_HAL_hal_03434463v1
proquest_journals_1787182023
crossref_primary_10_1109_TSP_2016_2518991
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2016-06-01
PublicationDateYYYYMMDD 2016-06-01
PublicationDate_xml – month: 06
  year: 2016
  text: 2016-06-01
  day: 01
PublicationDecade 2010
PublicationPlace New York
PublicationPlace_xml – name: New York
PublicationTitle IEEE transactions on signal processing
PublicationTitleAbbrev TSP
PublicationYear 2016
Publisher IEEE
The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Institute of Electrical and Electronics Engineers
Publisher_xml – name: IEEE
– name: The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
– name: Institute of Electrical and Electronics Engineers
References ref13
ref12
ref15
ref14
ref11
ref10
ref17
ref19
ref18
braca (ref6) 2008
ref48
grady (ref45) 2010
ref47
ref42
ref41
ref44
ref43
plata-chaves (ref23) 2014
ref49
ref8
ref7
ref9
ref4
sayed (ref16) 2014; 3
ref3
ref5
ref40
basar (ref46) 1995
ref35
ref34
ref37
ref36
ref31
ref30
ref33
ref2
ref1
ref39
ref38
ref24
ref26
ref25
ref20
ref22
ref21
bernstein (ref50) 2005
ref28
ref27
ref29
nassif (ref32) 2016
References_xml – ident: ref19
  doi: 10.1109/TSP.2012.2198470
– ident: ref42
  doi: 10.1109/TSP.2014.2385046
– ident: ref29
  doi: 10.1109/JSTSP.2013.2246763
– ident: ref2
  doi: 10.1109/JPROC.2014.2306253
– ident: ref28
  doi: 10.1109/ICASSP.2015.7178625
– ident: ref15
  doi: 10.1109/MSP.2012.2231991
– ident: ref35
  doi: 10.1109/TIT.2006.874516
– ident: ref31
  doi: 10.1109/TSP.2015.2412918
– ident: ref1
  doi: 10.1109/ACSSC.2014.7094557
– year: 2014
  ident: ref23
  publication-title: ?Distributed diffusion-based LMS for node-specific adaptive parameter estimation ?
– ident: ref14
  doi: 10.1109/TSP.2007.896034
– year: 2010
  ident: ref45
  publication-title: Discrete Calculus Applied Analysis on Graphs for Computational Science
  doi: 10.1007/978-1-84996-290-2
– ident: ref26
  doi: 10.1109/TSP.2011.2108290
– ident: ref5
  doi: 10.1016/j.sysconle.2004.02.022
– ident: ref39
  doi: 10.1109/TSP.2009.2036046
– ident: ref25
  doi: 10.1109/TSP.2010.2052612
– ident: ref21
  doi: 10.1109/TSP.2013.2289888
– ident: ref49
  doi: 10.1016/0024-3795(91)90332-Q
– ident: ref12
  doi: 10.1109/JSAC.2005.843546
– ident: ref34
  doi: 10.1109/TAC.1986.1104412
– ident: ref44
  doi: 10.1109/TSP.2014.2385037
– ident: ref30
  doi: 10.1109/CIP.2012.6232902
– ident: ref33
  doi: 10.1109/TSP.2015.2415755
– volume: 3
  start-page: 322
  year: 2014
  ident: ref16
  publication-title: Academic Press Library in Signal Processing
– ident: ref13
  doi: 10.1137/040615961
– ident: ref18
  doi: 10.1109/TSP.2009.2033729
– ident: ref11
  doi: 10.1137/S1052623499362111
– ident: ref3
  doi: 10.1561/2200000051
– ident: ref4
  doi: 10.1109/TAC.1984.1103385
– ident: ref22
  doi: 10.1109/ICASSP.2014.6855002
– ident: ref20
  doi: 10.1109/JSTSP.2013.2246763
– ident: ref7
  doi: 10.1109/TAC.2008.2009515
– ident: ref40
  doi: 10.1109/TSP.2010.2046635
– year: 1995
  ident: ref46
  publication-title: Dynamic Noncooperative Game Theory
– ident: ref38
  doi: 10.1109/TSP.2009.2016247
– start-page: 1
  year: 2008
  ident: ref6
  article-title: Running consensus in wireless sensor networks
  publication-title: Proc 5th Int Conf Inf Fusion (FUSION)
– ident: ref9
  doi: 10.1109/JSTSP.2011.2118740
– ident: ref24
  doi: 10.1109/MLSP.2014.6958929
– ident: ref10
  doi: 10.1137/S1052623495287022
– ident: ref27
  doi: 10.1109/TSP.2014.2333560
– ident: ref36
  doi: 10.1109/JSTSP.2011.2127446
– year: 2016
  ident: ref32
  article-title: Diffusion LMS over multitask networks with noisy links
  publication-title: IEEE Int Conf Acoust Speech Signal Process (ICASSP)
– year: 2005
  ident: ref50
  publication-title: Matrix Mathematics Theory Facts and Formulas With Application to Linear Systems Theory
– ident: ref37
  doi: 10.1109/TSP.2008.920143
– ident: ref43
  doi: 10.1109/TSP.2014.2385041
– ident: ref48
  doi: 10.1002/9780470374122
– ident: ref47
  doi: 10.2307/1911749
– ident: ref8
  doi: 10.1109/TSP.2008.2007111
– ident: ref17
  doi: 10.1109/TSP.2008.917383
– ident: ref41
  doi: 10.1109/TSP.2011.2146776
SSID ssj0014496
Score 2.3748767
Snippet The multitask diffusion LMS is an efficient strategy to simultaneously infer, in a collaborative manner, multiple parameter vectors. Existing works on...
SourceID hal
proquest
crossref
ieee
SourceType Open Access Repository
Aggregation Database
Enrichment Source
Index Database
Publisher
StartPage 2835
SubjectTerms Astrophysics
asynchronous networks
Context
Correlation
diffusion adaptation
Distributed optimization
Engineering Sciences
Estimation
Instrumentation and Methods for Astrophysic
Machine Learning
Mean square error methods
mean-square performance analysis
multitask learning
Network topology
Optimization
Sciences of the Universe
Signal and Image processing
Statistics
Topology
Title Multitask Diffusion Adaptation Over Asynchronous Networks
URI https://ieeexplore.ieee.org/document/7384746
https://www.proquest.com/docview/1787182023
https://hal.science/hal-03434463
Volume 64
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LS8NAEB7anvTgW6xWCeJFMG2a3ewmx-KDIlYFW-gtbPaBUmmLaQT99c4mafCFeFvCLCw7k3nszHwDcMI1RzPCQlcw47mUhNKNIlwFCSdc-EIEeUZ3cMv6I3o9DsY1OKt6YbTWefGZbttlnstXM5nZp7IOJ6hLKatDHQO3oleryhhQms_iQneBuEHIx8uUpBd1hg_3toaLtdGWY3jR_WKC6o-2ADKfrPJDHec25modBsvTFaUlk3a2SNry_Rtw43-PvwFrpbPp9Arp2ISanm7B6icIwm2Iig5ckU6ciydjMvt45vSUmBcpeucORd3ppW9TaVF0Z1nq3BaF4-kOjK4uh-d9txyn4ErC-ML1fc_orjLSY1pTaXOu2iiOLolAxyfxjWGChCoIRNg1VISRCUUSME6pUiKinOxCYzqb6j1wuPa1ssFQEHpUG56g-haCK8EZahCZNKGzvOFYlljjduTFc5zHHF4UI09iy5O45EkTTqsd8wJn4w_aY2RaRWYBsvu9m9h-8wglGOCSVyTathyoqMrLb0JryeO4_FvTuItaywLZ-2T_910HsGIPUJSItaCxeMn0IToji-Qol8IPgezZ9g
linkProvider IEEE
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwjV1LT9tAEB7xONAeCpQiUh61EJdKdWJ7X_YxakFpm6RIBCm31XofAoESVMeVyq9n1nasUhDitrJmpfXO7Dx2Zr8BOBFWoBnhaai4i0JKUh1mGY5YLohQiVKsyuiOxnxwSX9M2XQFvrRvYay1VfGZ7fphlcs3c136q7KeIKhLKV-FdbT7LK5fa7U5A0qrblzoMJCQpWK6TEpGWW9yce6ruHgXrTkGGPEjI7R65Usgq94qTxRyZWXONmG0XF9dXHLTLRd5V9__B9342h_YgneNuxn0a_nYhhU7ew9v_wEh3IGsfoOripvg27Vzpb8-C_pG3dVJ-uAXCnvQL_7OtMfRnZdFMK5Lx4sPcHl2Ovk6CJuGCqEmXCzCJImcjY3TEbeWap91tc4IdEoUuj554hxXJDWMqTR2VKWZS1XOuKDUGJVRQXZhbTaf2T0IhE2s8eEQSyNqnchRgSsljBIcdYjOO9Bb7rDUDdq4b3pxK6uoI8ok8kR6nsiGJx343M64q5E2XqA9Rqa1ZB4ie9AfSv8tIpRgiEv-INGO50BL1Wx-Bw6WPJbNeS1kjHrLQ9kn5OPzsz7BxmAyGsrh9_HPfXjjF1MXjB3A2uJ3aQ_RNVnkR5VEPgAKJN0_
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Multitask+Diffusion+Adaptation+Over+Asynchronous+Networks&rft.jtitle=IEEE+transactions+on+signal+processing&rft.au=Nassif%2C+Roula&rft.au=Richard%2C+Cedric&rft.au=Ferrari%2C+Andr%C3%A9&rft.au=Sayed%2C+Ali&rft.date=2016-06-01&rft.pub=Institute+of+Electrical+and+Electronics+Engineers&rft.issn=1053-587X&rft.volume=64&rft.issue=11&rft.spage=2835&rft.epage=2850&rft_id=info:doi/10.1109%2FTSP.2016.2518991&rft.externalDBID=HAS_PDF_LINK&rft.externalDocID=oai_HAL_hal_03434463v1
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1053-587X&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1053-587X&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1053-587X&client=summon