AUCTION: Automated and Quality-Aware Client Selection Framework for Efficient Federated Learning

• Published in: IEEE transactions on parallel and distributed systems Vol. 33; no. 8; pp. 1996 - 2009
• Main Authors: Deng, Yongheng, Lyu, Feng, Ren, Ju, Wu, Huaqing, Zhou, Yuezhi, Zhang, Yaoxue, Shen, Xuemin
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.08.2022; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Artificial neural networks; Budgets; client selection; Clients; Coders; Collaborative work; Data integrity; Data models; Data privacy; data quality; Design factors; Distributed databases; distributed system; Encoders-Decoders; Federated learning; Machine learning; Neural networks; reinforcement learning; Task analysis; Training
• ISSN: 1045-9219; 1558-2183
• DOI: 10.1109/TPDS.2021.3134647

The emergency of federated learning (FL) enables distributed data owners to collaboratively build a global model without sharing their raw data, which creates a new business chance for building data market. However, in practical FL scenarios, the hardware conditions and data resources of the participant clients can vary significantly, leading to different positive/negative effects on the FL performance, where the client selection problem becomes crucial. To this end, we propose AUCTION , an A utomated and q U ality-aware C lient selec TION framework for efficient FL, which can evaluate the learning quality of clients and select them automatically with quality-awareness for a given FL task within a limited budget. To design AUCTION , multiple factors such as data size, data quality, and learning budget that can affect the learning performance should be properly balanced. It is nontrivial since their impacts on the FL model are intricate and unquantifiable. Therefore, AUCTION is designed to encode the client selection policy into a neural network and employ reinforcement learning to automatically learn client selection policies based on the observed client status and feedback rewards quantified by the federated learning performance. In particular, the policy network is built upon an encoder-decoder deep neural network with an attention mechanism, which can adapt to dynamic changes of the number of candidate clients and make sequential client selection actions to reduce the learning space significantly. Extensive experiments are carried out based on real-world datasets and well-known learning models to demonstrate the efficiency, robustness, and scalability of AUCTION .