Privacy Preserving Back-Propagation Neural Network Learning Made Practical with Cloud Computing

• Published in: IEEE transactions on parallel and distributed systems Vol. 25; no. 1; pp. 212 - 221
• Main Authors: Jiawei Yuan, Shucheng Yu
• Format: Journal Article
• Language: English
• Published: IEEE 01.01.2014
• Subjects: Algorithm design and analysis; Approximation algorithms; back-propagation; cloud computing; computation outsource; Data privacy; Encryption; Feeds; learning; neural network; Neural networks; Privacy reserving
• ISSN: 1045-9219
• DOI: 10.1109/TPDS.2013.18

To improve the accuracy of learning result, in practice multiple parties may collaborate through conducting joint Back-Propagation neural network learning on the union of their respective data sets. During this process no party wants to disclose her/his private data to others. Existing schemes supporting this kind of collaborative learning are either limited in the way of data partition or just consider two parties. There lacks a solution that allows two or more parties, each with an arbitrarily partitioned data set, to collaboratively conduct the learning. This paper solves this open problem by utilizing the power of cloud computing. In our proposed scheme, each party encrypts his/her private data locally and uploads the ciphertexts into the cloud. The cloud then executes most of the operations pertaining to the learning algorithms over ciphertexts without knowing the original private data. By securely offloading the expensive operations to the cloud, we keep the computation and communication costs on each party minimal and independent to the number of participants. To support flexible operations over ciphertexts, we adopt and tailor the BGN "doubly homomorphic" encryption algorithm for the multiparty setting. Numerical analysis and experiments on commodity cloud show that our scheme is secure, efficient, and accurate.