Anirban Das
ABSTRACT
Federated Learning enables training of a general model through edge devices without sending raw data to the cloud. Hence, this approach is attractive for digital health applications, where data is sourced through edge devices and users care about privacy. Here, we report on the feasibility to train deep neural networks on the Raspberry Pi4s as edge devices. A CNN, a LSTM and a MLP was successfully trained on the MNIST data-set. Further, federated learning was demonstrated experimentally on IID and non-IID samples in a parametric study, to benchmark the model convergence. The weight updates from the workers are shared with the cloud to train the general model through federated learning. With the CNN and the non-IID samples a test-accuracy of up to 85% could be achieved within a training time of 2 minutes, while exchanging less than 10 MB data per device. In addition, we discuss federated learning from an use-case standpoint, elaborating on privacy risks and labeling requirements for the application of emotion detection from sound. Based on the experimental findings, we discuss possible research directions to improve model and system performance. Finally, we provide best practices for a practitioner, considering the implementation of federated learning.
- Martin Abadi, Andy Chu, Ian Goodfellow, H Brendan McMahan, Ilya Mironov, Kunal Talwar, and Li Zhang. 2016. Deep learning with differential privacy. In Proc. ACM SIGSAC Conf. on Computer and Communications Security. ACM, 308--318.Google Scholar
Digital Library
- Sebastian Caldas, Peter Wu, Tian Li, Jakub Konečny, H Brendan McMahan, Virginia Smith, and Ameet Talwalkar. 2018. Leaf: A benchmark for federated settings. arXiv preprint arXiv:1812.01097 (2018).Google Scholar
- Robin C Geyer, Tassilo Klein, and Moin Nabi. 2017. Differentially private federated learning: A client level perspective. arXiv preprint arXiv:1712.07557 (2017).Google Scholar
- H Brendan McMahan, Eider Moore, Daniel Ramage, Seth Hampson, et al. 2016. Communication-efficient learning of deep networks from decentralized data. arXiv preprint arXiv:1602.05629 (2016).Google Scholar
- Peter Middleton, Tracy Tsai, Masatsune Yamaji, Anurag Gupta, and Denise Rueb. 2017. Forecast: Internet of Things - Endpoints and Associated Services, Worldwide, 2017, Gartner. (2017). [Online; Accessed August 2019].Google Scholar
- Reza Shokri and Vitaly Shmatikov. 2015. Privacy-preserving deep learning. In Proc. ACM SIGSAC Conf. on Computer and Communications Security. ACM, 1310--1321.Google Scholar
- Virginia Smith, Chao-Kai Chiang, Maziar Sanjabi, and Ameet Talwalkar. 2017. Federated Multi-task Learning. In Proc. Int. Conf. on Neural Information Processing Systems (NIPS'17). Curran Associates Inc., USA, 4427--4437.Google Scholar
- S. Wang, T. Tuor, T. Salonidis, K. K. Leung, C. Makaya, T. He, and K. Chan. 2019. Adaptive Federated Learning in Resource Constrained Edge Computing Systems. IEEE J. Sel. Areas Commun. 37, 6 (June 2019), 1205--1221.Google ScholarCross Ref
- Qiang Yang, Yang Liu, Tianjian Chen, and Yongxin Tong. 2019. Federated machine learning: Concept and applications. ACM Trans. Intel. Syst. Tec. 10, 2 (2019), 12.Google ScholarDigital Library
Index Terms
- Privacy is What We Care About: Experimental Investigation of Federated Learning on Edge Devices
Recommendations
RuCIL: Enabling Privacy-Enhanced Edge Computing for Federated Learning
Edge Computing – EDGE 2023AbstractFederated learning has emerged as a promising approach for collaborative machine learning while preserving data privacy in distributed settings. Despite recent advancements, challenges such as privacy preservation and communication overhead ...
Fast deep autoencoder for federated learning
Highlights- A fast and privacy-preserving training algorithm for deep autoencoders is proposed.
- The encoder block of the autoencoder is trained using Singular Value Decomposition.
- The decoder block of the autoencoder is trained layer by layer.
AbstractThis paper presents a novel, fast and privacy preserving implementation of deep autoencoders. DAEF (Deep AutoEncoder for Federated learning), unlike traditional neural networks, trains a deep autoencoder network in a non-iterative way, which ...
FEEL: A Federated Edge Learning System for Efficient and Privacy-Preserving Mobile Healthcare
ICPP '20: Proceedings of the 49th International Conference on Parallel ProcessingWith the prosperity of artificial intelligence, neural networks have been increasingly applied in healthcare for a variety of tasks for medical diagnosis and disease prevention. Mobile wearable devices, widely adopted by hospitals and health ...
Comments