Overview of Research Progress and Challenges in Federated Learning
DOI:
https://doi.org/10.62051/9qyaha16Keywords:
Federated Learning; Data Heterogeneity; Data Privacy; Node Attacks.Abstract
In recent years, federated learning has become a hot research topic in the machine learning community. It aims to reduce the potential data security and privacy risks caused by the centralized training paradigm of traditional machine learning through local training and global aggregation. Although federated learning methods have been widely applied in numerous fields such as finance, healthcare, autonomous driving, and smart retail, there are still urgent issues to be addressed in the field of federated learning, including data privacy leakage, malicious node attacks, model security, and the trustworthiness of participants. By delving into and discussing federated learning, this paper aims to provide researchers and practitioners in related fields with a comprehensive understanding and the latest progress of this technology. Based on the characteristics of the data distribution of the parties involved in federated learning training, this paper categorizes existing federated learning methods into horizontal federated learning, vertical federated learning, and federated transfer learning. It also introduces representative federated learning algorithms under different types, including their design concepts, basic processes, and advantages and disadvantages. Combining different application scenarios, this paper further discusses the challenges of federated learning and looks forward to the future development direction of this topic.
Downloads
References
C Xu, W Lang, R Xin, K Mao, H Jiang.Generative detect for occlusion object based on occlusion generation and feature completing. Journal of Visual Communication and Image Representation, 2021, 78:103189.
H Sun, W Lang, C Xu, N Liu, H Zhou. Graph-based discriminative features learning for fine-grained image retrieval. Signal Processing: Image Communication, 2023, 110:116885.
C Xu, H Jiang, Peter Y., Khan Z. A., Y Chen. MHW-PD: A robust rice panicles counting algorithm based on deep learning and multi-scale hybrid window. Computers and Electronics in Agriculture, 2020, 173:105375.
Wang J, Wang Y, Liu L, Yin H, Ye N, Xu C. Weakly Supervised Forest Fire Segmentation in UAV Imagery Based on Foreground-Aware Pooling and Context-Aware Loss. Remote Sensing, 2023, 15, no. 14: 3606.
T. Y u, E. Bagdasaryan, and V . Shmatikov, “Salvaging federated learning by local adaptation,” arXiv preprint arXiv:2002.04758, 2020.
V . Smith, C.-K. Chiang, M. Sanjabi, and A. S. Talwalkar, “Federated multi-task learning,” in Advances in Neural Information Processing Systems, 2017, pp. 4424-4434.
H. Brendan McMahan, Eider M., Daniel R., Seth H., Blaise A. y. A. Communication-Efficient Learning of Deep Networks from Decentralized Data. In Proceedings of the 20th International Conference on Artificial Intelligence and Statistics 2017.
Reza N., Reihaneh T., Jan B., David B. Blumenthal. On the Privacy of Federated Pipelines. In SIGIR'21: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval. July 2021, 1975-1979.
K Cheng, T Fan, Y Jin, Y Liu, T Chen, Papadopoulos D., Q Yang, 2021. Secureboost: A lossless federated learning framework. IEEE Intelligent Systems, 2021, 36(6):87-98.
Yang H, Dasdan A, Hsiao R L, et al. Map-reduce-merge: simplified relational data processing on large clusters. Proceedings of the 2007 ACM SIGMOD international conference on Management of data. 2007: 1029-1040.
Liu, Y., Kang, Y., Xing, C., Chen, T. and Yang, Q. A secure federated transfer learning framework. IEEE Intelligent Systems, 2020, 35(4), pp.70-82.
Downloads
Published
Conference Proceedings Volume
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.