Open Access iconOpen Access

REVIEW

crossmark

Edge Intelligence with Distributed Processing of DNNs: A Survey

Sizhe Tang1, Mengmeng Cui1,*, Lianyong Qi2, Xiaolong Xu1

1 School of Computer and Software, Nanjing University of Information Science and Technology, Nanjing, 210000, China
2 School of Computer Science, Qufu Normal University, Qufu, 273100, China

* Corresponding Author: Mengmeng Cui. Email: email

(This article belongs to the Special Issue: Artificial Intelligence for Mobile Edge Computing in IoT)

Computer Modeling in Engineering & Sciences 2023, 136(1), 5-42. https://doi.org/10.32604/cmes.2023.023684

Abstract

With the rapid development of deep learning, the size of data sets and deep neural networks (DNNs) models are also booming. As a result, the intolerable long time for models’ training or inference with conventional strategies can not meet the satisfaction of modern tasks gradually. Moreover, devices stay idle in the scenario of edge computing (EC), which presents a waste of resources since they can share the pressure of the busy devices but they do not. To address the problem, the strategy leveraging distributed processing has been applied to load computation tasks from a single processor to a group of devices, which results in the acceleration of training or inference of DNN models and promotes the high utilization of devices in edge computing. Compared with existing papers, this paper presents an enlightening and novel review of applying distributed processing with data and model parallelism to improve deep learning tasks in edge computing. Considering the practicalities, commonly used lightweight models in a distributed system are introduced as well. As the key technique, the parallel strategy will be described in detail. Then some typical applications of distributed processing will be analyzed. Finally, the challenges of distributed processing with edge computing will be described.

Keywords


Cite This Article

APA Style
Tang, S., Cui, M., Qi, L., Xu, X. (2023). Edge intelligence with distributed processing of dnns: A survey. Computer Modeling in Engineering & Sciences, 136(1), 5-42. https://doi.org/10.32604/cmes.2023.023684
Vancouver Style
Tang S, Cui M, Qi L, Xu X. Edge intelligence with distributed processing of dnns: A survey. Comput Model Eng Sci. 2023;136(1):5-42 https://doi.org/10.32604/cmes.2023.023684
IEEE Style
S. Tang, M. Cui, L. Qi, and X. Xu "Edge Intelligence with Distributed Processing of DNNs: A Survey," Comput. Model. Eng. Sci., vol. 136, no. 1, pp. 5-42. 2023. https://doi.org/10.32604/cmes.2023.023684



cc This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 1675

    View

  • 775

    Download

  • 0

    Like

Share Link