Nguyen Van Huynh
Dynamic Optimal Coding and Scheduling for Distributed Learning over Wireless Edge Networks
Van Huynh, Nguyen; Hoang, Dinh Thai; Nguyen, Diep N.; Dutkiewicz, Eryk
Authors
Dinh Thai Hoang
Diep N. Nguyen
Eryk Dutkiewicz
Abstract
This paper proposes a novel framework that can effectively address key challenges for the development of distributed learning over wireless edge networks. In particular, we first introduce a highly effective distributed learning model leveraging the most recent advanced coded distributed computing algorithm together with collaborative computing resources from wireless edge nodes to securely and effectively execute learning tasks. To minimize the average delay of learning tasks, the coding and scheduling policies must be jointly optimized. However, determining the optimal coding scheme together with the optimal edge nodes for different learning tasks is NP-hard due to the dynamics and uncertainty of the wireless environment and straggling problems at the computing nodes. Thus, we develop a highly effective approach utilizing advances of both reinforcement learning algorithms and the dueling network architecture to quickly find the optimal coding scheme together with the best edge nodes for different learning tasks without requiring completed information about the surrounding environment and straggling parameters in advance. Through extensive simulation results, we show that our proposed framework can reduce the average delay for the whole system up to 66% compared with other conventional learning and optimization approaches.
Citation
Van Huynh, N., Hoang, D. T., Nguyen, D. N., & Dutkiewicz, E. (2021). Dynamic Optimal Coding and Scheduling for Distributed Learning over Wireless Edge Networks. In 2021 IEEE Global Communications Conference (GLOBECOM). https://doi.org/10.1109/globecom46510.2021.9685719
Conference Name | GLOBECOM 2021 - 2021 IEEE Global Communications Conference |
---|---|
Conference Location | Madrid, Spain |
Start Date | Dec 7, 2021 |
End Date | Dec 11, 2021 |
Online Publication Date | Feb 2, 2022 |
Publication Date | 2021 |
Deposit Date | Mar 29, 2023 |
Publisher | Institute of Electrical and Electronics Engineers |
Book Title | 2021 IEEE Global Communications Conference (GLOBECOM) |
DOI | https://doi.org/10.1109/globecom46510.2021.9685719 |
Keywords | Coded computing, wireless edge networks, distributed learning, deep reinforcement learning |
You might also like
Machine Learning for Smart Healthcare Management Using IoT
(2023)
Book Chapter
Defeating Eavesdroppers with Ambient Backscatter Communications
(2023)
Conference Proceeding
Transfer Learning for Signal Detection in Wireless Networks
(2022)
Journal Article
Transfer Learning for Wireless Networks: A Comprehensive Survey
(2022)
Journal Article
Downloadable Citations
About Edinburgh Napier Research Repository
Administrator e-mail: repository@napier.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search