Fast or Slow: An Autonomous Speed Control Approach for UAV-assisted IoT Data Collection Networks

Chu, Nam H.; Hoang, Dinh Thai; Nguyen, Diep N.; Huynh, Nguyen Van; Dutkiewicz, Eryk

Abstract

Unmanned Aerial Vehicles (UAVs) have been emerging as an effective solution for IoT data collection networks thanks to their outstanding flexibility, mobility, and low operation costs. However, due to the limited energy and uncertainty from the data collection process, speed control is one of the most important factors while optimizing the energy usage efficiency and performance for UAV collectors. This work aims to develop a novel autonomous speed control approach to address this issue. To that end, we first formulate the dynamic speed control task of a UAV as a Markov decision process taking into account its energy status and location. In this way, the Q-learning algorithm can be adopted to obtain the optimal speed control policy for the UAV. To further improve the system performance, we develop a highly-effective deep dueling double Q-learning algorithm utilizing outstanding features of the deep neural networks as well as advanced dueling architecture to quickly stabilize the learning process and obtain the optimal policy. Through simulations, we show that our proposed solution can achieve up to 40% greater performance, i.e., an average throughput of the system, compared with other conventional methods. Importantly, the simulation results also reveal significant impacts of UAV's energy and charging time on the system performance.

Citation

Chu, N. H., Hoang, D. T., Nguyen, D. N., Huynh, N. V., & Dutkiewicz, E. (2021, March). Fast or Slow: An Autonomous Speed Control Approach for UAV-assisted IoT Data Collection Networks. Presented at 2021 IEEE Wireless Communications and Networking Conference (WCNC), Nanjing, China

• Presentation Conference Type: Conference Paper (Published)
• Conference Name: 2021 IEEE Wireless Communications and Networking Conference (WCNC)
• Start Date: Mar 29, 2021
• End Date: Apr 1, 2021
• Online Publication Date: May 5, 2021
• Publication Date: 2021
• Deposit Date: Mar 29, 2023
• Publisher: Institute of Electrical and Electronics Engineers
• Series ISSN: 1558-2612
• Book Title: 2021 IEEE Wireless Communications and Networking Conference (WCNC)
• DOI: https://doi.org/10.1109/wcnc49053.2021.9417563
• Keywords: IoT, UAV, data collection, speed control, deep Q-learning, MDP, deep dueling