Part of the book series:Communications in Computer and Information Science ((CCIS,volume 1784))
Included in the following conference series:
612Accesses
Abstract
With the rapid development of the Internet of Things (IOT), the amount of business data carried by wireless sensor networks (WSNs) has exploded. Unmanned aerial vehicle (UAV)-assisted sensor data collection is effective and environmentally friendly. A UAV should determine which sensor nodes to visit, and the order in which to visit them according to the target requirements. Due to UAV energy and data-collection demands, a mission can have more than one goal. This study investigates the multi-objective global path planning of UAV-assisted sensor data collection (SDC). It is modeled as a multi-objective optimization problem (MOP) to maximize the amount of data collected and minimize UAV flight time. Based on a deep reinforcement learning (DRL) framework, we decompose the MOP into a series of subproblems, model them as neural networks and use an actor-critic algorithm and modified pointer network to solve each subproblem. Then the Pareto front of the path planning solution under the above constraints can be obtained through the forward propagation of the neural network. Experimental results show that the proposed method is superior to a traditional multi-objective evolutionary algorithms in terms of convergence, diversity of solutions, and time complexity. In addtion, the proposed method can be directly applied to the situation in which the number of sensors changes without retraining, and it has better robustness.
This work is supported in part by the National Key R &D Program of China under Grant 2019YFB2102000, and in part by the Collaborative Innovation Center of Novel Software Technology and Industrialization.
This is a preview of subscription content,log in via an institution to check access.
Access this chapter
Subscribe and save
- Get 10 units per month
- Download Article/Chapter or eBook
- 1 Unit = 1 Article or 1 Chapter
- Cancel anytime
Buy Now
- Chapter
- JPY 3498
- Price includes VAT (Japan)
- eBook
- JPY 8579
- Price includes VAT (Japan)
- Softcover Book
- JPY 10724
- Price includes VAT (Japan)
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Li, C., Zhang, H., Hao, B., Li, J.: A survey on routing protocols for large-scale wireless sensor networks. Sensors (Basel, Switzerland)11(4) (2011)
Li, B., Fei, Z., Zhang, Y.: UAV communications for 5g and beyond: Recent advances and future trends. IEEE Internet Things J.6(2), 2241–2263 (2019)
Zhan, C., Zeng, Y., Zhang, R.: Trajectory design for distributed estimation in UAV-enabled wireless sensor network. IEEE Trans. Veh. Technol. 67, 10155–10159 (2018)
Wang, Y., et al.: Trajectory design for UAV-based internet-of-things data collection: a deep reinforcement learning approach. IEEE Internet of Things J. pp. 1–1 (2021)
Gong, J., Chang, T.H., Shen, C., Chen, X.: Flight time minimization of UAV for data collection over wireless sensor networks. IEEE J. Select. Areas Commun.36, 1942–1954 (2018)
Zeng, Y., Zhang, R.: Energy-efficient uav communication with trajectory optimization. IEEE Trans. Wireless Commun.16(6), 3747–3760 (2017)
Ghdiri, O., Jaafar, W., Alfattani, S., Abderrazak, J.B., Yanikomeroglu, J.B.: Offline and online UAV-enabled data collection in time-constrained IoT networks. IEEE Trans. Green Commun. Netw.5, 1918–1933 (2021)
Li, K., Zhang, T., Wang, R.: Deep reinforcement learning for multiobjective optimization. IEEE Trans. Cybernet.51(6), 3103–3114 (2021)
Shu, F., et al.: UAV path intelligent planning in IoT data collection. J. Commun.42(2), 10 (2021)
Zhang, Q., Li, H.: Moea/d: a multiobjective evolutionary algorithm based on decomposition. IEEE Trans. Evol. Comput.11(6), 712–731 (2007)
Xu, Y., Fang, M., Chen, L., Xu, G., Du, Y., Zhang, C.: Reinforcement learning with multiple relational attention for solving vehicle routing problems. IEEE Trans. Cybernet.52, 11107–11120 (2021)
Mnih, V., et al.: Asynchronous methods for deep reinforcement learning. In: International Conference on Machine Learning, pp. 1928–1937 (2016)
Nazari, M., Oroojlooy, A., Takáč, M., Snyder, L.V.: Reinforcement learning for solving the vehicle routing problem. In: NIPS 2018 Proceedings of the 32nd International Conference on Neural Information Processing Systems, vol. 31, pp. 9861–9871 (2018)
Shang, K., Ishibuchi, H., He, L., Pang, L.M.: A survey on the hypervolume indicator in evolutionary multiobjective optimization. IEEE Trans. Evol. Comput.25(1), 1–20 (2021)
Deb, K., Pratap, A., Agarwal, S., Meyarivan, T.: A fast and elitist multiobjective genetic algorithm: NSGA-II. IEEE Trans. Evol. Comput.6(2), 182–197 (2002)
Author information
Authors and Affiliations
College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, China
Rongtao Zhang, Jie Hao, Ran Wang, Hui Wang & Hai Deng
Collaborative Innovation Center of Novel Software Technology and Industrialization, Nanjing, China
Rongtao Zhang & Jie Hao
Cetc Information Technology System Co., Ltd., Shanghai, China
Shifang Lu
- Rongtao Zhang
You can also search for this author inPubMed Google Scholar
- Jie Hao
You can also search for this author inPubMed Google Scholar
- Ran Wang
You can also search for this author inPubMed Google Scholar
- Hui Wang
You can also search for this author inPubMed Google Scholar
- Hai Deng
You can also search for this author inPubMed Google Scholar
- Shifang Lu
You can also search for this author inPubMed Google Scholar
Corresponding author
Correspondence toRongtao Zhang.
Editor information
Editors and Affiliations
Guangzhou University, Guangzhou, China
Shiyu Yang
Griffith University, Gold Coast, QLD, Australia
Saiful Islam
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Zhang, R., Hao, J., Wang, R., Wang, H., Deng, H., Lu, S. (2023). Global Path Planning for Multi-objective UAV-Assisted Sensor Data Collection: A DRL Approach. In: Yang, S., Islam, S. (eds) Web and Big Data. APWeb-WAIM 2022 International Workshops. APWeb-WAIM 2022. Communications in Computer and Information Science, vol 1784. Springer, Singapore. https://doi.org/10.1007/978-981-99-1354-1_15
Download citation
Published:
Publisher Name:Springer, Singapore
Print ISBN:978-981-99-1353-4
Online ISBN:978-981-99-1354-1
eBook Packages:Computer ScienceComputer Science (R0)
Share this paper
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative