Get 20M+ Full-Text Papers For Less Than $1.50/day. Start a 14-Day Trial for You or Your Team.

Learn More →

Deep Learning-Based Human Detection Using RGB and IR Images from Drones

Deep Learning-Based Human Detection Using RGB and IR Images from Drones This paper proposes an object detection algorithm based on a deep neural network which utilizes RGB and infrared (IR) images for human detection with drones. Although there are some public RGB image datasets in aerial view, there is no publicly available dataset in which both RGB and IR images are taken simultaneously with drones. Thus, we collect RGB and IR images at various altitudes on our own. However, the detection performance of the RGB and IR-based algorithm is limited, because there are more available RGB images for training than IR images or RGB and IR images taken simultaneously. To address this data imbalance, we use a generative adversarial neural network model called CycleGAN to generate IR images from RGB images in the public and self-collected dataset. Furthermore, the neural network for object detection is accelerated by neural network quantization and optimization to execute the algorithm faster on an embedded computing board. To shorten the search time and improve the robustness of detection, we employ a formation flight of multiple drones for human detection. The effectiveness of the integrated system of formation flight and onboard human detection algorithm is validated by the real flight experiment to find humans who are in a wide and wild area. http://www.deepdyve.com/assets/images/DeepDyve-Logo-lg.png International Journal of Aeronautical and Space Sciences Springer Journals

Loading next page...
 
/lp/springer-journals/deep-learning-based-human-detection-using-rgb-and-ir-images-from-0FZyPGn0K2

References (19)

Publisher
Springer Journals
Copyright
Copyright © The Author(s), under exclusive licence to The Korean Society for Aeronautical & Space Sciences 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
ISSN
2093-274X
eISSN
2093-2480
DOI
10.1007/s42405-023-00632-1
Publisher site
See Article on Publisher Site

Abstract

This paper proposes an object detection algorithm based on a deep neural network which utilizes RGB and infrared (IR) images for human detection with drones. Although there are some public RGB image datasets in aerial view, there is no publicly available dataset in which both RGB and IR images are taken simultaneously with drones. Thus, we collect RGB and IR images at various altitudes on our own. However, the detection performance of the RGB and IR-based algorithm is limited, because there are more available RGB images for training than IR images or RGB and IR images taken simultaneously. To address this data imbalance, we use a generative adversarial neural network model called CycleGAN to generate IR images from RGB images in the public and self-collected dataset. Furthermore, the neural network for object detection is accelerated by neural network quantization and optimization to execute the algorithm faster on an embedded computing board. To shorten the search time and improve the robustness of detection, we employ a formation flight of multiple drones for human detection. The effectiveness of the integrated system of formation flight and onboard human detection algorithm is validated by the real flight experiment to find humans who are in a wide and wild area.

Journal

International Journal of Aeronautical and Space SciencesSpringer Journals

Published: Jan 1, 2024

Keywords: CycleGAN; Formation flight; Infrared image; Neural network acceleration; Neural network quantization; Human detection

There are no references for this article.