UAV-Assisted Maritime Search and Rescue: A Holistic Approach (2403.14281v1)
Abstract: In this paper, we explore the application of Unmanned Aerial Vehicles (UAVs) in maritime search and rescue (mSAR) missions, focusing on medium-sized fixed-wing drones and quadcopters. We address the challenges and limitations inherent in operating some of the different classes of UAVs, particularly in search operations. Our research includes the development of a comprehensive software framework designed to enhance the efficiency and efficacy of SAR operations. This framework combines preliminary detection onboard UAVs with advanced object detection at ground stations, aiming to reduce visual strain and improve decision-making for operators. It will be made publicly available upon publication. We conduct experiments to evaluate various Region of Interest (RoI) proposal methods, especially by imposing simulated limited bandwidth on them, an important consideration when flying remote or offshore operations. This forces the algorithm to prioritize some predictions over others.
- Camera Overview Trinity F90+. https://t6y2v7k3.rocketcdn.me/wp-content/uploads/2023/01/QS_Trinity_Overview_Cameras_V01_220711.pdf. Accessed: 2023-11-02.
- Canadian Coast Guard Auxiliary Search & Rescue Crew Manual. https://ccga-pacific.org/files/library/Chapter_9_Search.pdf. Accessed: 2023-08-16.
- COCO Benchmark Leaderbord. https://paperswithcode.com/sota/real-time-object-detection-on-coco?dimension=FPS%20(V100%2C%20b%3D1). Accessed: 2024-01-27.
- Data Sheet DJI Matrice M210. https://shop.solectric.de/media/pdf/5a/b4/41/spezifikation_matrice210v2.pdf. Accessed: 2023-11-02.
- Data Sheet ElevonX SkyEye. https://www.elevonx.com/wp-content/uploads/2022/10/ElevonX.pdf. Accessed: 2023-11-02.
- Data Sheet Trinity F90+. https://quantum-systems.com/wp-content/uploads/2023/01/QS_TrinityF90_Overview_220912.pdf. Accessed: 2023-11-02.
- NVIDIA Orin NX. https://www.nvidia.com/de-de/autonomous-machines/embedded-systems/jetson-orin/. Accessed: 2024-01-28.
- G. Bradski. The OpenCV Library. Dr. Dobb’s Journal of Software Tools, 2000.
- End-to-end object detection with transformers. In European conference on computer vision, pages 213–229. Springer, 2020.
- Grad-cam++: Generalized gradient-based visual explanations for deep convolutional networks. In 2018 IEEE winter conference on applications of computer vision (WACV), pages 839–847. IEEE, 2018.
- Management of digital eye strain. Clinical and Experimental Optometry, 102, 2019.
- Vision Council. Eyes overexposed: the digital device dilemma. Alexandria, VA: The Vision Councile, 2016.
- Ross Girshick. Fast r-cnn. In Proceedings of the IEEE international conference on computer vision, pages 1440–1448, 2015.
- Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 770–778, 2016.
- Fast region of interest proposals on maritime uavs. In 2023 IEEE International Conference on Robotics and Automation (ICRA), pages 3317–3324, 2023.
- Microsoft coco: Common objects in context. In Computer Vision–ECCV 2014: 13th European Conference, Zurich, Switzerland, September 6-12, 2014, Proceedings, Part V 13, pages 740–755. Springer, 2014.
- Unsupervised human detection with an embedded vision system on a fully autonomous uav for search and rescue operations. Sensors, 19(16):3542, 2019.
- Drones for search and rescue. In 1st International Workshop on Human-Drone Interaction, 2019.
- Pytorch: An imperative style, high-performance deep learning library. In Advances in Neural Information Processing Systems 32, pages 8024–8035. Curran Associates, Inc., 2019.
- Architecture of a low latency h. 264/avc video codec for robust ml based image classification. In Workshop on Design and Architectures for Signal and Image Processing (14th edition), pages 1–9, 2021.
- John M Sullivan. Visual fatigue and the driver. Technical report, University of Michigan, Ann Arbor, Transportation Research Institute, 2008.
- Satoshi Suzuki et al. Topological structural analysis of digitized binary images by border following. Computer vision, graphics, and image processing, 30(1):32–46, 1985.
- Han Vanholder. Efficient inference with tensorrt. In GPU Technology Conference, volume 1, 2016.
- Seadronessee: A maritime benchmark for detecting humans in open water. In Proceedings of the IEEE/CVF winter conference on applications of computer vision, pages 2260–2270, 2022.
- Yolov7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 7464–7475, 2023.