Refereed article in conference proceedings (A4)
Visible and Infrared Image Fusion Framework based on RetinaNet for Marine Environment
List of Authors: Farahnakian Fahimeh, Poikkonen Jussi, Laurinen Markus, Markis Dimitrios, Heikkonen Jukka
Editors: N/A
Conference name: International Conference on Information Fusion
Publication year: 2019
Book title *: 2019 22th International Conference on Information Fusion (FUSION)
Number of pages: 5
ISBN: 978-1-7281-1840-6
eISBN: 978-0-9964527-8-6
URL: https://ieeexplore.ieee.org/document/9011182
Self-archived copy’s web address: https://research.utu.fi/converis/portal/detail/Publication/45719547
Safety and security are critical issues in maritime environment. Automatic and reliable object detection based on multi-sensor data fusion is one of the efficient way for improving these issues in intelligent systems. In this paper, we propose an early fusion framework to achieve a robust object detection. The framework firstly utilizes a fusion strategy to combine both visible and infrared images and generates fused images. The resulting fused images are then processed by a simple dense convolutional neural network based detector, RetinaNet, to predict multiple 2D box hypotheses and the infrared confidences. To evaluate the proposed framework, we collected a real marine dataset using a sensor system onboard a vessel in the Finnish archipelago. This system is used for developing autonomous vessels, and records data in a range of operation and climatic and light conditions. The experimental results show that the proposed fusion framework able to identify the interest of objects surrounding the vessel substantially better compared with the baseline approaches.
Downloadable publication This is an electronic reprint of the original article. |