Refereed article in conference proceedings (A4)

Visible and Infrared Image Fusion Framework based on RetinaNet for Marine Environment

List of Authors: Farahnakian Fahimeh, Poikkonen Jussi, Laurinen Markus, Markis Dimitrios, Heikkonen Jukka

Conference name: International Conference on Information Fusion

Publication year: 2019

Book title *: 2019 22th International Conference on Information Fusion (FUSION)

Number of pages: 5

ISBN: 978-1-7281-1840-6

eISBN: 978-0-9964527-8-6


Self-archived copy’s web address:


Safety and security are critical issues in maritime environment. Automatic and reliable object detection based on multi-sensor data fusion is one of the efficient way for improving these issues in intelligent systems. In this paper, we propose an early fusion framework to achieve a robust object detection. The framework firstly utilizes a fusion strategy to combine both visible and infrared images and generates fused images. The resulting fused images are then processed by a simple dense convolutional neural network based detector, RetinaNet, to predict multiple 2D box hypotheses and the infrared confidences. To evaluate the proposed framework, we collected a real marine dataset using a sensor system onboard a vessel in the Finnish archipelago. This system is used for developing autonomous vessels, and records data in a range of operation and climatic and light conditions. The experimental results show that the proposed fusion framework able to identify the interest of objects surrounding the vessel substantially better compared with the baseline approaches.

Downloadable publication

This is an electronic reprint of the original article.
This reprint may differ from the original in pagination and typographic detail. Please cite the original version.

Last updated on 2022-07-04 at 17:39