Refereed journal article or data article (A1)

Deep Learning Based Multi-Modal Fusion Architectures for Maritime Vessel Detection

List of Authors: Fahimeh Farahnakian, Jukka Heikkonen

Publisher: MDPI

Publication year: 2020

Journal: Remote Sensing

Journal name in source: REMOTE SENSING

Journal acronym: REMOTE SENS-BASEL

Volume number: 12

Issue number: 6

Number of pages: 17

eISSN: 2072-4292


Self-archived copy’s web address:

Object detection is a fundamental computer vision task for many real-world applications. In the maritime environment, this task is challenging due to varying light, view distances, weather conditions, and sea waves. In addition, light reflection, camera motion and illumination changes may cause to false detections. To address this challenge, we present three fusion architectures to fuse two imaging modalities: visible and infrared. These architectures can provide complementary information from two modalities in different levels: pixel-level, feature-level, and decision-level. They employed deep learning for performing fusion and detection. We investigate the performance of the proposed architectures conducting a real marine image dataset, which is captured by color and infrared cameras on-board a vessel in the Finnish archipelago. The cameras are employed for developing autonomous ships, and collect data in a range of operation and climatic conditions. Experiments show that feature-level fusion architecture outperforms the state-of-the-art other fusion level architectures.

Downloadable publication

This is an electronic reprint of the original article.
This reprint may differ from the original in pagination and typographic detail. Please cite the original version.

Last updated on 2022-07-04 at 18:09