Refereed article in conference proceedings (A4)

An Efficient Multi-sensor Fusion Approach for Object Detection in Maritime Environments

List of Authors: Mohammad-Hashem Haghbayan, Fahimeh Farahnakian, Jonne Poikonen, Markus Laurinen, Paavo Nevalainen, Juha Plosila, Jukka Heikkonen

Conference name: IEEE International Conference on Intelligent Transportation Systems

Publication year: 2018

Journal: Proceedings of the IEEE international conference on intelligent transportation systems

Book title *: 2018 21st International Conference on Intelligent Transportation Systems (ITSC)

Title of series: Proceedings of the IEEE international conference on intelligent transportation systems

Number of pages: 8

ISBN: 978-1-7281-0321-1

eISBN: 978-1-7281-0323-5

ISSN: 2153-0009


Self-archived copy’s web address:


Robust real-time object detection and tracking are challenging problems in autonomous transportation systems due to operation of algorithms in inherently uncertain and dynamic environments and rapid movement of objects. Therefore, tracking and detection algorithms must cooperate with each other to achieve smooth tracking of detected objects that later can be used by the navigation system. In this paper, we first present an efficient multi-sensor fusion approach based on the probabilistic data association method in order to achieve accurate object detection and tracking results. The proposed approach fuses the detection results obtained independently from four main sensors: radar, LiDAR, RGB camera and infrared camera. It generates object region proposals based on the fused detection result. Then, a Convolutional Neural Network (CNN) approach is used to identify the object categories within these regions. The CNN is trained on a real dataset from different ferry driving scenarios. The experimental results of tracking and classification on real datasets show that the proposed approach provides reliable object detection and classification results in maritime environments.

Downloadable publication

This is an electronic reprint of the original article.
This reprint may differ from the original in pagination and typographic detail. Please cite the original version.

Last updated on 2022-07-04 at 17:13