A4 Article in conference proceedings
An Efficient Multi-sensor Fusion Approach for Object Detection in Maritime Environments

List of Authors: Mohammad-Hashem Haghbayan, Fahimeh Farahnakian, Jonne Poikonen, Markus Laurinen, Paavo Nevalainen, Juha Plosila, Jukka Heikkonen
Publication year: 2018
Journal: Proceedings of the IEEE international conference on intelligent transportation systems
Book title *: 2018 21st International Conference on Intelligent Transportation Systems (ITSC)
Title of series: Proceedings of the IEEE international conference on intelligent transportation systems
ISBN: 978-1-7281-0321-1
eISBN: 978-1-7281-0323-5
ISSN: 2153-0009


Robust real-time object detection and tracking are challenging problems in autonomous transportation systems due to operation of algorithms in inherently uncertain and dynamic environments and rapid movement of objects. Therefore, tracking and detection algorithms must cooperate with each other to achieve smooth tracking of detected objects that later can be used by the navigation system. In this paper, we first present an efficient multi-sensor fusion approach based on the probabilistic data association method in order to achieve accurate object detection and tracking results. The proposed approach fuses the detection results obtained independently from four main sensors: radar, LiDAR, RGB camera and infrared camera. It generates object region proposals based on the fused detection result. Then, a Convolutional Neural Network (CNN) approach is used to identify the object categories within these regions. The CNN is trained on a real dataset from different ferry driving scenarios. The experimental results of tracking and classification on real datasets show that the proposed approach provides reliable object detection and classification results in maritime environments.

Downloadable publication

This is an electronic reprint of the original article.
This reprint may differ from the original in pagination and typographic detail. Please cite the original version.

Last updated on 2019-21-08 at 22:00