A4 Refereed article in a conference publication

Energy-Efficient Path Planning in Uneven Terrains Using Adaptive Reinforcement Learning




AuthorsWarnakulasuriya, Diluna A.; Plosila, Juha; Haghbayan, Hashem

EditorsN/A

Conference nameInternational Conference on Control and Robotics Engineering

Publication year2025

Book title 2025 10th International Conference on Control and Robotics Engineering (ICCRE)

First page 349

Last page355

ISBN979-8-3315-4352-5

eISBN979-8-3315-4351-8

DOIhttps://doi.org/10.1109/ICCRE65455.2025.11093435

Web address https://doi.org/10.1109/iccre65455.2025.11093435


Abstract

Efficient navigation of mobile robots through partially known, uneven terrains remains a significant challenge due to the impact of terrain features on motion costs. This paper presents a novel adaptive reinforcement learning approach using a dynamic reward function to address this issue. The proposed algorithm enables learning of energy-efficient paths by estimating cumulative energy costs in a two-and-a-half dimensional (2.5D) grid world, without requiring prior models or energy-cost maps. Unlike conventional reinforcement learning approaches that optimize step-wise energy, our method focuses on minimizing the total traversal energy. Based on classical Q-learning, the agent iteratively improves its policy through experience. Simulation results show that the proposed approach reduces energy consumption by 10.9% compared to shortest-path methods and achieves comparable performance to deterministic, model-based planners optimized for energy.


Funding information in the publication
This work was financially supported by the Academy of Finland funded project 357220 – DOMINIC (Developmental Multi-Robot Systems in Cognitive Manufacturing).


Last updated on 2025-01-08 at 07:16