A4 Refereed article in a conference publication
Energy-Efficient Path Planning in Uneven Terrains Using Adaptive Reinforcement Learning
Authors: Warnakulasuriya, Diluna A.; Plosila, Juha; Haghbayan, Hashem
Editors: N/A
Conference name: International Conference on Control and Robotics Engineering
Publication year: 2025
Book title : 2025 10th International Conference on Control and Robotics Engineering (ICCRE)
First page : 349
Last page: 355
ISBN: 979-8-3315-4352-5
eISBN: 979-8-3315-4351-8
DOI: https://doi.org/10.1109/ICCRE65455.2025.11093435
Web address : https://doi.org/10.1109/iccre65455.2025.11093435
Efficient navigation of mobile robots through partially known, uneven terrains remains a significant challenge due to the impact of terrain features on motion costs. This paper presents a novel adaptive reinforcement learning approach using a dynamic reward function to address this issue. The proposed algorithm enables learning of energy-efficient paths by estimating cumulative energy costs in a two-and-a-half dimensional (2.5D) grid world, without requiring prior models or energy-cost maps. Unlike conventional reinforcement learning approaches that optimize step-wise energy, our method focuses on minimizing the total traversal energy. Based on classical Q-learning, the agent iteratively improves its policy through experience. Simulation results show that the proposed approach reduces energy consumption by 10.9% compared to shortest-path methods and achieves comparable performance to deterministic, model-based planners optimized for energy.
Funding information in the publication:
This work was financially supported by the Academy of Finland funded project 357220 – DOMINIC (Developmental Multi-Robot Systems in Cognitive Manufacturing).