A1 Refereed original research article in a scientific journal
VistaRAG: Toward Safe and Trustworthy Autonomous Driving Through Retrieval-Augmented Generation
Authors: Dai X, Guo C, Tang Y, Li H, Wang Y, Huang J, Tian Y, Xia X, Lv Y, Wang F
Publisher: IEEE
Publication year: 2024
Journal: IEEE transactions on intelligent vehicles
Journal name in source: IEEE Transactions on Intelligent Vehicles
Volume: 9
Issue: 4
First page : 4579
Last page: 4582
eISSN: 2379-8858
DOI: https://doi.org/10.1109/TIV.2024.3396450
Web address : https://ieeexplore.ieee.org/abstract/document/10518077
Autonomous driving based on foundation models has recently garnered widespread attention. However, the risk of hallucinations inherent in foundation models could compromise the safety and reliability of autonomous driving systems. This letter, as part of a series of reports from the Distributed/Decentralized Hybrid Workshop on Foundation/Infrastructure Intelligence (DHW-FII), aims to tackle these issues. We introduce VistaRAG, which integrates retrieval-augmented generation (RAG) technologies into autonomous driving systems based on foundation models, to address the inherent reliability challenges in decision-making. VistaRAG employs a dynamic retrieval mechanism to access highly relevant driving experience, real-time road network status, and other contextual information from external databases. This aids foundation models in informed reasoning and decision-making, thereby enhancing the safety and trustworthiness of foundation-model-based autonomous driving systems under complex traffic scenarios.