Deep reinforcement learning for map-less goal-driven robot navigation

Matej Dobrevski, Danijel Skočaj

International Journal of Advanced Robotic Systems 2021 article cited by 45

importance 5/10 partially solved Reinforcement Learning in Robotics mobile robotics stage: research

Mobile robots normally need an explicit map of the environment to navigate, which is impractical or impossible in new or dynamic environments. The study developed a local navigation method that steers a robot to global goals without a map.

Safe map-less navigation is crucial for robot autonomy in unknown or changing real-world environments.

Trained a deep reinforcement learning navigation model based on the Advantage Actor-Critic method that directly translates robot observations into movement commands, and compared it with standard map-based approaches in several simulated navigation scenarios.

In simulation, the method navigated without a map or with a corrupted map while standard map-based approaches failed; no numeric metrics stated in abstract.

Demonstrated in simulation a navigation capability that survives map loss or corruption where standard approaches fail.

Venue International Journal of Advanced Robotic Systems
Published 2021
Work type article
Authors Matej Dobrevski, Danijel Skočaj
Citations 45 (OpenAlex, at import time)
References 22
Model or method Deep reinforcement learning, Advantage Actor-Critic
Organization not stated in source
Primary source https://doi.org/10.1177/1729881421992621
Open access gold
Keywords deep reinforcement learning, map-less navigation, obstacle avoidance, actor-critic, mobile robots
5 / 10

real but narrower advance

Map-less navigation is a genuinely new capability for robot autonomy in new/dynamic environments; demonstrated in simulation and transferred to a real robot; no scale stated.

Basis: inferred. Judged from the source text, which gives no explicit scale. Stated scale: not stated in source. Method and limits.

# Paper Year Citations Importance
1 Autonomous robotic laparoscopic surgery for intestinal anastomosis
Hamed Saeidi, Justin David Opfermann, Michael Kam, Shuwen Wei, Simon L...
2022 384
7
2 Solving Rubik's Cube with a Robot Hand
OpenAI, Ilge Akkaya, Marcin Andrychowicz, Maciek Chociej, Mateusz Litw...
2019 569
6
3 PaLM-E: An Embodied Multimodal Language Model
Danny Driess, Fei Xia, Mehdi S. M. Sajjadi, Corey Lynch, Aakanksha Cho...
2023 346
6
4 Assistive Navigation Using Deep Reinforcement Learning Guiding Robot With UWB/Voice Beacons and Semantic Feedbacks for Blind and Visually Impaired People
Chen-Lung Lu, Ziyan Liu, Jui-Te Huang, Ching-I Huang, Bo-Hui Wang, Yi...
2021 48
6
5 Towards Deep Radar Perception for Autonomous Driving: Datasets, Methods, and Challenges
Yi Zhou, Lulu Liu, Haocheng Zhao, Miguel López‐Benítez, Limin Yu, Yuta...
2022 154
6