Deep reinforcement learning for map-less goal-driven robot navigation
Problem
Mobile robots normally need an explicit map of the environment to navigate, which is impractical or impossible in new or dynamic environments. The study developed a local navigation method that steers a robot to global goals without a map.
Why it matters
Safe map-less navigation is crucial for robot autonomy in unknown or changing real-world environments.
What the AI did
Trained a deep reinforcement learning navigation model based on the Advantage Actor-Critic method that directly translates robot observations into movement commands, and compared it with standard map-based approaches in several simulated navigation scenarios.
Results
In simulation, the method navigated without a map or with a corrupted map while standard map-based approaches failed; no numeric metrics stated in abstract.
Impact
Demonstrated in simulation a navigation capability that survives map loss or corruption where standard approaches fail.
Record
| Venue | International Journal of Advanced Robotic Systems |
|---|---|
| Published | 2021 |
| Work type | article |
| Authors | Matej Dobrevski, Danijel Skočaj |
| Citations | 45 (OpenAlex, at import time) |
| References | 22 |
| Model or method | Deep reinforcement learning, Advantage Actor-Critic |
| Organization | not stated in source |
| Primary source | https://doi.org/10.1177/1729881421992621 |
| Open access | gold |
| Keywords | deep reinforcement learning, map-less navigation, obstacle avoidance, actor-critic, mobile robots |
Importance rating
real but narrower advance
Map-less navigation is a genuinely new capability for robot autonomy in new/dynamic environments; demonstrated in simulation and transferred to a real robot; no scale stated.
More in Robotics & Autonomy
| # | Paper | Year | Citations | Importance |
|---|---|---|---|---|
| 1 | Autonomous robotic laparoscopic surgery for intestinal anastomosis | 2022 | 384 |
7
|
| 2 | Solving Rubik's Cube with a Robot Hand | 2019 | 569 |
6
|
| 3 | PaLM-E: An Embodied Multimodal Language Model | 2023 | 346 |
6
|
| 4 | Assistive Navigation Using Deep Reinforcement Learning Guiding Robot With UWB/Voice Beacons and Semantic Feedbacks for Blind and Visually Impaired People | 2021 | 48 |
6
|
| 5 | Towards Deep Radar Perception for Autonomous Driving: Datasets, Methods, and Challenges | 2022 | 154 |
6
|