Model-free reinforcement learning for robust locomotion using demonstrations from trajectory optimization
Problem
Creating locomotion policies robust enough to deploy directly on real robots, where training from scratch on hardware is impractical.
Why it matters
Robust real-robot locomotion without extra training is a key barrier to deploying legged robots outside labs.
What the AI did
A two-stage model-free reinforcement learning approach uses a single trajectory-optimization demonstration to bootstrap exploration, then optimizes the task reward for robustness to environment uncertainties.
Results
not stated in source
Impact
Approach was demonstrated on highly dynamic hopping and bounding tasks on a quadruped robot, per the abstract.
Record
| Venue | Frontiers in Robotics and AI |
|---|---|
| Published | 2022 |
| Work type | article |
| Authors | Miroslav Bogdanović, Majid Khadiv, Ludovic Righetti |
| Citations | 26 (OpenAlex, at import time) |
| References | 51 |
| Model or method | model-free reinforcement learning (two-stage) |
| Organization | not stated in source |
| Primary source | https://doi.org/10.3389/frobt.2022.854212 |
| Open access | gold |
| Keywords | reinforcement learning, trajectory optimization, quadruped, locomotion, robust policies |
Importance rating
real but narrower advance
Robust direct-to-hardware legged locomotion is a key robotics barrier; abstract demonstrates hopping/bounding on one quadruped with no scale or impact figures, so significance is inferred.
More in Robotics & Autonomy
| # | Paper | Year | Citations | Importance |
|---|---|---|---|---|
| 1 | Autonomous robotic laparoscopic surgery for intestinal anastomosis | 2022 | 384 |
7
|
| 2 | Solving Rubik's Cube with a Robot Hand | 2019 | 569 |
6
|
| 3 | PaLM-E: An Embodied Multimodal Language Model | 2023 | 346 |
6
|
| 4 | Assistive Navigation Using Deep Reinforcement Learning Guiding Robot With UWB/Voice Beacons and Semantic Feedbacks for Blind and Visually Impaired People | 2021 | 48 |
6
|
| 5 | Towards Deep Radar Perception for Autonomous Driving: Datasets, Methods, and Challenges | 2022 | 154 |
6
|