Model-free reinforcement learning for robust locomotion using demonstrations from trajectory optimization

Miroslav Bogdanović, Majid Khadiv, Ludovic Righetti

Frontiers in Robotics and AI 2022 article cited by 26

importance 5/10 partially solved Reinforcement Learning in Robotics legged robotics stage: research

Creating locomotion policies robust enough to deploy directly on real robots, where training from scratch on hardware is impractical.

Robust real-robot locomotion without extra training is a key barrier to deploying legged robots outside labs.

A two-stage model-free reinforcement learning approach uses a single trajectory-optimization demonstration to bootstrap exploration, then optimizes the task reward for robustness to environment uncertainties.

not stated in source

Approach was demonstrated on highly dynamic hopping and bounding tasks on a quadruped robot, per the abstract.

Venue Frontiers in Robotics and AI
Published 2022
Work type article
Authors Miroslav Bogdanović, Majid Khadiv, Ludovic Righetti
Citations 26 (OpenAlex, at import time)
References 51
Model or method model-free reinforcement learning (two-stage)
Organization not stated in source
Primary source https://doi.org/10.3389/frobt.2022.854212
Open access gold
Keywords reinforcement learning, trajectory optimization, quadruped, locomotion, robust policies
5 / 10

real but narrower advance

Robust direct-to-hardware legged locomotion is a key robotics barrier; abstract demonstrates hopping/bounding on one quadruped with no scale or impact figures, so significance is inferred.

Basis: inferred. Judged from the source text, which gives no explicit scale. Stated scale: not stated in source. Method and limits.

# Paper Year Citations Importance
1 Autonomous robotic laparoscopic surgery for intestinal anastomosis
Hamed Saeidi, Justin David Opfermann, Michael Kam, Shuwen Wei, Simon L...
2022 384
7
2 Solving Rubik's Cube with a Robot Hand
OpenAI, Ilge Akkaya, Marcin Andrychowicz, Maciek Chociej, Mateusz Litw...
2019 569
6
3 PaLM-E: An Embodied Multimodal Language Model
Danny Driess, Fei Xia, Mehdi S. M. Sajjadi, Corey Lynch, Aakanksha Cho...
2023 346
6
4 Assistive Navigation Using Deep Reinforcement Learning Guiding Robot With UWB/Voice Beacons and Semantic Feedbacks for Blind and Visually Impaired People
Chen-Lung Lu, Ziyan Liu, Jui-Te Huang, Ching-I Huang, Bo-Hui Wang, Yi...
2021 48
6
5 Towards Deep Radar Perception for Autonomous Driving: Datasets, Methods, and Challenges
Yi Zhou, Lulu Liu, Haocheng Zhao, Miguel López‐Benítez, Limin Yu, Yuta...
2022 154
6