How can you make robot learning accessible to everyone? In this talk, Steven Palma introduces LeRobot, a Hugging Face initiative designed to bring Artificial Intelligence into the physical world by making AI for robotics more accessible through end-to-end learning.
In this talk, he will take the audience on a comprehensive tour of the LeRobot platform, exploring its core pillars for open-source robotics:
- Robots & simulation: Utilizing affordable, real-world hardware like the SO-101 arm, alongside robust simulation environments
- Control & teleoperation: Streamlining data collection through unified robot teleoperation and control systems
- Datasets: Navigating the explosive growth of community-driven datasets stored on the Hugging Face Hub - a surge approaching 30,000 datasets that may signal the "ChatGPT moment of robotics"
- Models: Training with ready-to-use, state-of-the-art (SOTA) Vision-Language-Action (VLA) models in PyTorch, including Action Chunking with Transformers (ACT) and SmolVLA.
- Inference & evaluation: Testing and evaluating policies across various layouts and goals using environments like LIBERO.
Finally, Steven Palma will highlight the endless possibilities unlocked by the global community, such as multi-task co-training for zero-shot and few-shot motion transfer. He will also cover the latest advancements in the LeRobot v0.5.0 release, which supercharges open-source robot learning in every dimension.