Excited to share my latest open-source project: a voice-controlled agentic robot with pi0, right before
@huggingface
@LeRobotHF
Hackathon!
I've released the complete codebase for a system that seamlessly bridges natural language and robotic action:
Deepgram ASR converts voice commands to text
OpenAI function calling translates text into precise robot instructions
Fine-tuned Pi0 model executes tasks via remote inference server
This demo showcases the potential of multimodal AI systems where voice becomes the primary interface for robotic control.
Check out the full implementation: https://github.com/PathOn-AI/awesome-lerobot/tree/main/contr...
demo video using english to control the robot: https://www.loom.com/share/205d9199f96d4a9498a1e145a3aee32a
demo video using chinese to control the robot:https://www.loom.com/share/2680bfbb3fcf4feabc825ee677164171
@LeRobotHF Hackathon! I've released the complete codebase for a system that seamlessly bridges natural language and robotic action: Deepgram ASR converts voice commands to text OpenAI function calling translates text into precise robot instructions Fine-tuned Pi0 model executes tasks via remote inference server This demo showcases the potential of multimodal AI systems where voice becomes the primary interface for robotic control. Check out the full implementation: https://github.com/PathOn-AI/awesome-lerobot/tree/main/contr... demo video using english to control the robot: https://www.loom.com/share/205d9199f96d4a9498a1e145a3aee32a demo video using chinese to control the robot:https://www.loom.com/share/2680bfbb3fcf4feabc825ee677164171