WAM-Policy:面向四足机器人行走操控的世界动作模型与在策略蒸馏

媒体报道 Hugging Face Papers 原文语言:中文

WAM-Policy 将针对机械臂预训练的世界动作模型转化为四足机器人行走操控策略,先通过跨形态适配与在策略自蒸馏得到快速学生模型,再用强化学习和多教师在策略蒸馏提升性能,实验在模拟任务中达到 85% 成功率并在真实 Unitree Go2 Air 上部署。

全文

Arm-free quadrupeds can perform loco-manipulation, walking on three legs while manipulating with a front leg, yet no existing policy for it follows language instructions. World action models (WAMs) have emerged as effective language-conditioned manipulation policies, but are pretrained for robot arms and sample slowly. WAM-Policy turns one WAM into a quadrupedal loco-manipulation policy via two stages. The first, Cross-Morphology Policy Adaptation and Acceleration, adapts the arm-centric WAM to quadrupeds and distills the transferred policy into a student with one video and two action steps by on-policy self-distillation (OPSD). This student, however, is bounded by its teacher, which only imitates demonstrations. The second stage, Task-Specific Improvement and Merging, therefore tunes the teacher by reinforcement learning (RL) and merges the slow specialists into one few-step student by multi-teacher on-policy distillation (M-OPD). On QLM-Bench, ten simulated tasks with 1,000 demonstrations synthesized without teleoperation, the transferred policy reaches 77.0%, and the OPSD student keeps 76.7% while sampling 14 times faster. Task-specific RL and M-OPD lift it to 85.0%. We also deploy the OPSD student on a real Unitree Go2 Air. WAM-Policy thus achieves a stronger quadrupedal policy at a fraction of the inference cost.

View arXiv page View PDF Project page GitHub 2 Add to collection

正文以来源语言显示。

参考来源

← 返回每日AI报告