Papers for 2026-10-31

10 papers

METATRON: A Promptable Whole-Body Execution Layer for Humanoids

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
Chen Tessler, Yifeng Jiang, Alec Otto, ... , Gal Chechik, Xue Bin Peng
总结: 可提示全身执行层,冻结策略支持多样任务。
方法: 生成基策略接收提示,技能层用代码表达意图。
证据: 物理Unitree G1上支持行走与恢复等。
为什么适合我: 契合全身控制与技能编程,利于复杂场景运动。
推荐理由: 直接对应人形全身控制与运动跟踪:可提示的全身执行层,结合动捕、重定向场景交互和技能编程。
原摘要

Humanoid controllers often require task-specific training despite sharing the need for balance and whole-body coordination. We present Metatron, a promptable whole-body execution layer combining a generative base policy with a programmable skill layer. The base policy receives partial goals, collectively called a prompt, that can combine timed body-part targets, velocity commands, and style cues. It produces diverse whole-body motions consistent with these goals. Training combines motion capture, synthetic recovery trajectories, and retargeted scene-interaction motions. After training, the policy is frozen. Stateful programs called skills express task intent as prompts at each control step, drawing rough geometric sketches that the policy turns into coordinated movement. Skills are ordinary code, refined by coding agents that analyze motion data and fit compact rules without task-specific policy training. On the physical Unitree G1, one frozen checkpoint supports walking, recovery, teleoperated object pickup, and sitting on furniture. Comparative evaluations show higher reaching success and push robustness than the tested reference-tracking pipelines. The same recipe produces climbing and acrobatics on a simulated character. Metatron enables coding agents to turn learned motor capabilities into new skills through code, without further policy training.

Kyrylo Kolesnichenko, Jong-Hoon Kim
总结: 将通用跟踪移植到小型人形,单GPU训练。
方法: 适配SONIC框架从头训练全身运动跟踪策略。
证据: 仿真跟踪多数动作,真机上身与慢速可靠。
为什么适合我: 人体动作跟踪重定向上真机,符合核心需求。
推荐理由: 直接对应人形全身运动跟踪与 sim-to-real,把通用跟踪器迁到小型人形并做真机评估。
原摘要

We present SONIC-K1, to our knowledge the first open-weights whole-body motion tracker for the Booster K1 humanoid, obtained by adapting the SONIC framework to this smaller robot. The policy is trained from scratch on a single shared GPU with a small fraction of the compute reported for SONIC. In MuJoCo simulation, it tracks nearly all held-out motion clips and performs well on external benchmarks under SONIC's success criterion. On the real K1, it tracks upper-body and slow motions, while stepping and turning remain less reliable, and simulation experiments show a sensitivity to action latency. These results show broad motion-tracking capability on a modest training budget and point to quantitative hardware evaluation as the main next step. Code, policy weights and evaluation tools are publicly available.

Nghia Le, Khang Nguyen, Ba Long Tran, ... , Hai-Nguyen Nguyen, Anh Nguyen
总结: 从野外视频迁移人人交互到人-人形交互。
方法: 重建3D运动后加权转移并优化平衡接触。
证据: 实现拥抱跳舞握手等,泛化不同人形形态。
为什么适合我: 接触丰富交互动作迁移,利于loco-manipulation。
推荐理由: 直接对应人体动作重定向与模仿,把野外人际交互视频转成可保持接触关系的人形交互。
原摘要

Enabling a humanoid to interact naturally with human partners requires preserving not only individual motions but also the spatial, semantic, and contact relationships underlying the interaction (i.e., hugging, dancing, hand-shaking, etc.). Furthermore, a practical solution should generalize across various humanoid embodiments with distinct morphologies and kinematic constraints. To tackle this challenge, we propose HumiTransfer, a mimetic embodiment transfer framework that converts in-the-wild human-human interaction videos into physically plausible human-humanoid interactions. HumiTransfer first reconstructs 3D human motion with consistent foot-ground contact, then transfers one participant to a target humanoid embodiment via interaction modeling, using weighted joint-relative directions and anatomical offsets to prioritize interaction-critical inter-body relationships, while post-retargeting optimization enforces balance, contact, and collision avoidance. Subsequently, we apply HumiTransfer to 1,200 in-the-wild videos, producing approximately 500,000 frames of diverse interactions for the 26-DoF Unitree R1 Edu and the 23-DoF HighTorque Mini-hi humanoid robot, resulting in our HumiMimic dataset. Across both robots, HumiTransfer achieves superior motion fidelity, preserves inter-body relationships, and maintains contact accuracy compared with existing baselines. Moreover, we demonstrate that HumiMimic supports motion generation methods for synthesizing interactive humanoid motions following a human partner. Finally, our real robot deployments confirm the physical executability of the transferred motions in real-world settings. Our project is available at https://aioznetwork.github.io/HumiMimic/

Adrian B. Ghansah, Yujin An, Jeeseop Kim, Soon-Jo Chung
总结: 两阶段框架实现敏捷人形运动参考与执行。
方法: 在线降阶模型生成参考,再训全身跟踪策略。
证据: G1实现宽速域运动、单腿跳与连续切换。
为什么适合我: 敏捷全身运动与参考生成,契合跑酷控制。
推荐理由: 直接对应人形全身控制与敏捷运动跟踪,用降阶参考生成驱动全身策略并在 G1 上验证。
原摘要

This paper presents a two-stage learning framework for versatile and agile humanoid locomotion that couples online reduced-order model (ROM) reference generation with whole-body tracking control. In the first stage, we train a command-conditioned whole-body reference generator using single rigid body dynamics combined with full humanoid kinematics. In the second stage, the frozen ROM policy is rolled out online to generate references for training a whole-body tracking policy on the full-order dynamics model. Learning a kino-dynamically consistent reference generator in the simplified ROM space enables us to generate references over a broad command space and over multiple locomotion strategies using a single unified framework. We demonstrate the approach on a Unitree G1 humanoid robot, achieving longitudinal velocities from -2.0 m/s to 2.8 m/s, lateral velocities up to +-1.0 m/s, angular velocities up to +-3.0 rad/s, one-legged hopping, and continuous transitions across the commands, all using one unified reference policy and one whole-body tracking policy.

Aoqian Zhang, Chunzheng Wang, Haoran Chen, ... , Fan Shi, Shuzhi Sam Ge
总结: RL框架学习人形快速动态障碍躲避动作。
方法: 威胁感知奖励与多方向对抗运动先验。
证据: 仿真与硬件实验显著提升避障性能。
为什么适合我: 动态复杂场景感知运动与对抗先验相关。
推荐理由: 直接对应人形全身控制与对抗运动先验,用强化学习学快速动态避障的全身动作并上硬件。
原摘要

Humanoids have become increasingly agile and capable in real-world environments. To operate safely in dynamic scenarios, they must rapidly evade fast-moving obstacles while maintaining stability and physically feasible whole-body motion. Learning such behaviors remains challenging due to the high-dimensional dynamics of humanoid systems and the need to jointly balance reactive obstacle avoidance, motion naturalness, and control robustness. In this work, we present Humanoid Dodgeball, a reinforcement learning (RL) framework for agile dynamic obstacle avoidance in humanoids. Our method enables highly dynamic whole-body evasive maneuvers against incoming projectiles through threat-aware reward shaping, while multiple direction-specific adversarial motion priors regularize the learned behaviors toward stable and diverse human-like motions. Extensive simulation and hardware experiments demonstrate that the proposed framework substantially improves dynamic obstacle avoidance performance across diverse obstacle speeds and launch distances, while preserving robust and physically plausible humanoid motions.

Shiqi Liu, Radu Corcodel, Ding Zhao
总结: 从任务失败自主获取四足全身操作控制器。
方法: 编码代理据失败制定RL问题并迭代精炼。
证据: 获取墙支撑等控制器,复用于后续任务。
为什么适合我: 接触丰富loco-manipulation与RL技能获取。
推荐理由: 落在腿足全身 loco-manipulation 与接触场景交互,用强化学习自动补齐全身技能,但是四足而非人形。
原摘要

Quadrupedal manipulators can extend their workspace through whole-body interaction, but task-planning agents' capabilities remain limited by their available controllers. We present ELEVATE, a framework that uses persistent failures during task-program refinement to identify and acquire missing whole-body control capabilities. When these failures suggest a missing physical capability, a coding agent formulates and iteratively refines a reinforcement-learning problem, specifying behavior-specific rewards, curricula, and termination conditions. Validated controllers are added to the capability library and composed with existing controllers to retry the task. Starting from a single pretrained loco-manipulation controller, ELEVATE autonomously acquires controllers for wall-supported elevation, supported manipulation, and wall descent across a sequence of seven simulation tasks. These controllers are reused in subsequent reaching and object-manipulation tasks. On the five tasks beyond the initial controller's workspace, ELEVATE achieves mean success rates of 98.4%-100% across five independent runs, while coding-agent baselines with a fixed controller library fail to complete these tasks. The synthesized task programs, together with the acquired controllers, also transfer to a physical quadrupedal manipulator without real-robot training or fine-tuning, achieving 18/20 successes in rack retrieval and 16/20 in floor-to-rack placement. Videos and demonstrations are available at https://agentic-quad-elevate.github.io/public/.

Catch It All!: Generalizable Dynamic Catching with a Dexterous Hand

4.0/5 相关 裁判分 7.0 Strong 当日相对
Arth Shukla, Kehlani Fay, Huaze Liu, ... , Alexiy Buynitsky, Nicklas Hansen
总结: 人形灵巧手泛化动态抓取未见物体。
方法: 仿真到真机学习,设计抓取奖励与安全课程。
证据: G1零样本上下手抓取九个未见物体。
为什么适合我: 接触丰富抓取与全身控制泛化部署。
推荐理由: 在 G1 上做接触丰富的动态接物与 sim-to-real,接近人形场景交互,但重心在灵巧手而非全身运动。
原摘要

Catching arbitrary objects requires generalization to novel projectiles and real-time adaptation to unpredictable contact dynamics under noisy visual observations. This paper presents Catch It All!, a sim-to-real catching framework for humanoid robots that generalizes and adapts to unseen objects with variable physical properties for underhand and overhand catches, using only one egocentric camera. We learn policies which generalize to unseen objects with varying geometry, deformability, elasticity, and physical properties. Effective grasps which adapt real-time to object poses and shapes are learned through careful grasp reward design. We provide safety-aware curricula which enable safe, high-frequency action execution near hardware limits, including wrist torque limits as low as 5 Nm. We validate our system by deploying zero-shot on a Unitree G1. With only one egocentric camera, Catch It All! successfully performs underhand and overhand catches on 9 unseen objects not seen during training, including low-rebound plushes, semi-deformable toys and chip bags, and rigid-elastic objects with high rebound on contact.

LLM-guided Planar Loco-Manipulation for Quadruped Robots

3.0/5 一般 裁判分 9.0 Top pick 当日相对
Georges Jetti, Michael Khayyat, Jean-Pierre Sleiman, Stefano Arrigoni, Francesco Braghin
总结: LLM引导四足平面loco-manipulation规划。
方法: 语言规划器映射任务到参数化RL动作序列。
证据: 优于经典规划器,学习交互导航几何关系。
为什么适合我: loco-manipulation规划与RL策略结合。
推荐理由: 接近腿足 loco-manipulation 与场景交互,但是四足平面导航加语言规划,不是人形全身跟踪、感知跑酷或真机全身控制。
原摘要

Robotic navigation typically assumes a collision-free route to the goal exists; in cluttered environments with movable obstacles, however, reaching the goal may require physical interaction. Classical solutions encode these behaviors through geometric rules and task-specific logic, while learning-based approaches often constrain the decision space to low-dimensional motion commands or predefined action sets. We instead consider a broader decision space, jointly selecting the skill, relevant object, and geometric target. Our language-conditioned task planner, fine-tuned with LoRA on synthetic data, maps natural-language tasks and a structured scene representation to variable-length sequences of parameterized actions, executed by low-level reinforcement-learning policies. The planner learns the geometric relations underlying interactive navigation and outperforms a classical planner and a prompted frontier model on interactive navigation tasks. Comparisons with models trained from scratch indicate that composition does not require pretraining when the representation is structured, whereas pretraining yields more reliable geometric targets. At the low level, we introduce an end-to-end whole-body planar pushing policy that achieves a 93.3% success rate in simulation, versus 83.5% for a hierarchical baseline, while reducing completion time by more than 60%. On hardware, the hierarchy yields the correct skill composition in 44/45 trials and end-to-end success in 34/45. Project website: https://anonymousprojects-dev.github.io/LLM-guided-LocoManipulation-Quadrupeds/

MinJun Chang
总结: 研究腕目标构建对人形手臂重定向关节限影响。
方法: 比较重建目标与可达归一化目标效果。
证据: 重建目标更易达限,归一化显著减少。
为什么适合我: 人体动作重定向到真机全身控制关键。
推荐理由: 触及人形手臂重定向,但只是腕部目标与关节限位的局部运动学实证,没有全身控制或学习。
原摘要

Motion retargeting maps a demonstrated human movement onto a robot to compute its joint motion. This study examines how the construction of the desired wrist position affects whether computed arm joint angles reach their permitted limits on a Unitree H1-2. A reconstructed target is formed from demonstrated arm directions and robot segment lengths, so its shoulder-to-wrist distance depends on the demonstrated angle between the segments even when no posture-matching preference is applied. A reach-normalized target retains that direction while rescaling the distance, using the same processed demonstrations and the same joint-angle method. Across a forward-reach sweep the reconstructed target places a joint angle at a bound in 10 of 20 repetitions and the reach-normalized target in none. Across 25 recordings from one participant the corresponding counts are 8 and 6 on the reaching arm and 14 and 5 on the supporting arm, and a second participant repeats the bricklaying and lifting comparison. In hardware replay a joint is commanded to a bound in 12 of 16 direction-matching arm-records and in none of the 16 normalized records, and within the eligible records both tracking error and executed torque at those frames exceed their values elsewhere in the same run. Cross-body reach and arm-to-arm clearance identify limits of radial adjustment. The findings support treating target construction and posture matching as separate retargeting decisions, and evaluating both alongside the wrist positions and clearance that manipulation requires.

Hojun Jang, Jinseok Bae, Donggeun Lim, ... , Yong Seok Kim, Young Min Kim
总结: 从足接触时间表生成长时程人体全身运动。
方法: 自回归扩散模型条件于左右足接触日程。
证据: 比空间引导方法更准确跟随接触时机。
为什么适合我: 扩散生成可跟踪运动,利于重定向上真机。
推荐理由: 用扩散模型按足部接触生成人体动作,接近运动先验,但不是机器人全身控制或上真机。
原摘要

Controllable human motion generation has largely focused on specifying what action should occur or where the body should move. We study a complementary question: can full-body motion be controlled by specifying only when each foot contacts the ground? We introduce StepControl, an autoregressive diffusion model conditioned on a future binary left/right foot-contact schedule, without requiring target root and body poses, or semantic prompts. StepControl represents contact as explicit temporal events and injects them through dedicated cross-attention with classifier-free guidance. We further introduce a stochastic mixture noise schedule and warmup strategy for stable long-horizon autoregressive generation. Experiments show that StepControl follows prescribed contact timing more accurately than adapting existing spatially guided motion generators to contact constraints. It maintains effective contact control over long continuous rollouts and responds to edited schedules such as cadence changes, stop-and-go pauses, limping gaits, and bilateral jumping. Our results show that minimal foot-contact schedules provide an effective and intuitive temporal interface for controllable motion generation.