Papers for 2026-10-09

10 papers

HULK: Learning Whole-Body Forceful Loco-Manipulation for Humanoids

5.0/5 很相关 裁判分 10.0 Top pick 当日相对
An Dang, Arturo Flores Alvarez, Yu-Ming Chen, ... , Nima Fazeli, Manikantan Nambi
总结: 全身有力loco-manipulation框架,应对重物负载下平衡与跟踪。
方法: MPC引导RL训练腕力与持物教师,蒸馏单策略并加捕获点屏障。
证据: 仿真每臂10kg时屏障教师速度误差最低,Unitree G1真机评估。
为什么适合我: 契合人形loco-manipulation与MPC+RL全身控制,接触丰富场景。
推荐理由: 直接命中全身强接触 loco-manipulation:用 MPC 引导强化学习做负重全身控制,并在 Unitree G1 上验证。
原摘要

Humanoid loco-manipulation of large, heavy objects demands forceful interaction across the entire body. However, such payloads shift a humanoid's center of mass and impose sustained loads across the upper body, challenging balance and command tracking. We present HULK, a whole-body control framework for forceful loco-manipulation. Using model predictive control (MPC) to guide reinforcement learning with predictions of the loaded dynamics, we train two teachers: one tracks arm motions under wrist forces, and the other locomotes while holding large objects against the body. A capture-point control barrier function augments the wrist-force teacher during training to improve balance under load. We distill both teachers into a single policy. Evaluation spans simulation and the Unitree G1. In simulation, the teacher with the barrier function achieves the lowest forward and lateral velocity tracking errors at 10 kg per arm among evaluated controllers and reduces aggregate divergent component of motion (DCM) excursion magnitude by 35.7% relative to MPC-guided reinforcement learning alone. Our wrist-force teacher withstands torso push disturbances of up to 130 N.

Workhorse: Learning Robust Whole-Body Humanoid Loco-Manipulation from Human Data

5.0/5 很相关 裁判分 10.0 Top pick 当日相对
Songbo Hu, Qiayuan Liao, Yufeng Chi, ... , Pieter Abbeel, Koushil Sreenath
总结: 从无机器人人类演示学习鲁棒全身loco-manipulation。
方法: 视觉规划器预测躯干腕足目标,RL跟踪器跟随并增强模仿误差。
证据: 真机G1分箱踢抓爬箱,仿真成功率77%,40N.s推扰下64%。
为什么适合我: 人体数据到真机loco-manipulation,感知运动与接触丰富核心。
推荐理由: 从人体示范学习接触丰富的人形全身 loco-manipulation 与运动跟踪,含踢、爬和推扰恢复,高度贴合。
原摘要

Humanoid robots still struggle to plan contact-rich whole-body manipulation from egocentric RGB and proprioception. Workhorse learns such manipulation from robot-free human demonstrations. A visual planner predicts five-link targets: the poses of the torso, both wrists, and both feet. A reinforcement-learning whole-body tracker follows them on the robot. Both policies train separately on the same recorded human poses, without retargeting. We augment the training data of each policy to imitate the errors that the other makes at deployment. On a real Unitree G1, Workhorse sorts boxes with its hands and a kick, catches a thrown box, and topples and climbs a suitcase. During box sorting, we show recoveries after a person pushes the robot or takes the box away. In a simulated copy of the demonstration room, the system completes box sorting in 77% of episodes, and in 64% under 40 N.s pushes. With both policies retrained from the same demonstrations, a simulated second humanoid completes box sorting in 83% of episodes without pushes.

Shuaijun Liu, Chenglong Zhang, Xuhao Liu, ... , Zhen Sun, Ningxin Su
总结: 策略闭环精炼视频驱动人形运动跟踪监督。
方法: 定位难过渡区域,联合适应目标与重置课程,滚动验证选优。
证据: 四任务体跟踪误差降25.7%,执行视界增255.6%,优于基线。
为什么适合我: 视频人体动作变可跟踪可上真机控制,模仿学习关键。
推荐理由: 面向视频驱动的人体动作重定向与人形运动跟踪,并用策略执行反馈修正监督与课程。
原摘要

Human videos provide rich motion targets for humanoid learning, yet visually plausible references can still produce persistent failures under physics-based execution. These failures reveal where training supervision should change. We present MimicX, a policy-in-the-loop framework that uses execution feedback to refine video-driven humanoid motion tracking. Starting from reconstructed and retargeted motion, MimicX localizes difficult transitions and affected body regions, then jointly adapts tracking objectives and the reset curriculum for policy continuation. Repeated rollout verification selects execution-priority improvements subject to tracking guards. Across four core video tasks, MimicX consistently improves tracking accuracy and Robust Execution Horizon relative to the Fixed Reference baseline. Task-averaged results show a 25.7% reduction in body-tracking error and a 255.6% increase in execution horizon. Additional video, motion-reference, and collision-scene studies evaluate the method beyond the core tasks, while MimicX-HLoop accelerates feedback through heterogeneous execution. Overall, MimicX turns policy failure into actionable supervision for deciding what to refine and which refinement to retain.

Jeonghwan Kim, Hyeonwoo Kim, Hanbyul Joo
总结: 技能组合实现长时程人环境交互全身控制。
方法: 运动先验加任务相位掩码,目标条件课程与跨任务联合训练。
证据: 统一策略整合场景交互与灵巧操作,保留物理可行性。
为什么适合我: 全身loco-manipulation技能组合,适合复杂接触场景。
推荐理由: 在预训练运动先验上组合全身场景交互与灵巧 loco-manipulation,属于长时程人-环境交互。
原摘要

Achieving human-level dexterity in complex, unstructured environments requires the seamless integration of whole-body scene interaction and dexterous object manipulation skills. While existing physics-based controllers generate physically plausible behaviors in each domain, they largely address these two capabilities independently. In this paper, we present Co${}^{2}$Skill that integrates scene interaction and dexterous manipulation through a unified policy formulation. Built on a pretrained motion prior, the policy uses task and phase dependent observation masks to select information relevant to the current interaction goals. We introduce a goal-conditioned loco-manipulation curriculum that combines partial reference guidance for precision with exploration from varied initial states while allowing goal-directed execution beyond the demonstrated trajectories. We further introduce a cross-task curriculum that jointly trains individual skills and selected task sequences, preserving physical states across task boundaries and maintaining grasps during subsequent scene interactions. Together, these support sequential task execution and simultaneous scene interaction with object manipulation. We evaluate sitting, standing, climbing, stair traversal, and goal-directed manipulation, together with sequential execution and with random different conditions. Additionally, we demonstrate skill compositions in indoor environments, illustrating their integration within the same control formulation.

Precise SE(3) End-Effector Tracking in Whole-Body Humanoid Control

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
Joohwan Seo, Xiaofeng Guo, Jinkun Cao, ... , Guanya Shi, Koushil Sreenath
总结: 几何导纳与残差RL实现全身精确末端SE(3)跟踪。
方法: GAC生成臂目标,残差RL补偿动力学并协调运动平衡。
证据: 真机Unitree G1验证,航向帧减少运动中末端参考误差。
为什么适合我: 全身控制精确末端跟踪,利于loco-manipulation与接触。
推荐理由: 人形全身控制下的精确末端跟踪,用几何导纳加残差强化学习协调操作、行走与平衡。
原摘要

Precise end-effector tracking during humanoid whole-body motion is challenging due to floating-base oscillations, gravity, dynamic coupling, and locomotion-induced disturbances. We propose ResGAC, a whole-body humanoid controller for precise end-effector pose tracking that combines geometric admittance control (GAC) with residual reinforcement learning. GAC provides structured $\SE$ task-space feedback and generates nominal arm joint-position targets, while residual RL compensates for unmodeled dynamics and coordinates locomotion and balance in the shared joint-position action space. The left-invariant geometric formulation allows the same GAC law to be used across manipulation reference frames. This enables the use of a ground-attached heading frame that preserves planar locomotion while removing pelvis roll, pitch, and heave from the manipulation reference, thereby reducing reference-induced end-effector motion during locomotion. ResGAC is validated on a real Unitree G1 humanoid. Across four standing end-effector tracking benchmarks, ResGAC consistently outperforms representative baselines, including SONIC, achieving lower translational and rotational errors. Real-world experiments further demonstrate reduced propagation of pelvis motion to the desired end-effector pose using the proposed ground-attached heading frame. ResGAC achieves $90\%$ success in a standing peg-in-hole task compared with $50\%$ for SONIC, and accurate world-frame $\SE$ end-effector pose tracking during lower-body motion. Experimental videos are included in the supplementary material and are also available on the project website: https://resgac.github.io/ResGAC-website/.

HuMBLE: Human Motion-Driven Behavior Learning for Embodied Locomotion

5.0/5 很相关 裁判分 8.0 Strong 当日相对
Mike Zhang, Dongho Kang, Kevin Bergamin, ... , Sylvain Bertrand, Farbod Farshidian
总结: 人体数据驱动学习可转向鲁棒仿生人形运动。
方法: 教师学生蒸馏先验,多任务RL微调扩展覆盖与鲁棒。
证据: 平衡跟踪鲁棒仿生,泛化超数据分布命令。
为什么适合我: 人体动作到可跟踪可重定向全身运动,RL模仿核心。
推荐理由: 由人体运动蒸馏出可速度引导、仿生且可泛化的人形运动策略,直接对应运动先验与全身运动。
原摘要

Despite recent advances in humanoid locomotion, controllers optimized for command tracking and robustness tend to produce mechanical gaits, whereas controllers tied to human motion data often fail to generalize to commands outside the data distribution. This work introduces a learning framework that balances these competing objectives to synthesize real-time steerable, robust, and biomimetic locomotion policies from human data. Using an in-house curated locomotion dataset covering diverse speeds and directions, we first learn a natural locomotion prior policy through a teacher-student distillation process. Specifically, we train a full-body reference-conditioned policy with Reinforcement Learning (RL), then distill it into a lightweight prior policy conditioned solely on proprioception and a planar torso-velocity steering command. Next, we fine-tune the prior policy with multi-task RL to expand command coverage and robustness beyond the data distribution, pairing a goal-conditioned task that tracks arbitrary commands with a reference-guided task that tracks the human data as an explicit style regularizer. We validate our framework on three humanoid robots: the Boston Dynamics Atlas R1, Atlas D1, and Unitree G1. Experimental results demonstrate robust performance across real-world scenarios, including direct user-controlled locomotion in indoor and outdoor environments, and integration as the locomotion layer within hierarchical control stacks. Benchmarks against Tabula Rasa RL policies trained without human data and ablation studies confirm that our framework yields a lightweight, deployable policy that reconstructs coordinated whole-body behavior from a steering command, retaining the human gait characteristics while remaining robust and fully steerable.

Kerui Chen, Jianrong Zhang, Kai Lv, Hehe Fan
总结: 共适应交互生成器与跟踪策略,提升物理交互技能。
方法: 固定跟踪执行候选建物理偏好,对齐生成器而非标量奖励。
证据: 提升可执行性与交互保真,扩大参考运动可用范围。
为什么适合我: 数字人体交互到物理人形,生成+跟踪匹配动作重定向。
推荐理由: 把数字人交互变成物理可执行的人形技能,贴近运动跟踪与物理角色控制,但重点是交互生成后训练。
原摘要

Recent methods have made promising progress in generating interactions between two humanoids, largely relying on physics-based tracking policies to convert digital reference motions into executable trajectories. However, limited tracking capabilities restrict the range of reference motions that can be successfully executed, reducing data utilization. Moreover, even successful tracking does not guarantee physically plausible responses or faithful realization of the intended interactions. In this paper, we introduce DIGHT, a co-adaptive framework that couples a Digital human Interaction Generator with a Humanoid Tracking policy. Our DIGHT first executes multiple text-conditioned interaction candidates in simulation using a fixed tracker. It then constructs physics-grounded preferences from the resulting rollouts, covering both general executability and interaction fidelity. Rather than collapsing these signals into a single scalar reward for candidate ranking, we align the pretrained generator using physics-decoupled diffusion direct preference optimization (DPO), preserving criterion-specific supervision without differentiating through the simulator. To improve executability, preference pairs are derived from tracking error, friction, and floating. Additionally, to improve interaction fidelity, we propose to incorporate force feedback from simulator as a measure of contact fidelity and construct preferences over contact occurrence, location, duration, and force magnitude. The aligned generator then supplies reference motions for fine-tuning the tracker, improving compatibility between generation and physical execution. Extensive experiments demonstrate that our approach not only improves the physical plausibility of generated motions but also enables more reliable and faithful humanoid interactions in simulation.

Benchmarking Behavioral Steerability in Behavior Foundation Models

4.0/5 相关 裁判分 8.0 Strong 当日相对
Minghe Gao, Zhanxi Yan, Jiahui Liu, ... , Tat-Seng Chua, Juncheng Li
总结: 首个行为基础模型行为可操纵性基准与评估。
方法: 三级条件约束组合操纵层次,统一框架与多模态语料。
证据: 对9个BFM大规模实证研究,定义意图跟随能力。
为什么适合我: 评估意图到人形行为,相关全身运动智能与基础模型。
推荐理由: 评测行为基础模型/运动先验能否按意图生成可执行人形行为,相关但是基准而非控制器。
原摘要

Behavior Foundation Models (BFMs) are emerging as a paradigm for translating human intentions into executable humanoid behaviors. As these models evolve beyond behavior generation toward general-purpose behavioral systems, a fundamental question arises: can they be reliably steered according to user intentions? In this paper, we introduce the concept of behavioral steerability, defined as the ability of BFMs to faithfully generate behaviors that satisfy user-specified intentions. To study this capability, we present RoboSteer, the first benchmark for behavioral steerability in BFMs. RoboSteer organizes behavioral steerability into a three-level hierarchy-Conditional Steering, Constraint Steering, and Compositional Steering-and establishes a unified evaluation framework supported by a large-scale multimodal motion corpus. Using RoboSteer, we conduct the first large-scale empirical study of behavioral steerability across 9 existing BFMs. We view behavioral steerability as more than a capability for controlling motion: it concerns how embodied systems translate human intentions into purposeful actions. We hope RoboSteer will advance research on intention realization as a foundation for general-purpose embodied intelligence.

Sebin Jung, Maitham F. AL-Sunni, Juan Alvarez-Padilla, ... , Changliu Liu, John M. Dolan
总结: GPU并行仿真实现腿足快速自适应全身控制。
方法: 误差选接触仿真器,MPPI优化选定模型,无需离线训练。
证据: 四任务成功率97.5%超基线74%,真机Go2验证。
为什么适合我: 腿足全身MPC自适应,契合复杂地形接触丰富控制。
推荐理由: 腿足机器人的自适应全身 MPPI 控制,符合全身控制与模型预测控制,但不是人形模仿或感知跑酷。
原摘要

Real-time whole-body controllers for legged robots typically plan through a fixed nominal model and degrade when the deployed dynamics change. Adaptive methods typically require a model structure that contact dynamics do not provide, or they need offline training for each anticipated condition. We present Look-back and Look-ahead Adaptive Model Predictive Path Integral control (LLA-MPPI). The method converts whole-body adaptation into selection over a bank of GPU-batched contact simulators with different physical or structural parameters. Windowed prediction errors select the simulator that best explains recent motion. A whole-body MPPI planner optimizes controls through the selected model. The framework requires no offline training, and its selected hypotheses are physically interpretable. Across four simulated tasks, it achieves 97.5% success while the strongest baseline reaches 74% and an oracle with the true model reaches 98.5%. Hardware validation on a Unitree Go2 shows the robot walking under a payload added mid-run, walking after one leg is disabled, and pushing a box to its goal while increasing its mass on the fly. Code, videos, and project details are available at: https://lla-control.github.io

Yunjiao Zhou, Junlang Qian, Lihua Xie, Jianfei Yang
总结: 寄生共去噪从冻结视频扩散解锁3D人体运动生成。
方法: 沿去噪日程解码,流匹配PMD读中间特征,不改主机。
证据: 主机覆盖超专用生成器,无需显式3D运动监督。
为什么适合我: 扩散生成人体运动可转全身控制,匹配方法兴趣。
推荐理由: 从冻结视频扩散中抽取3D人体动作,只停留在动作生成,没有机器人跟踪、重定向或全身控制。
原摘要

Despite never being supervised on explicit 3D motion, large-scale text-to-video diffusion models synthesize realistic human motion in their generated videos. We ask whether this implicit knowledge can be turned into explicit 3D motion generation, without training a separate motion model. Probing a frozen Wan2.1 reveals that a recoverable motion signal is present in its intermediate states across the entire denoising schedule, not confined to the clean output. Motivated by this, we introduce parasitic co-denoising, a paradigm in which motion is decoded from the host model along its denoising schedule rather than produced by an independent generator. We instantiate it as the Parasitic Motion Decoder (PMD), an efficient flow-matching decoder that shares the host's noise schedule and reads its intermediate features through a $σ$-adaptive multi-layer fusion, leaving the host unmodified. Drawing its coverage from the host rather than from motion data, PMD leads dedicated motion generators on text-motion alignment at a small fraction of their trainable parameters, while producing paired video and motion in a single pass that motion-only baselines cannot match.