Papers for 2026-11-03

10 papers
Yifei Huang, Yazhao Yang, Weijia Li, Zhiheng Ma, Dian Shen
总结: 一步扩散实现可引导全身人形运动跟踪。
方法: 建模轨迹分布统一跟踪引导与失败发现。
证据: BONES误差20.1mm最低,部署Unitree G1。
为什么适合我: 扩散模型全身控制契合跟踪重定向真机。
推荐理由: 直接对应人形全身运动跟踪:一步扩散全身控制、RL教师蒸馏、测试时引导与G1真机部署,紧贴全身控制、扩散模型与sim-to-real。
原摘要

General humanoid motion trackers typically rely on deterministic policies that cannot adapt online without brittle reference editing or costly retraining. We present DiffWBC, shifting whole-body control to a generative paradigm via a one-step diffusion model. By modeling distributions over future trajectories, DiffWBC unifies general tracking, test-time steering, and simulation-free failure discovery within a single controller: (1) Generative general tracking: DiffWBC requires a single forward pass per 50 Hz control step and can be distilled from an RL teacher or trained from scratch via model-based RL, achieving the lowest local tracking error among six general trackers on held-out benchmarks (20.1 mm on BONES) and deploying on a physical Unitree G1. (2) Zero-shot test-time steering: differentiable cost gradients and body-group masks modulate the frozen controller online, substantially outperforming kinematic reference editing (0.84 clean pass at 1.25 m ceiling vs. 0.10) and zero-shot generalizing across hurdles, spatial reaching, actuator faults, and tray balancing. (3) Simulation-free failure discovery: plan dispersion across generation noise effectively identifies physical tracking failures (91% precision in top 2%) without physics simulations; targeted fine-tuning on flagged clips resolves 50% of failure cases. Videos and interactive demonstrations are available at https://diffwbc.github.io/#selfassess.

Geometry-Aware Humanoid Retargeting via Manifold ODEs

5.0/5 很相关 裁判分 10.0 Top pick 当日相对
Pengyu Zhu, Heye Wang, Xi Wang, ... , He Kong, Guodong Shi
总结: 流形ODE实现保持交互的人形重定向。
方法: KKT条件作流形ODE,提出TaSP-KKT前向法。
证据: 达相同效果并连接SQP局部收敛性。
为什么适合我: 人体动作重定向到人形保持地形物体关系。
推荐理由: 聚焦交互保持的人形动作重定向,在流形ODE上改进OmniRetarget式约束优化,属于人体动作重定向与场景交互的核心方向。
原摘要

In this paper, we focus on interaction-preserving motion retargeting, which transfers human demonstrations to humanoids while maintaining spatial relationships with objects and terrain. Previous work, such as OmniRetarget, addresses this task through temporally coupled constrained optimization, requiring repeated sequential quadratic programming (SQP) iterations at each frame. We study this problem from an ordinary differential equation (ODE) perspective by modeling the continuous-time limit of its framewise Karush-Kuhn-Tucker (KKT) conditions as an ODE on the robot configuration manifold. This viewpoint offers two benefits: (i) it connects OmniRetarget's SQP iterations to a backward discretization of the ODE, enabling us to establish their local convergence under suitable regularity assumptions; and (ii) it leads to TaSP-KKT (tangent-space parametrization for KKT flow), a new retargeting method based on a forward discretization of the KKT flow. The proposed method achieves the same first-order convergence to the ODE solution as the corresponding backward scheme while requiring only one weighted tangent-cone projection and a closed-form manifold update per step, thereby avoiding repeated inner SQP iterations. Numerical experiments show that TaSP-KKT achieves retargeting quality comparable to, though slightly lower than, that of OmniRetarget while running approximately twice as fast.

Tianlin Zhang, Weipeng Xia, Lingwei Zhang, ... , Zhongyu Li, Yun-Hui Liu
总结: 在线学异构动力学提升精确loco-manipulation。
方法: 污染高斯近似潜在条件结合GP在线学习。
证据: 改善浮基预测与末端执行器跟踪。
为什么适合我: 复用运动策略实现接触丰富loco-manip。
推荐理由: 研究冻结运动策略下的在线动力学学习以提升精确loco-manipulation,直接命中腿足运动与全身loco-manipulation。
原摘要

How to reuse a pretrained locomotion policy for precise loco-manipulation is still an open problem. We propose an online method to learn the closed-loop dynamics under a frozen locomotion policy. The learned model predicts floating-base motion and improves loco-manipulation accuracy. However, unobserved latent conditions of the policy introduce heterogeneous responses, meaning that the same observed state will lead to different motions. Direct learning without accounting for this heterogeneity introduces bias and fluctuations into dynamics estimates, degrading floating-base prediction and end-effector tracking. To address this problem, a contaminated Gaussian model is proposed to approximate the effects of latent conditions. The model uses two Gaussian components to approximate predictable and unpredictable responses under the same observed state. Then, the contaminated Gaussian model is combined with a Gaussian process to construct an online learner using random Fourier features (RFFs). The learner estimates each response's probability of belonging to the predictable component and uses it to weight online updates, capturing predictable responses while reducing bias and fluctuations caused by heterogeneous observations. With consistent and unbiased dynamics estimates, model predictive control (MPC) predicts floating-base motion accurately and enables precise loco-manipulation. A finite-sample error bound is established to ensure uniform convergence in online learning. Simulation and hardware experiments demonstrate consistent end-effector tracking across different manipulator configurations and tasks, with errors of 0.01 m.

Wendong Bu, Tinghong Ye, Qizhou Wang, ... , Xingxing Wang, Juncheng Li
总结: 大规模视频扩展人形运动基础模型。
方法: 构建数据集与理解生成执行架构流匹配训练。
证据: 支持多模态生成与实时闭环执行。
为什么适合我: 人体视频到可执行全身运动契合兴趣。
推荐理由: 从大规模人体视频构建可执行人形动作并做实时闭环控制,覆盖动作重定向、运动基础模型与全身执行。
原摘要

Scaling humanoid motion foundation models is constrained by the scarcity of diverse, robot-executable data and by the difficulty of jointly learning from heterogeneous multimodal inputs while supporting real-time closed-loop control. We present Movens-5M, constructed from raw Internet videos through clip generation, quality filtering, semantic annotation, motion recovery, and physical refinement with humanoid retargeting and execution verification. It contains 15 million human-motion sequences and 5 million physically executable humanoid-motion sequences spanning over 10,000 hours, aligned with text, RGB video, speech, and music. Building on this data, we introduce Movens-Zero, a scalable understanding-generation-execution architecture that supports joint learning across modalities and real-time closed-loop execution. Task-mixed flow-matching training jointly optimizes a single action expert across seven generation tasks, enabling direct motion generation from text, speech, music, and video. Multimodal Real-Time Chunking connects overlapping chunks under continuously updated instructions and robot states for continuous closed-loop execution. We further introduce Movens-Intent, a four-track benchmark with 8,192 expert-verified condition-motion pairs across text, speech, music, and video. Experiments show consistent gains across all four modalities when scaling execution-verified data from 1% to 100% and action-expert capacity from 64M to 911M parameters, while demonstrating that data quality and cross-modal supervision improve generation and execution.

$\nabla$Mimic: Ultra-Efficient Humanoid Control with Differentiable Simulation

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
Weyl Lu, Yubei Chen
总结: 可微仿真实现超高效人形运动控制。
方法: 中值裁剪梯度并多步回归复用仿真。
证据: 精确梯度使跟踪更高效稳定。
为什么适合我: 一阶RL模仿学习适合接触丰富全身控制。
推荐理由: 用可微仿真的精确梯度做接触丰富的人形运动跟踪,显著提高全身模仿/控制的样本效率,属于人形全身控制核心。
原摘要

Robot policy learning is dominated by zeroth-order methods such as PPO, which treat the simulator as a black box and pay for it with enormous sample counts. First-order policy learning differentiates through the dynamics, but on contact-rich whole-body control it has rarely worked: its gradients explode. A recent world-model method showed that derivative information can make humanoid motion tracking far more efficient, using surrogate gradients of a learned model. We show that exact gradients of the simulator itself do better, once two obstacles are removed. Exact gradients contain rare unbounded samples, because contact dynamics is not differentiable everywhere and its derivative diverges near some events; and they are expensive, because the simulator's adjoint has to replay the contact solve. $\nabla$Mimic bounds these samples with median-relative per-sample gradient clipping at every step of the backward pass, and reuses each costly simulated window by multistep regression onto gradient-derived action targets, which bounds every action target independently of the gradient scale. NablaEngine, a differentiable GPU simulation engine for the Unitree G1, removes the cost: it computes MuJoCo's full contact dynamics with fused per-world kernels and the adjoint of a whole control step as a single megakernel, with analytic gradients that match float64 finite differences, $11.5\times$ faster than the available MuJoCo Warp adjoint. On whole-body tracking of all 40 LAFAN1 clips with one policy on one GPU, $\nabla$Mimic reaches the score reported by the state-of-the-art world-model method, 0.82, in 20 minutes instead of 1.2 h, and 0.874 in 1.8 h. SHAC, the standard first-order baseline, stops on exploding gradients within minutes. We release NablaEngine and $\nabla$Mimic as open-source infrastructure for first-order humanoid policy learning.

HIPC: Humanoid Iterative Planning and Control via Goal-Conditioned Motion Closure

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
Yi Han, Xingyu Chen, Zixuan Lang, ... , Renjing Xu, Lei Han
总结: 迭代规划控制实现目标条件运动闭环。
方法: 生成模型与跟踪耦合用规范表示避奇异。
证据: 支持多样地形语义运动生成适应扰动。
为什么适合我: 闭环全身规划控制契合复杂地形跑酷。
推荐理由: 把生成式全身运动规划与跟踪闭合成实时迭代规划控制,针对跟踪漂移与扰动适应,紧贴全身跟踪与生成控制。
原摘要

Recent generative models are widely used to provide whole-body motion for humanoid tracking. Current methods combine motion generators with controllers in an open-loop paradigm, which leads to critical issues: tracking errors can accumulate into spatial drift, and the planner cannot adapt to unexpected physical disturbances without feedback from physical execution. However, directly feeding realized states back to the planner in a closed loop can cause discontinuities, resulting in physical jitter and even falls, since such states are out of distribution during training. To bridge this gap, we propose HIPC, a real-time Humanoid Iterative Planning and Control framework that couples a generative model with motion tracking into a unified planning-and-control paradigm. HIPC introduces a goal-conditioned motion planning trained with a canonical motion representation that avoids gimbal-lock singularities under extreme orientations and supports motion generation on diverse geometric and semantic conditions. Then, HIPC adopts two strategies, deviation-decayed recovery and history re-anchoring, to mitigate the out-of-distribution shift caused by realized-state feedback. Finally, HIPC operates a real-time asynchronous planning-and-control system, with latency compensation to reduce temporal mismatch for inference delay. Extensive experiments confirm the effectiveness of HIPC under switching and composition of diverse conditions. Results show that HIPC achieves state-of-the-art goal-reaching accuracy among existing methods while simultaneously demonstrating robustness to physical perturbations and the ability to recover from falls.

Jo\~ao A. C\^andido Ramos, Lionel Blond\'e, Hugues Vinzant, Jacopo Castellini, Alexandros Kalousis
总结: 最优传输监督从观察实现模仿学习。
方法: 局部OT对齐与短时域可微actor-critic。
证据: 接触任务含152肌人形上提升效率稳定。
为什么适合我: 观察模仿与可微仿真用于腿足全身控制。
推荐理由: 面向仅观测模仿,用最优传输与短时域可微actor-critic处理接触丰富运动,并包含肌肉骨骼人形,接近模仿学习与物理角色控制。
原摘要

Imitation learning from observations must recover behavior from state-only demonstrations without known temporal correspondence. Differentiable simulators provide pathwise policy gradients, but differentiating through long, contact-rich trajectories can make optimization unstable. We introduce FOCUS, which combines local optimal-transport alignment with short-horizon differentiable actor-critic learning. FOCUS matches agent rollout windows to multiple sampled expert segments using a soft best-of-$K$ objective that emphasizes locally compatible matches. The resulting transport-based costs provide differentiable imitation rewards, while a learned critic bootstraps value beyond the rollout horizon. FOCUS requires neither temporally aligned trajectories nor expert-aligned initialization or teacher forcing. Across contact-rich locomotion tasks in DFlex, including a musculoskeletal humanoid controlled by 152 muscle activations, FOCUS improves sample efficiency and training stability over adversarial imitation-from-observation methods and prior differentiable imitation baselines.

ROOF: Learning Humanoid Fall Recovery under Overhead Constraints

4.0/5 相关 裁判分 8.0 Strong 当日相对
Yidan Lu, Jiayuan Yu, Zongrui Cai, ... , Ping Luo, Peng Lu
总结: 学习头顶障碍下人形跌倒恢复策略。
方法: RL结合几何逃逸引导与运动先验。
证据: 仿真88.5%成功,真机G1 95/150恢复。
为什么适合我: 接触丰富场景全身恢复与loco相关。
推荐理由: 人形在头顶约束下的跌倒恢复,结合强化学习、运动先验与接触支撑,属于接触丰富的全身运动控制,但不是跟踪或跑酷主线。
原摘要

A fallen humanoid beneath an overhead obstacle faces a coupled recovery problem. It must create clearance while organizing support for a stable rise, since attempting to stand before making room can further increase obstruction. We introduce a reinforcement learning method with contact-supported geometric escape guidance, which rewards incremental reduction of robot-obstacle overlap without prescribing an escape path. To achieve this, a learned motion prior, together with posture-dependent support and joint-stall costs, is proposed to shape a single policy that learns when to clear the obstacle, how to establish support, and when to complete the rise, all using proprioception alone. In simulation, it recovers in 88.5% of trials beneath plates that can only be lifted, compared with 18.9% without geometric guidance, and in 98.6% of trials beneath free plates with randomized size, mass and placement. On a Unitree G1, the deployed policy recovered in 95 of 150 attempts across seven real-world obstacle scenes, including furniture and multi-object arrangements absent from training. Project page: https://lu-yidan.github.io/ROOF/

Fenglong Song, Roland Schwan, Yuwen Chen, Yuning Jiang, Colin N. Jones
总结: GPU批量可微QP求解器服务机器人控制。
方法: 近端内点法支持密集稀疏多阶段QP。
证据: 大批量加速18.8倍,端到端学习有效。
为什么适合我: 全身MPC与控制的高效可微求解基础。
推荐理由: 批量可微QP求解器可服务全身控制与MPC,但是通用优化基础设施,不是人形运动智能本身。
原摘要

Quadratic programs (QPs) are fundamental building blocks of many robotic tasks such as inverse kinematics, whole-body control, and model predictive control. Extending these methods to large-scale robot learning and control requires solving many QPs concurrently and, for end-to-end learning, differentiating through their solutions. Efficient batched optimization is therefore essential to bringing established model-based methods into GPU-based robotics pipelines. We present \textsc{cuPIQP}, a batched and differentiable QP solver on GPUs based on a proximal interior-point method, with unified support for dense, sparse, and multistage problems. The solver exploits parallelism across independent QPs and their internal structure while preserving per-problem numerical updates and termination decisions. Benchmarks with up to 16384 QPs per batch demonstrate solve-time speedups of up to $18.8\times$ over \textsc{Moreau} and $4.26\times$ over eight-core \textsc{PIQP}. In an end-to-end learning task, \textsc{cuPIQP} accelerates training by $4.6\times$ over \textsc{QPAX} and $7.8\times$ over \textsc{Moreau}. By reducing the computational cost, \textsc{cuPIQP} provides efficient, reusable infrastructure for integrating model-based optimization into large-scale robot learning and control.

Zhixuan Xu, Yichen Li, Bingchen Wu, ... , Tianyu Qiu, Lin Shao
总结: 展示接触展开转移灵巧操作技能。
方法: 接触接地演示与分层接触轨迹策略。
证据: 六任务成功率至少提升50个百分点。
为什么适合我: 接触丰富模仿学习可扩展至loco-manip。
推荐理由: 用接触展开把人类演示重定向到灵巧手,触及模仿与重定向,但对象是手部操作而非人形全身运动。
原摘要

Robot-free human demonstrations offer a promising route to scaling dexterous manipulation data. The key challenge is to preserve the demonstrator's natural dexterity while producing contact-grounded observations and actions that transfer to robot hands. We present Contact Imitation Interface (CIMI), a framework with contact-grounded demonstration and learning interfaces. The demonstration interface combines shared contact geometry and fingertip RGB views with contact-alignment-first retargeting and reprojection of wider scene views. The learning interface introduces a hierarchical policy in which a contact-surface planner predicts relative contact-surface trajectories and a controller coordinates wrist and finger commands to improve contact alignment. CIMI combines contact-grounded observations, retargeting, and action representations, improving mean final-stage success by at least 50 percentage points over baseline policies across six hand-task pairs on LEAP and Wuji. Hardware designs and software are publicly available.