Papers for 2026-11-04

10 papers

Anchor 1: Precise and Stable Humanoid Control for Whole-Body Manipulation

5.0/5 很相关 裁判分 10.0 Top pick 当日相对
Archon Robotics, :, Caojun Wang, ... , Yu Zhang, Ziyan Li
总结: 用校准稀疏参考实现精确稳定的人形全身操作控制。
方法: 离线策展配对动作塑造分布,误差反馈与运动编码解耦。
证据: 摘要提出多样协调基准,但未给出定量成功率。
为什么适合我: 贴合全身操作、人体结构保留和无在线关节重定向。
推荐理由: 直接研究人形全身操作的精确稳定控制与稀疏运动参考,最贴近人形全身控制与移动操作。
原摘要

Humanoid controllers have acquired increasingly diverse motor skills, yet translating these capabilities into precise and stable whole-body manipulation remains challenging. Manipulation tasks are sensitive to execution deviations -- even small errors or unintended steps can cause failure. Introducing Anchor 1, a whole-body controller for precise and stable whole-body manipulation, together with a benchmark spanning diverse coordination demands. Anchor 1 adopts calibrated sparse motion references to preserve task-relevant human motion structure without online joint-space retargeting, leaving kinematic freedom for precise control. To guide this freedom towards stable, physically plausible whole-body coordination, we shape the training distribution through offline curation of robot motions paired with these calibrated sparse references. We further introduce explicit error feedback decoupled from motion encoding, improving control precision while supporting flexible command interfaces. To achieve a systematic evaluation of these capabilities, a benchmark is proposed to assess precision, sustained execution stability, and reachability across diverse whole-body coordination demands. Evaluations in simulation and on hardware show stronger precision and stability across all evaluation tracks. Under the most strict real-world global scoring setting, Anchor 1 achieves a 30\% to 80\% decrease in tracking error with fewer look-ahead inputs, and without retargeting compared to all existing controllers. Downstream experiments demonstrate more efficient teleoperated data collection and higher task success using the same deployment pipeline as well. We believe Anchor 1 supports precise and stable whole-body control as a practical basis for humanoid task execution.

Seonghyeon Lim, Hyeonwoo Lee, Mincheol Kim, Kimin Lee, Hyun Myung
总结: 交替优化路由与专家,修正混合专家跟踪的散度误估。
方法: 轮流更新路由器和专家,避免策略梯度中的散度误估。
证据: 可跟踪182段对方失败动作,反向仅有1段。
为什么适合我: 直接服务多样人形运动跟踪的混合专家强化学习。
推荐理由: 针对通用人形运动跟踪改进MoE策略优化,属于全身运动跟踪核心方向。
原摘要

Universal humanoid motion tracking is essential for enabling humanoid robots to perform diverse tasks in human environments. To capture the wide diversity of human motions, mixture-of-experts (MoE) policies have been widely adopted, leveraging dynamic routing to enhance policy expressiveness. However, we identify that divergence between old and updated policies can be misestimated during policy-gradient updates of MoE policies, due to their dynamic routing. Because most policy-gradient algorithms regulate policy updates based on the divergence, this misestimation can lead to either overly conservative or excessively large updates, which can yield a suboptimal policy. In this paper, we propose Mixture of Experts with Alternating Policy Optimization (MAPO), which alternately optimizes the router and the experts to avoid the divergence misestimation. MAPO consistently tracks 182 motions that PPO with MoE fails to track, whereas PPO with MoE tracks only one motion that MAPO fails to track. MAPO also attains the highest tracking success rate among the compared methods and the lowest tracking error across most error metrics, demonstrating its superior performance. Videos can be found on the project website: https://mapo-corl2026.github.io/MAPO/

Learning Agile Humanoid Dodgeball with Onboard Monocular Vision

5.0/5 很相关 裁判分 10.0 Top pick 当日相对
Feng Tian, Yulin An, Chenhao Li, Matthias Heyrman, Marco Hutter
总结: 机载单目估计球威胁,并驱动全身闪避、恢复与再搜索。
方法: 三阶段课程由特权状态过渡到估计器输出,并随机化感知。
证据: 摘要描述检测历史、威胁标志和策略组合,无成功率数字。
为什么适合我: 对应视觉驱动的高动态全身反应、平衡与目标再获取。
推荐理由: 用机载单目视觉驱动人形敏捷躲避、恢复与再搜索,贴近感知型全身控制与高动态敏捷运动。
原摘要

Humanoid robots operating in shared, dynamic environments must respond to rapidly approaching objects while maintaining balance. We study dodgeball as a controlled test of this capability, coupling visual threat assessment with whole-body evasion, recovery, and target reacquisition. We develop a system that integrates onboard monocular perception, temporal ball-state and threat-flag estimation, and learned whole-body control. A ball detector supplies bounding-box histories, and a temporal estimator predicts relative ball position and a binary threat flag. Separate dodge/recovery and search/track policies share this interface and are composed to support repeated encounters. A three-stage curriculum first trains control with privileged ball states, then starts estimator supervision from stable policy rollouts, and finally replaces the actor's privileged inputs with estimator outputs. Analytic projection and perception randomization provide detector-like training observations without image rendering. Across approach-angle bins in controlled simulation, dodge success ranges from 97.8--100.0% for 5.0 m launches at 6 m/s to 33.2--40.8% for 2.5 m launches at 10 m/s, with 1000 throws per speed--distance condition. On a physical Unitree G1, controlled single-throw success exceeds 85% over more than 15 trials. A hardware sequence demonstrates full-azimuth target reacquisition followed by another dodge. These results demonstrate an integrated onboard-monocular-vision system under highly dynamic motions.

Zhongkai Gu, Yang Liu, Wei Zhu, Mitsuhiro Hayashibe
总结: 用物体中心接触计划,从视频重建并重定向全身接触。
方法: 接触先验抗遮挡,冻结跟踪器上的残差策略对齐锚点受力。
证据: 摘要称仿真验证接触丰富操作,未给出完整定量结果。
为什么适合我: 契合接触丰富操作、人体视频重定向和全身支撑分配。
推荐理由: 从人类视频重建接触并重定向到接触丰富的人形操作,核心对应运动重定向与全身操作。
原摘要

Contact transitions allow humanoid robots to redistribute object support across the whole body, enabling manipulation beyond hand-only grasps. Human videos provide a scalable source of such transitions for robots to learn from. However, body occlusion disrupts object pose tracking and corrupts retargeted motion. Moreover, accurately reproducing the object trajectory does not ensure that the robot applies stabilizing forces at the intended contacts, risking slips or drops in later phases. To address these challenges, we propose ReContact, which reconstructs and retargets human-object interactions through an object-centric contact plan. The plan specifies contact phases, contact pairs, anchors, pressing directions, and sticking or sliding modes. Contact priors stabilize object pose reconstruction through occlusion. A residual policy over a frozen whole-body tracker is rewarded for making contact at planned anchors with forces aligned to the specified directions. In simulation, on a thigh-supported regrasp task, ReContact achieves the planned two-palm bottom hold in 83.5 of episodes over three training seeds, versus 0.16% for the best adapted baseline. One policy trained on 247 references re-solved for new placements raises in-workspace tube-transfer success from 20.4% (source reference only) to 97.8%. On a real Unitree G1, policies execute seven contact-rich manipulation and two loco-manipulation tasks.

HuG: Learning Humanoid Whole-Body Affordance-Aware Grasping with Active Perception

5.0/5 很相关 裁判分 10.0 Top pick 当日相对
Xuanbin Peng, Lai Wei, Yuze Zhai, ... , Jianglong Ye, Xiaolong Wang
总结: 主动视角与全身可操作性抓取,解决自我遮挡下取物。
方法: 感知对齐抓取流水线,并用控制器在环仿真筛选可行抓取。
证据: 拒绝73%运动学可行但会使部署控制器失稳的抓取。
为什么适合我: 贴合遮挡感知、浮基全身抓取和动力学可行的移动操作。
推荐理由: 结合主动感知、可供性与全身抓取,属于人形移动操作与全身控制。
原摘要

Acquiring objects in human environments is hard for humanoids: targets are partially occluded under egocentric viewpoints, and reaching them demands coordinated whole-body motion that keeps the target visible and reachable while the base stays stable. We present HuG, a framework for whole-body affordance-aware grasping with active perception that couples perception and action through a Perceive-Align-Grasp pipeline: belief-driven active perception resolves occlusion by treating viewpoint as an explicit decision variable; a point-cloud-conditioned affordance policy proposes whole-body grasps; and an affordance-aware alignment stage repositions the body to the most executable configuration. A key insight is that, on a floating base, kinematic validity is not enough: we curate training data with controller-in-the-loop dynamics simulation, rejecting 73% of kinematically valid grasps that would destabilize the deployment controller, so the policy learns kinodynamically feasible affordances. Trained entirely in simulation with zero real demonstrations, HuG attains 87.5% real-world success on a multi-level shelf task, generalizes to novel objects, and holds at least 73% success at every tested height. Beyond generalizing within its training distribution, the policy extrapolates spatially: at scale in simulation it succeeds at table heights well below any seen during training, indicating that kinodynamically filtered synthetic data grounds affordances in object geometry and whole-body feasibility rather than in memorized configurations.

ReGATE: Recurrent Gated Visual Fusion for Reactive Humanoid-Object Interaction

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
Hao Zhu, Jorge Pe\~na-Queralta
总结: 门控融合自我深度与本体感觉,完成反应式人形取放物体。
方法: 循环适配器估计几何和接触,分层门控调节视觉更新。
证据: 静态330次成功率85.2%对48.5%,动态440次为85.9%。
为什么适合我: 覆盖深度感知移动操作、在线接触估计和G1实机部署。
推荐理由: 以自我中心深度和本体感觉做反应式人形物体交互相全身控制,贴近感知型移动操作。
原摘要

Humanoid loco-manipulation requires coordinating object acquisition, transport, and release from onboard sensing while responding to user commands and incomplete visual observations. We present ReGATE, a whole-body controller that combines egocentric depth, proprioception, and online locomotion and contact commands. Built on a teacher-student framework, ReGATE integrates interaction-state estimation through a recurrent adapter that predicts object geometry and physical contact without an external object-pose estimator. Head-wise and global gates regulate visual updates to a proprioceptive pathway. A visual-grounding and corruption curriculum trains the adapter, while phase-aware initialization increases coverage of brief contact transitions. In simulation, ReGATE achieves 85.2% success across 330 static-object acquisition trials, compared with 48.5% for VisualMimic under the same protocol, and 85.9% across 440 moving-object acquisition trials. Deployment on a Unitree G1 demonstrates commanded grasp-transport-release sequences and acquisition of laterally displaced boxes. A qualitative hardware experiment further demonstrates successful box acquisition when the camera is occluded after an initial observation and before the contact command. To the best of our knowledge, this is the first work to extend recurrent gated fusion of onboard depth and proprioception from perceptive locomotion to humanoid loco-manipulation under interrupted visual sensing.

Haoyang Li, Keqi Zhu, Zhanxiang Cao, ... , Xuekang Yang, Yue Gao
总结: 不改任务接口即可学习屈服外力并恢复原跟踪或行走。
方法: 状态相关交互力场耦合载荷,力幅奖励促使降低受力。
证据: 无需预制柔顺轨迹,适用于跟踪和速度指令运动。
为什么适合我: 补强全身跟踪与行走在外力下的柔顺和任务恢复。
推荐理由: 为人形运动跟踪和速度指令行走学习可复用的全身柔顺,属于人形全身控制。
原摘要

Humanoid controllers need the ability to yield to external forces while retaining the capacity to resume their original tasks. However, tracking objectives penalize the deviations needed for yielding, while relaxing tracking goals persistently can make task recovery harder. Existing approaches often rely on task-specific interaction command interfaces or constructed compliant motion data and reference trajectories, limiting the direct reuse of their compliance-training mechanisms across different task interfaces. We introduce CompliantBot, a compliance-training framework for motion tracking and velocity-command locomotion. It preserves the original task inputs and requires no preconstructed compliant data or target trajectories. A state-dependent interaction force field couples applied loads to the robot's motion, enabling local articulation and whole-body movement to change the forces experienced. A complementary force-magnitude reward encourages lower interaction loads, while task rewards are downweighted during loading and restored after release to coordinate yielding and task resumption. The trained policies use task inputs and proprioceptive history without explicit external-force measurements. Across both task interfaces, CompliantBot yields farther under constant pulls and experiences lower spring interaction loads than matched baselines, while resuming task tracking after force removal. CompliantBot achieves the highest task completion among the compared methods under stronger pulls. Power evaluations further show that CompliantBot has the lowest mean joint mechanical power among the compared methods. Real-robot demonstrations further illustrate compliant responses through arm motion, stepping, and body reorientation.

Haizhou Ge, Mengshuo Wang, Yufei Jia, ... , Guyue Zhou, Ruqi Huang
总结: 库普曼提升结构并未改善可微世界模型的人形全身跟踪。
方法: 用提升空间线性动力学替换多层感知机世界模型并反向传播。
证据: 回报0.823对0.830,误差1.3至1.6倍,训练约慢15%。
为什么适合我: 为仿真全身跟踪里可微世界模型是否加结构提供判据。
推荐理由: 直接在仿真人形全身跟踪流程中检验可微世界模型,虽为否定结果,仍紧贴运动跟踪。
原摘要

We test whether Koopman structure, linear dynamics in a lifted state space, helps when a humanoid whole-body tracking policy is trained by backpropagating through a differentiable world model, replacing the MLP world model of an otherwise unchanged pipeline for simulated Unitree G1 tracking. It does not: return is at best equal (0.823 versus 0.830), one-step error on identical data is 1.3 to 1.6 times the MLP's, and training is about 15% slower. Lifted rollouts diverge or fail to train a policy; of the schemes tested, re-lifting at every imagined step trains best. Re-lifting never uses the lifted linear dynamics and leaves a model affine in the action, with state-dependent offset and slope; an action-affine MLP also predicts worse, so the cost belongs to this class. At a fixed state, the curvature of the true dynamics in the action explains only part of it. Across states, the policy's actions span a curved region, so an affine model fits policy data only as the tangent at the policy's action, the operating point: on G1, the MLP's tangent there is as accurate as the MLP; at the mean action, 31 times worse. The offset must encode, from the state alone, where the policy acts, whereas an MLP reads the action. Supplying the policy's action removes most of the remaining gap on G1, Ant and Humanoid. The only online repair approaching the MLP feeds the action into the nonlinear lift, giving up the structure. The MLP world model thus remains the better choice here.

Jason Jingzhou Liu, Tony Tao, Deepak Pathak, Ruslan Salakhutdinov
总结: 由传感人体示范学习感知环境的全身移动操作策略。
方法: 环境感知重定向生成避碰目标,误差掩码并用DAgger修正。
证据: 摘要强调视角误差与接触修正,未报告具体成功率。
为什么适合我: 契合人体到机器人重定向、环境几何和全身移动操作。
推荐理由: 从人类示教做环境感知重定向并学习全身操作策略,贴近运动重定向与移动操作,但未明确双足人形。
原摘要

Sensorized human demonstrations offer scalable data for mobile manipulation, but embodiment differences complicate policy learning. We present Pixel-UMI, a pipeline for learning environment-aware whole-body policies from human data. We first introduce Environment-Aware Retargeting (EAR), which combines reconstructed scene geometry with demonstrated head and gripper trajectories to determine robot posture and generate collision-aware joint and base targets. Delay-calibrated action assignment converts these trajectories into actions. However, kinematic differences can leave residual pose errors, creating viewpoint mismatches between human demonstrations and robot observations. We therefore introduce Retargeting-Error-Aware Masking (REAM), which uses these errors during training to reduce reliance on mismatched views at deployment. Finally, because estimated actions cannot fully capture contact-rich interactions, we collect on-policy human corrections through DAgger to improve performance. We evaluate Pixel-UMI on five challenging tasks spanning articulated-object manipulation, deformable-object handling, constrained-space reaching, whole-body collision avoidance, and contact-rich bimanual coordination, achieving 87.0% average task progress. Video results are available at https://pixel-robot.com/pixel-umi

Energy-Based Policy Orchestration

3.0/5 一般 裁判分 7.0 Strong 当日相对
Weirui Ye, Yen-Jen Wang, Elvis Hsieh, ... , Leslie Pack Kaelbling, Tom\'{a}s Lozano-P\'{e}rez
总结: 用能量在运行时选择低层策略及其目标,维持可行跟踪。
方法: 为每个目标条件策略学习可行性能量,执行最低能量组合。
证据: 摘要仅阐述编排动机与可扩展接口,没有定量结果。
为什么适合我: 关系到接触平衡快变时的分层全身策略切换与目标选择。
推荐理由: 讨论接触、平衡下的分层策略编排,但是通用目标条件策略选择,并非人形全身跟踪或移动操作。
原摘要

Hierarchical control scales robot behavior by separating task-level planning from low-level control. In dynamic, high-dimensional tasks, however, a fixed planner-to-policy interface can fail when contacts, balance, or disturbances evolve faster than high-level policy updates. Execution therefore requires choosing not only which low-level policy to run, but also which policy-specific goal should be given to it. We formulate this problem as policy orchestration: runtime selection of a policy-goal pair that is likely to remain feasible while tracking the planner target. We develop EPO, an energy-based policy orchestrator for modular goal-conditioned policy families. For each policy, EPO learns a composite energy over low-level goals, where lower energy corresponds to higher feasibility and more accurate target realization. At runtime, EPO refines each policy's goal and executes the lowest-energy policy-goal pair. Because energies are policy-specific, new policies can be incorporated by learning their own energy models, without retraining the existing policies or a centralized scheduler. In simulation, EPO improves the empirical precision-robustness trade-off by refining policy-specific goals before selectively switching among policies based on energy scores. We further demonstrate sim-to-real deployment of the same frozen policies and energy models on real humanoid loco-manipulation tasks. Project website: https://yewr.github.io/epo