Papers for 2026-10-16

10 papers
humanoid Team
总结: 大规模人类数据管道实现人形零样本loco-manipulation。
方法: 对齐视角外观并离线精炼运动参考与控制输入。
证据: 零样本迁移Unitree G1完成全身与长距任务。
为什么适合我: 直接支持人体动作转真机全身loco-manipulation。
推荐理由: 直接对应人形全身 loco-manipulation:用大规模第一人称人体数据做人体到人形重定向,并在 G1 上做全身操作与长程移动操作。
原摘要

Humanoid loco-manipulation requires coordinated whole-body interaction with the physical world, yet collecting robot demonstrations at scale remains costly. Human demonstrations offer a scalable alternative, but existing egocentric human supervision often omits locomotion and posture, while embodiment differences and controller dynamics hinder accurate end-effector execution. We introduce HumanVerse, a 500-hour dataset of open-world human loco-manipulation pairing egocentric video with synchronized body and hand motion. Our human-to-humanoid pipeline aligns camera viewpoints and arm appearance, and refines motion references and controller inputs offline to reduce end-effector errors while preserving whole-body coordination. We validate the pipeline through zero-shot transfer to Unitree G1 on representative whole-body manipulation and long-range loco-manipulation tasks, without target-task robot demonstrations. Building on this pipeline, we develop $\lambda_0$, a humanoid foundation model for whole-body loco-manipulation, with robot-aligned human demonstrations providing supervision for mid-training. Increasing whole-body human data consistently improves downstream task progress. $\lambda_0$ achieves 90.0% success on SIMPLE and 62.5% across real-world loco-manipulation tasks. We expect this study to guide scalable whole-body human data collection toward humanoid foundation models for richer interaction with the physical world. Homepage: https://lambdahumanoid.github.io/

Lingfan Bao, Hanshang Zhu, Yan Pan, ... , Dimitrios Kanoulas, Chengxu Zhou
总结: 残差框架保留人形全身控制的表达性特征。
方法: 补偿幅度能量等目标,门控按部位分配修正。
证据: 位置误差低不保证动态与姿势特征保留。
为什么适合我: 提升人体动作跟踪表达性与真机可部署性。
推荐理由: 直接属于人形全身控制与运动跟踪,关注在跟踪之外保留动作的动态与姿态表现特征。
原摘要

Whole-body control plays a crucial role in enabling humanoid robots to execute expressive motions. Faithful execution requires preserving both the intended action and its expressive characteristics. Existing whole-body trackers typically balance joint and keypoint tracking with physical stability across diverse motions, but these objectives do not necessarily prioritize the expressive characteristics of each action. Our analysis shows that lower average positional tracking error does not guarantee better preservation of dynamic and postural motion characteristics. To address this gap, we propose a residual learning framework with compensation objectives targeting amplitude, energy, body expansion, body lean, and pelvis height. To concentrate compensation while limiting interference with the underlying tracking behavior, motion-aware gating allocates correction capacity according to body-part activity, preserving larger correction ranges in more active parts and restricting them elsewhere. For each frozen tracker, we train motion-specific residual policies and distill them into a unified policy shared across motion categories. Simulation and physical experiments on the Unitree G1 across eight motion categories demonstrate superior preservation of dynamic and postural motion characteristics compared with the corresponding baselines.

Test-Time Compute for Humanoid Behavior Foundation Models

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
Weiji Xie, Junsong Wu, Zibo Zhou, ... , Weinan Zhang, Chenjia Bai
总结: 测试时计算缩小人形基础模型命令执行差距。
方法: 采样优化命令经闭环仿真适配特定模型。
证据: 三模型AMASS全局位置误差降79-84%。
为什么适合我: 增强全身位置精度服务loco-manipulation应用。
推荐理由: 针对人形行为基础模型的指令执行误差,服务全身位置精度和 loco-manipulation,并在 AMASS 类动作上验证。
原摘要

Humanoid Behavior Foundation Models (BFMs) can execute impressive motions, but downstream applications such as loco-manipulation demand high whole-body positional accuracy. Existing BFMs suffer from a systematic command-execution gap, where executed motions deviate from desired ones. We show that additional test-time compute can improve execution without retraining the BFM. First, we introduce Test-Time Command Optimization (TTCO), which adapts the input command to the specific BFM to produce an executed trajectory closer to the desired motion. TTCO finds such commands by sampling-based optimization through closed-loop simulations of the BFM and robot dynamics. Across three BFMs on the AMASS dataset, TTCO reduces mean global body-position error by 79-84% in simulation. Second, we analyze test-time compute scaling and derive an approximate compute-optimal strategy that can sustain performance gains as the compute budget increases. Third, TTCO can generate BFM-specific action labels from recorded robot trajectories without requiring the original teleoperation body-motion commands. Simulation and real-robot experiments show that these labels are effective for training high-level loco-manipulation policies. This method also supports reusing existing demonstrations across BFMs.

Qi Wu, Lulu Zhao, Sanghyun Hahn, ... , Jiuguang Wang, Kuan Fang
总结: 运动学接地视频生成定制人形loco-manipulation参考。
方法: 条件生成视频后拟合得机器人配置空间参考。
证据: 八任务穿透滑步更低,保留超90%接触。
为什么适合我: 无需人体代理即可生成可跟踪可重定向参考。
推荐理由: 直接生成可落在机器人构型空间中的人形 loco-manipulation 参考,覆盖身体、手和物体交互。
原摘要

We present KinoGen, a framework that synthesizes customizable humanoid loco-manipulation references through kinematically grounded video generation. KinoGen conditions a pretrained video generator on calibrated renders of the target robot and object in a simulated task instance and recovers the reference by fitting the same models to the generated two-view video, so that the reference lies in the robot configuration space by construction without a human body proxy or retargeting. Body, hand, and object priors initialize the reconstruction, and direct optimization against cross-view evidence refines it. Since an edited keyframe is simply another rendered state, a user can prescribe a goal object pose, regenerate the video around the edited keyframe, and obtain a reference that satisfies the pose exactly. Across eight loco-manipulation tasks, KinoGen yields lower penetration and foot skating than video-based baselines and preserves over 90% of annotated contacts, and its customized references satisfy every prescribed target with substantially less penetration than direct interpolation. Tracking policies trained on the synthesized references are deployed on a Unitree G1 humanoid with dexterous hands. Project webpage: https://kinogen-humanoid.github.io/.

Locomotion with Online Awareness of Dynamics for Precision Footholds

5.0/5 很相关 裁判分 7.0 Strong 当日相对
Kunzhao Ren, Zhishuo Zhu, Xiaobin Xiong
总结: 在线动力学感知实现精确落脚窄梁穿越。
方法: 循环推断惯性历史,蒸馏高度图至深度学生。
证据: 硬件载荷下成功穿越10cm与15cm梁。
为什么适合我: 复杂地形感知运动与精确接触控制相关。
推荐理由: 直接对应腿足感知运动:结合高程/深度感知与在线动力学估计,实现窄梁等小裕度落足。
原摘要

Unknown payloads alter robot dynamics and make precise contact execution difficult when foothold margins are small. We present LOAD, a perceptive locomotion framework that combines explicit inertial estimates with implicit dynamics features for narrow-beam traversal. Separate recurrent modules infer torso inertial changes and task-relevant history from proprioception, while a height-map teacher is distilled into a depth-based student. We extensively evaluate LOAD and its variants in simulation and on hardware across beam widths and payload configurations. The results show that implicit dynamics features accelerate training, while explicit inertial estimation further improves traversal success; combining both enables LOAD to approach the performance of a privileged policy supplied with ground-truth inertial parameters. Hardware experiments demonstrate traversal with unilateral payloads of 6 kg on a 10 cm beam and 9 kg on a 15 cm beam, and an evenly distributed 11 kg payload on a 15 cm beam. These results support combining physical estimates and history features for precision locomotion under unknown loads.

Keqiang Ren, Xuecheng Ye, Hanyu Liu, ... , Xinran Li, Zhigong Song
总结: 模块化协调策略解决高自由度全身移动操作。
方法: 分层解耦动作空间并用交叉注意力动态协调。
证据: VLM任务分解抑制误差,触觉支持全身决策。
为什么适合我: 助力接触丰富场景全身感知与loco-manipulation。
推荐理由: 贴近全身 loco-manipulation 与遥操作数据采集,用高自由度全身遥操作学习移动、手臂和手的协调策略。
原摘要

Whole-body mobile manipulation suffers from two fundamental challenges: inherent motion heterogeneity across locomotion, arm, and hand modules, and progressive error accumulation over long-horizon multi-stage tasks. Existing teleoperation platforms also lack integrated dexterous tactile sensing to support coordinated whole-body decision-making. This paper presents RoboSpan, a high-DoF whole-body teleoperation and demonstration platform, and the Hierarchical Modular Framework (HMF) for learning modular coordination policies. HMF functionally decouples the 29-DoF action space into fine hand manipulation, arm pose adjustment, and mobile-base spatial configuration branches, and introduces the Coordinated Modular Embodied Transformer (COMET) with inter-modular cross-attention to enable dynamic information exchange and action coordination. Vision-language model driven hierarchical task decomposition structurally suppresses temporal error propagation, while a full-palm 2D tactile representation encodes distributed contact signals for cross-module tactile empowerment. Experiments on a physical 29-DoF robot demonstrate that the proposed method achieves over 20\% higher task success rate than mainstream baselines across a range of long-horizon whole-body tasks, markedly improving stability and robustness in contact-rich manipulation.

Nolan Fey, Khai Nguyen, Yash Prabhu, Gabriel B. Margolis, Pulkit Agrawal
总结: 残差世界模型校正人形执行器动力学差距。
方法: 保留仿真先验,用本体感觉对齐硬件滚动。
证据: 6.5分钟行走数据泛化至其他接触任务。
为什么适合我: 缩小力交互sim-to-real差距提升接触鲁棒性。
推荐理由: 面向接触场景下人形控制的执行器 sim-to-real,补齐全身策略上真机时的力交互与接触一致性。
原摘要

Humanoid policies trained in simulation can transfer qualitatively to hardware while failing to transfer the force interactions learned during training, compromising torque efficiency, load regulation, and robustness to impacts. This failure can arise from actuator sim-to-real gaps because forces depend on actuator torques. We introduce Contact-UAN, a residual world model that preserves a simulator's physics priors while correcting actuator dynamics to align simulated rollouts with recorded hardware rollouts. For humanoid motion with contact, this requires contact-consistent replay: if hardware playback in simulation begins with misaligned contact wrenches, the residual model learns to correct reset artifacts rather than actuator discrepancies. Using only onboard proprioception, Contact-UAN infers the simulator-side stance-foot pose needed to initialize replay with consistent contact forces. We show that a UAN trained on 6.5 minutes of real-world walking data generalizes to tasks that benefit from accurate force and impulse regulation and produces policies that transfer seamlessly to the real world, yielding 20% lower running torque, 43% lower force-tracking error, extreme compliance, accurate impedance control, and dynamic, robust jumps.

Shikun Ban, Shohei Nagai, Qingyang Song, ... , Thomas Wang, Zackory Erickson
总结: 动态人体生成学习全身移动辅助机器人策略。
方法: 对抗先验训人体策略,扩散策略映射点云。
证据: 仿真收集多样演示训练3D扩散策略。
为什么适合我: 对抗先验与扩散契合全身模仿与辅助控制。
推荐理由: 用对抗运动先验生成被辅助者的动态全身反应,再学机器人全身辅助策略,方法上紧贴运动先验与人机全身交互。
原摘要

Robotic assistance for human mobility could benefit care recipients and reduce caregiver burden during physically demanding tasks such as Sit-to-Stand (STS) and Lift-and-Transfer (L&T). Learning robot policies for these whole-body assistive tasks is challenging: real-world data collection for human-robot interaction is costly and safety-critical, making simulation an attractive alternative. Prior work, however, typically treats the human as static or minimally responsive and thus fails to capture the cooperative nature of mobility assistance. We present a simulation-based framework for learning whole-body assistive robot policies. At its core is a human policy trained with an adversarial motion prior that produces realistic care-recipient motion in response to the robot's actions. A human-adaptive scripted controller interacts with this policy to collect diverse robot demonstrations at scale. From these demonstrations, we train 3D diffusion policies that map segmented human point clouds and robot joint positions to whole-body actions for a mobile manipulator, without relying on privileged human state at deployment. The resulting robot policies successfully perform both STS and L&T assistance in simulation. Preliminary experiments further demonstrate sim-to-real transfer for STS after fine-tuning on a small amount of real-world data. Videos are available on our project page: https://rchi-lab.github.io/human-gen-mobility-assistance/

Haoran Jiang, Yichao Zhong, Kai Zhang, ... , Tianyu Li, Li Chen
总结: 层级框架实现敏捷人形双打安全团队协调。
方法: 团队规划过滤风险,个体技能结合敏捷精确。
证据: 人类参考引导,仿真校准残差精炼击球。
为什么适合我: 接触丰富协调与全身运动智能高度相关。
推荐理由: 属于人形全身敏捷控制,用人体双打步法参考协调脚步与击球,含接触丰富的操作但场景较专。
原摘要

Unlike singles, humanoid table tennis doubles requires teammates to strike in strict alternation while sharing a confined workspace. Rapid repositioning can compromise striking accuracy, while uncoordinated teammate movements introduce collision risks. We present PingpongDuo, a hierarchical framework for agile humanoid doubles with safe team coordination. At the team level, a planner jointly selects positioning targets and uses learned risk estimates to filter risky proposals, preferentially preserving the current striker's target. At the individual level, separate footwork and striking skills combine agile movement with precise racket control. The skills are guided by human motion references, including footwork collected from human doubles play, and trained from states produced by one another to support rapid transitions. A racket-arm residual further refines strikes after movement using return feedback from a simulator calibrated with real ball-flight and contact measurements. In simulation, PingpongDuo improves the ball-return success rate by 13.2% over the state-of-the-art baseline, while achieving approximately 2 cm positioning error during clearance. In real-world experiments, a robot completes a 2.15 m clearance-and-recovery cycle in 2.4 s with a peak speed of 2.23 m/s, while two robots sustain more than 10 consecutive strikes in strict alternation.

Alvaro Belmonte-Baeza, Miguel Cazorla, Gabriel J. García, Carlos J. Pérez-Del-Pulgar, Jorge Pomares
总结: 约束强化学习学习月球安全全身loco-manipulation。
方法: 单策略跟踪6D位姿,奖励几何涌现模式转换。
证据: 月球模拟三场景评估稳定性与正则化效果。
为什么适合我: 约束RL全身控制服务复杂地形loco-manipulation。
推荐理由: 虽是月球四足移动操作而非人形,但学习带安全约束的全身 loco-manipulation 策略,与腿足全身交互同向。
原摘要

Robotic systems for lunar surface operations must act autonomously and preserve their own integrity in an environment where failures are unrecoverable and continuous supervision is impossible. This paper presents a Constrained Reinforcement Learning framework for quadrupedal mobile manipulators that learns a single whole-body policy for tracking a 6D end-effector pose specified in task space, with operational limits enforced during learning through a constrained learning mechanism. We introduce a reward formulation in which the transition between locomotion and manipulation emerges from the reward geometry rather than from an explicit gating mechanism, a stability term derived from the Gravito-Inertial Inclination Margin and motivated by the reduced-gravity dynamics of the lunar surface, and a design rule for reward regularization that follows from the multiplicative structure of the termination-based objective. The framework is evaluated in a lunar-analog simulation spanning three terrain morphologies at five difficulty levels under lunar gravity, with regolith contact properties calibrated to the JSC-1a simulant and varied from loose to dense. The learned policy attains mean position and orientation errors of 3.22 cm and 6.83 deg. under nominal conditions, retains this precision across regolith densities and over the operationally representative range of terrain difficulty, and reduces soft-constraint violation time by up to an order of magnitude relative to an unconstrained baseline while incurring no hard-constraint violations.