Papers for 2026-10-08

10 papers
Haozhuo Zhang, Qiang Zhang, Jian Tang, ... , Angelo Cangelosi, Wei Pan
总结: 提出统一策略解决人形长时程全身loco-manipulation中的奖励偏置与灾难遗忘。
方法: 并行训练、动态起始与奖励门控三机制共享策略持续更新各阶段。
证据: 在杂乱室内顺序导航抓取运输放置任务中克服先前方法局限。
为什么适合我: 直接服务接触丰富场景下人形全身loco-manipulation与强化学习控制。
推荐理由: 直接对应长时程全身loco-manipulation:在杂乱场景中连续导航、抓取、搬运与放置,并用强化学习缓解阶段偏置与遗忘。
原摘要

Cluttered indoor environments, where large and heavy objects are scattered across diverse surfaces, require humanoid robots to sequentially navigate, grasp, transport, and accurately place each item at its target location within a single uninterrupted episode. This long-horizon, whole-body loco-manipulation task remains a significant challenge for current methods. Previous approaches often suffer from two main issues: easy-reward bias, where training overemphasizes early transport stages at the expense of later ones, and catastrophic forgetting, where focusing on later stages leads to a decline in earlier-stage performance. In this work, we introduce Humanoid Horizon, a unified policy framework designed to overcome these limitations through three interrelated mechanisms. The Parallel Training Strategy organizes $N$ scenes into $S$ concurrent stage streams governed by a shared policy, ensuring all transport stages receive continuous gradient updates and removing the bottleneck of sequential optimization. The Dynamic Starting Mechanism updates each environment's initial state with terminal states from upstream rollouts, gradually broadening transition coverage and enhancing robustness at stage boundaries. Reward Gating sets the reward to zero for the rest of the episode in later-stage streams when the immediately preceding object is displaced beyond a set threshold, so the shared policy learns not to disturb a just-placed object and earlier placements are preserved throughout the episode. Collectively, these strategies achieve per-stage success rates exceeding 80\% on the two-object LHM-Humanoid benchmark (350 training scenes, 66 held-out scenes). As the number of sequentially transported objects grows beyond two, success declines with the horizon, but the degradation is graceful relative to the sharp drop seen in all baselines.

Zexi Zhang, Zecheng Zhu, Zidong Chen, Zulkhuu Tuya, Stephen James
总结: BiGym 2.0为人形家务操作提供统一全身控制器基准与演示。
方法: 在Unitree G1上用VR演示基准VLA微调、模仿、演示驱动RL与编码智能体。
证据: VLA微调九任务均值最高,智能体程序在双臂到达上领先。
为什么适合我: 提供loco-manipulation基准与模仿强化学习方法,契合全身运动智能评估。
推荐理由: 面向Unitree G1的家务全身操作基准,统一全身控制器并比较模仿学习、演示驱动强化学习与VLA,贴合全身loco-manipulation与数据采集。
原摘要

Humanoid household manipulation requires the arms to act while the body balances, steps and changes posture. We present BiGym 2.0, an adaptation of BiGym for the Unitree G1 across 20 household tasks using a unified whole-body controller for demonstration and evaluation. The suite provides 60 native human virtual-reality demonstrations per task with synchronised multi-camera views and full-body execution records. We benchmark vision-language-action fine-tuning, imitation learning, demo-driven reinforcement learning, and cold-start coding agents given the interaction budget of online reinforcement learning. With the same onboard views, proprioception and whole-body controller for every method, vision-language-action fine-tuning has the highest nine-task mean, and agent-developed programs outperform every demo-driven reinforcement learning baseline on this mean and lead on bimanual reaching. Cross-workspace stacking remains open, $\pi_{0.5}$ stays low on pick-box, and multi-object transport is hard for imitation learning, demo-driven reinforcement learning and coding agents. All environments, human demonstrations, and evaluation traces are open-sourced at https://github.com/swirl-uk/BiGym2.

Sudarshan Harithas, Chen Yu, Juan Borbon, ... , Dingqi Zhang, Jiuguang Wang
总结: BRACE使全身跟踪器在斜坡上跟随平地参考并施加补偿手部力。
方法: 将地形顺应与扳手变换融入参考,联合质心与姿态解析力位移。
证据: 从多样姿态施加命令手力并在斜坡跟踪平地参考。
为什么适合我: 增强复杂地形接触丰富场景下的力感知全身跟踪与loco-manipulation。
推荐理由: 把末端力与坡地地形折进全身参考,使平地动作可在受力、非平地上跟踪,核心就是力与地形感知的人形全身运动跟踪。
原摘要

Whole-body tracking has become the interface through which operators drive humanoid robots, yet the references it consumes are recorded on level ground and carrying nothing, so the tracker is aware of neither the forces the robot must exchange with objects nor the terrain it must stand on. Existing controllers address one side of this gap: force-capable policies command an end-effector force but prescribe no whole-body pose, while terrain-adaptive trackers treat loads as disturbances to reject rather than wrenches to command. We present BRACE, a whole-body tracker that exerts and compensates commanded hand forces from diverse poses while following a flat-ground reference on sloped terrain. Rather than leaving the tracker to absorb the load and the slope, BRACE folds both into the reference it follows: terrain conformance lifts footholds and root onto the local surface, and a wrench transformation resolves the hand displacement that produces a force jointly with the center-of-mass and center- of-pressure shifts it induces, bounded by teacher-specific arm-effort limits. Separate exertion and compensation teachers are distilled by DAgger into one flow-matching student that runs on proprioception alone, without a height map or measured wrench, so a teleoperator (even in remote locations) can supply a flat- ground trajectory and the robot resolves slope and load onboard. We extensive experiments on the Unitree-G1 to demonstrate the ability of BRACE to exert, compensate force and handle diverse terrain in simulation and real robot experiments.

iGPC: Generative Motion Priors for Object-Aware Humanoid Interaction

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
Anujith Muraleedharan, Abdul Ahad Butt, Nolan Fey, ... , Maurice Rahme, Ivan Laptev
总结: iGPC将生成运动先验扩展到感知驱动的人形物体交互。
方法: 适配GPC为场景可供性条件专家,再蒸馏感知学生保留先验。
证据: 专家学习到达抓取支撑与推动,学生实现物体感知交互。
为什么适合我: 打通扩散生成先验与感知运动,服务接触丰富人形交互控制。
推荐理由: 将生成式运动先验扩展到可抓扶、推物的全身人机环境交互,紧贴生成运动先验与接触丰富的loco-manipulation。
原摘要

Humanoid robots operating in unstructured environments must combine robust whole-body control with the ability to perceive and physically interact with surrounding objects. While large-scale human motion data provides powerful priors for natural and versatile humanoid control, effectively transferring such priors to perception-driven object interaction remains challenging. To address this bottleneck, we propose a framework that extends the recently proposed Generative Pretrained Controller (GPC) from general human motion to full-body humanoid-environment interaction. First, we adapt GPC into interaction experts conditioned on scene affordance cues and privileged state information. These experts leverage the pretrained human motion prior while learning task-specific contact behaviors, including reaching toward objects, grasping environmental supports for stabilization, and pushing movable objects. Second, we introduce a perception-driven student that retains the pretrained GPC policy and distills interaction skills from the experts using onboard sensory observations. To bridge the gap between privileged expert observations and sensory inputs, we propose two complementary training objectives that enable effective adaptation of the pretrained motion prior during distillation. Notably, our experiments across multiple whole-body interaction tasks demonstrate that large-scale generative human motion priors provide an effective foundation for learning deployable policies for humanoid interactions in contact-rich real-world environments.

Xiayan Xu, Jiyu Yu, Xingzhou Chen, ... , Ling Shi, Haodong Zhang
总结: 提出无重定向低延迟鲁棒人形全身遥操作策略。
方法: 直接映射原始人体运动到关节命令,并用原子运动原语码本投影。
证据: 在仿真与真机多输入源上优于基线,处理分布外与部分观测。
为什么适合我: 实现人体动作到真机可跟踪全身控制,消除重定向延迟。
推荐理由: 免在线重定向的人形全身遥操作,用全身运动基元对抗不完整观测,直接对应遥操作、动作重定向与真机全身控制。
原摘要

Humanoid whole-body teleoperation translates human motion into stable robot behavior in real time. Existing systems typically rely on online motion retargeting to bridge human--robot morphological differences, but this process adds latency and can produce physically infeasible targets. Meanwhile, diverse, noisy, and partial human-motion observations often fall outside the training distribution, potentially causing unstable robot behavior. We propose a retargeting-free policy that maps raw human motion directly to robot joint commands in a single forward pass, eliminating online kinematic adaptation. To improve robustness, we learn a codebook of full-body motion primitives that projects out-of-distribution observations onto plausible motion prototypes and recovers full-body motion from partial inputs. Experiments on a Unitree~G1 in simulation and on hardware, using virtual reality, optical mocap, text-to-motion generation, and monocular video inputs, show that our method outperforms baselines in latency and robustness.

Filter-Aware Fine-Tuning for Safe Humanoid Whole-Body Tracking

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
Pranit Mohnot, Christian Helten, Daniele Gammelli, Marco Pavone
总结: 研究跟踪策略与安全滤波器接口失配并提出感知微调。
方法: 通过案例隔离动力学目标信息失配,开发CoFiT约束滤波器感知微调。
证据: 显示独立处理导致动作与状态分布改变,微调缓解失配。
为什么适合我: 提升复杂地形全身跟踪安全性,结合强化学习与约束控制。
推荐理由: 研究安全滤波器与全身跟踪策略的失配并做联合微调,属于可上真机的安全人形全身运动跟踪。
原摘要

Safe whole-body motion is essential for deploying humanoid robots in unstructured environments. Modern humanoid control commonly separates reference specification from execution, with a planner, teleoperator, or motion generator providing a reference that a reinforcement-learning policy tracks through dynamically feasible whole-body control. Runtime safety filters, such as control barrier functions (CBFs), offer a promising approach for enforcing newly introduced constraints via interventions on the tracker's outputs. We show, however, that treating the tracking policy and safety filter independently induces fundamental mismatches, as filtering alters both the executed actions and the induced state distribution. We study this policy-filter interface through case studies that isolate dynamics, objective, and information mismatches, highlight their root causes, and use these insights to develop CoFiT (Constrained Filter-aware Tuning), a filter-aware fine-tuning method for pretrained trackers. Across diverse constraint scenes, CoFiT reduces violation time relative to filter-only training by 91% on TWIST2 and 21% on SONIC, while requiring smaller safety filter corrections. On Unitree G1 hardware, CoFiT reduces violation time by 83% for TWIST2 and completes every trial without operator intervention, whereas 50% of baseline trials require an operator stop. Together, these results provide actionable insights into policy-filter interactions and establish design principles for integrating learned trackers with runtime safety filters.

Zhiyuan Li, Wenyan Yang, Pekka Marttinen, Joni Pajarinen
总结: 证明跨骨架动作重定向在标准生成目标下结构上不可辨识。
方法: 分析无配对分布匹配的规范不可辨识与稀疏配对的条件均值退化。
证据: 显示不同源条件映射同等拟合训练证据且忽略源细节。
为什么适合我: 揭示人体动作重定向到机器人的根本限制,指导可跟踪可重定向控制。
推荐理由: 直击人体动作跨骨架重定向:指出生成式重定向映射在标准目标下不可辨识,属于动作重定向与运动先验的理论边界。
原摘要

Cross-skeleton motion generation trains generative models to carry action structure and motion intention from one body to another. Yet a target motion that shows the right action has two explanations that the training data cannot tell apart: the model transferred the source clip, or it recovered a typical motion for the requested action. We show that this ambiguity is structural rather than incidental: under standard generative objectives, the source-conditioned retargeting map is non-identifiable in sparse heterogeneous motion domains. Unpaired distribution matching yields gauge non-identifiability: the latent spaces of different skeletons can be transformed relative to one another without changing the training evidence, so different source-conditioned maps fit it equally well. Sparse paired supervision admits the complementary failure mode, \emph{conditional-mean degeneration}: when clips are paired only by action, squared-error training converges to an average target motion that ignores the source clip. To make the missing evidence observable, we introduce Source-Instance Fidelity (SIF), a diagnostic that tests whether outputs differ from one another the way their source clips do, with the target skeleton and action held fixed. Under this diagnostic, methods that succeed at the standard action-level test on animal motion data often sit at the source-blind floor, while the methods that rise above it retain only a partial relational signal. Retargeting therefore needs objectives and evaluations that can identify the source-conditioned map it claims to learn. Project page: https://cross-skeleton-retargeting.netlify.app/.

Shunyu Yao, Songyang Liu, Dinghao Chen, Yuanyuan Lei, Shuai Li
总结: 基准暴露高程图不可见危险与执行偏差,提出闭环导航框架。
方法: 建模微妙危险与偏差,闭环对齐高层导航与底层运动控制。
证据: 揭示现有VLN假设失败模式并持续重对齐轨迹。
为什么适合我: 针对复杂地形感知运动与导航执行失配,服务人形loco智能。
推荐理由: 针对高程图看不见的语义危险和指令—执行偏差,做人形语义感知运动与可执行导航,贴近腿足高程图感知运动。
原摘要

Navigation for humanoid robots is critical, yet large-scale evaluation on physical hardware is often impractical due to cost and safety concerns, making simulation benchmarks essential. Existing VLN benchmarks achieve physically executable navigation, but still assume (1) all hazards are observable from elevation maps; (2) realized motions closely match desired motions. In real environments, however, fallen bottles may be ambiguous in elevation maps, while phones and water spills may be difficult to differentiate; hazard avoidance by the locomotion policy can cause the robot's actual trajectory to deviate from the path intended by the VLN policy. Such command-execution mismatch can accumulate and lead the robot toward unintended locations. To expose these failure modes, we introduce a benchmark that models both elevation-subtle hazards and execution deviations, together with a closed-loop VLN + locomotion control framework that continuously realigns high-level navigation with the robot's actual state. We evaluate navigation in simulation and further validate the locomotion policy on a physical Unitree G1 humanoid robot. Results show that semantic input reduces contact with hazards poorly represented in elevation maps, while anti-deviation improves navigation success. These findings highlight the need to evaluate humanoid navigation jointly in terms of route completion and hazard avoidance.

Zhilin He, Xinyuan Wang, Changliu Liu
总结: 2GO为约束运动规划引入几何感知模型基生成优化。
方法: 任务调制主动约束几何塑造分数方向,并自适应调度反向传输。
证据: 克服先前MBD缺乏几何调制与确定性传输的局限。
为什么适合我: 结合扩散与模型预测优化,适用于腿足约束loco规划。
推荐理由: 用模型式扩散做四足与人形的约束运动规划,显式处理碰撞、接触与支撑,贴近接触丰富场景下的全身运动规划。
原摘要

Constrained Locomotion Planning (CLP) for quadrupeds and humanoids, where robots must satisfy collision avoidance, contact consistency, kinematic feasibility, and support constraints, is challenging under high-dimensional dynamics and highly non-convex environments. Recent Model-Based Diffusion (MBD) approaches recast trajectory optimization as posterior sampling over trajectories, using known dynamics and Monte Carlo rollouts to analytically estimate the denoising score function without demonstration learning. While constrained variants further incorporate feasibility into model-based score rollouts and show promising performance, they are still limited by (1) lacking a task-modulated active constraint geometry that shapes the score direction and reverse stochasticity, and (2) using deterministic DDPM-style reverse transport without adaptive scheduling across different generative transports. Therefore, we introduce Model-Based Geometry-Aware Generative Optimization (2GO) for constrained locomotion, which turns active constraint geometry into executable denoising operators through normal- induced metric shaping, tangent-space stochastic filtering, and CFS-based retraction. 2GO further decouples generative transport from reverse stochasticity through an adaptive diffusion and flow-like schedule. Experiments on constrained quadruped and humanoid locomotion demonstrate strong performance in discrete foothold selection and continuous posture planning, with higher success rates, fewer violations, and improved execution compatibility.

Robust Nonprehensile Object Transport with Quadruped Robots

4.0/5 相关 裁判分 6.0 Good 当日相对
Ainoor Teimoorzadeh, Riccardo Pretto, Mario Selvaggio, Gokhan Alcan, Sami Haddadin
总结: 提出四足鲁棒非抓取物体运输框架应对惯性不确定性。
方法: 不确定性感知轨迹优化生成运动,耦合凸MPC与全身QP跟踪。
证据: 优化运动较固定姿态基线减少滑动约50%,较直线减少约30%。
为什么适合我: 扩展腿足loco-manipulation到负载运输,融合优化与全身控制。
推荐理由: 四足非抓取搬运结合轨迹优化、耦合MPC与全身QP,属于腿足接触丰富的负载运动与loco-manipulation。
原摘要

In this paper, we present a robust nonprehensile object transportation framework for quadruped robots. An uncertainty-aware trajectory optimization method generates object motions with minimal closed-loop sensitivity to uncertain parameters. The resulting reference trajectory is tracked using a coupled convex model predictive controller that jointly predicts the CoM dynamics of the quadruped and the payload followed by a whole-body QP that enforces ground reaction constraints. The approach is evaluated through extensive simulations and real-world experiments under variations in the object's inertial parameters. Its performance is compared with fixed-orientation and straight-line trajectories as baseline. The results show that the optimized object motion reduces the sliding by approximately 50% compared with the fixed-orientation baseline and 30% compared with the straight-line baseline, while also achieving lower robot CoM tracking errors.