Papers for 2026-10-21

10 papers

Action-Aligned Latent Planning for Versatile Humanoid Loco-Manipulation

5.0/5 很相关 裁判分 10.0 Top pick 当日相对
Yutang Lin, Guanya Shi, C. Karen Liu
总结: FIBER用冻结BFM可执行潜空间统一异构交互技能规划。
方法: 潜策略投影映射任务策略到匹配局部响应的潜命令。
证据: 实现低率规划同时保留BFM高频状态依赖控制响应。
为什么适合我: 契合loco-manipulation感知运动与全身潜空间规划。
推荐理由: 直接对应人形全身 loco-manipulation:用冻结行为基础模型的可执行潜空间衔接高层规划与全身控制,属于全身控制与场景交互核心。
原摘要

Learning a single perceptive policy for diverse humanoid loco-manipulation requires unifying high-level task decisions without losing the state-dependent physical responses that make each interaction succeed. This makes the representation between high-level planning and whole-body control critical: kinematic or contact targets provide compact abstractions but do not directly encode interaction-specific control responses, while directly predicting low-level actions requires the planner to model high-frequency closed-loop feedback. We propose FIBER, a framework that uses the executable latent space of a frozen behavioral foundation model (BFM) as a shared planning representation for heterogeneous interaction skills. Our latent policy projection (LPP) maps independently acquired task-specific policies into this representation by identifying latent commands whose induced actions match their local control responses, enabling lower-rate planning while retaining the BFM's high-frequency state feedback. After projection, we aggregate closed-loop latent rollouts from all skills and train a single perceptive flow planner entirely offline. We further introduce AH-BFM, an adaptive-horizon BFM trained with multi-gamma forward-backward (FB) learning to support both precise control and temporally extended whole-body behavior. We evaluate FIBER on box pickup, door opening, and object grasping in simulation and on a real Unitree G1 humanoid. Across 128 diverse variations per task in simulation, FIBER achieves 42.0% mean success, more than tripling projected latent replay (11.6%) and substantially outperforming kinematic planning (3.5%). Real-world experiments further demonstrate sim-to-real transfer, skill chaining, and conditional steering through the same unified planner.

OmniInteract: Towards Unified Whole-Body Interaction Control for Dual Humanoids

5.0/5 很相关 裁判分 10.0 Top pick 当日相对
Yinghao Li, Tianyu Zhang, Zhuohao Li, ... , Qing Zhang, Wei-Shi Zheng
总结: OmniInteract实现双人形统一全身交互控制。
方法: 表面接触感知重定向加可扩展流式残差交互策略。
证据: 保留接触接口与近场几何并维持控制保真度。
为什么适合我: 直接服务接触丰富双人形全身协调与重定向。
推荐理由: 双人形全身交互控制,含接触感知重定向与可扩展交互策略,紧贴全身 loco-manipulation、人体动作重定向与接触丰富交互。
原摘要

Physical interaction is a key capability for humanoid collaboration, requiring coordinated whole-body motion and precise contact. However, learning diverse dual-humanoid interactions faces two major challenges: (1) human-robot morphological differences disrupt contact interfaces and spatial relationships during retargeting, and (2) jointly learning motor skills and partner coordination makes it difficult to retain control fidelity as interaction diversity grows. In this paper, we propose OmniInteract to address these challenges through surface-aware modeling and scalable residual policy learning. First, we introduce Surface Contact-Aware Retargeting, which leverages dense human-robot surface correspondences to jointly retarget both humanoids, preserving explicit interaction contact interfaces and their near-field geometric context. Second, we propose a Scalable Flow-based Interaction Policy for partner-conditioned residual generation. It factorizes dual-humanoid control into a reusable motor foundation and interaction-specific adaptations: partner-aware experts learn corrections over a frozen whole-body motion prior, while conditional flow matching unifies them in a shared residual action space. This enables scalable skill consolidation while retaining pretrained motor capabilities. Extensive experiments demonstrate that OmniInteract improves retargeting fidelity and dual-humanoid coordination while better retaining interaction performance as skill diversity grows. Real-world deployment further demonstrates successful contact establishment, stable whole-body coordination, and recovery from external perturbations.

Yanjun Li, Jiarui Ye, Weiyu Guo, ... , Mingju Gao, Hao Tang
总结: 语言强制强化全身世界动作模型任务相关预测。
方法: 冻结VLM评估进度并对齐语言嵌入与未来视觉特征。
证据: 训练辅助无推理开销突出任务相关状态变化。
为什么适合我: 助力语义对齐的人形loco-manipulation全身控制。
推荐理由: 面向人形全身 loco-manipulation 的世界动作模型与语义对齐,直接落在全身运动智能与场景交互方向。
原摘要

World Action Models (WAMs) jointly predict robot actions and future observations. However, their visual prediction objectives do not explicitly distinguish task-relevant transitions from incidental scene changes. For whole-body policies, this distinction matters because task progress depends on coordinated changes in body pose, contact, and object state. We introduce LANGUAGE-FORCING, a training strategy that uses language to emphasize task-relevant changes in the future visual representations of a whole-body WAM. Given paired current and ground- truth short-horizon future frames, a frozen vision-language model assesses task progress and predicts plausible subsequent state changes. We encode these descriptions with a frozen text encoder and align their embeddings with intermediate, action-conditioned future-visual features, complementing the original visual and action prediction objectives. All auxiliary components are used only during training, introducing no additional inference overhead. On HumanoidArena, LANGUAGE-FORCING achieves an average success rate of 79.17%, exceeding the strongest competing policy by 9.46 percentage points and the same WAM without language alignment by 10.77 percentage points. Across five real-world tasks, language alignment raises average success from 53.33% to 71.33% over the same WAM baseline.

Kapalik Khanal, Biswash Khatiwada, Stephen Afrifa, Fan Wu, Ramesh Bahadur Bist
总结: DUET解耦上下身实现任务无关loco-manipulation。
方法: RL下肢策略与任意上肢策略仅在接口组合命令。
证据: 硬件上同一运动检查点可配对不同操作策略。
为什么适合我: 模块化全身控制利于跑酷与真机部署。
推荐理由: 任务无关的人形 loco-manipulation,用强化学习下肢策略与上肢操作解耦并在 G1 上保持平衡,完全对齐全身控制。
原摘要

Changing a humanoid robot's manipulation policy should not require retraining the controller that maintains the robot's balance. This study introduces DUET, a decoupled execution framework that enables locomotion and manipulation controllers to operate simultaneously by combining their commands only at the robot interface. A reinforcement-learning locomotion policy controls the 12 leg joints and a waist yaw joint, tracking planar velocity, turning rate, and pelvis height from deep crouching to upright standing on a 23-degree-of-freedom Unitree G1. The 10 arm joints are excluded from the action space, while their positions and velocities are included only as observations, so that any compatible manipulation policy that generates arm-joint targets can control the upper body, and the locomotion policy keeps the lower body stable without requiring shared training or direct coordination. This study demonstrates the modular approach on hardware by pairing the same locomotion checkpoint with two different vision-language-action models, GR00T N1.7 and pi0.5. In simulation evaluation, the locomotion controller kept the robot's lower body stable with no falls while tracking the commanded planar velocity, yaw rate, and pelvis height with errors of 0.186 m/s, 0.142 rad/s, and 0.016 m, respectively. Ablation studies identify the upper-body pose curriculum as the dominant component, and removing this training step reduces episode survival from 20.0 to 7.4 seconds and increases the fall rate to 6.06 per environment minute. Robustness tests show no falls under pushes of up to 1.0 m/s within the trained payload range, and no falls at twice the payload limit for pushes below 0.7 m/s. These results show that a manipulation policy can be exchanged without retraining, restarting, or otherwise touching the layer that keeps the robot upright.

DiPLO: Self-distilled Diffusion Planning for Loco-manipulation

5.0/5 很相关 裁判分 10.0 Top pick 当日相对
Shafeef Omar, Sebastian Sanokowski, Elham Daneshmand, ... , Cordelia Schmid, Majid Khadiv
总结: DiPLO自蒸馏扩散规划实现人形loco-manipulation。
方法: 自蒸馏扩散规划器加RL全身跟踪两阶段后训练。
证据: 预训练重定向运动后蒸馏微调提升规划性能。
为什么适合我: 扩散与模仿结合适合人体动作重定向真机控制。
推荐理由: 扩散规划加全身跟踪,预训练来自人体到人形重定向并用强化学习执行,方法与 loco-manipulation、重定向、扩散模型高度重合。
原摘要

Humanoid loco-manipulation is particularly challenging because it requires coordinating locomotion, balance, and object interaction, making it difficult to learn from limited demonstrations or from scratch through Reinforcement Learning (RL). We introduce DiPLO (self-distilled Diffusion Planning for Loco-manipulation), a framework that combines a self-distilled diffusion planner with a low-level whole-body tracking policy. Our planner is pretrained via supervised learning on motions derived from human-to-humanoid retargeting, while the tracker is trained via RL to execute them. DiPLO centers around two complementary post-training stages. First, we introduce Self-Distillation Diffusion Policy Optimisation (SD:DPO) to remove the planner's dependence on strong task conditioning, which we identify as a crucial ingredient for effective pretraining, as downstream fine-tuning does not recover comparable performance when it is omitted.. We then fine-tune this distilled model with Diffusion-Augmented Proximal Policy Optimization (DA:PPO), a maximum-entropy RL method for diffusion models, to improve task success and align generated plans with the frozen tracker's execution capabilities. Together, these stages enable motion generation through state-history and goal conditioning alone, enabling 99% task success in pick-carry-place tasks, compared to just 45% for the pretrained model. The resulting planner also generates motions for unseen object goals, with further evaluations on kicking and pushing/pulling tasks. Finally, we deploy our pipeline on the hardware, using our DA:PPO planner-tracker on a Unitree G1, achieving repeated successful executions without any real-world fine-tuning.

Yiming Wang, Peixian Yang, Lifeng Zhuo, ... , Weiming Wang, Daolin Ma
总结: HS-MoDP独立语义路由组合人形臂技能。
方法: 语义混合专家扩散策略加同构外骨骼采集演示。
证据: G1实验显示更强技能组合与可靠接触遥操作。
为什么适合我: 技能复用与人体动作到真机全身控制契合核心。
推荐理由: 人形操作技能组合、扩散策略与同构遥操作采集,并与已有运动控制器衔接,对齐遥操作、模仿和 loco-manipulation。
原摘要

Humanoid manipulation requires reusable arm skills, yet demonstrating every possible skill combination is impractical. We present Humanoid Semantic Mixture-of-Experts Diffusion Policy (HS-MoDP), which composes separately demonstrated arm skills through independent semantic routing over a shared expert pool. This design preserves arm-specific skill control while sharing action-generation parameters across arms. A semantic scheduler integrates the learned policy with an existing locomotion controller through alternating manipulation and repositioning stages, extending the effective workspace and enabling skill reuse across location changes. To acquire demonstrations of whole-body contact manipulation, we develop G1Exo, an isomorphic exoskeleton that provides direct joint-level control of arm configurations. Experiments on a Unitree G1 show stronger skill composition than the baselines. G1Exo enables more reliable contact teleoperation than end-effector VR-IK, and its demonstrations improve contact-skill learning across four policy architectures. For HS-MoDP, switching from VR-IK to G1Exo demonstrations raises full cabinet workflow success from 35% to 65%. All project hardware designs and source code will be released as open source after the review process.

Langzhe Gu, Chengkai Hou, Meng Li, ... , Shanghang Zhang, Zhengping Che
总结: HAF-VLA分层动作流适配人形VLA全身控制。
方法: 流匹配VLA渐进去噪共享全身动作空间。
证据: 继承预训练权重用阶段嵌入适应loco-manipulation。
为什么适合我: 视觉语言动作助力复杂地形感知运动智能。
推荐理由: 把视觉语言动作策略分层适配到人形全身 loco-manipulation,直接对应全身协调与场景交互。
原摘要

Humanoid robots hold great promise as general-purpose agents in human-centered environments, yet adapting generalist vision-language-action (VLA) policies to real-world humanoid loco-manipulation remains challenging. Unlike fixed-base or wheeled manipulators, humanoids must coordinate locomotion, posture, gaze, and dual-arm manipulation over a high-dimensional whole-body action space, where inaccurate base or waist motions can easily induce unstable and aggressive upper-body compensation. We propose HAF-VLA, a hierarchical action-flow framework for humanoid VLA control. Built upon a pretrained flow-matching VLA, HAF-VLA inherits the vision-language prefix encoder and action expert weights, and adapts them to humanoid whole-body loco-manipulation with learnable stage embeddings and cross-stage KV-cache conditioning. Instead of generating the full action chunk in a single pass, HAF-VLA progressively denoises a shared whole-body action space: first locomotion and head commands, then waist refinement, and finally full-body manipulation. To preserve structural dependencies across stages, we introduce a cross-stage KV cache conditioning mechanism, enabling subsequent action generation stages to refine and augment their outputs based on the action representations from preceding stages. Experimental results across six real-world tasks demonstrate that our framework significantly enhances the performance of existing models in humanoid loco-manipulation tasks, demonstrating an effective pathway for adapting strong mobile-manipulation VLAs to humanoid whole-body loco-manipulation.

SWAP: Test-Time Steerable Humanoid Whole-Body Collision Avoidance

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
Zeji Yi, Guanqi He, Xiaofeng Guo, ... , Karen Liu, Guanya Shi
总结: SWAP实现测试时可引导人形全身避障。
方法: 感知条件扩散高层提案加低层RL全身跟踪。
证据: 后见标签训练实现多模态稳定碰撞避免。
为什么适合我: 复杂地形接触场景全身避障与平衡高度相关。
推荐理由: 感知条件扩散策略生成全身避障动作,再由强化学习全身控制器跟踪并维持平衡,属于人形感知运动与全身控制。
原摘要

Humanoid robots operating in human-centric environments must coordinate the entire body to traverse tight, cluttered spaces while maintaining balance. Existing methods often struggle to jointly consider dynamic stability and collision avoidance from high-dimensional perceptual inputs. Moreover, for humanoids, safe behavior is inherently multimodal: the same obstacle may admit multiple valid traversals, which is difficult to represent with a single deterministic policy. To address these challenges, we propose SWAP (Steerable Whole-body Avoidance Policy), a hierarchical framework that separates collision-aware decision making from stabilization. A high-level, perception-conditioned diffusion policy generates multimodal, collision-aware motion proposals, while a low-level whole-body RL controller tracks these proposals and maintains dynamic balance. To efficiently train the high-level policy, we obtain scalable supervision via hindsight labeling: we roll out the low-level policy under randomized commands, place obstacles only in the space that each executed motion did not sweep, so the motion is collision-free by construction, and re-render the perception the robot would have seen. At deployment, Monte Carlo sampling with simple cost signals steers the diffusion model toward safe, task-aligned behaviors without heavy reward tuning. Experiments in simulation and on a real Unitree G1 humanoid show reliable avoidance with static and dynamic obstacles. Test-time steering further enables customization, improving targeted rewards (e.g., speed, orientation, or posture) by 34% on average while maintaining a high collision avoidance rate. Together, these results support a practical solution to humanoid whole-body collision avoidance with test-time steerability. Project website: https://iscoyizj.github.io/SWAP-steerable-humanoid-oa-website/

Tianqi Liu, Hanfei Zhao, Qifeng Liang, ... , Zhaoxi Chen, Ziwei Liu
总结: Ropedia W0跨具身扩展loco-manipulation世界模型。
方法: 统一运动学表示编码运动操作并用大规模数据训练。
证据: 跨具身评估达先进性能并引入长时程基准。
为什么适合我: 世界模型与人体经验利于全身运动预测控制。
推荐理由: 跨人体与机器人的自我中心 loco-manipulation 世界模型及遥操作基准,紧贴全身场景交互与数据采集。
原摘要

World models enable embodied agents to anticipate action consequences, yet jointly modeling locomotion and manipulation across diverse embodiments remains challenging due to heterogeneous action spaces and limited multimodal supervision. We present Ropedia W0, the first egocentric loco-manipulation world foundation model spanning humans and robots with diverse embodiments. We curate Xp-Data, comprising 10k hours of egocentric human data and 3k hours of robot data with unified multimodal annotations and systematic quality control. A unified kinematic representation encodes locomotion through camera poses and manipulation through projected skeletons, with robot skeletons combining embodiment-specific forward kinematics with extensive manual keypoint annotation and correction. We also introduce Xp-Teleop, a long-horizon loco-manipulation benchmark based on high-quality dexterous humanoid teleoperation data. Evaluations demonstrate state-of-the-art performance across five cross-embodiment benchmarks (DreamDojo, $\Psi_0$, $\omega$-HOME, Xp-Teleop, and AgiBot) and on held-out human egocentric video, from zero-shot inference to few-shot and full-data post-training. Scaling human pre-training data improves performance on both human and robot evaluations. After distillation, our model supports real-time, minute-long rollouts, enabling live VR interaction. Applications in policy evaluation, model-based planning, and world-action modeling further demonstrate the model's utility for embodied decision-making.

Fukang Liu, Feiyang Wu, Paul Barsa, ... , Tony G. Chen, Ye Zhao
总结: 超数肢体增强人形协调loco-manipulation能力。
方法: 集成超数臂并量化形态增强对可行动作空间影响。
证据: 硬件实验显示额外肢体扩展全身交互与支撑。
为什么适合我: 扩展接触丰富场景下全身运动与平衡协调。
推荐理由: 在人形平台上研究额外肢体与全身平衡、操作的协调,接近 loco-manipulation,但重点是形态增广而非通用全身跟踪或运动先验。
原摘要

Humanoid robots are envisioned to perform diverse human-level tasks through their anthropomorphic morphology. Their dual-arm configuration enables a broad range of everyday actions. Yet, as in humans, this morphology can constrain loco-manipulation when both arms are occupied or additional contacts are required beyond their reach. Supernumerary robotic limbs (SRLs) offer a way to extend these capabilities, but their integration requires the added limb to be coordinated with whole-body motion and balance. In this study, we develop and integrate a supernumerary arm into a humanoid platform to investigate how morphological augmentation reshapes its feasible action space. Through quantitative analysis and hardware experiments across two configurations, we show how the additional limb expands whole-body interaction capabilities by enabling manipulation and support to be coordinated beyond the constraints of the native dual-arm configuration. To control this augmented morphology, we leverage model-based trajectory optimization (TO) to generate dynamically feasible motions for goal-conditioned reinforcement learning (RL) controllers. The controllers are trained in simulation and transferred to hardware in a zero-shot manner, enabling coordinated whole-body skills for contact-rich tri-arm loco-manipulation. We further show vision-guided autonomous execution on selected tasks using diffusion policies trained from hardware demonstrations. Our findings suggest that humanoid morphology need not be restricted to human-like forms, but can be reimagined as an extensible design space for robotic augmentation.