Papers for 2026-10-29

10 papers
Simone Manni, Annika Wollschl\"ager, Dario Bellicoso, ... , Simon Le Cleac'h, Jan Br\"udigam
总结: 扩展PPO以单策略实现跨硬件多阶段loco-manipulation。
方法: 相位条件批评家、门控奖励与多阶段重置课程。
证据: 解耦分层架构在多样硬件上演示多阶段任务。
为什么适合我: 直接解决接触丰富loco-manipulation与RL全身控制。
推荐理由: 直接对应全身 loco-manipulation:用相位条件 PPO、分阶段奖励与课程训练长时程蹲、抓、行走,并面向多硬件全身控制。
原摘要

Complex whole-body loco-manipulation requires executing diverse maneuvers, such as crouching, grasping, and locomotion, within a single long-horizon task. While performing simple pick-and-place behaviors is well-established, scaling to complex, long-horizon tasks remains difficult. Currently, this challenge is addressed by relying on human motion data and correspondingly humanoid platforms, which limits platform independence and introduces substantial data processing overhead. Instead, we extend proximal policy optimization (PPO) to train a single policy for multi-phase tasks across diverse robotic hardware, leveraging prior task structure to shape behavior. Our method adapts PPO using a phase-conditioned critic, phase-gated reward functions, and a multi-phase reset curriculum to guide exploration. To support varied hardware, we employ a decoupled hierarchical control architecture that separates lower-level balancing dynamics from high-level phase execution. We demonstrate multi-stage loco-manipulation skills on hardware on both the Unitree G1 and a Boston Dynamics Spot equipped with a manipulator arm, and validate our design choices through ablations. Our approach enables the acquisition of complex loco-manipulation behaviors purely through environment interaction while directly incorporating high-level task structure into policy learning.

Wenhao Xu, Yanheng Mai, Yifei Fu, ... , Xinjue Wang, Renjing Xu
总结: 预测前瞻缩小信息差实现可部署人形多地形跑酷。
方法: 预测前瞻模块与超连接Transformer近似特权信号。
证据: 在高度不连续地形上实现全身感知跑酷。
为什么适合我: 复杂地形人形跑酷感知运动,契合核心兴趣。
推荐理由: 高度契合腿足感知运动与跑酷:人形多地形跑酷、落足预见与可部署感知策略,缩小训练特权信息与机载观测差距。
原摘要

Humanoid parkour requires robots to reason about future footholds and whole-body motions over highly discontinuous terrain. We revisit the information asymmetry in asymmetric actor-critic learning for perceptive humanoid locomotion: the critic exploits privileged simulator signals during training, whereas the deployable actor operates solely from onboard perception. We argue that the key is not exposing privileged information to the actor, but learning a deployable approximation of it to narrow the information gap between training and deployment. We present HC2Robot, a deployable perceptive humanoid parkour framework consisting of a Predicted Foresight Module (PFM) and a Hyper-Connection (HC) Transformer. PFM predicts from deployable observations the policy-conditioned timing, location, and support quality of each foot's next touchdown event, converting privileged supervision into a deployable latent representation that provides the actor with predicted touchdown information without privileged runtime sensing. The HC Transformer further enhances temporal reasoning through learnable multi-stream routing, while a future motion prediction head provides short-horizon motion priors for regularization. Across stairs, gaps, high platforms, and slopes, HC2Robot achieves a mean simulated traversal success rate of 97.60% and consistently higher safe foothold rates than strong perceptive locomotion baselines, supporting improved traversal performance and geometric foothold support under deployable sensing.

GRAFT: Geometry-Aware Residual Adaptation for Foundation Trackers

5.0/5 很相关 裁判分 10.0 Top pick 当日相对
Liang Li, Guoyao Zhang, Xingyu Chen, ... , Mingliang Zhou, Diyun Xiang
总结: 几何感知残差适配使冻结跟踪器适应局部地形。
方法: 轻量适配器为下肢目标添加地形条件校正。
证据: 任务与足几何奖励训练,平坦时抑制多余校正。
为什么适合我: 人体动作跟踪适配复杂地形,支持可重定向控制。
推荐理由: 紧贴人形全身控制与运动跟踪:在冻结行为基础模型上做地形条件残差,修正落足、摆腿间隙与接触时机。
原摘要

Humanoid behavior foundation models (BFMs) provide reusable whole-body motion priors: given a kinematic reference, they generate coordinated joint commands for motion replay, teleoperation, and VLA control. However, trained primarily on flat-ground motion, BFMs lack an explicit mechanism to adapt foot placement, swing clearance, and contact timing to local terrain. Many terrain-aware BFM approaches address this limitation by retraining or fine-tuning the tracker together with perception, incurring substantial data and computation costs while coupling ordinary tracking to the perception pathway. To bridge this gap, we propose GRAFT, a geometry-aware residual adaptation framework for frozen behavior trackers. GRAFT preserves the BFM parameters and motion-reference interface, while a lightweight adapter adds terrain-conditioned corrections only to lower-body execution targets. The adapter is trained with task and foot-geometry rewards, regularized to suppress unnecessary corrections on flat ground, and distilled from privileged terrain observations to onboard depth. Because the frozen BFM already provides whole-body reference tracking and nominal locomotion, GRAFT reduces terrain learning to a focused execution-adaptation problem. We instantiate the framework on four frozen trackers and evaluate stairs, gaps, and platforms in simulation. We further validate it through real-world deployment on a Unitree G1, where the adapted SONIC tracker traverses terrain with onboard depth and unmodified references.

Whole-Body Humanoid Control via Stochastic Motion Tokenization

5.0/5 很相关 裁判分 10.0 Top pick 当日相对
Michael Drolet, Oleg Arenz, Jan Peters
总结: 随机运动标记化提供详细参考实现全身人形控制。
方法: 高层生成简洁运动表示直接输入跟踪策略。
证据: 灵活执行跳舞打斗行走等基于条件的真实运动。
为什么适合我: 人体动作转可跟踪可部署全身控制,结合模仿学习。
推荐理由: 核心是人形全身控制与运动跟踪:随机运动 token 作为高层接口,驱动跟踪策略完成舞蹈、格斗、行走等全身动作。
原摘要

While velocity-commanded RL policies are effective for controlling quadrupeds, they are a limited interface for humanoids that need to perform complex whole-body motions. Furthermore, RL tracking policies for whole-body motions typically have limited information about the desired future motion, preventing them from performing controlled deviations to achieve long-term task success; such information is particularly relevant when a controller must prepare for transitions between behaviors. We address these challenges using concise motion representations that can be generated by a high-level controller, given a behavior label or text command. These representations can be fed directly into a tracking policy to provide a detailed motion reference. Our method exhibits a high degree of flexibility in performing real-world robot motions such as dancing, fighting, or walking based on conditional information. At matched capacity, our adopted stochastic motion tokenizer reconstructs motions from the Unitree G1 at a level that exceeds state-of-the-art approaches such as finite scalar quantization (FSQ) and the vector-quantized autoencoder (VQ-VAE). The resulting discrete interface conditions whole-body tracking policies that execute generated dance, fight, and walk motions lasting 16.8 s each and a 35 s fight-to-dance sequence on a physical Unitree G1.

Mimetic Embodiment Transfer of Human-Humanoid Interaction from In-the-Wild Videos

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
Nghia Le (Hann), Khang Nguyen (Hann), Ba Long Tran (Hann), ... , Nguyen (Hann), Anh Nguyen
总结: 从野外视频迁移人人交互为物理可行人-人形交互。
方法: 重建运动后加权相对方向转移并优化接触平衡。
证据: 支持拥抱跳舞握手,泛化不同形态人形。
为什么适合我: 接触丰富交互重定向,人体动作到真机全身控制。
推荐理由: 对应人体动作重定向与模仿:从野外交互视频重建并迁移到不同人形本体,保留空间、语义与接触关系。
原摘要

Enabling a humanoid to interact naturally with human partners requires preserving not only individual motions but also the spatial, semantic, and contact relationships underlying the interaction (i.e., hugging, dancing, hand-shaking, etc.). Furthermore, a practical solution should generalize across various humanoid embodiments with distinct morphologies and kinematic constraints. To tackle this challenge, we propose HumiTransfer, a mimetic embodiment transfer framework that converts in-the-wild human-human interaction videos into physically plausible human-humanoid interactions. HumiTransfer first reconstructs 3D human motion with consistent foot-ground contact, then transfers one participant to a target humanoid embodiment via interaction modeling, using weighted joint-relative directions and anatomical offsets to prioritize interaction-critical inter-body relationships, while post-retargeting optimization enforces balance, contact, and collision avoidance. Subsequently, we apply HumiTransfer to 1,200 in-the-wild videos, producing approximately 500,000 frames of diverse interactions for the 26-DoF Unitree R1 Edu and the 23-DoF HighTorque Mini-hi humanoid robot, resulting in our HumiMimic dataset. Across both robots, HumiTransfer achieves superior motion fidelity, preserves inter-body relationships, and maintains contact accuracy compared with existing baselines. Moreover, we demonstrate that HumiMimic supports motion generation methods for synthesizing interactive humanoid motions following a human partner. Finally, our real robot deployments confirm the physical executability of the transferred motions in real-world settings.

Shengzhang Xu, Yuning Guo, Weiyi Hu, ... , Zhongyu Li, He Kong
总结: 分层RL实现人形可变高行走与爬行穿越受限空间。
方法: 历史潜在表示捕捉接触,双向策略连接运动模式。
证据: G1在高度约束中调节身高并完成爬行穿越。
为什么适合我: 复杂地形接触丰富全身运动与感知运动智能。
推荐理由: 契合接触丰富的人形全身运动:Unitree G1 变高度行走与爬行,用分层 RL 穿越受限空间。
原摘要

Humanoid locomotion in confined spaces requires continuous height adaptation across multiple locomotion modes, yet most existing approaches remain limited to height-adjustable bipedal walking. We present REACH, an RL-based hierarchical framework that enables a Unitree G1 humanoid to traverse height-constrained environments through variable-height bipedal walking and crawling. The learned policies regulate body height over complementary command ranges of 1.27--0.50m in bipedal locomotion and 0.50--0.20m in crawling, extending traversal beyond the clearance limits of crouched walking. To address contact-rich crawling dynamics, we employ a history-conditioned latent representation that captures terrain and interaction context from proprioceptive observations. A bidirectional transition policy further connects crouched bipedal locomotion and crawling across large kinematic and contact discontinuities. These skills are integrated with a LiDAR-based planner that converts point clouds into collision-free three-dimensional paths and locomotion commands, including proactive height targets. Real-world experiments demonstrate accurate height and velocity tracking, robust terrain traversal, reliable mode transitions and confined-space traversal with the proposed pipeline. Code and videos are available at https://aislab-sustech.github.io/REACH/.

CARD: Contact-Anchored Retargeting for Dexterous Manipulation

3.0/5 一般 裁判分 8.0 Strong 当日相对
Cunxi Dai, Botao He, Francois R Hogan, ... , Guanya Shi, Akash Sharma
总结: 接触锚定重定向保留力目标实现灵巧操作迁移。
方法: 共享手接触表示生成力目标,加触觉跟踪控制。
证据: 开环重放保持接触,视频源用Vid-HACO估计。
为什么适合我: 接触丰富场景人体到机器人重定向,相关loco-manip。
推荐理由: 接触锚定重定向接近人体动作重定向,但对象是灵巧手操作而非人形全身或腿足运动。
原摘要

Humans are dexterous, but traditional data collection paradigms such as teleoperation, kinesthetic teaching, and wearable exoskeletons force humans to act through the robot embodiment, bottlenecking their dexterity. Retargeting can avoid this. However, existing methods purely translate kinematics and ignore the real-world contact dynamics essential for task success. We present CARD: Contact-Anchored Retargeting for Dexterous Manipulation, a simulator and object-free framework that retargets human demonstrations to robot actions by explicitly preserving contact force targets. CARD unifies human data sources including video, motion capture, and tactile gloves via a shared hand--contact representation and generates explicit contact force targets in addition to kinematics. To maintain these contact targets during hardware open-loop replay, CARD also introduces a tactile tracking controller. For video which does not contain an explicit tactile source, we present Vid-HACO, our video-to-contact model that sets a new state of the art. Across our video, glove, motion-capture data and the GRAB dataset, CARD maintains contact on $43$--$78\%$ of contact frames, while kinematic and object-aware retargeting methods maintain contact on $<10\%$ and $22.5\%$ of the frames respectively. Further, integrating our formulation into physics-based retargeting improves strict task success from 12\% to 32\% on GRAB dataset. Finally, we show that our tactile tracker is critical to reproduce demonstrated forces during hardware replay. These results establish that contact preservation via CARD is a scalable interface for transferring human dexterity to robots.

Leon Magnus, Nico Bohlinger, Jan Peters, Oleg Arenz
总结: 局部空间矩阵记忆提升腿足机器人端到端探索。
方法: Hadamard记忆在位置单元存储任务相关信息。
证据: 迷宫探索匹配基线覆盖并三倍降低布局重建误差。
为什么适合我: 复杂环境空间记忆支持腿足感知运动智能。
推荐理由: 虽用腿足机器人,但核心是迷宫探索的空间记忆,不是全身控制、跑酷或 loco-manipulation。
原摘要

Humanoids and other legged robots operating in complex environments must remember information that leaves their field of view and only becomes relevant much later. Reinforcement learning policies address this using memory networks such as LSTMs that are trained end-to-end with the policy to memorize such task-relevant aspects. Yet, such architectures often fail to preserve sufficient information over long horizons. In this work, we propose a network architecture based on Hadamard memory that specifically targets robot navigation. Our Local Spatial Matrix Memory (LSMM) enables RL agents to store generic task-relevant information at specific, position-based memory cells, enabling flexible and spatially grounded memorization. We evaluate LSMM on the task of autonomous maze exploration, where it matches the maze coverage of strong recurrent and finite-history baselines while being the only architecture that remembers the maze layout, reducing the reconstruction error threefold.

Hanwen Ren, Meng Zheng, Wenzhe Cui, ... , Terrence Chen, Ziyan Wu
总结: 用失败轨迹作负引导提升扩散流式VLA策略鲁棒性。
方法: 双动作生成器联合训成功失败行为共享视觉语言骨干。
证据: 在线生成失败rollout,采样时自适应避开失败区。
为什么适合我: 扩散模型用于技能学习,可扩展人形操作与模仿。
推荐理由: 标题像人体到人形技能迁移,摘要实为通用 VLA 失败轨迹引导的操作策略,未落在人形全身运动。
原摘要

Vision-language-action (VLA) models provide a promising paradigm for scalable robotic manipulation, yet their reliance on success-only behavioral cloning leaves them brittle; lacking corrective training signals, minor execution errors rapidly compound into unrecoverable, out-of-distribution failures. To address this limitation, we propose Adaptive Failure-Informed Learning (AFIL), an end-to-end framework that leverages failure trajectories as adaptive negative guidance for diffusion- and flow-based VLA policies. AFIL uses a pretrained VLA to generate failure rollouts online, avoiding the need for handcrafted failure-mode design or human-in-the-loop recovery. It then jointly trains Dual Action Generators (DAGs) for successful and failed behaviors while sharing a common vision-language backbone, enabling efficient failure-aware policy learning with limited parameter overhead. During sampling, the failure generator adaptively steers action generation away from failure-prone regions and toward more reliable success modes, with guidance strength determined by the per-diffusion-step distance between success and failure distributions. Experiments across in-domain and out-of-domain robotic manipulation tasks, covering both short- and long-horizon settings, show that AFIL consistently improves task success rates and robustness over existing VLA baselines, demonstrating its effectiveness, efficiency, and generality.

A Trainable CPG Framework for Quadruped Locomotion

2.0/5 偏低 裁判分 8.0 Strong 当日相对
Xiyan Liu, Yide Liu, Guoyong Mao, Shaoxing Qu
总结: 可训练CPG结合ENN实现四足多步态无缝转换。
方法: 八神经元CPG供节奏,共享ENN映射信号到关节角。
证据: 仿真所有20对步态转换成功率达99.39%。
为什么适合我: 腿足运动模式生成与学习结合,可启发人形控制。
推荐理由: 可训练 CPG 只覆盖四足常规步态切换,缺少人形全身、复杂地形感知与跑酷。
原摘要

We present CPG-ENN, a trainable quadruped locomotion framework that combines explicit neural coordination with learned motion realization. A symmetry-based eight-neuron central pattern generator (CPG) supplies gait rhythms, while a pretrained, leg-shared execution neural network (ENN) maps rhythmic signals and trajectory parameters to joint-angle references without online inverse kinematics. A single feedback policy modulates six physically interpretable trajectory variables. The controller tracks planar velocity and yaw-rate commands across walk, trot, pace, bound, and pronk without gait-specific learned controllers or transitionspecific rewards. Simulation yields 99.39% transition success across all 20 directed gait pairs and all source-target speed combinations from {0.5, 1.0, 1.5, 2.0} m/s. Ablations show high cross-gait transition feasibility without transition exposure; exposure mainly refines gait acquisition and velocity transients. Comparisons with AllGaits and Walk These Ways demonstrate accurate gait-speed regulation, and Unitree Go2 experiments validate five gaits and their transitions.