Papers for 2026-11-14

10 papers
Liangjun Xing, Ke Fan, Kailin Li, ... , Jingbo Wang, Weinan Zhang
总结: 力感知多粒度控制使人形在接触中协调行走与操作。
方法: 粗到细指令结合动量观测器与仿真力监督的学习修正。
证据: 部署只需稀疏腕姿、粗指令和可选负载,无需全身参考。
为什么适合我: 贴合人形移动操作、接触力感知与遥操作稀疏控制。
推荐理由: 直接对应人形移动操作与全身控制:力感知、接触维持、稀疏腕部位姿遥操作接口,且不依赖全身动捕轨迹。
原摘要

Humanoid loco-manipulation requires coordinated locomotion, balance regulation, and manipulation under frequent contacts, making teleoperated demonstration collection difficult: a practical controller must simultaneously provide precision, stability, and contact awareness. We propose FORGE, a force-aware multi-granularity control system with a coarse-to-fine command space spanning velocity navigation, planar foot placement, wrist-pose tracking, and optional force-conditioning inputs. Policy training requires no full-body human motion trajectories or joint-angle references; deployment consumes only sparse bilateral wrist poses relative to the pelvis, coarse motion commands, and optional desired wrist-load inputs. For sustained contact, FORGE combines a momentum observer with a learned correction trained using simulator contact-force supervision. At deployment, it estimates low-frequency, wrist-equivalent interaction forces from proprioception and reconstructed low-level arm PD torques, without wrist force/torque sensors. A quasi-static virtual-target loop uses this estimate and an optional desired applied-force input to adapt the wrist target. A frozen locomotion prior and asymmetric residual actions stabilize manipulation-induced whole-body corrections. Experiments evaluate unified-control stability, task-space tracking, quasi-static wrist-equivalent force estimation, squeezing forces during sustained contact with a rigid box, and downstream diffusion-policy execution of a squat-and-lift task across payload conditions. Website: https://bb0928.github.io/forge/.

BlinkMimic: Training a Humanoid Motion Tracker in Minutes on a Single GPU

5.0/5 很相关 裁判分 10.0 Top pick 当日相对
Fuyi Chen
总结: 单卡数分钟训出覆盖动作库的人形全身运动跟踪策略。
方法: 基于世界模型反传,并用新步长等配方缩短训练。
证据: 单卡三点四分钟覆盖四十段,连续达标且无失败片段。
为什么适合我: 显著加速强化学习动作模仿与人形运动跟踪训练。
推荐理由: 核心是人形全身运动跟踪与动作模仿,在Unitree G1上用仿真加速训练跟踪策略,紧贴运动跟踪方向。
原摘要

Whole-body motion tracking lets a humanoid robot follow reference motions, but training a tracking policy for a library of motions has usually taken hours of GPU time. SuperMimic showed that the policy can instead be trained by backpropagating through a world model learned from parallel simulation, and InstantTrack added Muon updates, a residual policy around the reference and an averaged deployed policy. We build on both and present BlinkMimic, a recipe that makes this training faster. On a simulated Unitree G1, BlinkMimic trains one policy for all 40 LAFAN1 clips in 3.4 minutes on a single RTX 4090, measured until three consecutive checkpoints reach a normalized return of at least 0.82 with no failed clip (mean of three seeds). We split training time into the cost of an iteration, the iterations needed to fit the motions, and the iterations needed to remove the last failures, and assign each component, inherited or new, to one of these terms. The new components are a step size that decreases once training has progressed, resets directed by failures of the deployed policy under deployment conditions, and GPU graph capture of the whole iteration. A leave-one-out ablation with three seeds per component shows which term each component affects, and further measurements of the gradient, the update rule and the failure cases explain these effects. Code and per-seed results are available at https://github.com/fuyichen0725/blinkmimic.

ILA: A Transferable Interface-Level Adapter for Compliant Humanoid Motion Tracking

5.0/5 很相关 裁判分 10.0 Top pick 当日相对
ZhuoChang Cai, Zihao Yan, Jinxuan Zhu, Yanjie Li, Hao Xiong
总结: 接口级适配器使预训练跟踪器能响应物理引导并柔顺跟踪。
方法: 由观测历史预测交互所致参考修正,仿真训练后即插即用。
证据: 接入三种跟踪器均提升柔顺性,且无需传感器或重训策略。
为什么适合我: 服务受约束环境与人机物理交互中的安全遥操作跟踪。
推荐理由: 面向人形运动跟踪与遥操作的柔顺适配器,可插入预训练跟踪策略并在仿真中学习交互修正。
原摘要

Humanoid motion tracking is fundamental to reproducing human motions on humanoid robots and serves as an important tool for teleoperation and motion data collection. However, directly tracking reference motions can be unsafe in constrained environments or during physical human--robot interaction, motivating the need for compliant motion tracking. We present ILA, an Interface-Level Adapter for compliant humanoid motion tracking without dedicated interaction sensors. ILA adapts motion references from the robot's observation history, allowing the robot to respond to physical guidance while preserving the capabilities of a pretrained motion tracker. As an interface-level module, ILA can be directly plugged into different pretrained motion trackers without retraining either the adapter or the tracking policies. ILA is trained entirely in simulation to predict reference corrections induced by physical interaction. We evaluate ILA with three humanoid motion trackers and achieve a 63.6--75.4% reduction in guidance-target error compared with their original policies. Matched simulation studies and hardware experiments further show that ILA improves responsiveness to human guidance while preserving nominal motion-tracking performance. These results demonstrate compliant guidance as a reusable, sensor-free extension to pretrained humanoid motion trackers.

PERA: Plug-in Experts for Robotic Actions in Continual Whole-Body Control

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
Shangchao Hu, Yadan Sun, Xibo Yu, Wei Huang
总结: 冻结基策略并加插件专家,持续学习新全身技能且少遗忘。
方法: 只训练新增任务专家和路由,用奖励或教师动作监督。
证据: 十项新任务均可完成,关闭专家后原一百二十六段仍可执行。
为什么适合我: 适合人形动作模仿技能持续扩展且保持原有运动能力。
推荐理由: 在G1上做持续全身控制与动作模仿,用插件专家扩展行走、舞蹈等技能且保留原策略,高度契合。
原摘要

Motion imitation enables humanoid robots to acquire whole-body skills such as walking and dancing. However, fine-tuning an entire policy for a new skill can affect existing behaviors, while training a separate policy for each skill increases training and maintenance costs. We present PERA, a method for learning new skills by reusing existing motion capabilities. PERA freezes a pretrained mixture-of-experts policy and trains an additional task expert and its routing score using task rewards or teacher-action supervision. In Unitree G1 simulation, each added task module contains approximately 1.03% of the parameters of the base actor. Built on our pretrained policy, PERA successfully completes all ten new tasks. Disabling the expert restores the original computation path of the base policy, which still fully executes all 126 original motions. Enabling the expert also improves the execution of some dance motions not used to train that expert, indicating that its benefits extend beyond its training motions. Experiments with HoloMotion further demonstrate the applicability of PERA to different base policies.

Zhenxuan Ding, Yu Huang, Xinmiao Wang, ... , Ziyang Dong, Wenhao Cui
总结: 由单张彩图重建场景并生成可迁移到人形的交互动作。
方法: 场景条件生成人体动作,重定向前度量修正、后接触引导。
证据: 两阶段修正用于维持重建几何与支撑接触在迁移中的一致性。
为什么适合我: 连接视觉场景理解、人体到人形重定向与交互执行。
推荐理由: 从单张RGB生成人形运动参考并做接触引导的人体到机器人重定向,正中运动重定向方向。
原摘要

Extending humanoid interaction generation to new environments remains limited by the need for prebuilt 3D scene assets. Reconstructing scenes directly from single RGB images offers a way to overcome this limitation, but introduces a key challenge in maintaining geometric consistency throughout motion generation and transfer. Visually plausible human motions may be misaligned with the reconstructed scene, while retargeting can introduce additional support errors due to differences between human and robot embodiments. We present a unified pipeline that transforms a single RGB image into a humanoid motion reference. It reconstructs scene geometry from the input image, generates a human interaction conditioned on the reconstructed scene, and retargets the motion to a humanoid robot. To maintain geometric consistency throughout this process, we incorporate two complementary refinement stages before and after embodiment transfer. Before retargeting, Joint Metric Interaction Refinement (JMIR) refines human motion alignment with the registered metric scene while preserving the generated interaction structure. Following retargeting, Contact Guided Residual Retargeting (CGRR) corrects robot specific support errors to restore the intended support relationships. Together, these stages produce motion references that are consistent with the reconstructed scene and can be followed by multiple pretrained humanoid trackers without scene specific policy fine tuning. Compared with GRAIL, our method reduces refinement time from 480 s to 87 s, yielding a speedup of 5.5 times. The complete pipeline achieves a success rate of 89% in simulation and 70% across 50 physical trials on the Unitree G1, demonstrating its effectiveness in generating executable humanoid motion references from single RGB images.

Heng Li, Yang Li, Yifan Duan, ... , Jianmin Ji, Yanyong Zhang
总结: 仅用末端轨迹协调四足底盘与不同机械臂的全身操作。
方法: 预览末端目标决定底盘,臂专用逆解跟踪,运动策略冻结。
证据: 覆盖四类六自由度臂,并可执行超出固定基座可达范围的轨迹。
为什么适合我: 契合足式移动操作、跨臂形态全身控制与末端轨迹跟踪。
推荐理由: 虽是四足而非人形,但是足式移动操作的全身控制,由末端轨迹协调臂与底盘,值得关注。
原摘要

Quadrupedal mobile manipulators can extend their manipulation workspace by coordinating the mounted arm with the mobile base. At the task level, short-horizon end-effector (EE) trajectories provide an interface for specifying the desired manipulation motion without prescribing how it should be realized by the arm and base. However, executing such trajectories remains challenging because the controller must determine when and how the base should move, and this decision depends on the mounted-arm morphology. We therefore present PolyMorphWBC, a hierarchical controller that takes an EE trajectory as the sole task-level motion command and generates coordinated arm--base motions across four families of 6-DoF mounted arms, with extended-reach trajectories beyond the initial fixed-base reach. Within PolyMorphWBC, a trajectory-conditioned coordinator determines the base motion from previewed EE targets, while arm-specific Inverse Kinematics (IK) tracks the current target, and a frozen locomotion backend executes the resulting motion. Cross-arm reuse is enabled by a Unified Robot Description Format (URDF)-derived morphology conditioning, together with online residual-wrench feedback. We train PolyMorphWBC on procedurally generated arms and structured trajectories within and beyond fixed-base reach. In IsaacLab, it achieves 93.95% completion with 2.30cm position error and 4.81{\deg} orientation error on held-out trajectories and arm morphologies. In MuJoCo evaluation against UMI-on-Legs, PolyMorphWBC reduces EE position error by 69--72% and orientation error by 91--97% across four within- and extended-reach trajectories. On a physical Go2--ARX5 system, we demonstrate language-conditioned extended-reach pick-and-place using EE trajectories from pi_0 without vision-language-action (VLA)-generated base commands.

Elastra: A Simulation Framework for Elastic Bodies

4.0/5 相关 裁判分 3.0 Candidate 当日相对
Youran Sun, Chugang Yi, Xingyu Ren, Haizhao Yang
总结: 弹性面仿真框架支持在床垫和蹦床上训练人形控制。
方法: 表面仅竖直运动,接触力驱动变形回弹并更新后续接触。
证据: 对照独立实现与真实床垫载荷,并训练站起残差策略。
为什么适合我: 面向接触形变与回弹下的人形强化学习及仿真评估。
推荐理由: 为弹性接触建立物理仿真,并在G1上结合已有运动跟踪器训练起身控制,贴近人形仿真控制。
原摘要

When robots interact with elastic surfaces such as mattresses and trampolines, changes in loading cause the surfaces to deform and rebound, altering subsequent contact locations and forces. We present Elastra, a simulation framework for modeling this interaction and supporting the training and evaluation of robot control policies. Elastra represents each surface using elements that move only vertically, with elastic connections and damping to model deformation and recovery. Contact forces drive surface motion, and the updated surface geometry is used to compute subsequent contact forces. We systematically validate our simulations against an independent implementation and a real mattress load curve. We further use Elastra to train the Unitree G1 humanoid to stand up on mattresses and trampolines. Using the pretrained HoST policy and ProtoMotions motion tracker as original controllers, we train residual policies through reinforcement learning to add corrections to their joint targets. Adding these residual policies increases the success rate with HoST from 44.1\% to 72.5\%, and from 55\% to 89\% on the trampoline. With ProtoMotions, the success rate increases from 19.0\% to 45.0\% for initial poses not encountered during training. The code and video are available on https://github.com/yichg/elastra.

HALO: Human-Aligned Data Collection for WhoLe-body MObile Manipulation

3.0/5 一般 裁判分 9.0 Top pick 当日相对
Shuai Yang, Fangyi Xu, Yishu Shen, Kecheng Zheng, Yinghao Xu
总结: 对齐人机感知与动作空间以采集全身移动操作示教。
方法: 动觉引导末端并移动低阻平台,再做部署对齐的示教处理。
证据: 保留直接物理反馈和自然行走,同时完成双臂操作与移动。
为什么适合我: 直接服务于全身移动操作的遥操作示教与数据收集。
推荐理由: 涉及全身移动操作示教采集,但未明确人形或足式本体,更像通用移动底盘的人机对齐数据采集。
原摘要

Learning whole-body mobile manipulation requires demonstrations that coordinate bimanual actions with locomotion across extended workspaces. However, existing interfaces trade off direct robot control, perception and action alignment, and natural operator mobility, making such demonstrations difficult to collect. We introduce HALO, a human-aligned data collection system for whole-body mobile manipulation. The system aligns the operator's perception and action space with the robot while preserving direct physical feedback and natural locomotion. Operators guide the robot end-effectors through kinesthetic teaching and move a low-resistance platform without the deployed mobile base while performing bimanual manipulation. This interface enables more natural whole-body demonstrations, but the close human-robot coupling introduces discrepancies between the demonstration and deployment settings. We address these discrepancies with deployment-aligned demonstration processing, which calibrates and temporally aligns platform motion with the deployed base response and masks and inpaints demonstrator hands in recorded observations. Compared with Mobile ALOHA and VR teleoperation, HALO enables up to 2.9x faster demonstration collection while maintaining comparable or higher success rates. Policies trained with HALO perform precise manipulation tasks, including zip-tie fastening, and achieve a 73.3% success rate on a six-stage long-horizon mobile manipulation task involving repeated coordinated base and arm motion. Project page: https://robbyant-research.github.io/Lingbot-ALOHA/

Yuki Kadokawa, Ritsuki Matsunaga, Yuqi Yang, Edgar Anarossi, Takamitsu Matsubara
总结: 混合地形建模让坍塌反应撤退策略能省内存并行学习。
方法: 非坍塌地形用刚体仿真,坍塌区以虚拟接触力代替。
证据: 以坍塌引起的接触响应替代刚体坍塌,降低并行采样内存。
为什么适合我: 关系到足式机器人在不稳定地形上的反应式运动学习。
推荐理由: 地形塌陷下的并行强化学习与接触撤退,只弱相关于地形感知运动,未体现人形/足式全身跟踪或操作。
原摘要

At disaster sites and on unstable slopes, robot contact can collapse uninspected terrain, requiring retreat upon support loss. Massively parallel reinforcement learning of collapse-reactive retreat requires independent state--action experiences. However, on shared rigid-body collapsible terrain, one robot's collapse alters others' contacts without direct interaction. We call this indirect interference. Duplicating terrain objects prevents this but is memory-intensive, limiting parallel sampling. Our key insight is that policy learning does not necessarily require rigid-body collapse modeling, which is feasible but computationally expensive; collapse-induced contact responses can suffice. We therefore propose a memory-efficient parallel policy-learning framework for collapse-reactive retreat via hybrid terrain modeling. Hybrid terrain modeling combines rigid-body simulation of non-collapsible terrain with virtual contact forces for collapsible regions. A State-Multiplexed Contact Model shares terrain geometry and a contact-response law while maintaining environment-specific collapse states, enabling independent experiences without terrain objects for collapsible regions. The framework trains a proprioceptive policy for both normal locomotion and collapse-reactive retreat. It supports over 100 times as many parallel environments as fine-resolution rigid-block terrain within the same GPU memory limit. This scalability and improved sample efficiency enable over 50 times faster policy convergence with comparable retreat performance. Sim-to-sim and real-robot experiments demonstrate retreat under multiple collapse conditions. A supplementary video is available at: https://youtu.be/_RrhwjzEPE0

Xiangyi Jia, Kaixian Qu, Shengzhi Wang, ... , Robert Katzschmann, Marco Hutter
总结: 从短时视觉遥操作历史推断原子动作及其所属任务意图。
方法: 汇总多机遥操作数据并微调视觉语言模型做分层意图预测。
证据: 未微调大模型相似度偏低,微调后的模型提高两项分数。
为什么适合我: 辅助遥操作意图理解,而非直接的全身控制或运动跟踪。
推荐理由: 研究视觉遥操作历史中的操作者意图识别,属于遥操作周边,但不是人形控制、跟踪或重定向本身。
原摘要

Vision-language models (VLMs) have become a powerful foundation for robotic scene understanding, task planning, and language-conditioned control. A natural question follows: can these models also decode what a human operator intends while teleoperating a robot, without any explicit instruction? We formulate this as hierarchical intent prediction, jointly inferring the ongoing atomic action and the broader mission it serves from a short visual teleoperation history. To study this, we introduce VI AMO (Vision Intention Action and Mission Ongoing), a dataset of 6,600 episodes from eleven robot sources with 13,653 temporally aligned action annotations and 9,702 mission annotations. Large proprietary models struggle with this problem: on held-out episodes, GPT-4o reaches Sentence-BERT similarities of only 0.563 and 0.470 for action and mission, and GPT-5.6 Luna achieves only 0.581 and 0.554. Fine-tuning a VLM on VI AMO yields our Vision-Intention Model (VIM), which raises these scores to 0.825 and 0.821 and still reaches 0.726 and 0.717 on the 35.4% of test actions with both labels absent from training. Finally, as a downstream application, VIM's predicted mission enables a vision-language-action (VLA) policy to take over from the operator mid-task in a real-world environment unseen during VIM fine-tuning, reducing human teleoperation time by 34.6% relative to GPT-4o and 39.8% relative to GPT-5.6 Luna, while cutting intent-prediction latency by roughly 70% on average.