Papers for 2026-10-22

10 papers
Qiayuan Liao, Yiyang Shao, Junfeng Long, ... , Pieter Abbeel, Koushil Sreenath
总结: 用单一可微世界模型高效扩展人形全身跟踪。
方法: 拟合共享动力学世界模型,与策略联合经想象轨迹反向传播。
证据: 单GPU三小时超多GPU多日SOTA,GPU时减超千倍,失败极少。
为什么适合我: 高效大规模人体动作转可跟踪全身控制,契合模仿强化学习。
推荐理由: 直接对应人形全身控制与运动跟踪:用可微世界模型摊销大规模人体动作跟踪,替代逐动作专家蒸馏或蛮力强化学习。
原摘要

Tracking large human-motion datasets has become the dominant route to general, expressive humanoid whole-body control, but scaling across many motions is expensive. Current pipelines use model-free reinforcement learning, either merging per-motion specialists through lossy distillation, or brute-forcing a single policy with cluster-scale compute. SuperMimic amortizes learning across all motions with one differentiable world model of their shared dynamics, fit from logged transitions of a standard rigid-body simulator. The world model and the tracking policy train together in one loop, and backpropagation-through-time over short imagined rollouts gives the policy analytic gradients. Fast imagined rollouts and analytic gradients make policy learning efficient. In 3 hours on a single GPU, SuperMimic surpasses the return of a state-of-the-art motion tracker baseline trained for 7 days on 128 GPUs. It reduces GPU-hours by more than $1000\times$ and fails on only 25 of 129,514 benchmark motions, versus 179 failures for the baseline. After 9.8 hours on two GPUs, SuperMimic achieves zero failures. From 1 to 264 hours of motion, the world model's prediction error stays stable, and GPU-hours to a target return grow slowly. Our policy transfers to a physical Unitree G1 across diverse and acrobatic motions. SuperMimic removes compute as the bottleneck to scaling humanoid whole-body control, making it practical to measure motion-tracking scaling laws.

Yuto Shibata, Kotaro Amaya, Kashu Yamazaki, ... , Mariko Isogawa, Katerina Fragkiadaki
总结: 从人人演示学可部署人形人交互策略处理遮挡。
方法: VLM引导接触建模重定向,保留语义结构训练特权策略。
证据: 语义接触作监督信号连接演示处理学习与机载控制。
为什么适合我: 处理接触丰富人机交互遮挡,契合全身感知运动控制。
推荐理由: 高度契合接触丰富的人形交互与人体动作重定向:用接触结构把人-人示范重定向为可部署的人形-人交互策略。
原摘要

Humanoid-human interaction requires robots to operate under severe partial observability: during close physical contact, the human partner is occluded, truncated, or outside the robot's field of view, causing pose estimation to fail and often necessitating external tracking or privileged human state. At the same time, heavy mutual occlusions introduce errors into the human-human motion-capture data used for learning. We present REACT, a framework for learning deployable humanoid-human interaction policies from human-human demonstrations. REACT treats semantic contact structure as the key supervisory signal connecting demonstration processing, interaction learning, and onboard control. First, a VLM-guided contact modeling and retargeting pipeline identifies semantically meaningful contacts and transfers them onto humanoid-human geometry while preserving interaction structure. Using these annotations, privileged interaction policies learn physically grounded behaviors through interaction-aware contact rewards and are then distilled into deployable egocentric depth policies trained entirely from onboard sensing using photorealistic human depth rendering. To address severe partial observability, we introduce generative partner-state modeling objectives that predict partner motion from occluded egocentric views. We evaluate REACT in simulation and on a real Unitree G1 humanoid across five contact-rich interactions. Semantic contact modeling substantially improves preservation of demonstrated interactions, while generative partner-state modeling improves contact recall on four of five interactions, most under heavy occlusion. On real hardware, REACT performs all five interactions using onboard sensing alone.

Fast Motion Retargeting Pipeline for Scalable Humanoid Robot Learning

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
Daniel Marew, Sangjun Park, Nisal Perera, Donghyun Kim
总结: 快速可扩展运动重定向管道用于人形学习。
方法: 约束运动学重定向加动力学验证,SQP求解并行处理。
证据: 速度远超现有方法,减少穿透自碰撞等伪影。
为什么适合我: 高效人体动作重定向人形,支持可跟踪可上真机控制。
推荐理由: 核心就是可扩展人形动作重定向:快速约束运动学重定向加动力学验证,直接服务大规模人形模仿学习。
原摘要

While large-scale human motion capture datasets provide a rich source of demonstrations for humanoid robot learning, retargeting the diverse motions to different humanoid robots remains a nontrivial challenge. Existing kinodynamic trajectory optimization pipelines are computationally expensive and often require manual adjustments per motion. We present FRDV (Fast Retargeting with Dynamics Validation), a scalable framework consisting of rapid constrained kinematic retargeting and an additional dynamics validation pipeline. Its kinematic stage integrates a custom Sequential Quadratic Programming solver, Real-Time Iteration, and parallel chunk-based processing, achieving up to 9,156 frames per second, approximately up to 136 times faster than GMR and ProtoMotions, while robot-specific constraints are incorporated into the optimization to reduce common retargeting artifacts, such as ground penetration and self-collision. For motions requiring additional verification, a contact implicit iLQR controller is utilized to test the retargeted reference under full rigid body dynamics. This dynamics-based validation identifies dynamically infeasible motions and refines contact-related artifacts such as foot floating and foot skating. We evaluate retargeting quality by training motion tracking reinforcement learning policies using several state-of-the-art pipelines and comparing their tracking fidelity and success rates. Furthermore, sim-to-real transfer is demonstrated on a Unitree G1 humanoid. Videos and code are available at: https://daroslab.github.io/frdv/.

Antonio Langella, Giovanni Minelli, Giovanni B. Dessy, ... , Victor Barasuol, Claudio Semini
总结: 单操作者双边遥操作框架采集loco-manipulation数据。
方法: 领导臂与手柄同步控制四足基座姿态臂与夹爪。
证据: 直接捕获平台命令本体感觉与机载观测,无传感器估力。
为什么适合我: 支持接触丰富loco-manipulation演示,利于真机策略学习。
推荐理由: 贴近腿足 loco-manipulation 与遥操作数据采集:单人双边遥操作同时采集机体与机械臂协同示范,虽平台是四足而非人形。
原摘要

Learning loco-manipulation policies requires demonstrations that capture coordinated base and arm motion on the target embodiment. Robot-free interfaces allow demonstrations to be collected independently of the target robot, increasing flexibility but without directly capturing platform-specific commands, proprioception, and body-mounted observations. On-robot teleoperation allows to capture these signals directly, but requires an interface capable of commanding the complete system concurrently. This paper presents LocoPilot, a single-operator bilateral teleoperation and data-collection framework implemented on a 12-DoF Unitree Go2 quadruped equipped with a 6-DoF AgileX Piper L manipulator, an Intel RealSense D435 wrist camera, and an Intel RealSense D405 head camera. A second 6-DoF Piper L arm, used as the leader and two handheld controllers provide simultaneous control of the base, body posture, manipulator, and gripper. The follower arm interaction forces are estimated without a dedicated force/torque sensor and rendered to the operator through a passivity-constrained haptic channel. A ROS~2 pipeline records synchronized multimodal observations together with a unified 11D action shared by teleoperation and policy deployment. Compared to prior work, LocoPilot uniquely unifies robot-in-the-loop legged data collection, force feedback without motion-capture instrumentation, and the same action interface at deployment. We evaluate the interface across multiple loco-manipulation tasks and validate the complete collection-to-deployment pipeline by fine-tuning MolmoAct2 \cite{MOLMO} on pick-and-place demonstrations and deploying on the physical robot without action retargeting or additional inverse kinematics. Code available at: https://github.com/iit-DLSLab/LocoPilot

Chaitanya Chawla, Kartik Sharma, Ananya Bal, Laszlo A. Jeni, Guanya Shi
总结: 具身感知生成手物交互用于人形灵巧操作。
方法: 流匹配生成器采样环嵌入可微IK反馈梯度优化。
证据: 生成时约束可达性保持接触,改善后续策略学习。
为什么适合我: 人体HOI转人形可行运动,支持接触丰富灵巧操控。
推荐理由: 贴近人形接触交互与重定向:在生成手-物轨迹时嵌入目标人形可达性,缓解事后重定向丢接触的问题,但偏灵巧手而非全身运动。
原摘要

Humanoid dexterous manipulation needs reference motions that are both semantically rich and kinematically feasible for the target robot. Text-conditioned hand-object interaction (HOI) generators supply diverse, language-specified demonstrations, but they synthesize motion in human (MANO) space. The embodiment gap is therefore deferred to post-hoc retargeting, where trajectories deployed on the robot can fail to maintain contact with objects and also degrade policy learning. Our key idea is that robot reachability should constrain the interaction trajectories while they are being generated. We present EmbodyHOI, which runs a differentiable inverse-kinematics (IK) solver for a specific humanoid embodiment inside the sampling loop of a frozen flow-matching HOI trajectory generator. We feed back gradients from the embodiment-aware IK solver into the HOI sampler and jointly optimize the position of the humanoid with respect to the object. Because guidance acts only at inference, one HOI trajectory generator trained on human hand poses transfers across humanoid embodiments without retraining. On ARCTIC trajectories with two contrasting humanoids (Unitree G1 and H1-2), our proposed guidance-based method cuts the retargeted wrist error from 8.9 cm to 0.6 cm while leaving text-to-HOI generation quality intact, and raises task success from 68% to 79% on 50 random G1 tasks and from 62% to 76% on a four-task H1-2 suite. Critically, cheaper alternatives for bridging the embodiment gap fail to beat EmbodyHOI. Post-hoc wrist refinement and compute-matched best-of-N selection both reach lower IK energy than our guidance yet train worse policies. For simulation results, see our website: https://embodyhoi.github.io/

Zijian Ge
总结: 姿态感知导航框架助双足穿越窄道社交避让。
方法: 自适应穿越管区间速度航向控制与侧步AMP先验。
证据: 统一几何社交信号,改善过渡稳定性可换默认策略。
为什么适合我: 复杂地形导航全身姿态控制,契合腿足运动智能。
推荐理由: 对应双足人形全身运动与对抗运动先验:姿态感知通行结合侧移增强的 AMP 运动策略,虽更偏导航而非跑酷。
原摘要

Bipedal humanoids can change their effective footprint by adjusting body yaw, enabling both narrow-passage traversal and socially aware yielding. This paper presents a posture-aware navigation framework centered on \emph{Adaptive Traversal Tubes} (ATT), \emph{Interval Velocity--Heading} (IVH) control, and a sidestep-enhanced AMP locomotion prior. ATT represents a behavior-feasible corridor width field along a reference path, unifying geometric clearance and social comfort into a continuous signal. IVH maps this width to a continuous frontal-to-sidestep posture schedule and omnidirectional velocity commands. A velocity-conditioned AMP policy, trained with GVHMR-retargeted frontal/sidestep motions and coupled \((v_x,v_y)\) tracking rewards, is designed to improve transition stability over a generic locomotion controller while remaining interchangeable with the default onboard policy. This preprint presents the full method; a planned evaluation protocol on a Unitree G1 is outlined, with quantitative results to follow. Demo videos of MuJoCo simulation and real-robot deployment are available at: github.com/lborogzj997/Humanoid-Navigation-in-Crowds-and-Narrow-Spaces.

Till Hielscher, Kai O. Arras
总结: 学习调制表达交互运动的稳定跟踪控制。
方法: 参数化表达合成物理控制与空间目标反应适配。
证据: 参考条件跟踪跨表达域保持稳定,轻量策略调制目标。
为什么适合我: 全身表达运动稳定跟踪,支持人机交互loco控制。
推荐理由: 贴近物理角色控制与运动跟踪:在不稳定平台上用参考条件跟踪策略稳定执行可调制的表现性、交互式全身动作。
原摘要

Expressive robot motion can improve naturalness, effectiveness, and perceived likability in human-robot interaction. When deployed on dynamically unstable platforms, however, reactive execution of expressive body motion may bring the robot to its stability limits, especially when expressivity is decoupled from physical control. In this paper, we present RoboMMT (Robot Modulated Motion Tracking), a modular control architecture that couples parameterized expressive motion synthesis, physics-based character control, and reactive adaptation to spatial interaction goals. Our approach trains a reference-conditioned tracking policy across a broad domain of expressivity, enabling it to faithfully realize the commanded motions while maintaining dynamic stability. Goal reactivity is achieved by training lightweight, task-specific interaction policies that modulate the reference generator's spatial goal-attraction point, with the stabilizing tracking policy kept in the loop. Evaluations on a quadruped and two humanoid robots show that the learned tracker remains stable and accurate across the entire modulation domain, whereas trackers trained without this coverage lose balance, tracking accuracy, or both. We show that layering closed-loop goal adaptation over this foundation enables interactive facing and pointing behaviors, while maintaining stable execution and comparable reference-tracking fidelity. The robot learns to proactively redistribute its weight and take corrective steps. Zero-shot sim-to-real transfer is demonstrated through real-robot experiments on a quadruped under heavy disturbances.

Weakly Supervised Discovery of Motion Styles for Compositional Robot Control

3.0/5 一般 裁判分 5.0 Candidate 当日相对
Heedo Woo, Antonio Marino, Eduardo Sebastián, Amanda Prorok
总结: 弱监督发现运动风格实现组合机器人控制。
方法: 重定向后共识编码密度聚类发现风格,RL组合训练。
证据: 四足仿真真机评估显著优于基线。
为什么适合我: 人体动作风格发现组合,支持可重定向全身控制。
推荐理由: 有动作重定向、风格发现和强化学习组合控制,但对象是 Go2 的运动风格而非人形全身跟踪、跑酷或 loco-manipulation。
原摘要

When a robot possesses more degrees of freedom than a task requires, multiple trajectories can achieve the same objective using distinct motion styles. Compositional robot control aims to preserve a selected style while simultaneously executing an independent task command, effectively balancing these potentially competing objectives. In this paper, we present CODES, a framework for compositional robot control that discovers a coherent style repertoire from diverse recordings and composes it with independent commands. First, motion retargeting maps the recordings to motions executable by the target robot; next, weakly supervised consensus encoding and density-based clustering identify styles within and across recordings without a prescribed count; finally, reinforcement learning trains a policy to compose the discovered styles with independent commands. We evaluate CODES on a Unitree Go2 quadruped across two simulators and physical hardware. Compared to baselines, CODES significantly improves kinematic coherence. Furthermore, our controller successfully tracks velocity commands that generalize beyond the support of the recorded data, exhibiting robust and distinguishable style characteristics during both cross-simulator and real-world hardware deployments. Project website: https://www.proroklab.org/compositional-motion-styles/

Learning Adaptable Dexterous Skills via Hybrid Dexterous Mimicking

3.0/5 一般 裁判分 4.0 Candidate 当日相对
Yuxuan Kuang, Jiashun Wang, Yixuan Sun, ... , Katerina Fragkiadaki, Shubham Tulsiani
总结: 混合灵巧模仿学可适应多指灵巧技能。
方法: 目标条件RL共享策略在跟踪与泛化环境并行训练。
证据: 从短轨迹学得可适应技能,平衡先验与泛化。
为什么适合我: 手物交互灵巧技能,支持接触丰富操作模仿学习。
推荐理由: 混合模仿把短时手-物轨迹变成可泛化灵巧技能,方法接近模仿学习,但只覆盖多指手而非全身/腿足运动智能。
原摘要

Dexterous multi-finger hands hold promise to unlock diverse skills like functional grasps, in-hand reorientation, and dynamic handover that the human-designed world assumes, yet existing learning recipes force a trade-off. Goal-reaching reinforcement learning generalizes to arbitrary object poses but, lacking any human prior, converges to unnatural and unreliable finger strategies; motion tracking reproduces human-like behavior from a single clip but cannot deviate from it. We present AdaDex, a goal-conditioned RL framework that turns a single hand-object trajectory of a few seconds---from mocap data or HOI reconstruction from in-the-wild RGB(D) video---into an adaptable dexterous skill. At the core of AdaDex is Hybrid Dexterous Mimicking: a shared policy is trained on two populations of massively parallel environments: motion tracking environments trained with dense motion tracking objective, which instill the human prior from human motion; and generalization environments with noised initial states and goals and a sparse object-success reward, which force the skill to work far off the reference. From seconds of human motion per skill, the resulting policies can learn diverse adaptable dexterous skills, such as functional grasping, object reposing, in-hand reorientation with finger gaiting, and dynamic behaviors like throw-and-catch. Our method outperforms baselines in terms of generalization and functionality, and we demonstrate transfer across simulators and to the real world. Project page: https://yuxuank.com/AdaDex/.

AgenticRoboRL: Bringing Coding-Agent Post-Training to Agentic Robotics

2.0/5 偏低 裁判分 5.0 Candidate 当日相对
Xinxin Liu, Bingxin Xu, Wenrui Bao, ... , Chen Chen, Yuzhang Shang
总结: 将编码代理后训练引入代理机器人规划器。
方法: 监督微调加多轮RL,适配器连接不同执行机制。
证据: 跨框架后训练规划器提升复杂任务能力。
为什么适合我: 辅助loco-manipulation复杂任务智能规划控制。
推荐理由: 是编码智能体式机器人规划器后训练,面向通用操作 harness,不涉及人形/腿足全身运动控制。
原摘要

Agentic robotics systems combine planners with robot harnesses to perform complex manipulation tasks. Recent work improves these systems through better harnesses and external memory, but relies on powerful closed-source models as planners and does not improve the planners' own capabilities. In contrast, coding agents have improved substantially by post-training the model itself. We therefore investigate whether post-training can also improve robot planners. However, applying it across robot harnesses requires accommodating different execution mechanisms, including VLA skill invocation and control-code generation. To this end, we introduce AgenticRoboRL, a framework for post-training robot planners across different harnesses. The training recipe combines supervised fine-tuning with multi-turn reinforcement learning. To accommodate different execution mechanisms, harness-specific adapters connect recorded planner interactions with task outcomes, enabling a common RL training pipeline while keeping execution components fixed. On LIBERO-PRO, AgenticRoboRL raises the success rate of a 9B-parameter planner from 18.1% to 71.0% without external memory, approaching the 72.1% achieved by Codex (GPT-5.5) with external memory. These results demonstrate post-training as an effective approach for improving robot planners. We will release the framework and trained planner checkpoints.