Papers for 2026-10-28

10 papers

Motion Retargeting with Spatiotemporal Preferences for Humanoid Loco-Manipulation

5.0/5 很相关 裁判分 10.0 Top pick 当日相对
Xiongbo Shi, Shihang Du, Zongyou Yu, ... , Junqiao Zhao, Guang Chen
总结: 时空重定向优化人形loco-manipulation关键接触关系保持。
方法: VLM选信号与部位识别关键帧分配迭代权重并加力学接触锚定。
证据: 关键帧与部位优化提升重定向效率与接触保真度。
为什么适合我: 直接服务人体动作重定向为可跟踪可上真机全身控制。
推荐理由: 直接做人形 loco-manipulation 的人体动作重定向,用时空关键帧保住身体-物体关系,紧贴全身跟踪与场景交互。
原摘要

Human motion retargeting bridges the embodiment gap between humans and humanoid robots by converting human demonstrations into reference trajectories for whole-body control and loco-manipulation. For object-interaction tasks, successful execution depends on accurately preserving body--object relations at critical stages. However, uniform per-frame iteration budgets do not account for these localized accuracy requirements, limiting the computational efficiency of retargeting. To address this limitation, we present Spatiotemporal Retargeting (STR), which uses keyframes and key body parts to allocate optimization effort. Specifically, a vision-language model selects relevant motion signals and body parts, and keyframes are identified from changes in the selected signals. Based on these selections, STR assigns additional solver iterations to keyframes and higher interaction weights to the selected parts. To further improve contact fidelity, we introduce Mechanics-Aware Contact Anchoring (MCA) to refine object-surface contact positions using an approximate object-wrench model while retaining the selected surface directions. Building on the resulting references, we develop Spatiotemporal Reinforcement Learning (STRL), which combines adaptive key-stage sampling with a contact-position reward based on target proximity for downstream control. Simulation experiments on a Unitree G1 and real-world experiments on a Unitree R1 demonstrate that STR improves geometric contact coverage and continuity at lower computational cost, while the resulting references improve downstream task completion across diverse object-interaction motions.

Zero-HLM: Generalizable Humanoid Loco-Manipulation without Real Robot Data

5.0/5 很相关 裁判分 10.0 Top pick 当日相对
Dianyi Yang, Mengya Liu, Zhumei Wang, ... , Baoxiong Jia, Siyuan Huang
总结: 零样本人形loco-manipulation框架无需真机数据实现泛化。
方法: 高斯引导实到仿重建与运动环境共适应生成物理验证演示。
证据: 生成4800演示零样本成功率66.7%优于真机46.7%泛化达69%。
为什么适合我: 打通仿真到真机支持全身loco-manipulation泛化控制。
推荐理由: 无真机示范的人形 loco-manipulation,含全身参考修正与 G1 sim-to-real,完全落在全身场景交互与迁移主线。
原摘要

Learning generalizable humanoid loco-manipulation remains bottlenecked by costly real-world demonstrations. Simulation provides a scalable alternative, but requires visually faithful, physics-ready scenes and executable whole-body motions. We present Zero-HLM, a real-to-sim-to-real framework that transforms smartphone captures and simulated source demonstrations into scalable training data for humanoid loco-manipulation. Gaussian-guided agentic real-to-sim reconstruction aligns visual and physical scenes; motion-environment co-adaptation uses rollout feedback to correct whole-body references and interaction geometry. We generate 4,800 physically validated demonstrations for zero-shot transfer across three Unitree G1 tasks. Simulation-trained GR00T N1.7 achieves 66.7% mean full-task success, versus 46.7% with real-data training. On generalized configurations, expanded simulation training raises pooled success from 23% for base-trained real-data policies to 69%, without additional real demonstrations. Project page: https://young-bit.github.io/zero-hlm/

MOTIO: Agentic Skill Engineering for Reality-Grounded Humanoid Loco-Manipulation

5.0/5 很相关 裁判分 10.0 Top pick 当日相对
SpatialtemporalAI
总结: 代理技能工程从人类视频生成可执行人形loco-manipulation程序。
方法: 上下文任务接触推理构建交互并用物理反馈人类验证改进。
证据: 33次批准中位代理97分钟请求批准2.8小时真机101.75秒执行。
为什么适合我: 将人体动作转为可重定向可上真机的全身loco-manipulation。
推荐理由: 把人体动作视频变成可执行的人形 loco-manipulation 程序,并调用全身与逆运动学接口,对应动作重定向与场景交互。
原摘要

We present MOTIO, an agentic skill-engineering system that turns ordinary human-action videos, reality-grounded 3D assets, motion references, and reusable robot skills into executable humanoid loco-manipulation programs. Through in-context task and contact reasoning, an agent constructs staged robot-native interactions and improves them using physics execution, multi-frame feedback, and human validation---without task-specific teleoperation or robot demonstration collection. Agentic 3D supplies metric product and environment assets, while existing whole-body, inverse-kinematics, and dexterous-hand interfaces realize the programs. Across 33 timestamped first approvals, the median recorded agent-turn time is 97.0 minutes and request-to-approval duration is 2.80 hours. Simulation-side layout and object variation prepare a long-horizon bottle-disposal skill for a continuous 101.75-second physical G1 execution in a scanned office; physical refinement reduces screw-tightening thread residual by 76.0%. Agent-generated skills additionally supervise BC/DAgger distillation into one shared reference policy, completing 18 simulated tasks under the same checkpoint without inference-time expert intervention. Project page: https://iiiiqiiii.github.io/motio/

Learning Force-Reactive Humanoid Loco-Manipulation

5.0/5 很相关 裁判分 10.0 Top pick 当日相对
Sihang Li, Xiaofeng Guo, Jinkun Cao, ... , Guanya Shi, Haozhi Qi
总结: 力反应框架学习人形loco-manipulation双手与全身力协调。
方法: 力传感夹具采集演示扩散策略预测动作力指令混合柔顺控制。
证据: 仿真控制器跟踪多样每手力指令并保持平衡。
为什么适合我: 强化接触丰富场景下力感知运动与全身控制。
推荐理由: 力反应式人形 loco-manipulation:扩散策略、柔顺全身力跟踪,以及手持力觉与身体运动采集,契合接触丰富全身操作。
原摘要

Many everyday tasks require controlling contact force as well as motion. On a humanoid, this force must often be coordinated across both hands and the whole body, and cannot be specified by kinematic trajectories alone. Therefore, we present FLORE, a framework for learning force-reactive humanoid loco-manipulation. We collect robot-free demonstrations using two force-sensing UMI-style handheld grippers for hand motion and contact wrenches, and wearable trackers for body motion. A force-reactive diffusion policy takes vision, proprioception, and measured wrenches as input, then predicts actions and per-hand force commands. A hybrid compliance whole-body controller with force tracking executes these commands while maintaining balance: an integral of the force error measured by real force/torque (F/T) sensors lets each hand track force accurately along the commanded direction and remain compliant along the others. In simulation, the controller tracks per-hand force commands of varied magnitude and direction, with little loss in whole-body motion accuracy. Across three contact-rich tasks on the robot, the force-reactive policy succeeds in 80% of rollouts, compared with 26.7% for a position-only policy trained on the same demonstrations and executed by the same controller. For more details, please visit our website: https://louis-leee.github.io/FLoRe/.

Jia Li, Lingyun Xu, Yitang Li, Hao Zhao
总结: 结构化具身条件实现跨异质人形共享全身运动跟踪。
方法: 具身描述编码条件结合历史参考预测偏移并物理随机化训练。
证据: 训练4096变体16家族基准464身体评估泛化迁移。
为什么适合我: 支持人体动作重定向跟踪到不同人形全身控制。
推荐理由: 跨人形形态的共享全身运动跟踪与身体标定重定向,强化学习直接对应全身控制与运动跟踪。
原摘要

Humanoid motion trackers reproduce diverse behaviors, but sharing a policy across bodies requires accounting for differences in structure, morphology and dynamics. We present MimicAll, a reinforcement-learning framework for shared whole-body motion tracking across heterogeneous humanoids. A structured embodiment descriptor is encoded into global and joint-aligned conditions, which are combined with observation history and body-matched motion references to predict joint-target offsets. Physics-consistent embodiment randomization, body-calibrated retargeting and heterogeneous simulation support training across 4,096 variants from 16 humanoid families. We introduce a benchmark of 464 bodies across five distribution strata to evaluate motion generalization, within-family embodiment shifts and unseen-family transfer. Controlled ablations show that embodiment information improves motion completion with simple concatenation, while self-attention yields the lowest global position errors. With equal training transitions, shared training achieves 99.4% 30-second success on randomized G1 bodies in 100STYLE, versus 42.9% for a single-body specialist. With Flat-MLP encoding and concatenation, continued training on a motion subset excluding obstacle categories achieves 98.3% and 93.5% 30-second success on 100STYLE for sampled training bodies and out-of-distribution variants within seen families, respectively. On an eight-motion LAFAN1 subset excluding ground and get-up sequences across 464 bodies, mismatched body conditions reduce self-attention's 30-second success from 61.7% to 47.0%, demonstrating a closed-loop benefit from embodiment information.

Chao Chen, Zhenrong Wang, Jilong Wang, ... , Li Yi, He Wang
总结: 神经动力学模型在线微调弥合人形运动跟踪训练部署差距。
方法: 低频参考扰动采集数据训练历史本体感觉神经动力学模型。
证据: 有效利用真机数据微调策略应对动力学差距。
为什么适合我: 提升人体动作跟踪策略真机复杂场景鲁棒部署。
推荐理由: 用真机神经动力学模型在线微调人形运动跟踪,专门缩小训练到部署的动力学差距,属于全身跟踪与 sim-to-real。
原摘要

Humanoid robots have recently achieved remarkable success in motion tracking. However, during real-world deployment, robots inevitably encounter dynamics gaps arising from either extra physical disturbances or inaccurate simulation modeling, resulting in a significant training-deployment gap. Therefore, effectively leveraging real-world data to fine-tune policies represents the crucial last mile for robust deployment. To bridge this gap, we propose HumanoidNDM, an online fine-tuning framework for humanoid motion tracking driven by a real-world-trained neural dynamics model. First, in the data collection stage, we introduce a low-frequency reference perturbation method with an adaptive intensity mechanism, balancing deployment feasibility and exploration efficiency. Second, for the model training stage, we train a robust history-based, proprioceptive neural dynamics model in Euclidean space by incorporating differentiable forward kinematics, eliminating the reliance on costly motion capture systems. Finally, in the policy fine-tuning stage, we directly fine-tune the policy via backpropagated model gradients, achieving high data efficiency. Through physical validation on the Unitree G1 robot, we demonstrate that HumanoidNDM enables rapid real-world adaptation to various perturbations, representing the first online, MoCap-free fine-tuning framework for humanoid tracking policies.

Yang Liu, Jiacheng Liu, Hengtao Li, ... , Lixin Yang, Donglin Wang
总结: 自我中心经验扩展人形通用视觉语言动作模型。
方法: 三阶段训练预测潜在运动令牌手控信号并构建伪本体感觉。
证据: 预训练超2000小时自我中心人类与机器人数据。
为什么适合我: 连接模仿学习与全身控制实现人形loco-manipulation。
推荐理由: 用自我中心人体与机器人经验训练人形通用策略,预测运动令牌驱动预训练全身控制器,契合模仿与全身控制。
原摘要

Extending Vision-Language-Action models (VLAs) to humanoid robots requires coordinated whole-body control and diverse demonstrations that are costly to collect in real-world scenarios. Although egocentric human demonstrations provide a complementary source of task experience, differences in visual embodiment and missing robot proprioception complicate transfer to humanoid policies. To address these challenges, we introduce HuGe, a family of Humanoid Generalist VLAs pre-trained on over 2,000 hours of egocentric human and robot data. Specifically, HuGe employs three existing representative VLA architectures to predict latent motion tokens for a pretrained whole-body controller, together with hand-control signals. Based on this, we introduce a three-stage training pipeline that combines egocentric pre-training, humanoid adaptation, and downstream fine-tuning. To facilitate transfer across embodiments, we construct pseudo-proprioceptive states through simulation playback during pre-training and modify arm appearance in egocentric observations through re-rendering during downstream fine-tuning. With this pipeline, HuGe achieves the state-of-the-art on simulation benchmark HumanoidArena. Furthermore, real-world experiments on the Unitree G1 indicate that augmenting robot demonstrations with visually adapted egocentric demonstrations significantly increases success on a pick-and-drop task.

Nuo Chen, Shizeng Zhang, Yujie Yang, ... , Xueyi Zhang, Jiangwei Zhong
总结: 代理框架以交错推理行动处理腿足loco-manipulation长时任务。
方法: 编排感知导航操作运动工具并显式将运动纳入推理执行域。
证据: 支持复杂长时程任务的泛化与错误恢复。
为什么适合我: 契合复杂地形接触丰富场景下感知运动与loco-manipulation。
推荐理由: 任务是腿足全身 loco-manipulation,但贡献是推理-行动智能体编排感知、导航与操作工具,不是模仿学习或全身运动跟踪本身。
原摘要

In this paper, we propose ThinkLocoManip, an agentic harness for legged loco-manipulation designed to tackle complex, long-horizon tasks in large-scale environments. Existing approaches typically follow either direct action generation or a plan-then-act paradigm, both of which can struggle with the generalization and error-recovery capabilities required for extended task execution. In contrast, ThinkLocoManip adopts an interleaved reasoning-and-acting paradigm, allowing the agent to continuously reason about its current state, execute actions, observe their outcomes, and adapt its strategy accordingly. Building on this paradigm, our agentic harness orchestrates a suite of specialized tools for perception, navigation, manipulation, and locomotion, enabling flexible composition of heterogeneous capabilities. Unlike existing robotic agentic harnesses, ThinkLocoManip explicitly incorporates locomotion as a tool domain for agent reasoning and execution. We further design a set of skills that explicitly account for both tool usage within each functional domain and coordination across domains, supporting effective execution of complex behaviors over long horizons. To tackle task failure during long-horizon interactions, we develop keyframe thinking mechanism to preserve critical execution context and support efficient error recovery. Extensive real-world experiments demonstrate that ThinkLocoManip substantially outperforms representative methods based on both direct action generation and plan-then-act paradigms across challenging long-horizon legged loco-manipulation tasks. Notably, ThinkLocoManip achieves a success rate of 77%, more than twice that of the strongest plan-then-act baseline (37.1%). Our experiments further validate the effectiveness of interleaved reasoning and acting, tool orchestration, and coordinated skill execution.

Gijeong Kim, Seungbin Oh, Dongyun Kang, Hae-Won Park
总结: 可微接触动力学梯度用于腿足策略学习与轨迹优化。
方法: 中心路径松弛摩擦互补提供平滑梯度保持前向硬接触。
证据: 梯度连续穿越接触模式并收敛至精确灵敏度。
为什么适合我: 打通强化学习与接触丰富场景全身模型预测控制。
推荐理由: 腿足摩擦接触的可微动力学,用于策略学习与接触隐式轨迹优化,贴近接触丰富腿足控制,但不是人形跟踪或感知跑酷。
原摘要

This paper proposes a smooth analytic gradient for frictional contact and applies it to policy learning and contact-implicit trajectory optimization for legged locomotion. The exact contact sensitivity is available in closed form but describes changes within the current contact mode, providing no first-order information toward neighboring contact modes. The proposed gradient replaces this sensitivity only in the backward pass, leaving the hard-contact forward solve unchanged and the realized rollout feasible. A central-path relaxation of the de Saxc\'e-corrected second-order-cone complementarity problem for Coulomb friction smooths the conditions defining the separating, clamping, and sliding modes. The relaxed sensitivity is evaluated at a point on the central path obtained by a Newton iteration initialized from the hard-contact solution. The sensitivity remains continuous through contact-mode transitions and converges to the exact sensitivity as the relaxation vanishes. Using 100,000 samples and less than 2 min of training on a desktop PC, policy learning with the proposed gradient produces a policy that transfers to hardware without fine-tuning. On hardware, the robot under a trotting policy withstands pushes and traverses debris and slippery ground. In trajectory optimization, the proposed gradient reaches contact-rich solutions missed by exact and Signorini-relaxed gradients. Project page: https://diffcontact.github.io

Active Reachability Learning for Humanoid Recoverability Monitoring

3.0/5 一般 裁判分 8.0 Strong 当日相对
Zeyuan Feng, Baljeet Singh, Sarthak Ranjeet Kaingade, Somil Bansal, Bryan Trinh
总结: 主动可达性学习监控人形可恢复性预防不可恢复跌倒。
方法: 价值学习与主动探索迭代用不确定性引导避开不可恢复区。
证据: 恢复更多真实可恢复包络减少分布外乐观幻觉。
为什么适合我: 增强复杂地形全身运动智能安全感知与恢复。
推荐理由: 学习人形兜底策略的可恢复性包络以监测跌倒,只旁及全身平衡安全,不是运动生成、跟踪或 loco-manipulation。
原摘要

Deploying humanoid task policies requires reliable runtime monitors that anticipate unrecoverable falls in time to trigger a fallback. We formulate this task as learning the stochastic, finite-horizon recoverability envelope of a given fallback policy. Synthesizing this monitor is challenging: existing methods assume training data naturally covers the recoverability envelope, yet acquiring such data remains a major bottleneck for contact-rich systems. Consequently, they recover only a fraction of the true envelope, leaving them prone to optimistic hallucinations for out-of-distribution (OOD) inputs. We resolve this via a unified framework that iterates between value learning and active exploration. Data exploration is reframed as a reach-avoid problem, where an uncertainty-guided explorer systematically uncovers unseen states while avoiding confidently unrecoverable regions. This loop is further supported by a combined Temporal Difference and Monte Carlo objective for accurate in-distribution value prediction and reliable uncertainty estimation. By explicitly treating the remaining high-uncertainty regions as unrecoverable, the monitor mitigates optimistic OOD hallucinations. Evaluated on stochastic benchmarks and a 29-DoF Unitree G1 humanoid, our approach drastically improves monitor coverage and accuracy and successfully transfers zero-shot to real-world hardware.