Papers for 2026-10-10

10 papers
Puying Shen, Wenhao Cui, Huaxing Huang, ... , Ziyang Dong, Guoteng Zhang
总结: 无感知下实现人形复杂地形稳健自然运动。
方法: RNN推断潜信息结合对抗运动先验的强化学习。
证据: 实现仿真到真机迁移并展示鲁棒泛化。
为什么适合我: 契合复杂地形全身运动与对抗先验方法。
推荐理由: 直接对应人形全身运动与对抗运动先验:无感知复杂地形行走、RNN隐式推断与sim-to-real。
原摘要

Humanoid robots possess the structural capability to traverse complex terrains. However, achieving stable t raversal without relying on perceived information remains challenging, particularly in complex environments. This paper introduces DAMP, a reinforcement learning framework aimed at achieving robust and naturalistic humanoid locomotion over challenging terrains, with the assumption that no perceived information is available. The framework leverages recurrent neural networks to capture temporal dependencies and implicitly infer privileged and other task-relevant latent information. By aligning the learned representations with the task objective, the method enables robust and goal-consistent policy learning. This end-to-end framework achieves transfer learning from simulation to real-world environments, demonstrating the proposed method's robustness and generalization capabilities. The video of the real-world demonstration can be found at the following link: https://youtu.be/AkI7TZB2DDM.

VioLA: Learning Generalist Humanoid Control Policies from Human Data

5.0/5 很相关 裁判分 10.0 Top pick 当日相对
Mert Albaba, Jens Bei{\ss}wenger, Anna Manasyan, ... , Georg Martius, Martin Riedmiller
总结: 从人类数据学习通用人形全身控制策略。
方法: 预测身体手部运动潜变量由预训练控制器执行。
证据: 人类录制直接标注为策略动作空间。
为什么适合我: 将人体动作转为可跟踪可上真机控制。
推荐理由: 直接对应人体动作到人形全身控制:预测身体与手部运动潜变量,并由预训练控制器在机器人上执行。
原摘要

Teaching a humanoid to follow instructions with its whole body runs into two obstacles. Its action space is large and tightly coupled: legs, arms, and fingers must move together while the robot keeps its balance, which makes joint-level actions hard to learn. And humanoid demonstrations are scarce, so current humanoid generalist policies do not follow new instructions out of the box and are fine-tuned on teleoperated demonstrations of each task before deployment. Human demonstrations exist in far larger numbers, but a person's motion is not a robot command. We remove both obstacles by changing what the generalist policy predicts. We introduce VioLA, a generalist humanoid policy that predicts body and hand motion latents instead of joint commands. A pretrained body- and hand-controller execute these latents on the robot. Their corresponding motion encoders map human and robot motion into the same latent spaces. A human recording is therefore labeled in the policy's action space, and the training demonstration pool contains 140.6 million frames, 93.2% of them human. As a result, VioLA follows locomotion instructions on the real robot zero-shot, without task-specific fine-tuning, reaching 100% success where GR00T N1.7 and $\Psi_0$ reach 16.7% and 0%, respectively. It also reaches 88.6% manipulation success without task-specific fine-tuning. The same approach works across two VLA and one world-action model backbones. A generalist policy trained on human demonstrations alone performs locomotion tasks on the real robot zero-shot. Code and checkpoints will be released.

Humanoid World Action Model With Joint State--Action Generation

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
Yan Yang, Jikun Rong, Minzhao Zhu, ... , Zhen Fu, Hua Chen
总结: 联合状态动作生成缩小人形动作执行差距。
方法: 显式生成执行后本体感觉状态的世界动作模型。
证据: 建模实现运动以关联动作与物理结果。
为什么适合我: 支持接触丰富loco-manipulation全身控制。
推荐理由: 直接对应人形loco-manipulation:显式建模参考动作与全身动力学、平衡和接触执行之间的差距。
原摘要

Humanoid robots are a promising platform for general-purpose manipulation. Recent Vision-Language-Action (VLA) policies learn actions directly from multimodal observations, while World Action Models (WAMs) further incorporate future visual prediction to improve action generation. However, in hierarchical humanoid systems, VLA and WAM policies output reference actions that are subsequently realized through whole-body control, robot dynamics, balance, and contact. This hierarchy creates an action--execution gap: the reference produced by the policy can differ from the motion realized by the robot. Without explicitly modeling the realized body state, future visual prediction must jointly explain scene evolution and discrepancies between reference actions and executed motion, making it difficult to associate an action with its physical outcome. We propose HWAM, a Humanoid World Action Model with joint state--action generation, which makes the robot's post-execution proprioceptive state an explicit prediction target. By jointly generating reference actions and their realized body states, HWAM directly incorporates supervision of executed motion into action learning. HWAM is trained through three complementary conditional paths. The Policy path jointly denoises state--action trajectories conditioned only on current observations, matching deployment conditions. Forward Dynamics Modeling (FDM) predicts future visual observations conditioned on actions and post-execution states, while Inverse Dynamics Modeling (IDM) reconstructs the joint trajectory from visual transitions. Together, these paths connect policy references, realized body motion, and visual outcomes. HWAM achieves the highest success rate among evaluated baselines on three real-robot tasks on the LimX OLI humanoid. On Candy Picking, HWAM achieves a 70.6% success rate, compared with 43.3% for Fast-WAM.

Being-M0.7: A Latent World-Action Model for Humanoid Robots

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
Junpeng Yue, Boyuan Li, Yuxuan Wang, ... , Jiangxing Wang, Zongqing Lu
总结: 潜在世界动作模型从人类数据迁移到人形。
方法: 预训练中训后训转移混合模态视觉运动先验。
证据: 联合预测未来视觉状态与运动编码运动学。
为什么适合我: 服务loco-manipulation与人体动作重定向。
推荐理由: 直接对应人形全身loco-manipulation:从大规模人体视频与动作中迁移视觉-运动先验并后训练为可执行控制。
原摘要

Humanoid loco-manipulation requires coordinated locomotion and manipulation informed by future scene evolution and whole-body motion, yet learning these capabilities is constrained by scarce robot demonstrations. Human video and motion datasets offer scalable supervision, but many contain only video or motion rather than paired video-motion data. Moreover, human motion does not directly specify executable robot actions. We present Being-M0.7, a latent world-action model that transfers visual-motion priors learned from mixed-modality human data to humanoid control through pre-training, robot mid-training, and action post-training. We curate a corpus from more than 10,000 hours of raw human-centric data, integrating video-only, motion-only, and paired video-motion streams to learn complementary visual dynamics and whole-body kinematic structure. Joint prediction of future latent visual states and motion encourages visual representations to encode future kinematics. Robot mid-training adapts this coarse-grained prior to robot viewpoints and body dynamics. During action post-training, an action expert combines visual predictive representations from the frozen, adapted prior with current images and proprioception through gated cross-attention, grounding predictive context in executable whole-body commands. Being-M0.7 achieves the highest aggregate success rate among the compared baselines on SIMPLE and matches the strongest baseline on real-world Unitree G1 loco-manipulation tasks.

Generative Neural Retargeting for Human-to-Robot Dexterous Manipulation

4.0/5 相关 裁判分 8.0 Strong 当日相对
Dechen Gao, Yue Yang, Ben Abbatematteo, ... , Sho Nakagome, Eric Whitmire
总结: 生成神经重定向实现人类到机器人灵巧操作。
方法: 从共享低维流形条件采样动态可行轨迹。
证据: 假设可行轨迹集中于演示共享流形。
为什么适合我: 人体动作变成可重定向可上真机控制。
推荐理由: 贴近人体动作重定向:用生成模型学习跨演示的动力学可行流形,并对比IK、RL与MPC。
原摘要

Human demonstrations are a scalable data source for learning dexterous manipulation, but the embodiment gap prevents human motion from being executed directly on robots. Inverse kinematics (IK) retargets human motion to robots efficiently but ignores dynamics, often producing infeasible motions. Reinforcement learning (RL) and sampling-based model predictive control (MPC) are commonly employed to yield dynamically feasible motions, but both are sample-inefficient and sensitive to hyperparameters. RL suffers from costly and unstable training and tedious reward engineering; MPC avoids policy optimization, yet retargets each trajectory in isolation, and solving one does not make the next easier. Sampling cost grows rapidly with dataset size and task difficulty. We hypothesize that dynamically feasible trajectories concentrate near a low-dimensional manifold shared across demonstrations, so that retargeting can be reduced to sampling from that manifold, conditioned on human motion, rather than solving a fresh optimization problem for every demonstration. We propose \textbf{Generative Neural Retargeting} (GNR), which uses a flow matching model to sample feasible trajectories. GNR outperforms MPC with only $8.5\%$ of the samples required by MPC, achieving a success rate of $56.20\%$ compared to $27.20\%$ for MPC. GNR can be used for scalable and efficient retargeting of large-scale, long-horizon, and millimeter precision human demonstrations: by applying GNR within a real-to-sim data engine, we produce a dexterous manipulation dataset with dense contact-force labels, spanning $223$k demonstrations and $3.3$k object geometries.

OmniHOI: Dexterous Hand-Object Interaction from Monocular Human Video

4.0/5 相关 裁判分 6.0 Good 当日相对
Ting Mao, Yanming Shao, Ziheng Wang, ... , Xuanye Wu, Yao Mu
总结: 单目视频转为灵巧手物交互忠实轨迹。
方法: 分阶段用证据优化重建重定向与动力学精炼。
证据: 动捕轨迹转移到多种灵巧手上验证。
为什么适合我: 接触丰富场景人体动作到机器人迁移。
推荐理由: 贴近人体动作重定向:单目手-物体视频经接触几何重定向和物理闭环细化到灵巧手。
原摘要

Monocular videos of human manipulation provide abundant dexterous demonstrations, yet reconstructing hand-object interaction from a single view and transferring it to robot hands remain difficult, limiting their direct use for robot execution. Prior methods either require task-specific RL training, limiting scalability, or assume clean motion-capture trajectories and thus cannot operate directly on video. We present OmniHOI, a pipeline that turns an RGB video of hand-object interaction into an interaction-faithful trajectory on dexterous hands. The key idea is to enforce physical consistency using the evidence available at each stage: image evidence during reconstruction, contact geometry during retargeting, and dynamics during physics-in-the-loop refinement. Each stage optimizes the corresponding representation directly, correcting errors before they propagate downstream or must be absorbed by a learned policy. Across 150 motion-capture trajectories transferred to each of five dexterous hands with 6 to 22 DoF, we achieve 39-89% success, compared with at most 31% for prior transfer methods. On 60 monocular video clips, we achieve 53% success, compared with 28% for the best prior video-to-robot pipeline. Its trajectories also execute on a real bimanual robot across diverse tasks.

Zekai Deng, Kangyi Chen, Ye Shi, Jingya Wang
总结: 层次框架实现可组合多智能体人物交互。
方法: 蒸馏单智能体为对象导向可重用运动技能。
证据: 高层策略协调多代理生成对象导向动作。
为什么适合我: 扩展接触丰富场景到多智能体协作。
推荐理由: 贴近物理角色控制与运动先验:把单智能体HOI蒸馏成可复用的物体导向运动技能并组合多智能体协作。
原摘要

Physics-based human-object interaction has achieved robust single-agent manipulation skills, yet extending them to multi-agent cooperative tasks remains challenging. Existing approaches typically adapt interaction policies through task-specific fine-tuning, which entangles low-level contact-rich execution with high-level coordination and limits reuse across object geometries, interaction types, and team sizes. We propose a hierarchical framework that converts a single-agent HOI policy into a reusable Object-oriented Motion Skill. Specifically, we reinterpret teacher rollouts as object-oriented action supervision by extracting short-horizon object-proxy motions from executed trajectories, and distill task-specific teachers into a low-level skill operating in an Object-oriented Action Space. For downstream tasks, the distilled skill is frozen as a reusable executor, while a high-level policy coordinates multiple agents by generating region-wise object-oriented actions conditioned on the shared object, task goal, agent states, and local manipulation regions. This formulation shifts multi-agent HOI learning from direct contact-rich full-body control to compact object-level proxy-motion coordination. Experiments on diverse HOI tasks show that the distilled Object-oriented Motion Skill supports robust proxy-motion execution and enables composable policy learning across different interaction types, object geometries, and team sizes.

Yu Zhang, Yunqi Li, Yushi Du, Yi Ma, Yanchao Yang
总结: 快速少样本无微调校准灵巧遥操作手姿。
方法: HyperNet预测冻结MANO模块的LoRA更新。
证据: 合成真实手套及遥操作任务上评估。
为什么适合我: 提升人体动作演示质量与重定向精度。
推荐理由: 只涉及灵巧遥操作的手部动捕标定,不是人形全身遥操作、运动跟踪或上真机控制。
原摘要

Dexterous teleoperation requires reliable human-hand state estimations. However, common low-cost motion-capture gloves and markerless trackers often exhibit biases that vary across users, glove fit, and recording sessions, degrading retargeting and demonstration quality. We present YOCO, a fast few-shot, fine-tuning-free calibration framework that corrects biased hand-pose streams from a small set of paired raw and target poses. Instead of optimizing a separate model for every operator or session, YOCO conditions a calibration HyperNet on the paired examples and predicts LoRA-style updates for a frozen MANO hand-estimation module, turning per-user calibration into a lightweight feed-forward adaptation step while preserving the geometric prior of MANO and the efficiency of a compact estimator. We train YOCO with synthetic drift augmentations on InterHand2.6M and evaluate on augmented InterHand sequences, offline real glove data, and dexterous teleoperation tasks. Across these settings, YOCO improves calibration efficiency, hand-state estimation quality and teleoperation performance compared with uncalibrated input and standard calibration baselines.

Jiyeon Koo, Eunseom Pyo, Jeonghee Seo, Taehwa Kim, Andrew Jaeyong Choi
总结: 具身感知人体运动重定向到轮式基座人形。
方法: 任务条件分配器分配基座升降与手臂责任。
证据: 适配器转换参考为命令并评估部署。
为什么适合我: 人体动作重定向到不同具身全身控制。
推荐理由: 虽是人体视频重定向,但目标是轮式底盘、升降和双臂,不是腿足或人形全身运动。
原摘要

Human video offers a scalable source of robot demonstrations, yet most human-to-humanoid retargeting methods assume a legged robot with human-like kinematics. This assumption does not hold for mobile-base humanoids equipped with a wheeled base, vertical lift, and two arms. Human walking must be expressed through base motion, while torso bending may require coordinated lift and arm motion. We address this mismatch with a task-conditioned framework that assigns reconstructed human motion to base, lift, and arm responsibilities before robot-specific realization. The allocator preserves the human-derived path, stabilizes heading, separates turn and translation when needed, retimes commands to satisfy base limits, and repairs lift and arm trajectories. A deployment adapter then converts the reference to 50 Hz commands using stationary-base detection, deadband and slew-rate filtering, time-consistent playback scaling, and separate linear and angular gains. We evaluate the resulting references with human-derived task-space comparisons, policy-free simulation replay, and a qualitative execution on a physical robot.

TAPNAV: Humanoid Navigation through Tactile Active Perception

3.0/5 一般 裁判分 8.0 Strong 当日相对
Huaze Liu, Zhenyu Wu, Jaehwi Jang, ... , Kevin Cai, Ye Zhao
总结: 触觉主动感知实现无视觉人形目标导航。
方法: 不确定性全局规划耦合信息增益局部探测。
证据: 仿真与真机不同平面障碍几何上评估。
为什么适合我: 复杂地形接触丰富感知运动智能。
推荐理由: 虽用人形全身控制器执行接触,核心是触觉导航与定位不确定性,偏离运动跟踪、跑酷与loco-manipulation。
原摘要

Navigation in vision-denied environments is challenging for humanoid robots because proprioceptive odometry drifts and localization uncertainty accumulates rapidly. We present TAPNAV, a tactile active-perception framework that enables humanoid navigation toward a goal by actively probing surrounding structures without relying on vision. TAPNAV maintains a pose belief from odometry, IMU, and tactile contact observations, and couples uncertainty-aware global route planning with information-gain-driven local probing. The global planner searches for routes that keep predicted localization uncertainty bounded by exploiting opportunities for tactile correction, while the local planner selects probe actions that maximize expected information gain. A whole-body controller coordinates the humanoid's locomotion and end-effector contact to execute the planned navigation and probe motions. We evaluate TAPNAV in simulation and on a Unitree G1 across different floor plans and obstacle geometries. TAPNAV achieves lower state estimation error and a higher task completion rate than baselines. These results demonstrate that actively planning physical interactions with the environment can provide localization cues for reliable humanoid navigation without vision.