Papers for 2026-10-13

10 papers
Chen Yu, Sudarshan S Harithas, Juan Borbon, Dingqi Zhang, Jiuguang Wang
总结: 人形推未知小车,在线估计规划闭环。
方法: BOPI按信念重叠部分反转流后重建。
证据: 模拟18目标位姿误差降约33%与47%,真机成功。
为什么适合我: 利接触丰富loco-manipulation与全身控制。
推荐理由: 直接做人形推车 loco-manipulation:在线信念估计、基于流的重规划与全身控制闭环,贴合接触丰富场景交互与全身控制。
原摘要

People often learn how an unfamiliar object moves through a small exploratory push, using its response to guide their next motion. Inspired by this behavior, we study humanoids pushing carts whose mass and caster stiffness are initially unknown. Our object-centric framework closes online estimation, flow-based planning, and whole-body control into a loop, creating a tension: replacing the plan whenever the belief shifts disrupts the maneuver under way, while keeping it strands the robot on a path its evidence has ruled out. Belief-Overlap Partial Inversion (BOPI) scales revision to agreement, inverting the flow under the old belief only as far as the beliefs disagree before reconstructing under the new one. Across 18 simulated goals it lowers pooled final position and yaw error by roughly 33% and 47% against fixed-depth replanning, and on hardware it translates and turns a non-holonomic cart.

Workhorse: Learning Robust Whole-Body Humanoid Loco-Manipulation from Human Data

5.0/5 很相关 裁判分 10.0 Top pick 当日相对
Songbo Hu, Qiayuan Liao, Yufeng Chi, ... , Pieter Abbeel, Koushil Sreenath
总结: 从人类演示学人形全身loco-manipulation。
方法: 视觉规划五连杆目标,RL跟踪并互错增强。
证据: 真机G1搬踢接爬箱,模拟77%成功推扰64%。
为什么适合我: 人体动作直接转真机可跟踪全身控制。
推荐理由: 从人体示范学习全身 loco-manipulation,并用强化学习跟踪器上真机 G1,覆盖模仿、接触丰富操作与 sim-to-real。
原摘要

Humanoid robots still struggle to plan contact-rich whole-body manipulation from egocentric RGB and proprioception. Workhorse learns such manipulation from robot-free human demonstrations. A visual planner predicts five-link targets: the poses of the torso, both wrists, and both feet. A reinforcement-learning whole-body tracker follows them on the robot. Both policies train separately on the same recorded human poses, without retargeting. We augment the training data of each policy to imitate the errors that the other makes at deployment. On a real Unitree G1, Workhorse transport boxes with its hands and a kick, catches a thrown box, and topples and climbs a suitcase. During box transport, we show recoveries after a person pushes the robot or takes the box away. In a simulated copy of the demonstration room, the system completes box transport in 77% of episodes, and in 64% under 40 N.s pushes. With both policies retrained from the same demonstrations, a simulated second humanoid completes box transport in 83% of episodes without pushes.

Dvij Kalaria, Bike Zhang, S. Shankar Sastry
总结: 第三人称视频学人形接触丰富交互技能。
方法: 恢复运动重建障碍,接触感知重定向保姿态。
证据: 提取噪声运动接触并精炼为可部署技能。
为什么适合我: 打通视频模仿到可重定向全身loco-manipulation。
推荐理由: 第三方视频到人形交互技能,强调接触感知重定向与全身模仿,紧贴动作重定向和 loco-manipulation。
原摘要

Third-person human videos offer a scalable alternative to task-specific reward engineering, teleoperation, and manually scripted demonstrations for humanoid loco-manipulation. Recent video-to-humanoid systems have shown that noisy human motion, object trajectories, and contacts can be extracted from unstructured videos and refined into deployable skills. However, a key gap remains for contact-rich imitation: the task is often defined by world-frame contacts whose poses, timing, and speed must survive embodiment mismatch and runtime scene changes. Towards this, we present VICAR (Video Imitation with Contact-Aware Retargeting), a pipeline for learning humanoid interactive skills from third-person human videos. The system first recovers human motion, reconstructs task-relevant obstacles from monocular video, and then retargets the motion to a humanoid while preserving global contact poses, motion speed, and collision clearance. Unlike retargeting methods that only remove penetration or preserve local interaction geometry, our formulation represents user-specified contact poses and collision clearance as high-priority Lagrangian penalty terms and optimizes the full motion to remain smooth through contact-rich transitions. The resulting motions are used to train a contact-conditioned motion generator whose inputs include movable contact points enabling runtime adaptation to new contact positions. We demonstrate the framework on ten diverse third-person video skills, including six table-tennis serves, three object-pickup tasks, and ladder climbing, and deploy the learned skills on hardware. These results suggest that contact-preserving retargeting is a practical step toward humanoids that learn useful interactive behavior by watching humans.

Reflex: Visually Grounded Reactive Humanoid Control

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
Taoyang Jia, Weikai Huang, Linxin Song, ... , Zhongzheng Ren, Ranjay Krishna
总结: 视觉接地反应式人形全身控制如接抛箱。
方法: 三阶段学全身接、推断动力学并视觉接地。
证据: 实现实时视觉反应全身接抛箱任务。
为什么适合我: 强化感知运动与接触丰富反应全身控制。
推荐理由: 以接抛箱研究视觉接地的反应式全身控制,同时要求全身协调、物体动态与第一人称感知,属核心 loco-manipulation。
原摘要

Humans effortlessly react to the world; they adeptly return a tennis shot, catch a falling cup, step aside from a passing cart, or pass a box tossed during truck unloading. These everyday actions require anticipating a moving target and reflexively responding with the whole body within about a second. Such visual reactive whole-body control remains challenging for humanoids, which must (1) coordinate whole-body control, (2) react to object dynamics in real time, and (3) ground perception in egocentric vision. We study catching thrown boxes as a representative task that demands all three capabilities; existing systems cover only part of it, relying on end-effectors, motion capture, or marked objects. We present Reflex, a three-stage framework that learns these capabilities stage by stage while connecting them through a compact representation of object dynamics. First, a state-based policy learns whole-body catching with reinforcement learning. Second, the policy learns to infer the dynamics of a moving box from delayed and incomplete observations. Third, an egocentric RGB-D encoder learns to recover this dynamics representation directly from visual observations while keeping the whole-body controller fixed. This decomposition provides each capability with a direct training signal and makes visual learning substantially more scalable. In simulation, Reflex achieves 85.7% catch success from egocentric RGB-D, compared with 87.9% when given privileged box observations. Temporal visual history is critical: removing it reduces success by 35.6 and 39.8 points on centered and laterally offset throws. On a real Unitree G1, Reflex catches human-thrown boxes with 65% and 40% success at 2.5 and 5 m, reaching 76% and 59% of human catchers' success at the same distances.

ATHLETE: Learning Reactive Humanoid Tennis via Trajectory-Guided Motion Matching

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
Zhihao Tian, Zifan Wang, Enzheng Zhu, ... , Mengbo Wang, Junwei Liang
总结: 通用运动与视频学反应式人形网球。
方法: TGMM建参考,师生DAgger蒸馏后PPO微调。
证据: 真机直接响应机器人与球观测部署。
为什么适合我: 模仿加RL实现反应全身运动与跑酷。
推荐理由: 用通用运动与网球视频构造反应式人形策略,经运动匹配、师生蒸馏和 PPO 微调,贴合模仿学习与全身反应控制。
原摘要

Humanoid tennis requires reactive whole-body coordination under rapidly changing ball dynamics, yet collecting task-specific motion-capture demonstrations that cover diverse approach states, contact locations, and timing conditions is costly. Inspired by how humans acquire new skills by combining reusable motor experience with task-specific demonstrations, we present ATHLETE, a framework for learning reactive humanoid tennis from generic locomotion data and ordinary tennis videos. ATHLETE combines LAFAN1 locomotion with video-derived striking motions and uses Trajectory-Guided Motion Matching (TGMM) to construct diverse task-conditioned whole-body references. These references are transformed into a reactive policy through physics-based teacher--student learning with online DAgger distillation, followed by PPO fine-tuning for the tennis task. The resulting policy responds directly to robot and ball observations without requiring reference-motion inputs at deployment. On a real humanoid robot, ATHLETE achieves forehand and backhand hit rates of $90.00\%$ and $86.67\%$, respectively, and enables multi-shot rallies with human players. These results demonstrate that ATHLETE can learn dynamic humanoid tennis skills from reusable locomotion data and video demonstrations. Result videos and code can be found at https://anonymous.4open.science/w/ATHLETE2027/.

PriMoRetarget: Humanoid Motion Transfer Through Prioritized Motion Retargeting

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
Nicholas Ioannidis, Dun Yang, Max Smith, ... , Shayegan Omidshafiei, Xue Bin Peng
总结: 优先级重定向保多角色物体交互接触。
方法: 显式优先级层次约束低优更新保高优目标。
证据: 四数据集评估含单角色与物体操作。
为什么适合我: 关键人体动作可重定向可上真机全身控制。
推荐理由: 优先保持足端与交互接触的人形动作重定向,直接对应人体动作迁移到可执行全身参考。
原摘要

Motion retargeting is a critical preprocessing step for transferring human motion data to humanoid robots. While existing methods are effective for single-character motions, interactions involving multiple characters and objects introduce additional contacts and spatial relationships that must be preserved. Retargeting is commonly formulated as a weighted multi-objective optimization problem, where conflicting objectives can require careful tuning of relative weights and can still compromise important motion characteristics. We introduce PriMoRetarget, a prioritized motion-retargeting framework that replaces relative objective weighting with an explicit priority hierarchy. Lower-priority updates are constrained to preserve higher-priority objectives, allowing critical characteristics such as foot placement and interaction contacts to take precedence over lower-priority pose objectives. The method is evaluated on four datasets spanning single-character motion, character-object manipulation, and character-character interactions. The resulting motions better preserve task-relevant interactions and provide reference trajectories that can be tracked more reliably than those produced by widely used retargeting methods.

PanTact: Teaching Whole-Body Dexterity with a Wearable Contact Interface

5.0/5 很相关 裁判分 4.0 Candidate 当日相对
Xiaomeng Xu, Han Zhang, Zhian Ruan, ... , Shuran Song, Guanya Shi
总结: 可穿戴接触从人类演示学全身灵巧。
方法: 接触补丁记录,视觉运动策略任意体表操作。
证据: 扩展操作超手部实现全身接触灵巧。
为什么适合我: 接触丰富全身灵巧服务感知运动与loco-manipulation。
推荐理由: 用非外骨骼的可穿戴接触采集,把全身任意表面接触教给人形,属于接触丰富 loco-manipulation 与数据采集。
原摘要

Humanoid robots have many degrees of freedom and contact surfaces, yet most loco-manipulation research restricts manipulation to the hands and avoids other body contacts with the environment. To extend manipulation beyond the hands, we present PanTact, a system that learns humanoid whole-body dexterity, the capability to manipulate with any suitable body surface, directly from robot-free human demonstrations. Our key idea is to use contact as manipulation-centric information that transfers across embodiments. Contact locations and timing specify the interactions needed to accomplish a task, while the robot chooses how to coordinate its body to realize them within its own physical constraints. Specifically, PanTact captures, learns, and executes whole-body contact via: 1) a wearable, robot-free data collection interface that augments egocentric vision and bimanual UMI grippers with whole-body modular contact patches to record body contact locations and states; 2) a visuomotor policy that mitigates the egocentric observation gap and predicts whole-body contact goals; and 3) contact-aware whole-body control formulations that realize active contact goals using suitable robot surfaces. We deploy PanTact on a Unitree G1 humanoid without additional body contact sensors, demonstrating whole-body dexterity involving body support, pushing, sweeping, and load-sharing. Website: https://pantact.github.io

Chuxuan Huang, Zhanxiang Cao, Tianyue Zhan, ... , Yang Yang, Yue Gao
总结: 部分感知扩散从语言生成人形运动。
方法: 部分注意力融合,自回归生成加FK与终点预测。
证据: FID达3.165降16.8%,R@1升1.4点时长误差降。
为什么适合我: 扩散生成可跟踪可重定向全身运动参考。
推荐理由: 面向 G1 的部位感知扩散式人形动作生成与运动参考,接近运动先验与可执行参考,但偏文本生成而非跟踪控制。
原摘要

Translating language into humanoid motion requires coordinating body parts, determining motion duration, and producing references suitable for robot execution. We introduce PartiGen, a part-aware latent diffusion framework that incorporates anatomical structure into a shared whole-body motion representation. Part-specific attention processes anatomically masked frame features, and its outputs are fused to combine local limb information with whole-body context. Conditioned on text and motion history, the model generates motion primitives autoregressively. Forward-kinematics supervision encourages kinematic consistency, while a learned end-of-sequence predictor selects a frame-level endpoint after generation. On HumanML3D retargeted to the Unitree G1, PartiGen achieves a segment-level FID of 3.165, a 16.8% reduction over TextOp, and improves R@1 by 1.4 percentage points. In the duration study with 16-frame primitives, endpoint prediction reduces mean absolute duration error from 12.471 to 3.080 frames compared with a fixed-length cutoff. We further evaluate robot execution using a pretrained, frozen GRIT tracker: 409 of 500 generated references (81.8%) pass the posture-based stability screen in MuJoCo. Following simulation screening and manual selection, 26 of 27 attempted motions are judged successful on the real G1.

Manh Cuong Nguyen, Duc Cuong Vu, Viet Anh Vu, ... , Ngo Anh Vien, Minh Nhat Vu
总结: 未知载荷下自适应全身MPC与姿态规划。
方法: 质心MPC参考、模糊补偿与路点最优规划。
证据: 实现稳定降抓举搬放行为。
为什么适合我: 全身MPC处理接触载荷,利loco-manipulation。
推荐理由: 未知负载下的人形全身 MPC、平衡补偿与姿态规划,符合全身模型预测控制与物料搬运,但学习成分较弱。
原摘要

Humanoid robots performing lifting and material-handling tasks must maintain balance despite unknown and varying payloads. However, payload uncertainty significantly affects whole-body dynamics and may destabilize conventional controllers. We propose an adaptive whole-body control architecture that integrates three components: (i) a centroidal model predictive controller (MPC) that generates dynamically feasible reference motions, (ii) an adaptive fuzzy balance controller that compensates for payload-induced model mismatch by generating corrective torques distributed across the supporting-leg joints, and (iii) a waypoint-based optimal posture planner built on a triple-integrator model that produces smooth sit-to-stand and stand-to-sit trajectories satisfying center-of-mass (CoM) stability constraints, joint limits, and whole-body feasibility requirements. Together, these components enable stable lowering, grasping, lifting, carrying, and placing behaviors under significant payload uncertainty. Extensive simulation and hardware experiments demonstrate that the proposed framework improves balance robustness and reduces tracking degradation during posture transitions and lifting tasks compared to non-adaptive baselines.

Octi Zhang, Mateo Guaman Castro, Patrick Yin, ... , Rosario Scalise, Byron Boots
总结: 大规模RL平衡数据饮食解决探索瓶颈。
方法: 平衡采样聚焦未掌握配置避免浪费经验。
证据: 缓解并行扩展中学习信号浪费问题。
为什么适合我: 改进RL支持复杂地形全身运动智能。
推荐理由: 大规模RL的探索与数据配比方法,可覆盖运动与操作,但未针对人形全身或人体动作。
原摘要

General-purpose robots must perform a wide range of tasks from agile locomotion to dexterous manipulation. While sim-to-real reinforcement learning (RL) has proven to be a useful tool for this goal, current RL pipelines depend on engineering-heavy, per-task structural priors such as shaped rewards and demonstrations. Recent work has shown that diverse simulator resets, combined with massively parallel simulation, can alleviate much of this engineering burden on several manipulation problems. However, we find that naively scaling this paradigm to more precise or dynamic problems remains non-trivial. While simulator resets can help with exploration, uniformly sampling over this distribution wastes a growing fraction of learning experience on task configurations the policy has already mastered or cannot yet attempt. This makes it challenging to see the expected benefits of scaling parallel environments for RL, since much of the learning signal in a batch is wasted during learning. To mitigate this, we introduce Success Guided Sampling (SGS), a simple adaptive sampler that concentrates RL training on task configurations around the frontier of the policy's capabilities. Doing so allows large-scale simulated RL to make the most out of the experience in a batch, enabling much more effective scaling to large-scale parallel simulation. Across experiments using up to $2^{20}$ (over one million) parallel environments, SGS enables RL to solve challenging multi-terrain quadruped locomotion and contact-rich assembly tasks that prior methods fail to solve. Finally, we distill the learned manipulation policies into RGB-based policies and demonstrate zero-shot transfer to several challenging assembly tasks on real hardware. Project website: https://sgs-rl.github.io/.