Papers for 2026-11-06

10 papers
Haoyu Shao, Yunshen Wang, Jingze Zhang, ... , Baoxiong Jia, Siyuan Huang
总结: 利用人体足球动作先验,统一学习敏捷带球与踢球。
方法: 分层强化学习将技能策略约束在潜在动作流形内。
证据: 鲁棒仿真设计支持零样本迁移,并保持类人过渡。
为什么适合我: 契合人形全身控制、动作模仿与仿真到现实迁移。
推荐理由: 直接命中高动态敏捷人形运动与潜在运动先验:从人体足球动捕蒸馏运动流形,再用分层强化学习统一走、运、停、踢,属于物理角色控制与动作模仿。
原摘要

Humanoid soccer requires a robot to seamlessly combine agile locomotion, ball manipulation, and impact-rich contact dynamics across a continuous, dynamic behavioral spectrum. Yet existing approaches either cover only a limited set of skills, or forego motion priors entirely and produce unnatural behaviors, leaving the combination of a unified skill set and human-like motion quality unaddressed. We present soccerbot, a hierarchical reinforcement learning framework that resolves both limitations through a structured latent motion prior distilled from large-scale human soccer motion capture data. By constraining policy learning within this dynamically plausible motion manifold, a single skill-conditioned policy naturally learns to perform moving, dribbling, trapping, and kicking in a unified formulation, while inherently producing human-like motion and fluid transitions during commanded skill switching. Augmented by robustness-oriented simulation design, soccerbot transfers zero-shot to the Unitree G1 humanoid robot, demonstrating agile, natural, and robust execution of the full soccer skill repertoire under real-world conditions.

Perceptive Humanoid Motion from Simulation

5.0/5 很相关 裁判分 10.0 Top pick 当日相对
Siyuan Hu, Abulikemu Abuduweili, Yue Meng, ... , Matthias M\"uller, Vladlen Koltun
总结: 在程序化住宅中合成数据,训练可感知的人形技能。
方法: 仿真流水线按算力扩展运动数据并编排长时任务。
证据: 无需真实人类数据即可完成穿门、爬行和推箱等技能。
为什么适合我: 匹配视觉感知运动、移动操作与仿真到现实。
推荐理由: 聚焦感知型人形运动,用仿真规模化生成视觉-语言-动作数据并学习蹲爬、侧身过门、推箱等全身技能,贴近感知运动与仿真技能获取。
原摘要

Humanoid robots have the potential to automate a wide range of physical tasks. Progress toward generalist humanoid autonomy, however, remains constrained by a data bottleneck: mapping pixels and free-form language to low-level joint commands requires paired supervision, and no corpus of such data exists at sufficiently large scale. Some approaches rely on human teleoperation and wearable capture devices, which require at least an hour of human time to produce an hour of data. We present HALO, a humanoid autonomy system powered by a pipeline that synthesizes vision-language-motion data across a thousand procedurally generated homes. The corpus scales with compute rather than human labor. HALO acquires a repertoire of physical skills, including sitting on chairs, navigating to named objects, stepping sideways through half-open doors, crouching and crawling beneath tables, and pushing boxes. It orchestrates these skills to solve composite, long-horizon tasks. Without ever seeing a real home during training, HALO transfers zero-shot to the physical world, achieving a 91% success rate across 360 trials in six unmapped real-world environments. See https://apple-aiml-research.github.io/ml-halo/ for code and videos.

Roberto Mauceri, Stefano Dafarra, Giulio Romualdi, Marco Gabiccini, Daniele Pucci
总结: 接触隐式全身优化可规划不平地形上的动态运动。
方法: 用光滑曲面近似地形,并以新约束建模地面接触。
证据: 非线性规划在多种地形及非共面地面验证可行性。
为什么适合我: 可补充人形全身轨迹优化与模型预测控制。
推荐理由: 用接触隐式全身轨迹优化规划人形在台阶、斜坡等不平地形上的动态行走,贴近全身模型预测控制与地形相关足式运动。
原摘要

This letter presents a trajectory planner for humanoid robots to perform dynamic motions on complex, parameterizable terrains using a contact-implicit whole-body optimization framework. The planner generates feasible movements without predefined contact sequences, considering the robot's full dynamics and kinematics. To plan bipedal locomotion on steps, ramps, and other terrains, we propose a mathematical model to approximate ground geometry with a smooth surface. The rigid interaction between the robot and the ground is modeled via novel contact constraints, extending the domain of applicability from flat and horizontal surfaces to any arbitrary smooth surface. Effectiveness is demonstrated using nonlinear programming to plan motions on various terrain topologies. We also explore dynamic trajectory generation by embedding high-level requirements in the cost function and the initial guess. Preliminary feasibility tests were conducted over non-coplanar terrains, both in simulation and on the real robot ErgoCub.

GRASP: Gradient-Guided Sampling for Contact-Rich Physics-Based Motion Retargeting

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
Yang Liu, Tong Wang, Yiming Bao, Heng Yang
总结: 采样与梯度引导结合,实现接触丰富动作重定向。
方法: 由存档样本拟合局部二次代价,并引导采样更新。
证据: 共享跟踪目标下,1352项双手任务成功率达92.8%。
为什么适合我: 正中人体到机器人的物理运动重定向与模仿。
推荐理由: 研究接触丰富的物理运动重定向,把人体示范转化为含人形在内的机器人控制,直接对应人体到机器人运动重定向。
原摘要

We study physics-based retargeting of human demonstrations for robot learning: finding robot controls that reproduce reference motions under contact dynamics. We propose GRASP (Gradient Recovery from Archived Samples for Proposals), which combines sampling-based exploration with gradient-guided refinement without requiring a differentiable simulator. GRASP-TO extends tempered sequential Monte Carlo by fitting local quadratic cost models to archived rollouts and using their gradients to guide Markov chain Monte Carlo rejuvenation. Metropolis-Hastings correction preserves the target distribution for each fixed proposal kernel, and a population analysis connects the recovered gradients to Gaussian smoothing. GRASP-MPC scales this optimizer to long demonstrations through warm-started receding-horizon planning. Experiments on dexterous hands and humanoids show accurate retargeting with a shared tracking objective and no task-specific contact rewards, including 92.8% success on 1352 bimanual OakInk2 demonstrations. The refined references improve PPO tracking in pen spinning and humanoid-object interaction. We also demonstrate dexterous manipulation and whole-body humanoid motion on real hardware.

Ctrl-F: Force as an Interface for Humanoid Loco-Manipulation

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
Mengjie Zhao, Yuxin Chen, Yiyang Shao, ... , Koushil Sreenath, Masayoshi Tomizuka
总结: 以三维接触力连接运动跟踪与环境物体交互。
方法: 低层同时跟踪并施力,高层依据状态在线规划力。
证据: 力指令不仅指定接触位置,还规定接触作用强度。
为什么适合我: 推动全身运动跟踪延伸到接触式移动操作。
推荐理由: 在人形运动跟踪上加入显式力指令实现运动-操作,同时覆盖全身运动跟踪与人形移动操作。
原摘要

Humanoid motion tracking has scaled to general policies that reproduce diverse human motion, but the resulting behavior is in free-space: the tracker knows where the body should be, not how it should interact with the environment. Other work makes the object part of the objective, yet abstracts that interaction to contact or geometry, which leaves the demanding cases under-explored. We argue that force is a natural command channel between motion imitation and object interaction, one that specifies not just where to make contact but how hard. We present Ctrl-F, a hierarchical motion-force framework that augments motion tracking with an explicit force command, a 3-D force at each designated contact body such as a hand or a foot. The hierarchical framework comprises: (1) A unified motion-force controller tracks the reference motion while applying the commanded force to the world. (2) A high-level force planner that issues a force command online based on object state and proprioception observations. In simulation and on hardware, Ctrl-F completes loco-manipulation that demands large, sustained interaction force and adjusts its command online as the load changes, both out of reach of a force-blind tracker. On hardware, Ctrl-F demonstrates hand-based dragging, pushing, and lifting, as well as foot-based kicking, successfully manipulating boxes weighing up to 20kg in pushing and kicking tasks where the force-blind baseline fails, while adapting online to additional loads introduced mid-task.

Xuemin Hu, Kaixin Li, Qingqing Xia, ... , Bo Tang, Long Chen
总结: 按关节异构性分解策略,并协同优化规划与执行。
方法: 各力矩关节以驱动、运动学和动力学描述为条件。
证据: 闭环机制联合适应高层姿态规划与低层执行策略。
为什么适合我: 高度契合人形全身控制与分层强化学习。
推荐理由: 面向单台人形的全身控制与深度强化学习,主题匹配;但重点是关节级异构多智能体分解,而非运动跟踪、重定向或感知运动。
原摘要

Coordinated whole-body control of humanoid robots remains challenging due to high-dimensional coupled dynamics and substantial physical heterogeneity across joint degrees of freedom (JDoFs). Existing multi-agent reinforcement learning methods either employ coarse agent partitions or directly apply generic heterogeneous-agent algorithms, while hierarchical controllers commonly optimize high-level planning and low-level execution independently, leading to uncoordinated motion. In this paper, we propose H^2MARL, a hierarchical heterogeneous multi-agent reinforcement learning framework with two key mechanisms. We first formulate humanoid whole-body control using a JDoF-level physical-heterogeneity-aware policy factorization, where each torque-actuated JDoF is conditioned on an explicit descriptor of its actuation, kinematic, and dynamic properties. Moreover, we develop a closed-loop policy-executor co-optimization mechanism that jointly adapts the high-level pose planner and the low-level joint executor using shared interaction trajectories, thereby reducing the distribution mismatch between planning and execution. Extensive experiments in MuJoCo and Isaac Gym demonstrate that H^2MARL consistently improves locomotion stability, gait coordination, and motion quality over homogeneous, coarse-grained, and independently optimized alternatives.

Zhengdong Hong, Guofeng Zhang
总结: 从人物交互预测未来状态,辅助灵巧手强化学习。
方法: 将预测的物体未来状态作为跨任务通用奖励项。
证据: 三项仿真与真实任务表现更优,并可跨机械手部署。
为什么适合我: 与运动重定向相关,但重点是灵巧操作而非足式。
推荐理由: 虽用人体运动先验和强化学习,但对象是多指灵巧手操作,不是人形全身控制、运动跟踪或足式移动操作。
原摘要

Manipulating diverse objects with multi-fingered dexterous hands is challenging due to the high dimensionality and complex dynamics. Human-Object Interaction (HOI) datasets provide rich knowledge about task information and embodied interactions. Instead of solely imitating the human demonstrations, our method learns to holistically predict future hand-object states by leveraging these datasets. The predicted future states of the object can serve as a general-purpose reward term for reinforcement learning, reducing reliance on task-specific reward engineering and enhancing generalization across tasks. We conduct extensive experiments on three manipulation tasks in simulation and the real world. Our approach outperforms existing SOTA methods in both success rate and generalizability on novel objects. Furthermore, we validate the cross-embodiment compatibility of our methods by successfully deploying the skills on different robot hands.

Michal Korniak, Marco Bagatella, Ralf R\"omer, ... , Max Simchowitz, Andrew Wagenmaker
总结: 探索通用机器人策略在部署中同时改进多项任务。
方法: 建立结构化评测,并系统检验多任务强化配方。
证据: 摘要强调多任务改进,但未报告具体性能数字。
为什么适合我: 与全身跟踪关联较弱,仅涉及策略持续改进。
推荐理由: 讨论通用机器人策略的多任务强化学习改进,未针对人形或足式全身控制、运动重定向与感知运动。
原摘要

The introduction of generalist robot policies has enabled a single, large model to learn to perform a variety of tasks from a vast pre-training corpus. While these models often exhibit powerful zero-shot generalization capabilities, they typically require an adaptation phase to achieve sufficient performance in deployment. Iterated self-improvement via reinforcement learning (RL) has demonstrated promise in enabling this adaptation, yet such approaches have been largely explored in single-task settings - where the goal is to simply improve on a narrow deployment task - which lies in stark contrast to the multi-task capabilities of the base policy. In this work we ask whether generalist robot policies are capable of multi-task, generalist improvement in deployment - targeting many diverse tasks simultaneously - and what algorithmic recipe enables this. To answer this question, we first develop a set of structured evaluations to test generalist improvement capabilities, and systematically evaluate algorithmic and practical design choices regarding value estimation, policy extraction and resource allocation. We show that not only can generalist policies be improved online across diverse tasks, but that the right recipe can enable generalization and increase performance on tasks not considered during online training. We characterize when this generalization occurs and show that both the training task distribution and the use of value-based RL are critical. To the best of our knowledge, this is among the first evidence for online generalist improvement for robot foundation models.

Future Representation Distillation for Imagination-free World Action Models

2.0/5 偏低 裁判分 5.0 Candidate 当日相对
Jaehyeong Jo, Sangwon Jang, Sihyun Yu, ... , Kimin Lee, Sung Ju Hwang
总结: 蒸馏视频扩散表征,无需生成未来视频即可控机器人。
方法: 编码器由当前观测预测表征,动作模块再提取信息。
证据: 真实与仿真成功率超过前沿方法,并支持实时闭环。
为什么适合我: 对视觉运动和闭环控制有参考,但非全身模仿。
推荐理由: 将视频扩散模型蒸馏为动作表征,服务于通用操作控制,不是人形运动生成、全身跟踪或足式控制。
原摘要

World Action Models (WAMs) use the predictive knowledge of pretrained video diffusion models for robot control through future video prediction. However, iterative video denoising is costly, and inaccurate visual predictions can compromise action prediction. Our key idea is to make this predictive knowledge available through visual representations computed from the current observation, enabling action prediction without generating future videos. We introduce DreamFree, a WAM that repurposes a pretrained video diffusion model as a predictive visual encoder through representation distillation. The visual encoder learns to predict a frozen video diffusion model's representation using only the current observation. An action module is then trained to predict actions by extracting action-relevant information from the visual encoder. Across real-world and simulated tasks, DreamFree achieves higher success rates than state-of-the-art VLAs and WAMs, while performing real-time closed-loop control at 11Hz with a 14B video diffusion backbone. Experiments show that DreamFree can translate stronger video priors and additional video data into better robot control and enable learning new robot tasks from video demonstrations, including videos from a different embodiment, without action annotation for the new tasks.

Xuhao Qin, Xiyan Huang, Haoyu Dong, Xi Zhang, Chenxi Xiao
总结: 比较触觉外观、几何和切向形变对接触模仿的作用。
方法: 同一演示与策略骨干下,单独及组合评估三类线索。
证据: 七百二十次真实试验还比较编码器与视觉触觉融合。
为什么适合我: 关注接触模仿感知,但距足式全身控制较远。
推荐理由: 比较接触丰富模仿学习中的触觉线索,面向通用实机操作,不涉及人形全身控制或足式运动。
原摘要

Vision-based tactile sensors capture multiple aspects of physical interaction within a single image stream, including contact appearance, geometry, indentation depth, and tangential deformation. However, existing visuo-tactile policies often directly process tactile observations as images, making it difficult to determine which physical cues contribute to policy learning. This paper presents a controlled real-robot study that compares physically interpretable tactile signals using the LeRobot platform, enhanced with our visuo-tactile perception system. From the same tactile stream, we derive tactile RGB images, normal/depth maps, and marker-flow fields, representing contact appearance, geometry, and tangential deformation, respectively. Using identical task demonstrations and the same policy backbone, we evaluate the individual and combined contributions of these tactile cues. We further compare tactile encoders and visuo-tactile fusion strategies. Evaluation across 720 real-robot trials yields four key findings: (1) tactile perception substantially improves the overall success rate from 57.8% to 78.9%, although its contribution varies across task stages; (2) marker flow is the most effective individual cue, achieving a success rate of 74.4% and playing a particularly important role in regulating established contact; (3) cue-factorized encoding consistently improves performance, highlighting that different physical cues require tailored processing techniques; and (4) although the effectiveness of tactile fusion is task-dependent, cross-attention offers a lightweight solution with performance comparable to that of pretrained tactile encoders.