Papers for 2026-10-17

10 papers
James Foster, Beomyeong Park, Luigi Penco, Robert Griffin
总结: 全身MPC结合在线惯性估计实现负载下人形遥操作。
方法: EKF估计时变惯性参数馈入WB-MPC,VR提供任务参考。
证据: 负载下提供更准确前馈扭矩并委托动态平衡。
为什么适合我: 契合全身MPC与接触丰富负载适应场景。
推荐理由: 直接对应人形遥操作与全身模型预测控制:在负载变化下用WB-MPC结合在线惯量估计做全身力矩前馈。
原摘要

The effective deployment of humanoid robots in practical tasks of interest will require a capability of sensing and adapting to variations in inertial parameters, as occurs during heavy tool use or when carrying significant payload. Such payloads constitute a significant proportion of the combined payload-robot system, the effects of which cannot be ignored by delegating to feedback control. This paper showcases a general solution to this problem by integrating a whole body model predictive controller (WB-MPC) with an extended Kalman filter (EKF) for online estimation of fully physically consistent time-varying inertial parameters. These estimates are fed through to the WB-MPC's full rigid body dynamics model, resulting in more accurate feedforward torques for task demands under external load. Additionally, a virtual reality (VR) interface is provided that enables an operator to provide task-specific references without regard to payload while delegating dynamic balance to the WB-MPC. The framework is validated with simulation and hardware experiments on a humanoid system.

Whole-Body Dexterity

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
Conor Mc Gartoll, An Dang, Pranay Thangeda, ... , Mustafa Mukadam, Manikantan Nambi
总结: 全身灵巧框架利用身体接触抓取操纵大物体。
方法: 生成抓取数据集训练RL专家后蒸馏为单策略。
证据: 零样本迁移G1完成重定位与长时搬运任务。
为什么适合我: 直接支持loco-manipulation与全身接触控制。
推荐理由: 核心是人形全身接触操作与loco-manipulation:用身体多接触抓取重定位,RL专家蒸馏并零样本上G1。
原摘要

Current humanoid dexterous manipulation remains largely confined to end-effectors and simple grasps, falling short of humans' ability to engage the entire body by bracing and sliding bulky objects against the arms and torso. We introduce Whole-Body Dexterity (WBD), a general framework that uses the robot's body and appendages as contact surfaces to grasp and manipulate objects. Our sim-to-real pipeline first generates a dataset of feasible whole-body grasps, then trains reinforcement-learning experts on a general any-to-any repositioning objective by sampling initial and goal grasps from the dataset, and distills these experts into a single policy that uses proprioception and object geometry. We show that the distilled policy transfers zero-shot to a real Unitree G1, where it repositions a basketball and a cardboard box to regions around the torso and completes a long-horizon task that stows a box under one arm, carries it from a shelf to a table, and places it. The controller operates interactively, steered by coarse motion references from a human teleoperator. Across real-world whole-body manipulation tasks, the distilled controller completes 90% of trials, compared with 18% for direct retargeting and 4% for a generalist whole-body controller.

Venki Parsuram, Michelle Wang, Jin-Hyuk Hong, Pulkit Agrawal
总结: 残差适配使通用运动跟踪具备全身柔顺响应。
方法: 预训练GMT加本体感觉历史条件残差适配器。
证据: 实现通用跟踪同时安全鲁棒响应交互力。
为什么适合我: 提升运动跟踪在真实交互中的柔顺性。
推荐理由: 紧贴人形全身运动跟踪:在通用GMT上加残差适配,使大规模动作模仿在交互力下变柔顺。
原摘要

We propose Compliant GMT (C-GMT), a modular framework for full-body compliant responses in general motion tracking. As humanoid robots move into real world deployment, they not only need to perform any motion but also respond safely and robustly to interaction forces. Existing general motion tracking policies can imitate diverse motions but are trained to be stiff, leading to unexpected and unsafe behaviors under disturbance. Prior work in compliant humanoid control trades off compliance and generality. There exist examples of full-body compliant responses, but these are heavily curated to single-reference policies. On the other hand, general motion trackers (GMT) are trained to rigidly imitate massive motion capture datasets. Our key insight is to leverage the generality of pretrained GMTs for motion tracking while introducing compliance from a residual adapter that conditions on a history of proprioception. This enables our approach, C-GMT, to achieve both general motion tracking and whole-body compliant responses. Compared to state-of-the-art general motion trackers and single-motion compliant policies, C-GMT demonstrates competitive performance in both motion tracking accuracy and compliance adherence. We further demonstrate improved safety, robustness, and error tolerance in simulation and real-world G1 experiments.

Zibo Zhou, Yueru Chen, Junsong Wu, ... , Chenjia Bai, Xuelong Li
总结: 将人类第一人称演示转为全身VLA训练数据。
方法: 规范轨迹引导视角合成与控制器状态动作监督。
证据: 生成仿真检查轨迹支持可重用监督。
为什么适合我: 助力人体动作转化为可跟踪可上真机控制。
推荐理由: 对应人体动作到人形可训练全身数据:把第一视角演示对齐成可仿真校验、控制器兼容的全身状态-动作。
原摘要

Training humanoid whole-body vision-language-action (VLA) policies requires costly robot demonstrations with aligned robot-view observations and controller-compatible whole-body state-action labels. Egocentric human demonstrations offer scalable supervision but have misaligned views and sparse motion cues. Existing approaches either pretrain policies that still require robot data for adaptation or generate controller-specific commands that limit reuse. Conversion also requires robot-view observations aligned with the generated whole-body motion. We present KODA (Kinematics-Observation Data Alignment), which converts egocentric RGB demonstrations into whole-body VLA training data using a reusable canonical trajectory to guide robot-view synthesis and generate controller-specific whole-body state-action supervision. KODA first generates a simulator-checked whole-body trajectory using a sparse tracker with sampling-based command optimization. This generated trajectory directly determines the onboard camera poses used to synthesize corresponding robot-view observations. The motion, observations, and task instruction form a canonical record. For each deployment controller, KODA optimizes commands to track the stored motion and records the corresponding action labels and proprioceptive states. When switching controllers, KODA retains this canonical record and regenerates whole-body state-action supervision for co-training with matching robot demonstrations. We evaluate KODA on four Unitree G1 loco-manipulation tasks using two whole-body controllers, SONIC and HEFT. With robot data held fixed, macro-average success on conditions covered by human demonstrations but absent from robot data improves by 45.0 and 46.25 percentage points, respectively. Under both controllers, this metric shows an upward trend across the evaluated human-data budgets, suggesting potential for further scaling.

SOMA: Stack-of-Objects Manipulation using a Quadruped Robot

4.0/5 相关 裁判分 8.0 Strong 当日相对
Stergios E. Bachoumas, Panagiotis Artemiadis
总结: 分层RL实现四足多物体堆叠全身非抓取操纵。
方法: 高层S5编码预测命令,低层适应腿部姿态。
证据: 三维推策略操纵堆叠负载防滑倾。
为什么适合我: 相关腿足机器人loco-manipulation接触场景。
推荐理由: 虽是四足而非人形,但属于腿足全身非抓取操作与分层强化学习,接近全身loco-manipulation。
原摘要

Executing heavy-duty physical manipulation in unpredictable environments remains a major challenge for quadrupedal robots lacking dedicated manipulators. This paper presents SOMA, a hierarchical reinforcement learning framework for whole-body non-prehensile manipulation of multi-object stacks using a quadruped robot. Unlike traditional methods restricted to two-dimensional planar pushing, SOMA integrates explicit robot base-height control, unlocking full three-dimensional pushing strategies. This capability enables the quadruped to manipulate complex payload stacks as a unified system while preventing relative sliding or tipping of upper layers. The architecture factorizes control into a high-level manipulation policy using a Simplified Structured State Space Sequence (S5) encoder to reason over long-horizon temporal history and predict bounded target tracking commands via Beta distributions, and a low-level locomotion policy that dynamically adapts leg stance configurations. In extensive simulation benchmarks, SOMA achieves a $90.3\%$ success rate for single-object reposing and up to $90.1\%$ for dynamic two-box stacks under stringent error margins ($0.05\text{ m}$ position error, $1^\circ$ orientation error). Finally, we validate zero-shot sim-to-real transfer on a Unitree Go1 quadruped robot across diverse payload masses and geometries, demonstrating active base-height adjustments to maintain traction and balance during heavy pushing tasks.

Zejian Kang, Yifu Luo, Boyang Shen, ... , Wentao Yang, Xiangru Huang
总结: 类型参考感知对话编辑用于人形运动扩散。
方法: 语言模型预测事件编码,扩散生成器结合文本。
证据: 支持类型请求定义范围与相对目标编辑。
为什么适合我: 连接扩散模型与人形运动生成可编辑控制。
推荐理由: 面向G1的语言条件人形动作扩散与编辑,含支撑/接触等运动结构,接近扩散运动先验与可跟踪全身动作生成。
原摘要

Language-conditioned humanoid motion generation enables users to create and refine robot movements through natural language. The central challenge is to connect an underspecified request to concrete motion structure that can subsequently be revised relative to an accepted reference. We present TRACE, a generation and editing framework for the Unitree G1 humanoid robot built around typed, measurable kinematic quantities. Our insight is to ground generation conditions in paired training motions and editing goals in the current motion. A language model learns to predict support, root, and hand events from motion-derived supervision; their time-aligned encodings complement the original text in a diffusion generator. Gravity-referenced states and trajectory--contact objectives improve kinematic consistency. For editing, typed requests define body--time scopes and source-relative goals. A separate reference-conditioned diffusion editor uses these goals and revised events to realize changes, while sampling-time projection preserves protected state coordinates. Quantitative evaluation and human assessment show improved semantic alignment and motion quality over the compared methods. Controlled ablations support the value of motion-grounded conditioning and kinematic consistency, while multi-turn editing evaluations demonstrate more reliable execution of successive relative requests under shared preservation constraints. Together, these results support typed kinematic structure as a common basis for motion generation and reference-aware revision.

C\'esar E. Ramos Chuquiure, Ryan Tsai, Yutong Zhou, ... , Challen Enninful Adu, Ram Vasudevan
总结: 梯度流增广拉格朗日优化接触约束轨迹。
方法: 伪谱配置转录OCP并积分原对偶梯度流。
证据: 多平台基准唯一全解并显著加速。
为什么适合我: 强化全身MPC接触约束求解能力。
推荐理由: 面向含人形在内的腿足接触约束轨迹优化,服务全身可行运动生成,接近全身控制与接触丰富运动。
原摘要

Generating dynamically feasible motions for legged and manipulating robots requires solving a large, nonlinear, non-convex optimal control problem (OCP) in which contact wrenches must satisfy friction-cone constraints throughout the motion, not only at isolated instants. Existing solvers are sensitive to the initial guess and scale poorly with the number of joints. This paper introduces LEAP, which transcribes the OCP with pseudospectral collocation and, instead of a Newton or SQP solve, integrates a primal--dual gradient flow of a Powell--Hestenes--Rockafellar augmented Lagrangian to compute a solution. Because the flow is stiff, this paper designs a linearly implicit integrator with a Gauss--Newton metric, momentum, and a merit-based step controller that keeps the augmented Lagrangian monotone. Across locomotion benchmarks on five robot platforms, from planar hoppers to 32-joint humanoids, LEAP is the only method to solve every tested problem, achieves substantial speedups over Crocoddyl and Aligator on several benchmarks, and reaches trackable references at smaller compute budgets. The resulting trajectories are validated by tracking them in a high-fidelity simulator and on hardware. We will make the code public upon final acceptance of this paper.

Zhilin He, Guoquan Qi, Changliu Liu
总结: 流形生成退火结合RL先验优化接触阻抗。
方法: RL策略提案经模型滚动精炼运动阻抗。
证据: 应对不确定交互与物理约束优化。
为什么适合我: 融合RL与模型基方法用于接触丰富任务。
推荐理由: 接触约束下的阻抗与RL先验生成优化方法相近,但未明确落在人形/腿足全身运动问题上。
原摘要

Contact-rich robotic tasks require coordinated motion and impedance under uncertain interaction dynamics and physical constraints. While recent methods on learned policies provide useful interaction strategies, they may fail when contact conditions differ from those encountered during training. Model-based generative methods show promising receding-horizon trajectories optimization results, but often lack structured behavioral guidance and refinement that jointly accounts for constraint geometry and actual contact responses. To this end, we propose Manifold Generative Annealing (MGA), a joint model-free and model-based generative framework for motion--impedance optimization. MGA first organizes pretrained reinforcement learning policies into structured sequence proposals, retaining task-specific interaction strategies without committing to their execution. It then evaluates these proposals alongside exploratory samples through model-based rollouts for refinement or separate execution selection. Crucially, realization-aware manifold refinement aligns updates from the refinement bank with both task constraints and locally achievable physical responses, allowing learned experience to guide online adaptation under changing contact conditions. Experiments cover surface scanning, peg insertion, and humanoid pushing, with improved safety success rate of impedance control under nominal and sensing-shift conditions.

Image Diffusion Models Are Good 3D Human Motion Generators

3.0/5 一般 裁判分 5.0 Candidate 当日相对
Siyuan Yang, Chong Wang, Hao Cheng, ... , Alex Kot, Hedvig Kjellstrom
总结: 图像扩散架构可有效生成3D人体运动。
方法: 关节轨迹成图像,SiT联合生成根与局部潜在。
证据: 单一模型跨不同骨骼布局生成运动。
为什么适合我: 扩散生成人体动作便于重定向到机器人。
推荐理由: 用扩散模型生成三维人体动作,可作运动先验,但停留在运动学生成,没有物理角色控制或上真机跟踪。
原摘要

Text-to-motion generation typically relies on dataset-specific skeletal representations, with models trained separately for benchmarks with different joint layouts. We investigate whether image diffusion architectures can model 3D human motion through a common image-compatible representation that accommodates heterogeneous skeletal layouts while preserving motion-specific kinematic structure. To this end, we organize root-centered joint trajectories into topology-informed joint--time images and model global root dynamics through a complementary latent stream. A motion autoencoder conditions local-motion decoding on the root latent, while a text-conditioned Scalable Interpolant Transformer (SiT) jointly generates both latent streams, with supervision on decoded 3D joint positions further constraining generation in motion space. In addition to dataset-specific models, we train a single motion autoencoder on HumanML3D and KIT-ML, followed by a single text-conditioned SiT shared across both datasets, preserving their respective skeletal definitions without skeleton retargeting to a common joint layout. Experiments on HumanML3D and KIT-ML show that our dataset-specific models achieve state-of-the-art performance, while shared training yields further gains on both benchmarks, demonstrating the benefits of shared modeling across heterogeneous skeletal layouts.

Anutam Srinivasan, Siddhant Panse, Glen Chou
总结: 学习感知鲁棒自适应MPC保证未来参数学习。
方法: 系统级合成预测不确定性构建紧可达集。
证据: 降低保守性并扩展到四足全身控制。
为什么适合我: 支持复杂场景感知运动与自适应全身控制。
推荐理由: 学习感知鲁棒自适应MPC并提到可扩展到全身控制,但是控制理论框架,不是感知运动、跟踪或模仿。
原摘要

Robust adaptive control is vital for keeping robots safe while actively reducing uncertainty in unfamiliar settings. However, traditional methods are often conservative since they fail to account for guaranteed future parameter learning during planning and struggle to scale to high-dimensional systems. In this work, we present A-SLS, a learning-aware robust adaptive model predictive control (RAMPC) framework based on system-level synthesis. A-SLS forecasts future parameter uncertainty and preserves correlations between process disturbances, parameter error, and estimate updates to construct tight, guaranteed reachable sets that account for future information gain. We also develop a GPU-accelerated A-SLS solver to enable real-time performance. Across nonlinear robotic systems, A-SLS reduces reachable-tube conservativeness, maintains real-time performance, and scales to whole-body control for a quadruped with 61 states, 8 uncertain parameters, and 12 control inputs. We further demonstrate the approach on hardware, where a physical Crazyflie drone learns an uncertain dynamics parameter online to stabilize on the fly.