Papers for 2026-11-12

10 papers
Xianghui Wang, Aoran Fu, Liyou Luo, ... , Dan Zhang, Wei Zhang
总结: 单手持物造成的非对称负载会破坏人形速度跟踪。
方法: 估计外力调制演员特征,并让有载与无载跟踪保持一致。
证据: 摘要仅给出方法设计,未见量化跟踪误差或实机结果。
为什么适合我: 正好对应人形移动操作里的速度跟踪与负载补偿。
推荐理由: 直接解决人形移动操作中单手负重带来的速度跟踪偏差,属于人形全身控制与loco-manipulation。
原摘要

In recent years, humanoid loco-manipulation has progressed to whole-body grasping, lifting, and transport. A basic requirement underlying these tasks is carrying the object to its destination, which depends on the locomotion controller accurately executing velocity commands from the navigation policy. However, carrying an object in one hand introduces a persistent asymmetric upper-body load that can degrade velocity tracking. Persistent tracking biases can accumulate into position and heading deviations, increasing the risk of collisions and navigation failure. To address this problem, we present ReACT, a framework for accurate velocity tracking under asymmetric upper-body loads. Reflection-consistent disturbance modulation uses the estimated wrench to modulate actor features for load compensation while preserving action correspondence under reflected observations. Cross-load tracking consistency training compares loaded and unloaded conditions under the same velocity commands to promote consistent velocity tracking across loading conditions. Simulation experiments on a Unitree G1 humanoid robot show improved velocity tracking and reduced directional bias under varying asymmetric loads. Real-world experiments demonstrate collision-free goal reaching in all 40 tested navigation trials under unilateral hand loads with a fixed mapless navigation policy.

RedirectMimic: Local Motion Content Redaction for Humanoid Whole-Body Control

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
Zepeng Wang, Xiaochuan Shi
总结: 控制器可在仍接收原参考时替换指定局部动作。
方法: 部署观测不变,近端策略优化改用规则编辑参考计算跟踪奖励。
证据: 过顶臂任务核心内容出现率降至2.7%,关节窗口成功率为94.2%。
为什么适合我: 高度契合人形全身控制、动作模仿与强化学习跟踪。
推荐理由: 在Unitree G1上改写参考动作并保持全身跟踪接口,紧密对应全身运动跟踪与动作模仿。
原摘要

Humanoid motion interfaces should accommodate application-specific movement constraints while retaining useful reference behavior. Local content redaction requires a controller to replace selected movements even when it continues to receive the original reference. Removing the tracking incentive for those movements leaves their replacement unspecified. We introduce RedirectMimic, which separates the reference observed by the actor from the target used to train its execution. A rule-generated edited reference guides tracking rewards during proximal policy optimization, while the deployed observation and action interfaces remain unchanged. We evaluate pose- and speed-defined arm editing in Unitree G1 simulation using a tracker pretrained on 7,509 motion clips. On the overhead-arm task, RedirectMimic reduces core-window content occurrence to 2.7%, compared with 58.9% for reward zeroing and 32.8% for anti-tracking. It achieves 94.2% core-window joint success, combining content suppression, fall-free execution, and local retention. On the speed-defined task, fast outward arm movements occurred at similarly low rates under all three local editing methods. Across both tasks, RedirectMimic achieved the lowest replacement error among these methods and tracked unedited motions with accuracy comparable to that of the pretrained controller. Project page: https://xiaopeng-whu.github.io/RedirectMimic/.

AHEADance: Anticipatory Humanoid Dance from Streaming Audio

4.0/5 相关 裁判分 8.0 Strong 当日相对
Tianhu Peng, Yukun Wang, Lingfan Bao, Yiyang Jia, Chengxu Zhou
总结: 流式伴舞必须在对应音乐到达前提交下一段人形动作。
方法: 依据已听片段和可靠度加权的音乐预报生成动作,并强制从已提交块续接。
证据: 承诺强制使低活动比例从83.5%降至10.3%,并提升节拍同步。
为什么适合我: 依赖全身跟踪器执行,但任务是舞蹈生成而非运动控制。
推荐理由: 流式音乐生成舞蹈并由人形全身跟踪器执行,接近全身运动跟踪与动作生成,但重点是舞蹈同步而非运动控制。
原摘要

A humanoid that dances to streamed music must commit each motion chunk before it has heard the music that chunk accompanies, and must continue from motion it has already committed. We present AHEADance, a robot-native streaming dance generator executed on a humanoid robot by a whole-body tracker. ListenAhead conditions each chunk on heard music and a frozen music model's forecasts of the coming music, aligned to their target times and weighted by reliability. The forecasts carry the timing of upcoming beats almost as well as the actual future; with them, the generator is better synchronized with the music and concentrates more motion energy at its song's beat frequency. Commit Forcing trains continuation from the model's own committed chunks, updating both the latent history and the decoded boundary of the next chunk; it reduces low activity from 83.5% to 10.3%, the level of real dance. Three music evaluators, each validated on real G1 dance, test synchronization, song and style. On a physical Unitree G1, it dances while the music plays and comes to rest when it stops, without a fall. Project page: https://ihcr.github.io/AHEADance

Improving the Diffusability of Motion Tokenizer

3.0/5 一般 裁判分 7.0 Strong 当日相对
Guanhe Huang, Songqiao Han, Tangzheng Lian, Oya Celiktutan
总结: 人体动作词元潜空间偏高频,导致扩散生成与重建难以兼得。
方法: 用预训练扩散模型作批评以抑制高频潜能量,并用生成式解码保动态。
证据: 摘要指出增大词元器容量改善重建,却未同比提升文本条件生成。
为什么适合我: 主要服务人体文本动作生成,与足式及人形控制距离较远。
推荐理由: 改进人体运动扩散分词器,方法上接近扩散模型运动生成,但未涉及机器人重定向、跟踪或控制。
原摘要

Latent diffusion models paired with a variational auto-encoder (VAE) tokenizer have shown promising performance for efficient text-driven human motion generation. However, motion latent diffusion suffers from a generation-reconstruction trade-off: simply increasing tokenizer capacity enhances reconstruction but fails to proportionally improve text-conditioned generation quality. We assume this trade-off stems from a spectral mismatch inside the VAE tokenizer: the encoder yields a latent space biased toward high frequencies, and the decoder introduces temporal artifacts. In this paper, we propose the Diffusable Motion Tokenizer (DiMoT) to improve the diffusability of the tokenizer, rather than scaling up the diffusion backbone. To improve text-conditioned optimization, Critic Spectral Adaptation (CSA) leverages a pretrained diffusion model as the critic to suppress high-frequency latent energy. To preserve motion dynamics, the Alpha-Flow Motion Decoder (AMD) performs generative decoding via average-velocity prediction, enabling efficient one-step decoding. Extensive experiments demonstrate that DiMoT achieves state-of-the-art performance across various challenging text-to-motion benchmarks, yielding superior motion fidelity and text-motion alignment. Project page: https://githubhgh.github.io/dimot/.

Huaijin Pi, Zehong Shen, Yong Wang, ... , Yujun Shen, Taku Komura
总结: 由人类手物交互低成本扩展出可执行的灵巧机器人演示。
方法: 按抓取模式组织数据,重定向后在手臂跟踪动力学下做物理仿真。
证据: 目标是覆盖不同物体与操作位置,并得到臂指动作及视觉观测。
为什么适合我: 契合人体到机器人重定向、仿真演示与灵巧操作数据生成。
推荐理由: 从人手物体交互扩展灵巧示教,仅部分接近人体到机器人重定向,核心是灵巧VLA数据而非人形全身控制。
原摘要

We study how to generate diverse, physically executable robot demonstrations for dexterous vision-language-action (VLA) learning. Existing demonstration-generation methods typically rely on costly teleoperated examples. Meanwhile, human hand--object datasets provide a reusable source, but existing transfer methods mainly reproduce given interactions. Turning these interactions into VLA training data further requires coverage of different objects and manipulation locations, together with executable arm and finger actions, and visual observations. To achieve this, we present DexSeed, a framework for low-cost generation of dexterous robot data from human hand--object interactions. Our key idea is to expand human sequences while preserving their grasps and realizing the resulting motions under arm-tracking dynamics in physics simulation. Specifically, we organize source sequences by grasp mode with shared language descriptions. InteractionMesh-based retargeting and arm trajectory augmentation adapt these sequences to the robot hand, different object geometries, and pick-and-place locations while preserving local hand--object relationships. An RL finger-control policy produces executable rollouts, while the arm tracks precomputed trajectories. Rendered observations and recorded actions from successful rollouts are paired with grasp descriptions to fine-tune a VLA. Experiments show improved contact fidelity in retargeting and more reliable whole-arm execution than the evaluated baselines. Simulation evaluation and real-world deployment further demonstrate that a VLA fine-tuned solely on the generated demonstrations can execute language-specified grasps. Project page: https://robbyant-research.github.io/DexSeed/.

Ilia Larchenko, Gleb Zarin, Atindra Nair, ... , Mirko Kiefer, Anjana Yodaiken
总结: 一个视觉语言动作检查点覆盖一百项长时程家务任务。
方法: 延长训练并降低梯度噪声,用技能阶段、任务嵌入和二十一维动作空间迁移。
证据: 共享五十项得分由0.260升至0.371,一百项总体得分为0.392。
为什么适合我: 属于长程移动操作策略,不是足式运动跟踪或跑酷。
推荐理由: 百项家庭任务的单一VLA,接近移动操作,但不是人形全身控制、运动跟踪或高动态运动。
原摘要

We describe our solution for the 2026 BEHAVIOR Challenge: 100 long-horizon household tasks in the OmniGibson simulator. We placed 9th on the final leaderboard, the only independent team in the top 10. The core of the solution is a single vision-language-action (VLA) model, one checkpoint for all 100 tasks, built on our 1st-place 2025 solution, which is based on $\pi_{0.5}$. On the 50 tasks shared with 2025, its Q rises from 0.260 to 0.371; across all 100 tasks it scores 0.392. Our main conclusion from 2025 was that the model was undertrained, so most of the 2026 work went into training the model for longer, optimizing some training parameters, making each training step slightly faster and reducing the gradient noise: a migration from 50 to 100 tasks (semantic stages built from the demonstrations' skill annotations, task and stage embeddings of new tasks warm-started from similar old ones, and a 21-dimensional action space matching the teleoperation controls); variance-reduced multi-sample flow matching with a simple noise-vs-compute model that picks the number of action-expert samples per observation without ablations; and a 200k-step training run, about one pass over the 211M frames of the demonstrations. A cloud evaluation infrastructure keeps a shared record with provenance, episode diagnostics and restorable simulator states, and runs six simulators on one GPU together faster than real time. On top of the learned policy, 14 tasks are routed to a GPT-6 Astra coding agent that controls the robot through observation and motion tools, starting every episode from a frozen copy of its own practice session on training instances. Across these 14 tasks, Astra's mean Q is 0.639, against 0.108 for the learned policy. The public submission included only part of the Astra results and scored 0.446 Q with 27.3% full-task success.

Santosh Mohan Rajkumar, Debdipta Goswami, Stephanie Stockar
总结: 图形处理器加速求解线性模型预测控制中的稠密二次规划。
方法: 融合核迭代并用计算图重放,按设备标定选择配置且懒更新算子。
证据: 仿真人形与四旋翼控制中延迟下降,同时保持求解精度与控制性能。
为什么适合我: 直接支撑读者关注的全身模型预测控制实时求解。
推荐理由: 实时MPC的GPU二次规划求解器,仅在仿真人形控制中验证,本身不是全身控制方法。
原摘要

We present FAME-QP, a GPU-accelerated solver for dense quadratic programs arising in linear model predictive control. FAME-QP combines constraint-dependent operator representations with fused single- and two-kernel iterations replayed through CUDA graphs, automatically selecting the execution configuration through device calibration and problem-specific timing. It probes a cached operator bank to select the initial penalty and updates operators lazily when problem matrices change. Numerical benchmarks and simulated humanoid and quadrotor control experiments demonstrate reduced latency relative to competing GPU solvers while maintaining solution accuracy and control performance.

Xu Luo, Jiaying Yang, Hao Wu, ... , Lianli Gao, Jingkuan Song
总结: 长动作块策略若直接用强化学习改动作,在线样本开销很大。
方法: 用离策略强化学习训练轻量适配器,只预测每块执行长度。
证据: 仿真基准和真实机器人任务都显示该适配更节省在线交互。
为什么适合我: 有助长块策略的高效微调,但不是全身运动模仿本身。
推荐理由: 通用长动作块策略的在线样本高效适应,未涉及人形或足式全身控制与运动跟踪。
原摘要

Predicting long action chunks, often spanning dozens of timesteps, has become a key ingredient in increasingly capable robot policies. In this paper, we find that adapting these long-chunk policies with existing reinforcement learning (RL) methods can require many online samples due to the high dimensionality of the action chunks being optimized, making such adaptation impractical in real-world scenarios where interaction data are costly to collect. Our key insight is to shift adaptation from optimizing actions to optimizing how long to execute each predicted action chunk. This keeps the adaptation space low-dimensional while its expressivity grows with the chunk size. We thus introduce Execution at the Right Length (ExRL), a simple approach which augments the base policy with a lightweight adapter that predicts the execution length of each chunk and is trained using off-policy RL algorithms. Across simulation benchmarks and real-world robotic tasks, ExRL enables sample-efficient adaptation of a diverse range of long-chunk policies with minimal task-specific hyperparameter tuning.

Yongxuan Lv, Zhen Fang, Lichen Man, ... , Fei Wang, Feng Zhao
总结: 在线蒸馏把多个视觉语言动作专家合并为一个共享学生。
方法: 学生滚动采集轨迹,在每个观测和流匹配中间态向冻结教师取目标。
证据: 摘要对比了稀疏信用分配、离线蒸馏漏访状态和端点蒸馏缺中间监督。
为什么适合我: 侧重多任务动作策略巩固,与足式全身控制关系有限。
推荐理由: 多任务VLA专家的在线蒸馏整合,属于通用操作策略,不是人形全身控制或运动重定向。
原摘要

Physical intelligence requires embodied agents to ground language in observations and execute actions while retaining useful skills. Vision-language-action (VLA) policies offer a shared interface, but task-specific post-training often produces separate specialists. Consolidation is difficult: mixed-task reinforcement learning provides sparse trajectory-level credit, while offline distillation may miss student-visited observations and endpoint distillation does not supervise intermediate action-generation states. We introduce VLA Multi-teacher On-Policy Distillation (VLA-MOPD), a protocol for consolidating flow-matching VLA specialists. After acquiring task or suite experts, a shared student collects robot rollouts and queries the instruction-routed frozen teacher at each visited observation and intermediate ordinary differential equation (ODE) state. Detached per-flow-step transition targets supervise valid action chunks through a masked local matching loss; an optional reference-policy term supports retention on other tasks. Starting from one trajectory per LIBERO task, VLA-MOPD raises mean success-once from 75.4% to 98.9%, compared with 98.15% for endpoint action distillation. It improves mean RoboTwin 2.0 success from 73.0% to 89.3%; on a Piper robot, two consolidation rounds improve average success from 70.0% to 90.0%. In a near-matched Spatial-adaptation study, reference matching limits the Object suite decrease to 3.0 points, versus 13.2 without the reference term.

FlashMotion: Ultra-Fast Long-Term 3D Motion Generation

2.0/5 偏低 裁判分 6.0 Good 当日相对
Kaixing Yang, Xulong Tang, Ronghui Li, ... , Zijiao Zeng, Jun He
总结: 在很紧的推理预算下生成长时程高质量三维人体动作。
方法: 用三维动作空间的均值流提升轨迹级效率,以应对多步采样与长序列开销。
证据: 同一框架覆盖文本生成动作、音乐生成舞蹈和语音生成手势三类任务。
为什么适合我: 可作重定向前的人体动作源,但不是机器人全身控制。
推荐理由: 面向游戏与数字人的快速三维人体动作生成,未落到机器人全身跟踪或重定向执行。
原摘要

3D human motion generation plays a crucial role in game development, extended reality (XR), digital humans, and embodied simulation. Beyond motion generation, practical pipelines include rigging, retargeting, and rendering, making ultra-fast long-term 3D motion generation without compromising quality valuable for real-time interactive applications. Despite promising progress, high-quality long-horizon motion generation under tight inference budgets remains challenging, owing to 2 coupled bottlenecks: (1) generative strategies that require many sampling steps for high-quality 3D motion generation and (2) model architectures with substantial per-step computational and memory costs for long sequences. We present FlashMotion, a co-designed framework for high-quality long-horizon 3D motion generation under a strict inference budget, covering text-to-motion, music-to-dance, and speech-to-gesture tasks. To enhance trajectory-level efficiency, we introduce a 3D motion-space MeanFlow formulation with kinematic and dynamic consistency constraints for few-step generation, together with an Adaptive Soft masking mechanism for temporally coherent motion editing. To improve per-step efficiency, we design a lightweight non-autoregressive BiMamba architecture with condition-guided state selection and AdaIN-based condition fusion mechanism, enhancing cross-modal alignment and generalization to longer motion sequences. Extensive experiments demonstrate that FlashMotion achieves overall state-of-the-art performance in both quality and efficiency across text-to-motion, speech-to-gesture, and music-to-dance generation. Code is available at FlashMotion (https://github.com/Sun-Happy-YKX/FlashMotion).