Papers for 2026-10-26

10 papers

Throwing a Tight Spiral American Football by a Humanoid Robot

4.0/5 相关 裁判分 8.0 Strong 当日相对
Zaid Mahboob, Bowen Weng
总结: 人形机器人实现美式足球稳定螺旋投掷。
方法: 精确调控耦合动量与释放瞬态接触动力学。
证据: 高自由度运动半秒完成,释放亚百毫秒。
为什么适合我: 契合人形全身控制与接触丰富场景智能。
推荐理由: 直接做人形机器人高速全身投掷,涵盖高自由度动量调节与释放瞬间接触动力学,贴近人形全身控制与接触丰富技能。
原摘要

Accurate throwing of the American football requires precise regulation of release conditions, where coupled linear and angular momentum determine flight stability and targeting accuracy. While prior work on robotic object throwing has largely focused on generating dynamically feasible release velocities using open-gripper paradigms, explicit control of spin injection at detachment remains underexplored, particularly for aerodynamically anisotropic objects like the American football. In this paper, we present the spin-stabilized controlled tight spiral throw of an American football by a humanoid robot. Achieving this requires (i) accurately reaching the desired coupled momentum, which often involves high degrees-of-freedom (DoF) movements completed within approximately half a second, and (ii) managing the complex transient contact dynamics that arise during the sub-100-millisecond release phase, when the football is effectively underactuated as it moves partially across the fingers. To this end, we develop a coupled whole-body control strategy where the lower body is performing informed stabilization while the upper body is further divided into two phases with (i) a throw phase accelerating the football to a target state through trajectory optimization and tracking, and (ii) a follow-through phase utilizing model predictive control to actively control the wrist and remaining in-contact fingers. The proposed framework is empirically validated on a 29-DoF Unitree G1 humanoid equipped with a 7-DoF Dex3-1 three-fingered gripper. The thrown American football reaches up to 93.6% spin efficiency and a 0.286 radians linear-velocity-to-nose-alignment (nose-angle) error (where an "ideal" tight spiral corresponds to 100 % spin efficiency and 0 radians nose-angle error) at up to a 5.35 m/s linear velocity and an angular velocity of 14.5 rad/s.

Tired Actor: Fatigue-Informed Character Control

3.0/5 一般 裁判分 9.0 Top pick 当日相对
Shengyuan Zhang, Xinpeng Liu, Muchun Niu, ... , Cewu Lu, Yong-Lu Li
总结: 疲劳先验提升物理角色运动自然性。
方法: 用3CC模型将疲劳注入运动模仿策略。
证据: 获得不同疲劳状态的通用模仿策略。
为什么适合我: 助力人体动作转可跟踪可重定向控制。
推荐理由: 最接近物理角色控制与运动先验,用疲劳能量约束改进物理仿真角色模仿;但停留在动画角色,不涉及人形真机跟踪、重定向或地形/接触运动。
原摘要

Replicating human behavior with physics simulation has been a long-expected goal in character animation. Existing efforts have achieved impressive performance in imitating a wide span of general motions. However, most existing efforts could still suffer from unnatural movements due to the lack of biomechanical and physiological priors. Given this, we project our sights to advances in behavioral energetics, which demonstrate how energy use shapes human movements. In contrast, current character controllers typically assume the character is equipped with infinite energy over time. Inspired by these, we propose to adopt fatigue as a proxy of the finite energy limit, inject it into general character animation, and thoroughly investigate how fatigue introduces new characteristics to physics-based character control. Leveraging the Three-Compartment Controller (3CC) model, we managed to obtain a policy for general motion imitation under different fatigue statuses. Furthermore, extensive analyses are conducted to demonstrate how fatigue could influence the naturalness, scalability, and robustness of character animation. Our code will be made public.

Fucai Zhu, Yanhou Lai, Paul Maestre, Koichi Hashimoto
总结: 低成本视觉触觉遥操作提升灵巧学习。
方法: SLAM腕部跟踪与相机手部加振动反馈。
证据: 触觉提升接触任务成功率与主观信心。
为什么适合我: 支持接触丰富场景感知运动数据采集。
推荐理由: 是机械臂与灵巧手的低成本视觉触觉遥操作,且依赖SLAM腕部跟踪;不是人形全身遥操作或腿足运动。
原摘要

Learning from demonstration is a promising approach for dexterous manipulation, but collecting high-quality contact-critical demonstrations remains difficult with low-cost teleoperation hardware. We present ViHaTeleop, a lightweight (0.7 kg), low-cost (\$550) visual-haptic teleoperation system with SLAM-based wrist tracking, camera-based hand tracking, and finger-wise vibrotactile feedback through Linear Resonant Actuators (LRA). The system includes several design choices (LED illumination, fisheye hand camera, and tactile-aware retargeting constraints) and is deployed on Franka + LEAP Hand + 9DTact in both real and simulated environments. Under matched with/without-haptic conditions with nine participants across six contact-critical tasks, haptics improved success rates across all tasks (+2.2 to +15.6 percentage points), while completion-time effects were task-dependent. Subjective ratings showed significant gains in contact clarity and grasp confidence in both simulation and real-world settings (Wilcoxon signed-rank, $p<0.05$). We also integrate a lightweight depth-camera-based tactile proxy in Isaac Sim, enabling a full pipeline from multi-modal demonstration collection to visual-tactile policy training. Preliminary downstream validation by training visual-tactile policies from collected demonstrations shows tactile cues benefit contact-critical subtasks (peg-in-hole: +17 percentage points over vision-only).

StructRL: Structured Action-Space Exploration for Flow-Based VLAs

2.0/5 偏低 裁判分 7.0 Strong 当日相对
Jiarui Yang, Bin Zhu, Jingjing Chen, ... , Jianggang Zhu, Yu-Gang Jiang
总结: 结构化动作探索改进流式VLA的RL。
方法: 确定性ODE解码加动作空间结构化噪声。
证据: 避免噪声稀释以提升有效探索效果。
为什么适合我: 强化学习可迁移至全身运动策略适应。
推荐理由: 面向flow式VLA操作策略的结构化探索,仅方法上沾强化学习;对象不是人形/腿足全身控制。
原摘要

Flow-based Vision-Language-Action (VLA) models are now widely used for continuous robotic manipulation, and online reinforcement learning (RL) is emerging as a key technique for adapting them to new tasks. Existing RL methods typically inject stochasticity inside the denoising chain, often through isotropic or temporally independent noise. However, effective robot exploration calls for structured noise: temporally smooth and scaled differently across action groups. We show that simply switching the in-chain noise to a structured form does not suffice: noise added at an intermediate flow time can be weakened by the remaining denoising steps before execution, a phenomenon we call \emph{Structured Noise Dilution}. We propose \textbf{StructRL}, which avoids dilution by relocating policy stochasticity to the action space via three coupled choices: (i) a deterministic ODE decoder, (ii) structured noise injected directly in the action space, and (iii) last-step replay, where policy-gradient updates avoid assigning likelihoods to intermediate denoising states. This keeps structured exploration tied to the executed action while providing a tractable training signal for the flow decoder. Across three flow-based VLA models on multiple simulated manipulation benchmarks and two real-world tasks, StructRL improves exploration efficiency and OOD performance over prior in-chain baselines, demonstrating the effectiveness of structured action-space exploration for adapting flow-based VLA with RL. \textbf{Project page:} https://flyfaerss.github.io/structrl/

Yuankun Chen, Zifei Nie, Xun Gong, Yunfeng Hu, Hong Chen
总结: 矩阵无关可微NMPC求解器加速优化。
方法: 近端准牛顿自适应线搜索加Krylov伴随。
证据: 避免显式海森雅可比降低计算成本。
为什么适合我: 直接支持全身模型预测控制高效实现。
推荐理由: 通用可微NMPC数值求解器,与全身模型预测控制仅有算法层面联系,无人形或腿足应用。
原摘要

Differentiable nonlinear model predictive control (NMPC) provides a principled way to embed optimal control structure into end-to-end learning paradigms, but its practical use is often limited by the computational and memory costs of both forward optimization and backward sensitivity propagation. This brief proposes PANDA, a matrix-free solver for differentiable NMPC. In the forward pass, PANDA combines proximal-gradient iterations with quasi-Newton acceleration and introduces an adaptive stepsize enlargement mechanism to mitigate the conservativeness of monotone stepsize reduction. The resulting stepsize behavior and its effect on local convergence are theoretically analyzed. In the backward pass, PANDA performs implicit differentiation from the residual equation and computes adjoint sensitivities using Krylov-subspace iterative methods together with automatic-differentiation-based Matrix-Vector product operators, thereby avoiding explicit Hessian and Jacobian construction. The method is evaluated on a nonconvex trailer NMPC problem embedded in an imitation learning task. The results show that PANDA achieves much faster forward and backward computation and lower memory overhead than representative differentiable optimization solvers, while maintaining effective imitation learning performance.

Michael Zeng, Abhinav Agarwal, Ajay Bati, ... , Siddharth Ancha, Russ Tedrake
总结: 重审视开环执行以提升模仿反应性。
方法: 分析非马尔可夫演示对开环视野影响。
证据: 多仿真真机任务验证非马尔可夫作用。
为什么适合我: 优化人体动作模仿的全身控制策略。
推荐理由: 讨论模仿学习中的开环action chunking与反应性,场景是一般操作策略,不是全身运动跟踪或loco-manipulation。
原摘要

Action chunking --- the practice of predicting a sequence of actions and executing a prefix open-loop --- has emerged as a key enabler of recent progress in imitation learning for robotic manipulation. However, executing long open-loop prefixes reduces reactivity, limiting policies' ability to correct for errors. Further, the mechanisms underlying these performance benefits remain poorly understood: prior works cite mitigating compounding errors, absorbing inference latency, or smoothing motions, but provide limited controlled evidence or guidance for preserving reactivity. In this work, we argue that long open-loop execution primarily helps short-context policies imitate "non-Markovian demonstrations". Across four simulation and two real-world tasks, we show that expert non-Markovianity strongly shapes the relationship between task success and open-loop execution horizon. Further, we investigate the impact of compounding errors --- the prevailing explanation for long open-loop execution in prior work --- and find that while they matter, expert non-Markovianity has a much stronger impact in our experimental setting. Finally, we show that when policies are provided with a sufficiently long context, open-loop execution is no longer beneficial and the most reactive, closed-loop policies perform best. While imitation learning has seen great success using long open-loop execution, our findings motivate long-context, reactive policies as a more principled and performant paradigm.

Ananya Bal, Kartik Sharma, Ethan Lai, ... , Chaitanya Chawla, Laszlo A. Jeni
总结: 掩码自回归扩散生成文本手物交互。
方法: 连续潜空间解耦手物加掩码自回归扩散。
证据: 支持变长复合运动补全与可靠终止。
为什么适合我: 扩散模型用于接触丰富交互可扩展全身。
推荐理由: 文本驱动的手物交互动画生成,虽用扩散模型且涉及接触,但是图形学生成而非可跟踪、可上真机的全身控制。
原摘要

Methods for text-based generation of hand-object interaction (HOI) sequences primarily focus on producing smooth, physically plausible trajectories. A truly utilitarian method should additionally support variable-length generation, composite motion sequences, motion completion and infilling, and reliable termination without compromising physical plausibility. Standard diffusion models for HOI generation are typically trained only for text-to-motion generation on atomic motions and require the motion length to be specified a priori. Autoregressive (AR) methods provide greater sequence-level flexibility, but commonly depend on discrete motion codes, which can lose contact-sensitive motion detail. To address these key limitations, we present a model performing Masked Autoregression with Diffusion for HOI generation (MAD-HOI). Our method starts by encoding hand and object motions in a continuous latent space while keeping them disentangled to maintain stream-wise control. This is followed by a masked autoregressive transformer to predict context features that condition a flow-matching head. MAD-HOI is capable of motion generation for atomic and composite articulated sequences, conditioned motion completion and infilling, as well as EOM (End of Motion) prediction from a single training objective. We provide comprehensive evaluations for these capabilities and benchmark our method on the ARCTIC and GRAB datasets. Our experiments show that MAD-HOI achieves the strongest text-motion alignment and distributional generation quality against baselines on both ARCTIC and GRAB, while maintaining competitive geometric accuracy and physical plausibility.

Xinyi Zhang, Yinuo Zhao, Pei Ren, ... , Chi Harold Liu, Jian Tang
总结: 利用不一致人类干预改进强化学习。
方法: 分布RL分位数Q网络加悲观探索策略。
证据: 多仿真挑战任务评估安全高效学习。
为什么适合我: 强化学习与干预契合真机全身部署。
推荐理由: 用分布强化学习处理操作任务中不一致的人类干预,不属于人形遥操作、动作重定向或腿足控制。
原摘要

Correcting robot manipulation policies through human intervention holds great promise for real-world deployment, yet human operators are inherently imperfect in both the actions they provide and the timing of their intervention signals. While the former has been extensively discussed in reinforcement learning (RL), the latter remains underexplored. At high control frequencies, human intervention signals are often delayed and inconsistent across time and state space. In this work, we present GAINS, a framework for leveraging inconsistent human intervention signals in RL. At the core of GAINS, we employ distributional RL with quantile Q-networks to model the return variability induced by sparse task rewards and inconsistent human interventions. Building on this distributional representation, we introduce a pessimistic exploration strategy that promotes safe and sample-efficient learning under human corrections. We evaluate GAINS on four diverse simulated manipulation tasks and two challenging real-world scenarios against state-of-the-art intervention-based methods. GAINS achieves a 22% higher task success rate than RLIF and improves recovery success by up to 43% in failure scenarios. These results highlight the importance of modeling return variability induced by human imperfection for real-world deployment of intervention-based learning.

Yijie Xu, Haopeng Jin, Run Zhou, ... , Huajie Tan, Shanghang Zhang
总结: 历史条件OOD感知过程奖励提升操作。
方法: 历史条件成对奖励与OOD感知进度空间。
证据: 解决时间模糊与OOD执行区分问题。
为什么适合我: 过程奖励可助全身运动RL精炼策略。
推荐理由: 为VLA操作策略学习过程奖励,聚焦桌面操作的OOD与误差累积,与全身运动智能无关。
原摘要

Vision-language-action (VLA) models improve robotic manipulation but remain vulnerable to compounding errors, scene changes, and off-trajectory states. Reinforcement learning can refine pretrained VLA policies, yet sparse success signals hinder exploration, while engineered dense rewards are costly and task-specific. Existing learned visual reward models often rely on static before-after observations, causing temporal ambiguity and weak discrimination between robustness-preserving variations and task-invalid failures under out-of-distribution (OOD) execution. We introduce Robo-Dopamine 2.0, a history- and OOD-aware process reward model with a pairwise prediction interface. It combines (1) history-conditioned pairwise rewards that use source-aligned reference panels for synthetic OOD queries and observed rollout history for online queries, while preserving the queried endpoints, and (2) an OOD-aware signed progress space that represents valid progress, robustness, failure, and recovery. A Signed-Hop Curriculum with transition-aware replay learns coarse execution ordering before fine-grained progress calibration. We also construct an OOD trajectory dataset and a five-family benchmark. Reference panels improve mean visual order consistency (VOC) from 0.967 to 0.986 and OOD-robust VOC from 0.906 to 0.958. With the same 400K pairwise-reward budget, Signed-Hop training with 25% replay reaches 0.9872 mean VOC, compared with 0.9858 for a matched-pool shuffled control. In downstream reinforcement learning, the full model achieves 86.8% mean RoboTwin success and 71/80 successful real-world insertions.

Colin Merk, Stefanos Charalambous, Peter Dürr, Farshad Khadivar
总结: GPU加速安全规划器实现实时碰撞感知。
方法: B样条参数化加卷积网络与条件VAE采样。
证据: 近毫秒推理达分析级成功率用于RL重置。
为什么适合我: 支持复杂地形碰撞感知全身运动生成。
推荐理由: 已知环境中的关节空间避碰轨迹生成,属于通用运动规划,不是感知运动、跑酷或全身模型预测控制。
原摘要

We present GASP, a GPU-Accelerated Safe Planner for real-time, collision-aware joint-space motion generation in known environments. GASP combines a clamped B-spline trajectory parameterization with a convolutional residual neural network that predicts the free interior control points, while analytically inserted boundary control points enforce initial and final derivative constraints for collision-aware planning under non-stationary conditions. A conditional variational autoencoder samples multiple trajectory candidates, which are decoded and validated in parallel on the GPU, yielding a batched planner for collision-aware coupled joint-space motion with near-millisecond inference. We validate GASP as an online motion-generation module, where it achieves analytical-level success rates with high collision-aware feasibility and substantially reduces inference time relative to GPU-based trajectory optimization. We further deploy GASP as a reinforcement-learning reset planner in competitive robotic table tennis, matching the baseline return rate while roughly halving training-time collisions.