Papers for 2026-10-30

10 papers
Sergio A. Esteban, Jason H. K. Siu, Derrick Mach, ... , Joel W. Burdick, Aaron D. Ames
总结: 接触隐式多射击将运动重定向为动力学可行全身轨迹。
方法: 在非线性规划嵌入可微仿真器内部解决接触摩擦约束。
证据: 加速运动模仿RL训练获高成功率低误差并零样本真机迁移。
为什么适合我: 直接支持接触丰富场景人体动作重定向与全身控制。
推荐理由: 直接对应人体动作重定向与模仿:接触隐式多重射击把运动学参考变成满足接触、摩擦、冲击与驱动约束的全身动力学轨迹,并明确服务运动模仿强化学习。
原摘要

Motion retargeting approaches often prioritize kinematic similarity over whole-body dynamics, contact consistency, and actuation limits, yielding references that are difficult for reinforcement learning (RL) policies to reproduce, particularly for contact-rich behaviors. We present a contact-implicit, direct simulation-based multiple shooting (DSMS) framework that transforms kinematically feasible references into dynamically feasible whole-body trajectories. By embedding a differentiable simulator within a nonlinear program, DSMS resolves contact, friction, impacts, self-collision, and joint limits internally while enforcing tracking, actuation, and task constraints without prescribing a contact schedule or introducing explicit contact constraints. Compared with existing retargeting methods, DSMS accelerates motion-imitation RL training and yields policies with high success rates and low tracking error. We further demonstrate zero-shot sim-to-real transfer on the Unitree G1 through command-conditioned walking, jogging, and contact-rich crawling, and a highly dynamic 180-degree jump-turn.

MoRAE: Flow-Friendly Self-Supervised Latents for Text-to-Motion Generation

3.0/5 一般 裁判分 9.0 Top pick 当日相对
Yifei Zhu, Mingyi Shi, Yangyang Cai, ... , Yoshifumi Kitamura, Taku Komura
总结: 诊断文本运动生成自监督潜在失败并提出流友好改进。
方法: 几何分析JEPA谱病态与流残差解码敏感对齐瓶颈。
证据: 基于诊断构建适合流模型的自监督运动潜在表示。
为什么适合我: 可改进扩散生成可重定向可跟踪人体全身动作。
推荐理由: 最接近物理角色控制与运动先验,但只做文本生成人体动作的流模型潜空间,不涉及全身跟踪、重定向或真机控制。
原摘要

Text-to-motion generation must produce motions that are semantically correct, temporally coherent, and physically plausible. A natural approach is to first project motion data into a structured semantic space and then train a generative model within that space. Such a paradigm has been highly successful in image generation through Representation Autoencoders (RAEs), where a frozen self-supervised encoder provides semantic features for diffusion or flow models to learn from. However, direct transfer of such a paradigm to motion space using Motion-JEPA as the frozen encoder fails dramatically. We diagnose this failure geometrically and identify two motion-specific bottlenecks: (1) the JEPA feature space is spectrally ill-conditioned, making the Gaussian-to-data transport unstable; and (2) even with a well-conditioned spectrum, flow residuals tend to align with decoder-sensitive directions, where small latent errors are amplified into large motion artifacts after decoding. Based on these insights, we propose MoRAE. MoRAE addresses the two bottlenecks separately. A compact bottleneck distills the structured JEPA representation while removing weak and redundant directions, bringing the latent spectrum into a transport-stable regime. Motion-coupled training then aligns the retained latent geometry with the decoder, making characteristic flow errors less costly after decoding. With this flow-friendly latent, a standard non-autoregressive Flow-Matching DiT achieves state-of-the-art performance.

Motion Generation With Environmental Constraints

3.0/5 一般 裁判分 6.0 Good 当日相对
Előd Páll, Oliver Brock
总结: 倡导环境约束利用简化高维不确定环境运动规划。
方法: 将ECE集成规划偏向任务区域并利用接触降不确定性。
证据: 用RRT规划器评估并在真实应用中展示实际益处。
为什么适合我: 助力复杂地形接触丰富场景运动规划与loco-manipulation。
推荐理由: 接触丰富场景交互有交集,但是用环境接触简化RRT规划,不是人形/腿足全身控制、模仿或感知运动。
原摘要

Robot motion planning faces challenges in high-dimensional spaces and uncertain environments, often constrained by the need for collision-free motions. We advocate an alternative approach, Environmental Constraint Exploitation (ECE), where deliberate contact with the environment simplifies planning by reducing dimensionality and computational complexity. By integrating ECE into motion planning algorithms, we bias exploration to task-relevant regions and leverage contact for uncertainty reduction to improve robustness during execution. We evaluate ECE benefits with RRT-based planners and demonstrate their practical benefits in a real-world application. This work consolidates and extends prior research, showcasing how ECE simplifies motion planning while enhancing adaptability and performance in complex environments.

Shilin Shan, Chuhao Zhou, Ruize Wang, ... , Jitendra Malik, Jianfei Yang
总结: 综述触觉力感知机器人学习的多模态与多阶段设计。
方法: 统一视角审视力触觉传感与多阶段系统架构整合。
证据: 填补现有综述未覆盖力触觉感知学习统一视角空白。
为什么适合我: 指导接触丰富场景感知运动与力调节策略学习。
推荐理由: 力觉与触觉操作综述靠近全身loco-manipulation,但对象是通用接触操作学习,而非腿足全身运动与动作跟踪。
原摘要

Physically grounded robot intelligence requires robots to perceive, reason about, and regulate their interactions with the physical world. This capability is particularly critical in contact-sensitive manipulation, where successful task execution depends not only on visual perception and motion generation, but also on force regulation and adaptive control. In this context, recent robot learning methods have made substantial progress by integrating force, tactile, vision, language, and proprioceptive sensing into learned manipulation policies. In parallel, many systems adopt multi-phase architectures that combine high-level policies, action-refinement modules, and low-level controllers to bridge semantic task understanding with reactive physical execution. Despite these advances, existing surveys have not explicitly reviewed force- and tactile-aware robot learning from a unified perspective that jointly captures multimodal sensing and multi-phase system design. This survey addresses this gap by proposing TF-ART, a Tactile/Force-Aware Robot learning Taxonomy for multimodal and multi-phase frameworks, which maps individual methods into a unified hierarchical structure. The framework characterizes how recent works organize observation modalities, encode and fuse heterogeneous sensory inputs, generate and refine actions across multiple phases, and connect learned policies to reactive robot-end control. Building on this methodological view, we further examine the task settings and infrastructure requirements of physical interaction, thereby integrating both algorithmic and practical perspectives on force- and tactile-aware robot learning.

Tongyan Wang, Zhengyuan Li, Muhan Lin, ... , Baijian Yang, Yingjie Victor Chen
总结: 从片段级监督学习细粒度运动语言帧短语对齐。
方法: 分割描述为短语并用最优传输建模多对多对齐。
证据: 在SnapMoGen上展示所学对齐提升细粒度生成效果。
为什么适合我: 提升文本生成精确动作以支持重定向全身控制。
推荐理由: 仅做动作-语言细粒度对齐的人体动作生成,不落到可跟踪、可重定向的全身机器人控制。
原摘要

Text-conditioned human motion generation has made rapid progress with the emergence of large-scale motion--language datasets. However, even datasets with rich long-form descriptions typically provide supervision only at the clip level, without explicit temporal correspondence between motion frames and language. This limits fine-grained motion--text grounding and temporally precise generation. We propose FineMoLA, a weakly supervised framework that learns fine-grained frame--phrase correspondence directly from clip-level annotations. Our method first segments long-form descriptions into action-bearing phrases, and then formulates motion--language alignment as an optimal transport problem, which naturally models many-to-many relations between motion frames and text under global constraints. With entropic regularization and Sinkhorn iterations, FineMoLA efficiently infers pseudo frame-level alignments without human labeling. Experiments on SnapMoGen demonstrate that the learned alignments outperform baselines in motion--text grounding.

Ying Chen, Weizhen Li, Zhe Hu, ... , Lei Yi, Jie Chen
总结: 构建以执行为中心的具身视觉语言模型能力分类。
方法: 按执行功能角色组织空间推理等四类能力训练。
证据: 围绕执行整体整合能力而非孤立任务特定目标。
为什么适合我: 增强人形机器人感知推理与全身动作执行闭环。
推荐理由: 具身视觉语言模型的执行推理,与人形全身运动智能、感知运动和运动先验方法栈不匹配。
原摘要

Vision-language models are increasingly serving as the reasoning core of embodied agents. Robot execution is inherently iterative: each action reshapes the scene and physical state, continually renewing what must be perceived, reasoned about, and verified. Meeting these demands requires complementary capabilities that differ in supervision signals, prediction formats, and verification criteria. Existing approaches typically develop these capabilities against isolated, task-specific objectives, leaving open how they should be organized and integrated around execution as a whole. We present Capek 0.5, an embodied vision-language model built around an execution-centric capability taxonomy. Rather than organizing training by datasets or tasks, the taxonomy groups embodied capabilities according to their functional roles throughout execution and comprises four capability families: Spatial Reasoning, Temporal Understanding, Action Guidance, and State Verification. Each capability is first acquired by a dedicated specialist through reinforcement learning with verifiable rewards from a shared backbone, and the specialists are then consolidated into a single inference-time model through weight-space merging followed by routed policy-space distillation. We instantiate Capek 0.5 at the 2B and 35B-A3B scales and evaluate it from three complementary perspectives: comprehensive benchmark suites including Capek-StateBench, a new benchmark for state verification; a controlled study of capability retention from specialists to the unified model; and closed-loop evaluation in simulated embodied environments. Capek 0.5 improves the large majority of matched benchmark rows over its initialization, retains all four specialized capabilities in one checkpoint with quantified losses, and transfers to closed-loop embodied task execution.

Ziheng Liu, Quantao Yang
总结: 提出语义动作解耦双时间尺度RL后训练VLA框架。
方法: 冻结视觉语言骨干分别优化语义投影与动作专家。
证据: 解耦更新防止快速策略变化破坏语义表示稳定。
为什么适合我: 优化RL后训练提升操作与loco-manipulation控制。
推荐理由: VLA操作策略的强化学习后训练,不是人形全身控制、跑酷或动作重定向。
原摘要

Vision-language-action (VLA) models are commonly adapted to downstream manipulation tasks via supervised fine-tuning (SFT) or online reinforcement learning (RL) post-training. SFT is prone to distribution mismatch, and existing RL approaches typically apply a single, uniform update strategy to all model components, ignoring their distinct functional roles. We propose TEMPO, a semantic-action decoupled, two-timescale RL post-training framework for VLA models. TEMPO freezes the pretrained vision-language backbone to preserve general semantic representations, and restricts adaptation to two components with dedicated RL optimization loops: the semantic projection layer and the low-level action expert. We update them at different rates--the semantic projection layer infrequently, to keep the latent action stable, and the action expert frequently, to rapidly incorporate control feedback from online interaction. This decoupling RL fine-tuning strategy prevents fast policy updates from destabilizing high-level semantic representations while still allowing the action expert to learn efficiently from online feedback. Experiments on the CALVIN benchmark and real-world manipulation tasks demonstrate that TEMPO consistently outperforms both pretrained state-of-the-art VLA models and the RL post-training baseline, while reaching and maintaining higher evaluation rewards on two real-world tasks.

Riccardo Curcio, Hongpeng Cao, Marco Caccamo
总结: 课程框架整合进化策略与统计验证实现安全策略。
方法: 闭环共优化性能并逐步扩大安全操作区域边界。
证据: Cartpole与四旋翼上安全区域分别扩大6.14与224倍。
为什么适合我: 保障全身运动策略安全稳健的真机部署迁移。
推荐理由: 方法上触及sim-to-real安全验证,但评估停留在倒立摆等通用控制,缺少腿足/人形运动场景。
原摘要

Synthesizing safe and robust neural controllers in simulation for reliable sim-to-real deployment remains a critical challenge in robotics. Existing learning-based methods typically lack safety and performance guarantees over an explicitly defined operating region, while post-training verification techniques provide no mechanism to refine controllers when safety violations are detected. To bridge this gap, we propose a curriculum-driven framework that tightly integrates scenario-based Evolution Strategy with Statistical Model Checking-based verification in a closed-loop procedure. Starting from a candidate region, our approach co-optimizes policy performance while progressively enlarging its safe operating boundaries. Upon termination, it yields a neural controller together with a region over which safety and performance are statistically verified. Extensive evaluations on Cartpole and 3D Quadrotor benchmarks, showing 6.14x and 224.04x expansions, respectively, of the safe operating region over mathematically certified ones, together with physical experiments under both nominal conditions and severe dynamic perturbations, demonstrate that our learned controllers consistently outperform established control-theoretic and learning-based baselines. Furthermore, we show that the size of the verified region serves as a quantitative indicator of policy quality before deployment. These results establish our framework as an automated pipeline for learning, assessing and deploying safe and robust neural controllers from simulation to reality.

Qi Zhao, Guozheng Ma, Yilun Kong, ... , Xueqian Wang, Dacheng Tao
总结: 系统研究RL组件协同以提升连续控制样本效率。
方法: 协调模型表示优化稳定性与探索提出ROSER框架。
证据: 发现组件效能任务依赖盲目堆叠常引发非平稳问题。
为什么适合我: 指导强化学习全身运动智能组件协同高效设计。
推荐理由: 通用连续控制强化学习组件协同,未针对全身运动跟踪、接触运动或模仿学习。
原摘要

Reinforcement learning systems are significantly more complex than other machine learning paradigms due to inherent properties, causing RL system design to jointly account for many tightly coupled factors. Despite advances in individual algorithmic components, their functional interdependencies remain underexplored: do they exhibit mutual synergy or counterproductive interference? To bridge this gap, we conduct a systematic investigation and find that the efficacy of different components exhibits significant task-dependency, and naively stacking state-of-the-art techniques does not necessarily yield performance gains; instead, it often triggers emergent challenges, such as compounded non-stationarity. Building upon these findings, we distill a suite of actionable insights into the principled coordination of these components. Guided by these insights, we propose ROSER, an RL framework that coordinates three critical dimensions: Model-based Representation, Optimization Stability, and Experience Replay. Across diverse continuous-control benchmarks, ROSER consistently outperforms vanilla baselines and achieves 17.60% gains over naive stack. Our findings underscore the necessity of a holistic perspective in RL system design and paves the way for developing sample-efficient agents.

Explore or Converge? Stage-Guided Per-Step Optimization for Diffusion Models

1.0/5 偏低 裁判分 1.0 Candidate 当日相对
Renye Yan, Jikang Cheng, You Wu, ... , Ling Liang, Yimao Cai
总结: 提出阶段引导逐步优化解决扩散RL奖励稀疏问题。
方法: 利用去噪阶段语义差异为每步提供针对性优化信号。
证据: 避免奖励捷径黑客并增强各步动作优化区分度。
为什么适合我: 改进扩散偏好对齐生成可跟踪可重定向全身动作。
推荐理由: 通用扩散模型偏好对齐,与机器人运动生成或全身控制无关。
原摘要

Diffusion models have strong generative capabilities. However, their maximum likelihood training objective only focuses on reconstructing the data distribution, making it difficult to align with specific preferences. Reinforcement learning (RL) for preference alignment in diffusion models is promising but limited by reward sparsity. Since a single reward cannot support optimization, existing RL methods usually backpropagate the final reward to all previous steps. However, denoising is stage-wise, with distinct semantics and controllability. Repeating the final reward across all steps creates a temporal objective mismatch, encouraging reward shortcuts that lead to reward hacking. At the same time, due to reward backfilling, each time step receives the same reward, making it impossible to distinguish between actions, thereby weakening the optimization process. To resolve this issue, we propose Stage-Guided Per-Step Optimization (SGPO) for diffusion models, which jointly leverages signal-to-noise ratio and semantic changes to identify generation stages and adaptively assign stage-specific objectives. Early denoising is chaotic and far from the final reward, resulting in weak reward-behavior correlation. This stage should prioritize exiting the chaotic state. In the mid stage, the latent transitions to a stable structure, where the final reward better corresponds to generative behavior. Therefore, this stage optimizes the final reward while exploring diversity to avoid early convergence to a single mode. In the late stage, the latent's core structure is largely fixed, and preference optimization mainly amplifies local details, risking overfitting. Therefore, stable convergence is preferred to avoid quality degradation. Results from 16 comparative experiments validate SGPO. Our method achieves 26.7% average gains in generative quality and 36.7% higher convergence speed.