Papers for 2026-11-13

10 papers
Meraj Mammadov, Pedro Zuidberg Dos Martires, Johannes Andreas Stork
总结: 在教师训练阶段对齐师生表征,缩小特权信息带来的模仿差距。
方法: 用对比学习构造共享潜空间,并直接在该空间训练教师策略。
证据: 摘要在方法说明处截断,未报告可引用的实验结果。
为什么适合我: 可用于把特权状态教师蒸馏到仅靠机载感知的运动模仿学生。
推荐理由: 通用师生模仿学习,未绑定人形、足式或全身运动跟踪场景。
原摘要

Reinforcement learning (RL) from raw sensory inputs such as images or onboard sensors can be challenging due to high-dimensional observations and sparse rewards. A common strategy is to train a teacher policy with access to privileged state information and then distill it into a student policy that acts from raw inputs alone. However, when the teacher relies on information unavailable to the student, exact imitation may be impossible, creating an irreducible imitation gap. Existing approaches typically mitigate this mismatch through careful reward shaping or additional reinforcement learning on the student policy after the teacher has been trained. Instead, we introduce Representation-Aligned Imitation Learning (RAIL), which addresses the mismatch during teacher training itself. RAIL learns a latent representation shared across teacher and student observations using contrastive learning, and trains the teacher policy directly in this space. Because the teacher policy is constrained to operate on this shared space, it learns behaviors that are reproducible from student observations. This substantially reduces the imitation gap while preserving task performance. Across multiple environments, RAIL outperforms strong baselines without reward modification or post-hoc student fine-tuning, and surpasses direct reinforcement learning from raw observations. The learned representations further enable zero-shot transfer to new tasks through teacher-only training. Project site: https://merajmammadov.com/rail/.

Darren Biskup, Jeonghan Yu, Zibo Yu, Sunil K. Agrawal
总结: 将地面反力与压力中心纳入质心动力学,做直立辅助预测控制。
方法: 实时二次规划在滚动时域内优化辅助力与力矩。
证据: 近三百次试验中,扰动时平面质心峰值误差降百分之十九点六。
为什么适合我: 质心预测控制可借鉴足式平衡,但场景是欠驱动站立康复。
推荐理由: 地面反力感知MPC用于缆驱康复站立辅助,虽用MPC,但不是人形或足式机器人全身控制。
原摘要

Many rehabilitation robots execute prescribed motions using reactive tracking controllers that do not explicitly incorporate the user's instantaneous human-ground interaction. This paper presents Ground Reaction Force-Aware Model Predictive Control (GRF-MPC), a framework for upright physical assistance. By integrating live GRF and center of pressure (CoP) measurements directly into a human centroidal dynamics model, GRF-MPC formulates a real-time quadratic program (QP) that optimizes assistive forces and moments over a receding horizon. We deployed GRF-MPC on the Robotic Upright Stand Trainer (RobUST) in an underactuated 4-cable configuration and evaluated it against a fully actuated 8-cable Cartesian impedance baseline in nearly 300 trials across six healthy participants. Across tasks spanning impulsive perturbations, lunge trajectories, and voluntary limits of stability, GRF-MPC reduced peak planar center-of-mass (CoM) error by 19.6% during perturbations, lowered trajectory tracking error by 24.1%, required 28.7% less net mechanical work, and permitted a 45.9% greater normalized voluntary excursion area. The underlying QP solves in under 1 ms, comfortably enabling 100 Hz replanning and demonstrating that incorporating live human-ground interaction into predictive control yields stronger, more transparent physical assistance with half the actuators.

Guoqiang Liang, Yiqi Lin, Yanzhe Chen, Kevin Yuchen Ma, Mike Zheng Shou
总结: 把机器人低维信号按频域打包进视频扩散空间以联合预测。
方法: 用冻结去噪器的相对重建误差筛选接口,并采用频域打包。
证据: 诊断表明常规空间编码远离先验,频域表示需更少去噪修正。
为什么适合我: 与人形足式全身控制关系弱,仅供视觉动作世界模型参考。
推荐理由: 讨论视频扩散世界动作模型的信号注入接口,泛化机器人动作预测,不针对人形运动跟踪或足式运动。
原摘要

Pretrained video diffusion models (VDMs) offer a powerful foundation for World Action Models (WAMs), which jointly predict robot actions and future observations. Building such models requires injecting low-dimensional robot signals (e.g. proprioception, actions, and values) into a latent space shaped by natural videos, and a key design choice is the interface through which these signals enter: existing schemes treat it as a formatting detail, spending a separate latent frame on each signal or bolting on dedicated encoders and decoders. We argue that signal injection is instead a distribution-alignment problem: how well a representation matches the prior of the pretrained VDMs during denoising. Using the relative reconstruction error of a frozen VDM denoiser as a probe, we find that conventional spatial encodings sit far off this prior, whereas frequency-domain packing yields latents that the denoiser corrects far less. Motivated by this diagnostic result, we propose MetaWAM, which folds all robot signals into a single unified meta-frame: each signal is assigned to a disjoint frequency-domain channel band and lifted to the spatial latent by an inverse DCT, yielding a decodable interface aligned with the pretrained VDM prior without any added module or architectural change. A fixed band layout together with slot-aware routing lets the same meta-frame support policy, world-model, and value prediction over a shared set of robot variables. On RoboCasa, MetaWAM reaches 68.9% success while collapsing the per-signal frames into one and cutting inference latency by 39%, and attains 85.0% success on three real-world Franka tasks. Code and models are available at https://github.com/showlab/MetaWAM

VLA Adaptation with Real and Simulated Data: A Case Study on Robotic Chess

2.0/5 偏低 裁判分 4.0 Candidate 当日相对
Matěj Kripner, Milan Straka
总结: 研究视觉语言动作模型在象棋挪子任务上的数据与仿真微调。
方法: 用遥操作及模仿人类变异的仿真脚本专家演示来微调模型。
证据: 仿真成功率随数据与更新提高,学习率冷却最多增加三十一点。
为什么适合我: 遥操作与仿真演示配比可借鉴,但远离足式全身控制。
推荐理由: 虽用遥操作与仿真示教微调VLA,但任务是SO-101机械臂下象棋,不是人形/足式全身控制、运动跟踪或移动操作。
原摘要

Vision-language-action (VLA) models are trained as general-purpose foundation models for robot learning, and require fine-tuning for each downstream task and robot. This raises practical questions such as how much data and training updates are needed, how checkpoints should be selected, and whether simulation can be leveraged to alleviate the cost of real data collection. We study these questions on a task that requires both precise manipulation and spatial understanding of the scene. In this task, an SO-101 arm moves a chess king between two squares that are given only by their names, such as e4 and a5. We fine-tune $π_{0.5}$ with various dataset sizes and update budgets, using teleoperated demonstrations as well as simulated demonstrations from a randomized scripted expert that imitates the variability of human demonstrations. In simulation, the success rate scales with both data and updates. Importantly, we find that a short learning-rate cool-down adds up to 31 points and is necessary for comparing checkpoints, and that validation loss and action error are unreliable for model selection. On the real arm, we fine-tune on up to 256 teleoperated demonstrations and evaluate ten policies in 25 trials each. Partial results indicate that pretraining on the simulated demonstrations helps substantially, most clearly when real data is scarce. We also present a negative result, in which training on the policy's own rollouts with filtered behavior cloning, RECAP-style advantage conditioning, corrections from an automatic coach, or residual reinforcement learning did not yield a measurable improvement over plain behavior cloning in our setting. We release the simulator, the expert and the real demonstrations.

Hanyu Jin, Kenji Shimada
总结: 用鸟瞰可达性监督结合深度重建来学习导航表征。
方法: 以同一架构预训练并冻结编码器,比较不同表征目标的影响。
证据: 摘要截断于评估说明,没有可引用的下游性能数字。
为什么适合我: 深度与局部可达性或助视觉运动,但未涉及足式全身控制。
推荐理由: 杂乱环境端到端导航的深度表征,未明确足式或人形感知运动,偏通用导航。
原摘要

End-to-end navigation in cluttered environments relies on compact visual representations to support collision avoidance and goal-directed motion. Existing methods typically learn these representations jointly with the policy or through observation reconstruction, which does not explicitly specify what information the representation should preserve. Moreover, they are usually evaluated with a single downstream policy learner, although the benefit of a representation may depend on how the policy is learned. It therefore remains unclear how different representation-learning objectives affect downstream navigation performance and robustness. This work proposes DeRep, a navigation-oriented representation-learning method that combines local bird's-eye-view reachability supervision with depth reconstruction. To compare representation objectives under controlled conditions, we pretrain encoders with a common architecture and freeze them during downstream learning. We evaluate the representations using a linear policy probe, flow-matching imitation learning, and reinforcement learning with PPO. DeRep achieves the lowest linear policy probe prediction error and outperforms reconstruction alone across all six tested PPO conditions. In imitation learning, both reachability-based objectives achieve higher mean success rates than reconstruction alone, with similar mean success rates between the reachability-only and joint objectives. These results demonstrate consistent benefits of incorporating reachability supervision into depth representation pretraining across different downstream learning methods and evaluation conditions. We further deploy the PPO policy with the frozen DeRep encoder in Gazebo and on a physical quadrotor without fine-tuning, demonstrating its capability for zero-shot sim-to-sim and sim-to-real transfer.

Embodied First Exam

2.0/5 偏低 裁判分 3.0 Candidate 当日相对
Kangrui Wang, Qineng Wang, Changhe Chen, ... , Ruohan Zhang, Manling Li
总结: 提出面向编程智能体的统一机器人考试,允许多种控制途径。
方法: 智能体可直接控制、生成代码或训练策略,并有多种评测设定。
证据: 涵盖一千一百五十六项任务、三十五套件和四十七台机器人。
为什么适合我: 新套件包含动态全身控制与仿真工程,值得关注相关基准。
推荐理由: 编程智能体控制机器人的大规模考试基准,动态全身控制只是众多套件之一。
原摘要

Early successes on agentic robotics point to a potential paradigm shift toward using coding agents to control robots. Existing robotics benchmarks are built around visuomotor policy learning, leaving it open whether coding agents can reliably control diverse robots under physical-world constraints. We therefore introduce the Embodied First Exam, a unified, comprehensive, and agent-native evaluation framework where coding agents can choose their own control approach: direct control, code to control, or train a policy to control. We hope it serves as a first exam for coding agents before they enter the physical world, with 1,156 tasks in 35 suites on 47 robots, including 9 new suites that go beyond pick-and-place to spatial puzzles, dexterous manipulation, multi-robot interaction, dynamic whole-body control, and sim-to-sim engineering. Each task can be run in up to three evaluation settings. The Standard Setting mimics the real world: the agent receives only sensor observations and, by default, cannot reset the environment. Its Realtime variant keeps the environment running while the agent reasons. The Privileged Setting gives the agent access to the full simulator state and unlimited resets, allowing it to search for an oracle solution for training purposes. Success rates in this setting serve as an approximate upper bound. On the 456 core tasks, the strongest of eight agents, GPT-6 Astra in Codex, achieves a success rate of 34% in the Standard Setting, leaving much room for improvement. To see where agents fail, we label the stage at which failed attempts go wrong and compare failures across agents, settings, and stage categories.

Autonomous Whole-body Loco-manipulation Using a Snake Robot

2.0/5 偏低 裁判分 3.0 Candidate 当日相对
Adarsh Salagame, Henry Noyes, Haroon Hublikar, Alireza Ramezani
总结: 蛇形机器人以全身任意接触同时完成侧行推进与推物。
方法: 在接触隐式全阶动力学上做轨迹优化,并由几何规划器引导。
证据: 硬件上跨多种构型验证了规划器与名义比例控制器。
为什么适合我: 全身接触移动操作有启发,但平台是蛇形而非人形足式。
推荐理由: 虽是全身loco-manipulation,但平台是蛇形机器人,形态与人形、足式不符。
原摘要

Snake robots can leverage their hyper-redundant morphology for both locomotion and manipulation through distributed body contact but whole-body loco-manipulation is particularly challenging since the entire body serves simultaneously as propulsive mechanism and manipulation tool Prior work on wheeled legged and snake robot platforms has decoupled these functions through dedicated appendages body segmentation or grippers We present closed-loop loco-manipulation with our snake robot COBRA without this distinction such that any part of the body may make contact We develop a contact-implicit dynamic model unifying robot-ground robot-object and object-ground interactions within a Moreau-Jean time-stepping framework and formulate a trajectory optimization over the full-order dynamics guided by a geometric planner and nominal proportional controller to autonomously push an object to a goal location during sidewinding We validate the planner and controller on hardware across varied configurations and present simulation results for a simplified trajectory optimization that resolves robot-object and object-ground contacts

Ruyi An, Mingyuan Zhou
总结: 离线强化学习中用价值扩散策略执行扩散规划给出的动作。
方法: 把规划转移后验里的行为先验替换为价值优化扩散策略。
证据: 摘要截断于算法构造,没有报告实验数字。
为什么适合我: 属于通用离线强化学习,与足式全身控制没有直接关系。
推荐理由: 离线强化学习中扩散策略与扩散规划器结合,无人形或足式全身控制场景。
原摘要

In offline reinforcement learning, diffusion models fill two roles with complementary strengths. Typically guided by a critic, a diffusion policy is value-aware and favors high-return, behavior-supported actions, but it is short-sighted: it never lays out the states it intends to visit. A diffusion planner is far-sighted, synthesizing such a long-horizon trajectory, but it is only behavior-driven at execution, realizing each planned transition using only offline behavior.Each is strong exactly where the other is weak. We introduce DPDP to bring them together at the planner's execution step, where a planned transition becomes an action. Reading the planner's inverse-dynamics executor as a posterior over actions: the environment's transition likelihood relates an action to the planned next state, while the behavioral prior determines its weight under the offline data. Replacing this prior with a value-optimized diffusion policy preserves the planned transition likelihood and favors valuable actions that can serve the plan. We target the resulting clean-action distribution in two ways. A training-free sampler composes policy and inverse-dynamics scores at matched action noise levels and applies Langevin correction; this route uses a shared action noise schedule and an approximately common terminal prior. A preference objective instead amortizes the transfer into a single diffusion executor. Across D4RL, DPDP improves the planner it builds on, staying competitive with reactive diffusion policies on locomotion and leading on long-horizon navigation.

Koopman Model-Based Reinforcement Learning

2.0/5 偏低 裁判分 3.0 Candidate 当日相对
Wenjian Hao, Paulo C. Heredia, Shaoshuai Mou
总结: 用随机库普曼算子线性化未知动力学并学习控制策略。
方法: 单步传播配合评论家保留长期代价,策略梯度化为矩阵乘积。
证据: 摘要说明策略可实时控制,但没有给出量化结果。
为什么适合我: 实时模型强化学习或服务机器人控制,但未面向足式全身。
推荐理由: 用Koopman模型做未知动力学强化学习,属于通用机器人控制,不是人形动作模仿或全身MPC。
原摘要

We propose a Koopman model-based reinforcement learning (K-MBRL) algorithm for controlling nonlinear robotic systems with unknown dynamics. The K-MBRL learns a control policy by minimizing an approximate policy objective that combines the analytical immediate cost with an estimate of the future cost evaluated at the one-step predicted state. To this end, we develop a stochastic Koopman operator-based learning method to approximate the unknown nonlinear dynamics in a linear representation, while a critic function estimates the remaining future cost. This formulation offers two key advantages. First, the linear Koopman dynamics simplify the model-dependent policy gradient computation to a constant matrix product, enabling computationally efficient policy improvement. Second, one-step model propagation mitigates the accumulation of prediction errors associated with long-horizon rollouts while retaining long-term cost information through the critic. The learned policy enables real-time control through feedforward evaluation without online optimization. We establish policy learning convergence guarantees under standard stochastic approximation assumptions. Simulations on HalfCheetah and quadruped four-legged locomotion tasks demonstrate strong sample efficiency and improved performance compared with classical model-free and model-based reinforcement learning baselines. A pendulum swing-up task is used to assess policy gradient approximation accuracy and conduct ablation studies on the learning mechanism and key hyperparameters. The proposed K-MBRL is further validated on a physical quadruped robot performing a challenging sequence of maneuvers: rising to an upright posture supported by two rounded rear feet, maintaining balance during bipedal walking, and safely returning to the ground, as shown in Fig.1.

eSharp: Diffusion-based Sharp Monocular Metric Event-to-Depth Estimation

2.0/5 偏低 裁判分 2.0 Candidate 当日相对
Qiushi Dai, Aniket Dashpute, Yuhao Liu, ... , Guha Balakrishnan, Ashok Veeraraghavan
总结: 用事件相机结合预训练扩散先验估计锐利单目度量深度。
方法: 用共注册帧相机产生的激光标定稠密伪标签做跨模态蒸馏。
证据: 实验显示真实数据上优于既有方法,但摘要未给出具体数字。
为什么适合我: 高速高动态深度估计或服务跑酷感知,本身不是运动控制器。
推荐理由: 事件相机单目度量深度估计,偏通用感知而非足式地形感知运动或人形控制。
原摘要

Depth perception is fundamental for autonomous navigation, industrial inspection, and mixed-reality systems. It often operates under strict constraints on power and form factor. In such cases, monocular depth estimation (MDE) is often used. Even as recent advances continue to improve monocular depth quality, conventional frame-based MDE systems remain challenged by fast motion and high-dynamic-range scenes. This work introduces eSharp, an MDE framework that addresses these problems using an event camera. eSharp repurposes pretrained diffusion priors for event-only MDE and produces accurate metric depth with unparalleled sharpness on real data. Real-world event datasets provide only sparse LiDAR depth maps for ground-truth supervision, making dense prediction challenging. We address this limitation through cross-modal distillation, using LiDAR-calibrated dense pseudo-labels generated from a spatially co-registered frame camera to train eSharp. Experiments show that eSharp outperforms prior event-to-depth baselines in both metric-depth accuracy and spatial fidelity, establishing diffusion models as a promising foundation for event-driven 3D perception.