Papers for 2026-11-17

10 papers
Siyuan Wang, Dongjie Zhu, Jinxuan Lu, Wenjun Xu, Jiankun Wang
总结: 视觉严重退化时,足式机器人回退到本体感觉以维持行走。
方法: 师生两阶段同时学习感知驱动与本体回退,并抑制分布外视觉特征。
证据: 方法在Unitree Go2四足上评估视觉干扰,摘要未给出具体指标。
为什么适合我: 直接针对视觉感知足式运动在遮挡、反光和光照变化下的失效。
推荐理由: 直接对应感知型足式运动:视觉腿式运动在遮挡、反光和光照退化下,用教师-学生强化学习显式建模感知可靠性并回退到本体感觉。
原摘要

Vision-based perceptive locomotion has enabled legged robots to achieve agile and terrain-aware locomotion across complex environments. However, the reliability of such systems heavily depends on visual observations, which are inherently susceptible to occlusion, reflective surfaces, and illumination variations, often resulting in catastrophic locomotion failures under degraded perception conditions. In this paper, we present PROOF (Perceptive Robustness via Out-of-Distribution Fallback for Legged Locomotion), a perceptive locomotion framework that enables robust locomotion under severe visual disturbances. Our method adopts a two-stage teacher-student learning paradigm that explicitly models perception reliability: the teacher learns both perception-driven and proprioceptive fallback behaviors, while the student predicts exteroceptive features with uncertainty and suppresses them under out-of-distribution inputs. We evaluate our method on a Unitree Go2 quadruped equipped with a RealSense D435 depth camera in real-world settings. Under normal visual conditions, our method enables the robot to successfully perform high-dynamic parkour maneuvers, including traversing large gaps, elevated platforms, and narrow beam terrains. Under severe visual degradation, such as heavy occlusion and strong illumination changes, the robot continues to maintain stable and robust locomotion performance.

Sol Choi, Mingon Kim, Seokin Seo, ... , Donghyeon Kim, Yisoo Lee
总结: 用身体对齐的虚拟关节统一人形接口,以便复用同一运动训练配方。
方法: 策略使用统一解剖坐标,再由确定性运动学层映射到各机器人原生关节。
证据: 同一未修改配方在三种腿轴布局不同的人形上均能稳定准确跟踪。
为什么适合我: 便于跨人形复用强化学习全身运动控制,并保持脚步与行进方向对齐。
推荐理由: 最接近人形机器人运动控制:以身体对齐虚拟关节统一不同人形的动作接口,使同一套强化学习运动训练配方可跨本体复用。
原摘要

Reinforcement learning has enabled robust humanoid locomotion, yet training recipes (rewards, architectures, hyperparameters) remain hard to reuse across robots with different native joint coordinates, since policies output native joint angles while action scales, bounds, gains, and penalties are defined in those robot-specific coordinates. Existing transmission models convert native targets into actuator commands but do not standardize the coordinate interface exposed to the policy. We introduce a body-aligned virtual joint space upstream of this mapping: policy actions and observations follow a common anatomical convention, and a deterministic kinematic layer maps virtual targets to native ones, leaving the existing transmission and low-level control stack unchanged. Under a single unmodified recipe on three humanoids with different leg-axis layouts, it is the only interface that tracks accurately, keeps the feet aligned with the travel direction, and trains stably on all three, and on Unitree G1 hardware it reduces heading drift by nearly a factor of six.

Mohammad Khoshnazar, Mike Degany, Deyuan Qu, Qing Yang, Matyas Szanto
总结: 隐藏起始延迟随机化,使自博弈学到的人形交接适应陌生伙伴。
方法: 仅对学习中的给予者随机延迟出手,且接收者无法观察该延迟。
证据: 自伙伴成功率为九成五和九成,陌生脚本伙伴仅三成一。
为什么适合我: 关乎人形协作递物与强化学习策略对未见伙伴的泛化。
推荐理由: 只部分贴近人形操作:Unitree G1递物交接的自博弈强化学习,但不是全身控制、运动跟踪、移动操作或感知运动主线。
原摘要

Cooperative self-play can teach a humanoid to receive an object without any human data, but the partner it meets after training is never the one it trained with; we show that a fluent self-play handover policy breaks with unfamiliar partners, identify the main cause, and repair it. In a physics-based parcel handover between a Unitree G1 and a learned giver, both trained by alternating PPO self-play, the receiver completes 95% and 90% of handovers with its own partner (two training seeds) but only 31% with scripted partners it has never met. Paired interventions isolate the cause: under a shared reward the learned giver always starts its offer at once, so the receiver learns a single rendezvous, and delaying its own partner by one second cuts success from 95% to 6% (87% to 34% in the second seed). We introduce hidden start-delay randomisation (HSD), a one-line rule on the learned partner that the receiver never observes. After 300 further updates, success with unseen scripted partners rises from 31% to 80% in both seeds, against 35--41% for a budget-matched control. The gain holds on a fresh scenario seed, on eleven held-out partner conditions and on partners that start later than any training delay; it cuts high-force contact three- to five-fold and needs no retraining of the partner.

FanCyqlone: A Parallelized Solver for Multi-Horizon Optimal Control

3.0/5 一般 裁判分 3.0 Candidate 当日相对
Matisse Teuwen, Pieter Pas, Mathijs Schuurmans, Panagiotis Patrinos
总结: 并行求解多时域最优控制,以降低不确定预测下的模型预测控制成本。
方法: 沿时间与场景分支并行计算贡献,再合并到共享根问题并处理约束。
证据: 在弹簧质量系统与四足控制基准上同先进求解器比较性能。
为什么适合我: 可作为足式和全身模型预测控制中处理多场景不确定性的求解工具。
推荐理由: 多时域最优控制求解器,仅以四足控制作基准,属于全身MPC的数值工具而非机器人控制贡献。
原摘要

Multi-horizon optimal control aims to select optimal control sequences simultaneously for several possible future scenarios, ensuring consistency at the first stage. While this enables advanced model predictive control schemes that explicitly handle prediction uncertainty, solving these problems tends to be costly. We introduce FanCyqlone, a linear solver that exploits parallelism across both time steps and scenario branches. The method builds on Cyqlone to compute the contribution of each branch and combines these results through a shared root problem. We integrate FanCyqlone into QPALM to develop FanCyQPALM, a solver for multi-horizon optimal control problems with general linear stage-wise constraints. We compare its performance with state-of-the-art solvers on spring-mass and quadruped control benchmarks.

Jiaxin Huang, Chengxing Lin, Xiaoyu Luo, ... , Zhihui Peng, Shaoli Huang
总结: 以语言指令驱动双足人形完成从室内到室外的长程导航。
方法: 用多源数据训练仅依赖机载彩色图像的模型,并由流程分解子任务部署。
证据: 摘要称在灵犀X2上完成长程任务,但后续结果描述被截断。
为什么适合我: 贴近真实人形长程移动,不过重点是导航而非全身运动跟踪。
推荐理由: 虽在人形上做室内外长时程语言导航,核心是导航数据与目标预测流程,不是全身控制或感知运动,且接近不感兴趣的建图导航。
原摘要

Long-horizon navigation from indoors to outdoors remains an open problem for humanoid robots: one instruction covers rooms, doors and roads, and the camera moves with the gait. Worken, AGIBOT's measure of productive robot work, depends on robots that reach their workplaces autonomously. We present X-Nav, to our knowledge the first system to take a bipedal humanoid through a language-instructed long-horizon mission from indoors to outdoors. X-Nav covers a pipeline from data to deployment. Its data engine collects navigation data in open-source scenes, in digital twins of deployment sites and on real robots. Its navigation model, MELIOR, takes only RGB images from the robot's built-in camera and comes in two versions: MELIOR-A predicts actions, and MELIOR-N predicts a navigation goal. Its agentic workflow, X-Navarch, turns a brief human instruction into sub-tasks and deploys MELIOR on the robot with explicit target navigation and obstacle avoidance. On the Lingxi X2, X-Nav completes a mission of about a hundred metres from an office lobby to a store in a neighbouring building; LiDAR and odometry are used for target approach and low-level control. The mission is completed with both versions of MELIOR: the robot follows a change of destination and walks through a door from the lobby to the road, and with X-Navarch it also passes static and dynamic obstacles on the route. During deployment, MELIOR is adapted with data collected in a digital twin of the site; the adaptation raises its closed-loop success rate in the twin, and the adapted model is then deployed on the robot at the real site. In addition, MELIOR achieves competitive results on the R2R-CE and RxR-CE benchmarks.

Inner Product Regularization for Imitation Learning

2.0/5 偏低 裁判分 4.0 Candidate 当日相对
Benjamin A. Christie, Tianyu Qiu, Amy H. Choi, David Fridovich-Keil, Dylan P. Losey
总结: 内积正则让模仿策略在邻近状态下对同类扰动保持一致响应。
方法: 通过策略雅可比将动作内积诱导到状态空间,并利用其零空间约束变化。
证据: 摘要仅阐述原理与正则构造,没有报告具体机器人实验数字。
为什么适合我: 有助于动作模仿在传感噪声和误差累积下保持可外推控制。
推荐理由: 模仿学习的策略正则化理论,缺少人形、足式、遥操作或运动重定向的具体问题设定。
原摘要

Robots that learn from demonstrations should extrapolate their policy despite state perturbations such as sensor noise, scene variation, and compounding errors. One approach to this robustness is regularization. Prior regularizers consider each state on its own and limit how sensitive the policy is to any perturbation at that state. By contrast, we explore how the policy's output shifts when given the same perturbation at different states. Our insight is that, locally, the robot should respond to state perturbations in a consistent manner: e.g., if changing an irrelevant object position does not impact the policy at one state, that same change should not shift the policy output at a nearby state. Applying this insight, we develop inner product regularization (InneR). We show that the inner product on action space induces an inner product on state space through the policy Jacobian (the Fisher information for stochastic policies), and that the null space of this inner product governs which state perturbations have a first-order effect on the policy. By clustering states whose inner products are aligned, averaging the inner products within each cluster, and minimizing the smallest eigenvalues of that average, InneR shapes the learned policy so that nearby states share a common null space. InneR enforces consistent responses to perturbations without limiting policy expressiveness, and can be appended to existing imitation learning pipelines for deterministic or stochastic policies. In simulated experiments, InneR makes learned policies more robust to irrelevant state dimensions and shifts between training and test distributions, whereas norm penalties often perform worse than behavior cloning. On a real robot arm performing three manipulation tasks, InneR raises the average success rate of a diffusion policy from 18% to 57% without additional data.

Yashwanth Kumar Nakka
总结: 用收缩认证的采样模型预测控制,实现不确定系统的跟踪与安全。
方法: 每次采样展开加入收缩跟踪反馈,执行前再用收紧屏障条件核验输入。
证据: 漫游车展开减少七到二十倍,四旋翼跟踪误差降低二到四倍。
为什么适合我: 强化不确定环境下的模型预测控制,但验证对象并非足式或人形。
推荐理由: 是带收缩认证的采样式MPC,但验证于巡视器、四旋翼和小行星着陆,不是人形/足式全身模型预测控制。
原摘要

We present contraction-certified sampling-based model predictive control (CS-MPC) for tracking and safety of nonlinear robotic systems under parametric uncertainty, disturbances, and safety constraints that are revealed online. CS-MPC uses a contraction-certified tracking feedback inside every sampled rollout, which concentrates the rollouts around the reference, and an execution layer that verifies the applied input using a quantile-tightened discrete-time control barrier function condition. We derive a verification procedure for nonlinear contraction of the feedback-closed dynamics, and we prove a finite-sample stochastic stability bound and a mission-level probabilistic safety guarantee. We validate CS-MPC in simulation on a rover, a quadrotor, and an asteroid landing. When compared with standard model predictive path integral (MPPI) control, CS-MPC attains the same tracking error with 7 to 20 times fewer rollouts for the rover, and a 2 to 4 times lower tracking error for the quadrotor, with no safety violations in 200 Monte Carlo missions.

Training Reasoning Models in Simulation to Natively Use Real Robots

2.0/5 偏低 裁判分 4.0 Candidate 当日相对
Jiaming Tang, Zhuoyang Zhang, Junxian Guo, ... , Zhijian Liu, Song Han
总结: 开源推理模型仅通过仿真强化学习,就能原生调用真实机器人。
方法: 模型直接观察环境、进行思维链推理并输出末端位姿,且不使用示范。
证据: 仿真技能可迁移到未见机器人和真实世界,其余结果在摘要中截断。
为什么适合我: 体现纯仿真到真实部署,但控制对象是末端执行器而非全身运动。
推荐理由: 通用机器人使用智能体在仿真中学习输出末端执行器位姿,不针对人形全身控制、运动跟踪或足式运动。
原摘要

Robot-use agents (RUAs) have emerged as a promising approach to general-purpose robot control. However, strong performance has so far been achieved only by frontier proprietary models such as GPT-6 Astra and Claude Fable 5.2, whereas open-weight models remain substantially less capable. We show that an open-weight 27B reasoning model can be trained to use real robots natively through reinforcement learning, entirely in simulation and without demonstrations. Like a computer-use agent (CUA), the model observes the environment, reasons in a chain of thought, and generates the next end-effector pose, without any harness. We build a Post-training Engine for Agentic Robotics (PEAR) and use it to train the model on simulated robot tasks at scale with robot-use reinforcement learning (RURL), mirroring how frontier models acquire computer use. We find that the skills acquired in simulation generalize well beyond the training tasks: they transfer to an unseen robot, to the real world, and to novel instructions. After training on LIBERO and RoboDojo in simulation, the model succeeds in 60% of our trials on a real dual-arm robot, whereas the base model succeeds in none. On LIBERO, training raises the success rate from 1.6% to 74.4%, approaching GPT-6 Astra and GPT-6.1 Sol at maximum reasoning effort. Compared with $\pi_{0.5}$, a vision-language-action model fine-tuned on demonstrations, our model is substantially more robust to changes in the task itself. On LIBERO-Pro, $\pi_{0.5}$ succeeds in only 0.75% of episodes when assigned a new task in a familiar scene whereas our model succeeds in 57.4%. Finally, the model retains its general capabilities, with no measurable degradation on nine reasoning, coding and vision benchmarks. These results highlight robot-use reinforcement learning as a promising component of foundation-model post-training.

Pengyang Shi, Jinlu Zhang, Chunze Lin, Yizhou Wang, Li Yi
总结: 组合音频与文本扩散模型,生成节奏和语义同时对齐的全身手势。
方法: 推理时联合两个模型,并估计耦合分数来校正跨模态推断偏差。
证据: 在BEAT上语义与节拍指标领先,盲评胜率为百分之七十六至八十三。
为什么适合我: 属于全身动作生成,与足式控制、运动跟踪和移动操作关系较弱。
推荐理由: 音频文本驱动的全身手势扩散生成,偏向社交角色动画,而非物理角色控制或机器人运动跟踪。
原摘要

Generating whole-body gestures that are simultaneously rhythmically synchronized with speech audio and semantically aligned with text descriptions is a fundamental challenge in embodied AI and social robotics. We tackle this Audio-Text-to-Motion (AT2M) problem by composing two independently-trained diffusion models at inference time and refine bias in joint inference by modeling the copula score $s_I$. A rigorous theoretical analysis reveals that naive epsilon blending corresponds to a Product-of-Experts formulation that omits the copula score $s_I$: the cross-modal interaction between audio and text that neither marginal model can capture. We propose CFGComposer: a jointly-trained AT2M diffusion model that estimates $s_I$ via a CFG analogy and injects it as an $ε$-space correction. Experiments on BEAT demonstrate best-in-class semantic fidelity (SRGR $0.9916$, FID $27.18$) with GT-level beat alignment (BA $0.1826$ vs. GT $0.1743$), and 76-83% win rate in blind pairwise human evaluation against all prior methods. Physical deployment on a Unitree G1 humanoid confirms direct sim-to-real transfer.

Suvarna Kadam (Witsense AI), Soran Parsa (University of Huddersfield)
总结: 按生命周期综述视觉语言动作模型的设计、训练与部署。
方法: 沿七个轴梳理输入、架构、动作输出、中间预测、数据与后训练。
证据: 覆盖二零二二年十二月至二零二六年十月的八十八篇相关研究。
为什么适合我: 可提供人形控制与视觉动作模型的文献地图,但并非新控制方法。
推荐理由: VLA全生命周期综述以操作和导航为主,仅顺带人形控制,不是全身跟踪、感知运动或全身MPC的专门工作。
原摘要

Vision-language-action (VLA) models adapt web-pretrained vision-language models to output robot actions, so that web knowledge carries over to physical control. In under 4 years the field has moved from RT-2, the first VLA, to open models that fine-tune on a single consumer GPU and to proprietary generalists that clean unseen homes. This survey reviews 88 works from December 2022 to October 2026, mainly on manipulation and navigation, plus humanoid control, world-action models and evaluation. We follow a VLA through its life cycle, from model design to training and deployment, along seven axes. Model design covers (a) inputs and memory, what the model observes; (b) architecture, how its pipeline is built; (c) action output, how it produces motor commands; and (d) intermediate predictions, what else it predicts, from reasoning steps to future observations. Training covers (e) pretraining data, the mix of robot, web, human and simulated data, and (f) post-training, adaptation to the target robot. Deployment covers (g) real-time execution, keeping pace with the robot. We analyse 22 models on these axes and report their training data, model size, inference speed and hardware. Three trends emerge: (i) training data has broadened, from about 10,000 hours of teleoperated robot data ($\pi_0$) to 23,000 community-collected episodes (SmolVLA) and 20,000 hours of egocentric human video (GR00T N1.7); (ii) model sizes have split: most recent models have 3-7 billion parameters, while a new group under one billion runs on consumer GPUs; and (iii) generalist VLAs are emerging that handle both manipulation and navigation, such as UniVLA and Qwen-VLA. We also compare VLAs with world-action models, which predict future observations as well as actions. We review evidence that some VLAs with near-perfect benchmark scores fail when objects or the camera move slightly, and open up further research questions.