Papers for 2026-10-20

10 papers
Narayanan Palghat Parameswaran (Carnegie Mellon University), Dong-Ki Kim (FieldAI), Jay Patrikar (FieldAI), ... , Shayegan Omidshafiei (FieldAI), Harmish Khambhaita (FieldAI)
总结: 失败引导课程树搜索生成地形提升四足跑酷泛化。
方法: 失败位置模式状态几何条件生成地形,蒙特卡洛树搜索探索课程。
证据: 在扫描真实建筑工地地形上验证有效。
为什么适合我: 针对腿足复杂地形跑酷与接触丰富感知运动。
推荐理由: 直接对应腿足感知运动与跑酷:用失败引导的地形课程和树搜索,解决复杂不规则地形上的腿足泛化。
原摘要

Quadruped parkour policies handle canonical obstacles well, but their training curricula often miss the irregular, compound geometry of industrial and disaster-response sites, where agile locomotion matters most. Such environments pose a hard generalization problem: even training directly on reconstructed geometry from the target site does not reliably yield policies that traverse it. Hand-designed curricula span only a few terrain families, and recent LLM-generated curricula offer little control over which policy weaknesses they target. We propose FCTS, a failure-conditioned terrain curriculum framework that uses localized traversal failures to automatically generate the terrains a policy should train on next. Each failure's location, termination mode, robot state, and surrounding terrain geometry condition this generation, and Monte Carlo Tree Search explores alternative curriculum trajectories under a fixed training budget. On terrains built from scanned real-world construction sites, FCTS raises success rate from 28.4% to 85.8% on a medium-difficulty course and from 14.9% to 44.7% on a hard course relative to the strongest parkour or LLM-curriculum baselines, and maintains higher progress on extreme terrains where full traversal is rare. Hardware experiments on a quadruped robot confirm that the learned FCTS policies transfer to the real world.

BeJEPA: A Goal-Conditioned Humanoid Behavior World Model via Unsupervised RL

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
Liyun Yan, Haoyang Li, Yang Zhang, ... , Chen Zhang, Yue Gao
总结: 目标条件人形行为世界模型经无监督强化学习习得。
方法: JEPA学共享表示,动态与后继预测器联合训练引导策略。
证据: 从人体运动先验与机器人交互学习,恢复目标世界位姿。
为什么适合我: 人形全身控制,人体动作转可跟踪可重定向策略。
推荐理由: 直接对应人形全身控制与人体运动先验:用无监督强化学习学习目标条件的全身行为世界模型,解决世界系姿态恢复。
原摘要

Humanoid control requires coordinating whole-body posture with position and heading in the world frame. Mainstream controllers imitate trajectories in the root frame, but struggle to regain the target world pose after displacement. We introduce BeJEPA, a goal-conditioned Behavior World Model learned through unsupervised reinforcement learning from human motion priors and robot interaction. BeJEPA learns a shared representation of body configuration and world placement through a joint-embedding predictive architecture (JEPA). A Dynamic Predictor predicts the next state embedding under an action, while a Successor Predictor summarizes a goal-conditioned policy's expected discounted future state embeddings in a single vector. During joint training, Dynamic grounds the initial representation in observed physical transitions, while Successor increasingly organizes it around long-term behavior. Their composition guides policy improvement through one physical prediction and one behavioral summary, without long imagined rollouts. In 20-second motion-tracking experiments, BeJEPA with online action refinement using Dynamic outperforms all evaluated baselines in global body-position error, reducing it on AMASS by 61.7% relative to BFM-Zero with world-pose inputs and 58.7% relative to SONIC. Physical deployment on a Unitree G1 demonstrates joint attainment of posture, world position, and heading goals, recovery from the ground, and closed-loop return after disturbances and goal changes. Project page: https://ylyem9x.github.io/BeJEPA-project.

Yanzhou Jin, Fei Suo, Chang Liu, ... , Yutaka Matsuo, Yaonan Zhu
总结: 强化学习全身控制实现四足操作臂多地形自适应。
方法: 混合任务表示与任务优先全身学习协调运动与操作。
证据: 真机在斜坡达30度楼梯可变形地形成功部署。
为什么适合我: 腿足loco-manipulation复杂地形全身控制核心相关。
推荐理由: 直接对应腿足全身loco-manipulation:强化学习全身控制在复杂地形上协调四足运动与操作,并保持末端任务一致性。
原摘要

Legged robots equipped with manipulators offer promising capabilities for loco-manipulation tasks in unstructured environments. However, achieving task-consistent end-effector behavior during locomotion remains challenging due to terrain-induced disturbances and the strong coupling between locomotion and manipulation, particularly for small-scale quadruped platforms. A reinforcement-learning based whole-body control framework is proposed for quadruped loco-manipulation on complex terrain. The proposed framework combines a hybrid task representation with task-prioritized whole-body learning to coordinate locomotion and manipulation while preserving task-consistent end-effector behavior. A lightweight quadruped manipulator platform is further developed to validate the proposed framework on a small-scale quadruped system. Real-world experiments demonstrate successful deployment on complex terrains such as slopes up to 30 degrees, stairs, and deformable terrain. These results demonstrate the feasibility of deploying learned whole-body control policy for quadruped loco-manipulation in real-world environments and highlight the importance of task-consistent whole-body coordination for terrain-adaptive loco-manipulation.

Zicheng Liu, Haochen Wu, Jiawei He, ... , Cheng Chi, Hao Tang
总结: 自进化代码策略从技能到策略实现人形机器人协作。
方法: 验证器引导协调进化,基础模型实例化运动原语策略。
证据: 物理验证评估转换,拒绝行为触发结构化协调。
为什么适合我: 人形全身运动与协作,相关loco-manipulation。
推荐理由: 虽提到人形运动技能,核心是多机协作代码策略演化,接近不感兴趣的群体机器人,而非单机全身运动智能。
原摘要

Recent advances in Vision-Language-Action (VLA) models and World Action Models (WAMs) have expanded the manipulation and whole body capabilities of individual robots. Yet a single robot remains limited by its embodiment, and many real world tasks require capabilities that can only emerge through cooperation. Existing multi robot frameworks largely emphasize task decomposition, allocation, and replanning, while providing limited support for adapting executable coordination when physical execution deviates from the intended behavior. We present CoEvolve, a framework that represents team coordination as executable code over fixed robot motor skills. CoEvolve introduces Verifier Guided Coordination Evolution, where a multimodal foundation model instantiates coordination strategies through motion primitives, semantic objectives, temporary robot roles, and bounded execution parameters. Physical verification evaluates each executed transition, rejected behaviors trigger structured coordination revision from an accepted checkpoint, and verified experience is retained to guide subsequent decisions. We evaluate CoEvolve with two simulated Unitree G1 humanoids transporting a freely supported rigid payload through constrained corridors. Across 15 base task runs with three multimodal backbone families, CoEvolve completes 8 tasks, with every backbone achieving end to end success. Additional evaluations yield verified placement on two additional corridor layouts and after both same-backbone and cross-backbone experience initialization, while exposing persistent limitations in motion precision and contact stability. These results support executable coordination as a practical interface for adapting long horizon multi robot collaboration under shared physical constraints.

Antonia Bronars, Younghyo Park, Kushal Kedia, Pulkit Agrawal
总结: 仅本体感觉实现盲精确装配多样零件。
方法: 仿真强化学习训练盲策略,仅观察关节位置速度动作。
证据: 学会插销插入齿轮啮合螺母拧螺纹。
为什么适合我: 接触丰富场景感知运动,腿足人形关节传感可用。
推荐理由: 本体感觉sim-to-real的精密装配,接触尺度和任务都不是腿足/人形全身运动或loco-manipulation。
原摘要

Every robot already carries high-resolution contact sensors: its own joints. Legged robots and humanoids exploit them to walk, run, and track whole-body motions without vision, but there the contacts are large and forceful. Is joint sensing also enough for precise, contact-rich assembly, where the robot must find a millimeter-scale opening, mesh gear teeth, or catch a thread through light contact? We study this question by training blind assembly policies that observe only a short history of joint positions, velocities, and their own actions, without visual, force, torque, or tactile sensing. The poses of both the fixture and the part are unknown to the policy, and the grasp is randomized substantially. The policy must therefore assemble the parts through contact, sensed exclusively through its own proprioception. Trained with reinforcement learning entirely in simulation over randomized parts, grasps, and contacts, such policies learn peg insertion, gear meshing, and nut threading. The peg insertion policy transfers zero-shot to the real world and inserts pegs of different shapes and sizes in 73% of trials. Controlled comparisons with matched visual policies in simulation show that blind policies generalize far better to unseen part shapes and sizes, though they can be slower. Training such policies needs thousands of different assemblies, each simulated with its clearance intact, so we also release an open-source generator that builds them procedurally from exact convex pieces for MuJoCo; it is more accurate and faster than convex decomposition or MuJoCo's signed-distance collision. Videos and interactive simulations are at https://younghyopark.me/blind-proprioceptive-assembly/.

Devin Han, Hershraj Niranjani
总结: 实施例分类器引导冻结VLA跨机器人动力学转移。
方法: 轻量分类器区分成功动作块,梯度微调去噪步骤。
证据: LIBERO上目标体平均成功率从72%升至80%。
为什么适合我: 跨实施例转移全身策略,无演示适配新动力学。
推荐理由: 冻结VLA跨本体迁移面向操作基准,不涉及人形全身跟踪、跑酷或动作重定向。
原摘要

Flow-based policies such as $\pi_0$ are trained on a fixed set of embodiments, and transferring them to new ones is an open problem. To adapt a frozen $\pi_0$ to a new embodiment without additional demonstrations or parameter updates, we train a lightweight embodiment classifier to distinguish successful action chunks on the source body from those on the target body, using a few calibration tasks. On transfer tasks that $\pi_0$ saw on its source body but the classifier was never trained on, we nudge each denoising step of $\pi_0$ with the classifier's gradient, which estimates the direction from the distribution of successful actions on the source body toward that on the target body. On the LIBERO simulation benchmark with four modified controllers, embodiment-classifier guidance raises $\pi_0$'s average success on the target bodies from 72% to 80% across 12 suite-controller pairs, with a 31% relative reduction in failures (11 of 12 gain; 5 significant after Holm correction). In simulation, guidance is data-efficient, needing few target-body rollouts per task, which makes it promising for sim-to-real transfer, where rollouts are costly. Guidance is mixed on weak wrists and harmful on a locked wrist, when the classifier lacks data or favors infeasible motions. Collecting more target-body data with guided $\pi_0$ can fill such gaps: on one weak-wrist arm, guided $\pi_0$ solved a task on which unguided $\pi_0$ had zero successes in the original data, and retraining the classifier on the guided successes raised success from 52.5% to 70.7%.

Hideyuki Ichiwara, Yushi Kaida, Hirokazu Ishida
总结: 硬件作正则化提升模仿学习关节轨迹一致性。
方法: 被动关节模块用可调离合器与螺旋弹簧作物理先验。
证据: 方差大减,下游成功率如堆积块73.3%对36.7%。
为什么适合我: 改进模仿学习数据,利于人体动作可跟踪重定向。
推荐理由: 被动领导臂改善模仿学习数据一致性,但是机械臂遥操作硬件,不是人形全身遥操作或运动控制。
原摘要

Low-cost passive leader arms enable scalable data collection for imitation learning, but their lack of restoring forces leaves redundant joints unconstrained, yielding highly inconsistent joint-space trajectories. We address this with a low-cost passive joint module (an adjustable mechanical clutch and a 3D-printed spiral spring) that pulls each joint toward a user-defined neutral posture. This passive restoring force acts as a physical prior equivalent to joint-space $L_2$ regularization (``Hardware-as-Regularization''), improving kinematic consistency with shorter completion time than an unregularized arm and preserved movement smoothness. Experiments show substantial variance reduction over a naive passive arm, trajectory consistency on par with an active virtual spring of the same actuator class, and substantially higher downstream success rates (e.g., 73.3% vs. 36.7% on Block Stacking); a stiffness sweep shows consistency degrading monotonically as stiffness decreases, confirming that mechanical stiffness behaves like a regularization weight.

Ayush Deshmukh, Nalin Agarwal, Elle Miller, Sethu Vijayakumar
总结: 仅触觉与本体觉实现盲保定球持续操作。
方法: 传感器对齐仿真与新颖域随机化实现零样本转移。
证据: 真机完成225次连续180度盲旋转。
为什么适合我: 接触丰富盲操作RL策略,相关感知运动智能。
推荐理由: 灵巧手盲操作与触觉sim-to-real,不属于全身运动跟踪、跑酷或loco-manipulation。
原摘要

Humans manipulate objects within their hands through touch alone with remarkable ease, but for robots, achieving sustained real-world manipulation without vision remains an open challenge. Although reinforcement learning (RL) can generate sophisticated blind manipulation policies in simulation, transferring them to a real dexterous hand remains hindered by continuously changing contacts, motion-induced tactile information drift, and the gap between simulated and physical dynamics. We study this problem through Baoding ball rotation on the Shadow Dexterous Hand Lite, using only proprioception and binary tactile feedback as observations. We achieve successful zero-shot transfer through a combination of a sensor-aligned, coupling-aware embodiment in simulation, tactile calibration, and two novel episodic domain randomisations: slew-rate action limits and STuck-AT Taxels. On the physical hand, the policy achieves sustained blind Baoding rotation, completing 225 consecutive $\mathbf{180^\circ}$ rotations (112.5 full rotations) at $\sim0.36 \;\text{rot/s}$ in a single continuous trial without any vision or object-state information. Furthermore, we evaluate the contribution of tactile sensing relative to proprioception alone and identify the hand regions where tactile information is most important. This is the strongest reported hardware result for Baoding ball manipulation in both rotation count and speed, irrespective of the sensing modality used. By effectively bridging the sim-to-real gap, our framework sets a new benchmark for sustained tactile-driven dexterous manipulation on physical hardware.

Yueyang Weng, Xiaopeng Zhang, Yuxi Ou, ... , Chengzhi Zhao, Yanjie Li
总结: 对象中心刚体动力学3D世界模型用于机器人操作。
方法: 向量神经元VAE编码点云,动作条件预测SE(3)增量。
证据: 解析应用刚体变换分离持久几何与运动。
为什么适合我: 世界模型预测接触操作,利于loco-manipulation。
推荐理由: 操作任务的物体刚体三维世界模型,不覆盖腿足感知运动或人形全身控制。
原摘要

World models provide robots with a predictive mechanism for reasoning about how actions change object states in manipulation tasks. However, existing image-based and dense 3D world models do not explicitly impose object-level rigid motion, leaving rigid-object geometry preservation to be learned implicitly and making multi-step rollouts susceptible to shape drift or object-level motion inconsistency. To address this, we propose ORD-WM, a 3D world model that learns object-centric rigid dynamics for robotic manipulation. ORD-WM learns a vector-neuron variational autoencoder supervised by signed distance fields, which encodes each object point cloud as a geometry-aware latent representation composed of 3D vector features, and uses an action-conditioned dynamics model to predict object-wise SE(3) motion increments. Rather than generating unconstrained next latent states, ORD-WM analytically applies predicted object-wise rigid transformations to the current latent states, separating persistent object geometry from pose changes. Experiments show that ORD-WM enables stable, geometry-preserving multi-step prediction and supports efficient real-time replanning for closed-loop model predictive control in simulated and real-world manipulation scenarios.

Scaling Online Exploration for Robot Agents

2.0/5 偏低 裁判分 4.0 Candidate 当日相对
Runhan Huang, Xiangcheng Zhang, Haoyu Chen, ... , Weirui Ye, Yilun Du
总结: 扩展在线探索框架使机器人代理通过经验自改进。
方法: 编码代理生成控制代码,在线探索编译感知规划控制程序。
证据: 多实施例系统研究扩展在线探索。
为什么适合我: 在线探索提升全身运动智能跨实施例泛化。
推荐理由: 通用机器人在线探索与代码策略,缺少人形/腿足全身运动这一核心对象。
原摘要

Robot learning has advanced by scaling demonstration datasets and model capacity; however, deploying a new robot embodiment or task typically necessitates a dedicated teleoperation corpus. The resulting policies remain bounded by their imitation distributions, limiting generalization and continual self-improvement. We introduce RAX (Robot Agent eXploration), an open-source framework for robot agents centered on scaling exploration: enabling agents to improve by acquiring online experience and synthesizing executable programs. In RAX, a general-purpose coding agent generates robot control code, operating without action demonstration data, hand-engineered action primitives, or value-function guidance. Through online exploration, the agent identifies decision sequences that achieve task goals and compiles them into modular programs encapsulating the full perception-planning-control loop. Using RAX, we present a systematic multi-embodiment study on scaling online exploration across precision and long-horizon manipulation tasks using single-arm, bimanual, dexterous, mobile, and humanoid systems in simulation and on real robots. Generalization performance on unseen environments improves consistently as exploration scales. In simulation, RAX outperforms top baseline models by +37.4% on average. On real robots, RAX autonomously learns memory-dependent, articulated, high-precision, deformable, and long-horizon mobile manipulation tasks without human demonstrations, continually improving performance by composing verified skills from prior exploration sessions. As exploration scales, we observe emergent capabilities including active perception, error recovery, safety guardrails, and human-robot collaboration. We open-source RAX as a generalist robot-agent platform in which new robot embodiments are integrated through their APIs alone, without teleoperated data collection or policy training.