Papers for 2026-11-09

10 papers
Xuebin Li, Jinpeng Xiao, Zong Chen, ... , Jiebao Sun, Yiqun Li
总结: 异构足式机器人协同搬运未固定载荷,分层多智能体强化学习解耦协调与运动。
方法: 高层扩散策略由集中评论家联合训练,低层本体策略跟踪协调指令。
证据: 摘要称协调策略从零经奖励驱动仿真交互学习,并支持多模态动作分布。
为什么适合我: 贴近足式协同搬运与运动跟踪,但不是人形模仿、跑酷或移动操作。
推荐理由: 最接近足式运动与分层强化学习:低层有面向本体的运动跟踪,并用扩散策略做协调,但核心是异构足式协同搬运,而非人形全身控制、动作模仿或重定向。
原摘要

Cooperative transport with heterogeneous legged robots requires coordinating different motion capabilities while supporting an unfixed shared payload. We present HA-DiPO (Heterogeneous-Agent Diffusion Policy Optimization), a hierarchical multi-agent reinforcement learning framework under centralized training with decentralized execution (CTDE). The framework decouples team-level coordination from embodiment-specific motion control: at the high level, a centralized critic uses team-value estimates to jointly train independent coordination policies, aligning robot-specific action responses with a shared transport objective; at the low level, embodiment-specific robust motion policies track the coordination commands. The high-level diffusion policies offer more flexible action distributions than single-Gaussian parameterizations, allowing potentially multimodal coordination responses to be represented. The coordination policies learn from scratch through reward-driven simulator interaction without demonstrations. At execution, each robot generates coordination commands using only local robot and payload observations, without partner-state inputs or inter-robot messages. Simulation comparisons show that HA-DiPO achieves higher final mean returns and velocity-tracking success rates, as well as lower velocity errors, than the evaluated baselines. Real-world experiments further demonstrate quadrupedal-wheeled-legged and human-robot cooperative transport.

Jianibieke Adalibieke, Qianwei Han, Xueyi Liu, Yuzhe Qin, Li Yi
总结: 语言条件下灵巧手物交互跟踪,用调制器在线修正噪声参考与本体偏差。
方法: 通用跟踪器蒸馏承载技能,强化学习调制器修正参考、物体潜变量与位置目标。
证据: 摘要说明跟踪器由专家到通才蒸馏,调制器在相同任务物体上用强化学习训练。
为什么适合我: 触及人体到机器人重定向与接触丰富跟踪,但对象是灵巧手而非足式全身。
推荐理由: 提到参考跟踪和人体到机器人重定向偏差,但对象是语言条件的灵巧手操作,不是全身运动跟踪或人形移动操作。
原摘要

Language is a natural way to command robots, but converting a single instruction into a long-horizon, contact-rich hand-object interaction remains challenging: synthesized references are noisy, human-to-robot retargeting introduces embodiment bias, and fixed-reference tracking lets small errors snowball. We address this with AdaDexTrack, a modulator-in-the-loop framework for language-conditioned manipulation tracking. A distilled generalist tracker serves as the skill carrier, while a tightly aligned modulator performs three feedback corrections: reference modulation (continual adjustment of what to track), object-latent modulation (online adaptation of the object representation to recruit suitable skills), and positional-target modulation (small state-dependent refinements for execution). The tracker is learned via large-scale specialist to generalist distillation on a corpus of language-conditioned hand-object trajectories; the modulator is trained with RL under the same task objective, ensuring tight coupling. Across large-scale evaluations, AdaDexTrack consistently outperforms prior SOTA on unseen-trajectory and unseen-object sets in both average tracking error and success rate, demonstrating robustness and generalization. We further show zero-shot sim-to-real transfer on real hardware, where adding the modulator yields substantial gains over a tracker-only variant. AdaDexTrack reframes language-conditioned dexterous manipulation as modulated tracking, replacing the open-loop, fixed-reference tracking with in-loop modulation that adjusts the reference, object latent, and positional target, yielding drift-resistant execution from noisy text references.

X-World: Transferring Video Priors to Variable-View Robot Control

2.0/5 偏低 裁判分 6.0 Good 当日相对
Chun Gu, Xiaofei Wei, Yiming Chen, Juntong Zhang, Li Zhang
总结: 将视频扩散先验经固定长度词元迁移到可变视角机器人闭环控制。
方法: 残差跨视角注意力扩展视频骨干,层对齐查询器聚合特征并映射到共享动作专家。
证据: 摘要报告在LIBERO平均成功率达百分之九十八点五,并采用异步动作分块执行。
为什么适合我: 属于多视角视觉策略与操作基准,和足式全身控制及运动模仿关联较弱。
推荐理由: 用视频扩散先验做可变视角机器人控制,方法上接近扩散策略,但未涉及人形/足式全身控制、运动模仿或地形感知运动。
原摘要

Video diffusion models provide a source of interaction representations for robot control, but transferring these representations requires reconciling variable camera inputs with heterogeneous action interfaces and closed-loop execution. We present X-World, a framework that transfers a video prior through a fixed-length token sequence to a shared action expert. A residual cross-view attention branch extends a pretrained video backbone to one, two, or three views while retaining its original self-attention path. A layer-aligned Q-Former aggregates backbone features, and dataset-specific modules map between native state and action interfaces and the shared action expert. Training separates video adaptation from action-only pretraining by freezing the video backbone in the latter stage, followed by joint target-domain post-training. The policy extracts video features with a single backbone pass and uses asynchronous action chunking for execution. On LIBERO, X-World reaches 98.5\% mean success; its LIBERO-trained checkpoint obtains 76.5\% on LIBERO-Plus without further adaptation. The seven-shift breakdown reveals gains in robot, language, lighting, and layout perturbations, alongside weaknesses under camera, background, and noise shifts relative to OpenVLA-OFT. On six dual-arm real-world tasks, it achieves 81.7\% mean success over 20 trials per task. Removing video adaptation or cross-view fusion produces the largest observed success drops among the tested removals.

Ao Zhou, Zongyou Yu, Ke Wu, ... , Alois Knoll, Guang Chen
总结: 将灵巧操作表述为同时满足累积代价与逐状态代价的多约束优化。
方法: 把多约束投影融入策略优化,以同时处理多种异构安全约束。
证据: 摘要指出既有约束强化学习难以同时处理多种异构约束。
为什么适合我: 关注灵巧手安全策略学习,而非人形全身跟踪、跑酷或移动操作。
推荐理由: 多约束强化学习用于安全灵巧操作,与人形全身控制、足式运动跟踪和动作重定向无关。
原摘要

Dexterous manipulation requires high-dimensional control policies to accomplish complex contact-rich tasks while simultaneously satisfying multiple safety requirements, such as joint limits, unsafe finger configurations, arm collisions, and unstable object interactions. Constrained reinforcement learning (RL) provides a principled framework for incorporating these requirements into dexterous manipulation policy learning. However, existing constrained RL methods for dexterous manipulation primarily focus on cumulative cost constraints and struggle to simultaneously handle multiple heterogeneous constraints during dexterous policy learning. In this work, we propose Multi-constraint Dexterous Policy Optimization (MDPO) for safe dexterous manipulation. We first formulate dexterous manipulation as a multi-constraint policy optimization problem involving both cumulative cost constraints and state-wise cost constraints. Based on this formulation, we integrate multi-constraint projection into the dexterous manipulation policy optimization process. Specifically, we employ constraint-specific policy projections to map the intermediate policy that maximizes task performance onto the feasible regions defined by the cumulative cost constraint and the state-wise cost constraint. Extensive experiments on ReDMan, including safe joint control, finger safety, and grasping tasks, demonstrate that MDPO achieves superior constraint satisfaction while maintaining competitive task performance compared with the baselines. Our code is available at this link.

Fangyu Jiang, Chaoran Xiong, Kehui Ma, ... , Zeyu Zhang, Ling Pei
总结: 为足式机器人全身多惯导提出运动学驱动的抗噪声主动标定框架。
方法: 以时序相关搜索估计时间偏移,再解析估计外参与惯性偏差。
证据: 摘要强调常规运动激励不足,且打滑、冲击和振动会干扰测量。
为什么适合我: 有助于足式多惯导里程计,但不直接做全身控制、模仿或仿真迁移。
推荐理由: 平台是足式机器人,但内容是全身多IMU时空标定与里程计,属于状态估计而非运动控制,接近不关注的纯定位建图。
原摘要

Recently, multi-node inertial measurement unit (multi-IMU) systems have shown promise for robust odometry in legged robots. Multi-IMU fusion can improve legged robot odometry but requires accurate spatiotemporal calibration among the sensors. Existing multi-IMU calibration methods, designed for aerial or handheld platforms, face challenges on legged robots because routine locomotion may provide insufficient excitation, while foot slips, impacts, and vibrations introduce measurement disturbances. To address these challenges, we propose A2I-Calib++, a kinematics-driven anti-noise active calibration framework for body-mounted IMUs covered by the robot kinematic model. It estimates temporal offsets, extrinsic rotations and translations, and inertial biases through temporal correlation search followed by analytic spatial and bias estimation, without artificial calibration targets or complex parameter tuning for the target IMU. A2I-Calib++ comprises three core modules: 1) a Noise-Isotropy-Inspired Trajectory supported by a finite-horizon conditioning proposition that generates sufficient excitation to limit noise sensitivity; 2) a constraint-aware Adversarial Motion Priors controller that combines the anti-noise excitation with a rolling-contact reward for contact-aware execution; and 3) a contact-constrained virtual IMU that fuses pre-calibrated calf IMUs and joint kinematics under a rolling-contact model to construct the calibration reference. Furthermore, evaluations on both simulation and real-world quadruped platforms demonstrate notably reduced noise sensitivity and simulation calibration errors compared to conventional methods, together with repeatable real-world calibration and improved proprioceptive odometry accuracy for legged robots.

Zongyou Yu, Ao Zhou, Xiongbo Shi, ... , Hanli Wang, Guang Chen
总结: 在离线到在线安全强化学习中按剩余安全预算仲裁引导与探索。
方法: 显式跟踪回合内已消耗后的剩余预算,自适应选择离线指导或在线改进。
证据: 摘要指出早期代价过高会压缩后续探索与策略改进空间。
为什么适合我: 服务灵巧操作的安全在线微调,与足式全身控制主线距离较远。
推荐理由: 面向灵巧操作的离线到在线安全强化学习,不属于全身控制、运动跟踪或仿真到现实的足式运动。
原摘要

Dexterous manipulation requires robots to leverage existing datasets for rapid skill acquisition while maintaining safety during real-world deployment to prevent damage to the robot or its surroundings. Offline-to-online safe reinforcement learning (O2O safe RL) provides a promising solution for this problem by leveraging prior experience for online improvement under safety constraints, thereby mitigating the sample inefficiency and exploration risk of learning safe policies from scratch. However, existing O2O safe RL approaches do not explicitly account for the safety budget already consumed when making decisions within an episode. Excessive cost incurred early can therefore leave little room for subsequent exploration and policy improvement. To address this limitation, we propose \textbf{R}esidual-\textbf{B}udget \textbf{G}uide \textbf{A}rbitration (RBGA), an algorithm that explicitly tracks the remaining episode safety budget and uses it to adaptively select between offline guidance and the evolving online policy. At each step, RBGA compares the cost-to-go estimates of the guide and online actions against the remaining budget, enabling step-wise action arbitration throughout the episode. We provide theoretical analysis characterizing the safety implications of residual-budget-based selection and its effect on guide-assisted exploration. Extensive experiments demonstrate that RBGA enables effective online policy improvement while maintaining strong safety performance. Our code is available at this \href{https://github.com/sii-pilab}{link}.

Yuanzhi He, Victor Romero-Cano, Jiayu Xu, Juan David Hernández, Gualtiero Colombo
总结: 用首层评论家迁移和分阶段奖励重设计降低障碍操作的数据需求。
方法: 在截断分位数评论家骨干上复用输入表征,并为抓放任务重设中间奖励。
证据: 摘要报告障碍推滑成功率提升,无障碍抓放所需训练步数明显减少。
为什么适合我: 属于障碍感知操作的深度强化学习,不是足式或人形全身控制。
推荐理由: 通用机械臂在Push、Pick-and-Place、Slide上的任务分解强化学习,不是人形或足式全身控制。
原摘要

Obstacle-aware robotic manipulation can require substantial interaction data when deep reinforcement learning policies are trained from scratch. We study a task decomposition framework combining first-layer critic transfer with staged reward redesign (RR) on a Truncated Quantile Critics (TQC) backbone. Transfer reuses an input representation across tasks, while RR supplies intermediate feedback for Pick-and-Place. Experiments cover Push, Pick-and-Place, and Slide in obstacle-free and single-obstacle PyBullet environments, with three random seeds per setting. On obstacle-aware Push, transfer achieves $0.83\pm0.05$ success against $0.77\pm0.06$ for TQC. On obstacle-aware Slide, it achieves $0.95\pm0.02$ against $0.84\pm0.06$ for SAC, the strongest baseline in that setting. These are gains of $6$ and $11$ percentage points, respectively. RR reduces the target-training steps needed for obstacle-free Pick-and-Place from roughly $0.75$M to $0.20$M. Transfer benefits depend on the route: obstacle-aware Pick-and-Place shows a lower mean than training from scratch. A selected simulated trajectory is executed open-loop on a Franka Emika FR3 as a feasibility demonstration. The study characterizes when a lightweight combination of established transfer and reward-design components helps learning.

Jinyu Zhang, Haitao Lin, Jiashu Hou, Xiangyang Xue, Yanwei Fu
总结: 单次前向从单帧深度彩色观测直接估计类别级位姿、尺寸与形状。
方法: 提升稠密基础特征到部分点云,以动态图卷积和混合专家变换器编码结构。
证据: 摘要强调单次前向避免中间结构误差传播及扩散模型的高延迟。
为什么适合我: 属类别级物体位姿感知,或可辅助操作,但不做运动控制与跟踪。
推荐理由: 类别级RGB-D物体位姿估计,是纯视觉感知,与机器人运动控制无关。
原摘要

This paper studies category-level RGB-D object pose estimation, which recovers an object's 3D rotation and translation without instance-specific CAD models or reference views. This task is highly ambiguous due to intra-class variations, symmetries, and partial observations. Current solutions struggle to balance reliability and efficiency: methods based on intermediate structures are prone to error propagation, while diffusion models suffer from high inference latency and complex post-hoc candidate extraction. To address this, we present F2G-Pose, a real-time direct, single-pass framework that predicts category-level pose, metric size, and camera-frame completed shape from a single RGB-D observation in one feed-forward pass. F2G-Pose lifts dense visual foundation features to partial point clouds, encodes local geometry with DGCNN tokenization, and integrates object-level structure with a Mixture-of-Experts Transformer. Joint size prediction and camera-frame shape completion encourage metric consistency through dense geometric supervision. With its task-specific network trained only on pose-annotated synthetic SOPE data and its frozen RADIO backbone externally pretrained, F2G-Pose achieves state-of-the-art accuracy on SOPE and ROPE while running at 28 FPS for pose-only inference, and further demonstrates strong camera-frame geometry on HouseCat6D and real-object transfer on HANDAL. Analyses of latency, robustness, shape completion, and GenPose++ candidate behavior further demonstrate the efficiency and reliability of F2G-Pose, with real-world manipulation experiments demonstrating deployment potential under segmented RGB-D inputs. The project page, code, and pretrained models are made available at https://jrryzh.github.io/F2G-Pose/.

Yilong Chen, Yong K. Cho
总结: 从无标注演示学习交互感知的路径修正,服务施工机器人激光导航。
方法: 常速外推生成残差目标,图网络建模人机目标关系并偏移规划路点。
证据: 摘要称砌砖试验路径不规则度降百分之三十九点二,并提高最小碰撞时间。
为什么适合我: 覆盖仿真到现实与动态避人,但是施工导航而非足式全身或移动操作。
推荐理由: 施工机器人的激光社交导航与路径修正,虽含仿真到现实,但不是足式/人形运动或移动操作。
原摘要

Construction robots operating near workers require navigation that can anticipate human motion while remaining robust to dynamic and unstructured site conditions. However, existing social navigation methods depend on hand-crafted interaction rules, labeled demonstrations, or robot-specific control policies, limiting their scalability and transferability in construction environments. We propose a real-time, LiDAR-only framework that learns interaction-aware path corrections from unlabeled demonstrations. Constant-velocity extrapolation generates residual learning targets, while a GNN models relationships among the robot, pedestrians, and goal context. During deployment, an extended Kalman filter tracks LiDAR detections to construct dynamic graphs, and the GNN offsets planner-generated waypoints through a planner-agnostic interface. Within the bricklaying trial, the GNN reduced path irregularity by 39.2\% and increased minimum TTC. Across Dynablox sequences, it increased minimum TTC by 38.3\% while producing shorter, smoother paths than the baselines. Ablation studies supported a 1.0-s prediction interval and confirmed the benefits of target context, reflection augmentation, and feature normalization.

Conditional Flow Models for Offline Maximum Entropy Reinforcement Learning

1.0/5 偏低 裁判分 2.0 Candidate 当日相对
Hao Cheng, Yuling Jiao, Lican Kang, Jerry Zhijian Yang, Chen Zhong
总结: 用条件流模型离线估计最大熵最优动作价值,无需再与环境交互。
方法: 以概率流微分方程估计条件奖励与转移,再最小化经验软贝尔曼残差。
证据: 摘要建立非渐近理论保证,并分开处理环境建模与价值函数学习。
为什么适合我: 是离线强化学习理论工具,未直接服务全身控制、跟踪或仿真到现实。
推荐理由: 离线最大熵强化学习的条件流模型理论,没有人形或足式控制场景。
原摘要

Offline maximum entropy reinforcement learning seeks to estimate the optimal soft action-value function \(Q^*\) from a fixed dataset without further interaction with the environment. Although \(Q^*\) is characterized by the soft optimal Bellman equation, the corresponding Bellman operator cannot be evaluated directly because both the reward distribution and the transition kernel are unknown. Consequently, estimating \(Q^*\) requires the joint treatment of environment modeling and value function learning. We propose a framework that addresses these tasks separately. Conditional diffusion models based on probability flow ODEs estimate the conditional reward distribution and transition kernel. The resulting distributional estimators define a data driven approximation of the soft optimal Bellman operator, whose empirical Bellman residual is minimized over a class of deep neural networks to estimate \(Q^*\). We establish nonasymptotic guarantees for the proposed method. For operator learning, we derive total variation error bounds for the conditional flow estimators that account explicitly for score estimation, numerical discretization, and terminal smoothing. For soft value learning, we first use the soft Bellman equation to show that $Q^*$ inherits Hölder regularity from the conditional reward and transition densities. For any Hölder index $β$, the value learning stage achieves an excess Bellman residual risk bound of order $\widetilde{\mathcal O}\big(n^{-\frac{2β}{d+2β}}\big),$ where $d$ is the total dimension of the state and action spaces. In contrast to many existing theoretical analyses of deep reinforcement learning, our results do not require Bellman completeness. Numerical experiments support the theoretical findings and demonstrate the effectiveness of the proposed method.