Papers for 2026-11-01

10 papers

Robotic Data Inoculation

3.0/5 一般 裁判分 6.0 Good 当日相对
Qiyang Li, Zhiyuan Zhou, Charles Xu, Sergey Levine
总结: 共享控制框架用残差策略扰动遥操作收集高覆盖数据。
方法: 人类闭环命令加在线训练残差扰动,目标同后续奖励最大化。
证据: 残差在增长数据集上训练,避免分布外状态。
为什么适合我: 提升复杂接触场景演示覆盖,支持腿足模仿与强化学习。
推荐理由: 最接近人形遥操作与数据采集,但是通用共享控制覆盖增强,没有人形全身或腿足场景。
原摘要

Modern robot learning systems feed on high-quality demonstration data, and their performance hinges on coverage. Without good coverage, small errors compound and the policy can quickly go into out-of-distribution states from which it cannot recover. Yet there is no principled way of collecting high-coverage data, and data collection often relies on heuristic instructions to human operators. Purely online reinforcement learning (RL) explores at the cost of safety and sample efficiency, while DAgger-style interventions require the policy to fail by chance before a human can correct it. In this paper, we ask instead whether we can modify how the robot behaves during data collection to collect more useful data. We propose Data Inoculation (DI), a shared-control framework in which a human provide closed-loop teleoperation commands while a residual policy perturbs these commands. The residual policy is trained online, on the growing dataset, with the same reward-maximizing objective later used for policy extraction, so its perturbations steer data collection toward the deviations a policy trained on the data would make. These perturbations expose the robot to a wider range of states, while the human's continuous corrections provide recovery demonstrations, "inoculating" the dataset against the learner's future mistakes while the human remains in control. On three challenging real-world robotic tasks, DI consistently improves or matches the success rate of policies trained with both behavioral cloning and offline RL, showing DI as an effective data collection strategy for improving downstream policy performance.

Event2Reward: Learning Robotic Rewards from Progress Relations

2.0/5 偏低 裁判分 8.0 Strong 当日相对
Junnan Nie, Zitian Fan, Jiachen Zhang, ... , Tianle Zhang, Songfang Huang
总结: 从进度关系学习密集塑形奖励,处理停滞与回退。
方法: 归一化时间锚定尺度,轨迹内相对关系约束局部变化。
证据: 结合绝对相对监督,避免误判回退为进展。
为什么适合我: 改进全身运动强化学习奖励,适用于跑酷与loco-manipulation。
推荐理由: 通用机器人强化学习的进度奖励塑造,未涉及人形或腿足全身控制、运动跟踪与模仿。
原摘要

Learning task progress from robot demonstrations provides a practical way to construct dense shaping rewards for robotic reinforcement learning. A common approach uses normalized demonstration time as progress labels, implicitly assuming monotonically increasing task progress. During policy exploration, however, actual task progress can stall or even regress. Such models may mistake regressions for progress, assigning positive shaping rewards to actions that cause progress loss. Real suboptimal and failed executions offer corrective experience, but assigning absolute progress values to their states is difficult. Our key observation is that stalls, regressions, and recoveries establish local relative progress relations even when absolute progress is unknown. We introduce Event2Reward, which uses normalized temporal labels to anchor the progress scale and these within-trajectory relations to constrain local changes, combining absolute and relative progress supervision. Its progress predictions serve as potentials for reward shaping. We curate an event-annotated dataset from approximately 100K raw real-robot execution records, covering successful, suboptimal, and failed executions, without requiring framewise absolute progress labels. Under the same training budgets, Event2Reward improves average policy success by 18.16 percentage points over a baseline using only sparse task rewards across 40 tasks in four LIBERO suites. On real robots, average success after 30 minutes of wall-clock training reaches 60.0% on three precise insertion tasks and 90.0% on three object manipulation tasks, exceeding the sparse-reward baseline under the same budget by 36.7 and 23.3 percentage points, respectively. Ablation studies further show that absolute progress supervision and relative progress relations are complementary, with joint supervision yielding better downstream policy learning.

Seoyoung Hwang, Tae-Kyun Kim
总结: 稀疏关节学习实现拓扑无关高效运动扩散生成。
方法: 紧凑关节子集训练,语义嵌入结合文本视觉与拓扑目标。
证据: 减少冗余,促进跨多样骨架可迁移模式学习。
为什么适合我: 支持人体动作重定向到任意骨架人形机器人全身控制。
推荐理由: 是拓扑无关的角色动作扩散生成,不属于人形/腿足控制或真机跟踪。
原摘要

Topology-agnostic motion generation aims to synthesize motions for diverse characters with arbitrary skeletons. Unlike conventional motion generation, which assumes a fixed skeletal template, this setting must handle diverse joint configurations and inconsistent joint semantics across characters. Existing methods address this challenge through dense full-joint modeling, which incurs substantial computational cost and hinders learning transferable motion patterns across diverse skeletal topologies. We present ETA-Motion, a topology-agnostic motion generation framework based on sparse joint learning. Instead of learning motion from all joints, our method uses a compact subset of joints to reduce redundancy and trains the motion generator on the resulting sparse skeleton. To facilitate correspondence across diverse topologies, we introduce semantic joint embeddings that combine textual and visual cues, together with topology-aware training objectives for preserving skeletal structure. Although ETA-Motion is trained only on sparse skeletal observations, it supports full-skeleton motion generation during inference. Experimental results demonstrate that ETA-Motion outperforms existing topology-agnostic baselines while significantly improving efficiency and generalization to unseen motions and unseen topologies.

Sachiya Fujita, Hideyuki Ichiwara, Shigeki Sugano, Tetsuya Ogata
总结: 能量分数稳定注意力混合密度策略处理多模态运动。
方法: 输出高斯混合参数,用能量分数优化并耦合空间注意力。
证据: 在8自由度机械臂上生成不同避障轨迹并稳定。
为什么适合我: 轻量多模态策略可用于接触丰富场景运动生成与模仿。
推荐理由: 通用多模态机器人运动策略,不针对人形、腿足或全身loco-manipulation,与库内对象不匹配。
原摘要

For practical motion generation, it is essential to handle multimodality (multiple actions can be correct for the same observation) while maintaining low inference cost and strong generalization from limited demonstrations. We introduce an attentive mixture-density policy trained with the Energy Score that represents future visuomotor trajectories as explicit probability distributions with a single forward pass. Concretely, we output Gaussian mixture parameters for joint commands (and optionally attention points) and optimize them with the Energy Score (computed as a sum of 1D CRPS under a diagonal covariance assumption) instead of the negative log-likelihood (NLL) to avoid MDN singularities and gradient-scale instabilities. Our architecture couples explicit spatial attention with mixture-density outputs, enabling robust multimodal behavior selection under visual noise and small-data regimes. On an 8-DOF manipulator, the method generates distinct avoidance trajectories and stabilizes learning in obstacle avoidance. Moreover, in a randomized moving-object grasping task, where spatiotemporal multimodality and fast timing decisions are required, the proposed model outperforms Diffusion Policy by 15-25% under several unseen conditions, demonstrating superior generalization and real-time feasibility.

Jiazhao Liang, Zhewen He, Shuaihang Yuan, Hao Huang, Yi Fang
总结: 压缩演示为潜在槽用于上下文模仿学习。
方法: 槽预测查询关键帧,反事实保留细节,后训练关键点令牌。
证据: LIBERO与真机显示多样本上下文提升成功与跟随。
为什么适合我: 利于人形机器人上下文模仿,压缩演示支持真机部署。
推荐理由: 通用上下文模仿学习的演示压缩,实验在 LIBERO 与普通机器人,不涉及全身人形控制。
原摘要

In-context imitation learning (ICIL) adapts robot policies through test-time demonstrations, but long multimodal trajectories constrain how many examples fit in context. We ask what a compressed demonstration should preserve. We propose JEDI, which compresses demonstrations into latent slots trained to predict the query episode's next-stage keyframe in a frozen video-JEPA space. Task and process counterfactuals help the slots preserve execution details, while the predictor selects demonstrations from a bank. Post-training with keypoint tokens enables human-hand conditioning on robots. Experiments on LIBERO and real robots show that JEDI supports many-shot context; LIBERO objective controls show improved success and demonstration following over action-only compression. These findings support query-future prediction as a training objective for preserving execution-relevant information in compressed demonstrations.

Neel Jawale, Stephan Pleines, Soha Pouya, ... , Ajay Mandlekar, Caelan Garrett
总结: 多臂演示生成集成规划调度算法处理约束。
方法: 从少量源演示合成新演示,考虑多臂安全约束。
证据: 在28个仿真任务变体上评估包括外部任务。
为什么适合我: 为人形多臂loco-manipulation生成安全演示,突破数据瓶颈。
推荐理由: 多臂模仿的演示调度生成,虽提及人形平台,核心不是全身运动跟踪或 loco-manipulation 控制。
原摘要

Multi-arm robot platforms, including bimanual and humanoid robots, have the capability to complete tasks with lower cycle times than single-arm systems, but they are more difficult to safely control due to the presence of multi-arm constraints. The paradigm of training generalist robot policies from massive datasets is a promising approach to address general-purpose multi-arm manipulation, but the acquisition of large multi-arm manipulation datasets remains a bottleneck. Automated demonstration generation can alleviate this burden by synthesizing new demonstrations from a handful of source demonstrations, but existing algorithms ignore multi-arm constraints and as a result often induce unsafe and unsuccessful behaviors. We address this limitation by introducing ScheduleGen, an integrated planning & scheduling algorithm for multi-arm demonstration generation. We evaluate ScheduleGen on 28 simulation task variants, including seven externally authored RoboDojo tasks and settings inaccessible to prior systems; it achieves 79.6% mean data-generation success and trains policies with 65.5% mean success. ScheduleGen policies outperform those trained on a state-of-the-art data generation baseline, and achieve 50-80% success across eight real-world variants through zero-shot sim-to-real and real-to-sim-to-real transfer. Videos and more at: https://schedulegen.github.io/

Shota Nomura, Takayuki Osa, Yasuhiro Kato, ... , Naoki Shitanda, Tatsuya Harada
总结: 运动原语表示使动作块平滑用于模仿学习。
方法: 轨迹段为平滑基函数线性组合,确保构造平滑。
证据: 解决块内块间抖动与速度限制饱和问题。
为什么适合我: 提升全身控制轨迹平滑,利于人体动作真机跟踪。
推荐理由: 改进模仿学习动作分块的平滑性,面向通用视觉策略而非人形全身运动。
原摘要

Imitation learning has become a widely adopted approach for vision-based robot policies, owing to its conceptual simplicity, scalability, and ability to leverage large-scale datasets. As these policies have grown more capable, action chunking has become their standard interface. At each decision step the policy outputs several future actions at once. Backbones from diffusion policies to large vision-language-action models all share it. Whatever backbone produces the chunk, its temporal structure is learned only implicitly. The commanded trajectory is therefore jerky both within a chunk and between successive chunks. On real hardware this appears as visible vibration and as repeated saturation of the follower's velocity limit. We address this issue by incorporating a movement-primitive-based trajectory representation into action chunking. Specifically, a trajectory segment is represented as a linear combination of smooth basis functions, yielding smooth trajectories by construction while leaving the policy architecture, training objective, and inference procedure unchanged. The same representation also yields a closed-form, inference-time correction for the second source of jerk. We condition the predicted coefficients so that the new chunk passes through a via-point at the previous chunk's last commanded action. This correction needs no retraining and, unlike asynchronous Real-Time Chunking, applies to policies queried in one shot. We instantiate it on a one-shot (ACT) and an iterative (DiT) backbone and evaluate in simulation and on a real bimanual ALOHA platform. The representation lowers within-chunk jerk by an order of magnitude on the one-shot backbone and by 2.4 times on the iterative one, with task success statistically non-inferior. The conditioning then removes 73-84% of the boundary discontinuity, at negligible per-step cost.

Kristian Ceder, Kilian Freitag, Knut Åkesson
总结: 在线蒸馏LLM监督为决策树处理机器人冻结。
方法: 反事实重放标记恢复,蒸馏决策树,测试无查询。
证据: 20未见布局中至少正确处理18个,匹配LLM。
为什么适合我: 结合MPC监督决策,适用于腿足复杂地形恢复与导航。
推荐理由: 移动机器人局部MPC卡死恢复与LLM监督蒸馏,不是全身运动控制或loco-manipulation。
原摘要

Autonomous mobile robots commonly pair a global planner with a local model predictive controller (MPC), but nonconvex obstacle avoidance and a limited horizon can make the robot freeze in complex layouts. Deciding whether to replan, wait, or call for help is a supervisory decision. Recent work queries a large language model (LLM) supervisor on every anomaly, which is slow and costly. We instead distill the LLM online into a decision tree. After each training episode, counterfactual replay labels recoveries as needed, unnecessary, or harmful. These labels retire unhelpful rules. In simulation, on 20 unseen layouts where the MPC alone freezes, the tree handles at least 18 correctly across all seeds, either by reaching the goal or by calling for help when no feasible path exists. The tree matches both an always-query LLM supervisor and expert-designed rules, while issuing no LLM queries at test time. Handwritten rules cannot anticipate the long tail of situations a physical robot will encounter. Online distillation is a promising remedy: the tree handles familiar cases, and the LLM is consulted only for new ones, whose validated recoveries become new rules. Language models can thus also serve as designers of supervisors rather than only as runtime supervisors.

Jianan Li, Jiawei Zhao, Yangtao Zhou, ... , Hua Chu, Fu Li
总结: 自进化多智能体框架支持对话式运动生成编辑。
方法: 多智能体协调指令理解、生成、局部编辑与质量评估。
证据: 仅精炼受影响区域,保留其余运动上下文。
为什么适合我: 支持人体动作迭代编辑,利于可重定向可跟踪全身运动。
推荐理由: 对话式文本生成与局部运动编辑,属于生成式动作合成,没有机器人全身跟踪、重定向上真机或物理控制。
原摘要

Despite rapid progress in text-to-motion generation, existing methods are commonly designed for single-shot generation. When users are dissatisfied with specific motion details, they are often forced to regenerate the entire sequence from scratch, which is computationally inefficient and potentially destroys previously established kinematic context. A practical generation system should instead support iterative user feedback and refine only the affected spatio-temporal regions while preserving the remaining motion. Therefore, we introduce a conversational motion generation paradigm that requires the system to coordinate instruction understanding, motion generation, localized editing, and quality assessment. Recent advances in LLM-driven multi-agent systems provide a promising foundation for such role-specialized coordination. To tackle these challenges, a Self-evolving Multi-Agent RefinemenT Framework (SMART) is proposed for conversational motion generation. Within SMART, to preserve semantic consistency, we design a semantic-guided masked motion editing mechanism, which precisely grounds natural language feedback into spatiotemporal motion regions to enable localized refinements without altering unedited regions. To reduce redundant exploration, we propose a memory-based self-evolving strategy that dynamically accumulates motion editing knowledge from interaction history and reuses past successful experience. Extensive experiments demonstrate that SMART effectively supports multi-turn conversational motion generation and enables efficient motion refinement.

OmniQuad: a Wheeled-Legged Hybrid Robot with Omnidirectional Wheels

2.0/5 偏低 裁判分 4.0 Candidate 当日相对
Francesco Iotti, Alok Ranjan, Franco Angelini, Manolo Garabini
总结: 轮腿混合机器人集成麦克纳姆轮实现全向移动。
方法: 设计自定义轮足结合腿式,利用两种模态优势。
证据: 全向机动增强狭窄空间敏捷与任务定向保持。
为什么适合我: 扩展腿足机器人复杂地形与室内高效运动能力。
推荐理由: 轮腿混合机构与全向轮设计,不是感知运动、跑酷或全身学习控制。
原摘要

Combining wheeled and legged locomotion within a single robotic platform offers the potential to harness the advantages of both systems. The development of such hybrid systems remains an active area of research. While legged robots exhibit remarkable adaptability for traversing uneven and rugged terrains, their relatively low speed limits their practicality in indoor environments. Conversely, wheeled robots demonstrate higher efficiency on flat surfaces but often encounter difficulties when navigating obstacles such as steps. This paper introduces OmniQuad, a novel hybrid robot that integrates mecanum wheels with legged locomotion to exploit the benefits of both modalities. Mecanum wheels provide omnidirectional mobility, enhancing the robot's manoeuvrability by enabling agile movement in confined spaces and the ability to maintain a consistent orientation during task execution. In this work, we first present the design of a custom wheeled-foot featuring mecanum wheels. Subsequently, we describe the complete robot assembly, comprising these wheeled feet and EM-Act actuators. Finally, we detail the control scheme developed to govern the OmniQuad and evaluate its performance through experimental trials conducted in both indoor and outdoor environments.