Papers for 2026-10-14

10 papers
Jordan Dowdy, Gryffin Reizian, Jean Chagas Vaz
总结: 低成本ToF提供紧凑地形表示,支撑人形强化学习运动。
方法: 令牌压缩时序Transformer处理本体与地形观测。
证据: 令牌压缩后存入15步历史,交叉注意力提取特征。
为什么适合我: 直接服务复杂地形人形感知运动与强化学习控制。
推荐理由: 直接做人形腿足在地形感知下的强化学习运动,低成本局部地形表征与时序策略,最贴近腿足感知运动与全身控制。
原摘要

Informative terrain perception is important for robust reinforcement learning policies in humanoid locomotion. Still, common sensors such as depth cameras and LiDARs incur high cost, power, and processing overhead while often producing redundant, high-resolution data. This work uses a low-cost time-of-flight sensor to provide a compact 3D local terrain representation for humanoid locomotion. To efficiently use this sparse exteroceptive input, we introduce a token-compressed temporal transformer policy. Proprioceptive and terrain observations are tokenized and processed by a self-attention multi-head transformer to capture within-timestep relationships between observation terms. The attended tokens are then compressed through an MLP-based latent-space token compression module before being stored in a rolling 15-timestep history. A second cross-attention multi-head transformer extracts temporal locomotion features from this compact history for policy learning. By compressing tokens before temporal aggregation, the architecture preserves important terrain-observation structure while limiting the dimensional growth of attention over observation histories. We validate our method through sim-to-real transfer on physical hardware using a terrain-based locomotion benchmark, demonstrating robust humanoid terrain walking with low-cost local terrain sensing.

ConFlow: Constraints-Guided Learning with Flow Matching for Motion Generation

3.0/5 一般 裁判分 5.0 Candidate 当日相对
Nutan Chen, Jianxiang Feng, Marvin Alles, Botond Cseke
总结: 约束引导流匹配框架直接融入训练生成运动。
方法: 可微屏障代价入目标,条件高斯过程替换源分布。
证据: 用不可行演示解决数据与任务约束不匹配。
为什么适合我: 流匹配利于接触丰富场景约束运动生成与控制。
推荐理由: 约束引导的流匹配运动生成,方法上靠近扩散/引导采样与运动先验,但未落到人形全身跟踪、重定向或真机运动控制。
原摘要

In recent years Flow Matching has become a prominent method for generative modeling robot motion generation. In its generic form Flow Matching is an ODE-based neural sampler that is trained by regressing empirical flow fields associated with motion samples as data. However, in robot motion generation we often have additional constraints that might not be present in the collected data. The majority of current approaches train the flow on the available data and use inference-time guidance to enforce task-specific constraints. To address this mismatch, we propose \textbf{ConFlow}, a constraint-guided flow matching framework that incorporates constraint information directly into the training objective via differentiable barrier or cost functions. To address design specifications such as smoothness and boundary conditions, we propose replacing the standard Gaussian source distribution used in flow matching training with a conditional Gaussian Process. Our approach also uses infeasible demonstrations as negative supervision, improving constraint satisfaction without requiring additional expert data. Experiments on a two-robot navigation task demonstrate that ConFlow achieves lower collision rates and higher trajectory quality than standard flow matching baselines, with or without inference-time guidance. These results validate training-time constraint integration as an effective approach to closing the training--inference gap in generative motion models.

MIME: Multimodal Interactive Motion Encoder

2.0/5 偏低 裁判分 4.0 Candidate 当日相对
Addison Zucek, Prerit Gupta, Kamila Kuatova, Aniket Bera
总结: 首个专为双人交互运动的多模态编码器。
方法: 流式共注意力加显式交互特征与课程对比训练。
证据: Inter-X上文本到运动R@1相对提升12.8%。
为什么适合我: 人体动作表示利于可跟踪重定向全身控制。
推荐理由: 双人交互文本-动作表征与检索,偏动画与多模态编码,不是人体动作重定向或可上真机的全身控制。
原摘要

Text-motion representation learning has advanced rapidly, with growing interest in multi person interactions for animation, AR/VR, and embodied AI. These settings require representations that align language with both individual actor dynamics and the relationships between actors. We introduce the Multimodal Interactive Motion Encoder (MIME), which, to our knowledge, represents the first dedicated multimodal encoder designed specifically for two person interactive motion. MIME captures individual and shared structure using stream based co-attention with explicit interaction features and curriculum based contrastive training. On Inter-X text-motion retrieval, MIME consistently outperforms early and late fusion baselines across gallery sizes, achieving a 12.8% relative improvement in text-to-motion R@1 at a 2,000-sample gallery. We further evaluate MIME as a frozen auxiliary prior within TIMotion and InterMask on the unseen InterHuman dataset. MIME improves semantic alignment metrics while maintaining comparable FID in TIMotion. These results show that interaction aware multimodal encoding improves multi person motion retrieval and transfers across datasets to support downstream motion generation.

Jialian Li, Junhong Liu, Yuchen Cao, ... , Jiangpin Liu, Jie Chen
总结: 8B端侧大脑兼顾通用智能与具身高层交互。
方法: 多阶段后训练含通用SFT、RL、具身专家与合并。
证据: 保持强通用能力同时获得高层具身交互能力。
为什么适合我: 可为人形loco-manipulation提供高层决策支持。
推荐理由: 端侧通用具身大模型大脑,关注高层交互而非人形/腿足全身运动、接触与感知运动。
原摘要

Large language models (LLMs) have demonstrated remarkable capabilities in language understanding, reasoning, and world knowledge. As embodied agents become increasingly capable, there is a growing demand for compact models that can serve as an on-device brain, preserving the broad general intelligence of LLMs while enabling effective high-level interaction with embodied environments. Existing approaches, however, often prioritize either general-purpose intelligence or specialized embodied capabilities, making it challenging to satisfy both requirements within a single model. We present \textbf{Athena-Brain-8B}, an 8B LLM designed to serve as an on-device brain for embodied intelligence for embodied intelligence. Through a multi-stage post-training pipeline consisting of General Supervised Fine-Tuning, General Reinforcement Learning, Embodied Expert training, and Model Merge, Athena-Brain-8B maintains strong general capabilities while acquiring strong high-level embodied interaction capabilities and generating concise responses for efficient embodied interaction. Experimental results demonstrate the effectiveness of Athena across both general and embodied evaluations. Compared with the corresponding Qwen3-8B thinking model, Athena-Brain-8B achieves comparable performance on general language and reasoning benchmarks while generating substantially shorter responses. On in-domain embodied benchmarks, Athena-Brain-8B consistently outperforms models of similar scale and surpasses several substantially larger frontier models evaluated zero-shot, demonstrating that compact language models can effectively integrate strong general intelligence with embodied capabilities.

Model-Agnostic Meta Learning for Differentiable MPC

2.0/5 偏低 裁判分 3.0 Candidate 当日相对
Salma Elfeki, Riccardo Zuliani, Niklas Schmid, Efe C. Balta, John Lygeros
总结: 元学习结合策略优化训练高适应MPC控制器。
方法: 策略优化与元学习,集成系统辨识精炼模型超参。
证据: 球板系统轨迹跟踪任务显示优越适应性。
为什么适合我: 直接提升全身MPC适应能力与真机部署。
推荐理由: 可微MPC与元学习,验证在球板轨迹跟踪,虽涉及MPC但与全身模型预测控制或腿足机器人无关。
原摘要

Applying policy optimization to Model Predictive Control (MPC) yields high-performance and reliable controllers. However, the resulting controllers often overfit their training conditions and suffer significant performance degradation in unseen tasks. We propose a novel framework combining policy optimization with meta-learning to train highly adaptable MPC controllers. Our approach enables rapid adaptation to unseen tasks, maintaining high performance at a fraction of the computational cost required for full retraining. Furthermore, we integrate system identification into the pipeline to continuously refine both the MPC hyperparameters and the underlying predictive models. We validate our proposed methodology on a Ball-on-Plate system, demonstrating superior adaptability across various parameterized trajectory-tracking tasks.

Zhilin He, Gauri Joshi
总结: 扩散先验对齐与价值基线引导异构联邦强化学习。
方法: OT-MoE聚合扩散先验,DICE价值基线指导改进。
证据: 为异构客户端提供个性化数据支持分布。
为什么适合我: 扩散与RL结合利于多场景人形运动策略学习。
推荐理由: 联邦强化学习中的扩散行为先验对齐,只用到扩散模型外壳,不是角色运动先验或机器人控制。
原摘要

Federated Reinforcement Learning (FRL) enables collaborative policy learning across distributed agents with heterogeneous environments. While recent methods based on variance reduction, divergence penalization, and momentum optimization improve FRL under heterogeneous settings, they still primarily synchronize policy or value-network parameters and do not explicitly address distributional mismatch among heterogeneous clients. Therefore, we propose \textbf{FedGuide}, a FRL framework that uses diffusion priors as behavior models to provide personalized data supported distributions for heterogeneous local policy learning. Instead of directly averaging local policies, FedGuide aggregates those diffusion priors through Optimal-Transport Mixture-of-Experts (OT-MoE), preserving heterogeneous behavior modes in distribution space. It further develops a Distribution Correction Estimation (DICE) value baseline to provide low-variance, return-aware guidance for local policy improvement. Experiments across heterogeneous environments show that FedGuide outperforms representative FRL methods in client-average returns, final-round performance, and worst-round robustness, while maintaining stable learning under stronger heterogeneity.

Agentic Real2Sim: Physics-based World Modeling with Vision-Language Agents

2.0/5 偏低 裁判分 1.0 Candidate 当日相对
Guanxiong Chen, Qianjun Xia, Jiawei Peng, ... , Chenfanfu Jiang, Peter Yichen Chen
总结: 视觉语言智能体实现物理世界建模的实到仿转换。
方法: 真实交互记录转可仿真孪生,连接下游策略微调。
证据: 评估刚性可变形物体及人形运动场景。
为什么适合我: 支持人形跑酷接触场景仿真数据与策略评估。
推荐理由: 刚体操作的agentic real2sim与策略微调,偏操作仿真管线,不是人形全身loco-manipulation或感知运动。
原摘要

Real-to-sim conversion for robotic interaction with objects remains labor-intensive because it requires more than visual reconstruction: a streamlined real2sim process must recover scene geometries and object states, infer physical parameters, and assemble actors, objects, cameras, poses, and trajectories into a runnable physical simulation. Today this process still depends on brittle workflow glue across visual perception tools and simulators: manual tuning of visual foundation models, mesh cleanup, coordinate frame alignments, etc. We introduce \textit{Agentic Real2Sim}, a framework for generalized physical world modeling with vision-language agents that converts a real-world recording of object-robot interaction into a simulatable episodic twin, and connects the resulting twin to downstream policy fine-tuning and evaluation. We evaluate Agentic Real2Sim on rigid-object manipulation, deformable-object interaction, and humanoid motion scenes, spanning domains that are usually handled by separate Real2Sim pipelines. The framework's agentic decisions can be driven by an open-weight VLM backend at a small fraction of the cost of frontier models, while attaining a comparable conversion success rate. The framework further supports custom scene conversion, fine-tuning of a pretrained policy with data generated from converted episodes, and works effectively as a surrogate for real-world policy evaluation. The project site, including code is available at https://agentic-real2sim.github.io.

Jiahong Zhang, Yifan Lin, Yandong Zhang, ... , Wei Wang, Guoqi Li
总结: 线性注意力策略用于开放词汇物体目标导航。
方法: 线性注意力作骨干维护结构化状态更新。
证据: 多变体下一致优于Transformer基线。
为什么适合我: 状态更新思路可借鉴复杂地形感知运动策略。
推荐理由: 开放词汇物体目标导航的线性注意力策略,是移动导航而非腿足跑酷或全身运动跟踪。
原摘要

Open-Vocabulary Object Goal Navigation (OVON) requires agents to operate under partial observability, making effective internal state updates critical for navigation performance. This update is implemented by the policy network, where recent approaches adopt Transformer-based backbones with self-attention over a context window to integrate temporal information. However, our controlled experiments show that performance does not scale with context length under Transformer-based policies, questioning the suitability of self-attention for state integration in navigation. To this end, we propose Linear Attention-based Navigation (LANav), which adopts linear attention (LA) as the policy backbone to maintain a structured state update rather than self-attention over the context window. Across multiple LA variants evaluated under identical settings, LANav consistently outperforms Transformer-based baselines. Performance improves as state update mechanisms become more structured and regulated, highlighting the importance of state update design. To improve state update effectiveness, we introduce Weighted State-Expansion Linear Attention (WSLA), which expands each attention head's state into multiple sub-states and uses learnable weighted readout to aggregate expanded sub-states. Equipped with WSLA, LANav achieves 36.4% average success rate (SR) on HM3D-OVON, outperforming Transformer-based counterparts by 6.3 percentage points in macro-averaged SR, while maintaining computational efficiency. Distance-stratified results show larger gains in long-distance episodes, while HSSD transfer and fine-tuning demonstrate robustness across scene distributions. Real-world deployment on a Unitree Go2 further achieves an 82% success rate over 50 trials, supporting the practical feasibility and sim-to-real transfer of LANav.

Siddarth Jain, Ho Jin Choi
总结: 高斯场景表示与反应控制实现感知动作耦合。
方法: 混合体素过滤动态高斯重定位,导出连续SDF。
证据: 连续距离融入控制屏障函数实现统一耦合。
为什么适合我: 接触丰富场景实时避障反应控制可迁移人形。
推荐理由: 高斯场景表示下的机械臂反应式避碰控制,是臂的感知-动作耦合,不是人形全身或腿足运动。
原摘要

Robotic manipulators excel in structured environments but face substantial challenges in unstructured and dynamic settings. This paper presents SplatCtrl, a unified framework for real-time scene reconstruction and reactive robot motion generation to enable collision-free robotic arm control in previously unseen and continuously changing environments. Building on 3D Gaussian Splatting (3D-GS), we introduce a hybrid voxel-based filtering and dynamic Gaussian relocation strategy that supports efficient scene reconstruction from RGB-D streams while accommodating environmental changes. For safe and reactive control, we further propose a method for deriving continuous signed distance functions from isotropic Gaussians, providing stable and differentiable collision probability estimates that bridge classical distance fields with the modern implicit representation. These continuous distance metrics are incorporated into control barrier functions, resulting in a unified perception-action coupling framework that supports smooth and reliable real-time motion generation in response to scene changes. Experimental validation in simulation, on physical robot, and within shared human-robot workspace demonstrates the framework's effectiveness, achieving integrated scene reconstruction and reactive control in uncertain, and dynamic environments.

VAMP-MR: Vector-Accelerated Motion Planning and Execution for Multi-Robot-Arms

2.0/5 偏低 裁判分 1.0 Candidate 当日相对
Philip Huang, Chenrui Gao, Jiaoyang Li
总结: 向量加速多机械臂运动规划与执行近实时套件。
方法: 经典规划结合向量化碰撞检测用SIMD加速。
证据: 碰撞检查加速达两数量级实现近实时生成。
为什么适合我: 多臂规划加速可启发loco-manipulation接触规划。
推荐理由: 多机械臂运动规划的向量化碰撞检测加速,工业多臂规划而非人形全身控制。
原摘要

Multi-robot-arm motion planning is a key challenge in deploying multiple manipulators for industrial tasks such as manufacturing. Existing search-based and sampling-based solvers often require significant computation time to produce collision-free, high-quality motions suitable for safe real-world execution. In this work, we introduce a new suite of multi-robot-arm motion planners capable of near real-time motion generation, combining classical planning algorithms with state-of-the-art vectorized collision-checking techniques. Based on CPU SIMD instructions, our new planners accelerate their primary bottleneck, collision checking, and achieve up to two orders of magnitude speedup in both motion planning and execution postprocessing for multi-arm manipulation tasks. We also release our implementation to lower the barrier for research and development of multi-robot-arm planning and manipulation problems. Code is available at https://vamp-mr.github.io/vamp-mr