Papers for 2026-11-16

10 papers
Felipe Tommaselli, Ricardo V. Godoy, Thiago H. Segreto, Juliano D. Negri, Marcelo Becker
总结: 按步态相位分析有效秩,可揭示足式策略的表征差异。
方法: 计算网络雅可比有效秩,并比较摆动主导与支撑主导状态。
证据: 观测与层归一化加残差提升摆动相位秩,普通网络不明显。
为什么适合我: 直接帮助理解足式强化学习策略及其硬件运动表现。
推荐理由: 直接分析足式运动强化学习策略的表征健康与步态相位,贴近感知型足式运动与深度强化学习运动控制;虽偏机制分析而非新控制器,仍值得进入短名单。
原摘要

Reinforcement learning has become the leading paradigm in legged locomotion, enabling complex behaviors from backflips to parkour via massively parallel simulation. Under PPO's non-stationarity, shallow networks remain the de facto architecture, supported by carefully staged environments; nevertheless, the representations learned by these policies remain poorly understood, specifically the relation to motion produced on hardware. In this work, we empirically study locomotion policies through the effective rank of the network Jacobian and show that conditioning rank on gait phase exposes representation structures invisible from a global rank. In particular, we find that architectural choices, namely observation and layer normalization with residual connections, allocate more than one additional dimension of effective rank to swing-dominant states than to stance-dominant states, which is mostly absent in vanilla MLPs. Building on this, we propose practical recommendations to convert these into diagnostics for healthier and smoother policies. In practice, this results in lower joint jitter, up to $2$x, not only in simulation, but also on a physical Spot. More broadly, our findings show that how a policy distributes its capacity across the gait cycle is closely tied to its health and sim-to-real transfer.

Xiang Li, Koya Dendo, Keigo Minamida, ... , Per Ola Kristensson, Jun Rekimoto
总结: 短暂交互中,人们常难区分人形遥操作的人与人工智能。
方法: 保持统一具身,播放两类控制片段并让被试判断来源。
证据: 在线研究显示被试常混淆,判断依赖自然性、协调与一致性。
为什么适合我: 仅涉及遥操作主体感知,不涉及全身运动控制。
推荐理由: 最接近人形遥操作,但研究的是语音、表情和手势的人类/AI能动性感知,而非全身控制、运动跟踪或遥操作控制。
原摘要

Can people distinguish between human and AI agency in humanoid teleoperation? To explore this question, we developed \textit{Ghost-in-the-Loop}, a teleoperation framework that supports both human-operated and AI-generated control of a robot's voice, facial expressions, and gestures while maintaining a consistent embodiment. We conducted a preliminary online study ($N=50$) in which participants viewed short interaction clips generated by either a Human Operator or an AI Control and judged the perceived source of control. Results suggest that participants often struggled to distinguish between the two conditions in brief interactions. Qualitative responses indicate that judgments were primarily influenced by perceived naturalness, temporal coordination, and consistency across speech, facial expression, and gesture. These findings provide initial insights into agency perception in embodied human--AI communication and motivate future investigations of blended human--AI telepresence systems.

Mahmoud Selim, Cristina Cipriani, Karl H. Johansson
总结: 在扩散噪声空间优化策略,从而避免反传整个去噪过程。
方法: 用干净动作价值估计噪声潜变量,并形成兼容扩散的回归。
证据: 状态与视觉离线基准表明该噪声空间目标原则且有效。
为什么适合我: 属于通用离线控制,与足式全身运动关联较弱。
推荐理由: 仅在扩散策略与离线强化学习方法上相邻,实验面向通用连续控制基准,不涉及人形或足式全身运动。
原摘要

Diffusion policies offer a powerful and expressive parameterization for continuous control. Yet, their integration with reinforcement learning remains conceptually and algorithmically challenging. In this work, we address this gap by introducing a noisy-space action-value (Q-)function that assigns values to diffusion latents through the distribution of executed actions induced by the denoising process. We show that this construction admits a precise semantic interpretation and derive a noisy-space policy gradient (NSPG) that optimizes noisy latents using only clean action-space value estimates. Building on this result, we formulate a KL-regularized policy improvement over noisy latents and show that the resulting objective admits a diffusion-compatible regression form, avoiding backpropagation through the denoising process. Empirical results on state-based D4RL benchmarks and vision-based OGBench tasks demonstrate that the proposed noisy-space objective provides a principled and effective basis for training diffusion policies in offline reinforcement learning. Project webpage: https://mahmoud-selim.github.io/NSPG/

Spatially Aware World Action Model via Geometric Latent Diffusion

2.0/5 偏低 裁判分 5.0 Candidate 当日相对
Javier Alejandro Lopetegui Gonzalez, Paul Pacaud, Cordelia Schmid
总结: 单一扩散骨干联合预测机器人动作、彩色图像和深度。
方法: 非线性编码无界深度,以复用冻结分词器并保留预训练先验。
证据: 摘要称其在RoboCasa及相关操作基准上取得领先结果。
为什么适合我: 深度世界模型或助移动操作,但并非足式运动控制。
推荐理由: 用视频扩散联合预测动作、RGB和深度,只与深度感知方法弱相关,并非地形感知足式运动或人形控制。
原摘要

World Action Models (WAMs) leverage the capabilities of large-scale pretrained video diffusion models to jointly predict future observations and actions, inheriting rich visual and physical priors from internet-scale video. This has made them a promising paradigm for robot policy learning, yet the prevailing models operate exclusively on RGB observations and do not leverage 3D information. To bridge this gap, we introduce a Spatially Aware World Action Model (SA-WAM), which repurposes a pretrained video model for joint action, RGB, and depth prediction, enabling 3D-aware world modeling and action prediction within a single diffusion backbone. We use a nonlinear encoding that maps the unbounded depth signal into the bounded input domain expected by the frozen VAE tokenizer. This allows us to reuse the tokenizer without 3D-specific fine-tuning, incorporating geometric information without sacrificing the pretrained priors. SA-WAM achieves state-of-the-art results on the RoboCasa and LIBERO-Plus benchmarks, while simultaneously improving future-state predictions. Furthermore, SA-WAM outperforms strong baselines in real-world evaluation using a UR5 robotic arm, with strong gains in randomized environments. We analyze the correlation between world model prediction quality and rollout success, providing insights into WAM performance and avenues for its improvement.

ContextFlow: In-Context Flow Matching for Robot Manipulation

2.0/5 偏低 裁判分 4.0 Candidate 当日相对
Jian Ding, Xianjie Dai, Roei Herzig, ... , Bernard Ghanem, Mohamed Elhoseiny
总结: 用条件流匹配学习上下文模仿中的连续动作分布。
方法: 以示范和观测调节动作生成,并用感知器压缩多模态上下文。
证据: 摘要强调它能从噪声动作分布稳健生成连续控制动作。
为什么适合我: 主要服务机械臂模仿,对人形运动跟踪帮助有限。
推荐理由: 属于通用机器人操作的上下文模仿与流匹配,不是人形移动操作、全身跟踪或动作重定向。
原摘要

Although highly effective in vision and language domains, applying in-context learning to robotics remains challenging. Existing autoregressive in-context imitation methods discretize continuous actions and exacerbate the accumulation of early prediction errors through next-token prediction, limiting their generalization on unseen task configurations. Meanwhile, flow-matching policies have been explored for continuous robot control and can help mitigate compounding errors; however, in-context imitation learning within a flow-matching framework remains underexplored. To address these limitations, we introduce ContextFlow, a conditional flow-matching model that learns continuous action distributions for in-context imitation learning. ContextFlow conditions flow-based action prediction on demonstrations and observations, enabling robust generation from noisy action distributions. To better encode multimodal in-context demonstrations, we adapt perceiver-style multimodal context compressors that distill visual, proprioceptive, and action sequences into compact, task-relevant latent representations. On LIBERO, ContextFlow outperforms ICRT by 35 percentage points in average success rate on unseen task configurations, while matching the performance of the task-specific fine-tuned VLA model $π_0$ without any fine-tuning on unseen tasks. On real robots, it generalizes to unseen configurations of both single-arm and bimanual tasks, achieving 40% success on a new pen-uncapping configuration. Project Page: https://dingjiansw101.github.io/contextflow-page/.

Zhaohong Mai, Chao Wang, Chao Zeng, ... , Shunbo Zhou, Chenguang Yang
总结: 提出面向接触操作、可反应调节的柔顺视觉语言动作模型。
方法: 用混合专家编码力序列和视觉语言特征,并分阶段训练。
证据: 摘要将风险归因于动作块执行及感知到控制的明显延迟。
为什么适合我: 接触力反应机制可借鉴,但任务不是足式全身控制。
推荐理由: 面向接触丰富操作的力觉VLA,缺少人形全身控制、移动操作或足式运动内容。
原摘要

Integrating visuomotor policies or Vision-Language-Action (VLA) models with force/torque (F/T) perception has demonstrated significant progress in imitation learning for robotic manipulation. However, existing force-aware VLA models frequently exhibit limited capability in precise force tracking and rapid successive adjustments. This deficiency stems from the limitations of action-chunk execution strategies and the substantial latency between perception and real-time control. Such limitations can lead to task failures and safety risks, particularly when the execution of an action chunk exerts excessive interaction forces without timely adjustment. To overcome this challenge, we propose the Control-aware Compliance VLA (CC-VLA) framework for reactive control. The CC-VLA model employs a multimodal mixture-of-experts (MoE) to encode force signal sequences and vision-language fused feature. Furthermore, it utilizes a multi-stage training strategy to ensure robust perception within the visual-semantic space and effective force perception under sparse sampling conditions. Additionally, a VLA-guided adaptive compliance controller is designed to facilitate precise position tracking during contact-free motion and optimal force-position tracking for contact-rich tasks. To facilitate high-precision F/T data acquisition, we also implement an adversaria shared teleoperation strategy for contact-rich demonstrations that bolsters system safety and interactivity. Extensive real-world experiments demonstrate that CC-VLA significantly improves success rates in challenging force-perception tasks and enhances force-control precision, while providing multi-level safety and robustness under the tested partial-OOD pose-shift settings.

Yuhan Wang, Yurou Chen, Hongye Jiang, Gaojing Zhang, Wenzhao Lian
总结: 以本体感觉锚定视觉和力觉,改善接触装配的仿真迁移。
方法: 通过预测本体状态转移,监督时序视觉与力矩表征。
证据: 摘要论证该目标可抑制光照、纹理及力传感偏置影响。
为什么适合我: 其仿真到现实和接触力迁移思路适合足式部署参考。
推荐理由: 虽涉及仿真到现实迁移,但任务是接触装配而非足式或人形运动控制与跟踪。
原摘要

Contact-rich assembly remains challenging because it requires submillimeter spatial accuracy and reliable interpretation of forces during sustained contact. Although simulation-based reinforcement learning offers a scalable training paradigm, discrepancies in visual observations, contact dynamics, and force/torque (F/T) measurements often limit policy transfer. We observe that proprioception is comparatively consistent across domains because joint positions are expressed in a shared calibrated coordinate system and joint velocities are computed consistently in simulation and on hardware. Based on this observation, we present PACE (Proprioception-Anchored Cross-Modal Encoder), which supervises temporal visual and F/T representations by predicting proprioceptive state transitions. Static domain-specific factors, including lighting, texture, and sensor bias, contain little information about joint motion; optimizing the proposed objective therefore suppresses their influence on the learned representation while retaining task-relevant motion cues. Policies trained on frozen PACE features are directly deployed on hardware without real-world fine-tuning or object-pose tracking. Across four contact-rich assembly tasks, PACE attains an average real-world success rate of 93.3\% and only a 2.7-percentage-point sim-to-real drop, while remaining robust to perturbations that substantially degrade pose-based and learned-fusion baselines.

Jie Yin, Zeyuan Zhao, Xiaojing Tan, ... , Chiyu Wang, Xinyang Gu
总结: 用世界联觉模型提供循环上下文,增强灵巧手内操作。
方法: 从本体、深度、触觉和动作学习潜动态,并重建干净深度。
证据: 摘要强调去噪几何状态服务真实部署,并比较循环基线。
为什么适合我: 深度与本体融合有启发,但对象是手内而非全身运动。
推荐理由: 聚焦灵巧手内操作与触觉世界模型,不属于人形移动操作或全身运动控制。
原摘要

Generalizable and robust dexterous in-hand manipulation requires a policy to infer object pose, geometry, contact, and potential slip from partial and noisy observations. Although recent tactile and visuotactile RL methods achieve strong in-hand rotation in controlled settings, their robustness often degrades under pose shifts, force disturbances, and object variation. We propose WM-Craftnet, a world-model-conditioned framework that learns compact action-conditioned latent dynamics from proprioception, depth, tactile sensing, and actions, supervised by multimodal reconstruction and reward prediction. Rather than using the world model for latent imagination or policy optimization, WM-Craftnet uses the learned World Synesthesia Model (WSM) as recurrent task context for an asymmetric actor--critic policy. Importantly, WSM is trained to reconstruct clean depth targets from noisy depth inputs, providing a denoised geometric state for real-robot deployment. Ablations over recurrent baselines, auxiliary heads, tactile masking, and WSM modality heads show that predictive world modeling, clean-depth supervision, and tactile contact cues all shape the learned state. A WSM pretrained on nine \(z\)-axis objects serves as a reusable prior for \(49\)-object downstream policy learning. This context improves multi-object rotation, with quantitative and qualitative evidence for unseen-object, perturbation-recovery, and sim-to-real transfer.

Time-Aware Assistive Navigation

1.0/5 偏低 裁判分 2.0 Candidate 当日相对
Masaki Kuribayashi, Zhongkai Shangguan, Eshed Ohn-Bar
总结: 研究多模态模型在自我中心辅助导航中何时发出指令。
方法: 构建大规模户外导航基准,并检验微调与简单模型修改。
证据: 摘要发现现成模型即使微调,仍难提供及时安全指令。
为什么适合我: 属于辅助导航交互,与机器人全身控制基本无关。
推荐理由: 是面向视障辅助的语言导航时机问题,与机器人全身控制、运动跟踪和足式运动无关。
原摘要

Can interactive vision-and-language agents learn not just what to say but also \textbf{\textit{when}} to say it? Current language models rarely plan over whether and when to realize a real-time response to a user. However, providing accurate and timely support for human decision-making, such as when guiding visually impaired individuals through urban environments, requires careful real-time responsiveness--poorly timed responses can distract users or add unnecessary cognitive load. As a machine intelligence challenge for Multimodal Large Language Model (MLLM)-based agents, we introduce a large-scale multimodal benchmark for an egocentric, assistive navigation task in complex outdoor environments. Using this benchmark, we uncover a fundamental limitation of off-the-shelf MLLMs in delivering safe and time-sensitive navigation instructions, even with model fine-tuning on substantial amounts of data. We then demonstrate that a simple yet effective modification of the model, including direct supervision to predict the underlying reason for each instruction, yields significant performance gains across open-loop, closed-loop, and sim-to-real generalization settings. However, our analysis highlights persistent challenges in temporal reasoning, safety-critical object awareness, and relational and distance understanding. To advance the development of scalable assistive agents, we will release our simulation, benchmark, and code (available at the project website: https://timeli-icra.github.io/).

Bernhard Hilpert, Kim Baraka, Joost Broekens
总结: 用时序差分误差构造可解释的强化学习顿悟情感信号。
方法: 取绝对时序差分误差生成信号,并通过仿真评估构念效度。
证据: 摘要考察仿真中的微观、宏观动态和事件以检验有效性。
为什么适合我: 关注人类教学理解,不服务运动跟踪或全身控制。
推荐理由: 讨论强化学习过程的人类可解释情感信号,不涉及人形、足式或物理角色控制。
原摘要

In Human-Interactive Robot Learning (HIRL), human teachers assess learning progress by observing agent behavior. However, Reinforcement Learning (RL) agents often fail to express learning progress in human-interpretable ways, leading to suboptimal or counterproductive teaching. This work proposes "Insight": a human-interpretable affective signal grounded in the RL process. It is specifically designed to address the "Absence of learning" human teacher mental model misalignment - the misconception that a failing or exploring agent is broken, underpowered or not learning at all - by signaling an agent's "Aha!" Insight moment. The signal is derived from the absolute Temporal Difference (TD) error making it easily implementable in other RL agents. To ground this signal, five design criteria were formulated: Relevance, Interpretability, Faithfulness, Scalability, Generalizability. The structural construct validity was assessed through simulation, examining micro and macro dynamics and event-related sensitivity. Micro dynamics reveal that Insight captures meaningful learning events at the appropriate time and magnitude. Macro dynamics demonstrate that the signal follows the agent's learning phases and reflects overall progress. Event-related sensitivity shows, the signal distinguishes the saliency of environment interactions, such as positive rewards versus "trauma-like" negative events. These results demonstrate that technical RL dynamics can be effectively packaged into human-like affective substrates to close the teacher-learner loop.