Papers for 2026-11-15

10 papers

Dataset-Free Compliant Humanoid Loco-Manipulation with Dynamic Online Posture

5.0/5 很相关 裁判分 10.0 Top pick 当日相对
Seungho Yeom, Zhenyu Wu, Jaeyoung Huh, ... , Soofiyan Atar, Michael Yip
总结: 无需人体数据,用末端目标与行走速度实现柔顺人形移动操作。
方法: 可达性先验在线定骨盆与躯干,弹簧阻尼按外力修正末端参考。
证据: 仿真中该先验把参考获取成功率从37.8%提高到77.8%。
为什么适合我: 直接服务人形全身移动操作与柔顺控制,且免人体动作数据。
推荐理由: 直接对应人形移动操作与全身控制:无需人体动作数据,仅由末端目标与行走速度驱动在线姿态和全身柔顺。
原摘要

Most humanoid loco-manipulation controllers require human motion data to learn whole-body coordination and posture, leaving policies reliant on external sources to provide this data. We present OCLO (Online-posture Compliant LOco-manipulation), a humanoid loco-manipulation system trained without human motion data and commanded only through two end-effector targets and a walking velocity. Because these targets do not uniquely determine whole-body posture, OCLO generates pelvis height and torso orientation online using an analytic reachability prior, further refined through policy-in-the-loop sampling with a task-agnostic cost. OCLO also learns whole-body compliance by displacing end-effector references according to measured forces through a spring-damper model, encouraging the legs, waist, and pelvis to yield to external loads. In simulation, using the reachability prior leads to a 77.8% success rate in acquiring the commanded reference, a vast improvement over the 37.8% success rate accomplished without the prior. Further, refinement reduces end-effector orientation error across all evaluated tasks. The same posture module improves a pretrained SONIC controller on all five tasks. Without compliance training, policies tend to lose balance under disturbances rather than sacrifice tracking. On a Unitree G1, OCLO maintains balance under end-effector disturbances that cause its ablations to fail and performs nine loco-manipulation tasks, including crouched walking and picking up a box from a low surface. Project website: https://oclo-humanoid.github.io/

Cheng Fan, Bingyang Zhou, Gang Yang, ... , Yan Rui Tan, Fan Shi
总结: 可微强化学习把四足从深度观测扩展到三维避障运动。
方法: 软穿透惩罚与停梯度训练教师,再蒸馏深度学生并门控混合步态。
证据: 摘要说明硬碰撞终止会破坏梯度,软约束用于提供训练信号。
为什么适合我: 贴合足式深度感知运动和强化学习仿真,不是人形或跑酷。
推荐理由: 高度契合感知型足式运动:四足端到端可微强化学习做三维避障,并将特权教师蒸馏为基于深度的可部署学生。
原摘要

Differentiable reinforcement learning shows strong promise for robot policy learning, but its application to legged locomotion has remained limited to blind walking or simulated 2D tasks. Extending it to end-to-end visual obstacle avoidance is challenging because hard collision constraints and early termination upon contact corrupt first-order gradients, trapping optimizers in local minima. We present E2DRL, which addresses this with a soft differentiable obstacle-interaction formulation: penetration penalties across multiple body keypoints with velocity-conditioned stop-gradient shaping to provide the first-order training signals for 3D obstacle avoidance. To realize a deployable perception-control system, a privileged teacher trained via Soft Analytic Policy Optimization (SAPO) in a differentiable simulator is distilled into a recurrent depth-based student via DAgger, then blended with a base locomotion policy using a terrain-aware gating module for deployment. In simulation, E2DRL achieves higher sample efficiency than PPO and demonstrates superior velocity-tracking performance and 3D obstacle-avoidance capability compared with both PPO and Duality-based DCBF NMPC. We present the first sim-to-real validation of end-to-end differentiable RL for 3D obstacle avoidance on a Unitree Go2 in static and dynamic environments.

Ömer Tarık Banuş, Uluç Saranlı, M. Mert Ankaralı
总结: 分层控制用强化学习改运动参考,优化全身层负责高频执行。
方法: 向量化控制器在环里,策略只调节已能独立小跑的模型控制。
证据: 自适应落足贡献最大,平均存活率77.29%高于基线50.35%。
为什么适合我: 适合关注足式全身控制、强化学习与模型控制结合的读者。
推荐理由: 对应足式全身控制:强化学习调节结构化运动参考,底层保留步态调度、落足规划与全身冲量控制。
原摘要

Quadruped locomotion requires coordinating body motion,contact forces, foothold placement, and gait timing. We present a hierarchical controller in which reinforcement learning adapts these structured locomotion references while a gait scheduler, reactive footstep planner, and whole-body impulse controller retain responsibility for high-frequency execution. The model-based backbone can sustain a nominal trot independently, allowing the policy to focus on when and how to modify an already functional locomotion controller. We train the complete hierarchy in a vectorized controller-in-the-loop environment using a six-direction disturbance curriculum. Under a common simulator and evaluation protocol, the proposed controller achieves 77.29% mean survival across the tested disturbance grid, compared with 50.35% for the model-based reference controller. Training-time channel ablations identify adaptive foothold placement as the largest marginal contributor to grid survival and reveal direction-dependent effects of gait-rate adaptation. Together, these results demonstrate the viability of the proposed hierarchical controller architecture for integrating learned adaptation with optimization-based whole-body control through structured locomotion references.

Austin Graves, Chuizheng Kong, Yunho Cho, ... , Shreyas Kousik, Mohsen Moghaddam
总结: 双人协作遥操作中回传轻量指尖接触的振动或声音提示。
方法: 扩展现实框架同步两台人形,在抬翻木箱任务中比较反馈条件。
证据: 全部三十二人把指尖振动排在声音之上,十八人评为最有效。
为什么适合我: 符合人形遥操作兴趣,但缺少全身控制、跟踪与仿真迁移。
推荐理由: 落在人形遥操作方向,研究双人协作遥操作的指尖接触反馈;偏交互评测而非运动跟踪或全身策略,但仍贴近兴趣。
原摘要

Dual-operator humanoid teleoperation enables collaborative manipulation through two separate robots, but operators lack direct awareness of robot-object contact that is normally available during physical interaction. To address this, we present eXtended Reality Teleoperation (XRT), an extended reality teleoperation framework that returns a robot's fingertip contact through lightweight vibrotactile and/or auditory feedback, and a synchronized dual-humanoid testbed built on it for two operators. Sixteen dyads performed a collaborative crate lift-and-flip under vision only and the three feedback conditions in a counterbalanced within-subject design with verified feedback-channel delivery. Three results follow. First, operators rated our finger-localized vibrotactile display as more effective than our open-ear sonification: all 32 ranked it above the sonification, 18 ranked it most effective, and its cues were rated far easier to perceive and interpret than the auditory cues. Second, completion time, failures, workload, discomfort, and partner awareness showed no detected condition differences, with wide completion-time intervals and smaller meaningful effects unresolved. Third, performance changed substantially with practice, especially on the harder flip-over task: completion time improved across blocks, and attempt-to-attempt variation within a dyad (SD x1.51) was larger than the largest condition contrast (x1.16). Exploratory analyses detected no difference in immediate grip or motion responses between feedback conditions. For novice collaborative teleoperation, our fingertip vibrotactile cues were rated more effective and easier to interpret than our auditory cues, while their effect on task performance remains unresolved.

Solving a Giant Rubik's Cube with a Quadruped Robot

4.0/5 相关 裁判分 8.0 Strong 当日相对
Lukas Amiet, Gabriel Sánchez-Blanco Repgen, Mayank Mittal, ... , Marco Hutter, Cesar Cadena
总结: 四足只用脚自主求解独立巨型魔方并维持层状态。
方法: 彩色深度估计位姿与配色,特权强化学习技能蒸馏到机载深度策略。
证据: 摘要强调误动层会破坏后续操作,部署策略容忍相对位姿变化。
为什么适合我: 结合足式移动操作、深度感知、动作技能学习与实机部署。
推荐理由: 接近足式全身技能与深度感知:四足用脚完成物体位姿与内部构型控制,强化学习技能再蒸馏到机载深度策略。
原摘要

Pedipulating a freestanding articulated object requires controlling its pose and internal configuration while maintaining balance. We demonstrate this capability by autonomously solving a giant Rubik's Cube with a quadruped using only its feet. The task demands repeated precise interactions, since unintended layer motion can invalidate subsequent operations. We develop an onboard RGB-D perception pipeline that estimates the cube's metric pose and its full color state from partial views acquired through locomotion and flipping. A planner converts the computed solve into robot-executable skill sequences. Learned whole-body skills reorient the cube while preserving its layer configuration and turn its layers with one foot pinning the cube as the other pushes. We train these skills using reinforcement learning with privileged observations and distill them into policies that map onboard depth and proprioception to joint targets. The deployed policies tolerate variations in relative robot-cube placement and recover from external disturbances. The system completes three autonomous hardware solves, each about 30 steps over 8-9 minutes. These results show that combining onboard perception with coordinated pedipulation enables a quadruped to complete extended multi-step physical tasks. Additional material can be found at: https://leggedrobotics.github.io/rubik-skills/

Abhishek Naik, Michael Wu, Michael O'Sullivan, Colin Bellinger, Yunli Wang
总结: 四足在极短仿真训练后把强化学习策略可靠迁到真实地形。
方法: 低配置仿真框架训练控制策略,并在月面模拟设施中验证迁移。
证据: 单张消费级显卡训练少于二十分钟后可可靠通过多样地形。
为什么适合我: 紧扣强化学习、物理仿真和仿真到现实,载体是足式机器人。
推荐理由: 契合足式强化学习与仿真到现实:四足快速学会穿越多样真实地形及月球模拟环境,但非高动态跑酷或运动跟踪。
原摘要

This work demonstrates the use of a fast simulation-based training framework to learn control policies using reinforcement learning. The hardware requirements are minimal and the simulation-learned policies transfer reliably to the real world. With this setup, we show that a quadruped robot can learn to traverse diverse real-world terrains reliably---including in a lunar-analog facility---after less than 20 minutes of training on a single consumer-grade GPU. These results provide a glimpse of a future where reinforcement learning is a crucial tool in developing more capable and robust space robotic systems. Video demonstrations are available at https://youtu.be/vUFJiZdJaQ0.

Shifei Duan, Zhe Wang, Francesco De Pace, Minas Liarokapis
总结: 用混合现实半自主遥操作降低双手精细任务的数据采集负担。
方法: 头显提供直观人在回路控制,半自主分担重复而费神的操作。
证据: 摘要认为大规模灵巧示范易使操作者疲劳,因而需要半自主。
为什么适合我: 只贴近遥操作与示教采集,不覆盖全身控制或运动模仿。
推荐理由: 混合现实半自主遥操作面向精细双臂示教采集,未体现人形或足式全身控制,只与遥操作弱相关。
原摘要

Nowadays, robotic telemanipulation enables humans to control robots so as to execute tasks in a manner similar to how they perform them, and serves as an essential approach for collecting on-robot data for robot learning by human demonstrations. The quality of collected demonstrations directly impacts the performance of the learned policy. However, existing telemanipulation systems rely heavily on human operation, particularly for large-scale data collection. Collecting dozens or hundreds of demonstrations is a demanding process, as operators tend to fatigue quickly, especially during the execution of dexterous tasks that require sustained concentration. Recently, semi-autonomous robotic telemanipulation has emerged as a promising direction that reduces operator workload while preserving human-in-the-loop control for task execution. We therefore introduce a scalable, intuitive, semi-autonomous robotic telemanipulation system that leverages a mixed reality (MR) headset for on-robot data collection. The system autonomously executes the majority of the task trajectories and only requires the operator to make fine adjustments at key stages. We validate the effectiveness of our system by collecting data and training imitation learning policies on the execution of a high-precision, fine-grained bimanual peg-in-hole task. With lower data collection effort, our system obtains high-quality demonstrations that can be used to train fully autonomous task execution policies.

Xiaowen Qiu, Yian Wang, Haoxiang You, Chuang Gan
总结: 把仿真场景生成的人手视频转成物理可执行的灵巧示范。
方法: 利用已知几何做跟踪与深度对齐,重定向后以残差强化学习修正。
证据: 摘要指出生成视频含几何失真与错误接触,难以直接上机执行。
为什么适合我: 非常贴近人体到机器人重定向、动作模仿和仿真物理落地。
推荐理由: 聚焦灵巧手操作与生成视频示教恢复,不是人形全身控制、运动重定向或足式移动。
原摘要

Human video demonstrations provide rich manipulation strategies for dexterous manipulation learning. We study a setting in which a fully specified simulated scene is used to generate videos that specify the demonstrated manipulation behavior. This setup provides access to scene information such as object geometry, articulation, and camera parameters, while allowing direct control over task and scene configuration. However, generated videos may contain geometric distortions, inaccurate contacts, and other physical inconsistencies, making the recovered motion difficult to execute directly on a robot. We present an end-to-end framework for converting such simulation-grounded videos into physically executable dexterous robot demonstrations. Our perception pipeline leverages the known scene through model-based object tracking with dense foundation-model features and depth-based hand-object alignment. The recovered human motion is then retargeted and physically grounded using residual reinforcement learning, where a backward curriculum and a cache of physically valid reset states enable the policy to correct imperfect video-derived references while preserving the demonstrated manipulation strategy. On clean ARCTIC demonstrations, our method achieves competitive performance with prior dexterous retargeting approaches and shows greater robustness when applied to references extracted from generated videos. We further demonstrate diverse rigid and articulated manipulation tasks in simulation and successful open-loop transfer of the optimized trajectories to a real dexterous robot.

Minghao Liu, Tutian Tang
总结: 一个模型用掩码流匹配从灵活稀疏传感恢复全身人体运动。
方法: 跨模态掩码编码异构输入,条件流匹配推理只做一步积分。
证据: 摘要称其在三种设置和七个基准上测试,包括野外数据集。
为什么适合我: 有助人体运动获取与重定向前置,但不是机器人控制器。
推荐理由: 从可穿戴传感器恢复人体SMPL运动,仅与运动重定向的上游人体动作相关,本身不做机器人控制。
原摘要

Recovering 3D human motion from sparse wearable sensors is challenging due to the inherent noise, occlusion, and instability of real-world tracking signals. Existing approaches are restricted to fixed sensor configurations and, when built on diffusion models, are computationally prohibitive for real-time deployment. We propose OmniPoser, a universal framework that recovers full-body SMPL motion from a flexible combination of heterogeneous inputs, such as 3D keypoints, sparse IMU rotations, head-mounted 6-DoF poses, or any subset thereof, within a single model. OmniPoser introduces a cross-modal masking mechanism paired with a Masked Conditioning Encoder, enabling one architecture to incorporate diverse sensor configurations through a masked design. A decoupled dual-stream generative backbone generates complete motion via Conditional Flow Matching, requiring only a single ODE integration step at inference. Across three settings and seven benchmarks, including in-the-wild Nymeria and Ego-Exo4D datasets, OmniPoser performs on par with state-of-the-art methods while running at over 700 FPS. The project page is available at https://jamesbridgewater51.github.io/omniposer-eccv/.

Reinforcement Learning-driven Diffusion Models: Language, Vision, and Beyond

2.0/5 偏低 裁判分 1.0 Candidate 当日相对
Zhiyuan Ma, Jiabao Wei, Tianyu Wang, ... , Xiang Bai, Bowen Zhou
总结: 首篇综述讨论强化学习如何后训练并引导扩散模型生成。
方法: 围绕轨迹优化和奖励设计,分语言、多模态、机器人与科学梳理。
证据: 摘要给出技术全景与经验分析,没有报告具体机器人实验数字。
为什么适合我: 与人形足式全身控制、跟踪和移动操作几乎无直接关系。
推荐理由: 强化学习驱动扩散模型的跨语言与视觉综述,虽提及机器人,但不是人形运动生成或全身控制工作。
原摘要

Diffusion models (DMs) have steadily demonstrated outstanding performance in high-fidelity, controllable generation across diverse scenarios, following the "pretraining-finetuning" paradigm established in LLMs. Despite these advances, conventional DMs still face critical limitations in sophisticated reasoning, autonomous exploration of generation pathways, and adaptability to complex, human-aligned objectives. Inspired by RLHF's success in LLMs, RL has recently emerged as a pivotal post-training mechanism to iteratively refine DMs through reward-driven trajectory optimization. This paper presents the first comprehensive review of RL-driven DMs and an empirical analysis of how RL reshapes the diffusion process towards experience-centric, goal-directed generation. We propose a novel technical panorama elucidating RL's multifaceted roles in diffusion-based language, multimodal, robotic, and scientific models, with a granular focus on diffusion trajectory optimization and reward engineering. Through extensive experiments on multiple task-specific benchmarks, we systematically evaluate representative methods to intuitively highlight the advantages of different RL post-training strategies. Furthermore, we reveal and dissect three crucial bottlenecks that currently hinder the real-world deployment of RL-driven DMs: reward design fragility, exploration-exploitation trade-off in high-dimensional generation spaces, and training instability under sparse rewards. Based on these perspectives, we provide a principled roadmap for the integration of RL into DMs and outline promising future research directions for robust, interpretable RL-diffusion systems. We also construct a public repository to continuously track the latest developments in this rapidly evolving field: https://github.com/MAIR-Lab-HUST/Awesome-RL-for-Diffusion-Models.