Papers for 2026-11-19

10 papers
Lechen Zhang, Chenyuan Chen, Muxin Zhou, Zewen He, Yoshihiko Nakamura
总结: 以身体图式组织视觉与动作,高效学习全身移动操作。
方法: 运动学树承载关节连杆特征,各部位查询视觉后去噪自身动作。
证据: 动作块返回更快,且无空间监督时出现分工化视觉读出。
为什么适合我: 契合人形视觉全身控制、移动操作与动作模仿。
推荐理由: 直接做全身loco-manipulation的模仿学习与视觉-动作接口,最贴近人形移动操作和全身控制。
原摘要

Currently, robots can learn whole-body loco-manipulation through scale: the strongest policies have billions of parameters and still need task-specific fine-tuning. Humans have limited processing capacity, yet learn and act efficiently through a body schema that organizes what they see and how they move. We introduce Body Schema Policy (BSP), an imitation learning policy that builds such a schema into the vision-action interface. Its latent body schema places joint and link tokens on the robot's kinematic tree, where learned screw motions carry features between links. Through body-queried vision, each body part retrieves its own visual evidence, which conditions the denoising of its actions. With this inductive bias, BSP returns an action chunk faster than any policy we compare. Compact, body-specific visual readouts also emerge without spatial supervision: manipulation commands depend strongly on task objects, while locomotion commands respond more broadly to the scene. On nine simulated Unitree G1 whole-body tasks, BSP matches the $\Psi_0$ humanoid foundation model with $75\times$ fewer parameters and nearly doubles Diffusion Policy's success. The same holds on a real G1 and a Fetch mobile manipulator.

Zhaoyang Li, Chiyu Zhang, Chengxin Xu, ... , Wanting Li, Ziyu Chen
总结: 轻量扩展预训练跟踪策略,使人形在共享空间主动避人。
方法: 接入人体感知与前瞻避让,在保持参考动作的同时局部修正。
证据: 多跟踪骨干的仿真与真机实验实现无碰撞并快速恢复跟踪。
为什么适合我: 服务人形全身运动跟踪、遥操作安全与人机共存。
推荐理由: 在预训练全身运动跟踪策略上加入人体感知与主动避让,紧贴人形运动跟踪与遥操作。
原摘要

Whole-body motion tracking has enabled humanoid dancing, athletic motions, and teleoperation, providing a foundation for capability demonstrations and manipulation data collection. However, existing tracking policies lack awareness of nearby humans and proactive avoidance capabilities, while motion substitution and local constraint-based corrections may compromise reference motion integrity and tracking continuity. We propose ALERT, a general lightweight pipeline for extending motion tracking to shared human-robot environments. Through lightweight adaptation, it integrates human perception and proactive avoidance into pretrained tracking policies, balancing avoidance demands with reference motion tracking while preserving existing motion capabilities. Simulation and real-world experiments across tracking backbones demonstrate reliable collision-free execution through localized human avoidance, preserving whole-body coordination and enabling rapid recovery of reference tracking, while retaining the ability of pretrained policies to track unseen motions.

Koki Inami, Takashi Sato, Hiroyuki Oka, ... , Yuki Noka, Shohei Matsugu
总结: 商用人形完成赛道自主奔跑,覆盖百米至一千五百米。
方法: 结合车道视觉、路径跟踪和带人体运动先验的强化学习奔跑策略。
证据: 在G1上针对电机发热限速配速,参加三项赛跑并取得第十三名。
为什么适合我: 覆盖人形高动态奔跑、视觉运动、动作先验与真机部署。
推荐理由: Unitree G1真实赛道奔跑,结合车道感知、人类运动先验强化学习与硬件约束,贴近高动态足式运动和仿真到现实。
原摘要

Learning-based methods now let humanoids run robustly, and they have begun to compete in athletic events. Yet few reports describe a complete autonomous humanoid running system in an actual race, where the robot must follow a lane at a new venue, pace itself within hardware limits, and finish without intervention. We report such a system deployed on the Unitree G1, a commercially available general-purpose humanoid, in the 100 m, 400 m, and 1500 m events of the World Humanoid Robot Games 2026. The system integrates vision-based lane perception, path tracking, and a running policy trained by reinforcement learning with a human motion prior. To address the challenges of humanoid running, we stabilize head-camera images against body motion and use IMU-assisted leg odometry to bridge flight phases. To manage motor heating, we penalize hip-pitch torque during training, add heat-dissipation plates, and apply temperature-based speed limiting with event-specific pacing. The robot placed 13th of 74 in the 100 m, 10th of 44 in the 400 m first round before falling in the semifinal, and seventh of 35 in the 1500 m. In this deployment, thermal margin set the pace in every event, and the semifinal fall followed a lane-detection error.

CADENCE: Learning Acyclic Gaits for Model-Based Quadruped Locomotion

4.0/5 相关 裁判分 8.0 Strong 当日相对
Owen Sullivan, Sourav Selvaraj, Mahdi Agheli
总结: 学习小动作空间步态规划器,让四足摆脱固定周期步态。
方法: 在凸模型预测控制上用强化学习离散选择落足,并预测摆腿时间。
证据: 无步态奖励仍出现对角配对的非周期步态,并可冻结迁移。
为什么适合我: 直接对应足式模型预测控制与强化学习步态生成。
推荐理由: 用强化学习在凸MPC上学习四足非周期落足,贴近足式运动与全身模型预测控制,但不是人形跟踪。
原摘要

Model-based quadruped controllers usually step on a cyclic gait, which lifts the legs in a fixed order on a fixed period, wherever the safe footholds are. We present CADENCE, a learned step planner with a small action space. Every 40 ms, it picks one of at most 65 discrete choices: no step, or one leg's step to a safe foothold. It also predicts a swing time. We train CADENCE by reinforcement learning on top of a convex model predictive controller (MPC). Nothing prescribes a gait: there is no gait schedule, and the reward has no gait term, only a cost per step. The one structural constraint is that at most two legs may swing at once. The policy we analyzed developed an acyclic gait, with no fixed period or stepping order, yet it still paired diagonal legs. An inverse footstep model (IFM), fitted on a controller's logged steps, turns each foothold into a command. With only the IFM refitted, on fewer than 20,000 steps, CADENCE ran frozen on OCS2's nonlinear MPC. In simulated trials on a range of terrains (26% to 49% voids) and speeds (0.1 m/s and 0.2 m/s), it succeeded in 85.1% (mean of five seeds), against 67.8% for OCS2-Trot, 65.5% for OCS2-Single, and 39.6% in a static walk ablation of CADENCE. At 49% voids, it succeeded in 72.9%, against 43.0% for OCS2-Trot.

Heave-Ho: Decentralized Long-Horizon Multi-Humanoid Collaboration

4.0/5 相关 裁判分 7.0 Strong 当日相对
Ting-Hsuan Chen, Siheng Zhao, Han Jiang, ... , Quan Nguyen, Yue Wang
总结: 去中心化实现多人形长时程协作式全身移动操作。
方法: 低层后训练适配物理耦合跟踪,高层用视觉语言规划与语音协同。
证据: 两机训练可扩展至十台及异构队伍,且无需重新训练。
为什么适合我: 把人形全身跟踪扩展到多机协作、长时规划与移动操作。
推荐理由: 低层改编人形基础跟踪模型以完成耦合全身移动操作;多机规模接近排除的群体机器人,但主体仍是人形控制。
原摘要

Collaboration promises to extend humanoid capabilities beyond what individual robots can achieve. However, realizing this potential requires coordinated whole-body interactions, coherent long-horizon planning, and precise synchronization across robots. We introduce Heave-Ho, a decentralized framework for long-horizon collaborative multi-humanoid loco-manipulation. At the low level, we develop a multi-agent post-training framework that adapts a humanoid foundation tracking model to physically coupled interactions between humanoids, enabling coordinated decentralized control from local observations alone. At the high level, we train a vision-language planner and design a speech-based leader-follower coordination mechanism to synchronize decentralized execution without network communication. Trained with two identical humanoids, our system scales to teams of up to ten robots and generalizes to heterogeneous teams without retraining. To benchmark these capabilities, we introduce HH-Bench, comprising 12 tasks involving teams of 2 to 10 humanoids, including heterogeneous teams. Systematic evaluations show that Heave-Ho consistently outperforms baseline methods, while real-world experiments demonstrate robust decentralized collaboration across challenging tasks.

From Temperature-Limited to Battery-Limited Legged Locomotion

3.0/5 一般 裁判分 8.0 Strong 当日相对
Rapha\"el S\'egas, Bal\'azs Opra, L\'eo Ghafari, Thomas Stewart
总结: 训练不直接观测温度的足式策略,以降低电机热极限。
方法: 拟合集总热网络,用平均力矩与转速预测稳态温度并写入奖励。
证据: 在Go2上十二个电机温度预测的平均误差低于一摄氏度。
为什么适合我: 关乎四足持续运动的硬件热约束与强化学习奖励设计。
推荐理由: 四足热感知行走策略只边缘涉及足式运动,核心是电机温升而非全身跟踪、感知或移动操作。
原摘要

On legged robots, sustained locomotion often ends in thermal shutdown rather than battery depletion: the heat of walking concentrates in a few joint motors, which overheat long before the battery is empty. We train thermally aware locomotion policies by reinforcement learning without ever observing temperature, and demonstrate this on a Unitree Go2 quadruped. We first identify a coupled 13-node lumped RC thermal network, fitted on two runs of a single robot and calibrated against the measured electrical power, that predicts all twelve motor temperatures with a mean RMSE below 1 $^\circ$C across different robot instances, gaits, payloads, and speeds. Under a sustained gait, the temperatures the motors will settle at follow directly from the gait-averaged squared torques and joint speeds. Our core contribution is a reward that drives down the hottest predicted asymptotes: thermal time constants exceed the credit-assignment horizon of reinforcement learning by orders of magnitude, but predicted asymptotes respond to torque and joint speed within a single gait cycle, so the policy learns to lower and spread heat with no temperature input. On the robot, the policy turns sustained locomotion from temperature-limited to battery-limited: with a 5 kg payload at 1 m/s, a learned baseline reaches thermal shutdown after 19 minutes (1.1 km), whereas our policy runs the battery down after 174 minutes (10.0 km) with its hottest motor 14 $^\circ$C below the shutdown threshold in a 26 $^\circ$C room; on an unloaded factory circuit with stairs and ramps, the baseline overheats after 25 laps (6.2 km), while our policy completes 47 (11.2 km) on one battery with 22 $^\circ$C of margin.

Yanghong Liu, Yang Chen, Kailang Xu, ... , Ruihai Wu, Wei Zhan
总结: 将人类视频先验细化成可执行的双臂灵巧操作演示。
方法: 仿真强化学习保留交互结构,并用置信度修正不可靠的物体运动。
证据: 以物体轨迹和双腕相对轨迹指导协调,同时重生机器人抓取。
为什么适合我: 贴近人体到机器人重定向,但重点是双手灵巧操作而非腿式运动。
推荐理由: 把人体视频先验重定向为双臂灵巧操作数据,只部分贴近运动重定向,并非全身人形或足式控制。
原摘要

Collecting demonstrations for bimanual dexterous manipulation is costly, motivating the use of human videos as a source of robot training data. However, uncertainty in video-derived motion estimates and differences between human and robot embodiments make direct motion transfer challenging. In this work, we introduce PriDex, a framework that transforms human-video Priors into executable robot Dexterous manipulation demonstrations through reinforcement learning in simulation. PriDex preserves task-relevant interaction structure while allowing embodiment-specific behavior to be regenerated for the robot. Human-object interactions provide affordance cues for selecting task-relevant, robot-specific grasps from geometry-based candidates. For motion refinement, object trajectories provide a task-level reference, while relative bimanual wrist trajectories offer complementary guidance for coordinated motion. Since object-motion estimates can become unreliable under occlusion or visual ambiguity, PriDex uses object-motion confidence to adaptively balance these two priors, emphasizing object-level guidance when confidence is high and increasing the contribution of wrist-level guidance as confidence decreases. Reinforcement learning refines these video-derived priors under the robot's kinematic and physical constraints, and the resulting policies are rolled out to generate robot demonstrations for training a vision-based diffusion policy. We evaluate PriDex on four bimanual dexterous manipulation tasks, including pouring, sweeping into a dustpan, bottle-cap unscrewing, and plate cleaning, assessing both simulation-based robot data generation and downstream visuomotor policy learning.

Yuhan Wang, Ruiyang Wang, Jiaguan Zhu
总结: 用结果均衡的策略优化后训练流式视觉语言动作模型。
方法: 按成功率重加权正优势并保持符号,同时周期校正策略诱导的流场。
证据: 该后训练框架已在仿真操作基准上进行评估。
为什么适合我: 与视觉动作策略强化学习后训练有关,但偏离足式全身控制。
推荐理由: 面向通用流式VLA的PPO后训练,与人形/足式全身控制、运动跟踪无直接对象。
原摘要

Reinforcement learning (RL) enables post-training of flow-based vision-language-action (VLA) policies by optimizing expected task return through environment interaction. However, this optimization raises two challenges: policy updates can alter the velocity-field geometry underlying the score approximation used for stochastic transitions, and sparse multi-task rollouts can yield uneven learning signals across tasks and advantage signs. We introduce an RL framework that combines Outcome-Balanced Proximal Policy Optimization (PPO) with policy-induced flow rectification. Outcome-Balanced PPO reweights positive advantages using task success-rate estimates and rescales positive and negative advantages while preserving their signs. Policy-induced rectification periodically fits a linear-bridge flow to ODE endpoint pairs generated by the current policy, refreshing the representation used in subsequent stochastic optimization. We evaluate the framework on simulated manipulation benchmarks and additionally study a component combination in a Real2Sim2Real task, examining task performance, optimization behavior, and flow consistency. The proposed framework improves success rates over the evaluated baselines across the simulated benchmarks.

Test-Time Constraint-Aware Diffusion Predictive Control

2.0/5 偏低 裁判分 5.0 Candidate 当日相对
Braghadeesh Lakshminarayanan, Ojas Phadake, Qi Chen, Dominik Baumann
总结: 测试时倾斜扩散采样,使预测控制适应新的安全约束。
方法: 以预训练序列为先验,按约束违反惩罚指数倾斜,并用失败比例调强度。
证据: 在线依据未通过约束校验的序列比例调节倾斜强度。
为什么适合我: 呼应模型预测控制的约束处理,但未指向人形或足式平台。
推荐理由: 通用扩散预测控制的测试时约束适配,未针对人形或足式全身技能。
原摘要

Diffusion models can learn multimodal distributions over finite-horizon state-input sequences, providing a way to generate candidates for predictive control. However, sequences generated by a pretrained model may violate safety constraints introduced at deployment, for example when obstacles are added or repositioned. Retraining whenever these constraints change limits the usefulness of learned predictive controllers. In this paper, we propose Test-Time Constraint-Aware Diffusion Predictive Control (TCA-DPC), an algorithm for adapting the sampling distribution of a pretrained diffusion controller to newly introduced safety constraints without retraining. We treat the pretrained model as a prior over finite-horizon sequences and define an adapted distribution through exponential tilting based on a constraint-violation penalty. The tilt strength is adjusted online using the fraction of generated sequences that fail constraint verification. We approximately sample the adapted distribution using the Metropolis-adjusted Langevin algorithm in the Gaussian noise space of the pretrained diffusion sampler.

World Manipulation Team, Che Tsang Calvin, Xingyu Chen, ... , Li Liu, Wenhao Wang
总结: 真机数据质量受工作空间、遥操作摩擦和延迟等隐性因素影响。
方法: 比较二十五台双臂可达性,并做受控遥操作与微调策略评估。
证据: 分部位并行控制缩短完成时间,柔顺控制提高成功并降低接触力峰值。
为什么适合我: 关系到遥操作演示质量、双臂操作数据与真机策略学习。
推荐理由: 分析双臂遥操作数据质量,只与遥操作弱相关,不是人形全身遥操作或运动跟踪。
原摘要

As real-robot data collection scales, collection-system design shapes both operator efficiency and the behaviors learned by robot policies. Workspace limitations, control-interface friction, and latency can introduce pauses, detours, and corrective motions into otherwise successful demonstrations. We investigate these effects across embodiment, teleoperation control, and data consistency, combining a kinematic study of 25 dual-arm robots, controlled teleoperation experiments, and real-robot evaluation of fine-tuned $\pi_{0.5}$ policies. The embodiment study shows that positional reachability overstates orientation-aware task coverage and that modest shoulder motion can substantially expand the effective workspace. Teleoperation experiments show that parallelizing body-part control reduces task completion time by 43-53%, while compliant control improves success and reduces peak contact forces on constrained and contact-rich tasks. Policy-learning experiments show that demonstrations must capture the visual information underlying action choices: active-search demonstrations improve arm-selection accuracy from chance (50%) to 100%. Calibration experiments reveal that mixed-calibration training data remain usable in our tested configurations when an inference-aligned subset is retained, whereas inference-time miscalibration causes all 30 trials to fail. Policies also retain approximately 90% of the extra path length in detour-contaminated demonstrations, showing how inefficient operator motions persist in learned behavior. Together, these findings connect collection-system design to demonstration quality and downstream policy execution. They motivate evaluating effective workspace, control efficiency, observation completeness, calibration alignment, and motion quality before scaling collection, and addressing system-induced compensations at their source.