Papers for 2026-11-10

10 papers
Tianshu Wu, Tianxiang Gui, Yue Chen, ... , Jingya Wang, Hao Dong
总结: 用合成交互参考和共享流程学习多样视觉人形移动操作。
方法: 模板适配空间配置生成参考,特权教师再以模仿奖励蒸馏视觉策略。
证据: 摘要称多样物体与视觉随机化用于支持泛化及仿真到现实。
为什么适合我: 直接对应视觉人形移动操作、动作模仿和仿真迁移。
推荐理由: 直接对应人形移动操作与视觉运动技能:用合成交互参考、模仿学习和教师蒸馏学习多样化视觉人形loco-manipulation。
原摘要

Scaling up visual humanoid loco-manipulation skill acquisition requires reducing the human effort needed as tasks and spatial configurations expand, particularly in demonstration collection and task-specific training design. We present SUGARv2, a unified framework for learning diverse visual humanoid loco-manipulation skills through interaction reference synthesis and a shared training pipeline. To obtain diverse references at low cost, we adapt reusable task templates to different spatial configurations, synthesizing coordinated robot and object motions. To reduce task-specific reward design and training effort, we use reference-based imitation as a common learning objective across tasks. We first train privileged teachers to execute these references, then train visual policies through teacher distillation and reinforcement learning with the same reference-based mimic rewards, using diverse object instances and visual domain randomization to support visual generalization and sim-to-real transfer. Across five humanoid loco-manipulation tasks, SUGARv2 achieves a mean success rate of 91.0% in simulation. Deployment on a real humanoid robot further demonstrates successful sim-to-real transfer for whole-body manipulation. These results demonstrate the framework's potential for learning diverse visual humanoid loco-manipulation skills.

DKWBC: Decoupling Motion Tracking and Balancing for Humanoid Whole-Body Control

5.0/5 很相关 裁判分 10.0 Top pick 当日相对
Dingkun Wei, Zehong Shen, Huaijin Pi, ... , Yujun Shen, Xiaowei Zhou
总结: 把人形运动跟踪与平衡解耦,以降低控制输出波动。
方法: 逆动力学前馈和关节反馈提供跟踪,残差策略补充平衡力矩。
证据: 摘要认为相似姿态的动力学需求差异会增加联合策略学习难度。
为什么适合我: 紧密契合人形全身控制与参考运动跟踪。
推荐理由: 直接对应人形全身控制与运动跟踪:把参考运动跟踪和平衡解耦,并结合模型前馈与学习残差。
原摘要

Humanoid whole-body control requires a robot to track diverse reference motions while maintaining balance under gravity, torque limits, contact switching, and external disturbances. Existing reinforcement-learning-based trackers typically learn control outputs that jointly address motion tracking and balance. However, similar reference poses can correspond to substantially different dynamic demands, requiring a unified policy to learn motion-dependent control requirements alongside balance corrections. This can complicate learning and lead to high-frequency fluctuations in control outputs. We propose DKWBC, a dynamics-informed whole-body control framework that combines explicit model-based tracking with a learned balancing residual. Inspired by the model-based and environmental-wrench contributions to joint torques in floating-base dynamics, DKWBC uses inverse-dynamics feedforward and joint PD feedback to supply tracking torques, while a residual policy learns additional joint-torque corrections for balanced execution. By explicitly accounting for motion-dependent torque demands, this structure simplifies the policy's learning task. Experiments in simulation and on real hardware demonstrate that a single learned balancing policy generalizes across motion datasets while maintaining accurate motion tracking and balance across ground support, attached payloads, and physical interaction. Project page: https://robbyant-research.github.io/DKWBC/.

ForPC: Force-Aware Whole-Body Control for Precise Humanoid Cart Pushing

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
ZhenYu Zou, Xing Liu, ShiChuang Wang, ... , Jun Wan, Cheng Cheng
总结: 以无力传感器的力感知全身控制实现人形精确推车。
方法: 先训练负载运动先验,再由力与状态潜变量驱动残差协调全身。
证据: 摘要指出接触力扰动平衡,多目标奖励惩罚内力对抗与滑移。
为什么适合我: 符合人形全身控制、移动操作与强化学习平衡需求。
推荐理由: 直接对应人形全身控制与移动操作:力感知全身策略完成推车,并用强化学习协调臂、腰与腿。
原摘要

Humanoid robots are expected to take over strenuous material handling in manufacturing, logistics, and healthcare, where operating existing wheeled carts would let them move heavy loads without modifying the workplace. However, humanoid cart pushing remains challenging because the bimanual grasp closes a force-coupled loop in which the contact wrenches that drive the cart also disturb the robot's balance, and payload changes alter the coupled dynamics. We propose ForPC, a force-aware whole-body control framework that regulates cart velocity through two-stage reinforcement learning. A locomotion prior is first trained under varied hand loads and upper-body postures to provide balance support. A force latent and a state latent are then inferred from onboard observations, without external force sensors, and fed to a residual policy that coordinates bounded arm, waist, and leg adjustments with base-velocity commands. Multi-objective rewards penalize bimanual internal opposition, grasp slip, and actuator saturation, encouraging the policy to apply contact force on demand without human demonstrations. Sim-to-sim experiments show that ForPC reduces cart-velocity RMSE by up to 68.2% relative to a locomotion-only baseline (Loco-only) and cross-track RMSE by up to 74.2% on the multi-bend route. Trained solely in simulation, the policy also transfers to a physical Unitree G1 without real-world training or fine-tuning and, with no payload-specific adjustment, pushes a cart carrying up to 30 kg at 0.5 m/s. These results suggest that humanoid robots could eventually replace humans for efficient material handling in daily life.

Nico Bohlinger, Jan Peters
总结: 仅凭机载惯性测量奖励加速度跟踪,快速学习人形行走。
方法: 用离策略强化学习,结合高增益位置控制与左右对称增强。
证据: 仿真中两款人形十四分钟学会,训练跌倒减少百分之八十一。
为什么适合我: 关乎人形运动强化学习,但侧重机载学习而非模仿。
推荐理由: 最接近人形足式运动的强化学习:在G1等平台用机载IMU加速度奖励快速学行走,但不是运动跟踪或移动操作。
原摘要

Learning locomotion directly on a humanoid robot is a promising direction to avoid the sim-to-real gap. However, locomotion rewards in Reinforcement Learning (RL) typically track the base velocity, which cannot be measured onboard without an external motion capture system or well-calibrated state estimator. This is why we introduce \method{}, which learns humanoid locomotion from minutes of samples with a reward that only requires the onboard Inertial Measurement Unit (IMU). Instead of tracking the base velocity, STRIDE rewards the robot for following a commanded acceleration profile. To learn efficiently from this reward, we use the off-policy RL algorithm XQC and combine a high gain setting for the joint position controllers with left-right symmetry augmentation. In simulation, STRIDE learns to walk on the Unitree G1 and Booster T1 humanoids within 14 minutes of samples. Compared to learning without these two components, it reduces the falls during training by 81%, while without them the robot learns only in over an hour.

PoseRieFlow: Riemannian Flow Matching for Whole-Body Text-to-Pose Generation

3.0/5 一般 裁判分 4.0 Candidate 当日相对
Jan Spindler, Bardia Ardakanian, Patrick Stotko, Reinhard Klein
总结: 在旋转流形上生成带文本条件的全身人体姿态。
方法: 沿黎曼测地学习流场,并用部位词元单独建模双手后解码。
证据: 摘要称二千一百六十万参数可生成含精细手部的全身姿态。
为什么适合我: 仅生成人体姿态,不直接解决机器人控制或跟踪。
推荐理由: 接近扩散/流模型的人体全身姿态生成,但停留在SMPL人体网格,未做机器人重定向或控制。
原摘要

We present PoseRieFlow, a compact flow-matching framework for text-conditioned generation of whole-body 3D human poses. Prior text-to-pose methods either neglect articulated hands or model rotations in Euclidean space despite their non-Euclidean geometry. PoseRieFlow instead formulates generation directly on the product manifold of SMPL-H joint rotations, learning a text-conditioned vector field that transports samples from an isotropic $\mathrm{SO}(3)$ Gaussian prior to the data distribution along Riemannian geodesics. A part-tokenized Diffusion Transformer aggregates the 52 joints into eight body-part tokens, allocating a dedicated token and nonlinear projector to each hand, and restores per-joint resolution through part-specific decoders, shortening the sequence while improving kinematic fidelity over per-joint tokenization. With only 21.6M trainable parameters, PoseRieFlow supports expressive SMPL-H generation with detailed hand articulation at a fraction of the scale of recent LLM-based generators. On PoseScript, it attains the lowest whole-body kinematic error among all hand-producing methods, with consistent kinematic gains from the Riemannian formulation over its Euclidean counterpart at every practical inference budget, while distributional and retrieval metrics remain comparable between them.

Xun Tu, Minghao Zou, Karthik Desingh
总结: 按下游任务选择初始抓取,服务大物体移动重排。
方法: 跨多种初始抓取训练统一近端策略,并用评论家蒸馏选择抓取。
证据: 摘要强调几何稳定的不同抓取仍会造成下游操作表现明显差异。
为什么适合我: 相关于长时程移动操作,但对象不是人形全身控制。
推荐理由: 虽涉及移动操作抓取选择,但面向一般移动机械臂的大物体重排,而非人形或足式全身控制。
原摘要

Loco-manipulation, which requires mobile manipulators to coordinate locomotion and manipulation over long horizons, is a key capability for large-object rearrangement in applications such as service robotics and warehouse automation. Despite recent progress, reliably executing these tasks remains challenging because performance depends on complex robot-object and object-environment interaction dynamics. Existing approaches address this challenge either through model-based methods, which often require accurate dynamics models, or through learning-based methods, which reduce this requirement but typically assume a fixed or predefined initial grasp. However, different geometrically stable grasps can lead to substantially different downstream manipulation performance. Therefore, we propose Grasp-TAGS, a task-aware grasp selection framework for goal-conditioned large-object rearrangement. We train a unified PPO-based reinforcement learning policy across multiple initial grasp configurations and distill the learned critic into a lightweight grasp utility network that ranks candidate grasps using only the candidate grasp configuration and goal information. At inference time, we select the grasp with the highest predicted downstream utility for the downstream policy to complete the task, before even making a contact. Experiments demonstrate that Grasp-TAGS improves rearrangement success over both fixed single-grasp policies and random grasp selection, achieving an average success rate of 89.84% compared with 79.87% for the best-performing single-grasp policies, an improvement of 9.97 percentage points. Grasp-TAGS also reduces final orientation errors across all evaluated objects. For more qualitative results, refer to the supplementary webpage: https://rpm-lab-umn.github.io/Grasp-TAGS-web-page/

Onur Beker, Andreas Ren\'e Geist, Georg Martius
总结: 面向精细网格接触交互,构建高吞吐轻量刚体仿真框架。
方法: 重新设计宽相、窄相碰撞检测及后续接触动力学计算。
证据: 摘要指出网格间碰撞会显著降低吞吐,因而针对该瓶颈设计。
为什么适合我: 可为接触丰富场景的强化学习与轨迹优化提供仿真基础。
推荐理由: 通用接触丰富网格仿真器,只提供物理仿真基础设施,未针对人形控制、运动跟踪或移动操作。
原摘要

In recent years, massively parallelized rigid-body simulation has played a central role in robotics research, enabling rapid progress in areas such as reinforcement learning, stochastic optimal control, and randomized smoothing-based trajectory optimization. Particularly in contact-rich settings, the scalability of such simulations in large part depends on well-optimized representations of collision geometry, often requiring a coarse approximation of the underlying surfaces using primitives such as spheres, capsules, cylinders, and boxes. Whenever the complexity of the surfaces or the precision demands of the application render such approximations insufficient, it is instead necessary to employ mesh-mesh collisions, which impose a significant reduction in throughput. This paper proposes a simulation framework designed from scratch to address this bottleneck, with novel routines for broadphase and narrowphase collision detection as well as the subsequent contact dynamics computation. As experimentally validated, the framework matches existing well-established simulators in terms of physical faithfulness, and can achieve approximately an order of magnitude higher throughput in the detailed mesh-mesh collision setting that it specializes in. The source code is available at https://github.com/martius-lab/lodos.

Probably Safe Sim-to-Real Transfer with Lifetime Validity

2.0/5 偏低 裁判分 4.0 Candidate 当日相对
Rohan Tangri, Jan-Peter Calliess
总结: 为强化学习策略的仿真到现实迁移提供终身安全保证。
方法: 用安全基线轨迹做重要性采样,并以投注置信序列随时认证。
证据: 摘要称仿真质量不影响保证,三个基准支持该理论结果。
为什么适合我: 服务于仿真到现实的安全部署,但不直接产生运动技能。
推荐理由: 通用约束MDP的仿真到现实安全认证,没有人形、足式或全身控制内容。
原摘要

We present Dejavu, a method that makes sim-to-real transfer of reinforcement learning policies in constrained Markov decision processes probably safe over an unbounded sequence of policy updates. An anytime valid test using per-decision importance sampling and a betting confidence sequence certifies each candidate trained in simulation before deployment using only trajectories collected by a safe baseline policy operating in production. Simulation quality does not affect the safety guarantee, only the production sample efficiency of the method. Finally, a summable per-test failure probability yields the lifetime valid property. Empirical results across three sim-to-real benchmarks support the theoretical work.

RevoSim: Scalable Multimodal Tactile Simulation for Dexterous Manipulation

2.0/5 偏低 裁判分 3.0 Candidate 当日相对
Ke Zhang, Lixin Xu, Ziyi Wang, ... , Chuanyu Li, Renjing Xu
总结: 为灵巧手提供可扩展的多模态高保真触觉仿真。
方法: 同步建模压力、深度、彩色和标记位移,并完全在仿真训练策略。
证据: 摘要称单卡的深度条件配置最多支持四千零九十六个并行环境。
为什么适合我: 聚焦手内操作触觉,与人形全身运动关联有限。
推荐理由: 灵巧手多模态触觉仿真与手内操作,不属于人形全身控制或足式运动。
原摘要

We present RevoSim, a scalable and high-fidelity multimodal tactile simulator for the BrainCo Revo3 hand that jointly models 285 piezoresistive taxels and five visuotactile fingertips. RevoSim efficiently generates synchronized pressure, depth, RGB, and marker-displacement observations; on a single RTX 5090, its depth-conditioned marker-displacement configuration supports up to 4,096 parallel environments. We train in-hand manipulation and grasping policies entirely in simulation, establishing a foundation for future sim-to-real transfer. Project page: https://braincotech.github.io/RevoSim-web/.

Armin Nurkanović
总结: 缩短非线性混合整数预测控制从测量到施加控制的延迟。
方法: 测量前预解松弛,测量后重建离散控制并做一步二次修正。
证据: 摘要提出时域尾部整数松弛,并推导相对原问题的误差界。
为什么适合我: 可辅助含离散决策的模型预测控制,间接关乎全身控制。
推荐理由: 通用非线性混合整数MPC算法,不是面向人形的全身模型预测控制。
原摘要

Model predictive control (MPC) of nonlinear systems with discrete decisions leads to mixed-integer nonlinear programs (MINLPs) whose combinatorial complexity often prevents real-time deployment. In this paper, we propose a decomposition-based MPC method that reorders and reduces computations to shorten the delay between receiving a state measurement and applying the control input. Before the measurement arrives, we solve a continuous relaxation of the MINLP at a predicted state and construct a mixed-integer quadratic program (MIQP). Once the measured state is available, we solve the MIQP that reconstructs the discrete controls and simultaneously performs one sequential quadratic programming step toward the corresponding nonlinear solution. To reduce the combinatorial complexity in the horizon length, we either fix the integer controls or relax their integrality over the prediction horizon tail, while retaining an integer-feasible first control input. We derive error bounds relating the nonlinear objective values obtained with the horizon-tail approximations to the optimal value of the original mixed-integer problem. In a data center cooling example, the proposed method reduces mean feedback computation time by 94% relative to a state-of-the-art MINLP method with a total closed-loop cost difference of less than 1%.