Papers for 2026-10-11

10 papers
Ajay Vikram Periasami, Xinyuan Luo, Haoyu Li, Xianyi Cheng
总结: 为人形loco-manipulation提供失败感知监督与恢复框架。
方法: 规划选技能,VLM监控多视角与接触证据,恢复代理反馈。
证据: 在Unitree G1上独立评估监控与恢复模块。
为什么适合我: 直接支撑接触丰富loco-manipulation的感知与失败处理。
推荐理由: 直接面向Unitree G1的人形全身loco-manipulation,在全身控制器之上做技能监督、失败检测与恢复,贴合全身loco-manipulation与场景交互。
原摘要

Large language model (LLM) planners can decompose natural-language instructions and select reusable robot skills, but choosing the correct skill does not guarantee successful physical execution. This gap is especially important in humanoid loco-manipulation, where errors during approach, grasping, transport, or placement can invalidate the remainder of a long-horizon plan. We present FRAMES, a failure-aware supervisory framework for the Unitree G1 humanoid that operates above the CEER whole-body controller. A Planner Agent selects subtasks through parameterized mid-level skills, while a vision-language-model-based Monitor Agent evaluates each skill using temporal multi-view observations and structured robot and contact evidence. Detected failures stop the active skill and provide grounded feedback to a Recovery Agent. The framework further includes a Memory Module for reusing prior skill experience, and geometric grounding via depth and segmentation. We independently evaluate the monitoring module of the framework in MuJoCo using 100 trials comprising 50 failed and 50 successful executions across five tasks. The monitor detects 48 of 50 failures, correctly accepts 46 of 50 successful executions, and achieves 94.0% overall accuracy. These results provide initial evidence for the monitoring component, while end-to-end evaluation of the complete recovery loop remains ongoing.

PredActor: Predictive Action Diffusion for Steerable Onboard Humanoid Control

5.0/5 很相关 裁判分 10.0 Top pick 当日相对
Lei Ye, Haibo Gao, Yitang Li, ... , Hao Zhao, Liang Ding
总结: 预测动作扩散策略实现可引导人形闭环控制。
方法: 统一状态动作扩散,仅用本体感觉直接执行可引导策略。
证据: 统一两种引导模式,支持测试时运动目标。
为什么适合我: 契合扩散模型与人形全身可重定向控制。
推荐理由: 用预测式动作扩散做可引导的机载人形闭环控制,打通扩散模型与人形全身控制,属于核心方法与全身运动跟踪方向。
原摘要

Diffusion models provide a flexible framework for motion generation, but turning this flexibility into closed-loop humanoid control remains challenging. Hierarchical generator-tracker systems steer motion through reference trajectories, yet these references may exceed the capabilities of the downstream tracker, leaving physical feasibility and disturbance recovery largely to a separate control module. Action-only diffusion avoids this separation by directly generating executable actions, but provides no explicit future-state trajectory that can be steered toward test-time motion objectives. Joint state-action diffusion offers a natural alternative, but existing controllers often rely on privileged full-body states, while learned behavior selection and test-time motion steering remain only partially integrated. We present PredActor, a predictive action diffusion policy that unifies both steering modes in one directly executed policy using proprioception alone. Given proprioceptive history and optional task context, PredActor jointly predicts actions and an internal future-state trajectory that enables guidance: classifier-free guidance strengthens text-conditioned motion, while classifier guidance steers future states toward test-time objectives. Only actions are executed, requiring neither a motion-reference tracker nor privileged full-body states. In simulation, PredActor reaches 44 of 45 destination targets and achieves a text retrieval score of 0.539 versus 0.424 for conditional action diffusion, with similar disturbance survival. Rolling denoising and computation-preserving runtime optimizations reduce the complete callback to 16.790 ms median and 19.383 ms p95 on a Jetson Orin NX, within the 20 ms control period. Deployed on a Unitree G1, PredActor demonstrates text-conditioned motion, disturbance response, joystick control, and semantic interpolation in simulation and hardware.

Zeyu Han, Zichong Meng, Julian Tanke, ... , Yuki Mitsufuji, Huaizu Jiang
总结: 语言驱动流匹配控制器实现接触丰富全身交互。
方法: 规划器预测短时轨迹,动作生成器闭环解析接触后调优。
证据: 在OMOMO基准上评估接触丰富交互。
为什么适合我: 针对接触丰富全身物体交互与模仿学习。
推荐理由: 语言驱动的物理角色接触丰富全身物体交互,含跟踪策略与闭环动作生成,直接对应物理角色控制与接触丰富全身交互。
原摘要

We present LYRIC, a generative flow-matching controller for language-driven physics-based contact-rich interaction control, that enables simulated characters to perform contact-rich whole-body object interactions from a free-form language instruction and a sparse terminal object goal. To obtain reliable expert trajectories from imperfect motion-capture references, a single tracking policy is trained using geometry-conditioned interaction rewards and relaxed reference tracking near hand-object contact. To guide interaction progress without prescribing a full-body kinematic reference, we factorize the controller into a task-level planner that predicts short-horizon object and humanoid-root trajectories, and an action generator that resolves whole-body motion and contacts in closed loop. After behavior cloning, we freeze the planner and post-tune the action generator on policy using the planner's predictions as stable supervision for intermediate task progression. In a controlled OMOMO evaluation, our tracker achieves 64.3% success compared with 53.2% for an InterMimic reimplementation, while a unified policy achieves 76.5% on the full OMOMO dataset. On the held-out split, LYRIC achieves 90.3% task success, compared with 74.2% for the strongest matched kinematic-planner baseline, with better semantic alignment and motion quality. Without retraining, the controller also supports test-time object-waypoint guidance. Qualitative results further demonstrate robust, natural contact-rich interactions and zero-shot transfer to novel object shapes. The webpage is available at https://neu-vi.github.io/LYRIC/

HumanoidTTT: Test-Time Capability Reuse for Efficient Humanoid Control

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
Jingtai Yang, Yining Wu, Yanjun Li, Zeyu Zhang, Hao Tang
总结: 测试时能力重用框架提升持续人形控制效率。
方法: 选择性全运动重用与能力巩固管理有界存储。
证据: 仅从认证入口状态重用已验证完整运动。
为什么适合我: 支持人形运动能力复用与真机高效部署。
推荐理由: 针对持续部署中的人形全身运动生成与跟踪能力复用,核心就是人形全身控制与运动跟踪。
原摘要

Recent advances in motion generation and whole-body tracking have enabled humanoid robots to execute increasingly diverse motions, yet the same motion capabilities may be requested repeatedly during continual deployment. Reliable reuse is challenging because intervening motions can change the robot's entry state, making previously successful motions unsafe to replay blindly. Meanwhile, validated capabilities accumulate during deployment, while bounded storage requires deciding which ones are worth retaining. To address these challenges, we present HumanoidTTT, a framework for test-time capability reuse in continual humanoid control. Specifically, we introduce Selective Full-Motion Reuse, which authorizes direct reuse of validated complete motions only from certified applicable entry states, allowing accepted reuse to bypass fresh generation. We further introduce Test-Time Capability Consolidation, which adapts which qualified capabilities persist in a bounded Full-Motion Store using subsequent deployment reuse as feedback. Experiments demonstrate zero unsafe accepts and a 16.4$\times$ end-to-end speedup over fresh generation, while online consolidation improves avoided generator calls by 13.2 per 200 requests over its frozen counterpart. Overall, HumanoidTTT enables reliable and efficient reuse of validated motion capabilities while adaptively retaining useful capabilities throughout continual deployment. Code: https://github.com/AIGeeksGroup/HumanoidTTT. Website: https://aigeeksgroup.github.io/HumanoidTTT.

REDACT: Robust Perceptive Locomotion under Unseen Visual Corruption

5.0/5 很相关 裁判分 8.0 Strong 当日相对
Natapat Kirdwichai, Tobias Driskell-Poole, Andrei Sontea, ... , Muhammad Burhan Hafez, Danesh Tarapore
总结: 教师学生框架实现未见视觉腐蚀下鲁棒运动。
方法: 改进编码器、持久掩码与共识门控保留深度信息。
证据: 仅干净深度训练,保留未建模腐蚀下有用视觉。
为什么适合我: 增强复杂地形感知运动鲁棒性适合腿足。
推荐理由: 研究深度观测损坏下的感知运动与敏捷行走,直接对应腿足感知运动以及深度/高程图感知的sim-to-real鲁棒性。
原摘要

Depth-conditioned locomotion policies have demonstrated impressive agile maneuvers, but can be steered to unpredictable actions when observations are outside their training distribution. Occlusion, invalid returns, sensor noise, and visual distractors can shift deployment observations away from nominal simulated depth. While synthetic sensor augmentation targets specified degradations, it does not by itself define behavior under corruption families omitted from training. To address gaps in training-time coverage, we present REDACT (Retaining Evidence Despite Artifacts for Continued Traversal), a teacher-student framework combining an improved visual encoder architecture, persistent feature masking, and a novel consensus-gating algorithm to retain useful depth information under unmodeled corruption. The gate uses approximate conformal calibration on clean observations alone, requiring no prior knowledge of the corruption type. Trained on clean simulated depth, REDACT retains useful visual information under unseen corruption, supporting higher traversal success than existing parkour baselines. Evaluation of depth augmentation across corruption families further shows that REDACT improves robustness where augmentation coverage is missing. Real-world trials demonstrate zero-shot transfer to structured and forested environments with unfamiliar scene content.

Benjamin Yang, Weiying Wang, Shenggao Li, ... , Yip Fun Yeung, Lingfeng Sun
总结: 仅用360相机实现模块化双臂loco-manipulation采集。
方法: 前后镜头分工建图记录,IMU融合,快拆板适配多种夹具。
证据: 六种双臂记录设置验证定位与操作。
为什么适合我: 助力人体动作采集转为可跟踪真机全身数据。
推荐理由: 用360相机做野外双手loco-manipulation动作采集,接近人形遥操作与数据采集;建图只是定位手段,不是视觉SLAM本身。
原摘要

A wrist-mounted camera for UMI-style data collection must do two jobs: record the manipulation and localize in the scene. Most handheld devices localize online from workspace-facing views crowded by hands and objects, or add dedicated tracking hardware. Room-scale bimanual capture therefore still tends to instrument the operator or the scene for accurate localization. We present KIWI (Kinematic Interface for the Wild), a capture kit whose only electronics are off-the-shelf cameras. Our core system splits the two jobs across the two lenses of a 360-degree camera. The rear lens faces the room and builds a shared metric map that registers both hands, and an optional head camera, in one frame without workspace co-visibility; the front lens records the manipulation, and offline IMU fusion bridges front-lens tracking loss. Through our quick-release plate, the camera module attaches to chopstick grippers, parallel-jaw grippers, hand-wrist mounts, or robot flanges. Across six bimanual recordings, combining the rear and front lenses failed to localize only 0.1% of query frames, whereas front-only bimanual feature alignment failed on 24.8% of frames and lost one recording entirely; against evaluation fiducials, localization error stayed within 4.5 mm. KIWI's recovered poses were sufficiently consistent for the four wrist streams alone to reconstruct the scene as a 3D Gaussian splat.

DAOCP: a dual active set solver for optimal control problems

4.0/5 相关 裁判分 4.0 Candidate 当日相对
Alberto Zaupa, Samuel Erickson, Mikael Johansson
总结: 双主动集求解器加速最优控制问题。
方法: 结合主动集与结构利用,递归计算无需浓缩QP。
证据: 机器人基准四场景最快,Atlas加速显著。
为什么适合我: 加速全身MPC支撑人形全身控制。
推荐理由: 面向全身机器人最优控制的结构利用主动集MPC求解器,直接对应全身模型预测控制这一方法主线。
原摘要

We present DAOCP, a dual active set solver for linear quadratic optimal control problems with stage-wise equality and inequality constraints. Active set methods are leading Model Predictive Control benchmarks for full-body robotics, but existing solvers operate on dense QPs, while typical problem dimensions favor methods that exploit the optimal control structure. DAOCP combines the warm-starting capabilities of active set algorithms with the better computational scaling of structure exploiting solvers, by relying on a generalization of the relationship between the Riccati recursion and the Cholesky factorization of the condensed Hessian. This result enables dual active set iterations to operate directly on the original optimal control problem through recursive computations, without explicitly forming the condensed quadratic program. On robotics benchmarks, DAOCP is the fastest of four solvers in four of five scenarios, cutting average solve time on a 58-state Atlas model by 9$\times$ relative to state of the art solvers DAQP and HPIPM.

Yiyi Cai, Yuhan Wu, Kunhang Li, ... , Kaipeng Zhang, Haiyang Liu
总结: 高效可控流式运动生成改进FloodDiffusion。
方法: 部分注意力、Bregman损失与精确路径条件。
证据: 提升效率并实现精确轨迹控制。
为什么适合我: 扩散生成可跟踪可重定向人体运动。
推荐理由: 改进流式人体动作扩散的效率与轨迹可控性,属于角色动作生成,未进入腿足/人形控制或真机跟踪。
原摘要

We present FloodDiffusion 2 (FD2), an efficient and controllable framework that builds upon FloodDiffusion (FD1), a state-of-the-art streaming motion generation model. While FD1 produces plausible motion, it suffers from low efficiency and limited controllability, as its attention design requires repeated computation over the entire history, and it lacks precise trajectory control for real-world applications. To address these limitations and improve generation quality, FD2 introduces three advances. First, Partial Attention makes finalized history representations independent of the active window, enabling KV-cached inference and shared-history packing for efficient training. Second, we establish a necessary-and-sufficient Bregman criterion for regression losses to preserve diffusion's conditional-mean velocity field. This criterion guides an FK-induced quadratic loss that incorporates motion geometry without online FK evaluation. Third, FD2 introduces precise path conditioning to control the character's root trajectory while preserving natural body motion. Experiments show that FD2 reduces training computation by 4.6$\times$ and accelerates denoising by 11.29$\times$, reaching 2.303 ms per update on long sequences. Alongside these efficiency gains, FD2 improves motion quality over FD1 and achieves state-of-the-art FID scores among streaming methods, with 0.048 on SEED and 0.053 on HumanML3D.

Xinyu Liu, Gökhan Solak, Arash Ajoudani
总结: 势场动作表示强化学习用于接触丰富操作。
方法: 策略调势场参数,经阻抗控制器生成状态依赖引导。
证据: 在插销入孔接触丰富任务上评估。
为什么适合我: 接触丰富操作RL可扩展至loco-manipulation。
推荐理由: 用势场动作表示学习接触丰富操作,接触与强化学习相关,但是机械臂级操作而非全身loco-manipulation或腿足运动。
原摘要

Model-free reinforcement learning can acquire contact-rich robotic manipulation skills through trial-and-error interaction, but it often requires the policy to learn both task strategy and low-level motion generation. In this setting, the action representation is critical because it determines how policy outputs are converted into robot motion, shaping both exploration and physical execution. Direct Cartesian command interfaces require the policy to generate motion at every decision step, coupling task-level adaptation with continuous low-level control and increasing the learning burden. We propose PA-RL, a reinforcement-learning framework that uses artificial potential fields as the action representation. Instead of commanding motion directly, the policy adapts the parameters of an energy-like potential field, which generates a state-dependent guidance direction executed through a Cartesian impedance controller. We evaluate PA-RL on peg-in-hole insertion, a representative contact-rich task with nonlinear dynamics and discontinuous contact transitions. In simulation, PA-RL is compared with Cartesian velocity, Cartesian pose, and variable-impedance action spaces using the same RL algorithm. PA-RL is the only method to reach a 100% evaluation success rate within the allotted training time, while the best baseline reaches 92.6%. It also reduces joint-torque variation by 55.4% and Cartesian acceleration variation by 70.8% relative to the best baseline, without explicit motion-quality penalties in the reward. The simulation-trained policy further completes 9/9 real-robot insertions without fine-tuning, demonstrating the deployment feasibility of the learned potential-field interface.

Peiyan Li, Yueran Tao, Enhao Zhang, ... , Yu Luo, Huaping Liu
总结: 利用命令状态差异改进机器人模仿学习。
方法: CSDW加权命令监督,融合进度与需求变化。
证据: 三真实任务上约束交互下优于均匀监督。
为什么适合我: 提升接触约束下模仿学习全身控制精度。
推荐理由: 利用指令-状态偏差改进真实机器人模仿学习,方法贴近模仿学习,但任务不是人形全身跟踪或loco-manipulation。
原摘要

Constructing action targets from measured robot motion is an established approach in imitation learning. Under interaction constraints, however, command-state discrepancy may reflect control demands that motion alone does not capture. We investigate when this information matters and how to exploit it. Across three real-robot tasks, task and phase analyses reveal larger supervision gaps under constrained interaction, while selective command retention provides evidence of locally useful command information. Building on these findings, we propose Command-State Discrepancy Weighting (CSDW), which accounts for robot response times and combines subsequent progress, persistent unmet demand, and demand changes into continuous weights for command supervision. The method requires no task-phase annotations or changes to policy architecture or inference. CSDW improves over uniform command supervision on constrained tasks, while methods perform similarly in the less constrained task. Project page: https://seen-e.github.io/CSDW/.