Papers for 2026-10-15

10 papers
Yunsong Zhou, Xuekun Jiang, Haiqi Shen, ... , Chunhua Shen, Weinan Zhang
总结: 提出百小时视觉运动触觉人类loco-manipulation观测数据集。
方法: 用校准补全约束管道从稀疏传感重建全身运动触觉。
证据: 连续对齐自我中心视频全身运动手指与触觉观测。
为什么适合我: 提供接触丰富loco-manipulation数据支持模仿与真机控制。
推荐理由: 直接对应人形 loco-manipulation 的人体示范采集:自我视角、全身运动、手指与触觉对齐,服务动作重定向与模仿。
原摘要

Learning humanoid loco-manipulation from human demonstrations rests on observing how locomotion, posture, and object interaction evolve together as tasks unfold. Scaling collection across diverse environments, in turn, favors lightweight, portable capture systems. Yet, existing datasets provide only partial views of this coordination. Thus, we introduce EgoExplorer, a 100-hour vision-motion-touch observatory of human loco-manipulation built with a wearable system. With an emphasis on professional activities, its continuous recordings align egocentric video with reconstructed whole-body motion, fine-grained finger articulation, and tactile observations, accompanied by step-level descriptions. To achieve this coverage with sparse body sensing, we develop the Calibrate-Complete-Constrain pipeline. Concretely, reusable calibration fixes participant geometry and sensor attachments before motion inference to disentangle mounting offsets from articulation. A temporal prior then completes unobserved joint motion, while layered constraints promote measurement agreement, temporal continuity, and geometric consistency, properties that motion plausibility alone does not guarantee. Against tracker-fitted references, the method reduces body-point error by 71.9% relative to the strongest baseline; matched evaluations also show gains in hand stability and contact estimation. Preliminary studies explore multimodal generation and conditioning alongside humanoid retargeting with whole-body control in simulation.

Thanh Ly, Chien Le, Truong-Duy Dang, ... , Vien Anh Ngo, An T. Le
总结: 无需运动先验的专家路由人形复杂地形穿越系统。
方法: 地形分类器路由五专家混合并用梯度精炼落脚规划。
证据: 部署保真仿真中八十五米五段路径成功率达百分之九十。
为什么适合我: 直接实现复杂地形感知运动契合跑酷全身控制。
推荐理由: 核心是无动作先验的人形复杂地形穿越,用高程图、地形专家路由和落足规划,紧贴腿足感知运动。
原摘要

State-of-the-art perceptive humanoid locomotion is mostly built on retargeted motion capture, a generative motion prior, and a distillation stage. We report a complete system that does not require this pipeline for a humanoid to cross varied terrain. In its place, we provide a five-expert mixture routed by a terrain classifier over a sensed elevation grid, and target every foothold with a model-based planner, refined by six closed-form-gradient steps on an interpolated terrain-cost field instead of picked from a fixed grid. Driven through the same perception-to-actuation software a robot would run, inside a second, deployment-fidelity simulator, it crosses an $85$\,m five-segment waypoint course $18$ of $20$ times end-to-end ($90\%$, Wilson $95\%$ CI $70$--$97$) and succeeds $20/20$ on four of five segments scored alone, where an ablated configuration without the mixture and without refinement reaches $0\%$ on both the stair and the hurdle segment. The continuous refinement moves $72.4\%$ of foot placements across at least one grid-cell boundary, which produces real sub-grid correction. We also ran matched component studies to report what does not account for it: one expert equals five on the training distribution, four label-free routers collapse to near-uniform activation, and a self-supervised terrain embedding loses to the privileged label.

Xue Wang, Yitang Li, Yiming Zhang, ... , Hao Zhao, Qingdu Li
总结: 感知行为基础模型分解地形不变意图与条件实现。
方法: 前向后向表示映射共享意图空间再由感知策略实现。
证据: 解决地形变化下行为覆盖组合爆炸与全局进度丢失。
为什么适合我: 无监督RL提供可重用全身行为支持复杂地形控制。
推荐理由: 把人形行为基座模型拆成地形无关意图与高程条件下的实现,属于感知式全身控制与无监督强化学习。
原摘要

Behavioral foundation models (BFMs) provide humanoids with reusable repertoires of whole-body behaviors; in real-world humanoid control, the same behavioral intent may require fundamentally different motions under different terrain constraints. Covering such variation with terrain-matched demonstrations requires enumerating a combinatorial space of behaviors and terrain geometries. We introduce P-BFM, a perceptive behavioral foundation model that factorizes humanoid control into terrain-invariant intent and terrain-conditioned realization. A forward-backward representation maps motion references, target states, and reward functions into a shared intent space without terrain information, while a perceptive policy learns how to realize each intent under the surrounding terrain geometry. We further identify a complementary limitation of purely latent control: behavioral latents can preserve local motion patterns while losing precise global progress. We therefore introduce Explicit Root Instructions (ERI), which separates global transport (e.g., heading and planar velocity) from behavioral intent, while leaving local whole-body adaptation to the perceptive policy. This decomposition leads to a characteristic capability absent from conventional BFMs: one fixed intent induces different, terrain-appropriate behaviors, including changes in step height, stride, posture, foothold placement, and contacts, without terrain-specific demonstrations. Across challenging terrains, P-BFM improves motion fidelity, root-control precision, and perturbation recovery over strong baselines. A single frozen policy further supports motion tracking, goal reaching, reward inference, teleoperation, and terrain-aware recovery, and transfers zero-shot to a Unitree G1 using onboard depth sensing.

Yongpeng Cao, Masahiro Hirano, Yuji Yamakawa
总结: 推理时搜索框架选择适合人形的人体反应动作。
方法: 从生成反应模型随机采样并联合质量与可行性评估。
证据: 生成多个候选反应并选最适合特定机器人实施例的。
为什么适合我: 提升人体动作重定向到真机的可行性与跟踪精度。
推荐理由: 针对人形重定向中的人体反应选择,在推理时同时考虑反应质量与本体可行性,直接命中动作重定向。
原摘要

Training humanoid robots to learn human behaviors requires expensive data collection, and human-robot interaction data can be even more difficult and costly to collect. Training a specialized reaction model for each humanoid embodiment can also be time-consuming and resource-intensive. Human-to-humanoid motion retargeting provides a more scalable alternative, allowing human-human reaction data to serve as a common motion representation for different humanoid embodiments. However, due to morphological and kinematic differences between humans and humanoid robots, a reaction preferred in human motion space may not be the most suitable one for execution on a particular robot embodiment. In this work, we propose an inference-time reaction search framework that leverages stochastic sampling from a generative reaction model and jointly considers reaction quality and humanoid embodiment feasibility. Given the observed interaction, our framework generates multiple plausible reaction candidates. Each candidate is retargeted to the target humanoid and evaluated using complementary interaction and embodiment-specific feasibility criteria, allowing candidate selection under the physical constraints of the target embodiment. Since the reaction generator remains frozen, the framework can adapt to different humanoid embodiments at inference time without retraining. Experimental results demonstrate that the proposed framework maintains overall human reaction quality while improving the feasibility of retargeted humanoid reactions across different embodiments. The proposed pipeline improves humanoid retargeting feasibility by 1.61%. Moreover, human-space and G1 best-candidate selections disagree in 78.98% of samples, demonstrating substantial embodiment dependence. Code will be released.

Huaxing Huang, Ruidong Li, Jinchao Han, Ziyang Dong, Wenhao Cui
总结: 学习全尺寸人形超七米每秒冲刺与激进转弯。
方法: 因果多头注意力建模高频反馈并设计替代偏航奖励。
证据: 实现超七米每秒冲刺与高达二十五度躯干倾斜转弯。
为什么适合我: 推进高速跑酷全身运动智能结合运动先验与强化学习。
推荐理由: 全尺寸人形高速冲刺与激进转弯,用运动先验引导步态并处理高速本体反馈,属于全身运动跟踪与运动先验。
原摘要

We present a learning-based framework that enables a full-scale bipedal humanoid to sprint at over 7 m/s with motion-prior-guided gait and perform aggressive cornering at high speed with a pronounced trunk lean of up to $25^\circ$. Achieving this combination is challenging: above approximately 4 m/s, periodic foot impacts induce severe, high-frequency yaw-rate oscillations intrinsic to high-speed gaits. This high-frequency temporal structure corrupts the history of proprioceptive feedback that flat-MLP policies rely on, while rendering conventional yaw-rate tracking rewards counterproductive, as they fight against the robot's natural oscillatory dynamics. Moreover, a single style prior shared across skills cannot tell which skill is commanded and inherently compromises the low-speed skill fidelity. To overcome these limitations, we adopt a causal multi-head attention (MHA) module to explicitly model the high-frequency temporal feedback. In place of the oscillatory yaw rate, we design a heading-direction reward that supervises only the low-frequency velocity direction, allowing agile turning at high speed without suppressing natural gait oscillations. We further introduce skill-conditioned multi-adversarial-motion-prior (MAMP) discriminators that condition the style reward on the commanded skill. Ablation experiments confirm that each mechanism is essential: replacing structured temporal encoding with a flat-history MLP caps the top speed; reverting to yaw-rate tracking prevents high-speed turning; and a single shared discriminator makes in-place turning collapse into a quasi-static stance. Our framework bridges the gap between raw sprinting speed and reference-motion fidelity, demonstrating stable high-speed sprinting and aggressive cornering in both simulation and real-robot deployment.

From Video to Vision: Learning Generalizable Humanoid Carrying from Human Motion

5.0/5 很相关 裁判分 9.0 Top pick 当日相对
Ziluo Ding
总结: 从视频学习可空间泛化的人形物体搬运策略。
方法: 多阶段教师助手学生强化学习框架结合视频重定向增强。
证据: 解决参考轨迹限制导致空间泛化差与仅工作室评估问题。
为什么适合我: 支持loco-manipulation与人体动作到真机全身控制。
推荐理由: 从人体视频重定向学习可泛化的人形搬运,结合 DeepMimic 式跟踪与师生强化学习,是 loco-manipulation。
原摘要

Most existing approaches rely on video or motion-capture data for reinforcement learning (RL) training; however, all of these methods require an upper-level module to generate reference trajectories in real time. In object carrying tasks, the humanoid can only lift objects from designated locations along the reference trajectory, resulting in poor spatial generalization. Moreover, existing policies can only be evaluated inside a motion-capture studio. To address these limitations, we propose \textbf{MOVER}, a multi-stage, Teacher-Assistant-Student, RL training framework for humanoid object carrying. We first collect data from videos and employ GENMO and GMR to retarget the video data, combining this with data augmentation techniques to generalize the data across objects of varying shapes and sizes. In the \textbf{first stage}, building upon the DeepMimic \cite{peng2018deepmimic} motion-training framework, we train the humanoid to transport objects from specified locations along designated trajectories. In the \textbf{second stage}, we relax the tracking of the reference motion and adjust the reward so that the humanoid learns to transport objects from different positions. In the \textbf{third stage}, we apply a Dagger-PPO distillation method to distill away the proprioceptive position observations and reference joint position of the humanoid. This allows the deployed policy to operate without relying on global position information from a motion-capture system; instead, the humanoid can directly perceive the object's pose from its onboard RGB-D camera to complete the carrying task. We design a series of simulation experiments to compare the success rates across stages (Stages 1 vs. 2) and before versus after distillation. We further transfer the policy to a real humanoid, successfully transporting objects at varying positions in a motion-capture-free setting.

Human-Like Redundancy Resolution for Real-Time Bimanual Humanoid Teleoperation

5.0/5 很相关 裁判分 8.0 Strong 当日相对
Chao Tan, Ming Shin Cindy Sung, Shuxian Liang, ... , Zhen Huang, Xian-Sheng Hua
总结: 类人冗余解析实现实时双臂人形遥操作控制。
方法: 自适应肘部引导结合奇异鲁棒手腕跟踪层次求解。
证据: 优先手腕跟踪并将自适应肘部引导投影到零空间。
为什么适合我: 支持loco-manipulation中双臂全身控制与可跟踪性。
推荐理由: 实时双臂人形遥操作的类人冗余分解与奇异鲁棒跟踪,直接对应人形遥操作与全身运动跟踪。
原摘要

Real-time bimanual humanoid teleoperation requires accurate wrist tracking while keeping arm configurations predictable. Because a 7-DoF arm admits multiple elbow configurations for the same wrist pose, wrist-only tracking can cause elbow drift or abrupt configuration changes. Fixed anthropomorphic constraints can stabilize elbow posture, but they can also block the redundant adjustments needed near singular configurations. We propose a human-like redundancy-resolution framework that combines adaptive elbow guidance with singularity-robust wrist tracking. Shoulder-wrist geometric retargeting generates robot-scale wrist targets. An adaptive elbow-offset criterion uses the offset direction to guide posture and scales this guidance by the offset magnitude, so the redundant degree of freedom is progressively released as the human arm straightens. A hierarchical velocity solver prioritizes wrist tracking and projects the adaptive elbow guidance into the wrist-task null space. In a fixed-wrist-target ablation, adaptive guidance reduces mean elbow-direction error by 54.4% compared with removing this guidance. In a workspace-boundary stress test, singularity-robust tracking reduces peak raw joint-velocity demand by 97.9% compared with the undamped pseudoinverse. Real-world bimanual tasks and cross-platform retargeting show applicability across robot morphologies.

Joshua Aurand, Agon Serifi, Sammy Christen, ... , Marco Hutter, Moritz B\"acher
总结: 示例驱动扩散实现独立速度与风格的腿足运动。
方法: 风格编码器条件自回归扩散再由强化学习跟踪参考。
证据: 仿真与真机展示实时控制及连续风格化运动能力。
为什么适合我: 结合扩散与强化学习实现可重定向风格化全身运动。
推荐理由: 用示例驱动扩散模型解耦速度与风格,再由强化学习跟踪,对应物理角色控制、运动先验与扩散策略。
原摘要

We present a real-time framework for expressive legged locomotion that enables independent control over velocity and style. Unlike existing data-driven controllers, which typically require explicit style labels for training, our method efficiently leverages large-scale unstructured motion data and generalizes to unseen styles. We disentangle style from functional locomotion through a tailored sampling strategy used to train a style encoder whose output conditions an autoregressive diffusion model. During inference, the user provides a style reference clip and a joystick velocity command. The diffusion model then generates a kinematic reference tracked by a reinforcement learning controller. To improve user controllability and stylization strength, we propose an attention biasing mechanism and a velocity command correction strategy. We demonstrate our method on a physics-based humanoid character in simulation and on a physical robot, showcasing robust real-time control and continuous style modulation. The results can be best seen in our supplemental video (https://www.youtube.com/watch?v=roFnS6N7nJ4).

Aashish Sahu, R. Prasanth Kumar
总结: 几何感知预测控制实现双足走跑障碍穿越。
方法: 相位结构化轨迹生成器结合约束模型预测控制跟踪。
证据: 五阶段结构适应障碍高度深度并平滑走跑转换。
为什么适合我: 全身模型预测控制用于复杂地形接触丰富场景。
推荐理由: 双足走跑过渡下的几何感知越障预测控制,接近腿足复杂地形通过与全身模型预测控制。
原摘要

This paper presents a geometry-aware predictive control framework for bipedal obstacle crossing across walking and running regimes. The proposed approach integrates a phase-structured trajectory generator with a constrained model predictive control (MPC) tracking layer to generate coordinated pelvis and swing-foot motions during obstacle traversal. The crossing process is represented through five interpretable phases: pre-crossing, leading-leg clearance, straddle, trailing-leg clearance, and recovery. Within this structure, swing-foot elevation is adapted as a function of obstacle height, while lateral stance widening and pelvis repositioning are introduced as functions of obstacle depth to improve transverse clearance and body alignment. A continuous gait-parameter evolution enables smooth walk-to-run transition without discrete controller switching. The generated references are tracked using MPC to regulate motion smoothness, clearance feasibility, touchdown behavior, and lateral admissibility. The framework is evaluated in reduced-order simulation over five progressively difficult obstacles under walking and running conditions. The robot successfully crosses the first four obstacles, achieving minimum body-obstacle clearances of 0.036, 0.036, 0.059, and 0.017 m, respectively. The fifth and most demanding obstacle leads to collision, identifying the current operating boundary of the proposed reduced-order formulation. Overall, the method provides a compact, interpretable, and computationally efficient basis for intelligent obstacle-aware bipedal locomotion.

Mohamad H. Danesh, Raina Hu, Mengxue Xu, Hsiu-Chin Lin
总结: 从单侧视视频无深度模型转移四足技能到真机。
方法: 固定二维关键点检测与解析重定向加相位奖励学习。
证据: 零样本部署多种步态与手势到硬件并测省略轴代价。
为什么适合我: 简化视频到腿足机器人动作重定向与真机部署。
推荐理由: 从单目侧视视频解析重定向并零样本上真机,覆盖四足行走与非周期技能,属于腿足模仿与 sim-to-real。
原摘要

Video-to-robot pipelines for quadrupedal imitation insert a learned lifting stage, either a monocular depth model or a per-clip 3D reconstruction, to recover the one axis a side-view camera cannot see. We present CopyQuad, which omits that stage and pins the missing axis to the robot's own stance width instead. The setting is side-view footage of sagittally dominated motion, where limb motion is almost entirely in the image plane. A frozen 2D keypoint detector and a fixed analytic retargeting then turn a single uncalibrated clip into a robot reference whose foot targets are reachable by construction, so no per-clip trajectory optimization is needed. One phase-indexed reward structure, whose only per-behavior freedom is three scalars from a shared sweep, learns a dog walk, a horse walk, a horse trot and two non-periodic gestures, all deployed zero-shot on hardware. We then measure what omitting the axis costs. In a training-free rigidity test, a video depth model varies the distance between the animal's hips by $40$ to $107\%$ of its own mean and a single-image metric model by $22$ to $58\%$, though that distance cannot move. Motion capture puts the true lateral paw travel of a dog walk at $4.5$ cm peak to peak, a mean deviation near $1.4$ cm against the $3.5$ cm of lateral foot error our policies already leave, so the discarded axis sits below the pipeline's resolution. Depth repaired to feasibility never beats the constant, and the unrepaired estimates put the robot on the ground.