An Efficient Metric for Data Quality Measurement in Imitation Learning

arXiv cs.RO / 5/5/2026

📰 NewsDeveloper Stack & InfrastructureSignals & Early TrendsModels & Research

Key Points

  • The paper targets a key bottleneck in imitation learning for real-world robot deployment: end-user demonstrations often contain low-quality, out-of-distribution behaviors such as oscillations and abrupt corrective motions.
  • It introduces a fast, fully automated demonstration ranking metric using the power spectral density (PSD) of demonstration trajectories, where lower PSD indicates smoother, higher-quality demonstrations.
  • Unlike prior automated curation methods that require expensive policy rollouts in the environment, the PSD approach needs no policy learning, environment interaction, or expert labeling.
  • Experiments on two benchmark datasets and a user study with older adults show that PSD-curated demonstrations improve task success rates and produce smoother policy execution than uncurated data and two competitive ranking baselines.
  • The method is demonstrated in an in-the-field fine-tuning setup for a daily living task, using PSD-ranked data to fine-tune a pre-trained policy (π0.5).

Abstract

Imitation learning (IL) has seen remarkable progress, yet field deployment of IL-powered robots remains hindered by the challenge of out-of-distribution (OOD) scenarios. Fine-tuning pre-trained policies with end-user demonstrations collected in deployment environments is a promising strategy to address this challenge. However, end-user demonstrations are frequently of poor quality, characterized by excessive corrective motions, oscillations, and abrupt adjustments that degrade both learned and fine-tuned policy performance. Existing automated approaches for curating demonstration data require policy rollouts in the environment, making them computationally expensive and impractical for real-world deployment. In this paper, we propose a fast, efficient, and fully automated demonstration ranking metric based on the power spectral density (PSD) of demonstration trajectories. The PSD metric requires no policy learning, environment interaction, or expert labeling, making it well-suited for scalable, in-the-field data curation. Lower PSD values correspond to smoother, higher-quality demonstrations, while higher PSD values indicate erratic, artifact-laden trajectories. We evaluate the proposed metric on two benchmark imitation learning datasets comprising expert and lay-user demonstrations, and through a user study with older adults at a retirement facility, where collected demonstrations are used to fine-tune \pi0.5 \cite{intelligence2025pi_} for a daily living task. Results demonstrate that PSD-curated data yields policies with higher task success rates and smoother execution trajectories compared to uncurated baselines and two competitive data-ranking methods.