Learning What Can Be Picked: Active Reachability Estimation for Efficient Robotic Fruit Harvesting

arXiv cs.RO / 3/26/2026

📰 NewsSignals & Early TrendsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper proposes an approach to estimate robotic fruit reachability in unstructured orchard environments using RGB-D perception combined with active learning.
  • Instead of using exhaustive inverse kinematics or motion planning to decide reachability, it reformulates reachability as a binary prediction problem learned from data.
  • Active learning is used to label only the most informative samples, reducing annotation effort while preserving accuracy for robotic harvesting.
  • Experiments show label-efficient adaptation to new orchard configurations, with the learned model achieving about 6–8% higher accuracy than random sampling when labels are limited.
  • The study finds entropy- and margin-based sampling strategies outperform Query-by-Committee and standard uncertainty sampling under low-label conditions, with convergence across strategies as more labeled data is added.

Abstract

Agriculture remains a cornerstone of global health and economic sustainability, yet labor-intensive tasks such as harvesting high-value crops continue to face growing workforce shortages. Robotic harvesting systems offer a promising solution; however, their deployment in unstructured orchard environments is constrained by inefficient perception-to-action pipelines. In particular, existing approaches often rely on exhaustive inverse kinematics or motion planning to determine whether a target fruit is reachable, leading to unnecessary computation and delayed decision-making. Our approach combines RGB-D perception with active learning to directly learn reachability as a binary decision problem. We then leverage active learning to selectively query the most informative samples for reachability labeling, significantly reducing annotation effort while maintaining high predictive accuracy. Extensive experiments demonstrate that the proposed framework achieves accurate reachability prediction with substantially fewer labeled samples, yielding approximately 6--8% higher accuracy than random sampling and enabling label-efficient adaptation to new orchard configurations. Among the evaluated strategies, entropy- and margin-based sampling outperform Query-by-Committee and standard uncertainty sampling in low-label regimes, while all strategies converge to comparable performance as the labeled set grows. These results highlight the effectiveness of active learning for task-level perception in agricultural robotics and position our approach as a scalable alternative to computation-heavy kinematic reachability analysis. Our code is available through https://github.com/wsu-cyber-security-lab-ai/active-learning.