Granularity-Aware Transfer for Tree Instance Segmentation in Synthetic and Real Forests

arXiv cs.CV / 4/16/2026

📰 NewsSignals & Early TrendsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper tackles synthetic-to-real transfer for tree instance segmentation when real forests provide only coarse tree labels but synthetic data include fine-grained trunk/crown annotations.
  • It introduces MGTD, a mixed-granularity dataset with 53k synthetic and 3.6k real images, designed specifically to evaluate label-granularity constraints in Sim-Real transfer.
  • The proposed four-stage training/evaluation protocol separates domain shift from granularity mismatch to better attribute performance gains.
  • Its key method, granularity-aware distillation (MGTD), transfers structural priors from fine-grained synthetic “teachers” to a coarse-label “student” using logit-space merging and mask unification.
  • Experiments report consistent mask AP improvements, with the biggest benefits for small or distant trees, positioning MGTD as a testbed for future Sim-Real forestry perception research.

Abstract

We address the challenge of synthetic-to-real transfer in forestry perception where real data have only coarse Tree labels while synthetic data provide fine-grained trunk/crown annotations. We introduce MGTD, a mixed-granularity dataset with 53k synthetic and 3.6k real images, and a four-stage protocol isolating domain shift and granularity mismatch. Our core contribution is granularity-aware distillation, which transfers structural priors from fine-grained synthetic teachers to a coarse-label student via logit-space merging and mask unification. Experiments show consistent mask AP gains, especially for small/distant trees, establishing a testbed for Sim-Real transfer under label granularity constraints.