Sparse Network Inference under Imperfect Detection and its Application to Ecological Networks

arXiv stat.ML / 4/22/2026

📰 NewsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper focuses on recovering latent structure in bipartite ecological networks from count data, emphasizing both cross-group interactions and within-group similarity patterns under imperfect detection.
  • It argues that prior models underexplore the similarity graphs they implicitly induce, and that lack of controlled sparsity and unbalanced scaling can yield oversparse or poorly rescaled estimates.
  • The authors propose a structured sparse nonnegative low-rank factorization framework that explicitly estimates detection probability and uses nonconvex ℓ1/2 regularization to better promote sparsity in both similarity and connectivity.
  • They develop an ADMM-based solver with adaptive penalization and scale-aware initialization, and provide theoretical results for asymptotic feasibility and KKT stationarity.
  • Experiments on synthetic and real ecological datasets show improved recovery of latent factors as well as the similarity/connectivity structure versus existing baselines.

Abstract

Recovering latent structure from count data has received considerable attention in network inference, particularly when one seeks both cross-group interactions and within-group similarity patterns in bipartite networks, which is widely used in ecology research. Such networks are often sparse and inherently imperfect in their detection. Existing models mainly focus on interaction recovery, while the induced similarity graphs are much less studied. Moreover, sparsity is often not controlled, and scale is unbalanced, leading to oversparse or poorly rescaled estimates with degrading structural recovery. To address these issues, we propose a framework for structured sparse nonnegative low-rank factorization with detection probability estimation. We impose nonconvex \ell_{1/2} regularization on the latent similarity and connectivity structures to promote sparsity within-group similarity and cross-group connectivity with better relative scale. The resulting optimization problem is nonconvex and nonsmooth. To solve it, we develop an ADMM-based algorithm with adaptive penalization and scale-aware initialization and establish its asymptotic feasibility and KKT stationarity of cluster points under mild regularity conditions. Experiments on synthetic and real-world ecological datasets demonstrate improved recovery of latent factors and similarity/connectivity structure relative to existing baselines.