Neural posterior estimation of the neutrino direction in IceCube using transformer-encoded normalizing flows on the sphere

arXiv cs.AI / 4/23/2026

💬 OpinionDeveloper Stack & InfrastructureSignals & Early TrendsModels & Research

Key Points

  • The study proposes a transformer-encoder-based neural posterior estimation method for reconstructing the neutrino arrival direction in IceCube by mapping outputs to a normalizing flow on the 2-sphere.
  • The approach achieves state-of-the-art angular resolution for both key IceCube event morphologies (tracks and showers) across energies from 100 GeV to 100 PeV, with reported median improvements of 1.3× (throughgoing tracks), 1.7× (showers), and 2.5× (starting tracks) at 100 TeV versus B-spline likelihood reconstructions.
  • It is substantially faster than traditional B-spline-based likelihood reconstructions, enabling all-sky scans in seconds with constant computation time regardless of whether the posterior is very narrow or spans the whole sky.
  • The method uses a novel spherical normalizing-flow distribution (C²-smooth rational-quadratic splines, scale transformations, and rotations) whose parameters are predicted jointly by the transformer, and it identifies architectural tweaks (e.g., dual residual streams, nonlinear QKV projections, and a separate class token with its own cross-attention) that improve test-time performance.
  • Importantly, the work claims the first ML-based method to outperform likelihood-based muon reconstructions above 100 GeV, marking a significant shift in performance expectations for directional neutrino reconstruction.

Abstract

IceCube is a cubic-kilometer-scale neutrino detector located at the geographic South Pole. A precise directional reconstruction of IceCube neutrinos is vital for associations with astronomical objects. In this context, we discuss neural posterior estimation of the neutrino direction via a transformer encoder that maps to a normalizing flow on the 2-sphere. It achieves a new state-of-the-art angular resolution for the two main event morphologies in IceCube - tracks and showers - while being significantly faster than traditional B-spline-based likelihood reconstructions. All-sky scans can be performed within seconds rather than hours, and take constant computation time, regardless of whether the posterior extent is arc-minutes or spans the whole sky. We utilize a combination of C^2-smooth rational-quadratic splines, scale transformations and rotations to define a novel spherical normalizing-flow distribution whose parameters are predicted as a whole as the output of the transformer encoder. We test several structural choices diverting from the vanilla transformer architecture. In particular, we find dual residual streams, nonlinear QKV projection and a separate class token with its own cross-attention processing to boost test-time performance. The angular resolution for both showers and tracks improves substantially over the whole trained energy range from 100 GeV to 100 PeV. At 100 TeV deposited energy, for example, the median angular resolution improves by a factor of 1.3 for throughgoing tracks, by a factor of 1.7 for showers and by a factor of 2.5 for starting tracks compared to state-of-the art likelihood reconstructions based on B-splines. While previous machine-learning (ML) efforts have managed to obtain competitive shower resolutions, this is the first time an ML-based method outperforms likelihood-based muon reconstructions above 100 GeV.