Event-Driven Neuromorphic Vision Enables Energy-Efficient Visual Place Recognition

arXiv cs.CV / 4/7/2026

📰 NewsSignals & Early TrendsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper introduces SpikeVPR, an event-driven neuromorphic visual place recognition method that uses event-based cameras together with spiking neural networks to produce compact place descriptors.
  • SpikeVPR is trained end-to-end with surrogate gradient learning and is designed to be invariant to extreme changes in illumination, viewpoint, and appearance using only a few exemplars.
  • The method includes EventDilation, a new augmentation technique aimed at improving robustness to variations in speed and temporal dynamics.
  • Experiments on Brisbane-Event-VPR and NSAVP show performance comparable to state-of-the-art deep networks while using far fewer parameters (about 50x fewer) and substantially less energy (30–250x less).
  • The authors conclude that spike-based coding provides an efficient route to deploying robust VPR in real-world, energy-constrained mobile and neuromorphic platforms.

Abstract

Reliable visual place recognition (VPR) under dynamic real-world conditions is critical for autonomous robots, yet conventional deep networks remain limited by high computational and energy demands. Inspired by the mammalian navigation system, we introduce SpikeVPR, a bio-inspired and neuromorphic approach combining event-based cameras with spiking neural networks (SNNs) to generate compact, invariant place descriptors from few exemplars, achieving robust recognition under extreme changes in illumination, viewpoint, and appearance. SpikeVPR is trained end-to-end using surrogate gradient learning and incorporates EventDilation, a novel augmentation strategy enhancing robustness to speed and temporal variations. Evaluated on two challenging benchmarks (Brisbane-Event-VPR and NSAVP), SpikeVPR achieves performance comparable to state-of-the-art deep networks while using 50 times fewer parameters and consuming 30 and 250 times less energy, enabling real-time deployment on mobile and neuromorphic platforms. These results demonstrate that spike-based coding offers an efficient pathway toward robust VPR in complex, changing environments.