Time-Series Classification with Multivariate Statistical Dependence Features

arXiv cs.LG / 4/9/2026

💬 OpinionSignals & Early TrendsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper introduces a non-stationary time-series classification framework that estimates statistical dependence directly via the cross density ratio (CDR) instead of using conventional correlation-based window statistics.
  • It claims CDR-based features are order-independent and more robust to regime changes, addressing limitations of windowed correlation estimates.
  • The approach leverages the functional maximal correlation algorithm (FMCA) to build a projection space by decomposing the eigenspectrum of the CDR, then uses multiscale eigenspace features for classification.
  • Classification is performed with a lightweight single-hidden-layer perceptron, emphasizing efficiency in model complexity and storage.
  • On the TI-46 digit speech corpus, the method reportedly achieves higher accuracy than HMMs and state-of-the-art spiking neural networks while using fewer than 10 layers and under 5 MB storage.

Abstract

In this paper, we propose a novel framework for non-stationary time-series analysis that replaces conventional correlation-based statistics with direct estimation of statistical dependence in the normalized joint density of input and target signals, the cross density ratio (CDR). Unlike windowed correlation estimates, this measure is independent of sample order and robust to regime changes. The method builds on the functional maximal correlation algorithm (FMCA), which constructs a projection space by decomposing the eigenspectrum of the CDR. Multiscale features from this eigenspace are classified using a lightweight single-hidden-layer perceptron. On the TI-46 digit speech corpus, our approach outperforms hidden Markov models (HMMs) and state-of-the-art spiking neural networks, achieving higher accuracy with fewer than 10 layers and a storage footprint under 5 MB.