AI Navigate

ECoLAD: Deployment-Oriented Evaluation for Automotive Time-Series Anomaly Detection

arXiv cs.LG / 3/12/2026

📰 NewsIdeas & Deep AnalysisModels & Research

Key Points

  • ECoLAD presents a deployment-oriented evaluation protocol for automotive time-series anomaly detectors, emphasizing predictable latency and stability under limited CPU parallelism.
  • It uses a monotone compute-reduction ladder with integer-only scaling rules and explicit CPU thread caps, logging every configuration change to evaluate deployment feasibility.
  • The evaluation sweeps target scoring rates to report coverage (the fraction of entities meeting the target) and the best AUC-PR achievable within measured ladder configurations that satisfy the target.
  • In proprietary automotive telemetry data, lightweight classical detectors maintain both coverage and detection lift over random baseline across the throughput sweep, while several deep methods become infeasible before losing accuracy.
  • The work highlights the importance of deployment-oriented metrics for realistic benchmarking, suggesting that accuracy-only leaderboards can misrepresent deployability in constrained environments.

Abstract

Time-series anomaly detectors are commonly compared on workstation-class hardware under unconstrained execution. In-vehicle monitoring, however, requires predictable latency and stable behavior under limited CPU parallelism. Accuracy-only leaderboards can therefore misrepresent which methods remain feasible under deployment-relevant constraints. We present ECoLAD (Efficiency Compute Ladder for Anomaly Detection), a deployment-oriented evaluation protocol instantiated as an empirical study on proprietary automotive telemetry (anomaly rate {\approx}0.022) and complementary public benchmarks. ECoLAD applies a monotone compute-reduction ladder across heterogeneous detector families using mechanically determined, integer-only scaling rules and explicit CPU thread caps, while logging every applied configuration change. Throughput-constrained behavior is characterized by sweeping target scoring rates and reporting (i) coverage (the fraction of entities meeting the target) and (ii) the best AUC-PR achievable among measured ladder configurations satisfying the target. On constrained automotive telemetry, lightweight classical detectors sustain both coverage and detection lift above the random baseline across the full throughput sweep. Several deep methods lose feasibility before they lose accuracy.