WaveMoE: A Wavelet-Enhanced Mixture-of-Experts Foundation Model for Time Series Forecasting

arXiv cs.LG / 4/14/2026

📰 NewsSignals & Early TrendsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper introduces WaveMoE, a time-series forecasting foundation model that enhances standard token modeling by incorporating explicit frequency-domain information using wavelets.
  • WaveMoE uses a dual-path architecture that processes both time-series tokens and wavelet tokens aligned on the same temporal axis, linking them through a shared expert routing mechanism.
  • The shared routing enables consistent expert specialization across the two representations while allowing efficient scaling of model capacity via a mixture-of-experts design.
  • Preliminary experiments on 16 diverse benchmarks suggest WaveMoE can improve forecasting performance, particularly by leveraging wavelet-domain corpora to better capture periodicity and localized high-frequency dynamics.

Abstract

Time series foundation models (TSFMs) have recently achieved remarkable success in universal forecasting by leveraging large-scale pretraining on diverse time series data. Complementing this progress, incorporating frequency-domain information yields promising performance in enhancing the modeling of complex temporal patterns, such as periodicity and localized high-frequency dynamics, which are prevalent in real-world time series. To advance this direction, we propose a new perspective that integrates explicit frequency-domain representations into scalable foundation models, and introduce WaveMoE, a wavelet-enhanced mixture-of-experts foundation model for time series forecasting. WaveMoE adopts a dual-path architecture that jointly processes time series tokens and wavelet tokens aligned along a unified temporal axis, and coordinates them through a shared expert routing mechanism that enables consistent expert specialization while efficiently scaling model capacity. Preliminary experimental results on 16 diverse benchmark datasets indicate that WaveMoE has the potential to further improve forecasting performance by incorporating wavelet-domain corpora.