Outperforming Self-Attention Mechanisms in Solar Irradiance Forecasting via Physics-Guided Neural Networks

arXiv cs.AI / 4/16/2026

💬 OpinionSignals & Early TrendsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper proposes a lightweight Physics-Informed Hybrid CNN-BiLSTM model for Global Horizontal Irradiance (GHI) forecasting in arid regions with rapid aerosol fluctuations.
  • Instead of relying on costly Transformer/self-attention architectures, the approach uses 15 engineered physics/domain features (e.g., Clear-Sky indices and Solar Zenith Angle) to guide learning beyond raw historical data.
  • Hyperparameters are tuned via Bayesian Optimization to achieve globally optimal settings for the proposed framework.
  • Experiments using NASA POWER data from Sudan report an RMSE of 19.53 W/m^2, substantially better than attention-based baselines at 30.64 W/m^2.
  • The authors argue for a “Complexity Paradox,” claiming that in high-noise meteorological forecasting, explicit physical constraints can outperform self-attention with greater efficiency and accuracy.

Abstract

Accurate Global Horizontal Irradiance (GHI) forecasting is critical for grid stability, particularly in arid regions characterized by rapid aerosol fluctuations. While recent trends favor computationally expensive Transformer-based architectures, this paper challenges the prevailing "complexity-first" paradigm. We propose a lightweight, Physics-Informed Hybrid CNN-BiLSTM framework that prioritizes domain knowledge over architectural depth. The model integrates a Convolutional Neural Network (CNN) for spatial feature extraction with a Bi-Directional LSTM for capturing temporal dependencies. Unlike standard data-driven approaches, our model is explicitly guided by a vector of 15 engineered features including Clear-Sky indices and Solar Zenith Angle - rather than relying solely on raw historical data. Hyperparameters are rigorously tuned using Bayesian Optimization to ensure global optimality. Experimental validation using NASA POWER data in Sudan demonstrates that our physics-guided approach achieves a Root Mean Square Error (RMSE) of 19.53 W/m^2, significantly outperforming complex attention-based baselines (RMSE 30.64 W/m^2). These results confirm a "Complexity Paradox": in high-noise meteorological tasks, explicit physical constraints offer a more efficient and accurate alternative to self-attention mechanisms. The findings advocate for a shift towards hybrid, physics-aware AI for real-time renewable energy management.