Deep Learning Multi-Horizon Irradiance Nowcasting: A Comparative Evaluation of Three Methods for Leveraging Sky Images

arXiv cs.AI / 3/31/2026

💬 OpinionSignals & Early TrendsIdeas & Deep AnalysisModels & Research

Key Points

  • The paper compares three approaches for using all-sky imager (ASI) sky images in deep learning irradiance nowcasting: direct CNN feature extraction from raw RGB, CNN over engineered 2D physical/domain-informed feature maps, and time-series aggregation of those engineered features.
  • All three methods are trained on a high-frequency 29-day dataset to produce multi-horizon global horizontal irradiance forecasts up to 15 minutes ahead.
  • Evaluation on 7 selected days uses root mean squared error (RMSE) and skill scores to assess performance across the three integration strategies.
  • Results show that using aggregated engineered ASI feature maps as model input outperforms the other methods, indicating that strong accuracy gains can come from domain-informed image feature engineering.
  • The authors conclude the approach can achieve improved performance without complex spatially ordered deep learning architectures, suggesting promising directions for simpler image processing pipelines and better spatial feature modeling.

Abstract

We investigate three distinct methods of incorporating all-sky imager (ASI) images into deep learning (DL) irradiance nowcasting. The first method relies on a convolutional neural network (CNN) to extract features directly from raw RGB images. The second method uses state-of-the-art algorithms to engineer 2D feature maps informed by domain knowledge, e.g., cloud segmentation, the cloud motion vector, solar position, and cloud base height. These feature maps are then passed to a CNN to extract compound features. The final method relies on aggregating the engineered 2D feature maps into time-series input. Each of the three methods were then used as part of a DL model trained on a high-frequency, 29-day dataset to generate multi-horizon forecasts of global horizontal irradiance up to 15 minutes ahead. The models were then evaluated using root mean squared error and skill score on 7 selected days of data. Aggregated engineered ASI features as model input yielded superior forecasting performance, demonstrating that integration of ASI images into DL nowcasting models is possible without complex spatially-ordered DL-architectures and inputs, underscoring opportunities for alternative image processing methods as well as the potential for improved spatial DL feature processing methods.