Ultra-Short-Term Photovoltaic Power Forecasting Approach Based on Cloud Features and ViT+LSTM Neural Network

DONG Haomiao, ZHANG Yao, LIN Fan, LI Jiaxing, ZHANG Beixi, LIAO Jian

Electric Power Construction ›› 2026, Vol. 47 ›› Issue (3) : 1-11.

PDF(5140 KB)
PDF(5140 KB)
Electric Power Construction ›› 2026, Vol. 47 ›› Issue (3) : 1-11. DOI: 10.12204/j.issn.1000-7229.2026.03.001
Key Technologies for High-Precision Prediction, Risk Assessment and Operation of Meteorology-Sensitive Power Systems ·Hosted by YU Guangzheng,YANG Mao,LI Gengfeng,LI Ran,LI Yuanzheng,WAN Can·

Ultra-Short-Term Photovoltaic Power Forecasting Approach Based on Cloud Features and ViT+LSTM Neural Network

Author information +
History +

Abstract

[Objective] To achieve accurate ultra-short-term photovoltaic power forecasting and address the insufficient extraction of cloud-information from ground-based sky images in traditional neural networks, this paper proposes an ultra-short-term photovoltaic power forecasting approach based on cloud features and a vision transformer+long short-term memory (ViT+LSTM) neural network. [Methods] First, an adaptive cloud recognition algorithm using Otsu’s method (OTSU) is adopted to generate high-accuracy binary images of cloud distribution. Second, a hybrid cloud‑motion‑vector algorithm is proposed, combining a similarity‑weighted cloud‑motion approach with the Farneback optical flow method to generate pixel‑level cloud‑displacement matrices. Ground‑based sky images, cloud distribution images and cloud motion matrices are concatenated to generate fused images. Finally, the ViT+LSTM neural network architecture is constructed for photovoltaic power forecasting. The ViT neural network extracts global spatial features from the fused images, and then global spatial features concatenated with historical photovoltaic power and temporal feature data are fed into LSTM neural network to capture temporal dynamic features. [Results] Case studies demonstrate that the approach effectively reduces cloud motion calculation error. The proposed approach achieves a 16.75% reduction in RMSE relative to the baseline model for ultra-short-term forecasting tasks. [Conclusions] The proposed cloud-feature extraction approach successfully extracts explicit cloud features, the proposed neural network architecture significantly outperforms existing models in forecasting performance; the proposed approach validates its accuracy in forecasting photovoltaic power fluctuations under different weather conditions.

Key words

photovoltaic power forecasting / deep learning / ground-based sky image / optical flow / vision transformer

Cite this article

Download Citations
DONG Haomiao , ZHANG Yao , LIN Fan , et al . Ultra-Short-Term Photovoltaic Power Forecasting Approach Based on Cloud Features and ViT+LSTM Neural Network[J]. Electric Power Construction. 2026, 47(3): 1-11 https://doi.org/10.12204/j.issn.1000-7229.2026.03.001

References

[1]
SINGH S, SAINI S, GUPTA S K, et al. Solar-PV inverter for the overall stability of power systems with intelligent MPPT control of DC-link capacitor voltage[J]. Protection and Control of Modern Power Systems, 2023, 8(1): 15.
[2]
International Renewable Energy Agency. Solar energy data[EB/OL]. (2021-04-17) [2025-07-20]. https://www.irena.org/solar.
[3]
饶志, 杨再敏, 杨雄平, 等. 基于地理和环境特征的光伏电站选址模型[J]. 电力建设, 2025, 46(7): 163-174.
RAO Zhi, YANG Zaimin, YANG Xiongping, et al. Study on photovoltaic plant site selection models based on geographic and environmental features[J]. Electric Power Construction, 2025, 46(7): 163-174.
[4]
胡烜彬, 纪正森, 许晓敏. DPCA-POA-RF-Informer在多情景光伏多步预测中的应用[J]. 智慧电力, 2024, 52(1): 8-13, 22.
HU Xuanbin, JI Zhengsen, XU Xiaomin. Application of DPCA-POA-RF-informer in multi-scenario multi-step prediction of photovoltaic power[J]. Smart Power, 2024, 52(1): 8-13, 22.
[5]
ZHANG R Y, MA H, SAHA T K, et al. Photovoltaic nowcasting with bi-level spatio-temporal analysis incorporating sky images[J]. IEEE Transactions on Sustainable Energy, 2021, 12(3): 1766-1776.
[6]
张光儒, 马振祺, 陈杰, 等. 考虑降压节能和光伏误差三维特性的主动配电网多时间尺度优化调度[J]. 电力建设, 2024, 45(8): 159-172.
Abstract
高比例分布式光伏的分散、随机特性加剧了配电系统潮流分布的不确定性,使得配电系统的安全经济运行面临严峻挑战。提出了考虑降压节能调节和分布式光伏预测误差三维特性的主动配电网多时间尺度优化调度方法。首先,分析负荷功率与馈线电压的灵敏度关系,提出了基于降压节能调节方法的综合负荷建模方法。其次,从时间-空间-功率三维角度,建立了一种分布式光伏预测误差的三维分析模型,为调度提供更精准的误差分析结果。然后,基于降压节能方法和预测误差三维分析模型,构建了可有效协调日前慢速调节资源与日内快速响应资源的主动配电网多时间尺度优化调度模型。最后,以改进IEEE 33节点系统为算例进行分析,算例分析结果表明所提误差建模方法对光伏功率有着较好的跟随效果,且基于该模型的优化调度策略能够减少误差随机性对调度决策的影响,提升配电系统运行的安全性与经济性。
ZHANG Guangru, MA Zhenqi, CHEN Jie, et al. Multi-timescale scheduling method for active distribution network considering three-dimensional characteristics of PV prediction error and voltage regulation[J]. Electric Power Construction, 2024, 45(8): 159-172.
The decentralized and random characteristics of high-proportion distributed photovoltaics aggravate the uncertainty of power flow distribution, which makes the safe and economic operation of the distribution system face severe challenges. In this paper, a multi-time scale optimization scheduling method for active distribution network considering the three-dimensional characteristics of conservation voltage reduction and distributed photovoltaic prediction error is proposed. Firstly, the sensitivity relationship between load power and feeder voltage is analyzed, and a comprehensive load modeling method based on step-down energy-saving regulation method is proposed. Then, from the perspective of time-space-power, a three-dimensional analysis model of distributed photovoltaic prediction error is established to provide more accurate error analysis results for scheduling. Finally, based on the conservation voltage reduction method and the three-dimensional analysis model of prediction error, a multi-timescale optimal scheduling model of active distribution network that can effectively coordinate the slow adjustment resources and the rapid response resources is constructed. Finally, taking the improved IEEE 33-node system as an example for analysis, the case study shows that the proposed error modeling method has a good following effect on photovoltaic power, and the optimized scheduling strategy based on this model can reduce the influence of error randomness on scheduling decision-making and improve the safety and economy of distribution system operation.
[7]
LI P S, WU Z J, ZHANG C, et al. Multi-timescale affinely adjustable robust reactive power dispatch of distribution networks integrated with high penetration of PV[J]. Journal of Modern Power Systems and Clean Energy, 2023, 11(1): 324-334.
[8]
XIA Y R, WANG J Z, ZHANG Z Y, et al. Short-term PV power forecasting based on time series expansion and high-order fuzzy cognitive maps[J]. Applied Soft Computing, 2023, 135: 110037.
[9]
杨峻, 彭乔, 蔡永翔, 等. 考虑最大功率点估计模型校准的光伏功率备用控制[J]. 电力工程技术, 2024, 43(6): 12-20, 52.
YANG Jun, PENG Qiao, CAI Yongxiang, et al. Power reserve control of photovoltaic system considering parameter correction in maximum power point estimation[J]. Electric Power Engineering Technology, 2024, 43(6): 12-20, 52.
[10]
CHENG L L, ZANG H X, TRIVEDI A, et al. Mitigating the impact of photovoltaic power ramps on intraday economic dispatch using reinforcement forecasting[J]. IEEE Transactions on Sustainable Energy, 2024, 15(1): 3-12.
[11]
TROCCOLI A, DUBUS L, HAUPT S E. Weather matters for energy[M]. New York: Springer New York, 2014: 429-454.
[12]
TANG Y G, YANG K, ZHANG S J, et al. Photovoltaic power forecasting: a hybrid deep learning model incorporating transfer learning strategy[J]. Renewable and Sustainable Energy Reviews, 2022, 162: 112473.
[13]
ZHEN Z, ZHANG X M, MEI S W, et al. Ultra-short-term irradiance forecasting model based on ground-based cloud image and deep learning algorithm[J]. IET Renewable Power Generation, 2022, 16(12): 2604-2616.
[14]
唐雅洁, 龚迪阳, 林达, 等. 基于SAX-MHA-GCN的区域分布式光伏超短期功率预测[J]. 浙江电力, 2025, 44(8): 88-98.
TANG Yajie, GONG Diyang, LIN Da, et al. Ultra-short-term power forecasting for regional DPV systems based on SAX-MHA-GCN[J]. Zhejiang Electric Power, 2025, 44(8): 88-98.
[15]
马成廉, 韩瑞, 宋萌清, 等. 基于多源气象数据的光伏功率预测深度学习架构[J]. 电网与清洁能源, 2025, 41(4): 104-112.
MA Chenglian, HAN Rui, SONG Mengqing, et al. Deep learning architecture for photovoltaic power prediction based on multi-source meteorological data[J]. Power System and Clean Energy, 2025, 41(4): 104-112.
[16]
黄晓燕, 郭洒洒, 陈成优, 等. 考虑时空关联及气象耦合的区域分布式光伏功率预测[J]. 浙江电力, 2025, 44(3): 79-89.
HUANG Xiaoyan, GUO Sasa, CHEN Chengyou, et al. Regional distributed photovoltaic power forecasting considering spatiotemporal correlation and meteorological coupling[J]. Zhejiang Electric Power, 2025, 44(3): 79-89.
[17]
张静, 熊国江. 考虑季节特性与数据窗口的短期光伏功率预测组合模型[J]. 电力工程技术, 2025, 44(1): 183-192.
ZHANG Jing, XIONG Guojiang. Short-term photovoltaic power prediction combination model considering seasonal characteristic and data window[J]. Electric Power Engineering Technology, 2025, 44(1): 183-192.
[18]
葛亚明, 戴上, 梁文腾, 等. 基于气象融合与深度学习的分布式光伏出力区间预测[J]. 电网与清洁能源, 2024, 40(8): 112-120.
GE Yaming, DAI Shang, LIANG Wenteng, et al. Prediction of distributed photovoltaic output interval based on meteorological fusion and deep learning[J]. Power System and Clean Energy, 2024, 40(8): 112-120.
[19]
陆毅, 薛枫, 唐小波, 等. 基于余弦相似度和TSO-BP的短期光伏预测方法[J]. 浙江电力, 2024, 43(6): 22-30.
LU Yi, XUE Feng, TANG Xiaobo, et al. A short-term PV power forecasting method based on cosine similarity and TSO-BP neural network[J]. Zhejiang Electric Power, 2024, 43(6): 22-30.
[20]
KUMAR D S, YAGLI G M, KASHYAP M, et al. Solar irradiance resource and forecasting: a comprehensive review[J]. IET Renewable Power Generation, 2020, 14(10): 1641-1656.
[21]
KONG W C, JIA Y W, DONG Z Y, et al. Hybrid approaches based on deep whole-sky-image learning to photovoltaic generation forecasting[J]. Applied Energy, 2020, 280: 115875.
[22]
LIN F, ZHANG Y, WANG J X. Recent advances in intra-hour solar forecasting: a review of ground-based sky image methods[J]. International Journal of Forecasting, 2023, 39(1): 244-265.
[23]
XU S J, ZHANG R Y, MA H, et al. On vision transformer for ultra-short-term forecasting of photovoltaic generation using sky images[J]. Solar Energy, 2024, 267: 112203.
[24]
SI Z Y, YANG M, YU Y X, et al. Photovoltaic power forecast based on satellite images considering effects of solar position[J]. Applied Energy, 2021, 302: 117514.
[25]
SUN Y C, SZŰCS G, BRANDT A R. Solar PV output prediction from video streams using convolutional neural networks[J]. Energy & Environmental Science, 2018, 11(7): 1811-1818.
[26]
MANNING J, BALDICK R. A novel clear-sky index for color sky imagery used in short-term irradiance forecasting[J]. Journal of Renewable and Sustainable Energy, 2020, 12: 013701.
A method for mapping color sky images of convective fair-weather cumuli to a scalar irradiance metric is presented. While basic interpretations of irradiance from color sky imagery are sufficient for many irradiance forecasting applications, sky images containing convective fair-weather cumuli can often contain gray-colored regions. Gray regions of a cloud commonly relate cloud thickness, indicating a region that has a high potential to attenuate surface irradiance from the sun. However, existing irradiance metrics are not found to translate such gray regions in accordance with their importance to a clear-sky index for short-term forecasting. This method exploits the special structure of sky images in three-dimensional red-green-blue (RGB) Cartesian space. By applying principal component analysis and basic clustering operations, a planar discriminant for cloudy-to-clear-sky classification is found. Once the {cloudy, clear-sky} identity of all image pixels is determined, the cloudy and clear-sky pixel distributions are separately remapped in RGB space so that gray pixels score a higher optical depth value than white pixels, and clear-sky pixels are mapped to low optical depth values. The resulting clear-sky index is simply the grayscale interpretation of the remapped image. The method is described and demonstrated with two actual sky images, and errors for sequences of several hundred images are tabulated and discussed. Remapped images are shown to represent gray cloud regions with a relatively high cloud optical depth in comparison with white cloud regions. The proposed metric is shown, by comparison with experimentally measured irradiance time series, to produce a more accurate clear-sky index in comparison with other methods.
[27]
BONE V, PIDGEON J, KEARNEY M, et al. Intra-hour direct normal irradiance forecasting through adaptive clear-sky modelling and cloud tracking[J]. Solar Energy, 2018, 159: 852-867.
[28]
QUESADA-RUIZ S, CHU Y, TOVAR-PESCADOR J, et al. Cloud-tracking methodology for intra-hour DNI forecasting[J]. Solar Energy, 2014, 102: 267-275.
[29]
CALDAS M, ALONSO-SUÁREZ R. Very short-term solar irradiance forecast using all-sky imaging and real-time irradiance measurements[J]. Renewable Energy, 2019, 143: 1643-1658.
[30]
王舒雨, 李豪, 马刚, 等. 基于TCN和DLinear的光伏发电功率多步预测模型[J]. 电力建设, 2025, 46(4): 173-184.
WANG Shuyu, LI Hao, MA Gang, et al. Multistep prediction model for photovoltaic power generation based on time convolution and DLinear[J]. Electric Power Construction, 2025, 46(4): 173-184.
[31]
LIU J X, ZANG H X, CHENG L L, et al. A Transformer-based multimodal-learning framework using sky images for ultra-short-term solar irradiance forecasting[J]. Applied Energy, 2023, 342: 121160.
[32]
SI Z Y, YU Y X, YANG M, et al. Hybrid solar forecasting method using satellite visible images and modified convolutional neural networks[J]. IEEE Transactions on Industry Applications, 2021, 57(1): 5-16.
[33]
张一帆, 王宇强, 潘大志, 等. 基于云图数据的分布式光伏超短期功率预测方法研究[J]. 电网与清洁能源, 2025, 41(9): 110-115.
ZHANG Yifan, WANG Yuqiang, PAN Dazhi, et al. Research on prediction methods of distributed photovoltaic ultra-short-term power based on cloud image data[J]. Power System and Clean Energy, 2025, 41(9): 110-115.
[34]
ZHANG Q L, HOU B P, ZHU W, et al. Distributed photovoltaic ultra-short-term power prediction using whole-sky images and multi-source data[J]. Electrical Engineering, 2025, 107(9): 11411-11429.
[35]
ZANG H X, CHEN D H, LIU J X, et al. Improving ultra-short-term photovoltaic power forecasting using a novel sky-image-based framework considering spatial-temporal feature interaction[J]. Energy, 2024, 293: 130538.
[36]
LIU J X, ZANG H X, DING T, et al. Harvesting spatiotemporal correlation from sky image sequence to improve ultra-short-term solar irradiance forecasting[J]. Renewable Energy, 2023, 209: 619-631.
[37]
NIE Y H, LI X T, SCOTT A, et al. SKIPP’D: a sky images and photovoltaic power generation dataset for short-term solar forecasting[J]. Solar Energy, 2023, 255: 171-179.
[38]
CHENG H Y. Cloud tracking using clusters of feature points for accurate solar irradiance nowcasting[J]. Renewable Energy, 2017, 104: 281-289.
[39]
MARQUEZ R, COIMBRA C F M. Intra-hour DNI forecasting based on cloud tracking image analysis[J]. Solar Energy, 2013, 91: 327-336.
[40]
FENG C, ZHANG J, ZHANG W Q, et al. Convolutional neural networks for intra-hour solar forecasting based on sky image sequences[J]. Applied Energy, 2022, 310: 118438.
[41]
ALDO V, JUAN C. Fundamentals of renewable energy processes[M]. New York: Academic Press, 2012: 519-576.

Funding

National Key Research and Development Program of China(2024YFF0809204)
PDF(5140 KB)

Accesses

Citation

Detail

Sections
Recommended

/