Short-term Forecasting of Multienergy Loads of Integrated Energy System Based on Multihead Probabilistic Sparse Self-attention Model

HAN Baohui, LU Lingxia, BAO Zhejing, YU Miao

Electric Power Construction ›› 2024, Vol. 45 ›› Issue (2) : 127-136.

PDF(3311 KB)
PDF(3311 KB)
Electric Power Construction ›› 2024, Vol. 45 ›› Issue (2) : 127-136. DOI: 10.12204/j.issn.1000-7229.2024.02.011
Smart Grid

Short-term Forecasting of Multienergy Loads of Integrated Energy System Based on Multihead Probabilistic Sparse Self-attention Model

Author information +
History +

Abstract

Accurate short-term forecasting of multienergy loads is the basis for the dispatch and operation of integrated energy systems. There is a strong coupling between multiple loads in an integrated energy system, and the existing single load forecasting is challenging to explore the complex internal relationship between multiple loads. Therefore, a short-term forecasting method for multienergy loads based on a multihead probabilistic sparse self-attention (MPSS) model was proposed. First, the Pearson correlation coefficient was used to analyze the correlation between multiple loads, the coupling features between multiple loads were extracted, a multihead probabilistic sparse self-attention mechanism with improved location coding was used to learn the dependencies of long-sequence inputs, and the parameter soft sharing mechanism of multivariate prediction tasks was adopted. The sharing mechanism realizes the joint prediction of multiple loads through a differentiated selection of shared features using different subtasks. Finally, the performance of the proposed model was verified using the multiple-load dataset of the Tempe Campus of Arizona State University. Compared with other forecasting models, the results show that the proposed multivariate load forecasting method can effectively improve forecasting accuracy.

Key words

integrated energy system / multienergy load forecasting / multihead probabilistic sparse self-attention model / location coding

Cite this article

Download Citations
Baohui HAN , Lingxia LU , Zhejing BAO , et al. Short-term Forecasting of Multienergy Loads of Integrated Energy System Based on Multihead Probabilistic Sparse Self-attention Model[J]. Electric Power Construction. 2024, 45(2): 127-136 https://doi.org/10.12204/j.issn.1000-7229.2024.02.011

References

[1]
曾鸣, 刘英新, 周鹏程, 等. 综合能源系统建模及效益评价体系综述与展望[J]. 电网技术, 2018, 42(6): 1697-1708.
ZENG Ming, LIU Yingxin, ZHOU Pengcheng, et al. Review and prospects of integrated energy system modeling and benefit evaluation[J]. Power System Technology, 2018, 42(6): 1697-1708.
[2]
艾芊, 郝然. 多能互补、集成优化能源系统关键技术及挑战[J]. 电力系统自动化, 2018, 42(4): 2-10, 46.
AI Qian, HAO Ran. Key technologies and challenges for multi-energy complementarity and optimization of integrated energy system[J]. Automation of Electric Power Systems, 2018, 42(4): 2-10, 46.
[3]
别朝红, 王旭, 胡源. 能源互联网规划研究综述及展望[J]. 中国电机工程学报, 2017, 37(22): 6445-6462, 6757.
BIE Zhaohong, WANG Xu, HU Yuan. Review and prospect of planning of energy internet[J]. Proceedings of the CSEE, 2017, 37(22): 6445-6462, 6757.
[4]
HAQ M R, NI Z. A new hybrid model for short-term electricity load forecasting[J]. IEEE Access, 2019, 7: 125413-125423.
Nowadays electricity load forecasting is important to further minimize the cost of day-ahead energy market. Load forecasting can help utility operators for the efficient management of a demand response program. Forecasting of electricity load demand with higher accuracy and efficiency can help utility operators to design reasonable operational planning of generation units. But solving the problem of load forecasting is a challenging task since electricity load is affected by previous history load, several exogenous external factors (i.e., weather variables, social variables, working day or holiday), time of day, and season of the year. To solve the problem of short-term load forecasting (STLF) and further improve the forecasting accuracy, in this paper we have proposed a novel hybrid STLF model with a new signal decomposition and correlation analysis technique. To this end, load demand time series is decomposed into some regular low frequency components using improved empirical mode decomposition (IEMD). To compensate for the information loss during signal decomposition, we have incorporated the effect of exogenous variables by performing correlation analysis using T-Copula. From the T-Copula analysis, peak load indicative binary variable is derived from value at risk (VaR) to improve the load forecasting accuracy during peak time. The data obtained from IEMD and T-Copula is applied to deep belief network for predicting the future load demand of specific time. The proposed data driven method is validated on real time data from the Australia and the United States of America. The performance of proposed load forecasting model is evaluated in terms of mean absolute percentage error (MAPE) & root mean square error (RMSE). Simulation results verify that, the proposed model provides a significant decrease in MAPE and RMSE values compared to traditional empirical mode decomposition based electricity load forecasting.
[5]
WANG Y, ZHANG N, TAN Y S, et al. Combining probabilistic load forecasts[J]. IEEE Transactions on Smart Grid, 2019, 10(4): 3664-3674.
[6]
SHARMA S, MAJUMDAR A, ELVIRA V, et al. Blind Kalman filtering for short-term load forecasting[J]. IEEE Transactions on Power Systems, 2020, 35(6): 4916-4919.
[7]
魏步晗, 鲍刚, 李振华. 基于支持向量回归预测模型考虑天气因素和分时电价因素的短期电力负荷预测[J]. 电网与清洁能源, 2023, 39(11): 9-19.
WEI Buhan, BAO Gang, LI Zhenhua. Short-term electricity load forecasting based on support vector regression forecasting model considering weather factors and time-of-use tariff factors[J]. Power System and Clean Energy, 2023, 39(11): 9-19.
[8]
KONG W C, DONG Z Y, JIA Y W, et al. Short-term residential load forecasting based on LSTM recurrent neural network[J]. IEEE Transactions on Smart Grid, 2019, 10(1): 841-851.
[9]
刘文杰, 刘禾, 王英男, 等. 基于完整自适应噪声集成经验模态分解的LSTM-Attention网络短期电力负荷预测方法[J]. 电力建设, 2022, 43(2): 98-108.
Abstract
短期电力负荷预测在电网安全运行和制定合理调度计划方面发挥着重要作用。为了提高电力负荷时间序列预测的准确度,提出了一种由完整自适应噪声集成经验模态分解(complete ensemble empirical mode decomposition with adaptive noise, CEEMDAN)和基于注意力机制的长短期记忆神经网络(long short-term memory network based on attention mechanism, LSTM-Attention)相结合的短期电力负荷预测模型。完整自适应噪声集成经验模态分解有效地将负荷时间序列分解成多个层次规律平稳的本征模态分量,并通过神经网络模型预测极大值,结合镜像延拓方法抑制边界效应,提高分解精度,同时基于注意力机制的长短期记忆神经网络自适应地提取电力负荷数据输入特征并分配权重进行预测,最后各预测模态分量叠加重构后获得最终预测结果。通过不同实际电力负荷季节数据分别进行实验,并与其他电力负荷预测模型结果分析进行比较,验证了该预测方法在电力负荷预测精度方面具有更好的性能。
LIU Wenjie, LIU He, WANG Yingnan, et al. Short-term power load forecasting method based on CEEMDAN and LSTM-attention network[J]. Electric Power Construction, 2022, 43(2): 98-108.

Short-term power load forecasting plays an important role in the safe operation of power grid and the formulation of reasonable dispatching plan. In order to improve the accuracy of power load time-series forecasting, a short-term power load forecasting model based on complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) and short-term memory neural network based on attention mechanism (LSTM-Attention) is proposed in this paper. The complete ensemble empirical mode decomposition with adaptive noise effectively decomposes the load time series into multiple levels of regular and stable eigenmode components, and suppresses the boundary effect through the neural network model prediction maximum combined with the image continuation method to improve the decomposition accuracy. At the same time, the long short-term memory neural network based on attention mechanism adaptively extracts the input characteristics of power load data and assigns weights for prediction. Finally, the final prediction results are obtained after superposition and reconstruction of each prediction modal component. Experiments are carried out on different seasonal data of actual power load, and the results of other power load forecasting models are analyzed and compared to verify that the forecasting method has better performance in power load forecasting accuracy.

[10]
曾囿钧, 肖先勇, 徐方维, 等. 基于CNN-BiGRU-NN模型的短期负荷预测方法[J]. 中国电力, 2021, 54(9): 17-23.
ZENG Youjun, XIAO Xianyong, XU Fangwei, et al. A short-term load forecasting method based on CNN-BiGRU-NN model[J]. Electric Power, 2021, 54(9): 17-23.
[11]
任建吉, 位慧慧, 邹卓霖, 等. 基于CNN-BiLSTM-Attention的超短期电力负荷预测[J]. 电力系统保护与控制, 2022, 50(8): 108-116.
REN Jianji, WEI Huihui, ZOU Zhuolin, et al. Ultra-short-term power load forecasting based on CNN-BiLSTM-Attention[J]. Power System Protection and Control, 2022, 50(8): 108-116.
[12]
庄家懿, 杨国华, 郑豪丰, 等. 基于多模型融合的CNN-LSTM-XGBoost短期电力负荷预测方法[J]. 中国电力, 2021, 54(5): 46-55.
ZHUANG Jiayi, YANG Guohua, ZHENG Haofeng, et al. Short-term load forecasting method based on multi-model fusion using CNN-LSTM-XGBoost framework[J]. Electric Power, 2021, 54(5): 46-55.
[13]
MOKEEV V V. Prediction of heating load and cooling load of buildings using neural network[C]// 2019 International Ural Conference on Electrical Power Engineering (UralCon). IEEE, 2019: 417-421.
[14]
ZHENG H H, ZHAO X M, WU Y T, et al. Research on cold load forecasting model based on long short-term memory[C]// 2021 2nd International Conference on Computer Science and Management Technology (ICCSMT). IEEE, 2022: 87-91.
[15]
LIN T, PAN Y, XUE G X, et al. A novel hybrid spatial-temporal attention-LSTM model for heat load prediction[J]. IEEE Access, 2020, 8: 159182-159195.
[16]
赵峰, 孙波, 张承慧. 基于多变量相空间重构和卡尔曼滤波的冷热电联供系统负荷预测方法[J]. 中国电机工程学报, 2016, 36(2): 399-406.
ZHAO Feng, SUN Bo, ZHANG Chenghui. Cooling, heating and electrical load forecasting method for CCHP system based on multivariate phase space reconstruction and Kalman filter[J]. Proceedings of the CSEE, 2016, 36(2): 399-406.
[17]
TANG Y, LIU H M, XIE Y F, et al. Short-term forecasting of electricity and gas demand in multi-energy system based on RBF-NN model[C]// 2019 IEEE International Conference on Energy Internet (ICEI). IEEE, 2019: 542-547.
[18]
朱刘柱, 王绪利, 马静, 等. 基于小波包分解与循环神经网络的综合能源系统短期负荷预测[J]. 电力建设, 2020, 41(12): 131-138.
ZHU Liuzhu, WANG Xuli, MA Jing, et al. Short-term load forecast of integrated energy system based on wavelet packet decomposition and recurrent neural network[J]. Electric Power Construction, 2020, 41(12): 131-138.
[19]
LI K, SUN Y X, LI S Z, et al. Load forecasting method for CCHP system based on deep learning strategy using LSTM-RNN[C]// 2019 14th IEEE Conference on Industrial Electronics and Applications (ICIEA). IEEE, 2019: 827-831.
[20]
TAN Z F, DE G, LI M L, et al. Combined electricity-heat-cooling-gas load forecasting model for integrated energy system based on multi-task learning and least square support vector machine[J]. Journal of Cleaner Production, 2020, 248: 119252.
[21]
WANG X, WANG S X, ZHAO Q Y, et al. A multi-energy load prediction model based on deep multi-task learning and ensemble approach for regional integrated energy systems[J]. International Journal of Electrical Power & Energy Systems, 2021, 126: 106583.
[22]
孙庆凯, 王小君, 张义志, 等. 基于LSTM和多任务学习的综合能源系统多元负荷预测[J]. 电力系统自动化, 2021, 45(5): 63-70.
SUN Qingkai, WANG Xiaojun, ZHANG Yizhi, et al. Multiple load prediction of integrated energy system based on long short-term memory and multi-task learning[J]. Automation of Electric Power Systems, 2021, 45(5): 63-70.
[23]
王琛, 王颖, 郑涛, 等. 基于ResNet-LSTM网络和注意力机制的综合能源系统多元负荷预测[J]. 电工技术学报, 2022, 37(7): 1789-1799.
WANG Chen, WANG Ying, ZHENG Tao, et al. Multi-energy load forecasting in integrated energy system based on ResNet-LSTM network and attention mechanism[J]. Transactions of China Electrotechnical Society, 2022, 37(7): 1789-1799.
[24]
侯健敏, 孟莹, 李志, 等. 基于综合相关性指标与SA-BiGRU的综合能源系统多元负荷预测[J/OL]. 电力建设: 1-11 [2023-12-28]. http://kns.cnki.net/kcms/detail/11.2583.TM.20231031.1351.006.html.
HOU Jianmin, MENG Ying, LI Zhi, et al. Multi-energy load forecasting in integrated energy systems based on comprehensive correlation index and SA-BiGRU network[J/OL]. Electric Power Construction: 1-11 [2023-12-28]. http://kns.cnki.net/kcms/detail/11.2583.TM.20231031.1351.006.html.
[25]
WANG C, SHE Z, CAO L. Coupled attribute analysis on numerical data[C]// Proceedings of the Twenty-third International Joint Conference on Artificial Intelligence. 2013: 1736-1742.
[26]
VASWANI A, SHAZEER N, PARMAR N, et al. Attention is all you need[C]// Proceedings of the 31st International Conference on Neural Information Processing Systems. New York: ACM, 2017: 6000-6010.
[27]
ZHOU H Y, ZHANG S H, PENG J Q, et al. Informer: beyond efficient transformer for long sequence time-series forecasting[J]. Proceedings of the AAAI Conference on Artificial Intelligence, 2021, 35(12): 11106-11115.
Many real-world applications require the prediction of long sequence time-series, such as electricity consumption planning. Long sequence time-series forecasting (LSTF) demands a high prediction capacity of the model, which is the ability to capture precise long-range dependency coupling between output and input efficiently. Recent studies have shown the potential of Transformer to increase the prediction capacity. However, there are several severe issues with Transformer that prevent it from being directly applicable to LSTF, including quadratic time complexity, high memory usage, and inherent limitation of the encoder-decoder architecture. To address these issues, we design an efficient transformer-based model for LSTF, named Informer, with three distinctive characteristics: (i) a ProbSparse self-attention mechanism, which achieves O(L log L) in time complexity and memory usage, and has comparable performance on sequences' dependency alignment. (ii) the self-attention distilling highlights dominating attention by halving cascading layer input, and efficiently handles extreme long input sequences. (iii) the generative style decoder, while conceptually simple, predicts the long time-series sequences at one forward operation rather than a step-by-step way, which drastically improves the inference speed of long-sequence predictions. Extensive experiments on four large-scale datasets demonstrate that Informer significantly outperforms existing methods and provides a new solution to the LSTF problem.
[28]
YAN H, DENG B C, LI X N, et al. TENER: adapting transformer encoder for named entity recognition[EB/OL]. [2023-08-10] 2019: arXiv: 1911.04474. http://arxiv.org/abs/1911.04474.pdf.
[29]
Arizona State University. Campus metabolism[EB/OL]. [2023-08-10]. https://cm.asu.edu/.
[30]
National centers for environmental information[EB/OL]. [2023-08-10]. https://www.ncei.noaa.gov/.

Funding

Zhejiang Provincial Natural Science Foundation of China(LGG22F030008)
Key Research and Development Program of Zhejiang Province(2021C01113)
PDF(3311 KB)

Accesses

Citation

Detail

Sections
Recommended

/