PDF(3311 KB)
Short-term Forecasting of Multienergy Loads of Integrated Energy System Based on Multihead Probabilistic Sparse Self-attention Model
HAN Baohui, LU Lingxia, BAO Zhejing, YU Miao
Electric Power Construction ›› 2024, Vol. 45 ›› Issue (2) : 127-136.
PDF(3311 KB)
PDF(3311 KB)
Short-term Forecasting of Multienergy Loads of Integrated Energy System Based on Multihead Probabilistic Sparse Self-attention Model
Accurate short-term forecasting of multienergy loads is the basis for the dispatch and operation of integrated energy systems. There is a strong coupling between multiple loads in an integrated energy system, and the existing single load forecasting is challenging to explore the complex internal relationship between multiple loads. Therefore, a short-term forecasting method for multienergy loads based on a multihead probabilistic sparse self-attention (MPSS) model was proposed. First, the Pearson correlation coefficient was used to analyze the correlation between multiple loads, the coupling features between multiple loads were extracted, a multihead probabilistic sparse self-attention mechanism with improved location coding was used to learn the dependencies of long-sequence inputs, and the parameter soft sharing mechanism of multivariate prediction tasks was adopted. The sharing mechanism realizes the joint prediction of multiple loads through a differentiated selection of shared features using different subtasks. Finally, the performance of the proposed model was verified using the multiple-load dataset of the Tempe Campus of Arizona State University. Compared with other forecasting models, the results show that the proposed multivariate load forecasting method can effectively improve forecasting accuracy.
integrated energy system / multienergy load forecasting / multihead probabilistic sparse self-attention model / location coding
| [1] |
曾鸣, 刘英新, 周鹏程, 等. 综合能源系统建模及效益评价体系综述与展望[J]. 电网技术, 2018, 42(6): 1697-1708.
|
| [2] |
艾芊, 郝然. 多能互补、集成优化能源系统关键技术及挑战[J]. 电力系统自动化, 2018, 42(4): 2-10, 46.
|
| [3] |
别朝红, 王旭, 胡源. 能源互联网规划研究综述及展望[J]. 中国电机工程学报, 2017, 37(22): 6445-6462, 6757.
|
| [4] |
Nowadays electricity load forecasting is important to further minimize the cost of day-ahead energy market. Load forecasting can help utility operators for the efficient management of a demand response program. Forecasting of electricity load demand with higher accuracy and efficiency can help utility operators to design reasonable operational planning of generation units. But solving the problem of load forecasting is a challenging task since electricity load is affected by previous history load, several exogenous external factors (i.e., weather variables, social variables, working day or holiday), time of day, and season of the year. To solve the problem of short-term load forecasting (STLF) and further improve the forecasting accuracy, in this paper we have proposed a novel hybrid STLF model with a new signal decomposition and correlation analysis technique. To this end, load demand time series is decomposed into some regular low frequency components using improved empirical mode decomposition (IEMD). To compensate for the information loss during signal decomposition, we have incorporated the effect of exogenous variables by performing correlation analysis using T-Copula. From the T-Copula analysis, peak load indicative binary variable is derived from value at risk (VaR) to improve the load forecasting accuracy during peak time. The data obtained from IEMD and T-Copula is applied to deep belief network for predicting the future load demand of specific time. The proposed data driven method is validated on real time data from the Australia and the United States of America. The performance of proposed load forecasting model is evaluated in terms of mean absolute percentage error (MAPE) & root mean square error (RMSE). Simulation results verify that, the proposed model provides a significant decrease in MAPE and RMSE values compared to traditional empirical mode decomposition based electricity load forecasting.
|
| [5] |
|
| [6] |
|
| [7] |
魏步晗, 鲍刚, 李振华. 基于支持向量回归预测模型考虑天气因素和分时电价因素的短期电力负荷预测[J]. 电网与清洁能源, 2023, 39(11): 9-19.
|
| [8] |
|
| [9] |
刘文杰, 刘禾, 王英男, 等. 基于完整自适应噪声集成经验模态分解的LSTM-Attention网络短期电力负荷预测方法[J]. 电力建设, 2022, 43(2): 98-108.
短期电力负荷预测在电网安全运行和制定合理调度计划方面发挥着重要作用。为了提高电力负荷时间序列预测的准确度,提出了一种由完整自适应噪声集成经验模态分解(complete ensemble empirical mode decomposition with adaptive noise, CEEMDAN)和基于注意力机制的长短期记忆神经网络(long short-term memory network based on attention mechanism, LSTM-Attention)相结合的短期电力负荷预测模型。完整自适应噪声集成经验模态分解有效地将负荷时间序列分解成多个层次规律平稳的本征模态分量,并通过神经网络模型预测极大值,结合镜像延拓方法抑制边界效应,提高分解精度,同时基于注意力机制的长短期记忆神经网络自适应地提取电力负荷数据输入特征并分配权重进行预测,最后各预测模态分量叠加重构后获得最终预测结果。通过不同实际电力负荷季节数据分别进行实验,并与其他电力负荷预测模型结果分析进行比较,验证了该预测方法在电力负荷预测精度方面具有更好的性能。
Short-term power load forecasting plays an important role in the safe operation of power grid and the formulation of reasonable dispatching plan. In order to improve the accuracy of power load time-series forecasting, a short-term power load forecasting model based on complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) and short-term memory neural network based on attention mechanism (LSTM-Attention) is proposed in this paper. The complete ensemble empirical mode decomposition with adaptive noise effectively decomposes the load time series into multiple levels of regular and stable eigenmode components, and suppresses the boundary effect through the neural network model prediction maximum combined with the image continuation method to improve the decomposition accuracy. At the same time, the long short-term memory neural network based on attention mechanism adaptively extracts the input characteristics of power load data and assigns weights for prediction. Finally, the final prediction results are obtained after superposition and reconstruction of each prediction modal component. Experiments are carried out on different seasonal data of actual power load, and the results of other power load forecasting models are analyzed and compared to verify that the forecasting method has better performance in power load forecasting accuracy. |
| [10] |
曾囿钧, 肖先勇, 徐方维, 等. 基于CNN-BiGRU-NN模型的短期负荷预测方法[J]. 中国电力, 2021, 54(9): 17-23.
|
| [11] |
任建吉, 位慧慧, 邹卓霖, 等. 基于CNN-BiLSTM-Attention的超短期电力负荷预测[J]. 电力系统保护与控制, 2022, 50(8): 108-116.
|
| [12] |
庄家懿, 杨国华, 郑豪丰, 等. 基于多模型融合的CNN-LSTM-XGBoost短期电力负荷预测方法[J]. 中国电力, 2021, 54(5): 46-55.
|
| [13] |
|
| [14] |
|
| [15] |
|
| [16] |
赵峰, 孙波, 张承慧. 基于多变量相空间重构和卡尔曼滤波的冷热电联供系统负荷预测方法[J]. 中国电机工程学报, 2016, 36(2): 399-406.
|
| [17] |
|
| [18] |
朱刘柱, 王绪利, 马静, 等. 基于小波包分解与循环神经网络的综合能源系统短期负荷预测[J]. 电力建设, 2020, 41(12): 131-138.
|
| [19] |
|
| [20] |
|
| [21] |
|
| [22] |
孙庆凯, 王小君, 张义志, 等. 基于LSTM和多任务学习的综合能源系统多元负荷预测[J]. 电力系统自动化, 2021, 45(5): 63-70.
|
| [23] |
王琛, 王颖, 郑涛, 等. 基于ResNet-LSTM网络和注意力机制的综合能源系统多元负荷预测[J]. 电工技术学报, 2022, 37(7): 1789-1799.
|
| [24] |
侯健敏, 孟莹, 李志, 等. 基于综合相关性指标与SA-BiGRU的综合能源系统多元负荷预测[J/OL]. 电力建设: 1-11 [2023-12-28]. http://kns.cnki.net/kcms/detail/11.2583.TM.20231031.1351.006.html.
|
| [25] |
|
| [26] |
|
| [27] |
Many real-world applications require the prediction of long sequence time-series, such as electricity consumption planning. Long sequence time-series forecasting (LSTF) demands a high prediction capacity of the model, which is the ability to capture precise long-range dependency coupling between output and input efficiently. Recent studies have shown the potential of Transformer to increase the prediction capacity. However, there are several severe issues with Transformer that prevent it from being directly applicable to LSTF, including quadratic time complexity, high memory usage, and inherent limitation of the encoder-decoder architecture. To address these issues, we design an efficient transformer-based model for LSTF, named Informer, with three distinctive characteristics: (i) a ProbSparse self-attention mechanism, which achieves O(L log L) in time complexity and memory usage, and has comparable performance on sequences' dependency alignment. (ii) the self-attention distilling highlights dominating attention by halving cascading layer input, and efficiently handles extreme long input sequences. (iii) the generative style decoder, while conceptually simple, predicts the long time-series sequences at one forward operation rather than a step-by-step way, which drastically improves the inference speed of long-sequence predictions. Extensive experiments on four large-scale datasets demonstrate that Informer significantly outperforms existing methods and provides a new solution to the LSTF problem.
|
| [28] |
|
| [29] |
Arizona State University. Campus metabolism[EB/OL]. [2023-08-10]. https://cm.asu.edu/.
|
| [30] |
National centers for environmental information[EB/OL]. [2023-08-10]. https://www.ncei.noaa.gov/.
|
/
| 〈 |
|
〉 |