%0 Journal Article %A MAO Xiaobo %A PEI Wei %A PU Xiaowei %A XIAO Hao %A XUE Mingfeng %T A Novel Energy Management Method Based on Modified Deep Q Network Algorithm for Multi-park Integrated Energy System %D 2022 %R 10.12204/j.issn.1000-7229.2022.12.009 %J ELECTRIC POWER CONSTRUCTION %P 83-93 %V 43 %N 12 %X

Multi-park integrated energy system can significantly improve the operation economy by complementing each other with multiple energy sources. However, the complex interactions between parks and multi-energy coupling decisions can bring challenging problems such as large decision space and difficult convergence of algorithms to the energy management of multi-park integrated energy system. To solve the above problems, an energy management method based on modified deep Q network (MDQN) algorithm for multi-park integrated energy systems is proposed. Firstly, the external meteorological data and historical interactive power data independent of the park are used to construct a long short-term memory (LSTM) deep network-based external interactive environmental equivalence model for each park integrated energy system, which reduces the computational complexity of the reinforcement learning reward function. Secondly, an improved DQN algorithm based on k-first sampling strategy is proposed to replace the greedy strategy with k-first sampling strategy to overcome the inefficiency of exploration in large-scale action spaces. Finally, the results are validated in an algorithm containing three integrated energy systems in the park, and show that the MDQN algorithm has better convergence and stability compared with the original DQN algorithm, while it can improve the economic efficiency of the park by 29.16%.

%U https://www.cepc.com.cn/EN/10.12204/j.issn.1000-7229.2022.12.009