PDF(14929 KB)
Resilience Improvement Strategy for the Electrification-Transportation Coupling Network Based on Safe Deep Reinforcement Learning
XU Ding, YANG Qiming, WU Mingming, FU Chaoran, XING Qiang, ZHANG Guoli, WANG Mingshen
Electric Power Construction ›› 2026, Vol. 47 ›› Issue (3) : 24-38.
PDF(14929 KB)
PDF(14929 KB)
Resilience Improvement Strategy for the Electrification-Transportation Coupling Network Based on Safe Deep Reinforcement Learning
[Objective] To address the problems that when large-scale electrification-transportation coupling network (ETCN) encounters sudden resilience faults, traditional schemes have slow generation speed, are difficult to respond to dynamic information interaction in real time, and artificial intelligence algorithms are prone to cause safety accidents such as voltage over-limit due to the lack of security mechanisms in application, this paper proposes a resilience improvement strategy for ETCN based on safe deep reinforcement learning (SDRL). [Methods] First, the paper establishes a two-stage electrification-transportation optimization framework: the first stage prioritizes the protection of high-value loads with minimum reconfiguration cost, while the second stage optimizes electric vehicle (EV) routing with minimum traffic dispatch cost. Second, a hierarchical decision-making model based on a modified Rainbow algorithm is designed. The upper layer outputs the action plan of the power grid interconnection switch and inputs the reconstructed power grid state to the lower layer. The lower layer integrates grid reconfiguration state with real-time traffic information to optimize EV routing selection, with the objective to ensure that EV routing optimization can real-time adapt to the power grid’s recovery needs. In addition, the Lagrange multiplier safety mechanism is embedded, and an objective function with risk penalties is constructed to achieve dynamic penalties for risk behaviors such as voltage over-limit and current over-limit. [Results] Finally, the simulation based on the actual road network in Shanghai and the IEEE123-node distribution network shows that the proposed strategy can significantly enhance the resilience and operational safety of the system in fault scenarios. Compared with the mixed integer programming and particle swarm optimization methods, the method proposed in this paper demonstrates superior comprehensive performance in terms of load recovery rate, recovery speed, voltage stability and strategy security. [Conclusions] This paper verifies the effectiveness of hierarchical safe deep reinforcement learning in improving the resilience of ETCN. This method solves the problem of the separation of electrification-transportation targets through a two-stage architecture, achieving a balanced synergy among computing efficiency, load recovery rate and operational safety.
electrification-transportation coupling network / resilience improvement strategy / safe deep reinforcement learning (SDRL) / hierarchical decision-making model / modified Rainbow algorithm
| [1] |
胡泽春, 邵成成, 何方, 等. 电网与交通网耦合的设施规划与运行优化研究综述及展望[J]. 电力系统自动化, 2022, 46(12): 1-19.
|
| [2] |
刘达夫, 钟剑, 杨祺铭, 等. 基于V2G与应急通信的配电网信息物理协同快速恢复方法[J]. 电力系统自动化, 2024, 48(7): 147-158.
|
| [3] |
嵇涛, 姚炎宏, 黄鲜, 等. 城市交通韧性研究进展及未来发展趋势[J]. 地理科学进展, 2023, 42(5): 1012-1024.
交通韧性是指在极端条件下交通系统能够通过自身抵抗、减缓以及吸收的方式维持其系统基本功能和结构的能力,或者能够在合理的时间和成本内恢复原始平衡或者新平衡状态的能力。受全球增温、海平面上升以及快速城市化的影响,极端事件的风险日益增加,从而导致城市交通运输基础设施运营面临着严峻的挑战。在此背景下,如何衡量极端事件下城市交通韧性强度(包括不同极端天气事件强度对其强度的影响),如何监测其时空分布特征和演变趋势,以及多长时间交通运输系统能够恢复正常状态?针对这些问题,目前还缺乏有效的监测方法,尤其是缺乏气候变化对交通韧性影响的时空动态变化监测。因此,如何精准识别极端事件下城市交通韧性的状态,提升自然灾害交通防治水平亟待解决。而随着大数据挖掘技术和时空预测深度学习方法的发展,为重建城市交通韧性强度时空数据集,进而揭示历史极端事件影响下城市交通韧性强度时空演变特征、变化趋势以及影响机制提供了可能。论文对国内外近50年来交通韧性研究进行了梳理和概括,结合国内外交通韧性的相关研究成果对已有的研究中存在的不足进行了评述;并指出了气候变暖情况下交通韧性研究的重点领域和方向,旨在为今后开展交通韧性研究提供新的思路。
Urban transportation resilience reflects the ability of the transportation system to maintain its basic functions and structure through its resistance, mitigation, and absorption under extreme conditions, or the ability to restore the original equilibrium or reach a new equilibrium state within a reasonable time and with reasonable cost. Global warming, sea-level rise, and rapid urbanization all increase the risk of compound extreme weather events, presenting challenges for the operation of urban-related infrastructure including transportation infrastructure. In this context, some questions become important. For example, how to measure the strength of urban transportation resilience under extreme weather events (including the impact of different extreme weather event intensities on its strength); how to monitor its spatial and temporal features and evolution trends; and how long will it take for the entire system to restore balance? At present, effective monitoring methods for transportation resilience under the influence of extreme events are lacking, especially the monitoring of the temporal and spatial dynamic changes of transportation resilience under climate change, to answer these questions. Therefore, it is urgently needed to solve the problem of accurately identifying the state of urban transportation resilience under extreme weather events and improving the level of prevention and control of transportation system impact of natural hazard-related disasters. The development of big data mining technology and deep learning methods for spatiotemporal prediction made the construction of spatiotemporal datasets for evaluating and predicting urban transportation resilience possible. Such datasets can reveal the spatiotemporal evolution features, changing trends of urban transportation resilience intensity under the influence of extreme weather events, as well as the mechanism of influence. It indicates the key research areas that should be focused on for transportation resilience under climate warming. This article reviewed and summarized the research on transportation resilience in China and internationally in the past 50 years, analyzed the deficiencies in the existing research based on the relevant research results of transportation resilience in China and globally, and identified the key areas and directions of the research on transportation resilience under climate warming in order to provide new ideas for future research on transportation resilience. |
| [4] |
杨祺铭, 李更丰, 别朝红, 等. 计及间歇性新能源的弹性城市电网输配电协同供电恢复方法[J]. 高电压技术, 2023, 49(7): 2764-2774.
|
| [5] |
王治然, 杨祺铭, 黄玉雄, 等. 考虑动态互联微电网与网络重构的弹性配电网多源序贯协同供电恢复方法[J]. 电力建设, 2025, 46(9): 13-26.
|
| [6] |
杨祺铭, 李更丰, 别朝红, 等. 台风灾害下基于V2G的城市配电网弹性提升策略[J]. 电力系统自动化, 2022, 46(12): 130-139.
|
| [7] |
刘文泽, 陈珂瑶, 成润婷, 等. 面向韧性提升的主动配电网灵活调度与故障修复协同策略[J]. 电力建设, 2025, 46(11): 10-23.
|
| [8] |
谢宇峥, 章德, 杨祺铭, 等. 台风灾害下考虑修复不确定性和V2G的弹性城市电网动态供电恢复方法[J]. 电网与清洁能源, 2024, 40(6): 107-114.
|
| [9] |
曹正东. 含分布式电源的配电网网络重构方法研究[D]. 南昌: 南昌大学, 2024.
|
| [10] |
马天祥, 程肖, 贾伯岩, 等. 基于不确定二层规划模型的主动配电网故障恢复方法[J]. 电力系统保护与控制, 2019, 47(6): 48-57.
|
| [11] |
王晗, 汤迪霏, 旷嘉庆, 等. 寒潮下基于智能导航的电动汽车充电网络韧性提升[J]. 电力工程技术, 2025, 44(6): 73-83.
|
| [12] |
杨锡运, 朱江, 赵泽宇, 等. 考虑路网耦合下的低温电动汽车充电站规划[J]. 电力工程技术, 2025, 44(6): 62-72.
|
| [13] |
田书欣, 苏鹏斌, 赵昊星, 等. 冰灾场景下考虑无人机应用的综合能源系统韧性提升方法[J]. 浙江电力, 2025, 44(11): 1-13.
|
| [14] |
麻灿皓, 陈丽娟, 吴志. 考虑多元灵活性资源协同的配电网韧性提升策略[J]. 电力工程技术, 2025, 44(1): 115-125.
|
| [15] |
郝子霖, 于华楠, 冷贤达, 等. 基于电动汽车激励策略的主动配电网日前优化调度[J]. 电网与清洁能源, 2024, 40(11): 129-137.
|
| [16] |
宣羿, 樊立波, 孙智卿, 等. 考虑低碳交通的电动汽车充电站优化配置方法[J]. 浙江电力, 2024, 43(6): 69-79.
|
| [17] |
陈业夫, 王钦, 蔡新雷, 等. 计及规模化电动汽车调控潜力的含风电系统优化调度策略[J]. 浙江电力, 2024, 43(4): 95-104.
|
| [18] |
刘子裕, 刘达夫, 杨祺铭, 等. 风涝复合灾害下配电网恢复资源灾前部署及灾后调度方法[J]. 电力系统自动化, 2025, 49(17): 154-164.
|
| [19] |
杨心贺, 孙亮, 王伟镪, 等. 考虑动态交通网络的区域电-气互联系统灾后故障抢修策略[J]. 东北电力大学学报, 2024, 44(4): 94-104.
|
| [20] |
谢敏, 谢宇星, 董凯元, 等. 应急电源车派遣联合网络重构的电网故障预案[J]. 电网技术, 2025, 49(7): 3031-3041.
|
| [21] |
李泽宁, 孙宏斌, 薛屹洵, 等. 计及需求侧资源的电力-交通系统协同负荷恢复随机优化方法: 以建筑用能为例[J]. 中国电机工程学报, 2025, 45(20): 8024-8039.
|
| [22] |
|
| [23] |
潘凯岩, 刘宏达, 赵瑞锋. 极端自然灾害下新型配电系统韧性提升技术综述与展望[J/OL]. 电力系统自动化, 2025: 1-18. (2025-07-18)[2025-09-20]. https://link.cnki.net/urlid/32.1180.TP.20250718.0926.002.
|
| [24] |
陈磊, 邓欣怡, 陈红坤, 等. 电力系统韧性评估与提升研究综述[J]. 电力系统保护与控制, 2022, 50(13): 11-22.
|
| [25] |
颜心斐, 钟海旺, 朱灏翔, 等. 基于系统约束诱导割平面的机组组合加速求解算法[J]. 电网技术, 2025, 49(3): 1155-1165.
|
| [26] |
徐潇源, 李佳琪, 王晗, 等. 城市电力-交通系统韧性研究综述及展望[J]. 电力系统自动化, 2024, 48(23): 1-15.
|
| [27] |
王红斌, 方健, 何嘉兴, 等. 极端灾害下配电网韧性研究综述[J]. 供用电, 2019, 36(7): 20-29.
|
| [28] |
In the context of large-scale grid connection of distributed energy, during the reconfiguration of the distribution network, the availability of distributed energy and the load of the distribution system may be inconsistent with the prediction due to the influence of environmental factors and human factors. If the distribution network reconfiguration is still carried out according to the expected offline optimization scheme, there may be reliability problems of voltage over-limits and economic problems of increased network loss in the actual reconfiguration process. Therefore, the reconfiguration plan formulated in advance can give some guidance to the dispatch operator, but it may not be directly used in the actual reconfiguration process. This paper proposes a deep reinforcement learning approach to solving the electric distribution network reconfiguration. Based on the uncertainty of distributed energy output and network load in the distribution network, the online algorithm of distribution network reconfiguration realizes the second-level solution of distribution network reconfiguration, through day-ahead training of the neural network.
|
| [29] |
董雷, 吴怡, 张涛, 等. 基于强化学习的含智能软开关主动配电网双层优化方法[J]. 电力系统自动化, 2023, 47(6): 59-68.
|
| [30] |
|
| [31] |
|
| [32] |
张建宏, 赵兴勇, 王秀丽. 考虑奖励机制的电动汽车充电优化引导策略[J]. 电网与清洁能源, 2024, 40(1): 102-108, 118.
|
| [33] |
王冲, 石大夯, 万灿, 等. 基于多智能体深度强化学习的随机事件驱动故障恢复策略[J]. 电力自动化设备, 2025, 45(3): 186-193.
|
| [34] |
徐何军. 基于图神经网络的配电网故障诊断及重构优化研究[D]. 武汉: 华中科技大学, 2020.
|
| [35] |
|
| [36] |
|
| [37] |
周政, 杨祺铭, 卞艺衡, 等. “车-商-网”模式下面向配网弹性提升的分布式车网协同应急供电策略[J/OL]. 高电压技术, 2025: 1-23. (2025-07-23)[2025-09-20]. https://doi.org/10.13336/j.1003-6520.hve.20250642.
|
| [38] |
李明昊, 杨祺铭, 李更丰, 等. 台风场景下基于多种分布式资源协同的弹性配电网两阶段供电恢复策略[J]. 高电压技术, 2024, 50(1): 93-104.
|
| [39] |
|
| [40] |
|
| [41] |
|
| [42] |
|
| [43] |
|
/
| 〈 |
|
〉 |