PDF(2003 KB)
Multi-Agent Interaction-Based Data Augmentation for Intelligent Pricing Strategies at Charging Stations
ZHOU Ruiao, XU Xiao, XU Lixiong, LIU Youbo, SHANG Yuwei, BAI Shuaitao, LIU Junyong
Electric Power Construction ›› 2026, Vol. 47 ›› Issue (10) : 151-165.
PDF(2003 KB)
PDF(2003 KB)
Multi-Agent Interaction-Based Data Augmentation for Intelligent Pricing Strategies at Charging Stations
[Objective] To address complex interactions and scarce training samples in collaborative pricing among multiple charging stations under large-scale random EV access, this paper proposes a method integrating Transformer-based DDPM data augmentation with multi-agent deep reinforcement learning to expand the sample space for pricing policy learning under complex conditions and optimize multi-agent collaborative pricing strategies. [Methods] A Transformer-based denoising diffusion probabilistic model (DDPM) is first designed. By employing a sparse attention mechanism to capture spatiotemporal characteristics of charging stations and combining Top-k selection with Softmax sampling, the model reconstructs and augments a physically consistent interaction sample space conditioned on historical prices, demand, and temporal features. Then, an interactive environment considering EV spatiotemporal distribution and network constraints is constructed, and a multi-agent deep deterministic policy gradient (MADDPG) algorithm trains collaborative pricing strategies on the augmented set. [Results] Simulation results show the proposed method effectively guides the rational spatiotemporal distribution of charging loads, enhances station revenue and service quality while ensuring distribution network safety. The Transformer-based sample augmentation method significantly expands the sample space for pricing learning and strengthens the strategy’s adaptability to complex interactions. [Conclusions] The proposed approach achieves coordinated optimization among distribution network security, station profitability, and user experience, offering a novel pathway for intelligent multi-agent collaborative pricing in the EV charging market.
electric vehicles / charging stations / denoising diffusion probabilistic model / sparse attention mechanism / deep reinforcement learning
| [1] |
张琳娟, 李文峰, 许长清, 等. 计及充电排队与实时SOC的电动汽车充电负荷时空分布预测[J]. 电力建设, 2025(8): 54-66.
|
| [2] |
国家发展改革委等部门:到2027年年底, 在全国范围内建成2800万个充电设施[J]. 汽车与配件, 2025,(20):13.
|
| [3] |
王炜歆, 张露元, 王小君, 等. 计及电动汽车引导和网络重构的配电网负荷恢复策略[J]. 山东电力技术, 2024, 51(8): 18-26.
|
| [4] |
徐婷婷, 龙羿, 胡晓锐, 等. “车-路-网” 耦合下含多类型充电桩协同的充电站规划[J]. 电力建设, 2025, 46(7): 95-107.
|
| [5] |
|
| [6] |
李英量, 白博旭, 朱琦, 等. 基于电动汽车充电站的不平衡配电网自愈及优化运行[J]. 电力建设, 2024, 45(6): 37-46.
分布式电源和电动汽车大量接入配电网,打破了配电网的三相平衡状态,致使传统的配电网保护方案无法适应时代的发展需求。为此,在现有平衡系统故障恢复策略的基础上,提出了一种基于电动汽车充电站的不平衡配电网灾后两阶段故障恢复策略。第一阶段以故障恢复成本最小为目标确定故障后的孤岛运行方案。第二阶段综合考虑电动汽车充电站及各分布式电源机组的折旧、运维、弃负荷惩罚等成本,以配电网运行收益最大为目标建立协同优化模型,以确定故障时各充电站出力情况。最后通过改进的IEEE 33节点系统验证所提两阶段故障自愈模型及优化运行策略的有效性。结果表明,所提方法较传统的孤岛划分法弃负荷率更低,为解决不平衡配电网的故障恢复问题提供了新思路。
The three-phase equilibrium state of a distribution network is broken owing to the large number of distributed power sources and electric vehicles connected to the distribution network, resulting in the traditional distribution network protection scheme illegally adapting to current development needs. Therefore, this study presents a two-stage fault recovery method for imbalanced distribution networks based on electric vehicle charging stations using an existing balancing system fault recovery technique. The island operation strategy after the fault is determined in the first stage to reduce the fault-recovery cost. In the second stage, a collaborative optimization model is established to determine the output of each charging station when a fault occurs, with the goal of maximizing the operating income of the distribution network, considering the cost of depreciation, operation and maintenance, and the load abandonment penalty of electric vehicle charging stations and distributed generation units. Finally, the enhanced IEEE 33 node system validates the effectiveness of the two-stage fault self-healing model and the optimal operating method suggested in this study. The results reveal that the proposed technique has a lower load rejection rate than the classic island division method, thereby providing a novel solution to the fault-recovery problem of an imbalanced distribution network.
|
| [7] |
|
| [8] |
|
| [9] |
|
| [10] |
|
| [11] |
王长春, 王果, 赵倩宇, 等. 考虑分时电价和充电利用率特征的大型电动汽车充电站负荷短期预测方法[J]. 南方电网技术, 2024, 18(5): 75-84.
考虑分时电价和充电利用率特征对电动汽车充电站负荷的影响,提出了融合长短记忆网络和支持向量回归(long short-term memory-support vector regression, LSTM-SVR)的大型电动汽车充电站负荷短期预测方法。首先,建立了分时电价、充电利用率、气象信息等影响充电负荷的因素以及历史充电负荷功率数据作为输入的特征矩阵。其次,运用自适应噪声完备经验模态分解(complete ensemble empirical mode decomposition with adaptive noise,CEEMDAN)方法将包含分时电价和充电利用率的特征矩阵序列进行分解,扩充了数据多样性,并采用组合相关系数方法实现了数据降维和特征选择。然后采用北方苍鹰优化(northern goshawk optimization, NGO)算法分别优化LSTM和SVR的超参数,求解权重系数并构建融合LSTM-SVR模型。最后采用某城市一座大型充电站数据进行验证,对比实验表明,考虑分时电价和充电利用率特征可有效提高电动汽车充电站负荷预测精度8%以上,同时采用所提出的融合LSTM-SVR预测方法能使预测精度进一步提高。
Considering the impact of time-of-use electricity pricing and charging utilization characteristics on the load of electric vehicle charging stations, a short-term load forecasting method is proposed for large scale electric vehicle charging stations that integrates long short-term memory and support vector regression (LSTM-SVR). Firstly, a feature matrix is constructed that includes factors influencing the charging load such as time-of-use electricity pricing, charging utilization rates, meteorological information, and historical data on charging load power. Secondly, the complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) method is applied to decompose sequences of the feature matrix containing time-of-use electricity pricing and charging utilization rates, which enhances data diversity. This process also employs a combined correlation coefficient method for data reduction and feature selection. Subsequently, the northern goshawk optimization (NGO) algorithm is used to optimize the hyperparameters of both LSTM and SVR, solving for weight coefficients and constructing the integrated LSTM-SVR model. Finally, the model is validated using data from a large scale charging station in a specific city. Comparative experiments demonstrate that considering time-of-use electricity pricing and charging utilization features can effectively improve the accuracy of electric vehicle charging station load forecasting by over 8%. Moreover, the proposed LSTM-SVR forecasting method further enhances prediction accuracy. |
| [12] |
|
| [13] |
|
| [14] |
|
| [15] |
刘润龙, 李亦言, 周正昊, 等. 考虑用户行为基于扩散模型的电动汽车充电场景生成[J]. 电力系统自动化, 2026, 50(3): 135-144.
|
| [16] |
苏大威, 范旖晖, 赵天辉, 等. 基于价格激励的城市公共充电站填谷潜力评估[J]. 中国电力, 2025, 58(4): 131-139.
|
| [17] |
江建, 张树森, 徐峰亮. 考虑电动汽车集群响应的分布式资源协同调度策略研究[J]. 山东电力技术, 2024, 51(6): 1-11, 35.
|
| [18] |
林湘宁, 王伟名, 随权, 等. 主动配电网-充换电站群-智慧社区群分层优化调度策略[J]. 广东电力, 2024, 37(10): 25-37.
|
| [19] |
马永翔, 韩子悦, 闫群民, 等. 考虑电动汽车充电负荷及储能寿命的充电站储能容量配置优化[J]. 电网与清洁能源, 2024, 40(4): 92-101.
|
| [20] |
赵子鋆, 胡湘伟, 邓亚芝, 等. 考虑电动汽车充电与常规负荷时空相关性的配电网可开放容量评估[J]. 全球能源互联网, 2024, 7(3): 283-291.
|
| [21] |
|
| [22] |
张延宇, 饶新朋, 周书奎, 等. 基于深度强化学习的电动汽车充电调度算法研究进展[J]. 电力系统保护与控制, 2022, 50(16): 179-187.
|
| [23] |
喻磊, 谈竹奎, 王扬, 等. 基于深度强化学习的电动汽车有序充电优化方法[J]. 南方电网技术, 2024, 18(12): 148-155.
针对大规模电动汽车无序接入电网引发的用户充电开销大和电网负荷波动加剧等问题,提出了基于深度强化学习(deep reinforcement learning,DRL)的电动汽车充电行为优化方法。首先,以最小化电网负荷波动和用户充电费用为目标,建立了电动汽车有序充电优化调度模型。其次,将电动汽车的充电行为构建为马尔科夫决策过程(Markov decision process,MDP),根据电网负荷预测信息和分时电价对充电时段进行优先级评定,并根据优先级控制电动汽车充电行为。通过双延迟深度确定性策略梯度(twin delayed deep deterministic policy gradient,TD3)算法对电动汽车有序充电策略进行快速优化。最后,通过算例验证了所提方法在减少用户的充电开销和配电网的负荷波动方面的有效性。
The large-scale disordered integration of electric vehicles (EVs) into power grid poses many problems, such as enlarged power fluctuation for grid and increased charging cost for users. To solve these problems, this paper proposes an optimized EV charging method based on deep reinforcement learning (DRL). Firstly, an EV ordered charging scheduling model is established aiming at minimizing the power fluctuation and user charging cost. Secondly, the EV charging behaviour is formulated as a Markov decision process (MDP) which evaluates the priority for each charging period based on load prediction information and time-of-use electricity tariff. The charging behaviour of EVs is controlled by the priority. The twin delayed deep deterministic policy gradient (TD3) algorithm is adopted to solve the MDP problem, which quickly optimizes EV ordered charging strategy. Finally, the effectivenesses of the proposed method in reducing charging cost and load fluctuation of distribution network are verified by case studies based on numerical examples. |
| [24] |
|
| [25] |
胡维昊, 曹迪, 黄琦, 等. 深度强化学习在配电网优化运行中的应用[J]. 电力系统自动化, 2023, 47(14): 174-191.
|
| [26] |
|
| [27] |
刘俊峰, 陈剑龙, 王晓生, 等. 基于深度强化学习的微能源网能量管理与优化策略研究[J]. 电网技术, 2020, 44(10): 3794-3803.
|
| [28] |
|
| [29] |
|
| [30] |
This paper develops a model-free volt-VAR optimization (VVO) algorithm via multi-agent deep reinforcement learning (DRL) in unbalanced distribution systems. This method is novel since we cast the VVO problem in distribution networks to an intelligent deep Q-network (DQN) framework, which avoids solving a specific optimization model directly when facing time-varying operating conditions in the systems. We consider statuses/ratios of switchable capacitors, voltage regulators, and smart inverters installed at distributed generators as the action variables of the agents. A delicately designed reward function guides these agents to interact with the distribution system, in the direction of reinforcing voltage regulation and power loss reduction simultaneously. The forward-backward sweep method for radial three-phase distribution systems provides accurate power flow results within a few iterations to the DRL environment. The proposed method realizes the dual goals for VVO. We test this algorithm on the unbalanced IEEE 13-bus and 123-bus systems. Numerical simulations validate the excellent performance of this method in voltage regulation and power loss reduction.
|
| [31] |
|
| [32] |
李玉璟, 李泽宁, 郝军强. 基于多智能体深度强化学习的充电站实时协调定价方法[J]. 电力系统自动化, 2026, 50(3): 125-134.
|
| [33] |
|
| [34] |
薛彤丹, 王红, 齐林海, 等. 基于改进扩散模型的电力数据超分辨率重建技术[J]. 电力系统自动化, 2025, 49(4): 214-223.
|
| [35] |
|
| [36] |
|
| [37] |
王强, 毕宇豪, 高超, 等. 融合多方信息的电动汽车充电负荷时空分布预测[J]. 电力建设, 2025, 46(6): 24-37.
|
| [38] |
|
| [39] |
褚文超, 李英俊. 基于Dijkstra算法的混联配电网故障区段定位方法[J]. 电网与清洁能源, 2021, 37(11): 25-30.
|
| [40] |
|
| [41] |
刘维民, 肖辉, 曾林俊, 等. 考虑电动汽车充电模式和供需灵活性的综合能源系统优化调度[J]. 电力建设, 2025, 46(6): 1-12.
|
| [42] |
|
| [43] |
|
| [44] |
|
| [45] |
|
| [46] |
|
| [47] |
陈锦韬, 林兵, 林崧, 等. 基于多智能体深度强化学习的光储充电站动态定价及能源调度策略[J]. 计算机科学, 2025, 52(9): 337-345.
|
利益冲突声明(Conflict of Interests): 所有作者声明不存在利益冲突。
作者贡献声明(Authors’ Contributions): 周瑞翱完成论文写作,许潇提出研究方向,许立雄设计研究思路,刘友波提出基本框架,尚宇炜进行论文修订,白帅涛开展文献调研,刘俊勇参与论文审核。所有作者均阅读并同意了论文终稿内容。
/
| 〈 |
|
〉 |