Multi-Agent Interaction-Based Data Augmentation for Intelligent Pricing Strategies at Charging Stations

ZHOU Ruiao, XU Xiao, XU Lixiong, LIU Youbo, SHANG Yuwei, BAI Shuaitao, LIU Junyong

Electric Power Construction ›› 2026, Vol. 47 ›› Issue (10) : 151-165.

PDF(2003 KB)
PDF(2003 KB)
Electric Power Construction ›› 2026, Vol. 47 ›› Issue (10) : 151-165. DOI: 10.12204/j.issn.1000-7229.2026.10.012
Power Economics

Multi-Agent Interaction-Based Data Augmentation for Intelligent Pricing Strategies at Charging Stations

Author information +
History +

Abstract

[Objective] To address complex interactions and scarce training samples in collaborative pricing among multiple charging stations under large-scale random EV access, this paper proposes a method integrating Transformer-based DDPM data augmentation with multi-agent deep reinforcement learning to expand the sample space for pricing policy learning under complex conditions and optimize multi-agent collaborative pricing strategies. [Methods] A Transformer-based denoising diffusion probabilistic model (DDPM) is first designed. By employing a sparse attention mechanism to capture spatiotemporal characteristics of charging stations and combining Top-k selection with Softmax sampling, the model reconstructs and augments a physically consistent interaction sample space conditioned on historical prices, demand, and temporal features. Then, an interactive environment considering EV spatiotemporal distribution and network constraints is constructed, and a multi-agent deep deterministic policy gradient (MADDPG) algorithm trains collaborative pricing strategies on the augmented set. [Results] Simulation results show the proposed method effectively guides the rational spatiotemporal distribution of charging loads, enhances station revenue and service quality while ensuring distribution network safety. The Transformer-based sample augmentation method significantly expands the sample space for pricing learning and strengthens the strategy’s adaptability to complex interactions. [Conclusions] The proposed approach achieves coordinated optimization among distribution network security, station profitability, and user experience, offering a novel pathway for intelligent multi-agent collaborative pricing in the EV charging market.

Key words

electric vehicles / charging stations / denoising diffusion probabilistic model / sparse attention mechanism / deep reinforcement learning

Cite this article

Download Citations
ZHOU Ruiao , XU Xiao , XU Lixiong , et al . Multi-Agent Interaction-Based Data Augmentation for Intelligent Pricing Strategies at Charging Stations[J]. Electric Power Construction. 2026, 47(10): 151-165 https://doi.org/10.12204/j.issn.1000-7229.2026.10.012

References

[1]
张琳娟, 李文峰, 许长清, 等. 计及充电排队与实时SOC的电动汽车充电负荷时空分布预测[J]. 电力建设, 2025(8): 54-66.
Zhang Linjuan, Li Wenfeng, Xu Changqing, et al. Spatial-temporal distribution prediction of electric vehicle charging load considering charging behavior and real-time SOC[J]. Electric Power Construction, 2025(8): 54-66.
[2]
国家发展改革委等部门:到2027年年底, 在全国范围内建成2800万个充电设施[J]. 汽车与配件, 2025,(20):13.
[3]
王炜歆, 张露元, 王小君, 等. 计及电动汽车引导和网络重构的配电网负荷恢复策略[J]. 山东电力技术, 2024, 51(8): 18-26.
Wang Weixin, Zhang Luyuan, Wang Xiaojun, et al. Load restoration strategy of distribution system considering electric vehicle guiding and network reconfiguration[J]. Shandong Electric Power, 2024, 51(8): 18-26.
[4]
徐婷婷, 龙羿, 胡晓锐, 等. “车-路-网” 耦合下含多类型充电桩协同的充电站规划[J]. 电力建设, 2025, 46(7): 95-107.
Xu Tingting, Long Yi, Hu Xiaorui, et al. A cooperative planning method for multi-type charging pile station based on vehicle-road-network coupling[J]. Electric Power Construction, 2025, 46(7): 95-107.
[5]
Sun L S, Lubkeman D. Agent-based modeling of feeder-level electric vehicle diffusion for distribution planning[J]. IEEE Transactions on Smart Grid, 2021, 12(1): 751-760.
[6]
李英量, 白博旭, 朱琦, 等. 基于电动汽车充电站的不平衡配电网自愈及优化运行[J]. 电力建设, 2024, 45(6): 37-46.
Abstract
分布式电源和电动汽车大量接入配电网,打破了配电网的三相平衡状态,致使传统的配电网保护方案无法适应时代的发展需求。为此,在现有平衡系统故障恢复策略的基础上,提出了一种基于电动汽车充电站的不平衡配电网灾后两阶段故障恢复策略。第一阶段以故障恢复成本最小为目标确定故障后的孤岛运行方案。第二阶段综合考虑电动汽车充电站及各分布式电源机组的折旧、运维、弃负荷惩罚等成本,以配电网运行收益最大为目标建立协同优化模型,以确定故障时各充电站出力情况。最后通过改进的IEEE 33节点系统验证所提两阶段故障自愈模型及优化运行策略的有效性。结果表明,所提方法较传统的孤岛划分法弃负荷率更低,为解决不平衡配电网的故障恢复问题提供了新思路。
Li Yingliang, Bai Boxu, Zhu Qi, et al. Self-healing and optimal operation of unbalanced distribution network based on electric vehicle charging station[J]. Electric Power Construction, 2024, 45(6): 37-46.
 The three-phase equilibrium state of a distribution network is broken owing to the large number of distributed power sources and electric vehicles connected to the distribution network, resulting in the traditional distribution network protection scheme illegally adapting to current development needs. Therefore, this study presents a two-stage fault recovery method for imbalanced distribution networks based on electric vehicle charging stations using an existing balancing system fault recovery technique. The island operation strategy after the fault is determined in the first stage to reduce the fault-recovery cost. In the second stage, a collaborative optimization model is established to determine the output of each charging station when a fault occurs, with the goal of maximizing the operating income of the distribution network, considering the cost of depreciation, operation and maintenance, and the load abandonment penalty of electric vehicle charging stations and distributed generation units. Finally, the enhanced IEEE 33 node system validates the effectiveness of the two-stage fault self-healing model and the optimal operating method suggested in this study. The results reveal that the proposed technique has a lower load rejection rate than the classic island division method, thereby providing a novel solution to the fault-recovery problem of an imbalanced distribution network.
[7]
Sarkar T, Kalita S. ParPER: a partitioned prioritized experience replay in multi-agent setting of reinforcement learning[C]// 2023 5th International Conference on Smart Systems and Inventive Technology (ICSSIT). IEEE, 2023: 932-938.
[8]
Li J H, Zhou J S, Chen B. Review of wind power scenario generation methods for optimal operation of renewable energy systems[J]. Applied Energy, 2020, 280: 115992.
[9]
Jonathan H, Ajay J, Pieter A. PP/OL]. Denoising diffusion probabilistic models.arXiv(2020-06-13)[2026-04-01]https://arxiv.org/abs/2006.11239.
[10]
Yagoda M, Abu-Hussein S, Giryes R. Diffusion models are robust pretrainers[J]. IEEE Signal Processing Letters, 2025, 32: 4219-4223.
[11]
王长春, 王果, 赵倩宇, 等. 考虑分时电价和充电利用率特征的大型电动汽车充电站负荷短期预测方法[J]. 南方电网技术, 2024, 18(5): 75-84.
Abstract
考虑分时电价和充电利用率特征对电动汽车充电站负荷的影响,提出了融合长短记忆网络和支持向量回归(long short-term memory-support vector regression, LSTM-SVR)的大型电动汽车充电站负荷短期预测方法。首先,建立了分时电价、充电利用率、气象信息等影响充电负荷的因素以及历史充电负荷功率数据作为输入的特征矩阵。其次,运用自适应噪声完备经验模态分解(complete ensemble empirical mode decomposition with adaptive noise,CEEMDAN)方法将包含分时电价和充电利用率的特征矩阵序列进行分解,扩充了数据多样性,并采用组合相关系数方法实现了数据降维和特征选择。然后采用北方苍鹰优化(northern goshawk optimization, NGO)算法分别优化LSTM和SVR的超参数,求解权重系数并构建融合LSTM-SVR模型。最后采用某城市一座大型充电站数据进行验证,对比实验表明,考虑分时电价和充电利用率特征可有效提高电动汽车充电站负荷预测精度8%以上,同时采用所提出的融合LSTM-SVR预测方法能使预测精度进一步提高。
Wang Changchun, Wang Guo, Zhao Qianyu, et al. A short-term load forecasting method for large scale electric vehicle charging stations considering characteristics of charging utilization rate and time-of-use electricity price[J]. Southern Power System Technology, 2024, 18(5): 75-84.

Considering the impact of time-of-use electricity pricing and charging utilization characteristics on the load of electric vehicle charging stations, a short-term load forecasting method is proposed for large scale electric vehicle charging stations that integrates long short-term memory and support vector regression (LSTM-SVR). Firstly, a feature matrix is constructed that includes factors influencing the charging load such as time-of-use electricity pricing, charging utilization rates, meteorological information, and historical data on charging load power. Secondly, the complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) method is applied to decompose sequences of the feature matrix containing time-of-use electricity pricing and charging utilization rates, which enhances data diversity. This process also employs a combined correlation coefficient method for data reduction and feature selection. Subsequently, the northern goshawk optimization (NGO) algorithm is used to optimize the hyperparameters of both LSTM and SVR, solving for weight coefficients and constructing the integrated LSTM-SVR model. Finally, the model is validated using data from a large scale charging station in a specific city. Comparative experiments demonstrate that considering time-of-use electricity pricing and charging utilization features can effectively improve the accuracy of electric vehicle charging station load forecasting by over 8%. Moreover, the proposed LSTM-SVR forecasting method further enhances prediction accuracy.

[12]
Yang R Z, Li Y J, Hu C X, et al. ExDiffusion: classifier-guidance diffusion model for extreme load scenario generation with extreme value theory[J]. IEEE Transactions on Smart Grid, 2025, 16(5): 3887-3903.
[13]
Wang Z Y, Zhang H C. Customized load profiles synthesis for electricity customers based on conditional diffusion models[J]. IEEE Transactions on Smart Grid, 2024, 15(4): 4259-4270.
[14]
Huang S Y, Ye C J, Liu S, et al. Data-driven reliability assessment of an electric vehicle penetrated grid utilizing the diffusion estimator and slice sampling[J]. CSEE Journal of Power and Energy Systems, 2023, 9(5): 1845-1853.
[15]
刘润龙, 李亦言, 周正昊, 等. 考虑用户行为基于扩散模型的电动汽车充电场景生成[J]. 电力系统自动化, 2026, 50(3): 135-144.
Liu Runlong, Li Yiyan, Zhou Zhenghao, et al. Diffusion model based electric vehicle charging scenario generation considering user behavior[J]. Automation of Electric Power Systems, 2026, 50(3): 135-144.
[16]
苏大威, 范旖晖, 赵天辉, 等. 基于价格激励的城市公共充电站填谷潜力评估[J]. 中国电力, 2025, 58(4): 131-139.
Su Dawei, Fan Yihui, Zhao Tianhui, et al. Valley-filling potential evaluation of urban public charging stations based on price incentive[J]. Electric Power, 2025, 58(4): 131-139.
[17]
江建, 张树森, 徐峰亮. 考虑电动汽车集群响应的分布式资源协同调度策略研究[J]. 山东电力技术, 2024, 51(6): 1-11, 35.
Jiang Jian, Zhang Shusen, Xu Fengliang. Research on the collaborative dispatch strategy of distributed resources considering the response of electric vehicle cluster[J]. Shandong Electric Power, 2024, 51(6): 1-11, 35.
[18]
林湘宁, 王伟名, 随权, 等. 主动配电网-充换电站群-智慧社区群分层优化调度策略[J]. 广东电力, 2024, 37(10): 25-37.
Lin Xiangning, Wang Weiming, Sui Quan, et al. Hierarchical optimal scheduling strategy for active power distribution network, charging and switching station cluster and smart community cluster[J]. Guangdong Electric Power, 2024, 37(10): 25-37.
[19]
马永翔, 韩子悦, 闫群民, 等. 考虑电动汽车充电负荷及储能寿命的充电站储能容量配置优化[J]. 电网与清洁能源, 2024, 40(4): 92-101.
Ma Yongxiang, Han Ziyue, Yan Qunmin, et al. Optimization of storage capacity allocation at charging stations considering EV charging load and storage lifetime[J]. Power System & Clean Energy, 2024, 40(4): 92-101.
[20]
赵子鋆, 胡湘伟, 邓亚芝, 等. 考虑电动汽车充电与常规负荷时空相关性的配电网可开放容量评估[J]. 全球能源互联网, 2024, 7(3): 283-291.
Zhao Zijun, Hu Xiangwei, Deng Yazhi, et al. Distribution network available capacity evaluation considering the spatiotemporal correlation of electric vehicles charging loads and base loads[J]. Journal of Global Energy Interconnection, 2024, 7(3): 283-291.
[21]
Zhou Z H, Li Y Y, Liu R L, et al. Unsupervised and controllable synthesizing for imbalanced energy dataset based on AC-InfoGAN[J]. Applied Energy, 2025, 393: 126107.
[22]
张延宇, 饶新朋, 周书奎, 等. 基于深度强化学习的电动汽车充电调度算法研究进展[J]. 电力系统保护与控制, 2022, 50(16): 179-187.
Zhang Yanyu, Rao Xinpeng, Zhou Shukui, et al. Research progress of electric vehicle charging scheduling algorithms based on deep reinforcement learning[J]. Power System Protection and Control, 2022, 50(16): 179-187.
[23]
喻磊, 谈竹奎, 王扬, 等. 基于深度强化学习的电动汽车有序充电优化方法[J]. 南方电网技术, 2024, 18(12): 148-155.
Abstract
针对大规模电动汽车无序接入电网引发的用户充电开销大和电网负荷波动加剧等问题,提出了基于深度强化学习(deep reinforcement learning,DRL)的电动汽车充电行为优化方法。首先,以最小化电网负荷波动和用户充电费用为目标,建立了电动汽车有序充电优化调度模型。其次,将电动汽车的充电行为构建为马尔科夫决策过程(Markov decision process,MDP),根据电网负荷预测信息和分时电价对充电时段进行优先级评定,并根据优先级控制电动汽车充电行为。通过双延迟深度确定性策略梯度(twin delayed deep deterministic policy gradient,TD3)算法对电动汽车有序充电策略进行快速优化。最后,通过算例验证了所提方法在减少用户的充电开销和配电网的负荷波动方面的有效性。
Yu Lei, Tan Zhukui, Wang Yang, et al. Deep reinforcement learning based optimization method for ordered charging of electric vehicle[J]. Southern Power System Technology, 2024, 18(12): 148-155.

The large-scale disordered integration of electric vehicles (EVs) into power grid poses many problems, such as enlarged power fluctuation for grid and increased charging cost for users. To solve these problems, this paper proposes an optimized EV charging method based on deep reinforcement learning (DRL). Firstly, an EV ordered charging scheduling model is established aiming at minimizing the power fluctuation and user charging cost. Secondly, the EV charging behaviour is formulated as a Markov decision process (MDP) which evaluates the priority for each charging period based on load prediction information and time-of-use electricity tariff. The charging behaviour of EVs is controlled by the priority. The twin delayed deep deterministic policy gradient (TD3) algorithm is adopted to solve the MDP problem, which quickly optimizes EV ordered charging strategy. Finally, the effectivenesses of the proposed method in reducing charging cost and load fluctuation of distribution network are verified by case studies based on numerical examples.

[24]
Wan Z Q, Li H P, He H B, et al. Model-free real-time EV charging scheduling based on deep reinforcement learning[J]. IEEE Transactions on Smart Grid, 2019, 10(5): 5246-5257.
[25]
胡维昊, 曹迪, 黄琦, 等. 深度强化学习在配电网优化运行中的应用[J]. 电力系统自动化, 2023, 47(14): 174-191.
Hu Weihao, Cao Di, Huang Qi, et al. Application of deep reinforcement learning in optimal operation of distribution network[J]. Automation of Electric Power Systems, 2023, 47(14): 174-191.
[26]
Li S Y, Xiong H, Chen Y Z. DiffCharge: generating EV charging scenarios via a denoising diffusion model[J]. IEEE Transactions on Smart Grid, 2024, 15(4): 3936-3949.
[27]
刘俊峰, 陈剑龙, 王晓生, 等. 基于深度强化学习的微能源网能量管理与优化策略研究[J]. 电网技术, 2020, 44(10): 3794-3803.
Liu Junfeng, Chen Jianlong, Wang Xiaosheng, et al. Energy management and optimization of multi-energy grid based on deep reinforcement learning[J]. Power System Technology, 2020, 44(10): 3794-3803.
[28]
Gan J P, Li S, Lin X K, et al. Multi-agent deep reinforcement learning-based multi-objective cooperative control strategy for hybrid electric vehicles[J]. IEEE Transactions on Vehicular Technology, 2024, 73(8): 11123-11135.
[29]
Lowe R, Wu Y, Tamar A, et al. Multi-agent actor-critic for mixed cooperative-competitive environments[C]// Proceedings of the 31st International Conference on Neural Information Processing Systems. ACM, 2017: 6382-6393.
[30]
Zhang Y, Wang X N, Wang J H, et al. Deep reinforcement learning based volt-VAR optimization in smart distribution systems[J]. IEEE Transactions on Smart Grid, 2021, 12(1): 361-371.
This paper develops a model-free volt-VAR optimization (VVO) algorithm via multi-agent deep reinforcement learning (DRL) in unbalanced distribution systems. This method is novel since we cast the VVO problem in distribution networks to an intelligent deep Q-network (DQN) framework, which avoids solving a specific optimization model directly when facing time-varying operating conditions in the systems. We consider statuses/ratios of switchable capacitors, voltage regulators, and smart inverters installed at distributed generators as the action variables of the agents. A delicately designed reward function guides these agents to interact with the distribution system, in the direction of reinforcing voltage regulation and power loss reduction simultaneously. The forward-backward sweep method for radial three-phase distribution systems provides accurate power flow results within a few iterations to the DRL environment. The proposed method realizes the dual goals for VVO. We test this algorithm on the unbalanced IEEE 13-bus and 123-bus systems. Numerical simulations validate the excellent performance of this method in voltage regulation and power loss reduction.
[31]
Li Y J, Su S, Zhang M H, et al. Multi-agent graph reinforcement learning method for electric vehicle on-route charging guidance in coupled transportation electrification[J]. IEEE Transactions on Sustainable Energy, 2024, 15(2): 1180-1193.
[32]
李玉璟, 李泽宁, 郝军强. 基于多智能体深度强化学习的充电站实时协调定价方法[J]. 电力系统自动化, 2026, 50(3): 125-134.
Li Yujing, Li Zening, Hao Junqiang. Real-time coordinated pricing method for charging stations based on multi-agent deep reinforcement learning[J]. Automation of Electric Power Systems, 2026, 50(3): 125-134.
[33]
Kingma D P, Welling M. Auto-encoding variational Bayes[PP/OL]. arXiv (2022-12-10)[2026-02-20]. https://doi.org/10.48550/arXiv.1312.6114.
[34]
薛彤丹, 王红, 齐林海, 等. 基于改进扩散模型的电力数据超分辨率重建技术[J]. 电力系统自动化, 2025, 49(4): 214-223.
Xue Tongdan, Wang Hong, Qi Linhai, et al. Super-resolution reconstruction technology for power data based on improved diffusion model[J]. Automation of Electric Power Systems, 2025, 49(4): 214-223.
[35]
Oliehoek F A, Amato C. A Concise Introduction to Decentralized POMDPs[M]. Cham: Springer International Publishing, 2016.
[36]
Ling Pan, Longbo Huang, Tengyu Ma,and Huazhe Xu. Plan better amid conservatism: Offline multi-agent reinforcement learning with actor rectification[PP/OL]. arXiv(2022-04-03)[2026-04-01]https://arxiv.org/abs/2111.11188.
[37]
王强, 毕宇豪, 高超, 等. 融合多方信息的电动汽车充电负荷时空分布预测[J]. 电力建设, 2025, 46(6): 24-37.
Wang Qiang, Bi Yuhao, Gao Chao, et al. Prediction of spatiotemporal distribution of electric vehicle charging load based on multi-source information[J]. Electric Power Construction, 2025, 46(6): 24-37.
[38]
Qin J, Ni L L, Zhang L X. The preventive maintenance for transportation network based on network efficiency[C]// 2014 7th International Conference on Intelligent Computation Technology and Automation. IEEE, 2014: 814-816.
[39]
褚文超, 李英俊. 基于Dijkstra算法的混联配电网故障区段定位方法[J]. 电网与清洁能源, 2021, 37(11): 25-30.
Chu Wenchao, Li Yingjun. A fault section location method of hybrid distribution network based on dijkstra algorithm[J]. Power System and Clean Energy, 2021, 37(11): 25-30.
[40]
Tu R, Gai Y J, Farooq B, et al. Electric vehicle charging optimization to minimize marginal greenhouse gas emissions from power generation[J]. Applied Energy, 2020, 277: 115517.
[41]
刘维民, 肖辉, 曾林俊, 等. 考虑电动汽车充电模式和供需灵活性的综合能源系统优化调度[J]. 电力建设, 2025, 46(6): 1-12.
Liu Weimin, Xiao Hui, Zeng Linjun, et al. Optimal scheduling of integrated energy systems considering electric vehicle charging patterns and supply-demand flexibility[J]. Electric Power Construction, 2025, 46(6): 1-12.
[42]
Varshosaz F, Moazzami M, Fani B, et al. Day-ahead capacity estimation and power management of a charging station based on queuing theory[J]. IEEE Transactions on Industrial Informatics, 2019, 15(10): 5561-5574.
[43]
Quan G C, Eryilmaz A, Shroff N B. Minimizing edge caching service costs through regret-optimal online learning[J]. IEEE/ACM Transactions on Networking, 2024, 32(5): 4349-4364.
[44]
Zhang K Q, Yang Z R, Başar T. Multi-agent reinforcement learning: a selective overview of theories and algorithms[M]//Handbook of Reinforcement Learning and Control. Cham Springer International Publishing 2021: 321-384.
[45]
Liu L F, Huang Z, Xu J. Multi-agent deep reinforcement learning based scheduling approach for mobile charging in Internet of electric vehicles[J]. IEEE Transactions on Mobile Computing, 2024, 23(10): 10130-10145.
[46]
Chen G, Sun F, Liang H J, et al. MADDPG-M&L: UAV-assisted joint user association and slicing resource allocation in HetNets[J]. IEEE Transactions on Network Science and Engineering, 2025, 12(4): 2878-2894.
[47]
陈锦韬, 林兵, 林崧, 等. 基于多智能体深度强化学习的光储充电站动态定价及能源调度策略[J]. 计算机科学, 2025, 52(9): 337-345.
Chen Jintao, Lin Bing, Lin Song, et al. Dynamic pricing and energy scheduling strategy for photovoltaic storage charging stations based on multi-agent deep reinforcement learning[J]. Computer Science, 2025, 52(9): 337-345.

Footnotes

利益冲突声明(Conflict of Interests): 所有作者声明不存在利益冲突。

作者贡献声明(Authors’ Contributions): 周瑞翱完成论文写作,许潇提出研究方向,许立雄设计研究思路,刘友波提出基本框架,尚宇炜进行论文修订,白帅涛开展文献调研,刘俊勇参与论文审核。所有作者均阅读并同意了论文终稿内容。

Funding

National Science and Technology Major Project on Smart Grid (2030)(2025ZD0806600)
PDF(2003 KB)

Accesses

Citation

Detail

Recommended

/

〈 〉