Optimal Charging and Discharging Scheduling of Urban Large-Scale Shared Electric Vehicles Considering Energy Temporal and Spatial Transfer

doi:10.12204/j.issn.1000-7229.2023.06.014

Abstract

Abstract:

The development of shared electric vehicles does not only provide users with a convenient way to travel but also provides efficient and flexible adjustment for urban power grid resources, large-scale shared electric vehicle (EV) travel and charge-discharge behavior, strong randomness, complex charging and discharging control model online rolling together to consider multiple stakeholders, large amount of calculation, and high real-time requirements. First, this study uses the aggregation modeling method based on the SOC interval to determine the energy transition state in time or space of shared EV; it also reduces the dimension of the optimal charging and discharging schedule of large-scale EVs. Thereafter, we consider the operator profit and utility of the limited rational users' cumulative prospect as well as the power demand response on multiple subject gains. Moreover, the optimization model of charge and discharge depth is constructed based on reinforcement learning. Next, the deep Q net is applied to solve the network method, and real-time online sharing of EV charging and discharging aggregation optimization strategy in the different regions is achieved. In addition, the model effectively copes with the effects of randomness. Finally, combined with the actual operation data of 5000 shared EVs in 9 regions of a city, numerical example analyses verify that shared EVs within the city have the characteristics of time-space transfer of energy. The modeling method and solving strategy proposed in this study are effective in solving the optimization scheduling problem of large-scale shared EV charging and discharging while aiming to ensure the interests of multiple subjects.

Key words: shared electric vehicles, multiple benefits subjects, deep Q net(DQN), energy transition in time and space

CLC Number:

TM734

WAN Lingling, CHEN Zhong, WANG Yi, ZHANG Ziqi. Optimal Charging and Discharging Scheduling of Urban Large-Scale Shared Electric Vehicles Considering Energy Temporal and Spatial Transfer[J]. ELECTRIC POWER CONSTRUCTION, 2023, 44(6): 135-143.

Figures/Tables 8

Fig.1 SOC-based shared EV aggregation model

Fig.2 Demand shift load value function

Fig.3 The DQN network structure

Table 1 Regions share EV parameters

Fig.4 DQN training convergence process

Fig.5 Experimental results Figure

Table 2 Comparison of different strategies solved by DQN algorithm

Table 3 Comparison of different algorithms

References 27

[1]	中商产业研究院. 中国汽车行业市场前景及投资机会研究报告[R/OL] (2021-03-21) [2022-05-10]. http://reportnew.cei.cn/ashx/SearchDetail.ashx?newsId=580592.
	China Commercial Industry Research Institute. Research report on market prospects and investment opportunities of china’s automobile industry[R/OL]. (2021-03-21) [2022-05-10]. http://reportnew.cei.cn/ashx/SearchDetail.ashx?newsId=580592.
[2]	崔桂香. 基于交通因素分析的电动汽车运行规划优化研究[D]. 杭州: 杭州电子科技大学, 2020.
	CUI Guixiang. Research on optimization of electric vehicle operation planning based on traffic factor analysis[D]. Hangzhou: Hangzhou Dianzi University, 2020.
[3]	胡泽春, 宋永华, 徐智威, 等. 电动汽车接入电网的影响与利用[J]. 中国电机工程学报, 2012, 32(4): 1-10, 25.
	HU Zechun, SONG Yonghua, XU Zhiwei, et al. Impacts and utilization of electric vehicles integration into power systems[J]. Proceedings of the CSEE, 2012, 32(4): 1-10, 25.
[4]	马玲玲, 杨军, 付聪, 等. 电动汽车充放电对电网影响研究综述[J]. 电力系统保护与控制, 2013, 41(3): 140-148.
	MA Lingling, YANG Jun, FU Cong, et al. Review on impact of electric car charging and discharging on power grid[J]. Power System Protection and Control, 2013, 41(3): 140-148.
[5]	肖浩, 裴玮, 孔力. 含大规模电动汽车接入的主动配电网多目标优化调度方法[J]. 电工技术学报, 2017, 32(S2): 179-189.
	XIAO Hao, PEI Wei, KONG Li. Multi-objective optimization scheduling method for active distribution network with large scale electric vehicles[J]. Transactions of China Electrotechnical Society, 2017, 32(S2): 179-189.
[6]	王宁, 张文剑, 刘向, 等. 电动汽车共享站点间车辆人工调度策略[J]. 同济大学学报(自然科学版), 2018, 46(8): 1064-1071.
	WANG Ning, ZHANG Wenjian, LIU Xiang, et al. Inter-site-vehicle artificial scheduling strategy design for electric vehicle sharing[J]. Journal of Tongji University (Natural Science), 2018, 46(8): 1064-1071.
[7]	丁梓文. 共享汽车调度优化策略研究[D]. 西安: 长安大学, 2018.
	DING Ziwen. Research on optimization strategy of shared car scheduling[D]. Xi’an: Changan University, 2018.
[8]	JORGE D, CORREIA G. Carsharing systems demand estimation and defined operations: a literature review[J]. European Journal of Transport and Infrastructure Research, 2013, 13(3): 201-220.
[9]	王宁, 舒雅静, 唐林浩, 等. 基于动态定价的共享汽车自适应调度策略[J]. 交通运输系统工程与信息, 2018, 18(5):12-17, 74.
	WANG Ning, SHU Yajing, TANG Linhao, et al. Adaptive scheduling strategy in car-sharing system based on feedback dynamic pricing[J]. Journal of Transportation Systems Engineering and Information Technology, 2018, 18(5):12-17, 74.
[10]	张彬桥, 李成, 李振兴, 等. 基于交通信息和配电网全成本电价的电动汽车充电负荷调度方法[J]. 智慧电力, 2021, 49(7): 52-57.
	ZHANG Binqiao, LI Cheng, LI Zhenxing, et al. Dipatching method of electric vehicle charging load considering traffic information and distribution network full cost electricity price[J]. Smart Power, 2021, 49(7): 52-57.
[11]	CORREIA G H DA, ANTUNES A P. Optimization approach to depot location and trip selection in one-way carsharing systems[J]. Transportation Research Part E: Logistics and Transportation Review, 2012, 48(1): 233-247. doi: 10.1016/j.tre.2011.06.003 URL
[12]	马群. 城市共享汽车网点选址研究与系统开发[D]. 北京: 北京交通大学, 2019.
	MA Qun. Research and system development of urban shared car network location[D]. Beijing: Beijing Jiaotong University, 2019.
[13]	刘彬彬. 共享汽车租赁点运营特性分析与车辆调度研究[D]. 北京: 北京交通大学, 2020.
	LIU Binbin. Analysis of operation characteristics of shared car rental points and research on vehicle scheduling[D]. Beijing: Beijing Jiaotong University, 2020.
[14]	王卉. 奖励机制下共享电动汽车双主体调配优化研究[D]. 大连: 大连理工大学, 2020.
	WANG Hui. Research on optimization of dual-agent allocation of shared electric vehicles under incentive mechanism[D]. Dalian: Dalian University of Technology, 2020.
[15]	范磊, 陈良亮, 罗雯茜, 等. 考虑城市不同功能区的电动汽车负荷时空分布建模方法[J]. 电力建设, 2021, 42(6): 67-75. doi: 10.12204/j.issn.1000-7229.2021.06.007
	FAN Lei, CHEN Liangliang, LUO Wenqian, et al. Spatial and temporal distribution model of electric vehicle load considering different urban functional areas[J]. Electric Power Construction, 2021, 42(6): 67-75. doi: 10.12204/j.issn.1000-7229.2021.06.007
[16]	赵思翔, 王亚超, 巨汉基, 等. 基于区块链的电动汽车充电桩两阶段交易优化[J]. 电力建设, 2021, 42(12): 93-103. doi: 10.12204/j.issn.1000-7229.2021.12.011
	ZHAO Sixiang, WANG Yachao, JU Hanji, et al. Two-stage transaction optimization for electric vehicle charging piles applying blockchain technology[J]. Electric Power Construction, 2021, 42(12): 93-103. doi: 10.12204/j.issn.1000-7229.2021.12.011
[17]	吴赋章, 杨军, 林洋佳, 等. 考虑用户有限理性的电动汽车时空行为特性[J]. 电工技术学报, 2020, 35(7): 1563-1574.
	WU Fuzhang, YANG Jun, LIN Yangjia, et al. Research on spatiotemporal behavior of electric vehicles considering the users’ bounded rationality[J]. Transactions of China Electrotechnical Society, 2020, 35(7): 1563-1574.
[18]	李含玉, 杜兆斌, 陈丽丹, 等. 基于出行模拟的电动汽车充电负荷预测模型及V2G评估[J]. 电力系统自动化, 2019, 43(21): 88-96.
	LI Hanyu, DU Zhaobin, CHEN Lidan, et al. Trip simulation based charging load forecasting model and vehicle-to-grid evaluation of electric vehicles[J]. Automation of Electric Power Systems, 2019, 43(21):88-96.
[19]	潘振宁, 张孝顺, 余涛, 等. 大规模电动汽车集群分层实时优化调度[J]. 电力系统自动化, 2017, 41(16): 96-104.
	PAN Zhenning, ZHANG Xiaoshun, YU Tao, et al. Hierarchical real-time optimized dispatching for large-scale clusters of electric vehicles[J]. Automation of Electric Power Systems, 2017, 41(16): 96-104.
[20]	潘振宁, 余涛, 王克英. 考虑多方主体利益的大规模电动汽车分布式实时协同优化[J]. 中国电机工程学报, 2019, 39(12): 3528-3540.
	PAN Zhenning, YU Tao, WANG Keying. Decentralized coordinated dispatch for real-time optimization of massive electric vehicles considering various interests[J]. Proceedings of the CSEE, 2019, 39(12): 3528-3540.
[21]	董锴, 蔡新雷, 崔艳林, 等. 基于马尔科夫链的电动汽车聚合建模及多模式调频控制策略[J]. 电网技术, 2022, 46(2): 622-631.
	DONG Kai, CAI Xinlei, CUI Yanlin, et al. Aggregation modeling based on Markov chain and multi-mode control strategies of aggregated electric vehicles for frequency regulation[J]. Power System Technology, 2022, 46(2): 622-631.
[22]	李佳颖, 陈炯, 张学友. 共享电动汽车的充放电协调控制[J]. 电力系统及其自动化学报, 2018, 30(12): 105-111.
	LI Jiaying, CHEN Jiong, ZHANG Xueyou. Coordinated control of charging and discharging for EV-sharing[J]. Proceedings of the CSU-EPSA, 2018, 30(12): 105-111.
[23]	PRENCIPE L P, THERESIA VAN ESSEN J, CAGGIANI L, et al. A mathematical programming model for optimal fleet management of electric car-sharing systems with Vehicle-to-Grid operations[J]. Journal of Cleaner Production, 2022, 368: 133147. doi: 10.1016/j.jclepro.2022.133147 URL
[24]	王静娜. 共享电动汽车租赁网点选址和车辆调度联合优化研究[D]. 北京: 北京交通大学, 2019.
	WANG Jingna. Research on joint optimization of location selection and vehicle scheduling of shared electric vehicle rental network[D]. Beijing: Beijing Jiaotong University, 2019.
[25]	李航, 李国杰, 汪可友. 基于深度强化学习的电动汽车实时调度策略[J]. 电力系统自动化, 2020, 44(22): 161-167.
	LI Hang, LI Guojie, WANG Keyou. Real-time dispatch strategy for electric vehicles based on deep reinforcement learning[J]. Automation of Electric Power Systems, 2020, 44(22): 161-167.
[26]	阮应君, 侯泽群, 钱凡悦, 等. 基于深度强化学习的分布式能源系统运行优化[J]. 科学技术与工程, 2022, 22(17): 7021-7030.
	RUAN Yingjun, HOU Zequn, QIAN Fanyue, et al. Optimization of the operation of distributed energy system based on deep reinforcement learning[J]. Science Technology and Engineering, 2022, 22(17): 7021-7030.
[27]	赵小瑾, 张开宇, 冯冬涵, 等. 基于强化学习的电动汽车集群实时优化调度策略[J]. 智慧电力, 2022, 50(1): 53-59, 81.
	ZHAO Xiaojin, ZHANG Kaiyu, FENG Donghan, et al. Real-time optimal scheduling strategy for electric vehicle clusters based on reinforcement learning[J]. Smart Power, 2022, 50(1): 53-59, 81.