Dynamic Pricing and Energy Consumption Scheduling With Reinforcement Learning

被引:202
|
作者
Kim, Byung-Gook [1 ]
Zhang, Yu [2 ]
van der Schaar, Mihaela [3 ]
Lee, Jang-Won [4 ]
机构
[1] Samsung Elect, Networks Business Div, Suwon 433742, South Korea
[2] Microsoft, Online Serv Div, Sunnyvale, CA 94085 USA
[3] Univ Calif Los Angeles, Dept Elect Engn, Los Angeles, CA 90095 USA
[4] Yonsei Univ, Dept Elect & Elect Engn, Seoul 03722, South Korea
基金
新加坡国家研究基金会; 美国国家科学基金会;
关键词
Smart grid; microgrid; dynamic pricing; load scheduling; demand response; electricity market; Markov decision process; reinforcement learning; DEMAND RESPONSE MANAGEMENT; ELECTRIC VEHICLES; SIDE MANAGEMENT; SMART DEVICES; UTILITY; GRIDS; DISPATCH; MARKETS;
D O I
10.1109/TSG.2015.2495145
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, we study a dynamic pricing and energy consumption scheduling problem in the microgrid where the service provider acts as a broker between the utility company and customers by purchasing electric energy from the utility company and selling it to the customers. For the service provider, even though dynamic pricing is an efficient tool to manage the microgrid, the implementation of dynamic pricing is highly challenging due to the lack of the customer-side information and the various types of uncertainties in the microgrid. Similarly, the customers also face challenges in scheduling their energy consumption due to the uncertainty of the retail electricity price. In order to overcome the challenges of implementing dynamic pricing and energy consumption scheduling, we develop reinforcement learning algorithms that allow each of the service provider and the customers to learn its strategy without a priori information about the microgrid. Through numerical results, we show that the proposed reinforcement learning-based dynamic pricing algorithm can effectively work without a priori information about the system dynamics and the proposed energy consumption scheduling algorithm further reduces the system cost thanks to the learning capability of each customer.
引用
收藏
页码:2187 / 2198
页数:12
相关论文
共 50 条
  • [1] Dynamic pricing and reinforcement learning
    Carvalho, AX
    Puterman, ML
    PROCEEDINGS OF THE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS 2003, VOLS 1-4, 2003, : 2916 - 2921
  • [2] A Scheduling Algorithm for Appliance Energy Consumption Optimization in a Dynamic Pricing Environment
    Touhs, Hamza
    Temouden, Anas
    Khallaayoun, Ahmed
    Chraibi, Mhammed
    El Hafdaoui, Hamza
    WORLD ELECTRIC VEHICLE JOURNAL, 2024, 15 (01):
  • [3] A Reinforcement Learning Approach for EV Charging Station Dynamic Pricing and Scheduling Control
    Wang, Shuoyao
    Bi, Suzhi
    Zhang, Ying-Jun Angela
    2018 IEEE POWER & ENERGY SOCIETY GENERAL MEETING (PESGM), 2018,
  • [4] Dynamic Pricing by Multiagent Reinforcement Learning
    Han, Wei
    Liu, Lingbo
    Zheng, Huaili
    PROCEEDINGS OF THE INTERNATIONAL SYMPOSIUM ON ELECTRONIC COMMERCE AND SECURITY, 2008, : 226 - 229
  • [5] Demand Response Dynamic Pricing and Economic Scheduling Considering Energy Consumption Characteristics
    Liu, Gang
    Yang, Dongmei
    Li, Bo
    Proceedings - 2022 Asian Conference on Frontiers of Power and Energy, ACFPE 2022, 2022, : 282 - 286
  • [6] Reinforcement Learning for Fair Dynamic Pricing
    Maestre, Roberto
    Duque, Juan
    Rubio, Alberto
    Arevalo, Juan
    INTELLIGENT SYSTEMS AND APPLICATIONS, VOL 1, 2019, 868 : 120 - 135
  • [7] Duck Curve Aware Dynamic Pricing and Battery Scheduling Strategy Using Reinforcement Learning
    Watari, Daichi
    Taniguchi, Ittetsu
    Onoye, Takao
    IEEE TRANSACTIONS ON SMART GRID, 2024, 15 (01) : 457 - 471
  • [8] Application of Reinforcement Learning in Dynamic Pricing Algorithms
    Wang Jintian
    Zhou Lei
    2009 IEEE INTERNATIONAL CONFERENCE ON AUTOMATION AND LOGISTICS ( ICAL 2009), VOLS 1-3, 2009, : 419 - 423
  • [9] Dynamic Pricing for Smart Grid with Reinforcement Learning
    Kim, Byung-Gook
    Zhang, Yu
    van der Schaar, Mihaela
    Lee, Jang-Won
    2014 IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (INFOCOM WKSHPS), 2014, : 640 - 645
  • [10] Improving duck curve by dynamic pricing and battery scheduling based on a deep reinforcement learning approach
    Watari, Daichi
    Taniguchi, Ittetsu
    Onoye, Takao
    BUILDSYS'21: PROCEEDINGS OF THE 2021 ACM INTERNATIONAL CONFERENCE ON SYSTEMS FOR ENERGY-EFFICIENT BUILT ENVIRONMENTS, 2021, : 232 - 233