Application of a Gradient Descent Continuous Actor-Critic Algorithm for Double-Side Day-Ahead Electricity Market Modeling

Continuous Reinforcement Algorithm and Robust Economic Dispatching-Based Spot Electricity Market Modeling considering Strategic Behaviors of Wind Power Producers and Other Participants

In a spot wholesale electricity market containing strategic bidding interactions among wind power producers and other participants such as fossil generation companies and distribution companies, the randomly fluctuating natures of wind power hinders not only the modeling and simulating of the dynamic bidding process and equilibrium of the electricity market but also the effectiveness about keeping economy and reliability in market clearing (economic dispatching) corresponding to the independent system operator. Because the gradient descent continuous actor-critic algorithm is demonstrated as an effective method in dealing with Markov’s decision-making problems with continuous state and action spaces and the robust economic dispatch model can optimize the permitted real-time wind power deviation intervals based on wind power producers’ bidding power output, in this paper, considering bidding interactions among wind power producers and other participants, we propose a gradient descent continuous actor-critic algorithm-based hour-ahead electricity market modeling approach with the robust economic dispatch model embedded. Simulations are implemented on the IEEE 30-bus test system, which, to some extent, verifies the market operation economy and the robustness against wind power fluctuations by using our proposed modeling approach.

The Role of Demand Response Aggregators and the Effect of GenCos Strategic Bidding on the Flexibility of Demand

This paper presents an interactive trading decision between an electricity market operator, generation companies (GenCos), and the aggregators having demand response (DR) capable loads. Decisions are made hierarchically. At the upper-level, an electricity market operator (EMO) aims to minimise generation supply cost considering a DR transaction cost, which is essentially the cost of load curtailment. A DR exchange operator aims to minimise this transaction cost upon receiving the DR offer from the multiple aggregators at the lower level. The solution at this level determines the optimal DR amount and the load curtailment price. The DR considers the end-user’s willingness to reduce demand. Lagrangian duality theory is used to solve the bi-level optimisation. The usefulness of the proposed market model is demonstrated on interconnection of the Pennsylvania-New Jersey-Maryland (PJM) 5-Bus benchmark power system model under several plausible cases. It is found that the peak electricity price and grid-wise operation expenses under this DR trading scheme are reduced.