Smart Grid and Microgrid

From NUEESS

(Difference between revisions)
Jump to: navigation, search
m (→Dynamic Residential DR)
(→Publications)
 
(24 intermediate revisions not shown)
Line 1: Line 1:
=Description=
=Description=
==Background==
==Background==
-
Sustainability has become an imperative requirement on many infrastructures and systems of our society with the impending energy crisis and environment deterioration.Power grids are being transformed into [http://en.wikipedia.org/wiki/Smart_grid Smart Grid] with advanced sensors, information and communication technologies.In smart grid, the energy flow will become two-way between the grid and consumers with renewable energy generations, which will be monitored and controlled by sensors, smart meters, digital controls and analytical tools. Smart Grid usually introduces [http://en.wikipedia.org/wiki/Demand_response Demand Response (DR)] and [http://en.wikipedia.org/wiki/Distributed_generation Distributed Generation (DG)] to improve energy consumption and generation efficiency.
+
Sustainability has become an imperative requirement on many infrastructures and systems of our society with the impending energy crisis and environment deterioration. Power grids are being transformed into [http://en.wikipedia.org/wiki/Smart_grid Smart Grid] with advanced sensors, information and communication technologies. In smart grid, the energy flow will become two-way between the grid and consumers with renewable energy generations, which will be monitored and controlled by sensors, smart meters, digital controls and analytical tools. Smart Grid usually introduces [http://en.wikipedia.org/wiki/Demand_response Demand Response (DR)] and [http://en.wikipedia.org/wiki/Distributed_generation Distributed Generation (DG)] to improve energy consumption and generation efficiency.
==Purpose==
==Purpose==
Line 10: Line 10:
==System Scheme==
==System Scheme==
-
[[File:MicrogridScheme.png |thumb|right|500px|Microgrid for a community]]
+
[[File:MicrogridScheme.png |thumb|right|350px|Microgrid for a community]]
The Microgrid is invested and shared by a cluster of residents. According to ratios of investment, residents subscribe certain amount of power from the microgrid with low price for unpaid investment cost, fuel cost and management cost. There are three types of flow in the microgrid: electric power flow, thermal power flow and information flow. The electric power is powered by both utility grid and internal hybrid energy generated by wind turbine, micro CHP systems, and battery discharging. Micro CHP is a smaller size CHP for residential generation. For general consideration, some houses in the community are equipped with micro CHP systems, whereas others are not. For the latter, thermal energy can only be generated by electric heat pump. The thermal energy will be stored in the form of hot water in the tank and can be consumed in the future. VRB is chosen to store surplus wind energy and discharge when the wind energy is insufficient for the demand to reduce the energy consumption cost.
The Microgrid is invested and shared by a cluster of residents. According to ratios of investment, residents subscribe certain amount of power from the microgrid with low price for unpaid investment cost, fuel cost and management cost. There are three types of flow in the microgrid: electric power flow, thermal power flow and information flow. The electric power is powered by both utility grid and internal hybrid energy generated by wind turbine, micro CHP systems, and battery discharging. Micro CHP is a smaller size CHP for residential generation. For general consideration, some houses in the community are equipped with micro CHP systems, whereas others are not. For the latter, thermal energy can only be generated by electric heat pump. The thermal energy will be stored in the form of hot water in the tank and can be consumed in the future. VRB is chosen to store surplus wind energy and discharge when the wind energy is insufficient for the demand to reduce the energy consumption cost.
-
 
+
<br\>
 +
<br\>
The management of the microgrid is based on hierarchical optimization and bill balance. The hierachical optimization is based on centralized and distributed agents and has 3 steps.
The management of the microgrid is based on hierarchical optimization and bill balance. The hierachical optimization is based on centralized and distributed agents and has 3 steps.
*Dynamic residential DR for energy consumption cost reduction, high user's convenience rate and user's preference adaption.
*Dynamic residential DR for energy consumption cost reduction, high user's convenience rate and user's preference adaption.
*Shared cost-led micro CHP generation management for cost reduction.
*Shared cost-led micro CHP generation management for cost reduction.
-
*Environment adaptive VRB discharging management for cost reduction considering stochastic elements.
+
*Environment adaptive VRB discharging management based on [http://en.wikipedia.org/wiki/Reinforcement_learning Reinforcement Learning] for cost reduction considering stochastic elements.
-
<br\>
+
 
==System Models==
==System Models==
===Dynamic Residential DR===
===Dynamic Residential DR===
 +
[[File:DRModel.png|thumb|right|300px|Model of dynamic DR]]
 +
[[File:PRFunction.png|thumb|right|300px|Reward/Penalty function]]
Electricity demands are represented as schedulable and fixed energy consumption tasks. Dynamic DR focuses on the schedulable load. Schedulable tasks have their own convenience rate distributions, which reflect the satisfaction users can get when tasks are executed at different time.
Electricity demands are represented as schedulable and fixed energy consumption tasks. Dynamic DR focuses on the schedulable load. Schedulable tasks have their own convenience rate distributions, which reflect the satisfaction users can get when tasks are executed at different time.
-
The model of dynamic DR consists of dynamic task array, external information and task convenience rate function as inputs, and generate task scheduling as outputs. After scheduling, only tasks scheduled in current decision period are executed. Others will be rescheduled in the next decision period with updated external information. DR agent will optimize the following cost function considering both energy consumption cost and user's convenience:
+
<br\>
 +
<br\>
 +
The model of dynamic DR consists of dynamic task array, external information and task convenience rate function as inputs, and generate task scheduling as outputs. After scheduling, only tasks scheduled in current decision period are executed. Others will be rescheduled in the next decision period with updated external information.
 +
<br\>
 +
<br\>
 +
The convenience rate function comprises Basic function and Reward/Penalty function. The basic function is used for initialization. The Reward/Penalty function serves as agents’ reaction towards user’s interference and is used to update the convenience rate function dynamically. The user may attempt to change task execution time scheduled by the agent. The new execution time is considered as the new comfort time for the user and will be given a maximum convenience rate increase. The old scheduled time will be penalized by decreasing its convenience rate with the same value.
 +
<br\>
 +
<br\>
 +
DR agent will optimize the following cost function considering both energy consumption cost and user's convenience:
  <math>\min \qquad J = \frac{{C_{{k_n}}^{}}}{{U_{{k_n}}^{}}} + (I - \sum\limits_{i = 1}^I {s_i^{{k_n}}} ){P_T}  
  <math>\min \qquad J = \frac{{C_{{k_n}}^{}}}{{U_{{k_n}}^{}}} + (I - \sum\limits_{i = 1}^I {s_i^{{k_n}}} ){P_T}  
</math>
</math>
-
  <math> C_{k_n}-\text{Energy consumption cost of loads}
+
  <math> C_{k_n}-\text{Energy consumption cost of loads.}
</math>
</math>
-
  <math> U_{k_n}-\text{Convenience satisfaction rate obtained after load scheduling}
+
  <math> U_{k_n}-\text{Convenience satisfaction rate obtained after load scheduling.}
</math>
</math>
-
  <math> P_T-\text{Load curtailment penalty}
+
  <math> \quad P_T-\text{Load curtailment penalty.}
</math>
</math>
 +
 +
The problem is solved by using [http://en.wikipedia.org/wiki/Particle_swarm_optimization Particle Swarm Optimization (PSO)] algorithm.
 +
 +
===Shared Cost-led CHP Management===
 +
In this section, the generation of micro CHP systems and power consumption of electric heat pumps are optimized to minimized the energy consumption cost of the whole community. The constraints include the maximum electric power of each house, thermal power balance, micro CHP fuel consumption range and heaters' power range. The optimization problem at nth decision period can be formed as:
 +
<math>\min \qquad \sum\limits_{k = 0}^{N - 1} {{C_{CME}}(k + nN) + {C_{CMF}}(k + nN) - {B_{CM}}(k + nN)}
 +
</math>
 +
<br\>
 +
<math> \quad C_{CME}-\text{Electric Power Consumption Cost.}
 +
</math>
 +
<math> \quad C_{CMF}-\text{Fuel Consumption Cost.}
 +
</math>
 +
<math> \quad B_{CM}-\text{Community income from energy sale.}
 +
</math>
 +
 +
This optimization problem is also solved by using PSO algorithm.
 +
 +
===Environment Adaptive VRB Management===
 +
In this step, a centralized VRB management is introduced to store surplus wind energy and discharge when there is high demand in the community. VRB has three statues: charging, discharging and idle. The charging management is simple: when there is surplus wind power, VRB is charged if it is not full. So the main problem of VRB management is to find the optimal discharging policy to compensate the unfed load after the second step and reduce cost. The management also considers stochastic elements, including stochastic load and wind power supply.
 +
<br\>
 +
<br\>
 +
The process dynamics of VRB management based on decision making can also be modeled as a stochastic Markov Decision Process (MDP).The state space includes utility electricity price, forecasted wind power, load unfed by internal supply, and DOD of VRB:
 +
<math>
 +
x(k) = {\left[ {\begin{array}{*{20}{c}}
 +
  {{R_G}(k)} & {{P_{WIND}}(k)} & {{E_{INSF}}(k)} & {{S_{DOD}}(k)} \\
 +
\end{array}} \right]^T}
 +
</math>
 +
The action of the centralized agent is to decide the percentage of the load unfed by internal supply. The reward function for action evaluation includes normalized cost reduction and the reliability level (energy backup):
 +
<math>
 +
r({x_k},{u_k}) = b - \lambda S_{DOD}^{}(k + 1)
 +
</math>
 +
<br\>
 +
<math>
 +
b = \frac{{\left( {{R_G}(k) - {R_B}} \right) \times \min \left( {{{E'}_{INSF}}(k),{E_{DCH}}(k)} \right)}}{{\left( {{R_{GMAX}}(k) - {R_B}} \right) \times {E_{DCH}}(k)}}
 +
</math>
 +
 +
In this step, the online reinforcement learning is realized by using [http://en.wikipedia.org/wiki/Q-learning Q-learning] algorithm.
=People=
=People=
 +
*[[Bingnan Jiang]]
 +
=Publications=
=Publications=
 +
*{{#lst:Publications|bjj1}}
 +
*B. Jiang and Y. Fei, “Dynamic residential demand response and distributed generation management in smart microgrid with hierarchical agents”, in Proc. IEEE Int. Conf. on Smart Grid and Clean Energy Technologies, Sep. 2011.

Latest revision as of 10:50, 6 August 2014

Contents

Description

Background

Sustainability has become an imperative requirement on many infrastructures and systems of our society with the impending energy crisis and environment deterioration. Power grids are being transformed into Smart Grid with advanced sensors, information and communication technologies. In smart grid, the energy flow will become two-way between the grid and consumers with renewable energy generations, which will be monitored and controlled by sensors, smart meters, digital controls and analytical tools. Smart Grid usually introduces Demand Response (DR) and Distributed Generation (DG) to improve energy consumption and generation efficiency.

Purpose

  • Community level Microgrid based system scheme is designed to make the sustainable energy usage more affordable for ordinary residents.
  • Dynamic residential DR with enhanced user-agent interaction is designed for user's preference adaption.
  • Shared Cost-led Micro Combined Heat and Power (CHP) management strategy is designed to increase the DG utilization and reduce energy consumption cost.
  • Vanadium Redox Battery (VRB) is management for environment adaptive discharging.

System Scheme

Microgrid for a community

The Microgrid is invested and shared by a cluster of residents. According to ratios of investment, residents subscribe certain amount of power from the microgrid with low price for unpaid investment cost, fuel cost and management cost. There are three types of flow in the microgrid: electric power flow, thermal power flow and information flow. The electric power is powered by both utility grid and internal hybrid energy generated by wind turbine, micro CHP systems, and battery discharging. Micro CHP is a smaller size CHP for residential generation. For general consideration, some houses in the community are equipped with micro CHP systems, whereas others are not. For the latter, thermal energy can only be generated by electric heat pump. The thermal energy will be stored in the form of hot water in the tank and can be consumed in the future. VRB is chosen to store surplus wind energy and discharge when the wind energy is insufficient for the demand to reduce the energy consumption cost.

The management of the microgrid is based on hierarchical optimization and bill balance. The hierachical optimization is based on centralized and distributed agents and has 3 steps.

  • Dynamic residential DR for energy consumption cost reduction, high user's convenience rate and user's preference adaption.
  • Shared cost-led micro CHP generation management for cost reduction.
  • Environment adaptive VRB discharging management based on Reinforcement Learning for cost reduction considering stochastic elements.

System Models

Dynamic Residential DR

Model of dynamic DR
Reward/Penalty function

Electricity demands are represented as schedulable and fixed energy consumption tasks. Dynamic DR focuses on the schedulable load. Schedulable tasks have their own convenience rate distributions, which reflect the satisfaction users can get when tasks are executed at different time.

The model of dynamic DR consists of dynamic task array, external information and task convenience rate function as inputs, and generate task scheduling as outputs. After scheduling, only tasks scheduled in current decision period are executed. Others will be rescheduled in the next decision period with updated external information.

The convenience rate function comprises Basic function and Reward/Penalty function. The basic function is used for initialization. The Reward/Penalty function serves as agents’ reaction towards user’s interference and is used to update the convenience rate function dynamically. The user may attempt to change task execution time scheduled by the agent. The new execution time is considered as the new comfort time for the user and will be given a maximum convenience rate increase. The old scheduled time will be penalized by decreasing its convenience rate with the same value.

DR agent will optimize the following cost function considering both energy consumption cost and user's convenience: 

\min \qquad J = \frac{{C_{{k_n}}^{}}}{{U_{{k_n}}^{}}} + (I - \sum\limits_{i = 1}^I {s_i^{{k_n}}} ){P_T} 

 C_{k_n}-\text{Energy consumption cost of loads.}

 U_{k_n}-\text{Convenience satisfaction rate obtained after load scheduling.}

 \quad P_T-\text{Load curtailment penalty.}

The problem is solved by using Particle Swarm Optimization (PSO) algorithm.

Shared Cost-led CHP Management

In this section, the generation of micro CHP systems and power consumption of electric heat pumps are optimized to minimized the energy consumption cost of the whole community. The constraints include the maximum electric power of each house, thermal power balance, micro CHP fuel consumption range and heaters' power range. The optimization problem at nth decision period can be formed as: 

\min \qquad \sum\limits_{k = 0}^{N - 1} {{C_{CME}}(k + nN) + {C_{CMF}}(k + nN) - {B_{CM}}(k + nN)}



 \quad C_{CME}-\text{Electric Power Consumption Cost.}

 \quad C_{CMF}-\text{Fuel Consumption Cost.}

 \quad B_{CM}-\text{Community income from energy sale.}

This optimization problem is also solved by using PSO algorithm.

Environment Adaptive VRB Management

In this step, a centralized VRB management is introduced to store surplus wind energy and discharge when there is high demand in the community. VRB has three statues: charging, discharging and idle. The charging management is simple: when there is surplus wind power, VRB is charged if it is not full. So the main problem of VRB management is to find the optimal discharging policy to compensate the unfed load after the second step and reduce cost. The management also considers stochastic elements, including stochastic load and wind power supply.

The process dynamics of VRB management based on decision making can also be modeled as a stochastic Markov Decision Process (MDP).The state space includes utility electricity price, forecasted wind power, load unfed by internal supply, and DOD of VRB: 


x(k) = {\left[ {\begin{array}{*{20}{c}}
   {{R_G}(k)} & {{P_{WIND}}(k)} & {{E_{INSF}}(k)} & {{S_{DOD}}(k)} \\
\end{array}} \right]^T}

The action of the centralized agent is to decide the percentage of the load unfed by internal supply. The reward function for action evaluation includes normalized cost reduction and the reliability level (energy backup): 


r({x_k},{u_k}) = b - \lambda S_{DOD}^{}(k + 1)




b = \frac{{\left( {{R_G}(k) - {R_B}} \right) \times \min \left( {{{E'}_{INSF}}(k),{E_{DCH}}(k)} \right)}}{{\left( {{R_{GMAX}}(k) - {R_B}} \right) \times {E_{DCH}}(k)}}

In this step, the online reinforcement learning is realized by using Q-learning algorithm.

People

Publications

  • B. Jiang and Y. Fei, “Smart home in smart microgrid: A cost-effective energy ecosystem with intelligent hierarchical agents,”IEEE Trans. on Smart Grid, vol. 6, no.1, pp.3-13, Jan. 2015.
  • B. Jiang and Y. Fei, “Dynamic residential demand response and distributed generation management in smart microgrid with hierarchical agents”, in Proc. IEEE Int. Conf. on Smart Grid and Clean Energy Technologies, Sep. 2011.




Whos here now:   Members 0   Guests 0   Bots & Crawlers 1
 
Retrieved from "http://nueess.coe.neu.edu/nueess/index.php/Smart_Grid_and_Microgrid"
Personal tools