Q-Learning Based Supervisory PID Controller for Damping Frequency Oscillations in a Hybrid Mini/Micro-Grid
Author(s):
Article Type:
Research/Original Article (دارای رتبه معتبر)
Abstract:
The purpose of this paper is to design a supplementary controller for traditional PID controller in order to damp the frequency oscillations in a micro-grid. Q-learning, which is used for supervise a classical PID controller in this paper, is a model free and a simple solution method of reinforcement learning (RL). RL is one of the branches of the machine learning, which is the main solution method of Markov decision process (MDPs). The proposed control mechanism is consisting of two main parts. The first part is a classical PID controller which is fixed tuned using Salp swarm algorithm. The second part is a Q‑learning based control strategy which is consistent and updates its characteristics according to the changes in the system continuously. Eventually, a hybrid micro-grid is considered to evaluate the performance of the suggested control method compared to classical PID and fractional order fuzzy PID (FOFPID) controllers. The considered hybrid system is consisting of renewable energy resources such as solar-thermal power station (STPS) and wind turbine generation (WTG), along with several energy storage devices such as batteries, flywheel and ultra-capacitor with physical constraints and time delays. Simulations are carried out in various realistic scenarios considering system parameter variations along with changing in operating conditions. Results indicate that the proposed control strategy has an excellent dynamic response compared to the traditional PID and FOFPID controllers for damping the frequency oscillations in different operating conditions.
Keywords:
Language:
English
Published:
Iranian Journal of Electrical and Electronic Engineering, Volume:15 Issue: 1, Mar 2019
Pages:
126 to 141
https://www.magiran.com/p1937275
سامانه نویسندگان
از نویسنده(گان) این مقاله دعوت میکنیم در سایت ثبتنام کرده و این مقاله را به فهرست مقالات رزومه خود پیوست کنند.
راهنما
مقالات دیگری از این نویسنده (گان)
-
Static Security Assessment of Integrated Power Systems with Wind Farms Using Complex Network Theory
Farshad Babaei, Amin Safari *, Javad Salehi,
Journal of Operation and Automation in Power Engineering, Summer 2025 -
A Modified Single-Phase Single-Stage Boost Inverter
Hadi Khoramdel, Farzad Sedaghati *, , Hadi Dolati
Journal of Modeling in Engineering,