基于多智能体协同强化学习的新能源场站AGC与一次调频动态协调控制
New energy station AGC and primary frequency modulation dynamic coordinated control based on multi-agent collaborative reinforcement learning
-
摘要: 由于现有方法调频资源分散,响应特性差异大,为此研究基于多智能体协同强化学习的新能源场站AGC与一次调频动态协调控制。构建涵盖多类型新能源发电单元、储能系统及电网频率响应的综合动态模型,将各调频资源建模为独立智能体,采用集中训练—分散执行的多智能体深度确定性策略梯度(MADDPG)算法,通过智能体间的协同机制实现AGC与一次调频的优化协调。控制器依据电网频率偏差的大小与变化趋势,动态调整各调频资源的参与程度及功率分配方案。仿真结果表明,在阶跃扰动及连续波动场景下,实验组均能实现系统频率的快速恢复,AGC区域控制偏差维持在较小范围内,有效提升了新能源场站参与电网频率调节的能力。Abstract: Due to the dispersed frequency regulation resources and significant differences in response characteristics of existing methods, this study investigates the dynamic coordination control of AGC and primary frequency regulation in new energy stations based on multi-agent collaborative reinforcement learning. Build a comprehensive dynamic model that covers multiple types of new energy generation units, energy storage systems, and grid frequency response. Model each frequency regulation resource as an independent agent and use a multi-agent deep deterministic policy gradient (MADDPG) algorithm with centralized training and decentralized execution. Through the collaborative mechanism between agents, optimize and coordinate AGC and primary frequency regulation. The controller dynamically adjusts the participation level and power allocation scheme of each frequency regulation resource based on the magnitude and trend of the grid frequency deviation. The simulation results show that in both step disturbance and continuous fluctuation scenarios, the experimental group can achieve rapid recovery of system frequency, and the AGC regional control deviation is maintained within a small range, effectively improving the ability of new energy stations to participate in grid frequency regulation.
下载: