Dennis Mullen System Operations Manager EPRI Power Switching Safety and Reliability Conference September 14, 2009
Electric System Control Center (ESCC) Member Companies PSNH Operating Company of NU Retail Load Serving Entity Generator Operator / Owner PSNH Wholesale Delivery Customers New Hampshire Electric Cooperative Municipals New Hampton Wolfeboro Ashland Unitil (UES) Concord Electric Exeter & Hampton FPL Energy Seabrook, LLC (Nuclear Plant) FPL New England Division (substation) 2
ESCC Jurisdiction Substations: 80 Transmission and Distribution Lines: Type Number Miles 345 kv lines 10 252 230 kv lines 1 9 115 kv lines 46 742 34.5 kv lines 163 1035 Generation: 113 Plants Peak Load: 2226 MW Summer; 1815 MW Winter 3
Storm Statistics Outages statewide 400,000 PSNH customers 322,000 Percent of state at peak 55% Major storms during restoration 2 Customer calls 425,000+ in 14 days Crews 1,200 4
The December ice storm was more significant than any other storm in PSNH s history 5
The Damage The majority of the outages were due to downed trees and branches coated with ice It s estimated that 75 to 80 percent of the trees that hit power lines were large and outside PSNH s trim zone 6
Mobilization & Restoration December 11: PSNH s Emergency Operations Center was activated December 12: 322,000 PSNH customers were without power December 14: hundreds of additional tree and line crews arrive by nightfall, crews had restored power to more than half of customers who had lost power 7
Mobilization & Restoration continued December 22 24 (final three days): PSNH s fleet topped out at 1,200 crews working around the clock to restore about 10,000 customers still without power PSNH was able to restore power to more than 99.9% of impacted customers by 6:00 p.m. on Christmas Eve Day 13 of the restoration effort 8
Statewide Damage Western Extreme damage Crews were redeployed as soon as they were freed up from other communities Opened three satellite area work centers in: Fitzwilliam, Peterborough, New Ipswich Restored 99.9% of customers by Day 13 at 6:00 p.m. Christmas Eve Southern Most populated part of the state Experienced severe and widespread damage 99.9% of customers restored by Day 13 Christmas Eve Northern Received mostly sleet and snow minimizing damage to this area Service was restored to 100% of customers by Day 7 December 18 Seacoast Received less severe damage than southern and western parts of the state 100% restored on Day 10 December 21
System Load Trend December 10-23, 2008 Plot-0 12/23/2008 12:00:00 AM 1450 965.28 MW 1250 1050 850 650 450 250 12/11/08 12/12/08 12/13/08 12/14/08 12/15/08 12/16/08 12/17/08 12/18/08 12/19/08 12/20/08 12/21/08 12/22/08 ESCC PSNH_AGC LOAD PSNH_TOTAL MW 10
ESCC Storm Response Circuits out of service Day 1 1 @ 345 kv 4 @ 115 kv (2 planned) 61 @ 34.5 kv Staffing 2 dispatchers on normal shift coverage Staff called in at 0100; Difficulty driving 10 Staff members in control room by 0700 Staff released to field on day 4 Communication ARD, Land Phone, Radio, Cell Phone, and VOIP Phone General Information Notification e-mail every 6 hours Emergency Operations Center conference calls every 6 hours 11
ESCC Jurisdiction 345 kv Broken Static Wire 12
ESCC Jurisdiction 34.5 kv Distribution line 13
12 kv Distribution line 14
ESCC Storm Strategies Planned work put on hold. Large capital project commissioning delayed til 2009. Man hydro stations beginning of storm Turn off voltage sensing load break switches Avoid damage from ice Divide control room staff by region of state and functions Assign scribes at each workstation Priority of restoration determined by local Area Work Center (distribution) based on resources and customer impact Field assistance across organizations and contract help 15
900 800 700 600 500 400 300 200 100 0 Activity Log by Date/Hour December 10-26 Day 1 of Storm December 12 th 725 Alarms at 0100 Day 8-9 of Storm December 19-20 10 11 0123456789 13 14 15 16 17 18 19 20 21 22 230 1 10 11 23456789 12 13 14 15 16 17 18 19 20 21 22 230123456789 10 11 12 13 14 15 16 17 18 19 20 21 22 23012345678 10 11 12 9 13 14 15 16 17 18 19 20 21 22 230123456789 10 11 12 13 14 15 16 17 18 19 20 21 22 230123 4 567 10 8 11 9 12 13 14 15 16 17 18 19 20 21 22 230123456 7 10 11 89 12 13 14 15 16 17 18 19 20 21 22 23012345 6 10 11 789 12 13 14 15 16 17 18 19 20 21 22 2301234 5 10 678 11 9 12 13 14 15 16 17 18 19 20 21 22 230123456789 10 11 12 13 14 15 16 17 18 19 20 21 22 0 10 11 123456789 13 14 15 16 17 18 19 20 21 22 23012 3 10 11 456789 12 13 14 15 16 17 18 19 20 21 22 2301 2 345 6 10 11 789 12 13 14 15 16 17 18 19 20 21 22 230 1 234 5 10 11 6789 12 13 14 15 16 17 18 19 20 21 22 230123 4 10 11 56789 12 13 14 15 16 17 18 19 20 21 22 230123456789 10 11 12 13 14 15 16 17 18 19 20 21 22 230123456789 10 11 12 13 14 15 16 17 18 19 20 21 22 23 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 16
Day 1 December 12 th Activity Log >6,100 Alarms Control SCADA, 880, 14% Control Manual, 173, 3% Control Tag, 162, 3% RTNET/CA, 190, 3% ESCC, 239, 4% P&C Alarm, 1753, 28% Automatic, 838, 14% Alarm Gen, 304, 5% Alarm Voltage, 879, 14% Alarm Reactive, 592, 10% Alarm Thermal, 122, 2% 17
Day 1 December 12th Protection &Control 1,750 Alarms Relay, 195, 11% Annunciator, 116, 7% Battery, 131, 7% Power, 278, 16% Comm, 267, 15% Hydro, 48, 3% Equipment, 299, 17% Entry, 109, 6% DSCADA, 310, 18% 18
Alarm Handling Techniques System Activity Display shows all alarms and messages Exception Displays for SCADA Data in an abnormal state Alarm Summary Display for unacknowledged alarms Segment alarms by category and severity Hide analog alarms that reset within certain timeframe Acknowledged alarm roll off display 19
Hidden Alarm Feature December 12 th 12% Hidden December 19-20 80% hidden from single point that was toggling 88% 20% 12% 80% 20
Storm Alarms Analysis 6% Status alarms toggled state on December 12 th 12% Analog alarms hidden on December 12 th 80% Analog alarms hidden on December 19-20, Single point chattering causes 7200 messages on System Activity Display Future Action Reduce annual alarm volume by 10-20% 21
Conclusions PSNH is very fortunate to have very dedicated and resourceful employees PSNH s Incident Management System process works well regardless of size Municipal and State partners step up Redundancies are vital in the supply chain Satellite distribution centers increase coordination and efficiency Proactive media outreach and use of new social media tools very effective Hardest hit communities need targeted communication Tree trimming continues to be vital Lines of authority and jurisdiction important for safe operation 22
Free Firewood Questions 23