9/11 Pager Messages

2001-09-11
04:07:55
Skytel
[002377819]
C
ALPHA
Martin.Monson@sun.com|T+10 minutes 01:55mst : Outage Notification|Console down. Backup email available. Sacto is running on backup email. Ticket
2001-09-11
04:08:55
Skytel
[002377819]
C
ALPHA
(SPU 1 of 1) : SRS2.1 SDT#1722819 Consoles in Brm and Sac are not refreshing - Both sites monitoring via backup email as of 01:05am - 01:05 - Casey Tucker
2001-09-11
04:28:40
Skytel
[002377819]
C
ALPHA
Martin.Monson@sun.com|T+30 minutes 01:55mst : Console Outage Notification|Console Down. Backup email working. Sacramento on backup email. Failover has been done but cannot log in as Bill and Bob are being restarted. Please call RMC @ (30
2001-09-11
04:47:40
Skytel
[002377819]
C
ALPHA
Martin.Monson@sun.com|T+46min 01:55mst : Console Outage Status Update|Failover to alternate has been done. All BRM consoles are up. Sac is up as well. Sulianti is investigating the primary. Will monitor console stability for 30min. Please
2001-09-11
05:04:10
Skytel
[002377819]
C
ALPHA
(SPU 1 of 1) : SRS2.1 SDT#1722819 Consoles in Brm and Sac are back up on alternate server - waiting 30min to ensure stability - 01:57 - Casey Tucker
2001-09-11
05:20:40
Skytel
[002377819]
C
ALPHA
Martin.Monson@sun.com|T+1hr20min 01:55mst : Console Outage Status Update|Failback to primary being done. console not yet stable. BRM and SAC on backup email. Will monitor console stability for 30min after failback is completed. Please cal
2001-09-11
05:31:25
Skytel
[002377819]
C
ALPHA
(SPU 1 of 1) : SRS2.1 SDT#1722819 Consoles in Brm and Sac are down again - now monitoring by backup email - 02:24 - Casey Tucker
2001-09-11
05:55:55
Skytel
[002377819]
C
ALPHA
Martin.Monson@sun.com|T+1hr50min: Console Outage Status Update|BRM and SAC consoles are now up. Failback to primary is completed. Root cause unknown at this time. Will monitor console for stability for 30min. Please call the RMC @(303)272
2001-09-11
06:25:55
Skytel
[002377819]
C
ALPHA
(SPU 1 of 1) : SRS2.1 SDT#1722819 Consoles in Brm and Sac are back up - waiting 30min to ensure stability - ETA 30min - 03:17 - Casey Tucker
2001-09-11
06:27:40
Skytel
[002377819]
C
ALPHA
Martin.Monson@sun.com|T +2hr20min 01:55mst : Status update|The monitoring system has been restored and has been stable for 30 minutes. Monitoring can resume as normal.
2001-09-11
06:52:40
Skytel
[002377819]
C
ALPHA
(SPU 1 of 1) : SRS2.1 SDT#1722819 CLOSED Consoles in Brm and Sac are back up and have been stable for 30min as of 03:45 - monitoring resumed as normal - Duration 160min - 03:45 - Casey Tucker
2001-09-11
10:35:40
Skytel
[002377819]
C
ALPHA
jacob.danforth@central.sun.com|8:20+10 minutes: SRS Monitoring System Outage|Monitoring system is
2001-09-11
10:35:42
Skytel
[002377819]
C
ALPHA
down. No backup email. Sacramento is also down. Ticket #1723038 logged. Please call RMC @ (303) 272-6944 to confirm customer notification
2001-09-11
10:41:55
Skytel
[002377819]
C
ALPHA
(SPU 1 of 1) : SRS2.1 SDT# 1723038 Consoles in Brm and Sac not refreshing - now monitoring via back up email - Specialist working on issue - No ETA - Casey Tucker
2001-09-11
11:00:11
Skytel
[002377819]
C
ALPHA
(SPU 1 of 1) : SRS2.1 SDT# 1723038 Sac and Brm are unable to monitor any customers via any method at this time - No ETA - 07:54 - Casey Tucker
2001-09-11
11:15:41
Skytel
[002377819]
C
ALPHA
(SPU 2 of 2) : to failover to backup, no ETA. Dave Mann 916-861-4574.
2001-09-11
11:17:41
Skytel
[002377819]
C
ALPHA
(SPU 1 of 2) : SRS2.1 SDT# 1723038 Sac and Brm unable to monitor by console or backup email at 7:20am PT. Sac and Brm are contacting customers to notify that we
2001-09-11
11:17:42
Skytel
[002377819]
C
ALPHA
are unable to monitor. Primary server down and unable
2001-09-11
11:25:41
Skytel
[002377819]
C
ALPHA
jacob.danforth@central.sun.com|8:20+60 minutes: SRS Monitoring System Outage|Monitoring system is down. No email backup. Sacramento is also down. Root cause unknown at this time. Please cal
2001-09-11
11:25:42
Skytel
[002377819]
C
ALPHA
l RMC @ (303) 272-6944 with questions.
2001-09-11
12:40:58
Skytel
[002377819]
C
ALPHA
jacob.danforth@central.sun.com|8:20+1 hour 45 minutes: Status update|The monitoring system has been restored and has been stable for 30 minutes. Be
2001-09-11
12:40:59
Skytel
[002377819]
C
ALPHA
ginning to notify customers that monitoring will resume.
2001-09-11
12:48:56
Skytel
[002377819]
C
ALPHA
(SPU 1 of 1) : 7:20 am + 145 minutes: SRS 2.X Outage Resolved. Blue and Gold consoles down at 7:20. Gold consoles back up at 9:15 am. Stable for 30 minutes. Dave Mann 916-861-4574.
2001-09-11
16:14:11
Skytel
[002377819]
C
ALPHA
jacob.danforth@central.sun.com|8:20+1 hour 45 minutes: Status update|Consoles in Broomfield are up and refreshing. Sacramento are at
2001-09-11
16:14:13
Skytel
[002377819]
C
ALPHA
tempting to log into their consoles now. Pleas call RMC @ (303) 272-6944 with any questions.
2001-09-11
16:45:41
Skytel
[002377819]
C
ALPHA
jacob.danforth@central.sun.com|8:20+30 minutes: SRS Monitoring System Outage|Monitoring system is down. No backup email. Beginning customer notification process. Sacramento will also notify there customers.
2001-09-11
16:45:43
Skytel
[002377819]
C
ALPHA
Root cause unknown. Please
2001-09-11
16:52:41
Skytel
[002377819]
C
ALPHA
jacob.danforth@central.sun.com|SRS Skytel pager malfunction|It appears old pages are being resent through a bug in Skytel. The monitoring center is functioning normally. Please ignore these pages.
2001-09-11
21:33:56
Skytel
[002377819]
C
ALPHA
(SPU 1 of 1) : 1815 <SRS V1.x Outage New SSMB router down did not respond to ping. attempted to concatc client--no responce. Ids notified on call comming in. Oscar Del Real 916 859 6868
2001-09-11
21:42:41
Skytel
[002377819]
C
ALPHA
(SPU 1 of 1) : 1835 <SRS V1.x Outage New TWC router down did not respond to ping. attempted to concatc client--no responce. Ids notified on call comming in. Oscar Del Real 916 859 6868
2001-09-11
22:02:41
Skytel
[002377819]
C
ALPHA
(SPU 1 of 1) : 30 Min. SRS V1.x Outage update SSMB router down did not respond to ping. UPDATE-IDS on site, attempting to contact sprint. Oscar Del Real 916 859 6868
2001-09-11
22:08:41
Skytel
[002377819]
C
ALPHA
(SPU 1 of 1) : 30 Min. SRS V1.x Outage update TWC router down did not respond to ping. UPDATE-IDS on site, attempting to contact sprint. Oscar Del Real 916 859 6868
2001-09-11
23:00:41
Skytel
[002377819]
C
ALPHA
(SPU 1 of 1) : 60 Min. SRS V1.x Outage update SSMB router down did not respond to ping. UPDATE-IDS opened Sprint Ticket. Oscar Del Real 916 859 6868
2001-09-11
23:09:41
Skytel
[002377819]
C
ALPHA
(SPU 1 of 1) : 60 Min. SRS V1.x Outage update TWC router down did not respond to ping. UPDATE-IDS opened Sprint Ticket. Oscar Del Real 916 859 6868
2001-09-12
00:03:41
Skytel
[002377819]
C
ALPHA
(SPU 1 of 1) : 120 Min. SRS V1.x Outage update TWC router down did not respond to ping. UPDATE-IDS opened Sprint Ticket. no further pages until change in status. Oscar Del Real 916 859 6868
2001-09-12
00:04:41
Skytel
[002377819]
C
ALPHA
(SPU 1 of 1) : 120 Min. SRS V1.x Outage update SSMB router down did not respond to ping. UPDATE-IDS opened Sprint Ticket. no further pages until change in status. Oscar Del Real 916 859 6868