9/11 Pager Messages
2001-09-11
09:33:42
Arch
[0568640]
A
ALPHA
|CCO-P1 NOTICE #4243775 |sendmail down on
2001-09-11
09:33:44
Arch
[0568640]
A
ALPHA
cco-sj-1. Minimal impact due to load balancing on cco-sj-2 and -3. Support investigating. OUTAGE START: 11 Sep 06:19 PT NO ETU. Ops 408.527.0007 |187
2001-09-11
09:41:27
Arch
[0568640]
A
ALPHA
|ERP-P1 NOTICE #4243807 |SJPROD down. ERP production db unable to accept new connections and impacting access to Status Agent. Support escalation in progress. OUTAGE START: 11 Sep 6:33 PT NO ETU. Ops 408.527.0007 |213
2001-09-11
10:08:53
Arch
[0568640]
A
ALPHA
|ERP-P1 UPDATE/CL
2001-09-11
10:08:55
Arch
[0568640]
A
ALPHA
OSE PENDING #4243807 |SJPROD db instance on host high was hung and is now up. ERP production db is now able to accept new connections. Status Agent is also available. ERP_dba's restarted instance to restore service. -1/2
2001-09-11
10:08:57
Arch
[0568640]
A
ALPHA
OUTAGE START: 11 Sep 6:33 PT END: 11 Sep 7:00 PT Ops 408.527.0007 |299 -2/2
2001-09-11
10:09:17
Arch
[0568640]
A
ALPHA
|CCO-P1 UPDATE #4243775 |cco-sj-1 not responding. Support removing host from service to allow apps availibility on cco-sj-2 and -3. OUTAGE START: 11 Sep 06:19 PT NO ETU.
2001-09-11
10:09:19
Arch
[0568640]
A
ALPHA
Ops 408.527.0007 |187
2001-09-11
11:30:00
Arch
[0568640]
A
ALPHA
|CCO-P1 CLOSE PENDING #4243775 |cco-sj-1 has been brought back in to service. Support continues to investigate cause of outage. OUTAGE START: 11 Sep 06:19 PT END: 11 Sep 08:00 PT Ops 408.527.0007 |196
2001-09-11
14:30:48
Arch
[0568640]
A
ALPHA
|P1 NOTICE #4244617 |CCEWP unavailable on ladybird impacting content delopyment to CCO. Support is investigating. OUTAGE START: 11 Sep 11:21 PT NO ETU. Ops 40
2001-09-11
14:30:50
Arch
[0568640]
A
ALPHA
8.527.0007 |169
2001-09-11
15:10:59
Arch
[0568640]
A
ALPHA
|P1 CLOSE PENDING #4244617 |CCEWP available on ladybird. Clients can deploy content to CCO. Support restarted applic to restore service. OUTAGE START: 11 Sep 11:21 PT END: 11 Sep 12:05 PT Ops 40
2001-09-11
15:11:01
Arch
[0568640]
A
ALPHA
8.527.0007 |205
2001-09-11
15:41:34
Arch
[0568640]
A
ALPHA
|P1 NOTICE #4244953 |sjc-i2prod has system resource issues impacting access to Demand Planning tool to forecast product demand. Support rebooting host. OUTAGE START: 11 Sep 12:32 PT ETU: 11 Sep 14:00 PT Ops 408.527.0007 |220
2001-09-11
17:12:28
Arch
[0568640]
A
ALPHA
|P1 UPDATE #4244953 |sjc-i2prod still unavailable impacting access to Demand Planning tool to forecast product demand. Support continues to investigate. OUTAGE START: 11 Sep 12
2001-09-11
17:12:30
Arch
[0568640]
A
ALPHA
:32 PT NO ETU. Ops 408.527.0007 |208
2001-09-11
18:47:22
Arch
[0568640]
A
ALPHA
|P1 UPDATE #4244953 |sjc-i2prod and Demand Planning tool still unavailable. Support working to fix hive corruption to restore services to host and application. OUTAGE START: 11 Sep 12:32 PT NO ETU. djaramil 408.527.0007 |220
2001-09-11
20:19:51
Arch
[0568640]
A
ALPHA
|P1 NOTICE #4245646 |outback-ams and outback-ams1 down impacting availability of NATKIT - NSA's customer network troubleshooting application - in EMEA. Support investigating. OUTAGE START: 11 Sep 17:09 PT NO ETU. Op
2001-09-11
20:19:53
Arch
[0568640]
A
ALPHA
s 408-527-0007 |230
2001-09-11
21:34:30
Arch
[0568640]
A
ALPHA
|P1 UPDATE/CLOSE PENDING #4245646 |NATKIT, NSA's customer network troubleshooting application in EMEA is available. Support rebooted servers to restore service. OUTAGE START: 11 Sep 17:09 PT END: 11 Sep 18:28 PT Ops 408-527-0007 |229
2001-09-11
22:18:45
Arch
[0568640]
A
ALPHA
|P1 UPDATE #4244953 |sjc-i2prod and Demand Planning tool still unavailable. Support attempting to bring dev serve
2001-09-11
22:18:47
Arch
[0568640]
A
ALPHA
r into production to replace corrupted server. OUTAGE START: 11 Sep 12:32 PT NO ETU. Ops 408.527.0007 |215
2001-09-11
23:32:45
Arch
[0568640]
A
ALPHA
|P1 CLOSE PENDING #4244953 |sjc-i2prod and Demand Planning tool are up. Support replaced corrupted server with de
2001-09-11
23:32:48
Arch
[0568640]
A
ALPHA
velopment server to restore service. OUTAGE START: 11 Sep 12:32 PT END: 11 Sep 20:31 PT Ops 408.527.0007 |218