9/11 Pager Messages

CAM:mcfl1u0q:20010911054900 mcfl1u0q trapd 10591 MQTRANS000 CAM: All Systems Normal

mcfl1u1m SP: mcfl1u1m:Tue Sep 11 07:01:41 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u1m

mcfl1u1m SP: mcfl1u1m:Tue Sep 11 07:30:11 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u1m

mcfl1u0p SP: BV_Log L1 Oracle Error (1 Total): 1906836:Tue Sep 11 07:33:32 2001 (1000208012.642059) genericdb[23666]@mcfl1u0p:<1.0>:L1:S05 bv_db_ex_handler:[SERVERERROR] ORA-00917: missing comma

mcfl1u1m SP: mcfl1u1m:Tue Sep 11 10:30:10 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u1m

mcfl1u0m SP: mcfl1u0m:Tue Sep 11 10:30:06 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u0m

Monitor [1000 errors - Across All Applications] Total Errors = 68 @ 9/11/2001 11:00:49 AM Threshold changed to 150

mcfl1u1m SP: mcfl1u1m:Tue Sep 11 11:00:11 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u1m

mcfl1u0m SP: mcfl1u0m:Tue Sep 11 11:00:05 EDT 2001: alert The MQTransportDir is

not Running ..on mcfl1u0m

mcfl1u1m SP: mcfl

1u1m:Tue Sep 11 11:30:11 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u1m

mcfl1u0m SP: mcfl1u0m:Tue Sep 11 11:30:06 EDT 2001: alert The MQTransportDir is not R

unning ..on mcfl1u0m

mcfl1u1m SP: mcfl1u1m:Tue Sep 11 12:00:10 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u1m

mcfl1u0m SP: mcfl1u0m:Tue Sep 11 12:00:06 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u0m

mcfl1u1m SP: mcfl1u1m:Tue Sep 11 12

:30:11 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u1m

mcfl1u0m SP: mcfl1u0m:Tue Sep 11 12:30:05 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u0m

mcfl1u1m SP: mcfl1u1m:Tue Sep 11 13:00:11 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u1m

mcfl1u0m SP: mcfl1u0m:Tue Sep 11 13:00:05 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u0m

mcfl1u1m SP: mcfl1u1m:Tue Sep 11 13:30:11 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u1m

mcfl1u0m SP: mcfl1u0m:Tue Sep 11 13:30:06 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u0m

mcfl1u1m SP: mcfl1u1m:Tue Sep 11 14:00:11 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u1m

mcfl1u0q SP: BV_Log L1 Oracle Error (1 Total): 3149300:Tue Sep 11 13:50:02 2001 (1000230602.658020) genericdb[13439]@mcfl1u0q:<1.0>:L1:S05 bv_db_ex_handler:[SERVERERROR] ORA-00917: missing comma

mcfl1u0m SP: mcfl1u0m:Tue Sep 11 14:00:06 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u0m

mcfl1u1m SP: mcfl1u1m:Tue Sep 11 14:30:11 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u1m

mcfl1u0m SP: mcfl1u0m:Tue Sep 11 14:30:06 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u0m

mcfl1u1m SP: mcfl1u1m:Tue Sep 11 15:00:11 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u1m

mcfl1u0m SP: mcfl1u0m:Tue Sep 11 15:00:06 EDT 2001: alert The MQTransp

ortDir is not Running ..on mcfl1u0m

mcfl1u0r SP: BV_Log L1 Oracle Error (1 Total): 3731868:Tue Sep 11 15:12:35 2001 (10002355

55.113367) genericdb[13737]@mcfl1u0r:<1.0>:L1:S05 bv_db_ex_handler:[SERVERERROR] ORA-00917: missing comma

Wellmed is intermittently having timeouts and the monitor has been disabled currently. Will continue to monitor. - Aaron SMTC

Oracle Errors related to OPR release no impact to user, will be addressed tomorrow. - John M

mcfl1u1m SP: mcfl1u1m:Tue Sep 11 15:30:10 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u1m

mcfl1ujc SP: BV_Log L1 Oracle Error (1 Total): 3813743:Tue Sep 11 15:17:44 2001 (1000235864.140909) gene

ricdb[12280]@mcfl1ujc:<1.0>:L1:S05 bv_db_ex_handler:[SERVERERROR] ORA-00917: missing comma

mcfl1u0m SP: mcfl1u0m:Tue Sep 11 15:30:06 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u0m

mcfl1u1m SP: mcfl1u1m:Tue Sep 11 16:00:11 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u1m

mcfl1u0m SP: mcfl1u0m:Tue Sep 11 16:00:06 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u0m

Monitor [1000 error Forms/Envelopes] Total Errors = 12 @ 9/11/2001 4:26:04 PM Threshold changed to 110

mcfl1u1m SP: mcfl1u1m:Tue Sep 11 16:30:11 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u1m

mcfl1u0m SP: mcfl1u0m:Tue Sep

11 16:30:06 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u0m

mcfl1u1m SP: mcfl1u1m:Tue Sep 11 17:00:11 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u1m

mc

fl1u0m SP: mcfl1u0m:Tue Sep 11 17:00:06 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u0m

mcfl1u1m SP: mcfl1u1m:Tue Sep 11 17:30:11 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u1m

mcfl1ujc SP: BV_Log L1 Oracle Error (2 Total): 4693701:Tue Sep 11 17:29:25 2001 (1000243765.352276) genericdb[14607]@mcfl1ujc:<1.0>:L1:S05 bv_db_ex_handler:[SERVERERROR] ORA-00917: missing comma

mcfl1u0m SP: mcfl1u0m:Tue Sep 11 17:30:06 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u0m

mcfl1u1m SP: mcfl1u1m:Tue Sep 11 18:00:11 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u1m

mcfl1u1m SP: mcfl1u1m:Tue Sep 11 18:30:11 EDT 2001: alert The MQTransportDir is not Running ..on mcfl1u1m

mcfl1u0s: Core found on mcfl1u0s. "core.0911.1930" "2001-09-11

mcfl1u0r SP: BV_Log L1 Oracle Error (2 Total): 5353657:Tue Sep 11 19:29:36 2001 (1000250976.221259) genericdb[13030]@mcfl1u0r:<1.0>:L1:S05 bv_db_ex_hand

ler:[SERVERERROR] ORA-00917: missing comma

mcfl1u0s: Core found on mcfl1u0s. "core.0911.2055" "2001-09-11

Core on u0s at 0911 1930 -- no stack trace -- T. Sommers

Core on u0s at 0911 2055 -- no stack trace -- T. Sommers

SSeer Err: SiteScope/Web Servers/BroadVision Login for Host1 Akamai Off/43829/unable to reach server on (step 1), https://host1

SSeer Err: SiteScope/Web Servers/BroadVision Login for Host2 Akamai Off/3674/unable to reach server on (step 1), https://host2.

B2C Site appears to be inaccessible from the Internet - Networking service / SMTC are researching. RobL

SSeer Err: SiteScope/Web Servers/Home Page - Frames & Images, ak=off/18878/unable to reach server/

SSeer Err: SiteScope/Web Servers/www index.jsp - Akamai Off/72541/unable to reach server/

SSeer Err: SiteScope/Web Servers/Host1 Index.jsp/72454/unable to reach server/

SSeer Err: SiteScope/Web Servers/Host1 Seed Page/72466/unable to reach server/

SSeer Err: SiteScope/Web Servers/Host2 index.jsp/72528/unable to reach server/

SSeer Err: SiteScope/Web Servers/Host2 Seed Page/72533/unable to reach server/

SSeer Err: SiteScope/Web Servers/Data Delivery FTP Server - Host3/72563/unable to reach server/

SSeer Err: SiteScope/Web Servers/uhcpharmacy Virtual Server /36420/unable to reach server/

SSeer Err: SiteScope/Web Servers/Highmark Partner Page/72559/unable to reach server/

SSeer OK: SiteScope/Web Servers/Home Page - Frames & Images, ak=off/18882/Total 5.14 sec (DNS 0.03 sec, connect 0.70 sec, respon

SSeer OK: SiteScope/Web Servers/Host1 Index.jsp/72458/Total 1.39 sec (DNS 0.00 sec, connect 0.15 sec, response 1.04 sec, downloa

SSeer OK: SiteScope/Web Servers/Host1 Seed Page/72470/Total 0.40 sec (DNS 0.00 sec, connect 0.07 sec, response 0.32 sec, downloa

B2C Site now accessible from the Internet - Issue appears to be related to a AT&T circuit in NYC. IISG, Networking services and SMTC are researching. RobL.

SSeer OK: SiteScope/Web Servers/Host2 Seed Page/72536/Total 0.40 sec (DNS 0.00 sec, connect 0.07 sec, response 0.32 sec, downloa

SSeer OK: SiteScope/Web Servers/www index.jsp - Akamai On/72552/Total 9.86 sec (DNS 1.39 sec, connect 3.55 sec, response 3.43 se

SSeer OK: SiteScope/Web Servers/BroadVision Login for Host2 Akamai Off/3678/12.81 sec, 10 steps, 67K total/

SSeer OK: SiteScope/Web Servers/Data Delivery FTP Server - Host3/72566/3.21 sec/

SSeer OK: SiteScope/Web Servers/Highmark Partner Page/72561/0.68 sec/

SSeer OK: SiteScope/Web Servers/uhcpharmacy Virtual Server /36422/1.20 sec/

SSeer OK: SiteScope/Web Servers/BroadVision Login for Host2 Akamai On/7270/12.39 sec, 10 steps, 70K total/

SSeer Err: SiteScope/Web Servers/www index.jsp - Akamai On/72552/Total 9.86 sec (DNS 1.39 sec, connect 3.55 sec, response 3.43 s

SSeer Err: SiteScope/Web Servers/Web01 Seed Page/72552/Total 0.17 sec (DNS 0.00 sec, connect 0.07 sec, response 0.09 sec, downlo

SSeer OK: SiteScope/Web Servers/www index.jsp - Akamai Off/72545/Total 5.79 sec (DNS 0.04 sec, connect 0.61 sec, response 4.15 s

SSeer OK: SiteScope/Web Servers/BroadVision Login for Host1 Akamai Off/43834/12.25 sec, 10 steps, 67K total/

SSeer OK: SiteScope/Web Servers/Host2 index.jsp/72531/Total 0.96 sec (DNS 0.00 sec, connect 0.15 sec, response 0.63 sec, downloa

Update: Verizon/GTE circuit 32HFGY582652 went down 2 blocks from World Trade Center. Ticket has been opened. Sire is recovering. Internet Ops. DW

mcfl1u0q: Core found on mcfl1u0q. "core.0911.2315" "2001-09-11