9/11 Pager Messages
2001-09-11
05:59:36
Skytel
[005384638]
D
ALPHA
oracle@hqfas14.desc.dla.mil|Errors found in routine alert file checkup of fest on hqfas14 at 09/11/01 06:00:00. Check /u001/app/oracle/admin/scripts/dba/data/monAlertLogErrors.fest.ERROR_LOG.110901_060000 for error message.|****************
2001-09-11
09:08:39
Skytel
[005384638]
D
ALPHA
oracle@rifas58.desc.dla.mil|Errors found in routine alert file checkup of fesd on rifas58.desc.dla.mil at 09/11/01 08:25:01. Check /u001/app/oracle/admin/scripts/dba/data/monAlertLogErrors.fesd.ERROR_LOG.110901_082501 for error message.
2001-09-11
09:08:40
Skytel
[005384638]
D
ALPHA
|***
2001-09-11
09:09:52
Skytel
[005384638]
D
ALPHA
oracle@rifas58.desc.dla.mil|Critical Space Alert|Tablespace TEMP in database fesd has reached 99 percent utilization on rifas58.desc.dla.mil
2001-09-11
09:12:52
Skytel
[005384638]
D
ALPHA
oracle@hqfas01.desc.dla.mil|tablespace_full |Target Name : fesd.fesp.world Node Name : rifas58.desc.dla.mil Tablespace Full Tablespace TEMP is 99.93% full. 730.0 KBytes of free space remain. CRITICAL Sep 11 2001 08:28:43 AM
2001-09-11
09:13:52
Skytel
[005384638]
D
ALPHA
oracle@rifas58.desc.dla.mil|Critical Space Alert|Tablespace TEMP in database fesd has reached 99 percent utilization on rifas58.desc.dla.mil
2001-09-11
09:19:37
Skytel
[005384638]
D
ALPHA
oracle@rifas58.desc.dla.mil|Critical Space Alert|Tablespace TEMP in database fesd has reached 99 percent utilization on rifas58.desc.dla.mil
2001-09-11
10:34:07
Skytel
[005384638]
D
ALPHA
oracle@rifas12.desc.dla.mil|Errors found in routine alert file checkup of fesp on rifas12 at 09/11/01 10:35:06. Check /u001/app/oracle/admin/scripts/dba/data/monAlertLogErrors.fesp.ERROR_LOG.110901_103506 for error message.|******
2001-09-11
10:34:09
Skytel
[005384638]
D
ALPHA
**********
2001-09-11
11:07:52
Skytel
[005384638]
D
ALPHA
oracle@hqfas01.desc.dla.mil|db_down |Target Name : p2wp Node Name : rifas12.desc.dla.mil Database UpDown The database instance is down. CRITICAL Sep 11 2001 11:09:04 AM Node UpDown Event test "Node UpDown" is cleared CLEARED S
2001-09-11
11:07:54
Skytel
[005384638]
D
ALPHA
ep 1
2001-09-11
11:09:52
Skytel
[005384638]
D
ALPHA
oracle@hqfas01.desc.dla.mil|db_down |Target Name : fesp Node Name : rifas12.desc.dla.mil Database UpDown The database instance is down. CRITICAL Sep 11 2001 11:09:04 AM Node UpDown Event test "Node UpDown
2001-09-11
11:09:54
Skytel
[005384638]
D
ALPHA
" is cleared CLEARED Sep 1
2001-09-11
11:13:37
Skytel
[005384638]
D
ALPHA
oracle@hqfas01.desc.dla.mil|db_down |Target Name : fest Node Name : hqfas14.desc.dla.mil Database UpDown The database instance is down. CRITICAL Sep 11 2001 11:13:46 AM
2001-09-11
11:13:39
Skytel
[005384638]
D
ALPHA
Node UpDown Event test "Node UpDown" is cleared CLEARED Sep 1
2001-09-11
11:19:37
Skytel
[005384638]
D
ALPHA
oracle@hqfas01.desc.dla.mil|db_down |Target Name : fesn Node Name : hqfas14.desc.dla.mil
2001-09-11
11:19:39
Skytel
[005384638]
D
ALPHA
Database UpDown The database instance is down. CRITICAL Sep 11 2001 11:18:47 AM Node UpDown Event test "Node UpDown" is cleared CLEARED Sep 1
2001-09-11
11:38:52
Skytel
[005384638]
D
ALPHA
oracle@rifas12.desc.dla.mil|CRITICAL RESYNC
2001-09-11
11:38:54
Skytel
[005384638]
D
ALPHA
FAILURE ON rifas12|The fesp RMAN recovery catalog resync FAILED on rifas12 at 09/11/01 11:40:01 with exit status 1.
2001-09-11
11:40:39
Skytel
[005384638]
D
ALPHA
oracle@rifas12.desc.dla.mil|CRITICAL RESYNC FAILURE ON rifas12|The p2wp RMAN recovery catalog resync FAILED on rifas12 at 09/
2001-09-11
11:40:40
Skytel
[005384638]
D
ALPHA
11/01 11:40:01 with exit status 1.
2001-09-11
11:59:07
Skytel
[005384638]
D
ALPHA
oracle@rifas12.desc.dla.mil|CRITICAL RESYNC FAILURE ON rifas12|The p2wp RMAN recovery catalog resync FAILED on rifas12 at 09/11/01 12:00:01 with exit status 1.
2001-09-11
11:59:52
Skytel
[005384638]
D
ALPHA
oracle@rifas12.desc.dla.mil|CRITICAL RESYNC FAILURE ON rifas12|The fesp RMAN recovery catalog resync FAILED on rifas12 at 09/11/01 12:00:01 with exit status 1
2001-09-11
11:59:54
Skytel
[005384638]
D
ALPHA
.
2001-09-11
12:02:37
Skytel
[005384638]
D
ST
NUM 505-797-4428
2001-09-11
12:20:37
Skytel
[005384638]
D
ALPHA
oracle@rifas12.desc.dla.mil|CRITICAL RESYNC FAILURE ON rifas12|The p2wp RMAN recovery catalog resync FAILED on rifas12 at 09/11/01 12:20:01 with exit status 1.
2001-09-11
12:21:54
Skytel
[005384638]
D
ALPHA
oracle@rifas12.desc.dla.mil|CRITICAL RESYNC FAILURE ON rifas12|The fesp RMAN recovery catalog resync FAILED on rifas12 at 09/11/01 12:20:01 with exit status 1.
2001-09-11
12:30:39
Skytel
[005384638]
D
ALPHA
oracle@hqfas01.desc.dla.mil|listener_alerts |Target Name : listener_rifas58.desc.dla.mil Node Name : rifas58.desc.dla.mil Oracle Net UpDown The Oracle Net listener is down. CRITICAL Sep 11 2001 11:46:17 AM No
2001-09-11
12:30:41
Skytel
[005384638]
D
ALPHA
de UpDown Event test "No
2001-09-11
12:32:37
Skytel
[005384638]
D
ALPHA
oracle@hqfas01.desc.dla.mil|db_down |Target Name : fesd.fesp.world Node Name : rifas58.desc.dla.mil Database UpDown The database instance is down. CRITICAL Sep 11 2001 11:46:26 AM Node UpDown Event test "Node UpDown" is cl
2001-09-11
12:32:39
Skytel
[005384638]
D
ALPHA
eared CLE
2001-09-11
16:40:37
Skytel
[005384638]
D
ALPHA
oracle@rifas12.desc.dla.mil|CRITICAL RESYNC FAILURE ON rifas12|The fesp RMAN recovery catalog resync FAILED on rifas12 at 09/11/01 16:41:18 with exit status 1.
2001-09-11
16:41:37
Skytel
[005384638]
D
ALPHA
oracle@rifas12.desc.dla.mil|CRITICAL RESYNC FAILURE ON rifas12|The p2wp RMAN recovery catalog resync FAILED on rifas12 at 09/11/01 16:41:18 with exit status 1.
2001-09-11
16:44:37
Skytel
[005384638]
D
ALPHA
oracle@hqfas14.desc.dla.mil|Critical Event -- Listener Down|Database listener LISTENER is down on hqfas14 at 09/11/01 16:45:00
2001-09-11
16:45:37
Skytel
[005384638]
D
ALPHA
oracle@hqfas14.desc.dla.mil|Critical Event -
2001-09-11
16:45:39
Skytel
[005384638]
D
ALPHA
- Listener Down|Database listener LISTENER is down on hqfas14 at 09/11/01 16:45:03
2001-09-11
16:47:52
Skytel
[005384638]
D
ALPHA
oracle@hqfas14.desc.dla.mil|Errors found in routine alert file checkup of fest on hqfas14 at 09/11/01 16:45:01. Check /u001/app/oracle/admin/scripts/dba/data/monAlertLogErrors.fest.ERROR_LOG.110901_164501 for error message.|****************
2001-09-11
16:49:37
Skytel
[005384638]
D
ALPHA
oracle@hqfas14.desc.dla.mil|Critical Event -- Listener Down|Database listener LISTENER is down on hqfas14 at 09/11/01 16:50:01
2001-09-11
16:50:37
Skytel
[005384638]
D
ALPHA
oracle@hqfas14.desc.dla.mil|HQFAS14 Oracle Back Online|All Oracle processes on HQFAS14 have been restarted. BP
2001-09-11
16:51:37
Skytel
[005384638]
D
ALPHA
oracle@hqfas14.desc.dla.mil|Critical Event -- Listener Down|Database listener LISTENER is down on hqfas14 at 09/1
2001-09-11
16:51:39
Skytel
[005384638]
D
ALPHA
1/01 16:50:02
2001-09-11
17:00:37
Skytel
[005384638]
D
ALPHA
oracle@rifas12.desc.dla.mil|CRITICAL RESYNC FAILURE ON rifas12|The p2wp RMAN recovery catalog resync FAILED on
2001-09-11
17:00:39
Skytel
[005384638]
D
ALPHA
rifas12 at 09/11/01 17:01:18 with exit status 1.
2001-09-11
17:01:37
Skytel
[005384638]
D
ALPHA
oracle@rifas12.desc.dla.mil|CRITICAL RESYNC FAILURE ON rifas12|The fesp RMAN recovery catalog resync FAILED on rifas12 at 09/11/01 17:01:18 with exit status 1.
2001-09-11
17:19:52
Skytel
[005384638]
D
ALPHA
oracle@rifas12.desc.dla.mil|CRITICAL RESYNC FAILURE ON rifas12|The fesp RMAN recovery catalog resync FAILED on rifas12 at 09/11/01 17:21:18 with exit status 1.
2001-09-11
17:20:52
Skytel
[005384638]
D
ALPHA
oracle@rifas12.desc.dla.mil|CRITICAL RESYNC FAILURE ON rifas12|The p2wp RMAN recovery catalog resync FAILED on rifas12 at 09/11/01 17:21:23 with exit status 1.
2001-09-11
17:39:52
Skytel
[005384638]
D
ALPHA
oracle@rifas12.desc.dla.mil|CRITICAL RESYNC FAILURE ON rifas12|The fesp RMAN recovery catalog resync FAILED on rifas12 at 09/11/01 17:41:18 with exit status 1.
2001-09-11
17:41:37
Skytel
[005384638]
D
ALPHA
oracle@rifas12.desc.dla.mil|CRITICAL RESYNC FAILURE ON rifas12|The p2wp RMAN recovery catalog resync FAILED on
2001-09-11
17:41:39
Skytel
[005384638]
D
ALPHA
rifas12 at 09/11/01 17:41:18 with exit status 1.
2001-09-11
18:00:37
Skytel
[005384638]
D
ALPHA
oracle@rifas12.desc.dla.mil|CRITICAL RESYNC FAILURE ON rifas12|The fesp RMAN recovery catalog resync FAILED on rifas12 at 09/11/01 18:01:18 with exit status 1.
2001-09-11
18:01:37
Skytel
[005384638]
D
ALPHA
oracle@rifas12.desc.dla.mil|CRITICAL RESYNC FAILURE ON rifas12|The p2wp RMAN recovery catalog resync FAILED on rifas12 at 09/11/01 18:01:18 with exit status 1.
2001-09-11
18:19:52
Skytel
[005384638]
D
ALPHA
oracle@rifas12.desc.dla.mil|CRITICAL RESYNC FAILURE ON rifas12|The p2wp RMAN recovery catalog resync FAILED on rifas12 at 09/11/01 18:21:18 with exit status 1.
2001-09-11
18:20:52
Skytel
[005384638]
D
ALPHA
oracle@rifas12.desc.dla.mil|CRITICAL RESYNC FAILURE ON rifas12|The fesp RMAN recovery catalog resync FAILED on rifas12 at 09/11/01 18:21:18 with exit st
2001-09-11
18:20:54
Skytel
[005384638]
D
ALPHA
atus 1.
2001-09-11
18:39:52
Skytel
[005384638]
D
ALPHA
oracle@rifas12.desc.dla.mil|CRITICAL RESYNC FAILURE ON rifas12|The p2wp RMAN recovery catalog resync FAILED on rifas12 at 09/11/01 18:41:17 with exit status 1.
2001-09-11
18:41:37
Skytel
[005384638]
D
ALPHA
oracle@rifas12.desc.dla.mil|CRITICAL RESYNC FAILURE ON rifas12|The fesp RMAN recovery catalog resync FAILED on rifas12 at 09/11/01 18:41:17 with exit status 1.
2001-09-11
22:02:37
Skytel
[005384638]
D
ALPHA
root@rifas23.desc.dla.mil|CRITICAL BACKUP FAILURE|rifas12-ora-fesp Veritas Backup failed, Sep 11 22:02:55. Veritas Error # 1. Must contact On-Call SA before taking any action. the requested operation was partially
2001-09-11
22:02:39
Skytel
[005384638]
D
ALPHA
successful A pr
2001-09-11
22:03:37
Skytel
[005384638]
D
ALPHA
oracle@rifas12.desc.dla.mil|CRITICAL BACKUP FAILURE ON rifas12|The fesp Veritas backup FAILED on rifas12 at 09/11/01 22:03:52 with exit status 1.
2001-09-11
23:32:37
Skytel
[005384638]
D
ALPHA
root@rifas23.desc.dla.mil|CRITICAL BACKUP FAILURE|rifas12-ora-p2wp Veritas Backup failed, Sep 11 23:32:38. Veritas Error # 1. Must contact On-Call SA before taking any action. the requested operation was partially successful A pr
2001-09-11
23:34:37
Skytel
[005384638]
D
ALPHA
oracle@rifas12.desc.dla.mil|CRITICAL BACKUP FAILURE ON rifas12|The p2wp Veritas backup FAILED on rifas12 at 09/11/01 23:33:34 with exit status 1.
2001-09-12
00:05:52
Skytel
[005384638]
D
ALPHA
root@rifas23.desc.dla.mil|CRITICAL BACKUP FAILURE|rifas58-daily Veritas Backup failed, Sep 12 00:06:25. Veritas Error # 41. Must contact On-Call SA before taking any action. network connection timed out The server did not receive
2001-09-12
00:10:54
Skytel
[005384638]
D
ALPHA
root@rifas23.desc.dla.mil|CRITICAL BACKUP FAILURE|rifas58-daily Veritas Backup failed, Sep 12 00:11:29. Veritas Error # 41. Must contact On-Call SA before taking any action. network connection timed out The server did not receive