1)Issue:Concurrent Manager is not coming up
Solution
------------
1. Bring down MT (Make sure no processes running)
2. Check the ICM lcok.
SELECT v$access.sid, v$session.serial#
FROM v$session,v$access
WHERE v$access.sid = v$session.sid and v$access.object = 'FND_CP_FNDSM'
GROUP BY v$access.sid, v$session.serial#;
3. Kill ICM lOCK.
alter system kill session 'SID,serial#';
4. Run cmlean.sql
-----------------------------------------------
2)IF DB is not Coming Down
----------------
check the Local process
ps -ef|grep LOCAL=NO
and kill by using this cmd
Action -- ps -ef | grep LOCAL=NO | grep sid | grep -v grep | awk '{ print "kill -9 " $2}' | ksh
3)Unable to find the controlfile location
--------------------
Check the Log file
-------------
WARNING:NFS file system /sid/oradata mounted with incorrect options(rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,hard,noacl,proto=tcp,port=65535,timeo=600,retrans=2,sec=sys,local_lock=none,addr=10.227.200.11)
WARNING:Expected NFS mount options: rsize>=32768,wsize>=32768,hard,noac/actimeo=0
WARNING:NFS file system /sid/oradata mounted with incorrect options(rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,hard,noacl,proto=tcp,port=65535,timeo=600,retrans=2,sec=sys,local_lock=none,addr=10.227.200.11)
WARNING:Expected NFS mount options: rsize>=32768,wsize>=32768,hard,noac/actimeo=0
ORA-00210: cannot open the specified control file
ORA-00202: control file: '/sid/oradata/data01/cntrl03.ctl'
ORA-27054: NFS file system where the file is created or resides is not mounted with correct options
Additional information: 3
Additional information: 1
ORA-00210: cannot open the specified control file
ORA-00202: control file: '/sid/oradata/data03/cntrl02.ctl'
if the issue is similar to this then
Action --mount the above mention moint pt with nolock opt & restart DB
-----------------------------
4)ISSUE--Not Getting SQL PROMPT while firing a command sqlplus / as sysdba
Action
-------
1. Shutdown the database and other processes related to the ORACLE_HOME
2. Navigate to $ORACLE_HOME/rdbms/lib
3. Take a backup of the current CONFIG.O and delete it :
mv config.o to config.o.bkp
4. Check the config.s or config.c to verify whether the name of the 'dba' and 'oper' groups are appropriate, if not correct them accordingly
5. MAke a new CONFIG.O by using the below command :
make -f ins_rdbms.mk config.o ioracle
6. Relink oracle
-----------------------------
5)Issue : Shared Library issue,soft link need to be disable
./opmnctl status
---------------------------------+--------------------+---------+---------
ias-component | process-type | pid | status
---------------------------------+--------------------+---------+---------
OC4JGroup:PEOPLESOFT | OC4J:sid | 7936 | Alive
OC4JGroup:PEOPLESOFT | OC4J:sid | N/A | Down
OC4JGroup:default_group | OC4J:home | 7934 | Alive
ASG | ASG | N/A | Down
HTTP_Server | HTTP_Server | N/A | Down
Log Details
-----------
/sid/ias/product/asmt_10131/Apache/Apache/bin/apachectl startssl: execing httpd
/sid/ias/product/asmt_10131/Apache/Apache/bin/httpd: error while loading shared libraries: libdb.so.2: cannot open shared object file: No such file or directory
Issue : This is Shared Library issue,soft link need to be disable
Action : disable link
---------------------------------------------
6)ISSUE : While submitting CONCURRENT PRG(Active Users), its submitted with Completed ERROR
Log File Details
-------------
tail -30f l8343015.req
Current NLS_LANG and NLS_NUMERIC_CHARACTERS Environment Variables are :
American_America.UTF8
'.,'
ar60run: relocation error: /sid/product/806/network/jre11/lib/i686/native_threads/libjava.so: symbol __libc_wait, version GLIBC_2.0 not defined in file libc.so.6 with link time reference
+---------------------------------------------------------------------------+
Start of log messages from FND_FILE
+---------------------------------------------------------------------------+
+---------------------------------------------------------------------------+
End of log messages from FND_FILE
+---------------------------------------------------------------------------+
Program exited with status 127
Concurrent Manager encountered an error while running Oracle*Report for your concurrent request 8343015.
Review your concurrent request log and/or report output file for more detailed information.
+---------------------------------------------------------------------------+
Executing request completion options...
Finished executing request completion options.
+---------------------------------------------------------------------------+
Concurrent request completed
Current system time is 01-APR-2015 03:31:36
Action
----------
install compat-libcwait-2.1-2.x86_64.rpm,After that bounce CM
------------------------
7) Issue while starting weblogic Admin server
-----------
PRNG=true>
<Apr 12, 2015 2:39:05 AM CDT> <Info> <WebLogicServer> <BEA-000377> <Starting WebLogic Server with Java HotSpot(TM) 64-Bit Server VM Version 14.3-b01 from Sun Microsystems Inc.>
<Apr 12, 2015 2:39:16 AM CDT> <Info> <Management> <BEA-141281> <unable to get file lock, will retry ...>
<Apr 12, 2015 2:39:26 AM CDT> <Info> <Management> <BEA-141281> <unable to get file lock, will retry ...>
<Apr 12, 2015 2:39:36 AM CDT> <Info> <Management> <BEA-141281> <unable to get file lock, will retry ...>
Solution
----------
1.Clear cache and tmp under AdminServer
bash-3.00$ pwd
/sid/disco11g/product/user_projects/domains/sid/servers/AdminServer
bash-3.00$
Solution
------------
1. Bring down MT (Make sure no processes running)
2. Check the ICM lcok.
SELECT v$access.sid, v$session.serial#
FROM v$session,v$access
WHERE v$access.sid = v$session.sid and v$access.object = 'FND_CP_FNDSM'
GROUP BY v$access.sid, v$session.serial#;
3. Kill ICM lOCK.
alter system kill session 'SID,serial#';
4. Run cmlean.sql
-----------------------------------------------
2)IF DB is not Coming Down
----------------
check the Local process
ps -ef|grep LOCAL=NO
and kill by using this cmd
Action -- ps -ef | grep LOCAL=NO | grep sid | grep -v grep | awk '{ print "kill -9 " $2}' | ksh
3)Unable to find the controlfile location
--------------------
Check the Log file
-------------
WARNING:NFS file system /sid/oradata mounted with incorrect options(rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,hard,noacl,proto=tcp,port=65535,timeo=600,retrans=2,sec=sys,local_lock=none,addr=10.227.200.11)
WARNING:Expected NFS mount options: rsize>=32768,wsize>=32768,hard,noac/actimeo=0
WARNING:NFS file system /sid/oradata mounted with incorrect options(rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,hard,noacl,proto=tcp,port=65535,timeo=600,retrans=2,sec=sys,local_lock=none,addr=10.227.200.11)
WARNING:Expected NFS mount options: rsize>=32768,wsize>=32768,hard,noac/actimeo=0
ORA-00210: cannot open the specified control file
ORA-00202: control file: '/sid/oradata/data01/cntrl03.ctl'
ORA-27054: NFS file system where the file is created or resides is not mounted with correct options
Additional information: 3
Additional information: 1
ORA-00210: cannot open the specified control file
ORA-00202: control file: '/sid/oradata/data03/cntrl02.ctl'
if the issue is similar to this then
Action --mount the above mention moint pt with nolock opt & restart DB
-----------------------------
4)ISSUE--Not Getting SQL PROMPT while firing a command sqlplus / as sysdba
Action
-------
1. Shutdown the database and other processes related to the ORACLE_HOME
2. Navigate to $ORACLE_HOME/rdbms/lib
3. Take a backup of the current CONFIG.O and delete it :
mv config.o to config.o.bkp
4. Check the config.s or config.c to verify whether the name of the 'dba' and 'oper' groups are appropriate, if not correct them accordingly
5. MAke a new CONFIG.O by using the below command :
make -f ins_rdbms.mk config.o ioracle
6. Relink oracle
-----------------------------
5)Issue : Shared Library issue,soft link need to be disable
./opmnctl status
---------------------------------+--------------------+---------+---------
ias-component | process-type | pid | status
---------------------------------+--------------------+---------+---------
OC4JGroup:PEOPLESOFT | OC4J:sid | 7936 | Alive
OC4JGroup:PEOPLESOFT | OC4J:sid | N/A | Down
OC4JGroup:default_group | OC4J:home | 7934 | Alive
ASG | ASG | N/A | Down
HTTP_Server | HTTP_Server | N/A | Down
Log Details
-----------
/sid/ias/product/asmt_10131/Apache/Apache/bin/apachectl startssl: execing httpd
/sid/ias/product/asmt_10131/Apache/Apache/bin/httpd: error while loading shared libraries: libdb.so.2: cannot open shared object file: No such file or directory
Issue : This is Shared Library issue,soft link need to be disable
Action : disable link
---------------------------------------------
6)ISSUE : While submitting CONCURRENT PRG(Active Users), its submitted with Completed ERROR
Log File Details
-------------
tail -30f l8343015.req
Current NLS_LANG and NLS_NUMERIC_CHARACTERS Environment Variables are :
American_America.UTF8
'.,'
ar60run: relocation error: /sid/product/806/network/jre11/lib/i686/native_threads/libjava.so: symbol __libc_wait, version GLIBC_2.0 not defined in file libc.so.6 with link time reference
+---------------------------------------------------------------------------+
Start of log messages from FND_FILE
+---------------------------------------------------------------------------+
+---------------------------------------------------------------------------+
End of log messages from FND_FILE
+---------------------------------------------------------------------------+
Program exited with status 127
Concurrent Manager encountered an error while running Oracle*Report for your concurrent request 8343015.
Review your concurrent request log and/or report output file for more detailed information.
+---------------------------------------------------------------------------+
Executing request completion options...
Finished executing request completion options.
+---------------------------------------------------------------------------+
Concurrent request completed
Current system time is 01-APR-2015 03:31:36
Action
----------
install compat-libcwait-2.1-2.x86_64.rpm,After that bounce CM
------------------------
7) Issue while starting weblogic Admin server
-----------
PRNG=true>
<Apr 12, 2015 2:39:05 AM CDT> <Info> <WebLogicServer> <BEA-000377> <Starting WebLogic Server with Java HotSpot(TM) 64-Bit Server VM Version 14.3-b01 from Sun Microsystems Inc.>
<Apr 12, 2015 2:39:16 AM CDT> <Info> <Management> <BEA-141281> <unable to get file lock, will retry ...>
<Apr 12, 2015 2:39:26 AM CDT> <Info> <Management> <BEA-141281> <unable to get file lock, will retry ...>
<Apr 12, 2015 2:39:36 AM CDT> <Info> <Management> <BEA-141281> <unable to get file lock, will retry ...>
Solution
----------
1.Clear cache and tmp under AdminServer
bash-3.00$ pwd
/sid/disco11g/product/user_projects/domains/sid/servers/AdminServer
bash-3.00$
