Вы находитесь на странице: 1из 19

Regular RAC Commands

Oracle Clusterware Log Directory Structure

CRS_HOME/log/hostname/crsd/ - The log files for the CRS daemon


CRS_HOME/log/hostname/cssd/ - The log files for the CSS daemon
CRS_HOME/log/hostname/evmd/ - The log files for the EVM daemon
CRS_HOME/log/hostname/client/ - The log files for the Oracle Cluster Registry (OCR)

CRS_HOME/log/hostname/racg/ - The log files for the Oracle RAC high availability
component
CRS_HOME/log/hostname/racg/ - The log files for the Oracle RAC high availability
component
CRS_HOME/log/hostanme/alert.log The alert.log for Clusterware issues.

Please note that the CRS_HOME is the directory in which the Oracle Clusterware
software was installed and hostname
is the name of the node

to check the current status of crs

[oracle@rac1 bin]$ ./crsctl check crs


CRS-4638: Oracle High Availability Services is online
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
[oracle@rac1 bin]$
[oracle@rac1 bin]$

to check the current status of a cluster


[oracle@rac1 bin]$ ./crsctl check cluster
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
[oracle@rac1 bin]$

To check Cluster status on both nodes.


[oracle@rac1 bin]$ ./crsctl check cluster -all
**************************************************************
rac1:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
rac2:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************

To check the status of the services onto the cluster

[oracle@rac1 bin]$ ./crsctl status res -t


--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ARCH.dg
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.DATA.dg
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.LISTENER.lsnr
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.OCR_VOTING_DSK.dg
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.asm
ONLINE ONLINE rac1 Started
ONLINE ONLINE rac2 Started
ora.gsd
OFFLINE OFFLINE rac1
OFFLINE OFFLINE rac2
ora.net1.network
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.ons
ONLINE ONLINE rac1
ONLINE ONLINE rac2
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE rac2
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE rac1
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE rac1
ora.cvu
1 ONLINE ONLINE rac1
ora.oc4j
1 ONLINE ONLINE rac1
ora.rac.db
1 ONLINE ONLINE rac1 Open
2 ONLINE ONLINE rac2 Open
ora.rac1.vip
1 ONLINE ONLINE rac1
ora.rac2.vip
1 ONLINE ONLINE rac2
ora.scan1.vip
1 ONLINE ONLINE rac2
ora.scan2.vip
1 ONLINE ONLINE rac1
ora.scan3.vip
1 ONLINE ONLINE rac1
[oracle@rac1 bin]$

[oracle@rac1 bin]$ ./crsctl status resource -t


--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ARCH.dg
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.DATA.dg
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.LISTENER.lsnr
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.OCR_VOTING_DSK.dg
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.asm
ONLINE ONLINE rac1 Started
ONLINE ONLINE rac2 Started
ora.gsd
OFFLINE OFFLINE rac1
OFFLINE OFFLINE rac2
ora.net1.network
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.ons
ONLINE ONLINE rac1
ONLINE ONLINE rac2
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE rac2
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE rac1
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE rac1
ora.cvu
1 ONLINE ONLINE rac1
ora.oc4j
1 ONLINE ONLINE rac1
ora.rac.db
1 ONLINE ONLINE rac1 Open
2 ONLINE ONLINE rac2 Open
ora.rac1.vip
1 ONLINE ONLINE rac1
ora.rac2.vip
1 ONLINE ONLINE rac2
ora.scan1.vip
1 ONLINE ONLINE rac2
ora.scan2.vip
1 ONLINE ONLINE rac1
ora.scan3.vip
1 ONLINE ONLINE rac1

To check version of oracle clusterware.


[oracle@rac1 bin]$ ./crsctl query crs softwareversion
Oracle Clusterware version on node [rac1] is [11.2.0.4.0]
[oracle@rac1 bin]$ ./crsctl query crs activeversion
Oracle Clusterware active version on the cluster is [11.2.0.4.0]
[oracle@rac1 bin]$

[oracle@rac1 bin]$ ./crsctl query crs releaseversion


Oracle High Availability Services release version on the local node is [11.2.0.4.0]
[oracle@rac1 bin]$

To check status of nodes

[oracle@rac1 bin]$ ./olsnodes -n -i


rac1 1 rac1-vip
rac2 2 rac2-vip
[oracle@rac1 bin]$
[oracle@rac1 bin]$ ./olsnodes -n -s
rac1 1 Active
rac2 2 Active

To display the database name

[oracle@rac1 bin]$ srvctl config database


RAC
[oracle@rac1 bin]$

To display the configuration details of the database.

[oracle@rac1 bin]$ srvctl config database -d RAC


Database unique name: RAC
Database name: RAC
Oracle home: /u01/app/oracle/product/11.2.0.4/db_1
Oracle user: oracle
Spfile: +DATA/RAC/spfileRAC.ora
Domain:
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools: RAC
Database instances: RAC1,RAC2
Disk Groups: DATA,ARCH
Mount point paths:
Services:
Type: RAC
Database is administrator managed
[oracle@rac1 bin]$

To display the status of the database

[oracle@rac1 bin]$ srvctl status database -d RAC


Instance RAC1 is running on node rac1
Instance RAC2 is running on node rac2
To check nodeapps running on a node:-

[oracle@rac1 bin]$ srvctl status service -d RAC


[oracle@rac1 bin]$
[oracle@rac1 bin]$ srvctl status nodeapps
VIP rac1-vip is enabled
VIP rac1-vip is running on node: rac1
VIP rac2-vip is enabled
VIP rac2-vip is running on node: rac2
Network is enabled
Network is running on node: rac1
Network is running on node: rac2
GSD is disabled
GSD is not running on node: rac1
GSD is not running on node: rac2
ONS is enabled
ONS daemon is running on node: rac1
ONS daemon is running on node: rac2

to check the voting disk location

[oracle@rac1 bin]$
[oracle@rac1 bin]$ ./crsctl query css votedisk
## STATE File Universal Id File Name Disk group
-- ----- ----------------- --------- ---------
1. ONLINE 963ea0d463bd4fadbfa5be21e3c856a2 (/dev/oracleasm/disks/DISK1)
[OCR_VOTING_DSK]
Located 1 voting disk(s).

to check the OCR status

[oracle@rac1 bin]$ ./ocrcheck


Status of Oracle Cluster Registry is as follows :
Version : 3
Total space (kbytes) : 262120
Used space (kbytes) : 3020
Available space (kbytes) : 259100
ID : 1547834023
Device/File Name : +OCR_VOTING_DSK
Device/File integrity check succeeded

Device/File not configured

Device/File not configured

Device/File not configured

Device/File not configured

Cluster registry integrity check succeeded

Logical corruption check bypassed due to non-privileged user


to check the backup status of ocr

[oracle@rac1 bin]$ ./ocrconfig -showbackup


PROT-24: Auto backups for the Oracle Cluster Registry are not available
PROT-25: Manual backups for the Oracle Cluster Registry are not available

to perform manual backup of ocr

[oracle@rac1 bin]$ su - root


Password:
[root@rac1 ~]#
[root@rac1 ~]#
[root@rac1 ~]# cd /u01/app/11.2.0.4/grid/bin/
[root@rac1 bin]# ./ocrconfig -manualbackup

rac1 2017/04/15 20:08:03 /u01/app/11.2.0.4/grid/cdata/rac-


scan/backup_20170415_200803.ocr
[root@rac1 bin]#
[root@rac1 bin]#

To check the backup of ocr


[root@rac1 bin]# ./ocrconfig -showbackup
PROT-24: Auto backups for the Oracle Cluster Registry are not available
rac1 2017/04/15 20:08:03 /u01/app/11.2.0.4/grid/cdata/rac-
scan/backup_20170415_200803.ocr

stop the database

[oracle@rac1 ~]$ cd /u01/app/11.2.0.4/grid/bin/


[oracle@rac1 bin]$ ./srvctl status database -d RAC
Instance RAC1 is running on node rac1
Instance RAC2 is running on node rac2
[oracle@rac1 bin]$
To stop the database
[oracle@rac1 bin]$ ./srvctl stop database -d RAC

To check the status of the database.


[oracle@rac1 bin]$ ./srvctl status database -d RAC
Instance RAC1 is not running on node rac1
Instance RAC2 is not running on node rac2

To start the database

[oracle@rac1 bin]$ ./srvctl start database -d RAC


[oracle@rac1 bin]$
[oracle@rac1 bin]$
[oracle@rac1 bin]$ ./srvctl status database -d RAC
Instance RAC1 is running on node rac1
Instance RAC2 is running on node rac2

to check the listener


[oracle@rac1 bin]$ ./srvctl status listener -n rac1
Listener LISTENER is enabled on node(s): rac1
Listener LISTENER is running on node(s): rac1

[oracle@rac1 bin]$ ./srvctl status listener -n RAC2


Listener LISTENER is enabled on node(s): RAC2
Listener LISTENER is running on node(s): RAC2

To stop specific listener

[oracle@rac1 bin]$ ./srvctl stop listener -n rac1

[oracle@rac1 bin]$ ./srvctl status listener -n RAC1


Listener LISTENER is enabled on node(s): RAC1
Listener LISTENER is not running on node(s): RAC1

[oracle@rac1 bin]$ ./srvctl start listener -n rac1

[oracle@rac1 bin]$ ./srvctl status listener -n RAC1


Listener LISTENER is enabled on node(s): RAC1
Listener LISTENER is running on node(s): RAC1

to display the current configuration of SCAN IP's.


[oracle@rac1 bin]$ srvctl config scan
SCAN name: rac-scan, Network: 1/192.168.56.0/255.255.255.0/eth0
SCAN VIP name: scan1, IP: /rac-scan/192.168.56.91
SCAN VIP name: scan2, IP: /rac-scan/192.168.56.92
SCAN VIP name: scan3, IP: /rac-scan/192.168.56.93

To display the scan listener status

[oracle@rac1 bin]$ srvctl status scan


SCAN VIP scan1 is enabled
SCAN VIP scan1 is running on node rac2
SCAN VIP scan2 is enabled
SCAN VIP scan2 is running on node rac1
SCAN VIP scan3 is enabled
SCAN VIP scan3 is running on node rac1

to stop the specific instance

[oracle@rac1 bin]$ ./srvctl status database -d RAC


Instance RAC1 is running on node rac1
Instance RAC2 is running on node rac2
[oracle@rac1 bin]$
[oracle@rac1 bin]$

[oracle@rac1 bin]$
[oracle@rac1 bin]$ srvctl stop instance -d RAC -i RAC1

[oracle@rac1 bin]$ ./srvctl status database -d RAC


Instance RAC1 is not running on node rac1
Instance RAC2 is running on node rac2
[oracle@rac1 bin]$
[oracle@rac1 bin]$
[oracle@rac1 bin]$
to start the specific instance.
[oracle@rac1 bin]$ ./srvctl start instance -d RAC -i RAC1
[oracle@rac1 bin]$
[oracle@rac1 bin]$
[oracle@rac1 bin]$ ./srvctl status database -d RAC
Instance RAC1 is running on node rac1
Instance RAC2 is running on node rac2

To stop the database

[oracle@rac1 bin]$ srvctl status database -d RAC


Instance RAC1 is running on node rac1
Instance RAC2 is running on node rac2
[oracle@rac1 bin]$
[oracle@rac1 bin]$
[oracle@rac1 bin]$ srvctl stop database -d RAC
[oracle@rac1 bin]$
[oracle@rac1 bin]$ srvctl status database -d RAC
Instance RAC1 is not running on node rac1
Instance RAC2 is not running on node rac2
[oracle@rac1 bin]$
[oracle@rac1 bin]$
[oracle@rac1 bin]$
[oracle@rac1 bin]$ su - root
Password:
[root@rac1 ~]#
[root@rac1 ~]#
[root@rac1 ~]# hostname
rac1.localdomain
[root@rac1 ~]#
[root@rac1 ~]# cd /u01/app/11.2.0.4/grid/bin/
[root@rac1 bin]# ./crsctl check cluster -all
**************************************************************
rac1:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
rac2:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************

[oracle@rac1 ~]$ su - root


Password:
[root@rac1 ~]#

[root@rac1 bin]# hostname


rac1.localdomain

[root@rac1 ~]# cd /u01/app/11.2.0.4/grid/bin/

[root@rac1 bin]#
[root@rac1 bin]# ./crsctl check cluster
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
[root@rac1 bin]#
[root@rac1 bin]# ./crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.ARCH.dg ora....up.type ONLINE ONLINE rac1
ora.DATA.dg ora....up.type ONLINE ONLINE rac1
ora....ER.lsnr ora....er.type ONLINE ONLINE rac1
ora....N1.lsnr ora....er.type ONLINE ONLINE rac2
ora....N2.lsnr ora....er.type ONLINE ONLINE rac1
ora....N3.lsnr ora....er.type ONLINE ONLINE rac1
ora...._DSK.dg ora....up.type ONLINE ONLINE rac1
ora.asm ora.asm.type ONLINE ONLINE rac1
ora.cvu ora.cvu.type ONLINE ONLINE rac1
ora.gsd ora.gsd.type OFFLINE OFFLINE
ora....network ora....rk.type ONLINE ONLINE rac1
ora.oc4j ora.oc4j.type ONLINE ONLINE rac1
ora.ons ora.ons.type ONLINE ONLINE rac1
ora.rac.db ora....se.type OFFLINE OFFLINE
ora....SM1.asm application ONLINE ONLINE rac1
ora....C1.lsnr application ONLINE ONLINE rac1
ora.rac1.gsd application OFFLINE OFFLINE
ora.rac1.ons application ONLINE ONLINE rac1
ora.rac1.vip ora....t1.type ONLINE ONLINE rac1
ora....SM2.asm application ONLINE ONLINE rac2
ora....C2.lsnr application ONLINE ONLINE rac2
ora.rac2.gsd application OFFLINE OFFLINE
ora.rac2.ons application ONLINE ONLINE rac2
ora.rac2.vip ora....t1.type ONLINE ONLINE rac2
ora.scan1.vip ora....ip.type ONLINE ONLINE rac2
ora.scan2.vip ora....ip.type ONLINE ONLINE rac1
ora.scan3.vip ora....ip.type ONLINE ONLINE rac1
[root@rac1 bin]#
[root@rac1 bin]# ./crsctl stop crs
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources
on 'rac1'
CRS-2673: Attempting to stop 'ora.crsd' on 'rac1'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac1'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'rac1'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN3.lsnr' on 'rac1'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'rac1'
CRS-2673: Attempting to stop 'ora.oc4j' on 'rac1'
CRS-2673: Attempting to stop 'ora.cvu' on 'rac1'
CRS-2673: Attempting to stop 'ora.OCR_VOTING_DSK.dg' on 'rac1'
CRS-2673: Attempting to stop 'ora.ARCH.dg' on 'rac1'
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'rac1'
CRS-2677: Stop of 'ora.cvu' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.cvu' on 'rac2'
CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.scan2.vip' on 'rac1'
CRS-2677: Stop of 'ora.LISTENER_SCAN3.lsnr' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.scan3.vip' on 'rac1'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.rac1.vip' on 'rac1'
CRS-2677: Stop of 'ora.ARCH.dg' on 'rac1' succeeded
CRS-2676: Start of 'ora.cvu' on 'rac2' succeeded
CRS-2677: Stop of 'ora.DATA.dg' on 'rac1' succeeded
CRS-2677: Stop of 'ora.scan2.vip' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.scan2.vip' on 'rac2'
CRS-2677: Stop of 'ora.scan3.vip' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.scan3.vip' on 'rac2'
CRS-2677: Stop of 'ora.rac1.vip' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.rac1.vip' on 'rac2'
CRS-2676: Start of 'ora.scan2.vip' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN2.lsnr' on 'rac2'
CRS-2676: Start of 'ora.scan3.vip' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN3.lsnr' on 'rac2'
CRS-2676: Start of 'ora.LISTENER_SCAN2.lsnr' on 'rac2' succeeded
CRS-2676: Start of 'ora.rac1.vip' on 'rac2' succeeded
CRS-2676: Start of 'ora.LISTENER_SCAN3.lsnr' on 'rac2' succeeded
CRS-2677: Stop of 'ora.oc4j' on 'rac1' succeeded
CRS-2672: Attempting to start 'ora.oc4j' on 'rac2'
CRS-2677: Stop of 'ora.OCR_VOTING_DSK.dg' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'rac1'
CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded
CRS-2676: Start of 'ora.oc4j' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'rac1'
CRS-2677: Stop of 'ora.ons' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'rac1'
CRS-2677: Stop of 'ora.net1.network' on 'rac1' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac1' has
completed
CRS-2677: Stop of 'ora.crsd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac1'
CRS-2673: Attempting to stop 'ora.evmd' on 'rac1'
CRS-2673: Attempting to stop 'ora.asm' on 'rac1'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac1'
CRS-2677: Stop of 'ora.evmd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'rac1' succeeded
CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac1'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'rac1'
CRS-2677: Stop of 'ora.cssd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.crf' on 'rac1'
CRS-2677: Stop of 'ora.crf' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'rac1'
CRS-2677: Stop of 'ora.gipcd' on 'rac1' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac1'
CRS-2677: Stop of 'ora.gpnpd' on 'rac1' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac1'
has completed
CRS-4133: Oracle High Availability Services has been stopped.

To stop the crs on node 2


[root@rac1 bin]# su - oracle
[oracle@rac1 ~]$ ssh rac2
Last login: Sat Apr 15 20:44:28 2017 from rac1.localdomain
[oracle@rac2 ~]$
[oracle@rac2 ~]$
[oracle@rac2 ~]$
[oracle@rac2 ~]$ ps -ef | grep d.bin
root 12116 1 0 20:35 ? 00:00:05
/u01/app/11.2.0.4/grid/bin/ohasd.bin reboot
oracle 12239 1 0 20:35 ? 00:00:02
/u01/app/11.2.0.4/grid/bin/oraagent.bin
oracle 12250 1 0 20:35 ? 00:00:00
/u01/app/11.2.0.4/grid/bin/mdnsd.bin
oracle 12261 1 0 20:35 ? 00:00:00
/u01/app/11.2.0.4/grid/bin/gpnpd.bin
oracle 12271 1 0 20:35 ? 00:00:04
/u01/app/11.2.0.4/grid/bin/gipcd.bin
root 12273 1 0 20:35 ? 00:00:03
/u01/app/11.2.0.4/grid/bin/orarootagent.bin
root 12288 1 1 20:35 ? 00:00:17
/u01/app/11.2.0.4/grid/bin/osysmond.bin
root 12304 1 0 20:35 ? 00:00:00
/u01/app/11.2.0.4/grid/bin/cssdmonitor
root 12318 1 0 20:35 ? 00:00:00
/u01/app/11.2.0.4/grid/bin/cssdagent
oracle 12330 1 0 20:35 ? 00:00:04
/u01/app/11.2.0.4/grid/bin/ocssd.bin
root 12367 1 0 20:35 ? 00:00:03 /u01/app/11.2.0.4/grid/bin/ologgerd
-m rac1 -r -d /u01/app/11.2.0.4/grid/crf/db/rac2
root 12443 1 0 20:36 ? 00:00:03
/u01/app/11.2.0.4/grid/bin/octssd.bin reboot
oracle 12474 1 0 20:36 ? 00:00:03 /u01/app/11.2.0.4/grid/bin/evmd.bin
root 12551 1 0 20:36 ? 00:00:09 /u01/app/11.2.0.4/grid/bin/crsd.bin
reboot
oracle 12625 12474 0 20:36 ? 00:00:00
/u01/app/11.2.0.4/grid/bin/evmlogger.bin -o
/u01/app/11.2.0.4/grid/evm/log/evmlogger.info -l
/u01/app/11.2.0.4/grid/evm/log/evmlogger.log
oracle 12687 1 0 20:36 ? 00:00:03
/u01/app/11.2.0.4/grid/bin/oraagent.bin
root 12691 1 0 20:36 ? 00:00:04
/u01/app/11.2.0.4/grid/bin/orarootagent.bin
oracle 12811 1 0 20:36 ? 00:00:00 /u01/app/11.2.0.4/grid/bin/tnslsnr
LISTENER -inherit
oracle 12825 1 0 20:36 ? 00:00:00 /u01/app/11.2.0.4/grid/bin/tnslsnr
LISTENER_SCAN1 -inherit
oracle 15186 1 0 20:58 ? 00:00:00
/u01/app/11.2.0.4/grid/bin/scriptagent.bin
oracle 15211 1 0 20:58 ? 00:00:00 /u01/app/11.2.0.4/grid/bin/tnslsnr
LISTENER_SCAN2 -inherit
oracle 15231 1 0 20:58 ? 00:00:00 /u01/app/11.2.0.4/grid/bin/tnslsnr
LISTENER_SCAN3 -inherit
oracle 15751 15687 0 21:01 pts/3 00:00:00 grep d.bin
[oracle@rac2 ~]$
[oracle@rac2 ~]$
[oracle@rac2 ~]$
[oracle@rac2 ~]$ cd /u01/app/11.2.0.4/grid/bin/
[oracle@rac2 bin]$ ./crsctl check cluster
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
[oracle@rac2 bin]$
[oracle@rac2 bin]$ ./crsctl check cluster -all
**************************************************************
rac2:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
[oracle@rac2 bin]$ ./crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.ARCH.dg ora....up.type ONLINE ONLINE rac2
ora.DATA.dg ora....up.type ONLINE ONLINE rac2
ora....ER.lsnr ora....er.type ONLINE ONLINE rac2
ora....N1.lsnr ora....er.type ONLINE ONLINE rac2
ora....N2.lsnr ora....er.type ONLINE ONLINE rac2
ora....N3.lsnr ora....er.type ONLINE ONLINE rac2
ora...._DSK.dg ora....up.type ONLINE ONLINE rac2
ora.asm ora.asm.type ONLINE ONLINE rac2
ora.cvu ora.cvu.type ONLINE ONLINE rac2
ora.gsd ora.gsd.type OFFLINE OFFLINE
ora....network ora....rk.type ONLINE ONLINE rac2
ora.oc4j ora.oc4j.type ONLINE ONLINE rac2
ora.ons ora.ons.type ONLINE ONLINE rac2
ora.rac.db ora....se.type OFFLINE OFFLINE
ora.rac1.vip ora....t1.type ONLINE ONLINE rac2
ora....SM2.asm application ONLINE ONLINE rac2
ora....C2.lsnr application ONLINE ONLINE rac2
ora.rac2.gsd application OFFLINE OFFLINE
ora.rac2.ons application ONLINE ONLINE rac2
ora.rac2.vip ora....t1.type ONLINE ONLINE rac2
ora.scan1.vip ora....ip.type ONLINE ONLINE rac2
ora.scan2.vip ora....ip.type ONLINE ONLINE rac2
ora.scan3.vip ora....ip.type ONLINE ONLINE rac2
[oracle@rac2 bin]$
[oracle@rac2 bin]$
[oracle@rac2 bin]$ ./crsctl stop crs
CRS-4563: Insufficient user privileges.

CRS-4000: Command Stop failed, or completed with errors.


[oracle@rac2 bin]$ su - root
Password:
[root@rac2 ~]#
[root@rac2 ~]#
[root@rac2 ~]#
[root@rac2 ~]# cd /u01/app/11.2.0.4/grid/bin/
[root@rac2 bin]# ./crsctl check cluster -all
**************************************************************
rac2:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
[root@rac2 bin]#
[root@rac2 bin]#
[root@rac2 bin]# ./crsctl check crs
CRS-4638: Oracle High Availability Services is online
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
[root@rac2 bin]#
[root@rac2 bin]#
[root@rac2 bin]# ./crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora.ARCH.dg ora....up.type ONLINE ONLINE rac2
ora.DATA.dg ora....up.type ONLINE ONLINE rac2
ora....ER.lsnr ora....er.type ONLINE ONLINE rac2
ora....N1.lsnr ora....er.type ONLINE ONLINE rac2
ora....N2.lsnr ora....er.type ONLINE ONLINE rac2
ora....N3.lsnr ora....er.type ONLINE ONLINE rac2
ora...._DSK.dg ora....up.type ONLINE ONLINE rac2
ora.asm ora.asm.type ONLINE ONLINE rac2
ora.cvu ora.cvu.type ONLINE ONLINE rac2
ora.gsd ora.gsd.type OFFLINE OFFLINE
ora....network ora....rk.type ONLINE ONLINE rac2
ora.oc4j ora.oc4j.type ONLINE ONLINE rac2
ora.ons ora.ons.type ONLINE ONLINE rac2
ora.rac.db ora....se.type OFFLINE OFFLINE
ora.rac1.vip ora....t1.type ONLINE ONLINE rac2
ora....SM2.asm application ONLINE ONLINE rac2
ora....C2.lsnr application ONLINE ONLINE rac2
ora.rac2.gsd application OFFLINE OFFLINE
ora.rac2.ons application ONLINE ONLINE rac2
ora.rac2.vip ora....t1.type ONLINE ONLINE rac2
ora.scan1.vip ora....ip.type ONLINE ONLINE rac2
ora.scan2.vip ora....ip.type ONLINE ONLINE rac2
ora.scan3.vip ora....ip.type ONLINE ONLINE rac2
[root@rac2 bin]#
[root@rac2 bin]# ./crsctl stop crs
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources
on 'rac2'
CRS-2673: Attempting to stop 'ora.crsd' on 'rac2'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac2'
CRS-2673: Attempting to stop 'ora.cvu' on 'rac2'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN3.lsnr' on 'rac2'
CRS-2673: Attempting to stop 'ora.rac2.vip' on 'rac2'
CRS-2673: Attempting to stop 'ora.oc4j' on 'rac2'
CRS-2673: Attempting to stop 'ora.OCR_VOTING_DSK.dg' on 'rac2'
CRS-2673: Attempting to stop 'ora.ARCH.dg' on 'rac2'
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'rac2'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'rac2'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'rac2'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'rac2'
CRS-2677: Stop of 'ora.cvu' on 'rac2' succeeded
CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.scan2.vip' on 'rac2'
CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.scan1.vip' on 'rac2'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'rac2' succeeded
CRS-2677: Stop of 'ora.LISTENER_SCAN3.lsnr' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.scan3.vip' on 'rac2'
CRS-2677: Stop of 'ora.ARCH.dg' on 'rac2' succeeded
CRS-2677: Stop of 'ora.rac2.vip' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.rac1.vip' on 'rac2'
CRS-2677: Stop of 'ora.DATA.dg' on 'rac2' succeeded
CRS-2677: Stop of 'ora.scan3.vip' on 'rac2' succeeded
CRS-2677: Stop of 'ora.scan1.vip' on 'rac2' succeeded
CRS-2677: Stop of 'ora.rac1.vip' on 'rac2' succeeded
CRS-2677: Stop of 'ora.scan2.vip' on 'rac2' succeeded
CRS-2677: Stop of 'ora.oc4j' on 'rac2' succeeded
CRS-2677: Stop of 'ora.OCR_VOTING_DSK.dg' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'rac2'
CRS-2677: Stop of 'ora.asm' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'rac2'
CRS-2677: Stop of 'ora.ons' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'rac2'
CRS-2677: Stop of 'ora.net1.network' on 'rac2' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'rac2' has
completed
CRS-2677: Stop of 'ora.crsd' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'rac2'
CRS-2673: Attempting to stop 'ora.evmd' on 'rac2'
CRS-2673: Attempting to stop 'ora.asm' on 'rac2'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac2'
CRS-2677: Stop of 'ora.evmd' on 'rac2' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'rac2' succeeded
CRS-2677: Stop of 'ora.asm' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac2'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac2' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'rac2'
CRS-2677: Stop of 'ora.cssd' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.crf' on 'rac2'
CRS-2677: Stop of 'ora.crf' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'rac2'
CRS-2677: Stop of 'ora.gipcd' on 'rac2' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac2'
CRS-2677: Stop of 'ora.gpnpd' on 'rac2' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac2'
has completed
CRS-4133: Oracle High Availability Services has been stopped.
[root@rac2 bin]#

To start the crs on NODE 1

[root@rac1 bin]# ./crsctl start crs


CRS-4123: Oracle High Availability Services has been started.

[root@rac1 bin]# ./crsctl check cluster


CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online

[root@rac1 bin]# ./crs_stat -t


Name Type Target State Host
------------------------------------------------------------
ora.ARCH.dg ora....up.type ONLINE ONLINE rac1
ora.DATA.dg ora....up.type ONLINE ONLINE rac1
ora....ER.lsnr ora....er.type ONLINE ONLINE rac1
ora....N1.lsnr ora....er.type ONLINE ONLINE rac1
ora....N2.lsnr ora....er.type ONLINE ONLINE rac1
ora....N3.lsnr ora....er.type ONLINE ONLINE rac1
ora...._DSK.dg ora....up.type ONLINE ONLINE rac1
ora.asm ora.asm.type ONLINE ONLINE rac1
ora.cvu ora.cvu.type ONLINE ONLINE rac1
ora.gsd ora.gsd.type OFFLINE OFFLINE
ora....network ora....rk.type ONLINE ONLINE rac1
ora.oc4j ora.oc4j.type ONLINE ONLINE rac1
ora.ons ora.ons.type ONLINE ONLINE rac1
ora.rac.db ora....se.type OFFLINE OFFLINE
ora....SM1.asm application ONLINE ONLINE rac1
ora....C1.lsnr application ONLINE ONLINE rac1
ora.rac1.gsd application OFFLINE OFFLINE
ora.rac1.ons application ONLINE ONLINE rac1
ora.rac1.vip ora....t1.type ONLINE ONLINE rac1
ora.rac2.vip ora....t1.type ONLINE ONLINE rac1
ora.scan1.vip ora....ip.type ONLINE ONLINE rac1
ora.scan2.vip ora....ip.type ONLINE ONLINE rac1
ora.scan3.vip ora....ip.type ONLINE ONLINE rac1

on Node 2

[root@rac2 bin]# ./crsctl start crs


CRS-4123: Oracle High Availability Services has been started.

after crs started check cluster stack status

[root@rac2 bin]# ./crsctl check cluster -all


**************************************************************
rac1:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
rac2:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
[root@rac2 bin]#

after start the database


[root@rac2 bin]# su - oracle
[oracle@rac2 ~]$
[oracle@rac2 ~]$
[oracle@rac2 ~]$ . .grid_profile
[oracle@rac2 ~]$ srvctl start database -d RAC
[oracle@rac2 ~]$
[oracle@rac2 ~]$
[oracle@rac2 ~]$ srvctl status database -d RAC
Instance RAC1 is running on node rac1
Instance RAC2 is running on node rac2

/u01/app/11.2.0.4/grid/
after open the database.

SQL> select INST_ID,name,created,open_mode,


2 log_mode from
3 gv$database;

INST_ID NAME CREATED OPEN_MODE LOG_MODE


---------- --------- --------- -------------------- ------------
1 RAC 12-APR-17 READ WRITE ARCHIVELOG
2 RAC 12-APR-17 READ WRITE ARCHIVELOG

To check all the resources status

[oracle@rac2 bin]$ ./crsctl status resource -t


--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.ARCH.dg
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.DATA.dg
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.LISTENER.lsnr
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.OCR_VOTING_DSK.dg
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.asm
ONLINE ONLINE rac1 Started
ONLINE ONLINE rac2 Started
ora.gsd
OFFLINE OFFLINE rac1
OFFLINE OFFLINE rac2
ora.net1.network
ONLINE ONLINE rac1
ONLINE ONLINE rac2
ora.ons
ONLINE ONLINE rac1
ONLINE ONLINE rac2
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
1 ONLINE ONLINE rac2
ora.LISTENER_SCAN2.lsnr
1 ONLINE ONLINE rac1
ora.LISTENER_SCAN3.lsnr
1 ONLINE ONLINE rac1
ora.cvu
1 ONLINE ONLINE rac1
ora.oc4j
1 ONLINE ONLINE rac1
ora.rac.db
1 ONLINE ONLINE rac1 Open
2 ONLINE ONLINE rac2 Open
ora.rac1.vip
1 ONLINE ONLINE rac1
ora.rac2.vip
1 ONLINE ONLINE rac2
ora.scan1.vip
1 ONLINE ONLINE rac2
ora.scan2.vip
1 ONLINE ONLINE rac1
ora.scan3.vip
1 ONLINE ONLINE rac1
[oracle@rac2 bin]$

To check specific status of any node

[oracle@rac2 bin]$ ./crsctl stat res -t -init


--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
1 ONLINE ONLINE rac2 Started
ora.cluster_interconnect.haip
1 ONLINE ONLINE rac2
ora.crf
1 ONLINE ONLINE rac2
ora.crsd
1 ONLINE ONLINE rac2
ora.cssd
1 ONLINE ONLINE rac2
ora.cssdmonitor
1 ONLINE ONLINE rac2
ora.ctssd
1 ONLINE ONLINE rac2 ACTIVE:0
ora.diskmon
1 OFFLINE OFFLINE
ora.evmd
1 ONLINE ONLINE rac2
ora.gipcd
1 ONLINE ONLINE rac2
ora.gpnpd
1 ONLINE ONLINE rac2
ora.mdnsd
1 ONLINE ONLINE rac2

[oracle@rac1 bin]$ hostname


rac1.localdomain

[oracle@rac1 bin]$ ./crsctl stat res -t -init


--------------------------------------------------------------------------------
NAME TARGET STATE SERVER STATE_DETAILS
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.asm
1 ONLINE ONLINE rac1 Started
ora.cluster_interconnect.haip
1 ONLINE ONLINE rac1
ora.crf
1 ONLINE ONLINE rac1
ora.crsd
1 ONLINE ONLINE rac1
ora.cssd
1 ONLINE ONLINE rac1
ora.cssdmonitor
1 ONLINE ONLINE rac1
ora.ctssd
1 ONLINE ONLINE rac1 ACTIVE:0
ora.diskmon
1 OFFLINE OFFLINE
ora.evmd
1 ONLINE ONLINE rac1
ora.gipcd
1 ONLINE ONLINE rac1
ora.gpnpd
1 ONLINE ONLINE rac1
ora.mdnsd
1 ONLINE ONLINE rac1

[oracle@rac1 bin]$ ps -ef | grep d.bin


root 19654 1 0 21:05 ? 00:00:03
/u01/app/11.2.0.4/grid/bin/ohasd.bin reboot
oracle 19778 1 0 21:05 ? 00:00:01
/u01/app/11.2.0.4/grid/bin/oraagent.bin
oracle 19789 1 0 21:05 ? 00:00:00
/u01/app/11.2.0.4/grid/bin/mdnsd.bin
oracle 19800 1 0 21:05 ? 00:00:00
/u01/app/11.2.0.4/grid/bin/gpnpd.bin
oracle 19811 1 0 21:05 ? 00:00:02
/u01/app/11.2.0.4/grid/bin/gipcd.bin
root 19813 1 0 21:05 ? 00:00:02
/u01/app/11.2.0.4/grid/bin/orarootagent.bin
root 19827 1 1 21:05 ? 00:00:10
/u01/app/11.2.0.4/grid/bin/osysmond.bin
root 19838 1 0 21:05 ? 00:00:00
/u01/app/11.2.0.4/grid/bin/cssdmonitor
root 19857 1 0 21:05 ? 00:00:00
/u01/app/11.2.0.4/grid/bin/cssdagent
oracle 19869 1 0 21:05 ? 00:00:02
/u01/app/11.2.0.4/grid/bin/ocssd.bin
root 19931 1 1 21:05 ? 00:00:11 /u01/app/11.2.0.4/grid/bin/ologgerd
-M -d /u01/app/11.2.0.4/grid/crf/db/rac1
root 19993 1 0 21:06 ? 00:00:01
/u01/app/11.2.0.4/grid/bin/octssd.bin reboot
oracle 20018 1 0 21:06 ? 00:00:01 /u01/app/11.2.0.4/grid/bin/evmd.bin
root 20185 1 0 21:06 ? 00:00:04 /u01/app/11.2.0.4/grid/bin/crsd.bin
reboot
oracle 20255 20018 0 21:06 ? 00:00:00
/u01/app/11.2.0.4/grid/bin/evmlogger.bin -o
/u01/app/11.2.0.4/grid/evm/log/evmlogger.info -l
/u01/app/11.2.0.4/grid/evm/log/evmlogger.log
root 20294 1 0 21:06 ? 00:00:03
/u01/app/11.2.0.4/grid/bin/orarootagent.bin
oracle 20298 1 0 21:06 ? 00:00:01
/u01/app/11.2.0.4/grid/bin/oraagent.bin
oracle 20417 1 0 21:06 ? 00:00:00
/u01/app/11.2.0.4/grid/bin/scriptagent.bin
oracle 20528 1 0 21:06 ? 00:00:00 /u01/app/11.2.0.4/grid/bin/tnslsnr
LISTENER_SCAN2 -inherit
oracle 20555 1 0 21:06 ? 00:00:00 /u01/app/11.2.0.4/grid/bin/tnslsnr
LISTENER_SCAN3 -inherit
oracle 20576 1 0 21:06 ? 00:00:00 /u01/app/11.2.0.4/grid/bin/tnslsnr
LISTENER -inherit
oracle 22144 21919 0 21:18 pts/6 00:00:00 grep d.bin