RAC(11gR2) OCR BACKUP & RESTORE / 憋错料

首先检查下OCR盘

[[email protected]1 cdata]$ ocrcheck

Status of OracleCluster Registry is as follows :

Version : 3

Total space (kbytes) : 262120

Used space (kbytes) : 3068

Available space (kbytes) : 259052

ID : 1088979561

Device/File Name : +CRS

Device/Fileintegrity check succeeded

Device/Filenot configured

Cluster registry integrity checksucceeded

Logical corruption check bypassed dueto non-privileged user

[[email protected]]$ cluvfy comp ocr -n all

Verifying OCR integrity

Checking OCRintegrity...

Checking the absence ofa non-clustered configuration...

All nodes free ofnon-clustered, local-only configurations

ASM Running checkpassed. ASM is running on all specified nodes

Checking OCR configfile "/etc/oracle/ocr.loc"...

OCR config file"/etc/oracle/ocr.loc" check successful

Disk group for ocrlocation "+CRS" available on all the nodes

NOTE:

This check does notverify the integrity of the OCR contents. Execute ‘ocrcheck‘ as a privilegeduser to verify the contents of OCR.

OCR integrity checkpassed

Verification of OCRintegrity was successful.

备份asm参数文件

[[email protected]]$ sqlplus / as sysasm

SQL> createpfile=‘/tmp/asm_pfile_20150306.txt‘ from spfile;

备份OCR盘

[root@rac1 grid]#bin/ocrconfig-export /tmp/ocr_bak20150306.dmp

模拟破坏OCR盘：

[[email protected]]# dd if=/dev/zero of=/dev/oracleasm/disks/CRS bs=1024 count=1000

破坏完后，检查集群状态

[[email protected]]$ crsctl check crs

CRS-4638: Oracle HighAvailability Services is online

CRS-4537: Cluster ReadyServices is online

CRS-4529: ClusterSynchronization Services is online

CRS-4533: Event Manageris online

检查OCR一致性

[[email protected]]$ cluvfy comp ocr -n all

Verifying OCR integrity

Checking OCRintegrity...

Checking the absence ofa non-clustered configuration...

All nodes free ofnon-clustered, local-only configurations

ASM Running checkpassed. ASM is running on all specified nodes

Checking OCR configfile "/etc/oracle/ocr.loc"...

OCR config file"/etc/oracle/ocr.loc" check successful

Disk group for ocrlocation "+CRS" available on all the nodes

NOTE:

This check does notverify the integrity of the OCR contents. Execute ‘ocrcheck‘ as a privilegeduser to verify the contents of OCR.

OCR integrity checkpassed

Verification of OCRintegrity was successful.

重启CRS

[[email protected]]# bin/crsctl stop crs

CRS-2791: Startingshutdown of Oracle High Availability Services-managed resources on ‘rac1‘

CRS-2673: Attempting tostop ‘ora.crsd‘ on ‘rac1‘

CRS-2790: Startingshutdown of Cluster Ready Services-managed resources on ‘rac1‘

CRS-2673: Attempting tostop ‘ora.CRS.dg‘ on ‘rac1‘

CRS-2673: Attempting tostop ‘ora.rac.db‘ on ‘rac1‘

CRS-2673: Attempting tostop ‘ora.registry.acfs‘ on ‘rac1‘

CRS-2673: Attempting tostop ‘ora.cvu‘ on ‘rac1‘

CRS-2673: Attempting tostop ‘ora.oc4j‘ on ‘rac1‘

CRS-2673: Attempting tostop ‘ora.LISTENER_SCAN1.lsnr‘ on ‘rac1‘

CRS-2673: Attempting tostop ‘ora.LISTENER.lsnr‘ on ‘rac1‘

CRS-2677: Stop of‘ora.cvu‘ on ‘rac1‘ succeeded

CRS-2672: Attempting tostart ‘ora.cvu‘ on ‘rac2‘

CRS-2677: Stop of‘ora.LISTENER_SCAN1.lsnr‘ on ‘rac1‘ succeeded

CRS-2673: Attempting tostop ‘ora.scan1.vip‘ on ‘rac1‘

CRS-2676: Start of‘ora.cvu‘ on ‘rac2‘ succeeded

CRS-2677: Stop of‘ora.LISTENER.lsnr‘ on ‘rac1‘ succeeded

CRS-2673: Attempting tostop ‘ora.rac1.vip‘ on ‘rac1‘

CRS-2677: Stop of‘ora.scan1.vip‘ on ‘rac1‘ succeeded

CRS-2672: Attempting tostart ‘ora.scan1.vip‘ on ‘rac2‘

CRS-2677: Stop of‘ora.rac1.vip‘ on ‘rac1‘ succeeded

CRS-2672: Attempting tostart ‘ora.rac1.vip‘ on ‘rac2‘

CRS-2677: Stop of‘ora.registry.acfs‘ on ‘rac1‘ succeeded

CRS-2676: Start of‘ora.scan1.vip‘ on ‘rac2‘ succeeded

CRS-2672: Attempting tostart ‘ora.LISTENER_SCAN1.lsnr‘ on ‘rac2‘

CRS-2677: Stop of‘ora.rac.db‘ on ‘rac1‘ succeeded

CRS-2673: Attempting tostop ‘ora.DATA.dg‘ on ‘rac1‘

CRS-2673: Attempting tostop ‘ora.FRA.dg‘ on ‘rac1‘

CRS-2676: Start of‘ora.rac1.vip‘ on ‘rac2‘ succeeded

CRS-2676: Start of‘ora.LISTENER_SCAN1.lsnr‘ on ‘rac2‘ succeeded

CRS-2677: Stop of‘ora.CRS.dg‘ on ‘rac1‘ succeeded

CRS-2677: Stop of‘ora.FRA.dg‘ on ‘rac1‘ succeeded

CRS-2677: Stop of‘ora.DATA.dg‘ on ‘rac1‘ succeeded

CRS-2673: Attempting tostop ‘ora.asm‘ on ‘rac1‘

CRS-2677: Stop of‘ora.asm‘ on ‘rac1‘ succeeded

CRS-2677: Stop of‘ora.oc4j‘ on ‘rac1‘ succeeded

CRS-2672: Attempting tostart ‘ora.oc4j‘ on ‘rac2‘

CRS-2676: Start of‘ora.oc4j‘ on ‘rac2‘ succeeded

CRS-2673: Attempting tostop ‘ora.ons‘ on ‘rac1‘

CRS-2677: Stop of‘ora.ons‘ on ‘rac1‘ succeeded

CRS-2673: Attempting tostop ‘ora.net1.network‘ on ‘rac1‘

CRS-2677: Stop of‘ora.net1.network‘ on ‘rac1‘ succeeded

CRS-2792: Shutdown ofCluster Ready Services-managed resources on ‘rac1‘ has completed

CRS-2677: Stop of‘ora.crsd‘ on ‘rac1‘ succeeded

CRS-2673: Attempting tostop ‘ora.crf‘ on ‘rac1‘

CRS-2673: Attempting tostop ‘ora.ctssd‘ on ‘rac1‘

CRS-2673: Attempting tostop ‘ora.evmd‘ on ‘rac1‘

CRS-2673: Attempting tostop ‘ora.asm‘ on ‘rac1‘

CRS-2673: Attempting tostop ‘ora.mdnsd‘ on ‘rac1‘

CRS-2673: Attempting tostop ‘ora.drivers.acfs‘ on ‘rac1‘

CRS-2677: Stop of‘ora.crf‘ on ‘rac1‘ succeeded

CRS-2677: Stop of‘ora.evmd‘ on ‘rac1‘ succeeded

CRS-2677: Stop of‘ora.mdnsd‘ on ‘rac1‘ succeeded

CRS-2677: Stop of‘ora.ctssd‘ on ‘rac1‘ succeeded

CRS-2677: Stop of‘ora.asm‘ on ‘rac1‘ succeeded

CRS-2673: Attempting tostop ‘ora.cluster_interconnect.haip‘ on ‘rac1‘

CRS-2677: Stop of‘ora.cluster_interconnect.haip‘ on ‘rac1‘ succeeded

CRS-2673: Attempting tostop ‘ora.cssd‘ on ‘rac1‘

CRS-2677: Stop of‘ora.drivers.acfs‘ on ‘rac1‘ succeeded

CRS-2677: Stop of‘ora.cssd‘ on ‘rac1‘ succeeded

CRS-2673: Attempting tostop ‘ora.gipcd‘ on ‘rac1‘

CRS-2677: Stop of‘ora.gipcd‘ on ‘rac1‘ succeeded

CRS-2673: Attempting tostop ‘ora.gpnpd‘ on ‘rac1‘

CRS-2677: Stop of‘ora.gpnpd‘ on ‘rac1‘ succeeded

CRS-2793: Shutdown ofOracle High Availability Services-managed resources on ‘rac1‘ has completed

CRS-4133: Oracle HighAvailability Services has been stopped.

启动

[[email protected]]# bin/crsctl start crs

CRS-4123: Oracle HighAvailability Services has been started.

观察告警日志

[[email protected] grid]# tail -100f/u01/app/11.2.0.4/grid/log/rac1/alertrac1.log

[/u01/app/11.2.0.4/grid/bin/orarootagent.bin(21098)]CRS-5016:Process"/u01/app/11.2.0.4/grid/bin/acfsregistrymount" spawned by agent"/u01/app/11.2.0.4/grid/bin/orarootagent.bin" for action"check" failed: details at "(:CLSN00010:)" in"/u01/app/11.2.0.4/grid/log/rac1/agent/crsd/orarootagent_root/orarootagent_root.log"

2015-03-0523:52:17.725:

2015-03-0618:46:58.197:

[/u01/app/11.2.0.4/grid/bin/orarootagent.bin(21098)]CRS-5822:Agent‘/u01/app/11.2.0.4/grid/bin/orarootagent_root‘ disconnected from server.Details at (:CRSAGF00117:) {0:3:22642} in/u01/app/11.2.0.4/grid/log/rac1/agent/crsd/orarootagent_root/orarootagent_root.log.

2015-03-0618:47:00.102:

[ctssd(20098)]CRS-2405:TheCluster Time Synchronization Service on host rac1 is shutdown by user

[client(7931)]CRS-10001:06-Mar-1518:47 ACFS-9290: Waiting for ASM to shutdown.

2015-03-0618:47:01.435:

[mdnsd(19905)]CRS-5602:mDNSservice stopping by request.

2015-03-0618:47:11.506:

[cssd(19972)]CRS-1603:CSSDon node rac1 shutdown by user.

2015-03-0618:47:11.721:

[cssd(19972)]CRS-1660:TheCSS daemon shutdown has completed

2015-03-0618:47:12.299:

[ohasd(15515)]CRS-2767:Resourcestate recovery not attempted for ‘ora.cssdmonitor‘ as its target state isOFFLINE

2015-03-0618:47:12.326:

[ohasd(15515)]CRS-2769:Unableto failover resource ‘ora.cssdmonitor‘.

2015-03-0618:47:13.861:

[ohasd(15515)]CRS-2769:Unableto failover resource ‘ora.cssd‘.

2015-03-0618:47:19.278:

[gpnpd(19923)]CRS-2329:GPNPDon node rac1 shutdown.

2015-03-0618:49:03.584:

[client(8370)]CRS-2302:Cannotget GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).

2015-03-0618:49:03.585:

[client(8370)]CRS-1013:TheOCR location in an ASM disk group is inaccessible. Details in/u01/app/11.2.0.4/grid/log/rac1/client/crsctl_oracle.log.

...

2015-03-0618:54:12.281:

[client(9870)]CRS-2302:Cannotget GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).

2015-03-0618:54:12.282:

[client(9870)]CRS-1013:TheOCR location in an ASM disk group is inaccessible. Details in/u01/app/11.2.0.4/grid/log/rac1/client/crsctl_oracle.log.

2015-03-0618:54:12.311:

[ohasd(9880)]CRS-2112:TheOLR service started on node rac1.

2015-03-0618:54:12.326:

[ohasd(9880)]CRS-1301:OracleHigh Availability Service started on node rac1.

2015-03-0618:54:12.382:

[ohasd(9880)]CRS-8017:location:/etc/oracle/lastgasp has 2 reboot advisory log files, 0 were announced and 0errors occurred

2015-03-0618:54:16.606:

[/u01/app/11.2.0.4/grid/bin/orarootagent.bin(9940)]CRS-2302:Cannotget GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).

2015-03-0618:54:17.004:

[client(10084)]CRS-2302:Cannotget GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).

2015-03-0618:54:17.005:

[client(10084)]CRS-1013:TheOCR location in an ASM disk group is inaccessible. Details in/u01/app/11.2.0.4/grid/log/rac1/client/crsctl_oracle.log.

2015-03-0618:54:20.445:

[client(10096)]CRS-2302:Cannotget GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).

2015-03-0618:54:20.446:

[client(10096)]CRS-1013:TheOCR location in an ASM disk group is inaccessible. Details in/u01/app/11.2.0.4/grid/log/rac1/client/crsctl_oracle.log.

2015-03-0618:54:20.878:

[gpnpd(10132)]CRS-2328:GPNPDstarted on node rac1.

2015-03-0618:54:23.356:

[cssd(10234)]CRS-1713:CSSDdaemon is started in clustered mode

2015-03-0618:54:25.105:

[ohasd(9880)]CRS-2767:Resourcestate recovery not attempted for ‘ora.diskmon‘ as its target state is OFFLINE

2015-03-0618:54:25.106:

[ohasd(9880)]CRS-2769:Unableto failover resource ‘ora.diskmon‘.

2015-03-0618:54:27.522: