OEL6.5_X86平台部署oracle11gR2RAC配置ACFS

ACFS， oracle官方定义：

Oracle AutomaticStorage Management Cluster File System (Oracle ACFS) is a multi-platform,scalable file system, and storage management technology that extends OracleAutomatic Storage Management (Oracle ASM) functionality to support customerfiles maintained outside of Oracle Database. Oracle ACFS supports many databaseand application files, including executables,database trace files, databasealert logs, application reports, BFILEs, and configuration files. Othersupported files are video, audio, text, images, engineering drawings, and othergeneral-purpose application file data.

下面来介绍下11G RAC环境下ACFS的使用，当前系统环境操作系统版本为OEL6.5，数据库版本为ORACLE11204。

1.  查看ACFS相关的服务

查看acfs/advm驱动是否加载

[[email protected] bin]#lsmod |grep oracle

[[email protected] bin]#

[[email protected] bin]#lsmod |grep oracle

[[email protected] bin]#

查看集群资源

[[email protected] ~]# su- grid -c crs_stat|grep acfs

[[email protected] ~]#

[[email protected] ~]# su- grid -c crs_stat|grep acfs

[[email protected] ~]#

使用acfsload加载驱动

[[email protected] bin]#./acfsload start -s

ACFS-9459:ADVM/ACFS is not supported on this OS version: ‘3.8.13-16.2.1.el6uek.x86_64‘

[[email protected] bin]#uname -a

Linux jxcw13.8.13-16.2.1.el6uek.x86_64 #1 SMP Thu Nov 7 17:01:44 PST 2013 x86_64 x86_64x86_64 GNU/Linux

[[email protected] bin]#

从报错信息中可以看出，OEL6.5操作系统11204数据库并未被支持。升级数据库版本，打补丁11204.7后驱动可以被加载，但不能被系统自动加载。处理如下:

[[email protected] ~]# cat/etc/init.d/acfsload

#!/bin/sh

# chkconfig: 234530 21

# description: LoadOracle ASM volume driver on system startup

ORACLE_HOME=/u01/app/11.2.0/grid

export ORACLE_HOME

$ORACLE_HOME/bin/acfsloadstart -s

[[email protected] ~]# chkconfigadd acfsload

[[email protected] ~]#chkconfig --list|grep acfsload

acfsload        0:off  1:off   2:on    3:on   4:on    5:on    6:off

[[email protected] ~]#

[[email protected] bin]#./acfsload start -s

[[email protected] bin]#lsmod |grep oracle

oracleacfs            877320  0

oracleadvm            221760  0

oracleoks             276880  2 oracleacfs,oracleadvm

[[email protected]]#  lsmod |grep oracle

oracleacfs            877192  0

oracleadvm            221504  0

oracleoks             277008  2 oracleacfs,oracleadvm

[[email protected] bin]#

添加资源ora.registry.acfs

[[email protected] ~]#/u01/app/11.2.0/grid/bin/crsctl add type ora.registry.acfs.type -basetypeora.local_resource.type -file/u01/app/11.2.0/grid/crs/template/registry.acfs.type

[[email protected] ~]# /u01/app/11.2.0/grid/bin/crsctladd resource ora.registry.acfs -attrACL=\‘owner:root:rwx,pgrp:oinstall:r-x,other::r--\‘ -typeora.registry.acfs.type -f

[[email protected] ~]#

查看是否添加成功

[[email protected] ~]# su- grid -c crs_stat | grep acfs

NAME=ora.registry.acfs

TYPE=ora.registry.acfs.type

[[email protected] ~]#

[[email protected] ~]# su- grid -c crs_stat | grep acfs

NAME=ora.registry.acfs

TYPE=ora.registry.acfs.type

[[email protected] ~]#

查看添加的资源状态。

[[email protected] ~]$crsctl stat res -t

---------------------------------------------------------------------

NAME          TARGET  STATE        SERVER                   STATE_DETAILS

Local Resources

---------------------------------------------------------------------

ora.ARCH.dg

ONLINE ONLINE       jxcw1

ONLINE  ONLINE      jxcw2

ora.CRS.dg

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.DATA.dg

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.LISTENER.lsnr

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.asm

ONLINE  ONLINE      jxcw1                   Started

ONLINE  ONLINE      jxcw2                   Started

ora.gsd

OFFLINE OFFLINE      jxcw1

OFFLINE OFFLINE      jxcw2

ora.net1.network

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.ons

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.registry.acfs

OFFLINE OFFLINE      jxcw1

OFFLINE OFFLINE      jxcw2

Cluster Resources

---------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

1       ONLINE  ONLINE       jxcw2

ora.cvu

1       ONLINE  ONLINE       jxcw2

ora.jxcw.db

1       ONLINE  ONLINE       jxcw1                    Open

2       ONLINE  ONLINE       jxcw2                    Open

ora.jxcw1.vip

1       ONLINE  ONLINE       jxcw1

ora.jxcw2.vip

1       ONLINE  ONLINE       jxcw2

ora.oc4j

1       ONLINE  ONLINE       jxcw2

ora.scan1.vip

1       ONLINE  ONLINE       jxcw2

[[email protected] ~]$

添加的ora.registry.acfs资源默认offline，需手工启动。                    

[[email protected] ~]$crsctl start resource ora.registry.acfs -n jxcw1

CRS-2672:Attempting to start ‘ora.registry.acfs‘ on ‘jxcw1‘

CRS-2676: Start of‘ora.registry.acfs‘ on ‘jxcw1‘ succeeded

[[email protected] ~]$crsctl start resource ora.registry.acfs -n jxcw2

CRS-2672:Attempting to start ‘ora.registry.acfs‘ on ‘jxcw2‘

CRS-2676: Start of‘ora.registry.acfs‘ on ‘jxcw2‘ succeeded

启动后查看状态如下，已为online状态。

[[email protected] ~]$crsctl stat res -t

---------------------------------------------------------------------

NAME           TARGET  STATE       SERVER                  STATE_DETAILS

---------------------------------------------------------------------

Local Resources

ora.ARCH.dg

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.CRS.dg

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.DATA.dg

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.LISTENER.lsnr

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.asm

ONLINE  ONLINE      jxcw1                   Started

ONLINE  ONLINE      jxcw2                   Started

ora.gsd

OFFLINE OFFLINE      jxcw1

OFFLINE OFFLINE      jxcw2

ora.net1.network

ONLINE  ONLINE      jxcw1

ONLINE ONLINE       jxcw2

ora.ons

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.registry.acfs

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

---------------------------------------------------------------------ClusterResources

---------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

1       ONLINE  ONLINE       jxcw2

ora.cvu

1       ONLINE  ONLINE       jxcw2

ora.jxcw.db

1       ONLINE  ONLINE       jxcw1                    Open

2       ONLINE  ONLINE       jxcw2                    Open

ora.jxcw1.vip

1       ONLINE  ONLINE      jxcw1

ora.jxcw2.vip

1       ONLINE  ONLINE       jxcw2

ora.oc4j

1       ONLINE  ONLINE       jxcw2

ora.scan1.vip

1       ONLINE  ONLINE       jxcw2

[[email protected] ~]$

2.  使用ASMCMD命令创建ACFS

（1）、使用volcreate命令创建vol01，大小为30G;

ASMCMD>volcreate -G data -s 30G testvol

（2）、使用volinfo查看vol01的相关信息

ASMCMD> volinfo-G data testvol

Diskgroup Name:DATA

Volume Name: TESTVOL

Volume Device: /dev/asm/testvol-347

State: ENABLED

Size (MB): 30720

Resize Unit (MB): 32

Redundancy: UNPROT

Stripe Columns: 4

Stripe Width (K): 128

Usage:

Mountpath:

ASMCMD>

（2）、使用操作系统命令查看设备名，这里的/dev/asm/ testvol-347相当于裸设备。

[[email protected] ~]$ cd/dev/asm/

[[email protected] asm]$ls -l

total 0

brwxrwx--- 1 rootasmadmin 251, 177665 Oct 28 13:20 testvol-347

[[email protected] asm]$

（3）、在v$asm_volume视图中使用sql查看volume相关信息

[[email protected] asm]$sqlplus / as sysasm

SQL*Plus: Release11.2.0.4.0 Production on Fri Oct 28 13:22:33 2016

Copyright (c) 1982,2013, Oracle.  All rights reserved.

Connected to:

Oracle Database 11gEnterprise Edition Release 11.2.0.4.0 - 64bit Production

With the RealApplication Clusters and Automatic Storage Management options

SQL> selectvolume_name,volume_device,size_mb from v$asm_volume;

VOLUME_NAME          VOLUME_DEVICE                                      SIZE_MB

---------------------------------------------------------

TESTVOL              /dev/asm/testvol-347                                 30720

SQL>

（4）、格式化卷，创建文件系统

[[email protected] ~]#mkfs.acfs /dev/asm/testvol-347

mkfs.acfs:version                   = 11.2.0.4.0

mkfs.acfs: on-diskversion           = 39.0

mkfs.acfs:volume                    =/dev/asm/testvol-347

mkfs.acfs: volumesize               = 32212254720

mkfs.acfs: Formatcomplete.

[[email protected] ~]#

（5）、注册ACFS文件系统，相当于定义挂载点，仅在节点1注册一次即可

[[email protected]~]#acfsutil registry -a /dev/asm/testvol-347/u01/app/grid/acfsmounts/data_testvol/

acfsutil registry:mount point /u01/app/grid/acfsmounts/data_testvol successfully added to OracleRegistry

查看文件系统信息

[[email protected] ~]#acfsutil info fs

/u01/app/grid/acfsmounts/data_testvol

ACFS Version: 11.2.0.4.0

flags:        MountPoint,Available

mount time:   Fri Oct 28 13:37:27 2016

volumes:      1

total size:   32212254720

total free:   32068386816

primary volume: /dev/asm/testvol-347

label:

flags:                 Primary,Available,ADVM

on-disk version:       39.0

allocation unit:       4096

major, minor:          251, 177665

size:                  32212254720

free:                  32068386816

ADVM diskgroup         DATA

ADVM resize increment: 33554432

ADVM redundancy:       unprotected

ADVM stripe columns:   4

ADVM stripe width:     131072

number of snapshots:  0

snapshot space usage: 0

replication status: DISABLED

[[email protected] ~]#

（6）、注册成功后自动挂载文件系统，两节点查看如下：

[[email protected] ~]# df-h

Filesystem                    Size  Used Avail Use% Mounted on

/dev/mapper/VolGroup-lv_root  532G  34G  476G   7% /

tmpfs                          16G  255M  16G   2% /dev/shm

/dev/sda1                     477M   55M 397M  13% /boot

/dev/asm/testvol-347           30G 138M   30G   1% /u01/app/grid/acfsmounts/data_testvol

[[email protected] ~]#

[[email protected] ~]# df-h

Filesystem                    Size  Used Avail Use% Mounted on

/dev/mapper/VolGroup-lv_root  533G  24G  487G   5% /

tmpfs                          16G  254M  16G   2% /dev/shm

/dev/sda1                     477M   55M 397M  13% /boot

/dev/asm/testvol-347           30G  138M  30G   1%/u01/app/grid/acfsmounts/data_testvol

[[email protected] ~]#

图形界面查看状态如下

再次查看集群资源状态

[[email protected] ~]$crsctl stat res -t

---------------------------------------------------------------------

NAME           TARGET  STATE       SERVER                  STATE_DETAILS

---------------------------------------------------------------------

Local Resources

---------------------------------------------------------------------ora.ARCH.dg

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.CRS.dg

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.DATA.dg

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.LISTENER.lsnr

ONLINE ONLINE       jxcw1

ONLINE  ONLINE      jxcw2

ora.asm

ONLINE  ONLINE      jxcw1                   Started

ONLINE  ONLINE      jxcw2                   Started

ora.gsd

OFFLINE OFFLINE      jxcw1

OFFLINE OFFLINE      jxcw2

ora.net1.network

ONLINE  ONLINE       jxcw1

ONLINE  ONLINE      jxcw2

ora.ons

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.registry.acfs

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

---------------------------------------------------------------------

Cluster Resources

---------------------------------------------------------------------ora.LISTENER_SCAN1.lsnr

1       ONLINE  ONLINE       jxcw2

ora.cvu

1       ONLINE  ONLINE       jxcw2

ora.jxcw.db

1       ONLINE  ONLINE       jxcw1                    Open

2       ONLINE  ONLINE       jxcw2                    Open

ora.jxcw1.vip

1       ONLINE  ONLINE       jxcw1

ora.jxcw2.vip

1       ONLINE  ONLINE       jxcw2

ora.oc4j

1       ONLINE  ONLINE       jxcw2

ora.scan1.vip

1       ONLINE  ONLINE       jxcw2

[[email protected] ~]$

3.  asmca图形界面创建

切换到grid用户下，执行asmca启动图形界面进行配置

启动图形界面后，点击asm instance可以看到advm driver状态为loaded。若acfs与advm驱动未加载时，状态为installed，volumes与asmcluster file systems标签栏为灰色无法点击。点击volumes标签，创建卷。

图中为使用命令创建成功的卷。再次点击create

指定卷名为jxcwvol，大小为25G,点击OK。

创建成功，点击ok退出，显示如下：

点击asm clusterfile systems标签

点击create,选择刚才创建的卷，选择database home file system选项，并指定图中所示挂载点。选择该选项该文件系统将作为集群资源被注册在集群中，由集群进行管理。

点击ok，创建ACFS文件系统。点击ok执行的命令如下

Create ACFSCommand:

/sbin/mkfs -t acfs/dev/asm/jxcw-347

Following commandsshould be run as privileged user :

/u01/app/11.2.0/grid/bin/srvctladd filesystem -d /dev/asm/jxcw-347 -g ‘DATA‘ -v jxcwvol -m/u01/app/grid/acfsmounts/data_jxcwvol -u grid

/u01/app/11.2.0/grid/bin/srvctlstart filesystem -d /dev/asm/jxcw-347

chown grid:oinstall/u01/app/grid/acfsmounts/ data_jxcwvol

chmod 775/u01/app/grid/acfsmounts/data_jxcwvol

根据提示使用root账户在ASMCA图形界面启动的节点上执行途中所示命令，如下：

[[email protected] ~]#/u01/app/grid/cfgtoollogs/asmca/scripts/acfs_script.sh

ACFS file system isrunning on jxcw1,jxcw2

[[email protected] ~]#

备注：途中所执行脚本内容如下：

[[email protected] ~]# vi/u01/app/grid/cfgtoollogs/asmca/scripts/acfs_script.sh

#!/bin/sh

/u01/app/11.2.0/grid/bin/srvctlstop filesystem -d /dev/asm/jxcwvol-347

/u01/app/11.2.0/grid/bin/srvctlremove filesystem -d /dev/asm/jxcwvol-347

/u01/app/11.2.0/grid/bin/srvctladd filesystem -d /dev/asm/jxcwvol-347 -g ‘DATA‘ -v JXCWVOL -m/u01/app/grid/acfsmounts/data_jxcwvol -u grid

if [ $? ="0" -o $? = "2" ]; then

/u01/app/11.2.0/grid/bin/srvctl startfilesystem -d /dev/asm/jxcwvol-347

if [ $? = "0" ]; then

chown grid:oinstall/u01/app/grid/acfsmounts/data_jxcwvol

chmod 775/u01/app/grid/acfsmounts/data_jxcwvol

/u01/app/11.2.0/grid/bin/srvctl statusfilesystem -d /dev/asm/jxcwvol-347

exit 0

fi

/u01/app/11.2.0/grid/bin/srvctl statusfilesystem -d /dev/asm/jxcwvol-347

fi

执行成功在两节点分别查看，新加ACFS文件系统已被挂载。

[[email protected] ~]# df-h

Filesystem                    Size  Used Avail Use% Mounted on

/dev/mapper/VolGroup-lv_root  532G  34G  476G   7% /

tmpfs                          16G  258M  16G   2% /dev/shm

/dev/sda1                     477M   55M 397M  13% /boot

/dev/asm/testvol-347           30G 138M   30G   1% /u01/app/grid/acfsmounts/data_testvol

/dev/asm/jxcwvol-347           25G 128M   25G   1% /u01/app/grid/acfsmounts/data_jxcwvol

[[email protected] ~]#

[[email protected] ~]# df-h

Filesystem                    Size  Used Avail Use% Mounted on

/dev/mapper/VolGroup-lv_root  533G  24G  487G   5% /

tmpfs                          16G  255M  16G   2% /dev/shm

/dev/sda1                     477M   55M 397M  13% /boot

/dev/asm/testvol-347           30G 138M   30G   1% /u01/app/grid/acfsmounts/data_testvol

/dev/asm/jxcwvol-347           25G 128M   25G   1% /u01/app/grid/acfsmounts/data_jxcwvol

[[email protected] ~]#

再次看集群资源状态，新创建的ACFS文件系统被作为资源加入集群。

[[email protected] ~]$crsctl stat res -t

---------------------------------------------------------------------

NAME           TARGET  STATE       SERVER                  STATE_DETAILS

---------------------------------------------------------------------

Local Resources

---------------------------------------------------------------------

ora.ARCH.dg

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.CRS.dg

ONLINE ONLINE       jxcw1

ONLINE  ONLINE      jxcw2

ora.DATA.dg

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.LISTENER.lsnr

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.asm

ONLINE  ONLINE      jxcw1                   Started

ONLINE  ONLINE      jxcw2                   Started

ora.data.jxcwvol.acfs

ONLINE  ONLINE      jxcw1                    mountedon /u01/app

/grid/acfsmounts/dat

a_jxcwvol

ONLINE  ONLINE      jxcw2                    mountedon /u01/app

/grid/acfsmounts/dat

a_jxcwvol

ora.gsd

OFFLINE OFFLINE      jxcw1

OFFLINE OFFLINE      jxcw2

ora.net1.network

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.ons

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.registry.acfs

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

---------------------------------------------------------------------ClusterResources

---------------------------------------------------------------------ora.LISTENER_SCAN1.lsnr

1       ONLINE  ONLINE       jxcw2

ora.cvu

1       ONLINE  ONLINE       jxcw2

ora.jxcw.db

1       ONLINE  ONLINE       jxcw1                    Open

2       ONLINE  ONLINE       jxcw2                    Open

ora.jxcw1.vip

1       ONLINE  ONLINE       jxcw1

ora.jxcw2.vip

1       ONLINE  ONLINE       jxcw2

ora.oc4j

1       ONLINE  ONLINE       jxcw2

ora.scan1.vip

1       ONLINE  ONLINE       jxcw2

[[email protected] ~]$

再次查看注册信息如下：

[[email protected] ~]#acfsutil info fs

/u01/app/grid/acfsmounts/data_testvol

ACFS Version: 11.2.0.4.0

flags:        MountPoint,Available

mount time:   Fri Oct 28 13:37:27 2016

volumes:      1

total size:   32212254720

total free:   32068386816

primary volume: /dev/asm/testvol-347

label:

flags:                 Primary,Available,ADVM

on-disk version:       39.0

allocation unit:       4096

major, minor:          251, 177665

size:                  32212254720

free:                  32068386816

ADVM diskgroup         DATA

ADVM resize increment: 33554432

ADVM redundancy:       unprotected

ADVM stripe columns:   4

ADVM stripe width:     131072

number of snapshots:  0

snapshot space usage: 0

replication status: DISABLED

/u01/app/grid/acfsmounts/data_jxcwvol

ACFS Version: 11.2.0.4.0

flags:        MountPoint,Available

mount time:   Fri Oct 28 13:45:44 2016

volumes:      1

total size:   26843545600

total free:   26710327296

primary volume: /dev/asm/jxcwvol-347

label:

flags:                 Primary,Available,ADVM

on-disk version:       39.0

allocation unit:       4096

major, minor:          251, 177666

size:                  26843545600

free:                  26710327296

ADVM diskgroup         DATA

ADVM resize increment: 33554432

ADVM redundancy:       unprotected

ADVM stripe columns:   4

ADVM stripe width:     131072

number of snapshots:  0

snapshot space usage: 0

replication status: DISABLED

[[email protected] ~]#

4.  删除ACFS文件系统

（1）、当前状态查看

[[email protected] ~]# df-h

Filesystem                    Size  Used Avail Use% Mounted on

/dev/mapper/VolGroup-lv_root  532G  34G  476G   7% /

tmpfs                          16G 256M   16G   2% /dev/shm

/dev/sda1                     477M   55M 397M  13% /boot

/dev/asm/jxcwvol-347           30G 138M   30G   1% /u01/app/grid/acfsmounts/data_jxcwvol

/dev/asm/testvol-347           15G 107M   15G   1% /u01/app/grid/acfsmounts/data_testvol

[[email protected] ~]#

[[email protected] ~]# df-h

Filesystem                    Size  Used Avail Use% Mounted on

/dev/mapper/VolGroup-lv_root  533G  24G  487G   5% /

tmpfs                          16G  254M  16G   2% /dev/shm

/dev/sda1                     477M   55M 397M  13% /boot

/dev/asm/jxcwvol-347           30G 138M   30G   1% /u01/app/grid/acfsmounts/data_jxcwvol

/dev/asm/testvol-347           15G 107M   15G   1% /u01/app/grid/acfsmounts/data_testvol

[[email protected] ~]#

[[email protected] ~]# su -grid

[[email protected] ~]$crsctl stat res -t

--------------------------------------------------------------------------------

NAME           TARGET  STATE       SERVER                  STATE_DETAILS

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.ARCH.dg

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.CRS.dg

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.DATA.dg

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.LISTENER.lsnr

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.asm

ONLINE  ONLINE      jxcw1                   Started

ONLINE  ONLINE      jxcw2                    Started

ora.data.jxcwvol.acfs

ONLINE  ONLINE      jxcw1                    mountedon /u01/app

/grid/acfsmounts/dat

a_jxcwvol

ONLINE  ONLINE      jxcw2                    mountedon /u01/app

/grid/acfsmounts/dat

a_jxcwvol

ora.gsd

OFFLINE OFFLINE      jxcw1

OFFLINE OFFLINE      jxcw2

ora.net1.network

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.ons

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.registry.acfs

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

1       ONLINE  ONLINE       jxcw1

ora.cvu

1       ONLINE  ONLINE       jxcw2

ora.jxcw.db

1       ONLINE  ONLINE       jxcw1                    Open

2       ONLINE  ONLINE       jxcw2                    Open

ora.jxcw1.vip

1       ONLINE  ONLINE       jxcw1

ora.jxcw2.vip

1       ONLINE  ONLINE       jxcw2

ora.oc4j

1       ONLINE  ONLINE       jxcw2

ora.scan1.vip

1       ONLINE  ONLINE       jxcw1

[[email protected] ~]$

（2）、卸载磁盘

节点1

[[email protected] ~]#umount /dev/asm/testvol-347

[[email protected] ~]#umount /dev/asm/jxcwvol-347

[[email protected] ~]# df-h

Filesystem                    Size  Used Avail Use% Mounted on

/dev/mapper/VolGroup-lv_root  532G  34G  476G   7% /

tmpfs                          16G  257M  16G   2% /dev/shm

/dev/sda1                     477M   55M  397M  13% /boot

[[email protected] ~]#

节点2

[[email protected] ~]#umount /dev/asm/testvol-347

[[email protected] ~]#umount /dev/asm/jxcwvol-347

[[email protected] ~]# df-h

Filesystem                    Size  Used Avail Use% Mounted on

/dev/mapper/VolGroup-lv_root  533G  24G  487G   5% /

tmpfs                          16G  254M  16G   2% /dev/shm

/dev/sda1                     477M   55M 397M  13% /boot

[[email protected] ~]#

再次查看资源状态

[[email protected] ~]$crsctl stat res -t

-------------------------------------------------------------------------------

NAME           TARGET  STATE       SERVER                  STATE_DETAILS

-------------------------------------------------------------------------------

Local Resources

-------------------------------------------------------------------------------

ora.ARCH.dg

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.CRS.dg

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.DATA.dg

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.LISTENER.lsnr

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.asm

ONLINE ONLINE       jxcw1                    Started

ONLINE  ONLINE      jxcw2                   Started

ora.data.jxcwvol.acfs

OFFLINE OFFLINE      jxcw1                    admin unmounted /u0

1/app/grid/acfsmount

s/data_jxcwvol

OFFLINE OFFLINE      jxcw2                    admin unmounted /u0

1/app/grid/acfsmount

s/data_jxcwvol

ora.gsd

OFFLINE OFFLINE      jxcw1

OFFLINE OFFLINE      jxcw2

ora.net1.network

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.ons

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.registry.acfs

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

-------------------------------------------------------------------------------

Cluster Resources

-------------------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

1       ONLINE  ONLINE       jxcw2

ora.cvu

1       ONLINE  ONLINE       jxcw1

ora.jxcw.db

1       ONLINE  ONLINE       jxcw1                    Open

2       ONLINE  ONLINE       jxcw2                    Open

ora.jxcw1.vip

1       ONLINE  ONLINE       jxcw1

ora.jxcw2.vip

1       ONLINE  ONLINE       jxcw2

ora.oc4j

1       ONLINE  ONLINE       jxcw1

ora.scan1.vip

1       ONLINE  ONLINE       jxcw2

[[email protected] ~]$

可以看出图形界面创建的jxcwvol卷，卸载文件系统后，ora.data.jxcwvol.acfs

资源自动offline，卷为umounted状态；testvol关联与ora.registry.acfs资源，该资源状态正常。

（3）、停止ora.registry.acfs资源

[[email protected] ~]$crsctl stop resource ora.registry.acfs -n jxcw1

CRS-2673: Attemptingto stop ‘ora.registry.acfs‘ on ‘jxcw1‘

CRS-2677: Stop of‘ora.registry.acfs‘ on ‘jxcw1‘ succeeded

[[email protected] ~]$crsctl stop resource ora.registry.acfs -n jxcw2

CRS-2673: Attemptingto stop ‘ora.registry.acfs‘ on ‘jxcw2‘

CRS-2677: Stop of‘ora.registry.acfs‘ on ‘jxcw2‘ succeeded

[[email protected] ~]$crsctl stat res -t

-------------------------------------------------------------------------------

NAME           TARGET  STATE       SERVER                  STATE_DETAILS

-------------------------------------------------------------------------------

Local Resources

-------------------------------------------------------------------------------

ora.ARCH.dg

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.CRS.dg

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.DATA.dg

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.LISTENER.lsnr

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.asm

ONLINE  ONLINE      jxcw1                   Started

ONLINE  ONLINE      jxcw2                    Started

ora.data.jxcwvol.acfs

OFFLINE OFFLINE      jxcw1                    admin unmounted /u0

1/app/grid/acfsmount

s/data_jxcwvol

OFFLINE OFFLINE      jxcw2                    admin unmounted /u0

1/app/grid/acfsmount

s/data_jxcwvol

ora.gsd

OFFLINE OFFLINE      jxcw1

OFFLINE OFFLINE      jxcw2

ora.net1.network

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.ons

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE      jxcw2

ora.registry.acfs

OFFLINE OFFLINE      jxcw1

OFFLINE OFFLINE      jxcw2

-------------------------------------------------------------------------------

Cluster Resources

-------------------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

1       ONLINE  ONLINE       jxcw2

ora.cvu

1       ONLINE  ONLINE       jxcw1

ora.jxcw.db

1       ONLINE  ONLINE       jxcw1                    Open

2       ONLINE  ONLINE       jxcw2                    Open

ora.jxcw1.vip

1       ONLINE  ONLINE       jxcw1

ora.jxcw2.vip

1       ONLINE  ONLINE       jxcw2

ora.oc4j

1       ONLINE  ONLINE       jxcw1

ora.scan1.vip

1       ONLINE  ONLINE       jxcw2

[[email protected] ~]$

（4）、删除注册信息

仅在一个节点执行

[[email protected] ~]#acfsutil registry -d /u01/app/grid/acfsmounts/data_testvol/

acfsutil registry: successfully removed ACFS mount point/u01/app/grid/acfsmounts/data_testvol from Oracle Registry

[[email protected] ~]#

上一步中已ora.data.jxcwvol.acfs资源offline，移除注册信息报错正常。

[[email protected] ~]#acfsutil registry -d /u01/app/grid/acfsmounts/data_jxcwvol/

acfsutil registry:ACFS-03143: The specified mount point does not exist and therefore cannot bedeleted.

[[email protected] ~]#

（5）、删除ACFS文件系统

仅在一个节点执行删除

[[email protected] ~]#acfsutil rmfs /dev/asm/testvol-347

[[email protected] ~]#acfsutil rmfs /dev/asm/jxcwvol-347

（6）、禁用volume

需要在两节点执行

节点1禁止

[[email protected] ~]$asmcmd

ASMCMD>voldisable -G data testvol

ASMCMD>voldisable -G data jxcwvol

ASMCMD>

节点2禁止

[[email protected] ~]$asmcmd

ASMCMD>voldisable -G data testvol

ASMCMD> voldisable-G data jxcwvol

ASMCMD> exit

[[email protected] ~]$

（7）、删除卷

仅在一个节点执行。

[[email protected] ~]$asmcmd

ASMCMD> ls

ASMCMD> voldelete-G data testvol

ASMCMD> voldelete-G data jxcwvol

（8）、删除资源对象

[[email protected]~]#/u01/app/11.2.0/grid/bin/srvctl remove filesystem-d /dev/asm/jxcwvol-347

[[email protected] ~]$ crsctl stat res -t

---------------------------------------------------------------------

NAME          TARGET  STATE        SERVER                   STATE_DETAILS

---------------------------------------------------------------------

Local Resources

ora.ARCH.dg

ONLINE  ONLINE       jxcw1

ONLINE  ONLINE       jxcw2

ora.CRS.dg

ONLINE  ONLINE      jxcw1

ONLINE  ONLINE       jxcw2

ora.DATA.dg

ONLINE  ONLINE       jxcw1

ONLINE  ONLINE      jxcw2

ora.LISTENER.lsnr

ONLINE  ONLINE       jxcw1

ONLINE  ONLINE       jxcw2

ora.asm

ONLINE  ONLINE       jxcw1                    Started

ONLINE  ONLINE       jxcw2                    Started

ora.gsd

OFFLINE OFFLINE      jxcw1

OFFLINE OFFLINE      jxcw2

ora.net1.network

ONLINE  ONLINE       jxcw1

ONLINE  ONLINE       jxcw2

ora.ons

ONLINE  ONLINE       jxcw1

ONLINE  ONLINE       jxcw2

ora.registry.acfs

ONLINE  ONLINE       jxcw1

ONLINE  ONLINE       jxcw2

---------------------------------------------------------------------ClusterResources

---------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

1        ONLINE ONLINE       jxcw2

ora.cvu

1        ONLINE ONLINE       jxcw2

ora.jxcw.db

1        ONLINE ONLINE       jxcw1                    Open

2        ONLINE ONLINE       jxcw2                    Open

ora.jxcw1.vip

1        ONLINE ONLINE       jxcw1

ora.jxcw2.vip

1        ONLINE ONLINE       jxcw2

ora.oc4j

1        ONLINE ONLINE       jxcw2

ora.scan1.vip

1        ONLINE ONLINE       jxcw2

[[email protected] ~]$

时间： 2024-08-10 19:16:19

OEL6.5_X86平台部署oracle11gR2RAC配置ACFS的相关文章

OEL6.8_X86平台部署oracle10gR2检测失败问题

系统是OEL6.8,更改过/etc/redhat-release为redhat-4安装10.2.0.1.0安装成功.启动runinstaller 成功的,但是在安装10.2.0.4.0的patch时候 就不行了, Checking operating system version: must be redhat-3, SuSE-9, SuSE-10, redhat-4, redhat-5, redhat-6, UnitedLinux-1.0, asianux-1, asianux-2, asia

《1》CentOS7.0+OpenStack+kvm云平台部署—基础配置

一.主机分配: 主机名        IP(Static)       系统配置                                      角色 openstack      192.168.1.2    CentOS-7.0-x86_64-desktop     4CPU,16G RAM,300G DISK,2网卡       管理节点/计算节点 node          192.168.1.3    CentOS-7.0-x86_64-desktop    4CPU,16G

日志分析ELK平台部署

工作原理如下如所示: 部署流程: 1.安装logstash的JDK环境: # tar zvxf jdk-8u73-linux-x64.tar.gz # mv jdk-8u73-linux-x64 /usr/local/java # vim /etc/profile export JAVA_HOME=/usr/local/java CLASSPATH=/usr/local/java/lib/dt.jar/usr/local/java/lib/tools.jar PATH=/usr/local/ja

Linux平台部署nginx反向代理实例

nginx有着优秀的代理性能,很多情况下,nginx常常被充当反向代理服务器负载后端应用web构建起一个高性能高可用的web集群(淘宝tengix ,京东的nginx集群都使用到了nginx反向代理功能),接下来给大家讲解Linux平台部署nginx反向代理实例. [本文档所介绍的内容适用于公司测试/生产等常见的nginx反向代理应用] 1. nginx环境部署前准备: 1.1相关软件以及系统 系统要求:Centos 6.0以上 (64位) 相关中间件:Nginx: 1.6.0 以上(包含1.6

KVM虚拟化平台部署及管理

前言 KVM即Kernel Virtual Machine,最初是由以色列公司Qumranet开发.2007年2月被导入Linux 2.6.20核心中,成为内核源代码的一部分.2008年9月4日,Redhat收购了Qumranet,至此Redhat拥有了自己的虚拟化解决方案,之后便舍弃Xen开始全面扶持KVM,从RHEL6开始KVM便被默认内置于内核中.本文介绍KVM虚拟化平台部署及管理. KVM简介 KVM特点 KVM必须在具备Intel VT或AMD-V功能的x86平台上运行.KVM包含一个

Puppet基于Master/Agent模式实现LNMP平台部署

前言 随着IT行业的迅猛发展,传统的运维方式靠大量人力比较吃力,运维人员面对日益增长的服务器和运维工作,不得不把很多重复的.繁琐的工作利用自动化处理.前期我们介绍了运维自动化工具ansible的简单应用,本期带来的是运维自动化神器puppet基于Master/Agent模式实现LNMP平台部署. Puppet 简介 Puppet是基于ruby语言开发的一种Linux.Unix.Windows平台的集中配置管理系统,可以C/S模式或独立运行,使用自有的puppet描述语言,可管理配置文件.用户.c

Windows Azure Pack快速部署（2） Azure Pack服务平台部署

Windows Azure Pack快速部署(2) Azure Pack服务平台部署 编号 FQDN IP OS 角色 1 12dc.contoso.com 192.168.6.10/24 Windows Server 2012 R2 Str AD服务器 2 WAP.contoso.com 192.168.6.11/24 Windows Server 2012 R2 Str Azure Pack 3 SPF.contoso.com 192.168.6.12/24 Windows Server 2

ELK服务搭建（开源实时日志分析ELK平台部署）（低版本—简单部署）

开源实时日志分析ELK平台部署 日志主要包括系统日志.应用程序日志和安全日志.系统运维和开发人员可以通过日志了解服务器软硬件信息.检查配置过程中的错误及错误发生的原因.经常分析日志可以了解服务器的负荷,性能安全性,从而及时采取措施纠正错误. 通常,日志被分散的储存不同的设备上.如果你管理数十上百台服务器,你还在使用依次登录每台机器的传统方法查阅日志.这样是不是感觉很繁琐和效率低下.当务之急我们使用集中化的日志管理,例如:开源的syslog,将所有服务器上的日志收集汇总. 集中化管理日志后,日志的

虚拟化技术之KVM平台部署及简单应用

前言  KVM即Kernel Virtual Machine,最初是由以色列公司Qumranet开发.2007年2月被导入Linux 2.6.20核心中,成为内核源代码的一部分.2008年9月4日,Redhat收购了Qumranet,至此Redhat拥有了自己的虚拟化解决方案,之后便舍弃Xen开始全面扶持KVM,从RHEL6开始KVM便被默认内置于内核中.本文介绍KVM虚拟化平台部署及管理. KVM简介KVM特点  KVM必须在具备Intel VT或AMD-V功能的x86平台上运行.KVM包含一