Centos 6.5 X86_64 安装oracle 11g rac，采用ASMlib创建asm磁盘

点击打开链接rac1-> ./runcluvfy.sh comp ssa -n rac1 -s /dev/sdb1,/dev/sdc1,/dev/sde1,/dev/sdf1

Verifying shared storage accessibility 

Checking shared storage accessibility...

PRVG-11110 : The specified database file location "/dev/sde" did not have read and write access to user "grid" on node "rac1"

PRVG-11110 : The specified database file location "/dev/sdc" did not have read and write access to user "grid" on node "rac1"

PRVG-11110 : The specified database file location "/dev/sdf" did not have read and write access to user "grid" on node "rac1"

PRVG-11110 : The specified database file location "/dev/sdb" did not have read and write access to user "grid" on node "rac1"

"/dev/sdb1" is shared

"/dev/sdc1" is shared

"/dev/sde1" is shared

"/dev/sdf1" is shared

Shared storage check was successful on nodes "rac1"

Verification of shared storage accessibility was unsuccessful on all the specified nodes. 
rac1-> ./runcluvfy.sh comp ssa -n rac2 -s /dev/sdb1,/dev/sdc1,/dev/sde1,/dev/sdf1 

Verifying shared storage accessibility 

Checking shared storage accessibility...

PRVG-11110 : The specified database file location "/dev/sde" did not have read and write access to user "grid" on node "rac2"

PRVG-11110 : The specified database file location "/dev/sdb" did not have read and write access to user "grid" on node "rac2"

PRVG-11110 : The specified database file location "/dev/sdf" did not have read and write access to user "grid" on node "rac2"

PRVG-11110 : The specified database file location "/dev/sdc" did not have read and write access to user "grid" on node "rac2"

"/dev/sdb1" is shared

"/dev/sdc1" is shared

"/dev/sde1" is shared

"/dev/sdf1" is shared

Shared storage check was successful on nodes "rac2"

Verification of shared storage accessibility was unsuccessful on all the specified nodes. 


rac1-> 

原因：没有安装asmlib，没有配置asm磁盘

百度搜索：Oracle ASMLib Downloads for Red Hat Enterprise Linux  6

下载rpm包

[root@rac1 grid]# wget http://oss.oracle.com/projects/oracleasm-support/dist/files/RPMS/rhel6/amd64/2.1.8/oracleasm-support-2.1.8-1.el6.x86_64.rpm
[root@rac1 grid]# wget http://download.oracle.com/otn_software/asmlib/oracleasmlib-2.0.4-1.el6.x86_64.rpm
安装：

[root@rac1 grid]# rpm -Uvh oracleasmlib-2.0.4-1.el6.x86_64.rpm \

> oracleasm-support-2.1.8-1.el6.x86_64.rpm \

> 

Preparing...                ########################################### [100%]

   1:oracleasm-support      ########################################### [ 50%]

   2:oracleasmlib           ########################################### [100%]

问题：

系统CentOS 6.5 x86_64 

[root@rac1 grid]# uname -a

Linux rac1.localdomain 2.6.32-431.el6.x86_64 #1 SMP Fri Nov 22 03:15:09 UTC 2013 x86_64 x86_64 x86_64 GNU/Linux

[root@rac1 grid]# cat /etc/issue

CentOS release 6.5 (Final)

Kernel \r on an \m

[root@rac1 grid]# lsb_release -a

LSB Version:    :base-4.0-amd64:base-4.0-noarch:core-4.0-amd64:core-4.0-noarch:graphics-4.0-amd64:graphics-4.0-noarch:printing-4.0-amd64:printing-4.0-noarch

Distributor ID: CentOS

Description:    CentOS release 6.5 (Final)

Release:        6.5

Codename:       Final

[root@rac1 grid]# 

因为/sbin/scsi_id -g -u -d /dev/sdb返回为空，考虑用raw，创建asm磁盘

但只在官网中下载到

oracleasm-support-2.1.8-1.el6.x86_64.rpmoracleasmlib-2.0.4-1.el6.x86_64.rpm

这两个rpm包，已经安装，但创建asm磁盘失败，

官方说明:

oracleasm driver for RHEL 6

The kernel driver package 'kmod-oracleasm' is available directly from Red Hat, and can be installed from the "RHEL Server Supplementary (v. 6 64-bit x86_64)" channel on Red Hat Network (RHN).   

这个kmod-oracleasm是哪里可以下载？

下载kmod-oracleasm-2.0.6.rh1-3.el6.x86_64这个版本才可以安装上

升级内核（其他可以不用升级）RAC2没有升级，他可以安装成功

rpm --import https://www.elrepo.org/RPM-GPG-KEY-elrepo.org
rpm -Uvh http://www.elrepo.org/elrepo-release-6-6.el6.elrepo.noarch.rpm
yum --enablerepo=elrepo-kernel install kernel-lt -y

配置ASM磁盘

/usr/sbin/oracleasm configure -i

/etc/init.d/oracleasm enable

/usr/sbin/oracleasm createdisk DATA1 /dev/sdb1

/usr/sbin/oracleasm listdisks

/etc/init.d/oracleasm createdisk VOL1 /dev/sdb1

/etc/init.d/oracleasm createdisk VOL2 /dev/sdc1

/etc/init.d/oracleasm createdisk VOL3 /dev/sdd1

/etc/init.d/oracleasm createdisk VOL4 /dev/sde1

/etc/init.d/oracleasm createdisk VOL5 /dev/sdf1

  /etc/init.d/oracleasm createdisk VOL6 /dev/sdg1

问题：

[root@rac2 ~]# rpm -ivh oracleasmlib-2.0.4-1.el6.x86_64.rpm 

warning: oracleasmlib-2.0.4-1.el6.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID ec551f03: NOKEY

error: Failed dependencies:

        oracleasm >= 1.0.4 is needed by oracleasmlib-2.0.4-1.el6.x86_64

解决：

先安装rpm -ivh kmod-oracleasm-2.0.6.rh1-3.el6.x86_64.rpm 

[root@rac2 ~]# rpm -ivh kmod-oracleasm-2.0.6.rh1-3.el6.x86_64.rpm 

Preparing...                ########################################### [100%]

   1:kmod-oracleasm         ########################################### [100%]

再安装

[root@rac2 ~]# rpm -ivh oracleasmlib-2.0.4-1.el6.x86_64.rpm       

warning: oracleasmlib-2.0.4-1.el6.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID ec551f03: NOKEY

Preparing...                ########################################### [100%]

   1:oracleasmlib           ########################################### [100%]

[root@rac2 ~]# 

安装向导发现磁盘路径：

/dev/oracleasm/disks/*