Oracle 10g RAC 添加节点
2014-06-25 10:31
405 查看
目前环境是一个版本为10.2.0.5的双节点RAC,hostname分别为racnode1,racnode2需要添加新节点racnode3。
OS版本是Oracle Linux 5.7 x86_64
保证RAC正常运行
配置public IP,private IP,VIP,将这些信息配置到/etc/hosts文件中
192.168.1.51 racnode1
192.168.1.151 racnode1-vip
172.168.1.51 racnode1-priv
192.168.1.52 racnode2
192.168.1.152 racnode2-vip
172.168.1.52 racnode2-priv
192.168.1.53 racnode3
192.168.1.153 racnode3-vip
172.168.1.53 racnode3-priv
安装相关的rpm包,配置系统内核参数,我这里使用的是Oracle Linux5提供的的oracle-validated包进行安装配置
[root@racnode3 ~]# yum -y install oracle-validated
Loaded plugins: rhnplugin, security
This system is not registered with ULN.
ULN support will be disabled.
Setting up Install Process
Package oracle-validated-1.1.0-15.el5.x86_64 already installed and latest version
同步各节点的时间,我这里使用的是NTP
4000
服务
[root@racnode3 ~]# crontab -l
*/5 * * * * /usr/sbin/ntpdate 0.asia.pool.ntp.org > /dev/null 2>&1
配置共享磁盘
[root@racnode3 ~]# cat /etc/udev/rules.d/60-raw.rules
# Enter raw device bindings here.
#
# An example would be:
# ACTION=="add", KERNEL=="sda", RUN+="/bin/raw /dev/raw/raw1 %N"
# to bind /dev/raw/raw1 to /dev/sda, or
# ACTION=="add", ENV{MAJOR}=="8", ENV{MINOR}=="1", RUN+="/bin/raw /dev/raw/raw2 %M %m"
# to bind /dev/raw/raw2 to the device with major 8, minor 1.
ACTION=="add", KERNEL=="sdb1", RUN+="/bin/raw /dev/raw/raw1 %N"
ACTION=="add", KERNEL=="sdb2", RUN+="/bin/raw /dev/raw/raw2 %N"
ACTION=="add", KERNEL=="sdc1", RUN+="/bin/raw /dev/raw/raw3 %N"
ACTION=="add", KERNEL=="sdc2", RUN+="/bin/raw /dev/raw/raw4 %N"
ACTION=="add", KERNEL=="sdc3", RUN+="/bin/raw /dev/raw/raw5 %N"
ACTION=="add", KERNEL=="raw*", OWNER=="oracle", GROUP=="oinstall", MODE=="0660"
[root@racnode3 ~]# cat /etc/udev/rules.d/99-oracle-asmdevices.rules
KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -s %p", RESULT=="SATA_VBOX_HARDDISK_VB5407c582-c0bbcc9c_", NAME="asm-diskd", OWNER="oracle", GROUP="oinstall", MODE="0660"
KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -s %p", RESULT=="SATA_VBOX_HARDDISK_VB2048e338-447949c0_", NAME="asm-diske", OWNER="oracle", GROUP="oinstall", MODE="0660"
KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -s %p", RESULT=="SATA_VBOX_HARDDISK_VB6d6f72b0-997f769f_", NAME="asm-diskf", OWNER="oracle", GROUP="oinstall", MODE="0660"
KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -s %p", RESULT=="SATA_VBOX_HARDDISK_VB867b3aae-2e3a3f0b_", NAME="asm-diskg", OWNER="oracle", GROUP="oinstall", MODE="0660"
KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -s %p", RESULT=="SATA_VBOX_HARDDISK_VB4dcf4abf-0266b2fc_", NAME="asm-diskh", OWNER="oracle", GROUP="oinstall", MODE="0660"
[root@racnode3 ~]#
[root@racnode3 ~]# start_udev
Starting udev: [ OK ]
[root@racnode3 ~]# ls -l /dev/raw/raw*
crw-rw---- 1 oracle oinstall 162, 1 Dec 24 14:31 /dev/raw/raw1
crw-rw---- 1 oracle oinstall 162, 2 Dec 24 14:31 /dev/raw/raw2
crw-rw---- 1 oracle oinstall 162, 3 Dec 24 14:31 /dev/raw/raw3
crw-rw---- 1 oracle oinstall 162, 4 Dec 24 14:31 /dev/raw/raw4
crw-rw---- 1 oracle oinstall 162, 5 Dec 24 14:31 /dev/raw/raw5
[root@racnode3 ~]# ls -l /dev/asm-disk*
brw-rw---- 1 oracle oinstall 8, 48 Dec 24 14:31 /dev/asm-diskd
brw-rw---- 1 oracle oinstall 8, 64 Dec 24 14:31 /dev/asm-diske
brw-rw---- 1 oracle oinstall 8, 80 Dec 24 14:31 /dev/asm-diskf
brw-rw---- 1 oracle oinstall 8, 96 Dec 24 14:31 /dev/asm-diskg
brw-rw---- 1 oracle oinstall 8, 112 Dec 24 14:31 /dev/asm-diskh
配置ssh用户等效性
[oracle@racnode1 ~]$ ssh racnode1 date;ssh racnode2 date;ssh racnode3 date
Mon Dec 24 14:37:08 CST 2012
Mon Dec 24 14:37:08 CST 2012
Mon Dec 24 14:37:08 CST 2012
[oracle@racnode1 ~]$ ssh racnode1-priv date;ssh racnode2-priv date;ssh racnode3-priv date
Mon Dec 24 14:37:15 CST 2012
Mon Dec 24 14:37:16 CST 2012
Mon Dec 24 14:37:16 CST 2012
[oracle@racnode2 ~]$ ssh racnode1 date;ssh racnode2 date;ssh racnode3 date
Mon Dec 24 14:38:22 CST 2012
Mon Dec 24 14:38:22 CST 2012
Mon Dec 24 14:38:22 CST 2012
[oracle@racnode2 ~]$ ssh racnode1-priv date;ssh racnode2-priv date;ssh racnode3-priv date
Mon Dec 24 14:38:27 CST 2012
Mon Dec 24 14:38:27 CST 2012
Mon Dec 24 14:38:27 CST 2012
[oracle@racnode3 ~]$ ssh racnode1 date;ssh racnode2 date;ssh racnode3 date
Mon Dec 24 14:40:39 CST 2012
Mon Dec 24 14:40:39 CST 2012
Mon Dec 24 14:40:39 CST 2012
[oracle@racnode3 ~]$ ssh racnode1-priv date;ssh racnode2-priv date;ssh racnode3-priv date
Mon Dec 24 14:40:54 CST 2012
Mon Dec 24 14:40:54 CST 2012
Mon Dec 24 14:40:54 CST 2012
配置racnode3 oracle用户的环境变量
alias ls="ls -FA"
export JAVA_HOME=/usr/local/java
# User specific environment and startup programs
export ORACLE_BASE=/u01/app/oracle
export ORACLE_HOME=$ORACLE_BASE/product/10.2.0/db_1
export ORA_CRS_HOME=$ORACLE_BASE/product/10.2.0/crs
export ORACLE_PATH=$ORACLE_BASE/common/oracle/sql:.:$ORACLE_HOME/rdbms/admin
export CV_JDKHOME=/usr/local/java
export ORACLE_SID=racdb3
export PATH=.:${JAVA_HOME}/bin:${PATH}:$HOME/bin:$ORACLE_HOME/bin:$ORA_CRS_HOME/bin
export PATH=${PATH}:/usr/bin:/bin:/usr/bin/X11:/usr/local/bin
export PATH=${PATH}:$ORACLE_BASE/common/oracle/bin
export ORACLE_TERM=xterm
export TNS_ADMIN=$ORACLE_HOME/network/admin
export ORA_NLS10=$ORACLE_HOME/nls/data
export NLS_DATE_FORMAT="DD-MON-YYYY HH24:MI:SS"
export DISPLAY=192.168.2.224:0.0
export NLS_LANG=AMERICAN_AMERICA.ZHS16GBK
export LD_LIBRARY_PATH=$ORACLE_HOME/lib
export LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:$ORACLE_HOME/oracm/lib
export LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:/lib:/usr/lib:/usr/local/lib
export CLASSPATH=$ORACLE_HOME/JRE
export CLASSPATH=${CLASSPATH}:$ORACLE_HOME/jlib
export CLASSPATH=${CLASSPATH}:$ORACLE_HOME/rdbms/jlib
export CLASSPATH=${CLASSPATH}:$ORACLE_HOME/network/jlib
export THREADS_FLAG=native
export TEMP=/tmp
export TMPDIR=/tmp
alias ls="ls -FA"
alias sqlplus="rlwrap sqlplus"
alias rman="rlwrap rman"
alias ggsci="rlwrap ggsci"
alias logdump="rlwrap logdump"
alias asmcmd="rlwrap asmcmd"
alias base="cd $ORACLE_BASE"
alias home="cd $ORACLE_HOME"
添加RAC Clusterware节点
在racnode1使用oracle用户执行$ORA_CRS_HOME/oui/bin/addNode.sh
[oracle@racnode1 ~]$ cd /u01/app/oracle/product/10.2.0/crs/oui/bin/
[oracle@racnode1 bin]$ ./addNode.sh
Starting Oracle Universal Installer...
No pre-requisite checks found in oraparam.ini, no system pre-requisite checks will be executed.
Oracle Universal Installer, Version 10.2.0.5.0 Production
Copyright (C) 1999, 2010, Oracle. All rights reserved.
用root用户在racnode3上运行
/u01/app/oracle/oraInventory/orainstRoot.sh
[root@racnode3 ~]# /u01/app/oracle/oraInventory/orainstRoot.sh
Changing permissions of /u01/app/oracle/oraInventory to 770.
Changing groupname of /u01/app/oracle/oraInventory to oinstall.
The execution of the script is complete
用root用户在racnode1上运行
/u01/app/oracle/product/10.2.0/crs/install/rootaddnode.sh
[root@racnode1 ~]# /u01/app/oracle/product/10.2.0/crs/install/rootaddnode.sh
clscfg: EXISTING configuration version 3 detected.
clscfg: version 3 is 10G Release 2.
Attempting to add 1 new nodes to the configuration
Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
node <nodenumber>: <nodename> <private interconnect name> <hostname>
node 3: racnode3 racnode3-priv racnode3
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
/u01/app/oracle/product/10.2.0/crs/bin/srvctl add nodeapps -n racnode3 -A racnode3-vip/255.255.0.0/eth0 -o /u01/app/oracle/product/10.2.0/crs
用root用户在racnode3运行
/u01/app/oracle/product/10.2.0/crs/root.sh
[root@racnode3 ~]# /u01/app/oracle/oraInventory/orainstRoot.sh
Changing permissions of /u01/app/oracle/oraInventory to 770.
Changing groupname of /u01/app/oracle/oraInventory to oinstall.
The execution of the script is complete
[root@racnode3 ~]# /u01/app/oracle/product/10.2.0/crs/root.sh
WARNING: directory '/u01/app/oracle/product/10.2.0' is not owned by root
WARNING: directory '/u01/app/oracle/product' is not owned by root
WARNING: directory '/u01/app/oracle' is not owned by root
WARNING: directory '/u01/app' is not owned by root
No value set for the CRS parameter CRS_OCR_LOCATIONS. Using Values in paramfile.crs
Checking to see if Oracle CRS stack is already configured
/etc/oracle does not exist. Creating it now.
OCR LOCATIONS = /dev/raw/raw1,/dev/raw/raw2
OCR backup directory '/u01/app/oracle/product/10.2.0/crs/cdata/crs' does not exist. Creating now
Setting the permissions on OCR backup directory
Setting up NS directories
Oracle Cluster Registry configuration upgraded successfully
WARNING: directory '/u01/app/oracle/product/10.2.0' is not owned by root
WARNING: directory '/u01/app/oracle/product' is not owned by root
WARNING: directory '/u01/app/oracle' is not owned by root
WARNING: directory '/u01/app' is not owned by root
clscfg: EXISTING configuration version 3 detected.
clscfg: version 3 is 10G Release 2.
Successfully accumulated necessary OCR keys.
Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
node <nodenumber>: <nodename> <private interconnect name> <hostname>
node 1: racnode1 racnode1-priv racnode1
node 2: racnode2 racnode2-priv racnode2
clscfg: Arguments check out successfully.
NO KEYS WERE WRITTEN. Supply -force parameter to override.
-force is destructive and will destroy any previous cluster
configuration.
Oracle Cluster Registry for cluster has already been initialized
Startup will be queued to init within 30 seconds.
Adding daemons to inittab
Expecting the CRS daemons to be up within 600 seconds.
CSS is active on these nodes.
racnode1
racnode2
racnode3
CSS is active on all nodes.
Waiting for the Oracle CRSD and EVMD to start
Waiting for the Oracle CRSD and EVMD to start
Oracle CRS stack installed and running under init(1M)
脚本全部执行后Exit退出
在racnode3上安装Oracle Database software
在racnode1上使用oracle用户执行$ORACLE_HOME/oui/bin/addNode.sh
[oracle@racnode1 bin]$ cd /u01/app/oracle/product/10.2.0/db_1/oui/bin/
[oracle@racnode1 bin]$ ./addNode.sh
Starting Oracle Universal Installer...
No pre-requisite checks found in oraparam.ini, no system pre-requisite checks will be executed.
Oracle Universal Installer, Version 10.2.0.5.0 Production
Copyright (C) 1999, 2010, Oracle. All rights reserved.
用root用户在racnode3上执行
/u01/app/oracle/product/10.2.0/db_1/root.sh
[root@racnode3 ~]# /u01/app/oracle/product/10.2.0/db_1/root.sh
Running Oracle 10g root.sh script...
The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /u01/app/oracle/product/10.2.0/db_1
Enter the full pathname of the local bin directory: [/usr/local/bin]:
Copying dbhome to /usr/local/bin ...
Copying oraenv to /usr/local/bin ...
Copying coraenv to /usr/local/bin ...
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root.sh script.
Now product-specific root actions will be performed.
执行之后Exit退出
配置监听
[oracle@racnode3 admin]$ cat listener.ora
# listener.ora.racnode2 Network Configuration File: /u01/app/oracle/product/10.2.0/db_1/network/admin/listener.ora.racnode2
# Generated by Oracle configuration tools.
LISTENER_RACNODE3 =
(DESCRIPTION_LIST =
(DESCRIPTION =
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = TCP)(HOST = racnode3-vip)(PORT = 1521)(IP = FIRST))
)
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.1.53)(PORT = 1521)(IP = FIRST))
)
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC))
)
)
)
[oracle@racnode3 admin]$ cat tnsnames.ora
# tnsnames.ora Network Configuration File: /u01/app/oracle/product/10.2.0/db_1/network/admin/tnsnames.ora
# Generated by Oracle configuration tools.
RACDB1 =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = racnode1-vip)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = racdb)
(INSTANCE_NAME = racdb1)
)
)
RACDB =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = racnode1-vip)(PORT = 1521))
(ADDRESS = (PROTOCOL = TCP)(HOST = racnode2-vip)(PORT = 1521))
(ADDRESS = (PROTOCOL = TCP)(HOST = racnode3-vip)(PORT = 1521))
(LOAD_BALANCE = yes)
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = racdb)
)
)
LISTENERS_RACDB =
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = TCP)(HOST = racnode1-vip)(PORT = 1521))
(ADDRESS = (PROTOCOL = TCP)(HOST = racnode2-vip)(PORT = 1521))
(ADDRESS = (PROTOCOL = TCP)(HOST = racnode3-vip)(PORT = 1521))
)
RACDB2 =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = racnode2-vip)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = racdb)
(INSTANCE_NAME = racdb2)
)
)
RACDB3 =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = racnode3-vip)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = racdb)
(INSTANCE_NAME = racdb3)
)
)
在racnode1上使用DBCA添加racnode3的instance
点击No
验证
SQL> select INSTANCE_NAME,HOST_NAME,VERSION,STARTUP_TIME,STATUS,ACTIVE_STATE,INSTANCE_ROLE,DATABASE_STATUS from gv$INSTANCE;
INSTANCE_NAME HOST_NAME VERSION STARTUP_TIME STATUS ACTIVE_ST INSTANCE_ROLE DATABASE_STATUS
---------------- ----------- ----------------- ----------------------- ------------ --------- ------------------ -----------------
racdb2 racnode2 10.2.0.5.0 20-DEC-2012 16:07:46 OPEN NORMAL PRIMARY_INSTANCE ACTIVE
racdb1 racnode1 10.2.0.5.0 20-DEC-2012 16:07:46 OPEN NORMAL PRIMARY_INSTANCE ACTIVE
racdb3 racnode3 10.2.0.5.0 24-DEC-2012 16:32:35 OPEN NORMAL PRIMARY_INSTANCE ACTIVE
SQL> exit
Disconnected from Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
[oracle@racnode2 ~]$ crs_stat -t -v
Name Type R/RA F/FT Target State Host
----------------------------------------------------------------------
ora.racdb.db application 0/0 0/1 ONLINE ONLINE racnode1
ora....b1.inst application 0/5 0/0 ONLINE ONLINE racnode1
ora....b2.inst application 0/5 0/0 ONLINE ONLINE racnode2
ora....b3.inst application 0/5 0/0 ONLINE ONLINE racnode3
ora....SM1.asm application 0/5 0/0 ONLINE ONLINE racnode1
ora....E1.lsnr application 0/5 0/0 ONLINE ONLINE racnode1
ora....de1.gsd application 0/5 0/0 ONLINE ONLINE racnode1
ora....de1.ons application 0/3 0/0 ONLINE ONLINE racnode1
ora....de1.vip application 0/0 0/0 ONLINE ONLINE racnode1
ora....SM2.asm application 0/5 0/0 ONLINE ONLINE racnode2
ora....E2.lsnr application 0/5 0/0 ONLINE ONLINE racnode2
ora....de2.gsd application 0/5 0/0 ONLINE ONLINE racnode2
ora....de2.ons application 0/3 0/0 ONLINE ONLINE racnode2
ora....de2.vip application 0/0 0/0 ONLINE ONLINE racnode2
ora....SM3.asm application 0/5 0/0 ONLINE ONLINE racnode3
ora....E3.lsnr application 0/5 0/0 ONLINE ONLINE racnode3
ora....de3.gsd application 0/5 0/0 ONLINE ONLINE racnode3
ora....de3.ons application 0/3 0/0 ONLINE ONLINE racnode3
ora....de3.vip application 0/0 0/0 ONLINE ONLINE racnode3
[oracle@racnode2 ~]$ sqlplus system@racdb1
SQL*Plus: Release 10.2.0.5.0 - Production on Mon Dec 24 16:39:26 2012
Copyright (c) 1982, 2010, Oracle. All Rights Reserved.
Enter password:
Connected to:
Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
SQL> show parameter local_lis
NAME TYPE VALUE
------------------------------------ ----------- ------------------------------
local_listener string (ADDRESS = (PROTOCOL = TCP)(HO
ST = 192.168.1.151)(PORT = 152
1))
SQL> exit
Disconnected from Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
[oracle@racnode2 ~]$ sqlplus system@racdb2
SQL*Plus: Release 10.2.0.5.0 - Production on Mon Dec 24 16:39:38 2012
Copyright (c) 1982, 2010, Oracle. All Rights Reserved.
Enter password:
Connected to:
Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
SQL> show parameter local_lis
NAME TYPE VALUE
------------------------------------ ----------- ------------------------------
local_listener string (ADDRESS = (PROTOCOL = TCP)(HO
ST = 192.168.1.152)(PORT = 152
1))
SQL> exit
Disconnected from Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
[oracle@racnode2 ~]$ sqlplus system@racdb3
SQL*Plus: Release 10.2.0.5.0 - Production on Mon Dec 24 16:39:47 2012
Copyright (c) 1982, 2010, Oracle. All Rights Reserved.
Enter password:
Connected to:
Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
SQL> show parameter local_lis
NAME TYPE VALUE
------------------------------------ ----------- ------------------------------
local_listener string
SQL> alter system set local_listener ='(ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.1.153)(PORT = 1521))' sid='racdb3';
System altered.
SQL> show parameter local_lis
NAME TYPE VALUE
------------------------------------ ----------- ------------------------------
local_listener string (ADDRESS = (PROTOCOL = TCP)(HO
ST = 192.168.1.153)(PORT = 152
1))
SQL>
[oracle@racnode3 ~]$ lsnrctl status
LSNRCTL for Linux: Version 10.2.0.5.0 - Production on 24-DEC-2012 16:42:41
Copyright (c) 1991, 2010, Oracle. All rights reserved.
Connecting to (ADDRESS=(PROTOCOL=tcp)(HOST=)(PORT=1521))
STATUS of the LISTENER
------------------------
Alias LISTENER_RACNODE3
Version TNSLSNR for Linux: Version 10.2.0.5.0 - Production
Start Date 24-DEC-2012 16:33:03
Uptime 0 days 0 hr. 9 min. 37 sec
Trace Level off
Security ON: Local OS Authentication
SNMP OFF
Listener Parameter File /u01/app/oracle/product/10.2.0/db_1/network/admin/listener.ora
Listener Log File /u01/app/oracle/product/10.2.0/db_1/network/log/listener_racnode3.log
Listening Endpoints Summary...
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.1.153)(PORT=1521)))
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.1.53)(PORT=1521)))
(DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=EXTPROC)))
Services Summary...
Service "+ASM" has 1 instance(s).
Instance "+ASM3", status BLOCKED, has 1 handler(s) for this service...
Service "+ASM_XPT" has 1 instance(s).
Instance "+ASM3", status BLOCKED, has 1 handler(s) for this service...
Service "racdb" has 3 instance(s).
Instance "racdb1", status READY, has 1 handler(s) for this service...
Instance "racdb2", status READY, has 1 handler(s) for this service...
Instance "racdb3", status READY, has 2 handler(s) for this service...
Service "racdbXDB" has 3 instance(s).
Instance "racdb1", status READY, has 1 handler(s) for this service...
Instance "racdb2", status READY, has 1 handler(s) for this service...
Instance "racdb3", status READY, has 1 handler(s) for this service...
Service "racdb_XPT" has 3 instance(s).
Instance "racdb1", status READY, has 1 handler(s) for this service...
Instance "racdb2", status READY, has 1 handler(s) for this service...
Instance "racdb3", status READY, has 2 handler(s) for this service...
The command completed successfully
[oracle@racnode3 ~]$ lsnrctl service
LSNRCTL for Linux: Version 10.2.0.5.0 - Production on 24-DEC-2012 16:43:07
Copyright (c) 1991, 2010, Oracle. All rights reserved.
Connecting to (ADDRESS=(PROTOCOL=tcp)(HOST=)(PORT=1521))
Services Summary...
Service "+ASM" has 1 instance(s).
Instance "+ASM3", status BLOCKED, has 1 handler(s) for this service...
Handler(s):
"DEDICATED" established:0 refused:0 state:ready
LOCAL SERVER
Service "+ASM_XPT" has 1 instance(s).
Instance "+ASM3", status BLOCKED, has 1 handler(s) for this service...
Handler(s):
"DEDICATED" established:0 refused:0 state:ready
LOCAL SERVER
Service "racdb" has 3 instance(s).
Instance "racdb1", status READY, has 1 handler(s) for this service...
Handler(s):
"DEDICATED" established:0 refused:0 state:ready
REMOTE SERVER
(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.1.151)(PORT=1521))
Instance "racdb2", status READY, has 1 handler(s) for this service...
Handler(s):
"DEDICATED" established:0 refused:0 state:ready
REMOTE SERVER
(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.1.152)(PORT=1521))
Instance "racdb3", status READY, has 2 handler(s) for this service...
Handler(s):
"DEDICATED" established:0 refused:0 state:ready
REMOTE SERVER
(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.1.153)(PORT=1521))
"DEDICATED" established:1 refused:0 state:ready
LOCAL SERVER
Service "racdbXDB" has 3 instance(s).
Instance "racdb1", status READY, has 1 handler(s) for this service...
Handler(s):
"D000" established:0 refused:0 current:0 max:1022 state:ready
DISPATCHER <machine: racnode1, pid: 13625>
(ADDRESS=(PROTOCOL=tcp)(HOST=racnode1)(PORT=30569))
Instance "racdb2", status READY, has 1 handler(s) for this service...
Handler(s):
"D000" established:0 refused:0 current:0 max:1022 state:ready
DISPATCHER <machine: racnode2, pid: 6359>
(ADDRESS=(PROTOCOL=tcp)(HOST=racnode2)(PORT=57869))
Instance "racdb3", status READY, has 1 handler(s) for this service...
Handler(s):
"D000" established:0 refused:0 current:0 max:1022 state:ready
DISPATCHER <machine: racnode3, pid: 1929>
(ADDRESS=(PROTOCOL=tcp)(HOST=racnode3)(PORT=59281))
Service "racdb_XPT" has 3 instance(s).
Instance "racdb1", status READY, has 1 handler(s) for this service...
Handler(s):
"DEDICATED" established:0 refused:0 state:ready
REMOTE SERVER
(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.1.151)(PORT=1521))
Instance "racdb2", status READY, has 1 handler(s) for this service...
Handler(s):
"DEDICATED" established:0 refused:0 state:ready
REMOTE SERVER
(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.1.152)(PORT=1521))
Instance "racdb3", status READY, has 2 handler(s) for this service...
Handler(s):
"DEDICATED" established:0 refused:0 state:ready
REMOTE SERVER
(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.1.153)(PORT=1521))
"DEDICATED" established:1 refused:0 state:ready
LOCAL SERVER
The command completed successfully
[oracle@racnode3 ~]$ crsctl query crs activeversion
CRS active version on the cluster is [10.2.0.5.0]
[oracle@racnode3 ~]$ ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 2
Total space (kbytes) : 1469612
Used space (kbytes) : 5384
Available space (kbytes) : 1464228
ID : 621085552
Device/File Name : /dev/raw/raw1
Device/File integrity check succeeded
Device/File Name : /dev/raw/raw2
Device/File integrity check succeeded
Cluster registry integrity check succeeded
[oracle@racnode3 ~]$ crsctl query css votedisk
0. 0 /dev/raw/raw3
1. 0 /dev/raw/raw4
2. 0 /dev/raw/raw5
located 3 votedisk(s).
C:\>sqlplus system@rac3
SQL*Plus: Release 10.2.0.1.0 - Production on 星期一 12月 24 16:44:50 2012
Copyright (c) 1982, 2005, Oracle. All rights reserved.
输入口令:
连接到:
Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
SQL> show parameter instance_name
NAME TYPE VALUE
------------------------------------ ----------- ------------------------------
instance_name string racdb3
SQL> set linesize 400
SQL> col host_name format a11
SQL> select INSTANCE_NAME,HOST_NAME,VERSION,STARTUP_TIME,STATUS,ACTIVE_STATE,INSTANCE_ROLE,DATABASE_STATUS from gv$INSTANCE;
INSTANCE_NAME HOST_NAME VERSION STARTUP_TIME STATUS ACTIVE_ST INSTANCE_ROLE DATABASE_STATUS
---------------- ----------- ----------------- -------------- ------------ --------- ------------------ ----------------
racdb3 racnode3 10.2.0.5.0 24-12月-12 OPEN NORMAL PRIMARY_INSTANCE ACTIVE
racdb2 racnode2 10.2.0.5.0 20-12月-12 OPEN NORMAL PRIMARY_INSTANCE ACTIVE
racdb1 racnode1 10.2.0.5.0 20-12月-12 OPEN NORMAL PRIMARY_INSTANCE ACTIVE
OS版本是Oracle Linux 5.7 x86_64
保证RAC正常运行
配置public IP,private IP,VIP,将这些信息配置到/etc/hosts文件中
192.168.1.51 racnode1
192.168.1.151 racnode1-vip
172.168.1.51 racnode1-priv
192.168.1.52 racnode2
192.168.1.152 racnode2-vip
172.168.1.52 racnode2-priv
192.168.1.53 racnode3
192.168.1.153 racnode3-vip
172.168.1.53 racnode3-priv
安装相关的rpm包,配置系统内核参数,我这里使用的是Oracle Linux5提供的的oracle-validated包进行安装配置
[root@racnode3 ~]# yum -y install oracle-validated
Loaded plugins: rhnplugin, security
This system is not registered with ULN.
ULN support will be disabled.
Setting up Install Process
Package oracle-validated-1.1.0-15.el5.x86_64 already installed and latest version
同步各节点的时间,我这里使用的是NTP
4000
服务
[root@racnode3 ~]# crontab -l
*/5 * * * * /usr/sbin/ntpdate 0.asia.pool.ntp.org > /dev/null 2>&1
配置共享磁盘
[root@racnode3 ~]# cat /etc/udev/rules.d/60-raw.rules
# Enter raw device bindings here.
#
# An example would be:
# ACTION=="add", KERNEL=="sda", RUN+="/bin/raw /dev/raw/raw1 %N"
# to bind /dev/raw/raw1 to /dev/sda, or
# ACTION=="add", ENV{MAJOR}=="8", ENV{MINOR}=="1", RUN+="/bin/raw /dev/raw/raw2 %M %m"
# to bind /dev/raw/raw2 to the device with major 8, minor 1.
ACTION=="add", KERNEL=="sdb1", RUN+="/bin/raw /dev/raw/raw1 %N"
ACTION=="add", KERNEL=="sdb2", RUN+="/bin/raw /dev/raw/raw2 %N"
ACTION=="add", KERNEL=="sdc1", RUN+="/bin/raw /dev/raw/raw3 %N"
ACTION=="add", KERNEL=="sdc2", RUN+="/bin/raw /dev/raw/raw4 %N"
ACTION=="add", KERNEL=="sdc3", RUN+="/bin/raw /dev/raw/raw5 %N"
ACTION=="add", KERNEL=="raw*", OWNER=="oracle", GROUP=="oinstall", MODE=="0660"
[root@racnode3 ~]# cat /etc/udev/rules.d/99-oracle-asmdevices.rules
KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -s %p", RESULT=="SATA_VBOX_HARDDISK_VB5407c582-c0bbcc9c_", NAME="asm-diskd", OWNER="oracle", GROUP="oinstall", MODE="0660"
KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -s %p", RESULT=="SATA_VBOX_HARDDISK_VB2048e338-447949c0_", NAME="asm-diske", OWNER="oracle", GROUP="oinstall", MODE="0660"
KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -s %p", RESULT=="SATA_VBOX_HARDDISK_VB6d6f72b0-997f769f_", NAME="asm-diskf", OWNER="oracle", GROUP="oinstall", MODE="0660"
KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -s %p", RESULT=="SATA_VBOX_HARDDISK_VB867b3aae-2e3a3f0b_", NAME="asm-diskg", OWNER="oracle", GROUP="oinstall", MODE="0660"
KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id -g -u -s %p", RESULT=="SATA_VBOX_HARDDISK_VB4dcf4abf-0266b2fc_", NAME="asm-diskh", OWNER="oracle", GROUP="oinstall", MODE="0660"
[root@racnode3 ~]#
[root@racnode3 ~]# start_udev
Starting udev: [ OK ]
[root@racnode3 ~]# ls -l /dev/raw/raw*
crw-rw---- 1 oracle oinstall 162, 1 Dec 24 14:31 /dev/raw/raw1
crw-rw---- 1 oracle oinstall 162, 2 Dec 24 14:31 /dev/raw/raw2
crw-rw---- 1 oracle oinstall 162, 3 Dec 24 14:31 /dev/raw/raw3
crw-rw---- 1 oracle oinstall 162, 4 Dec 24 14:31 /dev/raw/raw4
crw-rw---- 1 oracle oinstall 162, 5 Dec 24 14:31 /dev/raw/raw5
[root@racnode3 ~]# ls -l /dev/asm-disk*
brw-rw---- 1 oracle oinstall 8, 48 Dec 24 14:31 /dev/asm-diskd
brw-rw---- 1 oracle oinstall 8, 64 Dec 24 14:31 /dev/asm-diske
brw-rw---- 1 oracle oinstall 8, 80 Dec 24 14:31 /dev/asm-diskf
brw-rw---- 1 oracle oinstall 8, 96 Dec 24 14:31 /dev/asm-diskg
brw-rw---- 1 oracle oinstall 8, 112 Dec 24 14:31 /dev/asm-diskh
配置ssh用户等效性
[oracle@racnode1 ~]$ ssh racnode1 date;ssh racnode2 date;ssh racnode3 date
Mon Dec 24 14:37:08 CST 2012
Mon Dec 24 14:37:08 CST 2012
Mon Dec 24 14:37:08 CST 2012
[oracle@racnode1 ~]$ ssh racnode1-priv date;ssh racnode2-priv date;ssh racnode3-priv date
Mon Dec 24 14:37:15 CST 2012
Mon Dec 24 14:37:16 CST 2012
Mon Dec 24 14:37:16 CST 2012
[oracle@racnode2 ~]$ ssh racnode1 date;ssh racnode2 date;ssh racnode3 date
Mon Dec 24 14:38:22 CST 2012
Mon Dec 24 14:38:22 CST 2012
Mon Dec 24 14:38:22 CST 2012
[oracle@racnode2 ~]$ ssh racnode1-priv date;ssh racnode2-priv date;ssh racnode3-priv date
Mon Dec 24 14:38:27 CST 2012
Mon Dec 24 14:38:27 CST 2012
Mon Dec 24 14:38:27 CST 2012
[oracle@racnode3 ~]$ ssh racnode1 date;ssh racnode2 date;ssh racnode3 date
Mon Dec 24 14:40:39 CST 2012
Mon Dec 24 14:40:39 CST 2012
Mon Dec 24 14:40:39 CST 2012
[oracle@racnode3 ~]$ ssh racnode1-priv date;ssh racnode2-priv date;ssh racnode3-priv date
Mon Dec 24 14:40:54 CST 2012
Mon Dec 24 14:40:54 CST 2012
Mon Dec 24 14:40:54 CST 2012
配置racnode3 oracle用户的环境变量
alias ls="ls -FA"
export JAVA_HOME=/usr/local/java
# User specific environment and startup programs
export ORACLE_BASE=/u01/app/oracle
export ORACLE_HOME=$ORACLE_BASE/product/10.2.0/db_1
export ORA_CRS_HOME=$ORACLE_BASE/product/10.2.0/crs
export ORACLE_PATH=$ORACLE_BASE/common/oracle/sql:.:$ORACLE_HOME/rdbms/admin
export CV_JDKHOME=/usr/local/java
export ORACLE_SID=racdb3
export PATH=.:${JAVA_HOME}/bin:${PATH}:$HOME/bin:$ORACLE_HOME/bin:$ORA_CRS_HOME/bin
export PATH=${PATH}:/usr/bin:/bin:/usr/bin/X11:/usr/local/bin
export PATH=${PATH}:$ORACLE_BASE/common/oracle/bin
export ORACLE_TERM=xterm
export TNS_ADMIN=$ORACLE_HOME/network/admin
export ORA_NLS10=$ORACLE_HOME/nls/data
export NLS_DATE_FORMAT="DD-MON-YYYY HH24:MI:SS"
export DISPLAY=192.168.2.224:0.0
export NLS_LANG=AMERICAN_AMERICA.ZHS16GBK
export LD_LIBRARY_PATH=$ORACLE_HOME/lib
export LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:$ORACLE_HOME/oracm/lib
export LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:/lib:/usr/lib:/usr/local/lib
export CLASSPATH=$ORACLE_HOME/JRE
export CLASSPATH=${CLASSPATH}:$ORACLE_HOME/jlib
export CLASSPATH=${CLASSPATH}:$ORACLE_HOME/rdbms/jlib
export CLASSPATH=${CLASSPATH}:$ORACLE_HOME/network/jlib
export THREADS_FLAG=native
export TEMP=/tmp
export TMPDIR=/tmp
alias ls="ls -FA"
alias sqlplus="rlwrap sqlplus"
alias rman="rlwrap rman"
alias ggsci="rlwrap ggsci"
alias logdump="rlwrap logdump"
alias asmcmd="rlwrap asmcmd"
alias base="cd $ORACLE_BASE"
alias home="cd $ORACLE_HOME"
添加RAC Clusterware节点
在racnode1使用oracle用户执行$ORA_CRS_HOME/oui/bin/addNode.sh
[oracle@racnode1 ~]$ cd /u01/app/oracle/product/10.2.0/crs/oui/bin/
[oracle@racnode1 bin]$ ./addNode.sh
Starting Oracle Universal Installer...
No pre-requisite checks found in oraparam.ini, no system pre-requisite checks will be executed.
Oracle Universal Installer, Version 10.2.0.5.0 Production
Copyright (C) 1999, 2010, Oracle. All rights reserved.
用root用户在racnode3上运行
/u01/app/oracle/oraInventory/orainstRoot.sh
[root@racnode3 ~]# /u01/app/oracle/oraInventory/orainstRoot.sh
Changing permissions of /u01/app/oracle/oraInventory to 770.
Changing groupname of /u01/app/oracle/oraInventory to oinstall.
The execution of the script is complete
用root用户在racnode1上运行
/u01/app/oracle/product/10.2.0/crs/install/rootaddnode.sh
[root@racnode1 ~]# /u01/app/oracle/product/10.2.0/crs/install/rootaddnode.sh
clscfg: EXISTING configuration version 3 detected.
clscfg: version 3 is 10G Release 2.
Attempting to add 1 new nodes to the configuration
Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
node <nodenumber>: <nodename> <private interconnect name> <hostname>
node 3: racnode3 racnode3-priv racnode3
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
/u01/app/oracle/product/10.2.0/crs/bin/srvctl add nodeapps -n racnode3 -A racnode3-vip/255.255.0.0/eth0 -o /u01/app/oracle/product/10.2.0/crs
用root用户在racnode3运行
/u01/app/oracle/product/10.2.0/crs/root.sh
[root@racnode3 ~]# /u01/app/oracle/oraInventory/orainstRoot.sh
Changing permissions of /u01/app/oracle/oraInventory to 770.
Changing groupname of /u01/app/oracle/oraInventory to oinstall.
The execution of the script is complete
[root@racnode3 ~]# /u01/app/oracle/product/10.2.0/crs/root.sh
WARNING: directory '/u01/app/oracle/product/10.2.0' is not owned by root
WARNING: directory '/u01/app/oracle/product' is not owned by root
WARNING: directory '/u01/app/oracle' is not owned by root
WARNING: directory '/u01/app' is not owned by root
No value set for the CRS parameter CRS_OCR_LOCATIONS. Using Values in paramfile.crs
Checking to see if Oracle CRS stack is already configured
/etc/oracle does not exist. Creating it now.
OCR LOCATIONS = /dev/raw/raw1,/dev/raw/raw2
OCR backup directory '/u01/app/oracle/product/10.2.0/crs/cdata/crs' does not exist. Creating now
Setting the permissions on OCR backup directory
Setting up NS directories
Oracle Cluster Registry configuration upgraded successfully
WARNING: directory '/u01/app/oracle/product/10.2.0' is not owned by root
WARNING: directory '/u01/app/oracle/product' is not owned by root
WARNING: directory '/u01/app/oracle' is not owned by root
WARNING: directory '/u01/app' is not owned by root
clscfg: EXISTING configuration version 3 detected.
clscfg: version 3 is 10G Release 2.
Successfully accumulated necessary OCR keys.
Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
node <nodenumber>: <nodename> <private interconnect name> <hostname>
node 1: racnode1 racnode1-priv racnode1
node 2: racnode2 racnode2-priv racnode2
clscfg: Arguments check out successfully.
NO KEYS WERE WRITTEN. Supply -force parameter to override.
-force is destructive and will destroy any previous cluster
configuration.
Oracle Cluster Registry for cluster has already been initialized
Startup will be queued to init within 30 seconds.
Adding daemons to inittab
Expecting the CRS daemons to be up within 600 seconds.
CSS is active on these nodes.
racnode1
racnode2
racnode3
CSS is active on all nodes.
Waiting for the Oracle CRSD and EVMD to start
Waiting for the Oracle CRSD and EVMD to start
Oracle CRS stack installed and running under init(1M)
脚本全部执行后Exit退出
在racnode3上安装Oracle Database software
在racnode1上使用oracle用户执行$ORACLE_HOME/oui/bin/addNode.sh
[oracle@racnode1 bin]$ cd /u01/app/oracle/product/10.2.0/db_1/oui/bin/
[oracle@racnode1 bin]$ ./addNode.sh
Starting Oracle Universal Installer...
No pre-requisite checks found in oraparam.ini, no system pre-requisite checks will be executed.
Oracle Universal Installer, Version 10.2.0.5.0 Production
Copyright (C) 1999, 2010, Oracle. All rights reserved.
用root用户在racnode3上执行
/u01/app/oracle/product/10.2.0/db_1/root.sh
[root@racnode3 ~]# /u01/app/oracle/product/10.2.0/db_1/root.sh
Running Oracle 10g root.sh script...
The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /u01/app/oracle/product/10.2.0/db_1
Enter the full pathname of the local bin directory: [/usr/local/bin]:
Copying dbhome to /usr/local/bin ...
Copying oraenv to /usr/local/bin ...
Copying coraenv to /usr/local/bin ...
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root.sh script.
Now product-specific root actions will be performed.
执行之后Exit退出
配置监听
[oracle@racnode3 admin]$ cat listener.ora
# listener.ora.racnode2 Network Configuration File: /u01/app/oracle/product/10.2.0/db_1/network/admin/listener.ora.racnode2
# Generated by Oracle configuration tools.
LISTENER_RACNODE3 =
(DESCRIPTION_LIST =
(DESCRIPTION =
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = TCP)(HOST = racnode3-vip)(PORT = 1521)(IP = FIRST))
)
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.1.53)(PORT = 1521)(IP = FIRST))
)
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC))
)
)
)
[oracle@racnode3 admin]$ cat tnsnames.ora
# tnsnames.ora Network Configuration File: /u01/app/oracle/product/10.2.0/db_1/network/admin/tnsnames.ora
# Generated by Oracle configuration tools.
RACDB1 =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = racnode1-vip)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = racdb)
(INSTANCE_NAME = racdb1)
)
)
RACDB =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = racnode1-vip)(PORT = 1521))
(ADDRESS = (PROTOCOL = TCP)(HOST = racnode2-vip)(PORT = 1521))
(ADDRESS = (PROTOCOL = TCP)(HOST = racnode3-vip)(PORT = 1521))
(LOAD_BALANCE = yes)
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = racdb)
)
)
LISTENERS_RACDB =
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = TCP)(HOST = racnode1-vip)(PORT = 1521))
(ADDRESS = (PROTOCOL = TCP)(HOST = racnode2-vip)(PORT = 1521))
(ADDRESS = (PROTOCOL = TCP)(HOST = racnode3-vip)(PORT = 1521))
)
RACDB2 =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = racnode2-vip)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = racdb)
(INSTANCE_NAME = racdb2)
)
)
RACDB3 =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = racnode3-vip)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = racdb)
(INSTANCE_NAME = racdb3)
)
)
在racnode1上使用DBCA添加racnode3的instance
点击No
验证
SQL> select INSTANCE_NAME,HOST_NAME,VERSION,STARTUP_TIME,STATUS,ACTIVE_STATE,INSTANCE_ROLE,DATABASE_STATUS from gv$INSTANCE;
INSTANCE_NAME HOST_NAME VERSION STARTUP_TIME STATUS ACTIVE_ST INSTANCE_ROLE DATABASE_STATUS
---------------- ----------- ----------------- ----------------------- ------------ --------- ------------------ -----------------
racdb2 racnode2 10.2.0.5.0 20-DEC-2012 16:07:46 OPEN NORMAL PRIMARY_INSTANCE ACTIVE
racdb1 racnode1 10.2.0.5.0 20-DEC-2012 16:07:46 OPEN NORMAL PRIMARY_INSTANCE ACTIVE
racdb3 racnode3 10.2.0.5.0 24-DEC-2012 16:32:35 OPEN NORMAL PRIMARY_INSTANCE ACTIVE
SQL> exit
Disconnected from Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
[oracle@racnode2 ~]$ crs_stat -t -v
Name Type R/RA F/FT Target State Host
----------------------------------------------------------------------
ora.racdb.db application 0/0 0/1 ONLINE ONLINE racnode1
ora....b1.inst application 0/5 0/0 ONLINE ONLINE racnode1
ora....b2.inst application 0/5 0/0 ONLINE ONLINE racnode2
ora....b3.inst application 0/5 0/0 ONLINE ONLINE racnode3
ora....SM1.asm application 0/5 0/0 ONLINE ONLINE racnode1
ora....E1.lsnr application 0/5 0/0 ONLINE ONLINE racnode1
ora....de1.gsd application 0/5 0/0 ONLINE ONLINE racnode1
ora....de1.ons application 0/3 0/0 ONLINE ONLINE racnode1
ora....de1.vip application 0/0 0/0 ONLINE ONLINE racnode1
ora....SM2.asm application 0/5 0/0 ONLINE ONLINE racnode2
ora....E2.lsnr application 0/5 0/0 ONLINE ONLINE racnode2
ora....de2.gsd application 0/5 0/0 ONLINE ONLINE racnode2
ora....de2.ons application 0/3 0/0 ONLINE ONLINE racnode2
ora....de2.vip application 0/0 0/0 ONLINE ONLINE racnode2
ora....SM3.asm application 0/5 0/0 ONLINE ONLINE racnode3
ora....E3.lsnr application 0/5 0/0 ONLINE ONLINE racnode3
ora....de3.gsd application 0/5 0/0 ONLINE ONLINE racnode3
ora....de3.ons application 0/3 0/0 ONLINE ONLINE racnode3
ora....de3.vip application 0/0 0/0 ONLINE ONLINE racnode3
[oracle@racnode2 ~]$ sqlplus system@racdb1
SQL*Plus: Release 10.2.0.5.0 - Production on Mon Dec 24 16:39:26 2012
Copyright (c) 1982, 2010, Oracle. All Rights Reserved.
Enter password:
Connected to:
Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
SQL> show parameter local_lis
NAME TYPE VALUE
------------------------------------ ----------- ------------------------------
local_listener string (ADDRESS = (PROTOCOL = TCP)(HO
ST = 192.168.1.151)(PORT = 152
1))
SQL> exit
Disconnected from Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
[oracle@racnode2 ~]$ sqlplus system@racdb2
SQL*Plus: Release 10.2.0.5.0 - Production on Mon Dec 24 16:39:38 2012
Copyright (c) 1982, 2010, Oracle. All Rights Reserved.
Enter password:
Connected to:
Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
SQL> show parameter local_lis
NAME TYPE VALUE
------------------------------------ ----------- ------------------------------
local_listener string (ADDRESS = (PROTOCOL = TCP)(HO
ST = 192.168.1.152)(PORT = 152
1))
SQL> exit
Disconnected from Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
[oracle@racnode2 ~]$ sqlplus system@racdb3
SQL*Plus: Release 10.2.0.5.0 - Production on Mon Dec 24 16:39:47 2012
Copyright (c) 1982, 2010, Oracle. All Rights Reserved.
Enter password:
Connected to:
Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
SQL> show parameter local_lis
NAME TYPE VALUE
------------------------------------ ----------- ------------------------------
local_listener string
SQL> alter system set local_listener ='(ADDRESS = (PROTOCOL = TCP)(HOST = 192.168.1.153)(PORT = 1521))' sid='racdb3';
System altered.
SQL> show parameter local_lis
NAME TYPE VALUE
------------------------------------ ----------- ------------------------------
local_listener string (ADDRESS = (PROTOCOL = TCP)(HO
ST = 192.168.1.153)(PORT = 152
1))
SQL>
[oracle@racnode3 ~]$ lsnrctl status
LSNRCTL for Linux: Version 10.2.0.5.0 - Production on 24-DEC-2012 16:42:41
Copyright (c) 1991, 2010, Oracle. All rights reserved.
Connecting to (ADDRESS=(PROTOCOL=tcp)(HOST=)(PORT=1521))
STATUS of the LISTENER
------------------------
Alias LISTENER_RACNODE3
Version TNSLSNR for Linux: Version 10.2.0.5.0 - Production
Start Date 24-DEC-2012 16:33:03
Uptime 0 days 0 hr. 9 min. 37 sec
Trace Level off
Security ON: Local OS Authentication
SNMP OFF
Listener Parameter File /u01/app/oracle/product/10.2.0/db_1/network/admin/listener.ora
Listener Log File /u01/app/oracle/product/10.2.0/db_1/network/log/listener_racnode3.log
Listening Endpoints Summary...
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.1.153)(PORT=1521)))
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.1.53)(PORT=1521)))
(DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=EXTPROC)))
Services Summary...
Service "+ASM" has 1 instance(s).
Instance "+ASM3", status BLOCKED, has 1 handler(s) for this service...
Service "+ASM_XPT" has 1 instance(s).
Instance "+ASM3", status BLOCKED, has 1 handler(s) for this service...
Service "racdb" has 3 instance(s).
Instance "racdb1", status READY, has 1 handler(s) for this service...
Instance "racdb2", status READY, has 1 handler(s) for this service...
Instance "racdb3", status READY, has 2 handler(s) for this service...
Service "racdbXDB" has 3 instance(s).
Instance "racdb1", status READY, has 1 handler(s) for this service...
Instance "racdb2", status READY, has 1 handler(s) for this service...
Instance "racdb3", status READY, has 1 handler(s) for this service...
Service "racdb_XPT" has 3 instance(s).
Instance "racdb1", status READY, has 1 handler(s) for this service...
Instance "racdb2", status READY, has 1 handler(s) for this service...
Instance "racdb3", status READY, has 2 handler(s) for this service...
The command completed successfully
[oracle@racnode3 ~]$ lsnrctl service
LSNRCTL for Linux: Version 10.2.0.5.0 - Production on 24-DEC-2012 16:43:07
Copyright (c) 1991, 2010, Oracle. All rights reserved.
Connecting to (ADDRESS=(PROTOCOL=tcp)(HOST=)(PORT=1521))
Services Summary...
Service "+ASM" has 1 instance(s).
Instance "+ASM3", status BLOCKED, has 1 handler(s) for this service...
Handler(s):
"DEDICATED" established:0 refused:0 state:ready
LOCAL SERVER
Service "+ASM_XPT" has 1 instance(s).
Instance "+ASM3", status BLOCKED, has 1 handler(s) for this service...
Handler(s):
"DEDICATED" established:0 refused:0 state:ready
LOCAL SERVER
Service "racdb" has 3 instance(s).
Instance "racdb1", status READY, has 1 handler(s) for this service...
Handler(s):
"DEDICATED" established:0 refused:0 state:ready
REMOTE SERVER
(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.1.151)(PORT=1521))
Instance "racdb2", status READY, has 1 handler(s) for this service...
Handler(s):
"DEDICATED" established:0 refused:0 state:ready
REMOTE SERVER
(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.1.152)(PORT=1521))
Instance "racdb3", status READY, has 2 handler(s) for this service...
Handler(s):
"DEDICATED" established:0 refused:0 state:ready
REMOTE SERVER
(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.1.153)(PORT=1521))
"DEDICATED" established:1 refused:0 state:ready
LOCAL SERVER
Service "racdbXDB" has 3 instance(s).
Instance "racdb1", status READY, has 1 handler(s) for this service...
Handler(s):
"D000" established:0 refused:0 current:0 max:1022 state:ready
DISPATCHER <machine: racnode1, pid: 13625>
(ADDRESS=(PROTOCOL=tcp)(HOST=racnode1)(PORT=30569))
Instance "racdb2", status READY, has 1 handler(s) for this service...
Handler(s):
"D000" established:0 refused:0 current:0 max:1022 state:ready
DISPATCHER <machine: racnode2, pid: 6359>
(ADDRESS=(PROTOCOL=tcp)(HOST=racnode2)(PORT=57869))
Instance "racdb3", status READY, has 1 handler(s) for this service...
Handler(s):
"D000" established:0 refused:0 current:0 max:1022 state:ready
DISPATCHER <machine: racnode3, pid: 1929>
(ADDRESS=(PROTOCOL=tcp)(HOST=racnode3)(PORT=59281))
Service "racdb_XPT" has 3 instance(s).
Instance "racdb1", status READY, has 1 handler(s) for this service...
Handler(s):
"DEDICATED" established:0 refused:0 state:ready
REMOTE SERVER
(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.1.151)(PORT=1521))
Instance "racdb2", status READY, has 1 handler(s) for this service...
Handler(s):
"DEDICATED" established:0 refused:0 state:ready
REMOTE SERVER
(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.1.152)(PORT=1521))
Instance "racdb3", status READY, has 2 handler(s) for this service...
Handler(s):
"DEDICATED" established:0 refused:0 state:ready
REMOTE SERVER
(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.1.153)(PORT=1521))
"DEDICATED" established:1 refused:0 state:ready
LOCAL SERVER
The command completed successfully
[oracle@racnode3 ~]$ crsctl query crs activeversion
CRS active version on the cluster is [10.2.0.5.0]
[oracle@racnode3 ~]$ ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 2
Total space (kbytes) : 1469612
Used space (kbytes) : 5384
Available space (kbytes) : 1464228
ID : 621085552
Device/File Name : /dev/raw/raw1
Device/File integrity check succeeded
Device/File Name : /dev/raw/raw2
Device/File integrity check succeeded
Cluster registry integrity check succeeded
[oracle@racnode3 ~]$ crsctl query css votedisk
0. 0 /dev/raw/raw3
1. 0 /dev/raw/raw4
2. 0 /dev/raw/raw5
located 3 votedisk(s).
C:\>sqlplus system@rac3
SQL*Plus: Release 10.2.0.1.0 - Production on 星期一 12月 24 16:44:50 2012
Copyright (c) 1982, 2005, Oracle. All rights reserved.
输入口令:
连接到:
Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
SQL> show parameter instance_name
NAME TYPE VALUE
------------------------------------ ----------- ------------------------------
instance_name string racdb3
SQL> set linesize 400
SQL> col host_name format a11
SQL> select INSTANCE_NAME,HOST_NAME,VERSION,STARTUP_TIME,STATUS,ACTIVE_STATE,INSTANCE_ROLE,DATABASE_STATUS from gv$INSTANCE;
INSTANCE_NAME HOST_NAME VERSION STARTUP_TIME STATUS ACTIVE_ST INSTANCE_ROLE DATABASE_STATUS
---------------- ----------- ----------------- -------------- ------------ --------- ------------------ ----------------
racdb3 racnode3 10.2.0.5.0 24-12月-12 OPEN NORMAL PRIMARY_INSTANCE ACTIVE
racdb2 racnode2 10.2.0.5.0 20-12月-12 OPEN NORMAL PRIMARY_INSTANCE ACTIVE
racdb1 racnode1 10.2.0.5.0 20-12月-12 OPEN NORMAL PRIMARY_INSTANCE ACTIVE
内容来自用户分享和网络整理，不保证内容的准确性，如有侵权内容，可联系管理员处理 
相关文章推荐
- RedHat 5.6_x86_64 + ASM + RAW+ Oracle 10g RAC （十一） 添加节点—创建实例
- (超详细)Oracle 10g RAC 添加节点实验操作总结
- Redhat 5.4 Oracle 10g RAC 添加节点
- RedHat 5.6_x86_64 + ASM + RAW+ Oracle 10g RAC （九） 添加节点—安装数据库软件
- RedHat 5.6_x86_64 + ASM + RAW+ Oracle 10g RAC （八） 添加节点—安装clusterware
- Redhat 5.4 Oracle 10g RAC 添加节点
- oracle 10g RAC添加节点遭遇ORA-02174错误解决
- Redhat 5.4 Oracle 10g RAC 添加节点
- Oracle 10g RAC 无法添加节点 Unable to access cluster service while creating node, could not add node rac1
- Oracle 10g RAC 添加节点
- RedHat 5.6_x86_64 + ASM + RAW+ Oracle 10g RAC （十） 添加节点—创建监听
- Redhat 5.4 Oracle 10g RAC 添加节点
- RedHat 5.6_x86_64 + ASM + RAW+ Oracle 10g RAC （七） 添加节点—初始化环境
- Redhat 5.4 Oracle 10g RAC 添加节点
- Oracle10203 RAC环境添加新节点（一）
- Oracle 10G RAC - 某个节点上缺失某些归档日志后删除报错问题
- Oracle 10203 RAC环境添加新节点（三）
- 节点地址ORACLE 10g RAC监听报TNS-12545 TNS_12560 TNS-00515
- 一步一步在virtual box4.1.6中安装基于rhel5.5x86_64的oracle 10g R2双节点RAC
- Oracle 添加RAC数据库集群节点(二)