1.1 删除 DB 实例
[oracle@rac1 ~]$ srvctl remove instance -db orcl -instance orcl2
1.2 从集群中删除节点
$ORACLE_HOME/oui/bin 在保留节点上运行以下命令以更新该节点上的清单：
[oracle@rac1 bin]$ /oracle/app/product/193000/db_1/oui/bin/./runInstaller -updateNodeList ORACLE_HOME=/oracle/app/product/193000/db_1 "CLUSTER_NODES={rac1}" -local
1.3 移除集群中二节点的 VIP
[root@rac1 ~]# /oracle/grid/crs_1/bin/srvctl stop vip -n rac2
[root@rac1 ~]# /oracle/grid/crs_1/bin/srvctl remove vip -i rac2-vip -f
检查是否移除成功二节点 VIP
[root@rac1 ~]# /oracle/grid/crs_1/bin/crsctl stat res -t
检查二节点 ping 状态
[grid@rac1 ~]$ olsnodes -s -t
rac1 Active Unpinned
rac2 Inactive Unpinned
（如果二节点是 ping 状态，需要执行这步：
[grid@rac1 ~]$crsctl unpin css -n rac2
1.4 删除二节点
[root@rac1 ~]# /oracle/grid/crs_1/bin/crsctl delete node -n rac2
CRS-4661: Node rac2 successfully deleted.
1.5 更新 GI 的 inventory 信息
su - gird
cd $ORACLE_HOME/oui/bin
[grid@rac1 bin]$ /oracle/app/product/193000/db_1/oui/bin/./runInstaller -updateNodeList ORACLE_HOME=/oracle/app/product/193000/db_1 "CLUSTER_NODES={rac1}" CRS=TRUE -local
Starting Oracle Universal Installer...
Checking swap space: must be greater than 500 MB. Actual 15500 MB Passed
The inventory pointer is located at /etc/oraInst.loc
二：重新添加二节点到集群中
（ 1 ）：添加相应的用户和组，用户及用户组 ID 相同
（ 2 ）：配置 hosts 文件 , 新增节点和原有都配置为相同
（ 3 ）：配置系统参数，用户参数和原有节点一样，配置网络
（ 4 ）：创建相应的目录，并保证权限对应（根据实际情况创建目录 , 非常重要）
（ 5 ）：检查多路径，盘权限
2 、配置用户之间的 SSH 、安装集群 rpm 包：
到 grid 软件解压目录下：
[root@rac1 sshsetup]# cd $GI_HOME/oui/prov/resources/scripts/sshUserSetup.sh
grid 用户的 ssh ：
./sshUserSetup.sh -user grid -hosts "rac1 rac2" -advanced –noPromptPassphrase
oracle 用户的 ssh ：
./sshUserSetup.sh -user oracle -hosts "rac1 rac2" -advanced –noPromptPassphrase
将 grid 软件目录下的 rpm 包传到二节点：
[grid@rac1 ~]$ scp /oracle/grid/crs_1/cv/rpm/cvuqdisk-1.0.10-1.rpm 192.168.238.146:/home/grid/
3. 二节点安装 rpm 包：
[root@rac2 grid]# rpm -ivh cvuqdisk-1.0.10-1.rpm
Preparing... ################################# [100%]
package cvuqdisk-1.0.10-1.x86_64 is already installed
4 、检查 rac2 是否满足 rac 安装条件
[grid@rac1 ~]$ cluvfy stage -pre nodeadd -n rac2
1 2 3 4 5 6 7 8 9 10 11 12 13 |
Check: TCP connectivity of subnet "10.0.0.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
rac1:192.168.40.101 rac2:10.0.0.3 failed
Verifying Device Checks for ASM ...FAILED
Verifying Access Control List check ...FAILED
rac2: PRVF-9992 : Group of device "/dev/asmdisk2" did not match the expected
group. [Expected = "asmadmin"; Found = "oinstall"] on nodes: [rac1,rac2]
Verifying /dev/shm mounted as temporary file system ...FAILED
rac2: PRVE-0421 : No entry exists in /etc/fstab for mounting /dev/shm
|
第一个报错需要将共享盘数组权限更改为 asmadmin, 第二个报错可忽略
[grid@rac1 addnode]$ $GI_HOME/addnode/addnode.sh -silent "CLUSTER_NEW_NODES=rac2 CLUSTER_NEW_PRIVATE_NODE_NAMES=rac2-pri CLUSTER_NEW_VIRTUAL_HOSTNAMES=rac2-vip"
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 |
Copy Files to Remote Nodes in progress.
.................................................. 6% Done.
.................................................. 11% Done.
....................
Copy Files to Remote Nodes successful.
Prepare Configuration in progress.
Prepare Configuration successful.
.................................................. 21% Done.
You can find the log of this install session at:
/oracle/oraInventory/logs/addNodeActions2021-07-21_05-21-25PM.log
Instantiate files in progress.
Instantiate files successful.
.................................................. 49% Done.
Saving cluster inventory in progress.
.................................................. 83% Done.
Saving cluster inventory successful.
The Cluster Node Addition of /oracle/grid/crs_1 was successful.
Please check '/oracle/oraInventory/logs/silentInstall2021-07-21_05-21-25PM.log' for more details.
Setup Oracle Base in progress.
Setup Oracle Base successful.
.................................................. 90% Done.
Update Inventory in progress.
You can find the log of this install session at:
/oracle/oraInventory/logs/addNodeActions2021-07-21_05-21-25PM.log
Update Inventory successful.
.................................................. 97% Done.
As a root user, execute the following script(s):
1. /oracle/oraInventory/orainstRoot.sh
2. /oracle/grid/crs_1/root.sh
Execute /oracle/oraInventory/orainstRoot.sh on the following nodes:
[rac2]
Execute /oracle/grid/crs_1/root.sh on the following nodes:
[rac2]
The scripts can be executed in parallel on all the nodes.
Successfully Setup Software with warning(s).
.................................................. 100% Done.
|
然后根据提示在待修复节点上运行脚本。
此次在跑 root.sh 脚本时发现，报如下错误
oracle.ops.mgmt.cluster.ClusterException: scp: /oracle/grid/crs_1/gpnp/profiles/peer/profile.xml: No such file or directory
于是去正常节点检查这个文件，发现在另外一个目录下，于是将此文件拷贝到该目录，重新跑 root.sh 脚本，成功加入二节点
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 |
Performing root user operation.
The following environment variables are set as:
ORACLE_OWNER= grid
ORACLE_HOME= /oracle/grid/crs_1
Copying dbhome to /usr/local/bin ...
Copying oraenv to /usr/local/bin ...
Copying coraenv to /usr/local/bin ...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Relinking oracle with rac_on option
Using configuration parameter file: /oracle/grid/crs_1/crs/install/crsconfig_params
The log of current session can be found at:
/oracle/gridbase/crsdata/rac2/crsconfig/rootcrs_rac2_2021-07-21_06-09-57PM.log
2021/07/21 18:10:13 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'.
2021/07/21 18:10:13 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'.
2021/07/21 18:10:13 CLSRSC-363: User ignored prerequisites during installation
2021/07/21 18:10:13 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'.
2021/07/21 18:10:13 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.
2021/07/21 18:10:14 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'.
2021/07/21 18:10:17 CLSRSC-594: Executing installation step 5 of 19: 'SetupOSD'.
2021/07/21 18:10:17 CLSRSC-594: Executing installation step 6 of 19: 'CheckCRSConfig'.
oracle.ops.mgmt.cluster.ClusterException: scp: /oracle/grid/crs_1/gpnp/wallets/peer/cwallet.sso: No such file or directory
2021/07/21 18:10:23 CLSRSC-180: An error occurred while executing the command '/oracle/grid/crs_1/bin/cluutil -copy -sourcefile /oracle/grid/crs_1/gpnp/wallets/peer/cwallet.sso -fromnodesfile /tmp/nEoOrw_ITb -destfile /oracle/grid/crs_1/gpnp/wallets/peer/cwallet.sso -nodelist rac2'
2021/07/21 18:10:28 CLSRSC-594: Executing installation step 7 of 19: 'SetupLocalGPNP'.
2021/07/21 18:10:32 CLSRSC-594: Executing installation step 8 of 19: 'CreateRootCert'.
2021/07/21 18:10:32 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'.
2021/07/21 18:10:50 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'.
2021/07/21 18:11:24 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'.
2021/07/21 18:11:29 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'.
2021/07/21 18:11:29 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'
2021/07/21 18:12:50 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'.
2021/07/21 18:12:54 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'.
2021/07/21 18:14:42 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'.
2021/07/21 18:14:45 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'.
2021/07/21 18:15:19 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'.
2021/07/21 18:17:33 CLSRSC-343: Successfully started Oracle Clusterware stack
2021/07/21 18:17:33 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'.
clscfg: EXISTING configuration version 19 detected.
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
2021/07/21 18:18:45 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'.
2021/07/21 18:19:18 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded
|
验证是否成功添加新节点 :
cluvfy stage -post nodeadd -n rac2
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 |
Verifying Node Connectivity ...
Verifying Hosts File ...PASSED
Verifying Check that maximum (MTU) size packet goes through subnet ...PASSED
Verifying subnet mask consistency for subnet "192.168.238.0" ...PASSED
Verifying subnet mask consistency for subnet "172.16.28.0" ...PASSED
Verifying Node Connectivity ...PASSED
Verifying Cluster Integrity ...PASSED
Verifying Node Addition ...
Verifying CRS Integrity ...PASSED
Verifying Clusterware Version Consistency ...PASSED
Verifying '/oracle/grid/crs_1' ...PASSED
Verifying Node Addition ...PASSED
Verifying Multicast or broadcast check ...PASSED
Verifying Node Application Existence ...PASSED
Verifying Single Client Access Name (SCAN) ...
Verifying DNS/NIS name service 'rac-scan' ...
Verifying Name Service Switch Configuration File Integrity ...PASSED
Verifying DNS/NIS name service 'rac-scan' ...FAILED (PRVG-11826, PRVG-11827, PRVF-4664)
Verifying Single Client Access Name (SCAN) ...FAILED (PRVG-11826, PRVG-11827, PRVG-11368)
Verifying User Not In Group "root": grid ...PASSED
Verifying Clock Synchronization ...PASSED
Post-check for node addition was unsuccessful on all the nodes.
Failures were encountered during execution of CVU verification request "stage -post nodeadd".
Verifying Single Client Access Name (SCAN) ...FAILED
rac2: PRVG-11368 : A SCAN is recommended to resolve to "3" or more IP
addresses, but SCAN "rac-scan" resolves to only "/192.168.238.149"
Verifying DNS/NIS name service 'rac-scan' ...FAILED
PRVG-11826 : DNS resolved IP addresses "" for SCAN name "rac-scan" not found
in the name service returned IP addresses "192.168.238.149"
PRVG-11827 : Name service returned IP addresses "192.168.238.149" for SCAN
name "rac-scan" not found in the DNS returned IP addresses ""
rac2: PRVF-4664 : Found inconsistent name resolution entries for SCAN name
"rac-scan"
CVU operation performed: stage -post nodeadd
Date: Jul 21, 2021 6:20:19 PM
CVU home: /oracle/grid/crs_1/
User: grid
|
三、添加新节点数据库： ( 在一节点操作 )
cd $ORACLE_HOME/addnode
[oracle@rac1 bin]$./addnode.sh -silent "CLUSTER_NEW_NODES={rac2}"
出现提示时， root.sh 在新的 Oracle RAC 节点上运行。
跑完脚本后，到一节点 DBCA 图形化添加实例即可。
vk.com/topic-230984599_53764782
vk.com/topic-230984599_53764781
vk.com/topic-230984599_53764780
vk.com/topic-230984599_53764779
vk.com/topic-230984599_53764778
vk.com/topic-230984647_54226086
vk.com/topic-230984647_54226085
vk.com/topic-230984647_54226084
vk.com/topic-230984678_53701888
vk.com/topic-230984678_53701887
vk.com/topic-230984678_53701886
vk.com/topic-230984678_53701885
vk.com/topic-230984678_53701884
vk.com/topic-230984677_54226083
vk.com/topic-230984677_54226082
vk.com/topic-230984677_54226081
vk.com/topic-230984677_54226080
vk.com/topic-230984677_54226079
vk.com/topic-230984655_53168429
vk.com/topic-230984653_53521262
vk.com/topic-230984653_53521261
vk.com/topic-230984653_53521260
