Public IP addresses

1. Check current network information:

oracle@test01 /export/home/oracle $ oifcfg getif
bond0  172.23.72.0  global  public
bond1  172.23.58.16  global  cluster_interconnect

2. Delete the existing interface information from OCR

oracle@test02 /export/home/oracle $ oifcfg delif -global bond0/172.23.72.0

3. Add it back with the correct information

 oracle@test02 /export/home/oracle $ oifcfg setif -global bond0/172.29.2.0:public

4. Shutdown the cluster

root@test02)$ /u01/app/11.2.0.3/grid/bin/crsctl stop cluster -all
CRS-2673: Attempting to stop 'ora.crsd' on 'test02'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'test02'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'test02'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'test02'
CRS-2673: Attempting to stop 'ora.testdb.testdb.svc' on 'test02'
CRS-2677: Stop of 'ora.testdb.testdb.svc' on 'test02' succeeded
CRS-2673: Attempting to stop 'ora.testdb.db' on 'test02'
CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'test02' succeeded
CRS-2673: Attempting to stop 'ora.scan1.vip' on 'test02'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'test02' succeeded
CRS-2673: Attempting to stop 'ora.test02.vip' on 'test02'
CRS-2677: Stop of 'ora.test02.vip' on 'test02' succeeded
CRS-2677: Stop of 'ora.scan1.vip' on 'test02' succeeded
CRS-2677: Stop of 'ora.testdb.db' on 'test02' succeeded
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'test02'
CRS-2673: Attempting to stop 'ora.FLASH.dg' on 'test02'
CRS-2677: Stop of 'ora.FLASH.dg' on 'test02' succeeded
CRS-2673: Attempting to stop 'ora.crsd' on 'test01'
CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'test01'
CRS-2673: Attempting to stop 'ora.testdb.testdb.svc' on 'test01'
CRS-2673: Attempting to stop 'ora.cvu' on 'test01'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN3.lsnr' on 'test01'
CRS-2673: Attempting to stop 'ora.oc4j' on 'test01'
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN2.lsnr' on 'test01'
CRS-2677: Stop of 'ora.testdb.testdb.svc' on 'test01' succeeded
CRS-2673: Attempting to stop 'ora.testdb.db' on 'test01'
CRS-2673: Attempting to stop 'ora.LISTENER.lsnr' on 'test01'
CRS-2677: Stop of 'ora.cvu' on 'test01' succeeded
CRS-2677: Stop of 'ora.LISTENER_SCAN3.lsnr' on 'test01' succeeded
CRS-2673: Attempting to stop 'ora.scan3.vip' on 'test01'
CRS-2677: Stop of 'ora.LISTENER_SCAN2.lsnr' on 'test01' succeeded
CRS-2673: Attempting to stop 'ora.scan2.vip' on 'test01'
CRS-2677: Stop of 'ora.LISTENER.lsnr' on 'test01' succeeded
CRS-2673: Attempting to stop 'ora.test01.vip' on 'test01'
CRS-2677: Stop of 'ora.scan3.vip' on 'test01' succeeded
CRS-2677: Stop of 'ora.scan2.vip' on 'test01' succeeded
CRS-2677: Stop of 'ora.test01.vip' on 'test01' succeeded
CRS-2677: Stop of 'ora.testdb.db' on 'test01' succeeded
CRS-2673: Attempting to stop 'ora.DATA.dg' on 'test01'
CRS-2673: Attempting to stop 'ora.FLASH.dg' on 'test01'
CRS-2677: Stop of 'ora.FLASH.dg' on 'test01' succeeded
CRS-2677: Stop of 'ora.oc4j' on 'test01' succeeded
CRS-2677: Stop of 'ora.DATA.dg' on 'test02' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'test02'
CRS-2677: Stop of 'ora.asm' on 'test02' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'test02'
CRS-2677: Stop of 'ora.ons' on 'test02' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'test02'
CRS-2677: Stop of 'ora.net1.network' on 'test02' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'test02' has completed
CRS-2677: Stop of 'ora.crsd' on 'test02' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'test02'
CRS-2673: Attempting to stop 'ora.evmd' on 'test02'
RS-2673: Attempting to stop 'ora.asm' on 'test02'
CRS-2677: Stop of 'ora.DATA.dg' on 'test01' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'test01'
CRS-2677: Stop of 'ora.asm' on 'test01' succeeded
CRS-2673: Attempting to stop 'ora.ons' on 'test01'
CRS-2677: Stop of 'ora.evmd' on 'test02' succeeded
CRS-2677: Stop of 'ora.ons' on 'test01' succeeded
CRS-2673: Attempting to stop 'ora.net1.network' on 'test01'
CRS-2677: Stop of 'ora.net1.network' on 'test01' succeeded
CRS-2792: Shutdown of Cluster Ready Services-managed resources on 'test01' has completed
CRS-2677: Stop of 'ora.crsd' on 'test01' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'test01'
CRS-2673: Attempting to stop 'ora.evmd' on 'test01'
CRS-2673: Attempting to stop 'ora.asm' on 'test01'
CRS-2677: Stop of 'ora.evmd' on 'test01' succeeded
CRS-2677: Stop of 'ora.asm' on 'test02' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'test02'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'test02' succeeded
CRS-2677: Stop of 'ora.ctssd' on 'test01' succeeded
CRS-2677: Stop of 'ora.asm' on 'test01' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'test01'
CRS-2677: Stop of 'ora.ctssd' on 'test02' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'test02'
CRS-2677: Stop of 'ora.cssd' on 'test02' succeeded
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'test01' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'test01'
CRS-2677: Stop of 'ora.cssd' on 'test01' succeeded

5. Modify the IP address at network layer, DNS and /etc/hosts file to reflect the change. Files to modify/check are:

   - /etc/sysconfig/network-script/ifcfg-eth0
   - /etc/sysconfig/network
   - /etc/hosts

6. Restart network interface to activate changes

 $ ifdown eth0
 $ ifup eth0

6. Restart the cluster

root@test01)$ /u01/app/11.2.0.3/grid/bin/crsctl start cluster -all
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'test01'
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'test02'
CRS-2676: Start of 'ora.cssdmonitor' on 'test02' succeeded
CRS-2676: Start of 'ora.cssdmonitor' on 'test01' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'test01'
CRS-2672: Attempting to start 'ora.cssd' on 'test02'
CRS-2672: Attempting to start 'ora.diskmon' on 'test01'
CRS-2672: Attempting to start 'ora.diskmon' on 'test02'
CRS-2676: Start of 'ora.diskmon' on 'test02' succeeded
CRS-2676: Start of 'ora.diskmon' on 'test01' succeeded
CRS-2676: Start of 'ora.cssd' on 'test02' succeeded
CRS-2676: Start of 'ora.cssd' on 'test01' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'test02'
CRS-2672: Attempting to start 'ora.ctssd' on 'test01'
CRS-2676: Start of 'ora.ctssd' on 'test02' succeeded
CRS-2676: Start of 'ora.ctssd' on 'test01' succeeded
CRS-2672: Attempting to start 'ora.evmd' on 'test02'
CRS-2672: Attempting to start 'ora.evmd' on 'test01'
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'test01'
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'test02'
CRS-2676: Start of 'ora.evmd' on 'test01' succeeded
CRS-2676: Start of 'ora.evmd' on 'test02' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'test01' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'test02' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'test01'
CRS-2672: Attempting to start 'ora.asm' on 'test02'
CRS-2676: Start of 'ora.asm' on 'test01' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'test01'
CRS-2676: Start of 'ora.asm' on 'test02' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'test02'
CRS-2676: Start of 'ora.crsd' on 'test01' succeeded
CRS-2676: Start of 'ora.crsd' on 'test02' succeeded

 Changing VIPs node 1

1. Check current configuration

oracle@test01 /export/home/oracle $ srvctl config nodeapps -a
Network exists: 1/172.23.72.0/255.255.248.0/bond0, type static
VIP exists: /test01-vip/172.29.2.31/172.23.72.0/255.255.248.0/bond0, hosting node test01
VIP exists: /test02-vip/172.29.2.33/172.23.72.0/255.255.248.0/bond0, hosting node test02

2. Stop the database instance and VIP:

oracle@test01 /export/home/oracle $ srvctl stop instance -d testdb -n test01
oracle@test01 /export/home/oracle $ srvctl stop vip -n test01 -f

3. Ensure VIP is offline and VIP is not bounded to network interface

crsctl stat res -t
ifconfig -a

4. Alter the VIP

root@test01)$ srvctl modify nodeapps -n test01 -A 172.29.2.31/255.255.255.0/bond0

5. Verify the change

root@test01)$ srvctl config nodeapps -n test01 -a
-n <node_name> option has been deprecated.
Network exists: 1/172.29.2.0/255.255.255.0/bond0, type static
VIP exists: /test01-vip/172.29.2.31/172.29.2.0/255.255.255.0/bond0, hosting node test01

6. Start the database instance and VIP

oracle@test01 /export/home/oracle $ srvctl start vip -n test01
oracle@test01 /export/home/oracle $ srvctl start instance -d testdb -n test01

8. Ensure VIP is online and VIP is bounded to network interface

 $ crsctl stat res -t
 $ ifconfig -a

9. Repeat the steps for each node in the cluster

Changing SCAN IPs

1. Stop the SCAN listener and the SCAN

srvctl stop scan_listener
srvctl stop scan
srvctl status scan

2. Check the current IP address(es) of the SCAN

srvctl config scan

3. Refresh the SCAN with the new IP addresses from the DNS entry:

srvctl modify scan -n testdb-scan

4. Check whether the SCAN has been changed

oracle@test01 /export/home/oracle $ srvctl config scan
SCAN name: testdb-scan, Network: 1/172.29.2.0/255.255.255.0/bond0
SCAN VIP name: scan1, IP: /testdb-scan/172.29.2.36
SCAN VIP name: scan2, IP: /testdb-scan/172.29.2.35
SCAN VIP name: scan3, IP: /testdb-scan/172.29.2.34