Oracle Database 19c: Grid Infrastructure / RAC Installation - Part 2/3
In this blog I discuss from the part where you have setup your machine and ready to do your Linux configuration
This is a 3 Blog Series and this is Blog 2
Of this Blog series -
Part 1
Part 3
(Make sure you have internet connectivity)
Linux Configuration (on Both nodes)
1. Install rpm's via yum
2. Groups and User Addition
3. Copy secure/limits.d
4. Add huge pages
5. Swap Creation - Refer Blog - Swap Creation
6. Update Contents of /etc/profile
if [ $USER = "oracle" ]; then
if [ $SHELL = "/bin/ksh" ]; then
ulimit -p 16384
ulimit -n 65536
ulimit -s 32768
else
ulimit -u 16384 -n 65536
ulimit -s 32768
fi
fi
if [ $USER = "grid" ]; then
if [ $SHELL = "/bin/ksh" ]; then
ulimit -p 16384
ulimit -n 65536
ulimit -s 32768
else
ulimit -u 16384 -n 65536
ulimit -s 32768
fi
fi
Network Configuration (on both nodes)
7. Contents of /etc/hosts file
(The key thing here is to configure your machines as per below addresses.
There will be 3 interfaces on Virtual box One public, 2 private to Cluster - One for ASM communcation and one Private for Cluster Communcation
192.168.10.51 rac19c01.novalocal rac18c01
192.168.10.52 rac19c02.novalocal rac18c02
192.168.10.61 rac19c01-vip.novalocal rac18c01-vip
192.168.10.62 rac19c02-vip.novalocal rac18c02-vip
192.168.30.21 rac19c01-priv01.novalocal rac18c01-priv01
192.168.30.22 rac19c02-priv01.novalocal rac18c02-priv01
8. DNS Configuration (On Node 1 only)
(After you clone the machine - make sure you disable named service on the cloned machine
File - /etc/named.conf - Make the changes as given below
Change 1 - Add highlighted entry
options {
listen-on port 53 { 127.0.0.1;192.168.50.51; };
Change 1.1
allow-query { 192.168.10.0/24; };
Change 2 - remove the below section
zone "." IN {
type hint;
file "named.ca";
};
Change 3 - and add this in the end of the file
zone "novalocal" IN {
type master;
file "novalocal.zone";
allow-update { none; };
};
Create file /var/named/localdomain.zone with contents as below
$ cat /var/named/novalocal.zone
$TTL 86400
@ IN SOA novalocal. novalocal.(
42 ; serial (d. adams)
3H ; refresh
15M ; retry
1W ; expiry
1D ) ; minimum
IN NS rac19c01.novalocal.
localhost IN A 127.0.0.1
rac19c01.novalocal. IN A 192.168.10.51
rac19c02.novalocal. IN A 192.168.10.52
rac19c01-vip.novalocal. IN A 192.168.10.61
rac19c02-vip.novalocal. IN A 192.168.10.62
rac-scan.novalocal. IN A 192.168.10.71
rac-scan.novalocal. IN A 192.168.10.72
rac-scan.novalocal. IN A 192.168.10.73
File - /etc/resolv.conf - create this file as below (On both nodes)
$ cat /etc/resolv.conf
nameserver 192.168.10.51
search novalocal
options attempts:1
options timeout:1
Finally enable the named.service and restart it
Note - the systemctl utiltity used instead of conventional chkconfig and service utility
$ systemctl enable named.service
$ systemctl restart named.service
9. ORACLEASM Configuration
[As root on All Nodes ]
$ oracleasm configure -i
Configuring the Oracle ASM library driver.
This will configure the on-boot properties of the Oracle ASM library
driver. The following questions will determine whether the driver is
loaded on boot and what permissions it will have. The current values
will be shown in brackets ('[]'). Hitting <ENTER> without typing an
answer will keep that current value. Ctrl-C will abort.
Default user to own the driver interface []: grid
Default group to own the driver interface []: asmadmin
Start Oracle ASM library driver on boot (y/n) [n]: y
Scan for Oracle ASM disks on boot (y/n) [y]: y
Writing Oracle ASM library driver configuration: done
$ oracleasm init
[As root on Node 1]
(Ensure the disks are partitioned, no FS required though)
$ oracleasm createdisk OCR_VOTE1 /dev/xvdc1
Writing disk header: done
Instantiating disk: done
$ oracleasm createdisk OCR_VOTE2 /dev/xvdd1
Writing disk header: done
Instantiating disk: done
$ oracleasm createdisk OCR_VOTE3 /dev/xvde1
Writing disk header: done
Instantiating disk: done
[As root on All nodes]
$ oracleasm scandisks
Reloading disk partitions: done
Cleaning any stale ASM disks...
Scanning system for ASM disks...
Instantiating disk "OCR_VOTE1"
Instantiating disk "OCR_VOTE2"
Instantiating disk "OCR_VOTE3"
10. Create Directories and Unzip Software
[As root user on both/all nodes]
mkdir /u01
mkdir /u01/app
chown root:oinstall /u01 /u01/app
chmod 755 /u01 /u01/app
mkdir /u01/app/190
chown grid:oinstall /u01/app/190
chmod 755 /u01/app/190
mkdir /u01/app/grid
chown grid:oinstall /u01/app/grid
chmod 755 /u01/app/grid
mkdir /u01/app/oraInventory
chown grid:oinstall /u01/app/oraInventory
chmod 755 /u01/app/oraInventory
[As grid user]
mkdir -p /u01/app/190/grid
The next part of the blog discusses on the real installation
This is a 3 Blog Series and this is Blog 2
Of this Blog series -
Part 1
Part 3
(Make sure you have internet connectivity)
Linux Configuration (on Both nodes)
1. Install rpm's via yum
- yum install oracle-database-preinstall-19c.x86_64 -y
- yum install oracleasm-support -y
- yum install kmod-oracleasm.x86_64 -y
- yum install bind -y
- yum install kmod -y
- yum install kmod-libs -y
2. Groups and User Addition
- groupadd -g 54331 asmadmin
- useradd -g oinstall -G asmadmin,dba -u 54232 grid
- Set password for root, oracle and grid user
3. Copy secure/limits.d
- cd /etc/security/limits.d/
- In file oracle-database-preinstall-19c.conf duplicate all entries and change the user to grid.
4. Add huge pages
- vi /etc/sysctl.conf
- vm.nr_hugepages = 10000
- sysctl --system
5. Swap Creation - Refer Blog - Swap Creation
6. Update Contents of /etc/profile
if [ $USER = "oracle" ]; then
if [ $SHELL = "/bin/ksh" ]; then
ulimit -p 16384
ulimit -n 65536
ulimit -s 32768
else
ulimit -u 16384 -n 65536
ulimit -s 32768
fi
fi
if [ $USER = "grid" ]; then
if [ $SHELL = "/bin/ksh" ]; then
ulimit -p 16384
ulimit -n 65536
ulimit -s 32768
else
ulimit -u 16384 -n 65536
ulimit -s 32768
fi
fi
Network Configuration (on both nodes)
7. Contents of /etc/hosts file
(The key thing here is to configure your machines as per below addresses.
There will be 3 interfaces on Virtual box One public, 2 private to Cluster - One for ASM communcation and one Private for Cluster Communcation
192.168.10.51 rac19c01.novalocal rac18c01
192.168.10.52 rac19c02.novalocal rac18c02
192.168.10.61 rac19c01-vip.novalocal rac18c01-vip
192.168.10.62 rac19c02-vip.novalocal rac18c02-vip
192.168.30.21 rac19c01-priv01.novalocal rac18c01-priv01
192.168.30.22 rac19c02-priv01.novalocal rac18c02-priv01
8. DNS Configuration (On Node 1 only)
(After you clone the machine - make sure you disable named service on the cloned machine
File - /etc/named.conf - Make the changes as given below
Change 1 - Add highlighted entry
options {
listen-on port 53 { 127.0.0.1;192.168.50.51; };
Change 1.1
allow-query { 192.168.10.0/24; };
Change 2 - remove the below section
zone "." IN {
type hint;
file "named.ca";
};
Change 3 - and add this in the end of the file
zone "novalocal" IN {
type master;
file "novalocal.zone";
allow-update { none; };
};
Create file /var/named/localdomain.zone with contents as below
$ cat /var/named/novalocal.zone
$TTL 86400
@ IN SOA novalocal. novalocal.(
42 ; serial (d. adams)
3H ; refresh
15M ; retry
1W ; expiry
1D ) ; minimum
IN NS rac19c01.novalocal.
localhost IN A 127.0.0.1
rac19c01.novalocal. IN A 192.168.10.51
rac19c02.novalocal. IN A 192.168.10.52
rac19c01-vip.novalocal. IN A 192.168.10.61
rac19c02-vip.novalocal. IN A 192.168.10.62
rac-scan.novalocal. IN A 192.168.10.71
rac-scan.novalocal. IN A 192.168.10.72
rac-scan.novalocal. IN A 192.168.10.73
File - /etc/resolv.conf - create this file as below (On both nodes)
$ cat /etc/resolv.conf
nameserver 192.168.10.51
search novalocal
options attempts:1
options timeout:1
Finally enable the named.service and restart it
Note - the systemctl utiltity used instead of conventional chkconfig and service utility
$ systemctl enable named.service
$ systemctl restart named.service
9. ORACLEASM Configuration
[As root on All Nodes ]
$ oracleasm configure -i
Configuring the Oracle ASM library driver.
This will configure the on-boot properties of the Oracle ASM library
driver. The following questions will determine whether the driver is
loaded on boot and what permissions it will have. The current values
will be shown in brackets ('[]'). Hitting <ENTER> without typing an
answer will keep that current value. Ctrl-C will abort.
Default user to own the driver interface []: grid
Default group to own the driver interface []: asmadmin
Start Oracle ASM library driver on boot (y/n) [n]: y
Scan for Oracle ASM disks on boot (y/n) [y]: y
Writing Oracle ASM library driver configuration: done
$ oracleasm init
[As root on Node 1]
(Ensure the disks are partitioned, no FS required though)
$ oracleasm createdisk OCR_VOTE1 /dev/xvdc1
Writing disk header: done
Instantiating disk: done
$ oracleasm createdisk OCR_VOTE2 /dev/xvdd1
Writing disk header: done
Instantiating disk: done
$ oracleasm createdisk OCR_VOTE3 /dev/xvde1
Writing disk header: done
Instantiating disk: done
[As root on All nodes]
$ oracleasm scandisks
Reloading disk partitions: done
Cleaning any stale ASM disks...
Scanning system for ASM disks...
Instantiating disk "OCR_VOTE1"
Instantiating disk "OCR_VOTE2"
Instantiating disk "OCR_VOTE3"
10. Create Directories and Unzip Software
[As root user on both/all nodes]
mkdir /u01
mkdir /u01/app
chown root:oinstall /u01 /u01/app
chmod 755 /u01 /u01/app
mkdir /u01/app/190
chown grid:oinstall /u01/app/190
chmod 755 /u01/app/190
mkdir /u01/app/grid
chown grid:oinstall /u01/app/grid
chmod 755 /u01/app/grid
mkdir /u01/app/oraInventory
chown grid:oinstall /u01/app/oraInventory
chmod 755 /u01/app/oraInventory
[As grid user]
mkdir -p /u01/app/190/grid
The next part of the blog discusses on the real installation
