Oracle Database 19c: Grid Infrastructure / RAC Installation - Part 2/3

In this blog I discuss from the part where you have setup your machine and ready to do your Linux configuration
This is a 3 Blog Series and this is Blog 2
Of this Blog series - 
Part 1
Part 3 

(Make sure you have internet connectivity)
Linux Configuration (on Both nodes)
1. Install rpm's via yum

• yum install oracle-database-preinstall-19c.x86_64 -y
• yum install oracleasm-support -y
• yum install kmod-oracleasm.x86_64 -y
• yum install bind -y
• yum install kmod -y
• yum install kmod-libs -y

2. Groups and User Addition

• groupadd -g 54331 asmadmin
• useradd -g oinstall -G asmadmin,dba -u 54232 grid
• Set password for root, oracle and grid user

3. Copy secure/limits.d

• cd /etc/security/limits.d/
• In file oracle-database-preinstall-19c.conf duplicate all entries and change the user to grid.

4. Add huge pages

• vi /etc/sysctl.conf
• vm.nr_hugepages = 10000
• sysctl --system

5. Swap Creation - Refer Blog - Swap Creation

6. Update Contents of /etc/profile 

if [ $USER = "oracle" ]; then
  if [ $SHELL = "/bin/ksh" ]; then
    ulimit -p 16384
    ulimit -n 65536 
  ulimit -s 32768
  else
    ulimit -u 16384 -n 65536
    ulimit -s 32768
  fi
fi

if [ $USER = "grid" ]; then
  if [ $SHELL = "/bin/ksh" ]; then
    ulimit -p 16384
    ulimit -n 65536 
  ulimit -s 32768
  else
    ulimit -u 16384 -n 65536
    ulimit -s 32768
  fi
fi

Network Configuration (on both nodes)

7.  Contents of /etc/hosts file 
(The key thing here is to configure your machines as per below addresses. 
There will be 3 interfaces on Virtual box One public, 2 private to Cluster - One for ASM communcation and one Private for Cluster Communcation

192.168.10.51 rac19c01.novalocal rac18c01
192.168.10.52 rac19c02.novalocal rac18c02
192.168.10.61 rac19c01-vip.novalocal rac18c01-vip
192.168.10.62 rac19c02-vip.novalocal rac18c02-vip

192.168.30.21 rac19c01-priv01.novalocal rac18c01-priv01
192.168.30.22 rac19c02-priv01.novalocal rac18c02-priv01



8. DNS Configuration (On Node 1 only)
(After you clone the machine - make sure you disable named service on the cloned machine 

File - /etc/named.conf - Make the changes as given below

Change 1  - Add highlighted entry
options {
        listen-on port 53 { 127.0.0.1;192.168.50.51; };  

Change 1.1
        allow-query     { 192.168.10.0/24; };

Change 2 - remove the below section
zone "." IN {
type hint;
file "named.ca";
};

Change 3 -  and add this in the end of the file

zone "novalocal" IN {
type master;
file "novalocal.zone";
allow-update { none; };
};


Create file /var/named/localdomain.zone with contents as below

$ cat /var/named/novalocal.zone

$TTL  86400
@ IN SOA      novalocal. novalocal.(
42          ; serial (d. adams)
3H          ; refresh
15M         ; retry
1W          ; expiry
1D )        ; minimum

                                 IN NS   rac19c01.novalocal.
localhost                        IN A    127.0.0.1
rac19c01.novalocal.                IN A    192.168.10.51
rac19c02.novalocal.                IN A    192.168.10.52
rac19c01-vip.novalocal.            IN A    192.168.10.61
rac19c02-vip.novalocal.            IN A    192.168.10.62
rac-scan.novalocal.            IN A    192.168.10.71
rac-scan.novalocal.            IN A    192.168.10.72
rac-scan.novalocal.            IN A    192.168.10.73


File - /etc/resolv.conf - create this file as below (On both nodes)

$ cat /etc/resolv.conf

nameserver 192.168.10.51
search novalocal
options attempts:1
options timeout:1

Finally enable the named.service and restart it
Note - the systemctl utiltity used instead of conventional chkconfig and service utility

$ systemctl enable named.service
$ systemctl restart named.service


9.  ORACLEASM Configuration
[As root on All Nodes  ]
$ oracleasm configure -i
Configuring the Oracle ASM library driver.

This will configure the on-boot properties of the Oracle ASM library
driver.  The following questions will determine whether the driver is
loaded on boot and what permissions it will have.  The current values
will be shown in brackets ('[]').  Hitting <ENTER> without typing an
answer will keep that current value.  Ctrl-C will abort.

Default user to own the driver interface []: grid
Default group to own the driver interface []: asmadmin
Start Oracle ASM library driver on boot (y/n) [n]: y
Scan for Oracle ASM disks on boot (y/n) [y]: y
Writing Oracle ASM library driver configuration: done

$ oracleasm init

[As root on Node 1]
(Ensure the disks are partitioned, no FS required though)

$ oracleasm createdisk OCR_VOTE1 /dev/xvdc1
Writing disk header: done
Instantiating disk: done

$ oracleasm createdisk OCR_VOTE2 /dev/xvdd1
Writing disk header: done
Instantiating disk: done

$ oracleasm createdisk OCR_VOTE3 /dev/xvde1
Writing disk header: done
Instantiating disk: done

[As root on All nodes]
$  oracleasm scandisks
Reloading disk partitions: done
Cleaning any stale ASM disks...
Scanning system for ASM disks...
Instantiating disk "OCR_VOTE1"
Instantiating disk "OCR_VOTE2"
Instantiating disk "OCR_VOTE3"

10.  Create Directories and Unzip Software 
[As root user on both/all nodes] 

mkdir /u01 
mkdir /u01/app
chown root:oinstall /u01 /u01/app
chmod 755 /u01 /u01/app

mkdir /u01/app/190
chown grid:oinstall /u01/app/190
chmod 755 /u01/app/190

mkdir /u01/app/grid
chown grid:oinstall /u01/app/grid
chmod 755 /u01/app/grid

mkdir /u01/app/oraInventory
chown grid:oinstall /u01/app/oraInventory
chmod 755 /u01/app/oraInventory

[As grid user]
mkdir -p /u01/app/190/grid


The next part of the blog discusses on the real installation