Install Oralce 11gr2 Grid on Virtual Box

This document only focus on main steps and gotchas.

Part I install VM

1. Download and install VirtualBox. You can download from oracle site or http://dlc.sun.com.edgesuite.net/virtualbox/4.1.4/VirtualBox-4.1.4-74291-Win.exe

2. When install choose customized folder such as D, which has space for your disks. This will eliminate a lot click when choosing folder later.

3. First just create one virtual machine and install Linux, clone it later once first node1 configuration is read.

4. Add three network adapters. one choosing bridged, the other two can choose virtual machine only or bridged. The first one will comunicate with your other pcs.

5. add at least three disk for ASM. Choose SCSI controler. After disk is added, modify disk type choose multi-path mount.

6. uname -a

Linux node1.localdomain 2.6.32-100.34.1.el6uek.x86_64 #1 SMP Wed May 25 17:46:45 EDT 2011 x86_64 x86_64 x86_64 GNU/Linux

[root@node1 app]# cat /etc/redhat-release

Red Hat Enterprise Linux Server release 6.1 (Santiago)

Part II prepare node1

1. download Oracle Linux 6.1 from http://epd-akam-intl.oracle.com/aaruna04/vol/patch28/EPD/V26568-01.zip?AuthParam=1317761330_bf1d83b0979d4275357db54d1a672c74&FilePath=/aaruna04/vol/patch28/EPD/V26568-01.zip&File=V26568-01.zip&params=NndQNG1mQzc3c01CeitnMlZHRGdCUTphcnU9MTM3ODk3NjYmZW1haWw9cm9iaW4uc29uZ0BlZG1vbnRvbi5jYSZmaWxlX2lkPTQwNzc5NzY4JnBhdGNoX2ZpbGU9VjI2NTY4LTAxLnppcCZ1c2VyaWQ9ZXBkLXJvYmluLnNvbmdAZWRtb250b24uY2Emc2l6ZT0zNDM2NzkyNTExJmNvbnRleHQ9QUAxNStIQGFhcnUyMDEub3JhY2xlLmNvbStQQDEzODE3NDk2JmRvd25sb2FkX2lkPTk2NDQxNDY@

2. Install the Linux.

Customize the package during installation. Remember to choose Destop package else you won't have X-server installed.

3. after install

a. change /etc/inittab to runlevel 3.

b. configure network adapters

eth0 use DHCP

eth1 use static 192.168.10.1

eth2 use static 192.168.20.11

c. edit /etc/hosts

127.0.0.1 localhost node1 localhost.localdomain localhost4 localhost4.localdomain4

::1 localhost node1 localhost.localdomain localhost6 localhost6.localdomain6

192.168.10.1 node1 node1.localdomain

192.168.20.1 node1-vip node1-vip.localdomain

192.168.10.2 node2 node2.localdomain

192.168.20.2 node2-vip node2-vip.localdomain

192.168.10.254 ORA-RAC1 ORA-RAC1.localdomain

d. shared libiary

cd /lib64

cp /lib64/libcap.so.2 /lib64/libcap.so.1

e. format disk

such as /dev/sda1, /dev/sdb1, /dev/sdc1

g. prepare users and groups. commands( useradd, groupadd)

oinstall:x:1000:

asmadmin:x:1001:grid

dba:x:1002:grid,oracle

asmdba:x:1003:oracle

user:

grid:x:1000:1000::/home/grid:/bin/bash

oracle:x:1001:1000::/home/oracle:/bin/bash

f. change owner of disk

add lines in /etc/rc.local

chown grid:asmadmin /dev/sda1

chown grid:asmadmin /dev/sdb1

chown grid:asmadmin /dev/sdc1

h. disable ipv6

Disable IPv6 on RedHat Enterprise RHEL 6

Add a new file /etc/modprobe.d/ipv6.conf containing

alias net-pf-10 off

alias ipv6 off

Edit /etc/sysconfig/network and add a line saying

NETWORKING_IPV6=off

Then do

chkconfig ip6tables off

then reboot.

PART III clone VM

1. from virtual box menu select clone machine. Name new machine node2.

vi /etc/sysconfig/network

2. start node.

a. change hostname

hostname node2

b. vi /etc/hosts and change localhost line to node2.

cat /etc/hosts

127.0.0.1 localhost node2 localhost.localdomain localhost4 localhost4.localdomain4

::1 localhost node2 localhost.localdomain localhost6 localhost6.localdomain6

192.168.10.1 node1 node1.localdomain

192.168.20.1 node1-vip node1-vip.localdomain

192.168.10.2 node2 node2.localdomain

192.168.20.2 node2-vip node2-vip.localdomain

192.168.10.254 ORA-RAC1 ORA-RAC1.localdomain

c. change network adapter name. comment out node1 enthr and rename network adapter to 0,1,2

[root@node2 app]# cat /etc/udev/rules.d/70-persistent-net.rules

# PCI device 0x8086:0x100e (e1000)

SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", ATTR{address}=="08:00:27:4d:41:de", ATTR{dev_id}=="0x0", ATTR{type}=="1", KERNEL=="eth*", NAME="eth0"

# PCI device 0x8086:0x100e (e1000)

SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", ATTR{address}=="08:00:27:33:4a:2b", ATTR{dev_id}=="0x0", ATTR{type}=="1", KERNEL=="eth*", NAME="eth1"

# PCI device 0x8086:0x100e (e1000)

SUBSYSTEM=="net", ACTION=="add", DRIVERS=="?*", ATTR{address}=="08:00:27:a0:09:d6", ATTR{dev_id}=="0x0", ATTR{type}=="1", KERNEL=="eth*", NAME="eth2"

3. reboot then reconfig the IPs.

ifconfig eth1 192.168.10.12

ifconfig eth2 192.168.20.12

PART IV prepare install Grid

1. setup ssh authentication

a. login node1 as grid

ssh-keygen

ssh-copyid node1 grid@node1

ssh-copyid node2 grid@node1

b. login node2 as grid and repeat step a.

2. start install Grid