How To Create A Cluster Testbed Using CentOS 5 Vir
A. Overview
This guide attempts to provide a Xen based test environment where you can practice setting up a two node cluster (cluster setup itself is not discussed here – I'm merely giving you what you need to set it up).
XEN can host two type of guest systems para-virtualized and fully-virtualized:
for para-virtualized guests you require the Red Hat Enterprise Linux 5 installation tree available over NFS, FTP or HTTP.
for fully-virtualized guest installations you will require DVD or CD-ROM distribution media or a bootable .iso file and a network accessible installation tree
For details, please refer to the RHEL5 Virtualization Manual.
I'll be using para-virtualized guests here in my setup. There will be three systems involved here:
node00 – physical system
virtual IPs: 192.168.222.1 (public1 vlan)
192.168.100.1 (private1 vlan)
node01 – para-virtualized guest 1
virtual IPs: 192.168.222.10 (public1 vlan)
192.168.100.10 (private1 vlan)
node02 – para-virtualized guest 1
virtual IPs: 192.168.222.20 (public1 vlan)
192.168.100.20 (private1 vlan)
B. What I used
an HP Blade bl25p machine with 4G of RAM (this is actually an AMD64 blade machine). A machine with decent amount of RAM and processing speed should do.
Centos i386 5 update 1 www.centos.org DVD ISO downloaded HTTP, NFS and FTP installation sources were created from this iso. Also, the yum repository that can be used by host and guest systems will be generated from the centos iso image.
logical volumes hosting the guests and the "virtual luns" via iscsi (you can also use disk partitions – please refer to the virtualization guide for details).
1. My LVM setup
The following is my LVM configuration. The lvLUN0* entries are the ones I used for iSCSI setup and will be shared by the two virtual guest systems.
lvs
LV VG Attr LSize origin Snap% Move Log Copy%
lvLUN01 Virtual00VG -wi-ao 50.00G
lvLUN02 Virtual00VG -wi-ao 50.00G
lvNODE01 Virtual00VG -wi-ao 30.00G
lvNODE02 Virtual00VG -wi-ao 30.00G
lvNODE03 Virtual00VG -wi-ao 15.00G
lvsys00 vg00 -wi-ao 512.00M
lvsys01 vg00 -wi-ao 8.00G
lvsys02 vg00 -wi-ao 8.00G
lvsys03 vg00 -wi-ao 512.00M
lvsys04 vg00 -wi-ao 128.00M
lvsys05 vg00 -wi-ao 1.00G
lvsys06 vg00 -wi-ao 256.00M
C. Host Preparation
I'm assuming that you know how to install CentOS or other RHEL based distributions and that you are familiar with rpm installation. Since I do a lot of setup for test/dev environments at work, I already have an installation server making it easy to do a network based install via PXE. The kickstart file for node00 is provided below. You can do a local media install (you have the ISO so you can burn it to a DVD) and just refer to the kickstart file for some of the configuration. The list of packages I used is in the %packages section of node00's kickstart file. You can install them manually using yum, like:
# will list centos installation groups
yum grouplist
# will install Virtualization group
yum groupinstall Virtualization
1. ks file and installation
1.a kickstart file I use for the host (node00)
You'll have to modify the following to suit your setup.
## START node00_ks.cfg
#modify for your own settings
install
nfs –server=remote_server –dir=/path/to/CENTOS5U1/i386
lang en_US.UTF-8
keyboard us
skipx
reboot
network –device eth2 –bootproto static –ip a.b.c.1 –netmask 255.255.255.0 –gateway a.b.c.2 –nameserver x.y.z.n –hostname node00.example.com
# grub and root password is a1s2d3f4g5
rootpw –iscrypted $1$3CXK2$CG9WlX2PuPpp7nxYMQGwP0
firewall –disabled
authconfig –enableshadow
selinux –disabled
timezone Asia/Singapore
bootloader –location=mbr –driveorder=cciss/c0d0 –append="rhgb quiet" –md5pass=$1$3CXK2$CG9WlX2PuPpp7nxYMQGwP0
clearpart –all –initlabel –drives=cciss/c0d0
part /boot –fstype ext3 –size=100 –ondisk=cciss/c0d0
part pv.100000 –size=100 –grow –ondisk=cciss/c0d0 –asprimary
volgroup vg00 –pesize=32768 pv.100000
logvol /tmp –fstype ext3 –name=lvsys05 –vgname=vg00 –size=1024
logvol /opt –fstype ext3 –name=lvsys04 –vgname=vg00 –size=128
logvol /var –fstype ext3 –name=lvsys03 –vgname=vg00 –size=512
logvol /usr –fstype ext3 –name=lvsys02 –vgname=vg00 –size=8192
logvol swap –fstype swap –name=lvsys01 –vgname=vg00 –size=8192
logvol /home –fstype ext3 –name=lvsys06 –vgname=vg00 –size=256
logvol / –fstype ext3 –name=lvsys00 –vgname=vg00 –size=512
%packages
@development-libs
@editors
@system-tools
@text-internet
@x-software-development
@virtualization
@dns-server
@core
@base
@ftp-server
@network-server
@legacy-software-development
@base-x
@web-server
@printing
@server-cfg
@sql-server
@admin-tools
@development-tools
lsscsi
createrepo
audit
net-snmp-utils
iptraf
tftp
lynx
mesa-libGLU-devel
kexec-tools
bridge-utils
device-mapper-multipath
vnc-server
xorg-x11-server-Xnest
xorg-x11-server-Xvfb
imake
openmotif
-vim-enhanced
-zisofs-tools
-zsh
-bluez-hcidump
-sysreport
## END of node00_ks.cfg
2. Host configuration
Setting up an HTTP, NFS and FTP installation server:
2.a web server
#/etc/httpd/conf.d/centos5u1.conf
Alias /centos5u1 /var/ftp/pub/centos5u1
Options Indexes FollowSymLinks MultiViews
IndexOptions FancyIndexing
Order deny,allow
Deny from all
Allow from 127.0.0.1 ::1 all
Then start the httpd service and make sure it does during startup:
service httpd start
chkconfig httpd on
2.b NFS server
Edit /etc/exports and put the following into it:
# /etc/exports
/var/ftp/pub/centos5u1 192.168*(ro)
service nfs start
chkconfig nfs on
2.c FTP server
Since we already have the source in /var/ftp/pub/centos5u1, all that is needed is to start vsftpd:
service vsftpd start
chkconfig vsftpd on
2.d YUM repository
For this setup, I only use a local yum repository from the Centos DVD ISO I downloaded. First, I loopback mount it in /var/ftp/pub/centos5u1/i386/:
cd /var/ftp/pub/centos5u1/
mkdir temp
mount -o loop CentOS-5.1-i386-bin-DVD.iso temp
cp -pr temp i386
umount temp
createrepo -g i386
(i386/repodata/ will then be updated.)
For RHEL5, it's different:
createrepo -g repodata/comps-rhel5-server-core.xml Server
You need to do this inside the i386 directory (after loopback mounting and copying the whole directory structure).
2.d.1 the yum repo configuration:
I renamed the default repo files in /etc/yum.repos.d/ to *-repo (instead of *.repo) to disable them. I then created this file:
#/etc/yum.repos.d/CentOS5.repo
[centos5-Server]
name=CentOS5 Server
baseurl=http://node00/centos5u1/i386
enabled=1
gpgcheck=1
gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-5
node00 needs to be defined in /etc/hosts for the above file to work. or just replace node00 with its IP address.
2.e VNC server
You won't be needing a vnc connection if you have local console access to the physical machine. All you need to do is switch into gui mode:
telinit 5
and open a gui terminal (like gnome-terminal or kde konsole). But since I do everything remotely, I use vncserver and vncviewer to do gui based stuff.
2.e.1 run vncserver:
This will bringvup a vncserver in node00 that is accessible via "vncviewer" at node00:1 (assuming node00 is resolveable from your vncviewer host).
vncserver
You will require a password to access your desktops.
Password:
Verify:
xauth: creating new authority file /root/.Xauthority
New 'node00.example.com:1 (root)' desktop is node00.example.com:1
Creating default startup script /root/.vnc/xstartup
Starting applications specified in /root/.vnc/xstartup
Log file is /root/.vnc/node00.example.com:1.log
How To Create A Cluster Testbed Using CentOS 5 Virtualization And iSCSI – Page 2
How To Create A Cluster Testbed Using CentOS 5 Virtualization And iSCSI – Page 3
next
How To Create A Cluster Testbed Using CentOS 5 Virtualization And iSCSI – Page 2
Copyright ? 2008 roderick tapang
