EDG 2 Testbed Install

Introduction

Presently this method can be used to install edg version 2.0.

These notes are based on the methods explained in WP4's instructions for LCFGng with some extras portions added by WP6. Do read WP4's documentations as there is much overlap with this and there are more details there in some areas.

Required Nodes

Optional boxes include the UI, an RB and a MyProxy node. All other nodes are for supporting VOs and in the first instance will be provided by core EDG testbed sites.

LCFG Server

The LCFGng server should have an Apache webserver, an NFS server, a DHCP server and tftp server if you plan to use PXE.

Fetch EDG Release Module and Required RPMS

# gpp-fetch-edg-release.sh -o /tmp -r v2_0_1,
# cp /tmp/edg-release/ng_updaterep/updaterep.conf /etc/updaterep.conf
# cp /tmp/edg-release/ng_updaterep/*.pl /usr/local/bin/.
# mkdir -p /opt/local/linux/7.3/RPMS
# /usr/local/bin/updateRPMCache.pl \
      --rpmcfg /tmp/edg-release/ng_rpmlist/*-rpm.h \
               /tmp/edg-release/ng_rpmlist/lcfgng-server-rpm

The gpp-fetch-edg-release checks a particular cvs tag of edg-release from the server at Marianne. The script updateRPMCache.pl reads both /etc/updaterep.conf and all the *rpm.h files specified on the command line and downloads the exact rpms that you need to /opt/local/linux/7.3/RPMS

Network Time Protocol

Set up LCFGng

Now run the script:

/opt/local/linux/utils/installpackages-ngserver73

this will install some more RPMS on the LCFGng server.

Now run.

checkServerRPMs.pl /opt/local/linux/7.3/rpmcfg

This does a portion of what the script above does but with rather more success, the first script may indead not be nescesary but needs to be confirmed.

Now run the script:

/opt/local/linux/utils/create-nginstallroot-rh73

This will create a mini rpm installation within /opt/local/linux/nginstallroot/7.3 to be used as an NFS mounted root by the LCFGng clients. You may see an error like this which you can ignore.

Create a couple of empty directories.

mkdir -p /opt/local/linux/7.3/RPMS/WP8/LHCb
mkdir -p /opt/local/linux/7.3/RPMS/WP10

Prepare Profiles

Defaults

# cp /tmp/edg-release/ng_source/* /var/obj/conf/server/source/.
# cp /tmp/edg-release/ng_rpmlist/* /opt/local/linux/7.3/rpmcfg/.

Node Types

# cp /tmp/edg-release/ng_source/examples/exampleCE /var/obj/conf/server/source/gppce06
# cp /tmp/edg-release/ng_source/examples/exampleSE /var/obj/conf/server/source/gppse06
# cp /tmp/edg-release/ng_source/examples/exampleWN /var/obj/conf/server/source/gppwn06
# cp /tmp/edg-release/ng_source/examples/exampleUI /var/obj/conf/server/source/gppui06

Note in the exampleCE there is presently a mistake. Replace '#else' with '#endif'.

Customise

Modify each of your top level nodefiles , eg gppce06:

• Change the unqualified hostname in this file.
• Include your customised site-cfg-ral.h
• Set a root password with the line:
  +auth.rootpwd GlNcFTQdsfjaa5
  having generated the password hash with openssl passwd.
• If you have anything other than eepro100 ethernet card you need to add something like.
  +hardware.mod_eth0 alias eth0 e1000
  to the end of you profile to specify the network driver that is required.

Webserver

This apache config sets up a DocumentRoot of /var/obj/conf/server/web and provides basic authentication to files that match install.cgi.

You must set a a password for this user that can view install.cgi. Running

# htpasswd -c /etc/httpd/.htpasswd lcfgng

will allow you to set a password for a user lcfgng.

htpasswd is part of the apache package.

Compile Profiles

/sbin/service mkxprofd start
/sbin/chkconfig --levels 345 mkxprofd on

To actually compile the profiles

/sbin/service mkxprofd reload

can be issued.

Touching the files in /var/obj/conf/server/source/ and reloading mkxprofd will force a recompile your profiles.

To check the status of your profile compilations vist. http://yourLCFGserver.nowhere.org/status/.

NFS

/opt/local/linux/ *.gridpp.rl.ac.uk(ro,no_root_squash)

DHCP

deny unknown-clients;
# the server will not reply to the unknown clients; in this way
# it is possible to have a second DHCP server on your subnet
not authoritative;
                                                                                
subnet 130.246.184.0 netmask 255.255.252.0 {
                                                                                  

  group {
     option domain-name "gridpp.rl.ac.uk";
     option routers 130.246.184.254;
     option user-class "http://gpplcfg.gridpp.rl.ac.uk/profiles/";
     option domain-name-servers 130.246.8.13, 130.246.72.21, 130.246.56.240;
     filename      "pxelinux.0" ;                                                                      
     next-server   gpplcfg.gridpp.rl.ac.uk;                                                                                 
     host gppse01 {
         hardware ethernet   00:03:47:97:cb:d2;
         fixed-address gppse01.gridpp.rl.ac.uk;
     }
                                                                                
     host dev06 {
         hardware ethernet 00:03:47:97:c9:95;
         fixed-address dev06.gridpp.rl.ac.uk;
     }

}

In this example this is for installing gppse01 and dev06 using the lcfgng server, gpplcfg.gridpp.rl.ac.uk on a RAL network.

The "pxelinux.0" loader file must be placed on the lcfgng server in /tftpboot.

• cp /usr/lib/syslinux/pxelinux.0 /tftpboot

Install Nodes

Floppy

dd if=bootdisk_rh73_22112002.img of=/dev/fd0 bs=1024

Put this in your LCFGng client and boot from this floppy.

PXE

service tftp
{
        socket_type             = dgram
        protocol                = udp
        wait                    = yes
        user                    = root
        server                  = /usr/sbin/in.tftpd
        server_args             = -s /tftpboot -v
        disable                 = no
        per_source              = 11
        cps                     = 100 2
}

with disable = no.

Visit http://yourlcfgserver/install/install.cgi providing the username(lcfgng) and password you entered earlier. You can now select a kernel to load via PXE rather than just booting by default from the hard disk.

You should modify your client' boot order in the bios to be.

1. Floppy
2. Network
3. Harddisk.

Now reboot the client. At the end of the install a cgi script on the web server is called to change the clients pxe configuration to again boot from the hard disk.

Post Installation

Host Certificates

• chmod 400 hostkey.pem
• chmod 444 hostcert.pem

Supporting the gridpp VO

group ldap://vo.gridpp.ac.uk/ou=testbed,dc=gridpp,dc=ac,dc=uk .gridpp

• /opt/edg/sbin/edg-mkgridmap --conf /opt/edg/etc/edg-mkgridmap.conf --output /share/grid-security/grid-mapfile

Setting up PBS Queues and Nodes

• cd /var/spool/pbs
• edit pbs_environment and add /usr/sbin to the PATH
• /usr/bin/qmgr < my_qmgr.conf
• /usr/bin/qmgr < my_nodes.conf

Summary