GridSeed: working notes

GridSeed testbed

The GridSeed main testbed is currently installed at SISSA/Democritos. It consists of several VMs running on hosts:

neon.hpc.sissa.it
gridseed07.env
gridseed08.env
gridseed09.env
gridseed10.env
gridseed11.env

All VMs are currently run and managed with VirtualBox (which see).

GridSeed VMs (up and running)

As of 2010-02-02, the following hosts are up and running:

HostRoleIPHostLocation
masterhosts central network services10.10.0.1neon/root/.VirtualBox/Machines/master/master.xml
caCA repository and web interfacealias for master  
voms"gridseed" VO VOMS serveralias for master  
myproxyMyProxy server (gLite PX node)alias for master  
dhcpDHCP serveralias for master  
dnsDNS serveralias for master  
gatewayrouter/gatewayalias for master  
central-1hosts Grid central services10.10.0.2gridseed07/vmware/central-1/central-1.xml
bdiigLite site-BDII(?)alias for central-1  
top-bdiigLite top-BDII instancealias for central-1  
top-lfc"central" LFC serveralias for central-1  
lfc"local" LFC serveralias for central-1  
wmsgLite WMS10.10.0.3gridseed07/vmware/wms/wms.xml
ce-1lcg-CE and TORQUE server10.10.1.254gridseed09/vmware/ce-1/ce-1.xml
ce-1wn1gLite WN for ce-110.10.1.1gridseed09/vmware/ce-1wn1/ce-1wn1.xml
ce-1wn2gLite WN for ce-110.10.1.2gridseed09/vmware/ce-1wn2/ce-1wn2.xml
se-1StoRM SRM server10.10.1.253gridseed08/vmware/se-1/se-1.xml
ce-2CREAM-CE and TORQUE server10.10.2.254gridseed10/vmware/ce-2/ce-2/ce-2.xml
ce-2wn1WN for ce-210.10.2.1gridseed10/vmware/ce-2wn1/ce-2wn1.xml
se-2DPM SRM server10.10.2.253gridseed10/vmware/se-2/vbox.xml
arc-ceARC 0.8.x front-end10.10.0.82gridseed08/vmware/arc-ce.xml
ui-1gLite + ARC UI10.10.0.21gridseed08/vmware/ui-1/ui-1.xml

GridSeed VMs (off)

Some other virtual machines exists, but not running ATM:

HostRoleIPHostLocation
nagiosEGEE SA1 Nagios server10.10.0.9neon/vmware/nagios/nagios.vmx
nagios-ui???(not registered in DNS)gridseed07/vmware/nagios-ui/nagios-ui.vmx
ce-3lcg-CE and TORQUE server10.10.3.254gridseed11/vmware/ce-3/ce-3.vmx
testfresh SL4 installation(?)10.10.0.254gridseed10/vmware/test/vbox.xml
templateclean-up SL4.x installation10.10.255.254gridseed10/vmware/template/vbox.xml

More hosts are registered in the DNS than actually deployed as VMs.

Template VMs (off)

These VMs should be copied to add a new node to GRIDSEED; instructions to do so are in the NewHost page.

HostRoleIPHostLocation
centos5fresh CentOS5 install10.10.0.253neon/vmware/centos5/
testfresh SL4 installation(?)10.10.0.254gridseed10/vmware/test/vbox.xml
templateclean-up SL4.x installation10.10.255.254gridseed10/vmware/template/vbox.xml

Questions/FIXME's

  • what's the difference between lfc and top-lfc? As far as I know, you cannot run two separate LFC instances on one host
  • why are some Grid services running on master and some on central-1?

How to...

Connect to the testbed

Complete instructions can be found at: http://doc.escience-lab.org/index.php/Main/SSHtunnel

The procedure of connectiong to neon can be almost automated with the following one-liner::

alias neon='nc -z localhost 2222 || (ssh democritos.sissa.it -N -L 2222:neon.hpc.sissa.it:22 & \
sleep 4); ssh localhost -t -p 2222 -X'

Connecting directly to master can also be automated with a one-liner::

alias master='nc -z localhost 2222 || (ssh democritos.sissa.it -N -L 2222:neon.hpc.sissa.it:22 & \
sleep 4); ssh localhost -t -p 2222 -X ssh root@master -X'

List all machines currently registered in DNS

On any GridSeed machine, run the command::

  host -t AXFR grid.seed

More hosts are registered in the DNS than actually deployed as VMs, so this command will return a lot of unused usernames.

List all VMs installed, and their running status

The location and status of all GridSeed VMs can be printed with the script::

  /opt/gridseed/bin/list-VM

Here is a sample output::

--------- neon ---------
running         master
************************* gridseedenv *************************
--------- gridseed07---------
running         central-1
running         wms
--------- gridseed08---------
running         se-1
running         ui-1
--------- gridseed09---------
running         ce-1wn2
running         ce-1wn1
running         ce-1
running         ui-2
--------- gridseed10---------
running         se-2
running         ce-2wn1
off             test
off             template
running         ce-2
--------- gridseed11---------
running         arc_ce
off             ce-3

List all DNS names currently _up_

On any GridSeed machine, run the command::

  host -t AXFR grid.seed \
       | cut -d. -f1 \
       | grep '^[a-z]' \
       | (while read host;
                do ping -c 1 -W 1 $host >/dev/null && echo $host;
         done)