Storm Install

NOTE: This document was written in 2009, and documents the install of an old version of StoRM. It contains some useful tips, but please rely on the official documentation and StoRM

This documents an install of StoRM at Edinburgh. Please also consult official documentation as well as INFNGRID generic glite guide. The Edinburgh system has yet to be fully tested so these instructions and configuration are provisional.

Install using YUM

cd /etc/yum.repos.d/
wget http://grid-it.cnaf.infn.it/mrepo/repos/glite-generic.repo
wget http://grid-it.cnaf.infn.it/mrepo/repos/lcg-ca.repo
wget http://grid-it.cnaf.infn.it/mrepo/repos/ig.repo

enable 
/etc/yum.repos.d/dag.repo 

yum install lcg-CA
yum install ig_SE_storm_backend 
yum install ig_SE_storm_frontend

Java issues

You may well get an error of the form

Error: Missing Dependency: jdk = 2000:1.6.0_13-fcs is needed by ...

Even if you think you have the correct jdk/ java packages.

In order to get around this there are some instructions here

I found option 2 to be effective by uninstalling all existing java packages, downloading the relevant jdk version from the SUN website and then installing java and

yum localinstall jdk-6u13-linux-i586.rpm
yum install ig_SE_storm_backend java-1.6.0-sun-compat

Configure using YAIM

Install certificates hostkey.pem and hostcert.pem in /etc/grid-security

Site Info

Edit siteinfo.def file In addition to standard files such as wn-list , users and groups set these variables

STORM_HOST=se2.glite.$MY_DOMAIN
STORM_PORT=8444
STORM_USER=storm
STORM_DB_USER=storm
STORM_DB_PWD=XXXXXXXX
STORM_DB_HOST=localhost
STORM_DEFAULT_ROOT=/storage
STORM_AUTH_POLICY=permit
VOS="ops dteam lhcb atlas ilc pheno vo.scotgrid.ac.uk biomed hone cms" 
STORM_AP_LIST=$VOS
STORM_STORAGEAREA_LIST=$VOS

For each VO (as well as the standard SW_DIR and VOMSES) set

STORM_ATLAS_VONAME=atlas
STORM_DTEAM_VONAME=dteam
STORM_OPS_VONAME=ops

For each spacetoken set

STORM_ATLASDATADISK_VONAME=atlas
STORM_ATLASDATADISK_ACCESSPOINT=/atlas/atlasdatadisk
STORM_ATLASDATADISK_ROOT=$STORM_DEFAULT_ROOT/atlas/atlasdatadisk
STORM_ATLASDATADISK_TOKEN=ATLASDATADISK

ALL_VOMS_VOS=$VOS
SE_LIST="$STORM_HOST" # "$DPM_HOST"
SE_ARCH="multidisk" # "disk, tape, multidisk, other"

I also found I had to set the following variables to please yaim. If you don't set NTP_HOSTS to a valid IP then it will overwrite the ntp.conf with a blank file and clocks will skew.

NTP_HOSTS_IP
HOST_SW_DIR

as well as

BDII_HOST
SITE_BDII_HOST

I also had to edit

/opt/glite/yaim/functions/local/config_edgusers

to set

home=/home

before the test

if [ "x$home" = "x" ]; then

Then run yaim

/opt/glite/yaim/bin/ig_yaim -c -s siteinfo/site-info.def -n ig_SE_storm_backend -n ig_SE_storm_frontend

Configuration files

Backend

Backend is started with

/sbin/service storm-backend start

There are two config files

/opt/storm/backend/etc/storm.properties

and

/opt/storm/backend/etc/namespace.xml 

Frontend

/sbin/service storm-frontend start

Configuration in

/opt/storm/frontend/etc/storm-frontend.conf

Adding Cluster Filesystems

One of the key advantages of StoRM is that it supports cluster filesystems such as Lustre and GPFS.

GPFS

The Storm_GPFS_Install guide outlines some instructions for setting up GPFS filesystems at a site and enabling this to be seen by StoRM.

Lustre

Chris Walker's talk at hepsysman outlines some of QMUL experiences and the performance seen using StoRM and Lustre.