Difference between revisions of "Storm Install"
(No difference)
|
Latest revision as of 17:25, 14 April 2012
NOTE: This document was written in 2009, and documents the install of an old version of StoRM. It contains some useful tips, but please rely on the official documentation and StoRM
This documents an install of StoRM at Edinburgh. Please also consult official documentation as well as INFNGRID generic glite guide. The Edinburgh system has yet to be fully tested so these instructions and configuration are provisional.
Contents
Install using YUM
cd /etc/yum.repos.d/ wget http://grid-it.cnaf.infn.it/mrepo/repos/glite-generic.repo wget http://grid-it.cnaf.infn.it/mrepo/repos/lcg-ca.repo wget http://grid-it.cnaf.infn.it/mrepo/repos/ig.repo
enable /etc/yum.repos.d/dag.repo
yum install lcg-CA yum install ig_SE_storm_backend yum install ig_SE_storm_frontend
Java issues
You may well get an error of the form
Error: Missing Dependency: jdk = 2000:1.6.0_13-fcs is needed by ...
Even if you think you have the correct jdk/ java packages.
In order to get around this there are some instructions here
I found option 2 to be effective by uninstalling all existing java packages, downloading the relevant jdk version from the SUN website and then installing java and
yum localinstall jdk-6u13-linux-i586.rpm yum install ig_SE_storm_backend java-1.6.0-sun-compat
Configure using YAIM
Install certificates hostkey.pem and hostcert.pem in /etc/grid-security
Site Info
Edit siteinfo.def file In addition to standard files such as wn-list , users and groups set these variables
STORM_HOST=se2.glite.$MY_DOMAIN STORM_PORT=8444 STORM_USER=storm STORM_DB_USER=storm STORM_DB_PWD=XXXXXXXX STORM_DB_HOST=localhost STORM_DEFAULT_ROOT=/storage STORM_AUTH_POLICY=permit VOS="ops dteam lhcb atlas ilc pheno vo.scotgrid.ac.uk biomed hone cms" STORM_AP_LIST=$VOS STORM_STORAGEAREA_LIST=$VOS
For each VO (as well as the standard SW_DIR and VOMSES) set
STORM_ATLAS_VONAME=atlas STORM_DTEAM_VONAME=dteam STORM_OPS_VONAME=ops
For each spacetoken set
STORM_ATLASDATADISK_VONAME=atlas STORM_ATLASDATADISK_ACCESSPOINT=/atlas/atlasdatadisk STORM_ATLASDATADISK_ROOT=$STORM_DEFAULT_ROOT/atlas/atlasdatadisk STORM_ATLASDATADISK_TOKEN=ATLASDATADISK
ALL_VOMS_VOS=$VOS SE_LIST="$STORM_HOST" # "$DPM_HOST" SE_ARCH="multidisk" # "disk, tape, multidisk, other"
I also found I had to set the following variables to please yaim. If you don't set NTP_HOSTS to a valid IP then it will overwrite the ntp.conf with a blank file and clocks will skew.
NTP_HOSTS_IP HOST_SW_DIR
as well as
BDII_HOST SITE_BDII_HOST
I also had to edit
/opt/glite/yaim/functions/local/config_edgusers
to set
home=/home
before the test
if [ "x$home" = "x" ]; then
Then run yaim
/opt/glite/yaim/bin/ig_yaim -c -s siteinfo/site-info.def -n ig_SE_storm_backend -n ig_SE_storm_frontend
Configuration files
Backend
Backend is started with
/sbin/service storm-backend start
There are two config files
/opt/storm/backend/etc/storm.properties
and
/opt/storm/backend/etc/namespace.xml
Frontend
/sbin/service storm-frontend start
Configuration in
/opt/storm/frontend/etc/storm-frontend.conf
Adding Cluster Filesystems
One of the key advantages of StoRM is that it supports cluster filesystems such as Lustre and GPFS.
GPFS
The Storm_GPFS_Install guide outlines some instructions for setting up GPFS filesystems at a site and enabling this to be seen by StoRM.
Lustre
Chris Walker's talk at hepsysman outlines some of QMUL experiences and the performance seen using StoRM and Lustre.