Difference between revisions of "RALnonLHCCVMFS"

From GridPP Wiki
Jump to: navigation, search
m
(List of hosted repositories updated)
 
Line 4: Line 4:
  
  
RAL Tier-1 is currently hosting CernVM-FS Stratum-0 repositories for 14 non-LHC VOs (<code>auger, biomed, cernatschool.org, glast.org, hone, hyperk.org, km3net.org, mice, na62.vo.gridpp.ac.uk, pheno, phys.vo.ibergrid.eu, snoplus.snolab.ca, t2k.org, enmr.eu</code>).
+
RAL Tier-1 is currently maintaining two CernVM-FS domains (<code>egi.eu</code> and <code>gridpp.ac.uk</code>) that include 24 CernVM-FS Stratum-0 repositories for non-LHC VOs and projects (<code>auger, biomed, cernatschool.org, chipster.csc.fi, dirac, galdyn, comet.j-parc.jp, glast.org, hyperk.org, km3net.org, ligo, vo.londongrid.ac.uk, lucid, mice, na62.vo.gridpp.ac.uk, vo.northgrid.ac.uk, pheno, phys.vo.ibergrid.eu, vo.scotgrid.ac.uk, snoplus.snolab.ca, vo.southgrid.ac.uk, t2k.org, enmr.eu</code>).
  
 
The Stratum-0 v2.1 repositories are replicated by dedicated EGI CernVM-FS Stratum-1 servers located at RAL, NIKHEF, ASGC and TRIUMF.
 
The Stratum-0 v2.1 repositories are replicated by dedicated EGI CernVM-FS Stratum-1 servers located at RAL, NIKHEF, ASGC and TRIUMF.
  
At the moment (1 Nov 2014) the repositories hosted at RAL are published under two identical CernVM-FS spaces i.e. <code>/cvmfs/<repo_name>.gridpp.ac.uk</code> and <code>/cvmfs/<repo_name>.egi.eu</code>. Similarly the Stratum-1 services (except TRIUMF) are replicating both <code>gridpp.ac.uk</code> and <code>egi.eu</code> domains. The plan is to retire the <code>gridpp.ac.uk</code> domain by very early 2015.
+
<!-- At the moment (1 August 2015) the repositories hosted at RAL are published under two identical CernVM-FS spaces i.e. <code>/cvmfs/<repo_name>.gridpp.ac.uk</code> and <code>/cvmfs/<repo_name>.egi.eu</code>. Similarly the Stratum-1 services (except TRIUMF) are replicating both <code>gridpp.ac.uk</code> and <code>egi.eu</code> domains. The plan is to retire the <code>gridpp.ac.uk</code> domain by very early 2015.
 +
-->
  
 
The following instructions will refer to configuration under <code>egi.eu</code> CernVM-FS domain.
 
The following instructions will refer to configuration under <code>egi.eu</code> CernVM-FS domain.
Line 39: Line 40:
 
<pre>
 
<pre>
 
VO_CERNATSCHOOL_ORG_SW_DIR=/cvmfs/cernatschool.egi.eu
 
VO_CERNATSCHOOL_ORG_SW_DIR=/cvmfs/cernatschool.egi.eu
 +
</pre>
 +
 +
- for <code>comet.j-parc.jp</code> users/jobs
 +
<pre>
 +
VO_COMET_J-PARC_JP_SW_DIR=/cvmfs/comet.egi.eu
 
</pre>
 
</pre>
  
Line 89: Line 95:
 
<pre>
 
<pre>
 
VO_ENMR_EU_SW_DIR=/cvmfs/wenmr.egi.eu
 
VO_ENMR_EU_SW_DIR=/cvmfs/wenmr.egi.eu
 +
</pre>
 +
 +
- for <code>vo.northgrid.ac.uk</code> users/jobs
 +
<pre>
 +
VO_VO_NORTHGRID_AC_UK_SW_DIR=/cvmfs/northgrid.gridpp.ac.uk
 +
</pre>
 +
 +
- for <code>vo.southgrid.ac.uk</code> users/jobs
 +
<pre>
 +
VO_VO_SOUTHGRID_AC_UK_SW_DIR=/cvmfs/southgrid.gridpp.ac.uk
 +
</pre>
 +
 +
- for <code>vo.londongrid.ac.uk</code> users/jobs
 +
<pre>
 +
VO_VO_LONDONGRID_AC_UK_SW_DIR=/cvmfs/londongrid.gridpp.ac.uk
 +
</pre>
 +
 +
- for <code>vo.scotgrid.ac.uk</code> users/jobs
 +
<pre>
 +
VO_VO_SCOTGRID_AC_UK_SW_DIR=/cvmfs/scotgrid.gridpp.ac.uk
 
</pre>
 
</pre>

Latest revision as of 14:30, 6 August 2015

CernVM-FS Stratum-0 for non-LHC VOs

Note: Old page (mainly related to gridpp.ac.uk CernVM-FS domain) can be found here ([1]).


RAL Tier-1 is currently maintaining two CernVM-FS domains (egi.eu and gridpp.ac.uk) that include 24 CernVM-FS Stratum-0 repositories for non-LHC VOs and projects (auger, biomed, cernatschool.org, chipster.csc.fi, dirac, galdyn, comet.j-parc.jp, glast.org, hyperk.org, km3net.org, ligo, vo.londongrid.ac.uk, lucid, mice, na62.vo.gridpp.ac.uk, vo.northgrid.ac.uk, pheno, phys.vo.ibergrid.eu, vo.scotgrid.ac.uk, snoplus.snolab.ca, vo.southgrid.ac.uk, t2k.org, enmr.eu).

The Stratum-0 v2.1 repositories are replicated by dedicated EGI CernVM-FS Stratum-1 servers located at RAL, NIKHEF, ASGC and TRIUMF.


The following instructions will refer to configuration under egi.eu CernVM-FS domain.

Setting up a site to access small VOs CernVM-FS repositories located at RAL

Assuming that your site is already supporting CernVM-FS (client v2.1.X) for LHC VOs, one only needs to update / install the cvmfs-keys package to the version 1.5-1 ([2]) on the worker nodes. This package adds the public keys and Stratum-1 server addresses for the egi.eu and opensciencegrid.org domains (no changes for the *.cern.ch repositories).

In addition, one must specify in /etc/cvmfs/default.local the names of the local site squids:

CVMFS_HTTP_PROXY="http://first.squid.domain:3128;http://second.squid.domain:3128"

The last requirement is that the site local squid(s) are configured to use the Stratum-1 servers at RAL, NIKHEF, ASGC and TRIUMF (see /etc/cvmfs/domain.d/egi.eu.conf for the server names).

Also do not forget to define the following environment variables on the batch farm (Note - you need to define them only if your site supports the specific VO):

- for auger users/jobs

VO_AUGER_SW_DIR=/cvmfs/auger.egi.eu

- for biomed users/jobs

VO_BIOMED_SW_DIR=/cvmfs/biomed.egi.eu

- for cernatschool.org users/jobs

VO_CERNATSCHOOL_ORG_SW_DIR=/cvmfs/cernatschool.egi.eu

- for comet.j-parc.jp users/jobs

VO_COMET_J-PARC_JP_SW_DIR=/cvmfs/comet.egi.eu

- for glast.org users/jobs

VO_GLAST_ORG_SW_DIR=/cvmfs/glast.egi.eu

- for hyperk.org users/jobs

VO_HYPERK_ORG_SW_DIR=/cvmfs/hyperk.egi.eu

- for km3net.org users/jobs

VO_KM3NET_ORG_SW_DIR=/cvmfs/km3net.egi.eu

- for mice users/jobs

VO_MICE_SW_DIR=/cvmfs/mice.egi.eu

- for na62 users/jobs

VO_NA62_VO_GRIDPP_AC_UK_SW_DIR=/cvmfs/na62.egi.eu

- for pheno users/jobs

VO_PHENO_SW_DIR=/cvmfs/pheno.egi.eu

- for phys.vo.ibergrid.eu users/jobs

VO_PHYS_VO_IBERGRID_EU_SW_DIR=/cvmfs/phys-ibergrid.egi.eu

- for snoplus.snolab.ca users/jobs

VO_SNOPLUS_SNOLAB_CA_SW_DIR=/cvmfs/snoplus.egi.eu

- for t2k.org users/jobs

VO_T2K_ORG_SW_DIR=/cvmfs/t2k.egi.eu

- for enmr.eu users/jobs

VO_ENMR_EU_SW_DIR=/cvmfs/wenmr.egi.eu

- for vo.northgrid.ac.uk users/jobs

VO_VO_NORTHGRID_AC_UK_SW_DIR=/cvmfs/northgrid.gridpp.ac.uk

- for vo.southgrid.ac.uk users/jobs

VO_VO_SOUTHGRID_AC_UK_SW_DIR=/cvmfs/southgrid.gridpp.ac.uk

- for vo.londongrid.ac.uk users/jobs

VO_VO_LONDONGRID_AC_UK_SW_DIR=/cvmfs/londongrid.gridpp.ac.uk

- for vo.scotgrid.ac.uk users/jobs

VO_VO_SCOTGRID_AC_UK_SW_DIR=/cvmfs/scotgrid.gridpp.ac.uk