Difference between revisions of "GridPP5 Tier2 plans"

From GridPP Wiki
Jump to: navigation, search
Line 32: Line 32:
 
|-
 
|-
 
|UKI-LT2-Brunel
 
|UKI-LT2-Brunel
−
|<span style="color:green">Arc/Condor</span>
+
|.
−
|<span style="color:green">ArcCE info system </span>
+
|.
−
|<span style="color:green">Spark cluster in test</span>
+
|.
−
|<span style="color:green">Arc</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:black">-</span>
+
|.
 
|
 
|
 
   
 
   
 
|-
 
|-
 
|UKI-LT2-IC-HEP
 
|UKI-LT2-IC-HEP
−
|<span style="color:green">Gridengine (local)</span>
+
|.
−
|<span style="color:green">None</span>
+
|.
−
|<span style="color:green">No reason</span>
+
|.
−
|<span style="color:green">CREAM, ARC</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:black">No</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:black">-</span>
+
|.
 
|
 
|
  
Line 57: Line 57:
 
|-
 
|-
 
|UKI-LT2-QMUL
 
|UKI-LT2-QMUL
−
|<span style="color:green">Gridengine / SLURM </span>
+
|.
−
|<span style="color:green">SLURM does support MaxCPUTime for queues but it's complicated</span>
+
|.
−
|<span style="color:green">SLURM</span>
+
|.
−
|<span style="color:green">CREAM</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:black">Yes (SLURM)/ No (Gridengine) </span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:black">-</span>
+
|.
 
|
 
|
  
 
|-
 
|-
 
|UKI-LT2-RHUL
 
|UKI-LT2-RHUL
−
||<span style="color:green">Torque/Maui (local)</span>
+
|.
−
|<span style="color:green">Torque/Maui support non-existent</span>
+
|.
−
|<span style="color:green">Will follow the consensus</span>
+
|.
−
|<span style="color:green">CREAM</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:black">No</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:black">-</span>
+
|.
 
|
 
|
  
Line 82: Line 82:
 
|-
 
|-
 
|UKI-NORTHGRID-LANCS-HEP
 
|UKI-NORTHGRID-LANCS-HEP
−
||<span style="color:green">Son of Gridengine (HEC)</span>
+
|.
−
|<span style="color:green">Torque/Maui clusterDecommissioned, for for grid and local (tier 3)</span>
+
|.
−
|<span style="color:green">Sticking with grid engine</span>
+
|.
−
|<span style="color:green">CREAM, moving to ARC eventually</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:red">No</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:black">-</span>
+
|.
 
|
 
|
  
 
|-
 
|-
 
|UKI-NORTHGRID-LIV-HEP </span>
 
|UKI-NORTHGRID-LIV-HEP </span>
−
|<span style="color:green">Torque Maui (local)</span>
+
|.
−
|<span style="color:green">Poor Support, Maui intrinsically broken</span>
+
|.
−
|<span style="color:green"> </span>
+
|.
−
|<span style="color:green">Cream</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:black">No</span>
+
|.
−
|<span style="color:green">No</span>
+
|.
−
|<span style="color:black">-</span>
+
|.
 
|
 
|
  
 
|-
 
|-
 
|UKI-NORTHGRID-MAN-HEP
 
|UKI-NORTHGRID-MAN-HEP
−
|<span style="color:green">Torque/Maui (local)</span>
+
|.
−
|<span style="color:green">Maui is unsupported. It had memory leaks. Robert wrote a patch and there was nowhere to feed it back into.</span>
+
|.
−
|<span style="color:green">HTCondor</span>
+
|.
−
|<span style="color:green">Currently CREAM, testing ARC-CE/HTCondor</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:orange">Looking into it</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:green">Pass</span>
+
|.
 
|
 
|
  
Line 119: Line 119:
 
|-
 
|-
 
|UKI-NORTHGRID-SHEF-HEP
 
|UKI-NORTHGRID-SHEF-HEP
−
|<span style="color:green">Torque/Maui (local)</span>
+
|.
−
|<span style="color:green">Torque/Maui support non-existent</span>
+
|.
−
|<span style="color:green">HTCondor is in testing mode</span>
+
|.
−
|<span style="color:green">CREAM CE, ACR CE is in test</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:black">No</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:black">-</span>
+
|.
 
|
 
|
  
Line 132: Line 132:
 
|-
 
|-
 
|UKI-SCOTGRID-DURHAM
 
|UKI-SCOTGRID-DURHAM
−
|<span style="color:green">SLURM (local)</span>
+
|.
−
|<span style="color:green"></span>
+
|.
−
|<span style="color:green">No reason</span>
+
|.
−
|<span style="color:green">ARC CE</span>
+
|.
−
|<span style="color:green"></span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:black">-</span>
+
|.
 
|
 
|
  
Line 145: Line 145:
 
|-
 
|-
 
|UKI-SCOTGRID-ECDF
 
|UKI-SCOTGRID-ECDF
−
|<span style="color:green">Gridengine</span>
+
|.
−
|<span style="color:green">None</span>
+
|.
−
|<span style="color:green">No reason</span>
+
|.
−
|<span style="color:green">Cream CE for standard production, ARC CE for exploratory HPC work</span>
+
|.
−
|<span style="color:green"></span>
+
|.
−
|<span style="color:black">No</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:black">-</span>
+
|.
 
|
 
|
  
Line 158: Line 158:
 
|-
 
|-
 
|UKI-SCOTGRID-GLASGOW
 
|UKI-SCOTGRID-GLASGOW
−
|<span style="color:green"> HTcondor (local), Torque/Maui (local)</span>
+
|.
−
|<span style="color:green">Becomes unresponsive at times of high load or nodes being un-contactable.</span>
+
|.
−
|<span style="color:green">Investigating HTCondor/SoGE/SLURM as a replacement.</span>
+
|.
−
|<span style="color:green">ARC, Cream</span>
+
|.
−
|<span style="color:green"></span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:black">-</span>
+
|.
 
|
 
|
  
 
|-
 
|-
 
|UKI-SOUTHGRID-BHAM-HEP
 
|UKI-SOUTHGRID-BHAM-HEP
−
||<span style="color:green">Torque/Maui</span>
+
||.
−
|<span style="color:green">Maui sometimes fails to see new jobs and so nothing is scheduled</span>
+
|.
−
|<span style="color:green">HTCondor</span>
+
|.
−
|<span style="color:green">CREAM</span>
+
|.
−
|<span style="color:green"></span>
+
|.
−
|<span style="color:black">No</span>
+
|.
−
|<span style="color:green">No</span>
+
|.
−
|<span style="color:black">-</span>
+
|.
 
|
 
|
  
Line 183: Line 183:
 
|-
 
|-
 
|UKI-SOUTHGRID-BRIS
 
|UKI-SOUTHGRID-BRIS
−
|<span style="color:green">HTCondor (shared)</span>
+
|.
−
|<span style="color:green">None</span>
+
|.
−
|<span style="color:green">No reason</span>
+
|.
−
|<span style="color:green">ARC-CE, abandoned plan to move to HTCondor CE(no accounting)</span>
+
|.
−
|<span style="color:yellow">On roadmap</span>
+
|.
−
|<span style="color:black">No</span>
+
|.
−
|<span style="color:green">No</span>
+
|.
−
|<span style="color:black">-</span>
+
|.
 
|
 
|
  
Line 196: Line 196:
 
|-
 
|-
 
|UKI-SOUTHGRID-CAM-HEP
 
|UKI-SOUTHGRID-CAM-HEP
−
|<span style="color:green">Torque/Maui (local)</span>
+
|.
−
|<span style="color:green">Torque/Maui support non-existent</span>
+
|.
−
|<span style="color:green">Will follow the consensus</span>
+
|.
−
|<span style="color:green">CREAM CE</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:black">No</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:green">Pass</span>
+
|.
 
|
 
|
  
 
|-
 
|-
 
|UKI-SOUTHGRID-OX-HEP
 
|UKI-SOUTHGRID-OX-HEP
−
|<span style="color:green">HTCondor (local)</span>
+
|.
−
|<span style="color:green">None</span>
+
|.
−
|<span style="color:green">No reason</span>
+
|.
−
|<span style="color:green">ARC CE in production</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:black">-</span>
+
|.
 
|
 
|
  
Line 221: Line 221:
 
|-
 
|-
 
|UKI-SOUTHGRID-RALPP
 
|UKI-SOUTHGRID-RALPP
−
|<span style="color:green">HTCondor</span>
+
|.
−
|<span style="color:green">None</span>
+
|.
−
|<span style="color:green">No reason</span>
+
|.
−
|<span style="color:green">ARC CE</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:orange">Warn</span>
+
|.
 
|
 
|
  
Line 234: Line 234:
 
|-
 
|-
 
|UKI-SOUTHGRID-SUSX
 
|UKI-SOUTHGRID-SUSX
−
|<span style="color:green">(Shared) Gridengine - (Univa Grid Engine)</span>
+
|.
−
|<span style="color:green">None</span>
+
|.
−
|<span style="color:green">No reason</span>
+
|.
−
|<span style="color:green">CREAMCE</span>
+
|.
−
|<span style="color:green"></span>
+
|.
−
|<span style="color:orange">Looking into it</span>
+
|.
−
|<span style="color:green">Yes</span>
+
|.
−
|<span style="color:black">-</span>
+
|.
 
|
 
|
  

Revision as of 10:16, 14 March 2017

Other links

Sites batch system status

This page has been setup to collect information from GridPP sites regarding their batch systems in February 2014. The information will help with wider considerations and strategy. The table seeks the following:

  1. Site name
  2. Batch/CE system (the main batch system and CE you are intending to use in GridPP5. This might be one that you are testing as a replacement for, say, Torque/CREAM)
  3. Shared, non-CE? (Is the batch system shared with users who don’t access it through the grid CE?)
  4. Shared filesystem? (Do users rely on a shared filesystem? e.g. Lustre. i.e. that couldn’t be replaced with local filesystems on worker nodes.)
  5. Non-LHC, non GridPP DIRAC VOs? (Do you support VOs, e.g. from EGI, that aren’t LHC experiments or use the GridPP DIRAC service. Please list the top 3.)
  6. Non-LHC storage? (Do you provide storage to non-LHC projects? Please list the top 3.)


Site Batch/CE system Shared, non-CE? Shared filesystem? Non-LHC, non GridPP DIRAC VOs? Non-LHC storage? . . . Notes
UKI-LT2-Brunel . . . . . . . .
UKI-LT2-IC-HEP . . . . . . . .


UKI-LT2-QMUL . . . . . . . .
UKI-LT2-RHUL . . . . . . . .


UKI-NORTHGRID-LANCS-HEP . . . . . . . .
UKI-NORTHGRID-LIV-HEP </span> . . . . . . . .
UKI-NORTHGRID-MAN-HEP . . . . . . . .


UKI-NORTHGRID-SHEF-HEP . . . . . . . .


UKI-SCOTGRID-DURHAM . . . . . . . .


UKI-SCOTGRID-ECDF . . . . . . . .


UKI-SCOTGRID-GLASGOW . . . . . . . .
UKI-SOUTHGRID-BHAM-HEP . . . . . . . .


UKI-SOUTHGRID-BRIS . . . . . . . .


UKI-SOUTHGRID-CAM-HEP . . . . . . . .
UKI-SOUTHGRID-OX-HEP . . . . . . . .


UKI-SOUTHGRID-RALPP . . . . . . . .


UKI-SOUTHGRID-SUSX . . . . . . . .


Retrieved from "https://www.gridpp.ac.uk/w/index.php?title=GridPP5_Tier2_plans&oldid=13788"