Difference between revisions of "Batch system status"

From GridPP Wiki
Jump to: navigation, search
 
(131 intermediate revisions by 22 users not shown)
Line 12: Line 12:
 
# CE type(s) - What CE type (gLite, ARC...) do you currently run and do you plan to change this, perhaps in conjunction with a batch system move?
 
# CE type(s) - What CE type (gLite, ARC...) do you currently run and do you plan to change this, perhaps in conjunction with a batch system move?
 
# glExec/pilot support for all VOs - do you have glExec and pilot pool accounts for all VOs, as opposed to just the LHC VOs? Used for the move to a Dirac WMS.
 
# glExec/pilot support for all VOs - do you have glExec and pilot pool accounts for all VOs, as opposed to just the LHC VOs? Used for the move to a Dirac WMS.
−
# Cloud interface(s)? - Does your site offer access to resources in ways other than via a CE? (See [[Cloud & VM status]] for more up-to-date / detailed information)
 
 
# Multicore status for ATLAS and CMS
 
# Multicore status for ATLAS and CMS
 
## ATLAS [http://tinyurl.com/mclkmfq multicore jobs history for UK sites]  
 
## ATLAS [http://tinyurl.com/mclkmfq multicore jobs history for UK sites]  
 +
# Machine/Job Features (MJF) enabled: - = not started; Fail = failing SAM tests; Warn = warnings from SAM tests; Pass =  passing SAM tests
 
# Notes - Any other information you wish to share on this topic.
 
# Notes - Any other information you wish to share on this topic.
  
−
 
+
See [[Cloud & VM status]] for status of Vac/Cloud deployment by site.
−
 
+
  
 
{|border="1" cellpadding="1"
 
{|border="1" cellpadding="1"
Line 32: Line 31:
 
|cgroups  
 
|cgroups  
 
|Multicore Atlas/CMS
 
|Multicore Atlas/CMS
−
|Cloud interface available/plans
+
|MJF
 +
|CentOS7 WN
 
|Notes
 
|Notes
 +
|Date last reviewed or updated
  
 
|-
 
|-
Line 40: Line 41:
 
|<span style="color:green">None</span>
 
|<span style="color:green">None</span>
 
|<span style="color:green">No reason</span>
 
|<span style="color:green">No reason</span>
−
|<span style="color:green">ARC</span>
+
|<span style="color:green">ARC-CE</span>
−
|<span style="color:green"></span>
+
|<span style="color:green">Yes</span>
 +
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
 +
|<span style="color:green">Pass</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
−
|<span style="color:green">OpenNebula</span>
+
| <span style="color:black">8-Jan-2019</span>
 
|
 
|
−
 
 
|-
 
|-
 
|UKI-LT2-Brunel
 
|UKI-LT2-Brunel
−
|<span style="color:green">Torque/Maui, Arc/Condor</span>
+
|<span style="color:green">HTCondor</span>
−
|<span style="color:green">No support for Torque/Maui</span>
+
|<span style="color:green">ArcCE info system </span>
−
|<span style="color:green">Slurm and HTCondor in test</span>
+
−
|<span style="color:green">Arc in test</span>
+
 
|<span style="color:green"></span>
 
|<span style="color:green"></span>
 +
|<span style="color:green">ARC-CE</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
−
|<span style="color:green">OpenVZ in production, Docker in test</span>
+
|<span style="color:green">Yes</span>
−
|
+
|<span style="color:black">-</span>
 +
|<span style="color:green">Yes</span>
 +
|<span style="color:black">CEs and WNs on C7 since Jan 2018. Storage being moved to C7. All other services on C7</span>
 +
|<span style="color:black">2019-01-22</span>
 +
 
 
   
 
   
 
|-
 
|-
 
|UKI-LT2-IC-HEP
 
|UKI-LT2-IC-HEP
 
|<span style="color:green">Gridengine (local)</span>
 
|<span style="color:green">Gridengine (local)</span>
−
|<span style="color:green">None</span>
+
|<span style="color:green"> </span>
−
|<span style="color:green">No reason</span>
+
|<span style="color:green">ARC-CE</span>
−
|<span style="color:green">CREAM, ARC</span>
+
|<span style="color:green">CREAM, ARC-CE</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:black">No</span>
 
|<span style="color:black">No</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
−
|<span style="color:green">GridPP Cloud Tests</span>
+
|<span style="color:black">-</span>
 +
|<span style="color:green">Yes</span>
 +
|an style="color:green">Yes</span>
 
|
 
|
  
Line 74: Line 81:
 
|-
 
|-
 
|UKI-LT2-QMUL
 
|UKI-LT2-QMUL
−
|<span style="color:green">Gridengine (local)</span>
+
|<span style="color:green">SLURM </span>
−
|<span style="color:green">None</span>
+
|<span style="color:green">SLURM does support MaxCPUTime for queues but it's complicated</span>
−
|<span style="color:green">SLURM</span>
+
|<span style="color:green">SPark and hadoop integration with slurm and lustre</span>
 
|<span style="color:green">CREAM</span>
 
|<span style="color:green">CREAM</span>
 +
|<span style="color:green">Yes</span>
 +
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:black">No</span>
 
|<span style="color:black">No</span>
−
|<span style="color:green">Yes</span>
+
|<span style="color:black">In local testing</span>
−
|<span style="color:green">Deploy cloudstack, find scalable solution to get our storage usable in the cloud</span>
+
|<span style="color:black">GPU and preempt queues also supported on the grid</span>
−
|
+
|<span style="color:black">13-April-18</span>
  
 
|-
 
|-
Line 93: Line 102:
 
|<span style="color:black">No</span>
 
|<span style="color:black">No</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
−
|<span style="color:green"></span>
+
|<span style="color:black">-</span>
−
|
+
|<span style="color:black">Testing</span>
−
 
+
|<span style="color:black">Setting up CC7 ArcCondor cluster</span>
−
 
+
|<span style="color:black">21-Nov-17</span>
−
|-
+
−
|UKI-LT2-UCL-HEP
+
−
||<span style="color:green">Torque/Maui (local)</span>
+
−
|<span style="color:green">Torque/Maui support non-existent</span>
+
−
|<span style="color:green">HTCondor</span>
+
−
|<span style="color:green">CREAM CE</span>
+
−
|<span style="color:green"></span>
+
−
|<span style="color:black">No</span>
+
−
|<span style="color:red">X</span>
+
−
|<span style="color:green"></span>
+
−
|
+
−
 
+
  
 
|-
 
|-
 
|UKI-NORTHGRID-LANCS-HEP
 
|UKI-NORTHGRID-LANCS-HEP
 
||<span style="color:green">Son of Gridengine (HEC)</span>
 
||<span style="color:green">Son of Gridengine (HEC)</span>
−
|<span style="color:green">Torque/Maui clusterDecommissioned, for for grid and local (tier 3)</span>
+
|<span style="color:green"> </span>
−
|<span style="color:green">Sticking with grid engine</span>
+
|<span style="color:green"> </span>
−
|<span style="color:green">CREAM, moving to ARC eventually</span>
+
|<span style="color:green">CREAM, looking at HTCondorCE over ARC now</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:red">No</span>
 
|<span style="color:red">No</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
−
|<span style="color:green">VMWare testing; Vac in production</span>
+
|<span style="color:black">-</span>
−
|
+
|<span style="color:green">Yes</span>
 +
|<span style="color:black">Almost all resources CentOS7, small amount of SL6 for smaller VO use. Singularity deployed (local build)</span>
 +
| 16/10/18
 +
 
 +
 
  
 
|-
 
|-
−
|UKI-NORTHGRID-LIV-HEP <span style="color:blue">(Single core cluster)</span>
+
|UKI-NORTHGRID-LIV-HEP <span style="color:blue"></span>
−
|<span style="color:green">Torque Maui (local)</span>
+
|<span style="color:green">HTCondor/VAC</span>
−
|<span style="color:green">Poor Support, Maui intrinsically broken</span>
+
 
|<span style="color:green"> </span>
 
|<span style="color:green"> </span>
−
|<span style="color:green">Cream</span>
 
−
|<span style="color:green">Yes</span>
 
−
|<span style="color:black">No</span>
 
−
|<span style="color:green">No</span>
 
−
|<span style="color:green">None</span>
 
−
|
 
−
 
−
|-
 
−
|UKI-NORTHGRID-LIV-HEP <span style="color:blue">(Multi core cluster)</span>
 
−
|<span style="color:green">HTCondor (local)</span>
 
−
|<span style="color:green">None</span>
 
 
|<span style="color:green"></span>
 
|<span style="color:green"></span>
−
|<span style="color:green">ARC</span>
+
|<span style="color:green">HTCondor-CE (C7), ARC (C7)</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
−
|<span style="color:orange">Loooking into it</span>
 
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
−
|<span style="color:green">None</span>
+
|<span style="color:green">Yes</span>
−
|
+
|<span style="color:green">Yes</span>
 +
|<span style="color:green">Yes</span>
 +
|<span style="color:black">Move all to HTCondor-CE</span>
 +
|<span style="color:black">12 Feb 2019</span>
  
  
 
|-
 
|-
 
|UKI-NORTHGRID-MAN-HEP
 
|UKI-NORTHGRID-MAN-HEP
−
|<span style="color:green">Torque/Maui (local)</span>
+
|<span style="color:green">HTCondor/VAC<br>(local)</span>
−
|<span style="color:green">Maui is unsupported. It had memory leaks. Robert wrote a patch and there was nowhere to feed it back into.</span>
+
|<span style="color:green"> </span>
−
|<span style="color:green">HTCondor</span>
+
|<span style="color:green"></span>
−
|<span style="color:green">Currently CREAM, investigating ARC-CE</span>
+
|<span style="color:green">ARC-CE/HTCondor</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
−
|<span style="color:orange">Looking into it</span>
 
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
−
|<span style="color:green">Vac in production</span>
+
|<span style="color:green">Yes</span>
−
|
+
|<span style="color:green">Pass</span>
−
 
+
|<span style="color:green">Yes</span>
 +
|<span style="color:black"></span>
 +
|<span style="color:black">29/03/2019</span>
  
 
|-
 
|-
Line 164: Line 156:
 
|<span style="color:green">Torque/Maui (local)</span>
 
|<span style="color:green">Torque/Maui (local)</span>
 
|<span style="color:green">Torque/Maui support non-existent</span>
 
|<span style="color:green">Torque/Maui support non-existent</span>
−
|<span style="color:green">HTCondor is in testing mode</span>
+
|<span style="color:green">HTCondor is installed</span>
 
|<span style="color:green">CREAM CE, ACR CE is in test</span>
 
|<span style="color:green">CREAM CE, ACR CE is in test</span>
−
|<span style="color:green"></span>
+
|<span style="color:green">Yes</span>
 
|<span style="color:black">No</span>
 
|<span style="color:black">No</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
−
|<span style="color:green"></span>
+
|<span style="color:green">-</span>
−
|
+
|<span style="color:black">Ongoing work</span>
−
 
+
|<span style="color:green">-</span>
 +
|<span style="color:black">22/01/2019</span>
  
 
|-
 
|-
Line 178: Line 171:
 
|<span style="color:green"></span>
 
|<span style="color:green"></span>
 
|<span style="color:green">No reason</span>
 
|<span style="color:green">No reason</span>
−
|<span style="color:green">ARC CE</span>
+
|<span style="color:green">ARC-CE</span>
−
|<span style="color:green"></span>
+
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
−
|<span style="color:green">N/A</span>
+
|<span style="color:green">Yes</span>
 +
|<span style="color:black">-</span>
 +
|<span style="color:black">Ongoing Testing</span>
 +
|<span style="color:black">CentOS7 WNs are being tested locally prior to complete rollout.</span>
 
|
 
|
−
 
  
 
|-
 
|-
 
|UKI-SCOTGRID-ECDF
 
|UKI-SCOTGRID-ECDF
 
|<span style="color:green">Gridengine</span>
 
|<span style="color:green">Gridengine</span>
−
|<span style="color:green">None</span>
+
|<span style="color:green"> </span>
−
|<span style="color:green">No reason</span>
+
|<span style="color:green"> </span>
−
|<span style="color:green">Cream CE for standard production, ARC CE for exploratory HPC work</span>
+
|<span style="color:green">ARC-CE</span>
 
|<span style="color:green"></span>
 
|<span style="color:green"></span>
 
|<span style="color:black">No</span>
 
|<span style="color:black">No</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
−
|<span style="color:green"></span>
+
|<span style="color:black">-</span>
 +
|<span style="color:green">Yes</span>
 +
|
 
|
 
|
−
 
  
 
|-
 
|-
 
|UKI-SCOTGRID-GLASGOW
 
|UKI-SCOTGRID-GLASGOW
−
|<span style="color:green"> HTcondor (local), Torque/Maui (local)</span>
+
|<span style="color:green">HTcondor (local)</span>
−
|<span style="color:green">Becomes unresponsive at times of high load or nodes being un-contactable.</span>
+
|<span style="color:green"> </span>
−
|<span style="color:green">Investigating HTCondor/SoGE/SLURM as a replacement.</span>
+
|<span style="color:green">Containers (Singularity, Docker)</span>
−
|<span style="color:green">ARC, Cream</span>
+
|<span style="color:green">ARC-CE (investigating HTCondor-CE)</span>
−
|<span style="color:green"></span>
+
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
−
|<span style="color:green">N/A</span>
+
|<span style="color:green">Yes</span>
−
|
+
|<span style="color:black">-</span>
 +
|<span style="color:black">No</span>
 +
|<span style="color:black">CentOS7 was waiting for move to DC, with June 1st deadline now re-evaluating to complete before move.</span>
 +
|<span style="color:black">22/1/2019</span>
  
 
|-
 
|-
 
|UKI-SOUTHGRID-BHAM-HEP
 
|UKI-SOUTHGRID-BHAM-HEP
−
||<span style="color:green">Torque/Maui</span>
+
||<span style="color:green">VAC</span>
−
|<span style="color:green">Maui sometimes fails to see new jobs and so nothing is scheduled</span>
+
|<span style="color:green">None</span>
−
|<span style="color:green">HTCondor</span>
+
|<span style="color:green">Containers with VAC (rather than VMs)</span>
−
|<span style="color:green">CREAM</span>
+
|<span style="color:green">VAC</span>
−
|<span style="color:green"></span>
+
|<span style="color:green">Yes</span>
−
|<span style="color:black">No</span>
+
|<span style="color:green">Yes?</span>
−
|<span style="color:green">No</span>
+
|<span style="color:green">Yes</span>
−
|<span style="color:green">Testing Vac setup</span>
+
|<span style="color:green">Yes?</span>
−
|
+
|<span style="color:green">Given by VM</span>
−
 
+
|<span style="color:black">Still running Torque/CREAM for tests. Plan to decommission early 2019</span>
 +
|<span style="color:black">22/1/2019</span>
  
 
|-
 
|-
 
|UKI-SOUTHGRID-BRIS
 
|UKI-SOUTHGRID-BRIS
−
|<span style="color:green">HTCondor (shared), torque + maui (local)</span>
+
|<span style="color:green">HTCondor (shared)</span>
−
|<span style="color:green">None</span>
+
|<span style="color:green">Cannot run modern workflows (e.g. Apache Spark)</span>
−
|<span style="color:green">No reason</span>
+
|<span style="color:green">kubernetes, Mesos</span>
−
|<span style="color:green">ARC & CREAM CEs, plan to move to HTCondor CE</span>
+
|<span style="color:green">ARC-CE, plan to add HTCondor CE once accounting is sorted.</span>
−
|<span style="color:green"></span>
+
|<span style="color:purple">On roadmap</span>
−
|<span style="color:black">No</span>
+
|<span style="color:green">Yes</span>
−
|<span style="color:green">No</span>
+
|<span style="color:green">Yes</span>
−
|<span style="color:green">Docker in pre-testing</span>
+
|<span style="color:black">-</span>
−
|
+
|<span style="color:black">In local testing</span>
−
 
+
|<span style="color:black"></span>
 +
|<span style="color:black">11 Dec 2018</span>
  
 
|-
 
|-
 
|UKI-SOUTHGRID-CAM-HEP
 
|UKI-SOUTHGRID-CAM-HEP
−
|<span style="color:green">Torque/Maui (local)</span>
+
|<span style="color:green">VAC (local)</span>
−
|<span style="color:green">Torque/Maui support non-existent</span>
+
|<span style="color:green"></span>
−
|<span style="color:green">Will follow the consensus</span>
+
|<span style="color:green">VAC</span>
−
|<span style="color:green">CREAM CE</span>
+
|<span style="color:green">Migrated to VAC</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
−
|<span style="color:black">No</span>
+
|<span style="color:black">N/A</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
−
|<span style="color:green">None at present</span>
+
|<span style="color:green">Pass</span>
−
|
+
|<span style="color:green">Yes, via VMs</span>
 +
|<span style="color:black">Completely migrated to VAC on CentOS7</span>
 +
|<span style="color:black">22/06/2019</span>
  
 
|-
 
|-
 
|UKI-SOUTHGRID-OX-HEP
 
|UKI-SOUTHGRID-OX-HEP
 
|<span style="color:green">HTCondor (local)</span>
 
|<span style="color:green">HTCondor (local)</span>
−
|<span style="color:green">None</span>
+
|<span style="color:green"> </span>
−
|<span style="color:green">No reason</span>
+
|<span style="color:green"> </span>
−
|<span style="color:green">ARC CE in production</span>
+
|<span style="color:green">ARC-CE</span>
 +
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
 +
|<span style="color:black"> </span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
−
|<span style="color:green">OpenStack in production. Testing VAC</span>
+
|<span style="color:black">Worker node migration to CentOS7 completed. SL6 ARC-CE retired.</span>
−
|
+
|<span style="color:black">09/05/2019 </span>
  
  
Line 265: Line 268:
 
|UKI-SOUTHGRID-RALPP
 
|UKI-SOUTHGRID-RALPP
 
|<span style="color:green">HTCondor</span>
 
|<span style="color:green">HTCondor</span>
−
|<span style="color:green">None</span>
+
|<span style="color:green"> </span>
−
|<span style="color:green">No reason</span>
+
|<span style="color:green"> </span>
−
|<span style="color:green">ARC CE</span>
+
|<span style="color:green">ARC-CE</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
−
|<span style="color:green"></span>
+
|<span style="color:orange">Warn</span>
−
|
+
|<span style="color:green">Yes</span>
−
 
+
|Majority or Worker nodes migrated to C7 fronted by 2 of the 3 CEs, 1 CE fronting a few SL6 nodes remaining for other VOs/Local Users.
 +
|14/02/2019
  
 
|-
 
|-
 
|UKI-SOUTHGRID-SUSX
 
|UKI-SOUTHGRID-SUSX
 
|<span style="color:green">(Shared) Gridengine - (Univa Grid Engine)</span>
 
|<span style="color:green">(Shared) Gridengine - (Univa Grid Engine)</span>
−
|<span style="color:green">None</span>
+
|<span style="color:green"> </span>
−
|<span style="color:green">No reason</span>
+
|<span style="color:green"> </span>
−
|<span style="color:green">CREAMCE</span>
+
|<span style="color:green">CREAM</span>
 
|<span style="color:green"></span>
 
|<span style="color:green"></span>
−
|<span style="color:orange">Looking into it</span>
 
 
|<span style="color:green">Yes</span>
 
|<span style="color:green">Yes</span>
−
|<span style="color:green"></span>
+
|<span style="color:green">Yes</span>
−
|
+
|<span style="color:black"></span>
 +
|<span style="color:black">No</span>
 +
|will review early May 2019
 +
|02/04/2019
  
  
Line 291: Line 297:
  
 
[[Category:Multicore]]
 
[[Category:Multicore]]
 +
[[Category:Sites Status]]
 
[[Category:Batch System]]
 
[[Category:Batch System]]

Latest revision as of 12:47, 21 June 2019

Other links

Sites batch system status

This page has been setup to collect information from GridPP sites regarding their batch systems in February 2014. The information will help with wider considerations and strategy. The table seeks the following:

  1. Current product (local/shared) - what is the current batch system at the site. Is it locally managed or shared with other groups?
  2. Concerns - has your site experienced any problems with the batch system in operation?
  3. Interest/Investigating/Testing - Does your site already have plans to change and if so to what. If not are you actively investigating or testing any alternatives?
  4. CE type(s) - What CE type (gLite, ARC...) do you currently run and do you plan to change this, perhaps in conjunction with a batch system move?
  5. glExec/pilot support for all VOs - do you have glExec and pilot pool accounts for all VOs, as opposed to just the LHC VOs? Used for the move to a Dirac WMS.
  6. Multicore status for ATLAS and CMS
    1. ATLAS multicore jobs history for UK sites
  7. Machine/Job Features (MJF) enabled: - = not started; Fail = failing SAM tests; Warn = warnings from SAM tests; Pass = passing SAM tests
  8. Notes - Any other information you wish to share on this topic.

See Cloud & VM status for status of Vac/Cloud deployment by site.

Site Current product (local/shared) Concerns and observations Interest/Investigating/Testing CE type(s) & plans at site Pilots for all cgroups Multicore Atlas/CMS MJF CentOS7 WN Notes Date last reviewed or updated
RAL Tier-1 HTCondor (local) None No reason ARC-CE Yes Yes Yes Pass Yes 8-Jan-2019
UKI-LT2-Brunel HTCondor ArcCE info system ARC-CE Yes Yes Yes - Yes CEs and WNs on C7 since Jan 2018. Storage being moved to C7. All other services on C7 2019-01-22


UKI-LT2-IC-HEP Gridengine (local) ARC-CE CREAM, ARC-CE Yes No Yes - Yes an style="color:green">Yes</span>


UKI-LT2-QMUL SLURM SLURM does support MaxCPUTime for queues but it's complicated SPark and hadoop integration with slurm and lustre CREAM Yes Yes Yes No In local testing GPU and preempt queues also supported on the grid 13-April-18
UKI-LT2-RHUL Torque/Maui (local) Torque/Maui support non-existent Will follow the consensus CREAM Yes No Yes - Testing Setting up CC7 ArcCondor cluster 21-Nov-17
UKI-NORTHGRID-LANCS-HEP Son of Gridengine (HEC) CREAM, looking at HTCondorCE over ARC now Yes No Yes - Yes Almost all resources CentOS7, small amount of SL6 for smaller VO use. Singularity deployed (local build) 16/10/18


UKI-NORTHGRID-LIV-HEP HTCondor/VAC HTCondor-CE (C7), ARC (C7) Yes Yes Yes Yes Yes Move all to HTCondor-CE 12 Feb 2019


UKI-NORTHGRID-MAN-HEP HTCondor/VAC
(local) 		ARC-CE/HTCondor Yes Yes Yes Pass Yes 29/03/2019
UKI-NORTHGRID-SHEF-HEP Torque/Maui (local) Torque/Maui support non-existent HTCondor is installed CREAM CE, ACR CE is in test Yes No Yes - Ongoing work - 22/01/2019
UKI-SCOTGRID-DURHAM SLURM (local) No reason ARC-CE Yes Yes Yes - Ongoing Testing CentOS7 WNs are being tested locally prior to complete rollout.
UKI-SCOTGRID-ECDF Gridengine ARC-CE No Yes - Yes
UKI-SCOTGRID-GLASGOW HTcondor (local) Containers (Singularity, Docker) ARC-CE (investigating HTCondor-CE) Yes Yes Yes - No CentOS7 was waiting for move to DC, with June 1st deadline now re-evaluating to complete before move. 22/1/2019
UKI-SOUTHGRID-BHAM-HEP VAC None Containers with VAC (rather than VMs) VAC Yes Yes? Yes Yes? Given by VM Still running Torque/CREAM for tests. Plan to decommission early 2019 22/1/2019
UKI-SOUTHGRID-BRIS HTCondor (shared) Cannot run modern workflows (e.g. Apache Spark) kubernetes, Mesos ARC-CE, plan to add HTCondor CE once accounting is sorted. On roadmap Yes Yes - In local testing 11 Dec 2018
UKI-SOUTHGRID-CAM-HEP VAC (local) VAC Migrated to VAC Yes N/A Yes Pass Yes, via VMs Completely migrated to VAC on CentOS7 22/06/2019
UKI-SOUTHGRID-OX-HEP HTCondor (local) ARC-CE Yes Yes Yes Yes Worker node migration to CentOS7 completed. SL6 ARC-CE retired. 09/05/2019


UKI-SOUTHGRID-RALPP HTCondor ARC-CE Yes Yes Yes Warn Yes Majority or Worker nodes migrated to C7 fronted by 2 of the 3 CEs, 1 CE fronting a few SL6 nodes remaining for other VOs/Local Users. 14/02/2019
UKI-SOUTHGRID-SUSX (Shared) Gridengine - (Univa Grid Engine) CREAM Yes Yes No will review early May 2019 02/04/2019


Retrieved from "https://www.gridpp.ac.uk/w/index.php?title=Batch_system_status&oldid=20126"