Difference between revisions of "Batch system status"
From GridPP Wiki
(→Sites batch system status) |
(Add 'pilots for all' column) |
||
Line 11: | Line 11: | ||
# Interest/Investigating/Testing - Does your site already have plans to change and if so to what. If not are you actively investigating or testing any alternatives? | # Interest/Investigating/Testing - Does your site already have plans to change and if so to what. If not are you actively investigating or testing any alternatives? | ||
# CE type(s) - What CE type (gLite, ARC...) do you currently run and do you plan to change this, perhaps in conjunction with a batch system move? | # CE type(s) - What CE type (gLite, ARC...) do you currently run and do you plan to change this, perhaps in conjunction with a batch system move? | ||
+ | # glExec/pilot support for all VOs - do you have glExec and pilot pool accounts for all VOs, as opposed to just the LHC VOs? Used for the move to a Dirac WMS. | ||
# Cloud interface(s)? - Does your site offer access to resources in ways other than via a CE? (See [[Cloud & VM status]] for more up-to-date / detailed information) | # Cloud interface(s)? - Does your site offer access to resources in ways other than via a CE? (See [[Cloud & VM status]] for more up-to-date / detailed information) | ||
# Multicore status for ATLAS and CMS | # Multicore status for ATLAS and CMS | ||
Line 28: | Line 29: | ||
|Interest/Investigating/Testing | |Interest/Investigating/Testing | ||
|CE type(s) & plans at site | |CE type(s) & plans at site | ||
+ | |Pilots for all | ||
|cgroups | |cgroups | ||
|Multicore Atlas/CMS | |Multicore Atlas/CMS | ||
Line 39: | Line 41: | ||
|<span style="color:green">No reason</span> | |<span style="color:green">No reason</span> | ||
|<span style="color:green">ARC</span> | |<span style="color:green">ARC</span> | ||
+ | |<span style="color:green"></span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
Line 50: | Line 53: | ||
|<span style="color:green">Slurm and HTCondor in test</span> | |<span style="color:green">Slurm and HTCondor in test</span> | ||
|<span style="color:green">Arc in test</span> | |<span style="color:green">Arc in test</span> | ||
+ | |<span style="color:green"></span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
Line 61: | Line 65: | ||
|<span style="color:green">No reason</span> | |<span style="color:green">No reason</span> | ||
|<span style="color:green">CREAM, ARC</span> | |<span style="color:green">CREAM, ARC</span> | ||
+ | |<span style="color:green"></span> | ||
|<span style="color:black">No</span> | |<span style="color:black">No</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
Line 73: | Line 78: | ||
|<span style="color:green">Son of Gridengine</span> | |<span style="color:green">Son of Gridengine</span> | ||
|<span style="color:green">CREAM</span> | |<span style="color:green">CREAM</span> | ||
+ | |<span style="color:green"></span> | ||
|<span style="color:black">No</span> | |<span style="color:black">No</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
Line 84: | Line 90: | ||
|<span style="color:green">Will follow the consensus</span> | |<span style="color:green">Will follow the consensus</span> | ||
|<span style="color:green">CREAM</span> | |<span style="color:green">CREAM</span> | ||
+ | |<span style="color:green"></span> | ||
|<span style="color:black">No</span> | |<span style="color:black">No</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
Line 96: | Line 103: | ||
|<span style="color:green">HTCondor</span> | |<span style="color:green">HTCondor</span> | ||
|<span style="color:green">CREAM CE</span> | |<span style="color:green">CREAM CE</span> | ||
+ | |<span style="color:green"></span> | ||
|<span style="color:black">No</span> | |<span style="color:black">No</span> | ||
|<span style="color:red">X</span> | |<span style="color:red">X</span> | ||
Line 108: | Line 116: | ||
|<span style="color:green">Sticking with grid engine</span> | |<span style="color:green">Sticking with grid engine</span> | ||
|<span style="color:green">CREAM, moving to ARC eventually</span> | |<span style="color:green">CREAM, moving to ARC eventually</span> | ||
+ | |<span style="color:green"></span> | ||
|<span style="color:black">No</span> | |<span style="color:black">No</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
Line 119: | Line 128: | ||
|<span style="color:green"> </span> | |<span style="color:green"> </span> | ||
|<span style="color:green">Cream</span> | |<span style="color:green">Cream</span> | ||
+ | |<span style="color:green"></span> | ||
|<span style="color:black">No</span> | |<span style="color:black">No</span> | ||
|<span style="color:green">No</span> | |<span style="color:green">No</span> | ||
Line 130: | Line 140: | ||
|<span style="color:green"></span> | |<span style="color:green"></span> | ||
|<span style="color:green">ARC</span> | |<span style="color:green">ARC</span> | ||
+ | |<span style="color:green"></span> | ||
|<span style="color:orange">Loooking into it</span> | |<span style="color:orange">Loooking into it</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
Line 142: | Line 153: | ||
|<span style="color:green">HTCondor</span> | |<span style="color:green">HTCondor</span> | ||
|<span style="color:green">Currently CREAM, investigating ARC-CE</span> | |<span style="color:green">Currently CREAM, investigating ARC-CE</span> | ||
+ | |<span style="color:green"></span> | ||
|<span style="color:black">No</span> | |<span style="color:black">No</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
Line 154: | Line 166: | ||
|<span style="color:green">HTCondor is in testing mode</span> | |<span style="color:green">HTCondor is in testing mode</span> | ||
|<span style="color:green">CREAM CE, ACR CE is in test</span> | |<span style="color:green">CREAM CE, ACR CE is in test</span> | ||
+ | |<span style="color:green"></span> | ||
|<span style="color:black">No</span> | |<span style="color:black">No</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
Line 166: | Line 179: | ||
|<span style="color:green">No reason</span> | |<span style="color:green">No reason</span> | ||
|<span style="color:green">ARC CE</span> | |<span style="color:green">ARC CE</span> | ||
+ | |<span style="color:green"></span> | ||
|<span style="color:black">No</span> | |<span style="color:black">No</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
Line 178: | Line 192: | ||
|<span style="color:green">No reason</span> | |<span style="color:green">No reason</span> | ||
|<span style="color:green">Cream CE for standard production, ARC CE for exploratory HPC work</span> | |<span style="color:green">Cream CE for standard production, ARC CE for exploratory HPC work</span> | ||
+ | |<span style="color:green"></span> | ||
|<span style="color:black">No</span> | |<span style="color:black">No</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
Line 190: | Line 205: | ||
|<span style="color:green">Investigating HTCondor/SoGE/SLURM as a replacement.</span> | |<span style="color:green">Investigating HTCondor/SoGE/SLURM as a replacement.</span> | ||
|<span style="color:green">ARC, Cream</span> | |<span style="color:green">ARC, Cream</span> | ||
+ | |<span style="color:green"></span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
Line 201: | Line 217: | ||
|<span style="color:green">HTCondor</span> | |<span style="color:green">HTCondor</span> | ||
|<span style="color:green">CREAM</span> | |<span style="color:green">CREAM</span> | ||
+ | |<span style="color:green"></span> | ||
|<span style="color:black">No</span> | |<span style="color:black">No</span> | ||
|<span style="color:green">No</span> | |<span style="color:green">No</span> | ||
Line 213: | Line 230: | ||
|<span style="color:green">No reason</span> | |<span style="color:green">No reason</span> | ||
|<span style="color:green">ARC & CREAM CEs</span> | |<span style="color:green">ARC & CREAM CEs</span> | ||
+ | |<span style="color:green"></span> | ||
|<span style="color:black">No</span> | |<span style="color:black">No</span> | ||
|<span style="color:red">X</span> | |<span style="color:red">X</span> | ||
Line 225: | Line 243: | ||
|<span style="color:green">Will follow the consensus</span> | |<span style="color:green">Will follow the consensus</span> | ||
|<span style="color:green">CREAM CE</span> | |<span style="color:green">CREAM CE</span> | ||
+ | |<span style="color:green"></span> | ||
|<span style="color:black">No</span> | |<span style="color:black">No</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
Line 236: | Line 255: | ||
|<span style="color:green">No reason</span> | |<span style="color:green">No reason</span> | ||
|<span style="color:green">ARC CE in production</span> | |<span style="color:green">ARC CE in production</span> | ||
+ | |<span style="color:green"></span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
Line 248: | Line 268: | ||
|<span style="color:green">No reason</span> | |<span style="color:green">No reason</span> | ||
|<span style="color:green">ARC CE</span> | |<span style="color:green">ARC CE</span> | ||
+ | |<span style="color:green"></span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
Line 260: | Line 281: | ||
|<span style="color:green">No reason</span> | |<span style="color:green">No reason</span> | ||
|<span style="color:green">CREAMCE</span> | |<span style="color:green">CREAMCE</span> | ||
+ | |<span style="color:green"></span> | ||
|<span style="color:orange">Looking into it</span> | |<span style="color:orange">Looking into it</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> |
Revision as of 12:55, 11 November 2015
Other links
Sites batch system status
This page has been setup to collect information from GridPP sites regarding their batch systems in February 2014. The information will help with wider considerations and strategy. The table seeks the following:
- Current product (local/shared) - what is the current batch system at the site. Is it locally managed or shared with other groups?
- Concerns - has your site experienced any problems with the batch system in operation?
- Interest/Investigating/Testing - Does your site already have plans to change and if so to what. If not are you actively investigating or testing any alternatives?
- CE type(s) - What CE type (gLite, ARC...) do you currently run and do you plan to change this, perhaps in conjunction with a batch system move?
- glExec/pilot support for all VOs - do you have glExec and pilot pool accounts for all VOs, as opposed to just the LHC VOs? Used for the move to a Dirac WMS.
- Cloud interface(s)? - Does your site offer access to resources in ways other than via a CE? (See Cloud & VM status for more up-to-date / detailed information)
- Multicore status for ATLAS and CMS
- Notes - Any other information you wish to share on this topic.
Site | Current product (local/shared) | Concerns and observations | Interest/Investigating/Testing | CE type(s) & plans at site | Pilots for all | cgroups | Multicore Atlas/CMS | Cloud interface available/plans | Notes |
RAL Tier-1 | HTCondor (local) | None | No reason | ARC | Yes | Yes | OpenNebula | ||
UKI-LT2-Brunel | Torque/Maui, Arc/Condor | No support for Torque/Maui | Slurm and HTCondor in test | Arc in test | Yes | Yes | OpenVZ in production, Docker in test | ||
UKI-LT2-IC-HEP | Gridengine (local) | None | No reason | CREAM, ARC | No | Yes | GridPP Cloud Tests |
| |
UKI-LT2-QMUL | Gridengine (local) | None | Son of Gridengine | CREAM | No | Yes | Deploy cloudstack, find scalable solution to get our storage usable in the cloud | ||
UKI-LT2-RHUL | Torque/Maui (local) | Torque/Maui support non-existent | Will follow the consensus | CREAM | No | Yes |
| ||
UKI-LT2-UCL-HEP | Torque/Maui (local) | Torque/Maui support non-existent | HTCondor | CREAM CE | No | X |
| ||
UKI-NORTHGRID-LANCS-HEP | Son of Gridengine (HEC) | Torque/Maui clusterDecommissioned, for for grid and local (tier 3) | Sticking with grid engine | CREAM, moving to ARC eventually | No | Yes | VMWare testing; Vac in production | ||
UKI-NORTHGRID-LIV-HEP (Single core cluster) | Torque Maui (local) | Poor Support, Maui intrinsically broken | Cream | No | No | None | |||
UKI-NORTHGRID-LIV-HEP (Multi core cluster) | HTCondor (local) | None | ARC | Loooking into it | Yes | None |
| ||
UKI-NORTHGRID-MAN-HEP | Torque/Maui (local) | Maui is unsupported. It had memory leaks. Robert wrote a patch and there was nowhere to feed it back into. | HTCondor | Currently CREAM, investigating ARC-CE | No | Yes | Vac in production |
| |
UKI-NORTHGRID-SHEF-HEP | Torque/Maui (local) | Torque/Maui support non-existent | HTCondor is in testing mode | CREAM CE, ACR CE is in test | No | Yes |
| ||
UKI-SCOTGRID-DURHAM | SLURM (local) | No reason | ARC CE | No | Yes | N/A |
| ||
UKI-SCOTGRID-ECDF | Gridengine | None | No reason | Cream CE for standard production, ARC CE for exploratory HPC work | No | Yes |
| ||
UKI-SCOTGRID-GLASGOW | HTcondor (local), Torque/Maui (local) | Becomes unresponsive at times of high load or nodes being un-contactable. | Investigating HTCondor/SoGE/SLURM as a replacement. | ARC, Cream | Yes | Yes | N/A | ||
UKI-SOUTHGRID-BHAM-HEP | Torque/Maui | Maui sometimes fails to see new jobs and so nothing is scheduled | HTCondor | CREAM | No | No | Testing Vac setup |
| |
UKI-SOUTHGRID-BRIS | HTCondor (shared), torque + maui (local) | None | No reason | ARC & CREAM CEs | No | X |
| ||
UKI-SOUTHGRID-CAM-HEP | Torque/Maui (local) | Torque/Maui support non-existent | Will follow the consensus | CREAM CE | No | Yes | None at present | ||
UKI-SOUTHGRID-OX-HEP | HTCondor (local) | None | No reason | ARC CE in production | Yes | Yes | OpenStack in production. Testing VAC |
| |
UKI-SOUTHGRID-RALPP | HTCondor | None | No reason | ARC CE | Yes | Yes |
| ||
UKI-SOUTHGRID-SUSX | (Shared) Gridengine - (Univa Grid Engine) | None | No reason | CREAMCE | Looking into it | Yes |
|