Difference between revisions of "Batch system status"
From GridPP Wiki
| Line 29: | Line 29: | ||
|CE type(s) & plans at site | |CE type(s) & plans at site | ||
|Multicore Atlas/CMS | |Multicore Atlas/CMS | ||
| + | |cgroups | ||
|Cloud interface available/plans | |Cloud interface available/plans | ||
|Notes | |Notes | ||
| Line 38: | Line 39: | ||
|<span style="color:green">No reason</span> | |<span style="color:green">No reason</span> | ||
|<span style="color:green">ARC</span> | |<span style="color:green">ARC</span> | ||
| + | |<span style="color:green">Yes</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
|<span style="color:green">OpenNebula</span> | |<span style="color:green">OpenNebula</span> | ||
| Line 48: | Line 50: | ||
|<span style="color:green">Slurm and HTCondor in test</span> | |<span style="color:green">Slurm and HTCondor in test</span> | ||
|<span style="color:green">Arc in test</span> | |<span style="color:green">Arc in test</span> | ||
| + | |<span style="color:black">No</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
|<span style="color:green">OpenVZ in production, Docker in test</span> | |<span style="color:green">OpenVZ in production, Docker in test</span> | ||
| Line 58: | Line 61: | ||
|<span style="color:green">No reason</span> | |<span style="color:green">No reason</span> | ||
|<span style="color:green">CREAM, ARC</span> | |<span style="color:green">CREAM, ARC</span> | ||
| + | |<span style="color:black">No</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
|<span style="color:green">GridPP Cloud Tests</span> | |<span style="color:green">GridPP Cloud Tests</span> | ||
| Line 69: | Line 73: | ||
|<span style="color:green">Son of Gridengine</span> | |<span style="color:green">Son of Gridengine</span> | ||
|<span style="color:green">CREAM</span> | |<span style="color:green">CREAM</span> | ||
| + | |<span style="color:black">No</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
|<span style="color:green">Deploy cloudstack, find scalable solution to get our storage usable in the cloud</span> | |<span style="color:green">Deploy cloudstack, find scalable solution to get our storage usable in the cloud</span> | ||
| Line 79: | Line 84: | ||
|<span style="color:green">Will follow the consensus</span> | |<span style="color:green">Will follow the consensus</span> | ||
|<span style="color:green">CREAM</span> | |<span style="color:green">CREAM</span> | ||
| + | |<span style="color:black">No</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
|<span style="color:green"></span> | |<span style="color:green"></span> | ||
| Line 90: | Line 96: | ||
|<span style="color:green"></span> | |<span style="color:green"></span> | ||
|<span style="color:green"></span> | |<span style="color:green"></span> | ||
| + | |<span style="color:black">No</span> | ||
|<span style="color:red">X</span> | |<span style="color:red">X</span> | ||
|<span style="color:green"></span> | |<span style="color:green"></span> | ||
| Line 101: | Line 108: | ||
|<span style="color:green">Slurm or HTCondor.</span> | |<span style="color:green">Slurm or HTCondor.</span> | ||
|<span style="color:green">CREAM, interested in ARC</span> | |<span style="color:green">CREAM, interested in ARC</span> | ||
| + | |<span style="color:black">No</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
|<span style="color:green">VMWare testing; Vac in production</span> | |<span style="color:green">VMWare testing; Vac in production</span> | ||
| Line 111: | Line 119: | ||
|<span style="color:green"> </span> | |<span style="color:green"> </span> | ||
|<span style="color:green">Cream</span> | |<span style="color:green">Cream</span> | ||
| + | |<span style="color:black">No</span> | ||
|<span style="color:green">NO</span> | |<span style="color:green">NO</span> | ||
|<span style="color:green">None</span> | |<span style="color:green">None</span> | ||
| Line 121: | Line 130: | ||
|<span style="color:green"></span> | |<span style="color:green"></span> | ||
|<span style="color:green">ARC</span> | |<span style="color:green">ARC</span> | ||
| + | |<span style="color:black">No</span> | ||
|<span style="color:green">YES</span> | |<span style="color:green">YES</span> | ||
|<span style="color:green">None</span> | |<span style="color:green">None</span> | ||
| Line 132: | Line 142: | ||
|<span style="color:green">HTCondor</span> | |<span style="color:green">HTCondor</span> | ||
|<span style="color:green">Currently CREAM, investigating ARC-CE</span> | |<span style="color:green">Currently CREAM, investigating ARC-CE</span> | ||
| + | |<span style="color:black">No</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
|<span style="color:green">Vac in production</span> | |<span style="color:green">Vac in production</span> | ||
| Line 143: | Line 154: | ||
|<span style="color:green">HTCondor is in testing mode</span> | |<span style="color:green">HTCondor is in testing mode</span> | ||
|<span style="color:green">CREAM CE, ACR CE is in test</span> | |<span style="color:green">CREAM CE, ACR CE is in test</span> | ||
| + | |<span style="color:black">No</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
|<span style="color:green"></span> | |<span style="color:green"></span> | ||
| Line 154: | Line 166: | ||
|<span style="color:green">No reason</span> | |<span style="color:green">No reason</span> | ||
|<span style="color:green">ARC CE</span> | |<span style="color:green">ARC CE</span> | ||
| + | |<span style="color:black">No</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
|<span style="color:green">N/A</span> | |<span style="color:green">N/A</span> | ||
| Line 165: | Line 178: | ||
|<span style="color:green">No reason</span> | |<span style="color:green">No reason</span> | ||
|<span style="color:green">Cream CE for standard production, ARC CE for exploratory HPC work</span> | |<span style="color:green">Cream CE for standard production, ARC CE for exploratory HPC work</span> | ||
| + | |<span style="color:black">No</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
|<span style="color:green"></span> | |<span style="color:green"></span> | ||
| Line 176: | Line 190: | ||
|<span style="color:green">Investigating HTCondor/SoGE/SLURM as a replacement.</span> | |<span style="color:green">Investigating HTCondor/SoGE/SLURM as a replacement.</span> | ||
|<span style="color:green">ARC, Cream</span> | |<span style="color:green">ARC, Cream</span> | ||
| + | |<span style="color:green">Yes</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
|<span style="color:green">N/A</span> | |<span style="color:green">N/A</span> | ||
| Line 186: | Line 201: | ||
|<span style="color:green">HTCondor</span> | |<span style="color:green">HTCondor</span> | ||
|<span style="color:green">CREAM</span> | |<span style="color:green">CREAM</span> | ||
| + | |<span style="color:black">No</span> | ||
|<span style="color:green">No</span> | |<span style="color:green">No</span> | ||
|<span style="color:green"></span> | |<span style="color:green"></span> | ||
| Line 197: | Line 213: | ||
|<span style="color:green">No reason</span> | |<span style="color:green">No reason</span> | ||
|<span style="color:green">ARC & CREAM CEs</span> | |<span style="color:green">ARC & CREAM CEs</span> | ||
| + | |<span style="color:black">No</span> | ||
|<span style="color:red">X</span> | |<span style="color:red">X</span> | ||
|<span style="color:green"></span> | |<span style="color:green"></span> | ||
| Line 208: | Line 225: | ||
|<span style="color:green">Will follow the consensus</span> | |<span style="color:green">Will follow the consensus</span> | ||
|<span style="color:green">CREAM CE</span> | |<span style="color:green">CREAM CE</span> | ||
| + | |<span style="color:black">No</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
|<span style="color:green">None at present</span> | |<span style="color:green">None at present</span> | ||
| Line 218: | Line 236: | ||
|<span style="color:green">No reason</span> | |<span style="color:green">No reason</span> | ||
|<span style="color:green">ARC CE in production</span> | |<span style="color:green">ARC CE in production</span> | ||
| + | |<span style="color:orange">testing</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
|<span style="color:green">OpenStack in production. Testing VAC</span> | |<span style="color:green">OpenStack in production. Testing VAC</span> | ||
| Line 229: | Line 248: | ||
|<span style="color:green">No reason</span> | |<span style="color:green">No reason</span> | ||
|<span style="color:green">ARC CE</span> | |<span style="color:green">ARC CE</span> | ||
| + | |<span style="color:black">No</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
|<span style="color:green"></span> | |<span style="color:green"></span> | ||
| Line 240: | Line 260: | ||
|<span style="color:green">No reason</span> | |<span style="color:green">No reason</span> | ||
|<span style="color:green">CREAMCE</span> | |<span style="color:green">CREAMCE</span> | ||
| + | |<span style="color:black">No</span> | ||
|<span style="color:green">Yes</span> | |<span style="color:green">Yes</span> | ||
|<span style="color:green"></span> | |<span style="color:green"></span> | ||
Revision as of 17:55, 9 March 2015
Other links
Sites batch system status
This page has been setup to collect information from GridPP sites regarding their batch systems in February 2014. The information will help with wider considerations and strategy. The table seeks the following:
- Current product (local/shared) - what is the current batch system at the site. Is it locally managed or shared with other groups?
- Concerns - has your site experienced any problems with the batch system in operation?
- Interest/Investigating/Testing - Does your site already have plans to change and if so to what. If not are you actively investigating or testing any alternatives?
- CE type(s) - What CE type (gLite, ARC...) do you currently run and do you plan to change this, perhaps in conjunction with a batch system move?
- Cloud interface(s)? - Does your site offer access to resources in ways other than via a CE?
- Multicore status for ATLAS and CMS
- Notes - Any other information you wish to share on this topic.
| Site | Current product (local/shared) | Concerns and observations | Interest/Investigating/Testing | CE type(s) & plans at site | Multicore Atlas/CMS | cgroups | Cloud interface available/plans | Notes |
| RAL Tier-1 | HTCondor (local) | None | No reason | ARC | Yes | Yes | OpenNebula | |
| UKI-LT2-Brunel | Torque/Maui, Arc/Condor | No support for Torque/Maui | Slurm and HTCondor in test | Arc in test | No | Yes | OpenVZ in production, Docker in test | |
| UKI-LT2-IC-HEP | Gridengine (local) | None | No reason | CREAM, ARC | No | Yes | GridPP Cloud Tests |
|
| UKI-LT2-QMUL | Gridengine (local) | None | Son of Gridengine | CREAM | No | Yes | Deploy cloudstack, find scalable solution to get our storage usable in the cloud | |
| UKI-LT2-RHUL | Torque/Maui (local) | Torque/Maui support non-existent | Will follow the consensus | CREAM | No | Yes |
| |
| UKI-LT2-UCL-HEP | No | X |
| |||||
| UKI-NORTHGRID-LANCS-HEP | Son of Gridengine (HEC), torque/maui (local) | Disillusioned with torque/maui. | Slurm or HTCondor. | CREAM, interested in ARC | No | Yes | VMWare testing; Vac in production | |
| UKI-NORTHGRID-LIV-HEP (Single core cluster) | Torque Maui (local) | Poor Support, Maui intrinsically broken | Cream | No | NO | None | ||
| UKI-NORTHGRID-LIV-HEP (Multi core cluster) | HTCondor (local) | None | ARC | No | YES | None |
| |
| UKI-NORTHGRID-MAN-HEP | Torque/Maui (local) | Maui is unsupported. It had memory leaks. Robert wrote a patch and there was nowhere to feed it back into. | HTCondor | Currently CREAM, investigating ARC-CE | No | Yes | Vac in production |
|
| UKI-NORTHGRID-SHEF-HEP | Torque/Maui (local) | Torque/Maui support non-existent | HTCondor is in testing mode | CREAM CE, ACR CE is in test | No | Yes |
| |
| UKI-SCOTGRID-DURHAM | SLURM (local) | No reason | ARC CE | No | Yes | N/A |
| |
| UKI-SCOTGRID-ECDF | Gridengine | None | No reason | Cream CE for standard production, ARC CE for exploratory HPC work | No | Yes |
| |
| UKI-SCOTGRID-GLASGOW | HTcondor (local), Torque/Maui (local) | Becomes unresponsive at times of high load or nodes being un-contactable. | Investigating HTCondor/SoGE/SLURM as a replacement. | ARC, Cream | Yes | Yes | N/A | |
| UKI-SOUTHGRID-BHAM-HEP | Torque/Maui | Maui sometimes fails to see new jobs and so nothing is scheduled | HTCondor | CREAM | No | No |
| |
| UKI-SOUTHGRID-BRIS | HTCondor (shared), torque + maui (local) | None | No reason | ARC & CREAM CEs | No | X |
| |
| UKI-SOUTHGRID-CAM-HEP | Torque/Maui (local) | Torque/Maui support non-existent | Will follow the consensus | CREAM CE | No | Yes | None at present | |
| UKI-SOUTHGRID-OX-HEP | HTCondor (local) | None | No reason | ARC CE in production | testing | Yes | OpenStack in production. Testing VAC |
|
| UKI-SOUTHGRID-RALPP | HTCondor | None | No reason | ARC CE | No | Yes |
| |
| UKI-SOUTHGRID-SUSX | (Shared) Gridengine - (Univa Grid Engine) | None | No reason | CREAMCE | No | Yes |
|
