Search results

Create the page "Batch System" on this wiki!

• Tier1 Operations Report 2014-10-08
  ...h hosts the Atlas and GEN SRM databases) was moved to the standby database system. This required an outage of the Castor Atlas and GEN instances which lasted ...day morning (5th Oct). It was restarted and tested but no fault found. The system was returned to service this morning (8th Oct).
  15 KB (1,740 words) - 10:50, 15 October 2014
• Site information
  ...completed in October 2008. The first is to provide information about batch system memory limits. The second is to give an update on networking issues that ca [[Background to batch system memory request for details:]]
  17 KB (2,669 words) - 11:14, 1 March 2016
• Guide to Ganga
  ...ol for use with both local batch systems and the DIRAC workload management system. It's maintained by Ulrik Egede (ulrik<AT>monash.edu) - please email if you ...want to use it to submit jobs to the grid rather than just for local batch system submission), there are a few steps you need to go through:
  15 KB (2,621 words) - 14:40, 27 May 2020
• Tier1 Operations Report 2018-06-18
  <!-- ******************Start Limits On Batch System Jobs***************** -----> ...; padding-top: 0.1em; padding-bottom: 0.1em;" | Limits on concurrent batch system jobs.
  16 KB (1,535 words) - 13:37, 20 June 2018
• Tier1 Operations Report 2018-05-14
  <!-- ******************Start Limits On Batch System Jobs***************** -----> ...; padding-top: 0.1em; padding-bottom: 0.1em;" | Limits on concurrent batch system jobs.
  16 KB (1,476 words) - 07:41, 16 May 2018
• Publishing tutorial
  ...y maximise throughput. Experiments show that, in order to fully utilize a system, it is often necessary to choose a number of slots that is higher than th Sites have to transmit (via the BDII and the accounting system) a couple more things; the power of the site and the amount of work done.
  8 KB (1,284 words) - 14:03, 2 October 2017
• Tier1 Operations Report 2014-10-29
  ...tlasDataDisk - D1T0) had failed for the third time on around a month. This system has been completely drained and is undergoing further investigations. ...regular "PSU" patches will be applied to the Pluto Castor standby database system on Monday (27th Oct) and to the Pluto production database on Wednesday (29t
  14 KB (1,569 words) - 13:13, 29 October 2014
• Operations Bulletin 271014
  * Machine/Job features: Concluded on a single architecture for cloud and batch implementations. * The OGMA database system (Atlas3D/Frontier) has been updated and switched to using Oracle GoldenGate
  40 KB (4,976 words) - 10:25, 27 October 2014
• Operations Bulletin 031114
  * Machine/Job features: Concluded on a single architecture for cloud and batch implementations. * The OGMA database system (Atlas3D/Frontier) has been updated and switched to using Oracle GoldenGate
  42 KB (5,228 words) - 10:37, 4 November 2014
• Operations Bulletin 101114
  * Machine/Job features: Concluded on a single architecture for cloud and batch implementations. LHCB having cvmfs trouble at IC, which was likely caused by a batch of naughty CMS jobs ruining it for everyone else. LHCB re-enabled IC to see
  48 KB (6,138 words) - 09:19, 10 November 2014
• Operations Bulletin 171114
  * Multicore: Passing parameters to batch system discussion started. Limited tests. ATLAS 40% resources now MC. Still 37 sit
  39 KB (4,698 words) - 18:46, 16 November 2014
• OldEMITarball
  ...caster test cluster runs using torque, interfacing with a DPM SE, so other batch/storage combinations are not as well tested. ''This assumes that the workernode has been setup to work within the batch system, and the users and groups have been set up. It would technically be possibl
  25 KB (4,174 words) - 09:57, 23 July 2015
• EMITarball
  The tarball versions listed may look convoluted, but there is a system to them! The first part denotes what middleware was used to build the tarba ... vomses, CA and CRLs. For a WN you will have to set up the users and batch system yourself.
  11 KB (1,832 words) - 10:02, 23 January 2018
• Operations Bulletin 081214
  * Multicore: Passing parameters to batch systems [https://indico.cern.ch/event/272779/session/0/contribution/8/mater ...n F ticketed the CA concerning a possible problem with the ticket reminder system. JK has responded with a reply, and asked that similar tickets in the futur
  50 KB (6,536 words) - 00:08, 7 December 2014
• Past Ticket Bulletins 2015
  ...on (but as he also notes - what's getting loaded and causing the problem - Batch, CE or WNs?). Kashif reckons the argus server, and suggests a handy glexec Sno+ spotted malloc errors at Lancaster. The problems seemed to survive one batch of fixes, but I asked again if they still see problems after running a good
  117 KB (18,736 words) - 11:05, 4 January 2016
• Tier1 Operations Report 2014-12-17
  * Following a restriction on numbers of CMS batch jobs imposed during problems a week or so ago the CMS jobs limits on the fa ... brought into use. (Currently Atlas 3D/Frontier still uses the OGMA datase system, although this was also changed to update from CERN using Oracle Golden Gat
  14 KB (1,504 words) - 14:50, 17 December 2014
• Tier1 Operations Report 2015-01-07
  ... brought into use. (Currently Atlas 3D/Frontier still uses the OGMA datase system, although this was also changed to update from CERN using Oracle Golden Gat | Due to Kernel patching of EGI ADV 20141217, the RAL tier1 batch farm worker nodes will need to be rebooted.
  17 KB (1,780 words) - 12:56, 7 January 2015
• Dirac Dictionary
  WMS - Workload Managment System. The central part of the DIRAC system
  2 KB (306 words) - 12:29, 12 March 2015
• Tier1 Operations Report 2015-01-14
  ...ostic tests were being run on the faulty router – however after that the system restarted and took over as the master router of the pair (which was not ant ...the week. Intermittent timeouts were seen on the tests. The number of LHCb batch jobs has been restricted to try and reduce the problem. In addition, during
  14 KB (1,559 words) - 10:52, 21 January 2015
• Tier1 Operations Report 2015-02-11
  * We are now fully using cgroups to control job memory limits on the batch farm. ... brought into use. (Currently Atlas 3D/Frontier still uses the OGMA datase system, although this was also changed to update from CERN using Oracle Golden Gat
  13 KB (1,290 words) - 11:23, 11 February 2015
• Tier1 Operations Report 2015-03-04
  ...Thursday (26th Feb) there was a problem with our Argus server that stopped batch job submission starting for an hour or so. * Cap on maximum number of ALICE batch jobs raised from 3500 to 6000.
  12 KB (1,175 words) - 14:56, 4 March 2015
• Cloud & VM status
  ...ese sites. There is a complementary page about [[Batch system status|batch system status]].
  3 KB (378 words) - 09:57, 27 June 2017
• Vacuum
  ...f this system is that there is no gate keeper service, head node, or batch system accepting and then directing jobs to particular worker nodes, avoiding seve
  4 KB (628 words) - 12:52, 13 March 2015
• RAL Tier1 Summary of Post Mortems
  ...fter the action refer to the Tier1 internal (Footprints) incident tracking system. * Investigate, and implement, an alternative method of connecting to the system to allow for a reconnection in the event of a network break.
  8 KB (1,074 words) - 09:36, 18 September 2018
• RAL Tier1 Incident 20150408 network intervention preceding Castor upgrade
  ... network changes were made at the start of a planned upgrade to the Castor system. A network problem was triggered that took most of the day to resolve (and | In response to a ticket from t2k, the non-LHC VOs were re-enabled on the batch farm.
  15 KB (2,406 words) - 16:43, 17 August 2015
• Operations Bulletin 270415
  * A [https://indico.cern.ch/event/319821/ pre-GDB on batch systems] will take place in May. ...tops the HTC solution until after CHEP. Is there interest in testing other batch systems? Raul mentioned SLURM. There is also SGE and Torque.
  43 KB (5,339 words) - 06:42, 27 April 2015
• GridPP VO Incubator
  |Enable the OSG VO on RAL CEs and batch system. |Test of the Transformation System
  19 KB (3,141 words) - 12:14, 27 April 2020
• Monitoring Resource Usage of Jobs with cAdvisor
  ...addition data is exported to a central database. For sites running a batch system with cgroups enabled, cAdvisor can provide information about running jobs o
  4 KB (584 words) - 20:09, 12 May 2015
• RAL Tier1 weekly operations castor 18/05/2015
  * CMS CASTOR file open time issues affecting batch farm efficiency ...t dataset that is located almost entirely on one node. Shaun has devised a system to redistribute this dataset across the rest of the cmsDisk pool.
  4 KB (566 words) - 14:12, 15 May 2015
• Operations Bulletin 180515
  * There is a [https://indico.cern.ch/event/319821/ pre-GDB on batch systems at CERN this week]. Tier-2 participation encouraged. ** "Consider open science as a production and dissemination system that needs integrated, easy and fair access to several types of shared reso
  46 KB (5,803 words) - 11:48, 16 May 2015
• RAL Tier1 CASTOR Experiments Completed Actions 2012
  | 20120425-01 || Medium || || Gareth || Review batch system limits || Done. Limits have been removed or increased. || 2012-05-23
  4 KB (566 words) - 09:26, 20 May 2015
• Operations Bulletin 250515
  ...ch/twiki/bin/view/LCG/GDBMeetingNotes20150512 summary of the pre-GDB about batch systems] is available. * There is a [https://indico.cern.ch/event/319821/ pre-GDB on batch systems at CERN this week]. Tier-2 participation encouraged.
  46 KB (5,732 words) - 18:32, 23 May 2015
• Operations Bulletin 010615
  * Tier-1problems with secondary database system for Castor - resolved quickly. ...ch/twiki/bin/view/LCG/GDBMeetingNotes20150512 summary of the pre-GDB about batch systems] is available.
  43 KB (5,271 words) - 22:18, 31 May 2015
• Tier1 Operations Report 2015-06-10
  * A problem with the Argus server affected batch job submissions for a while during the early evening of Friday 5th June. Th * The second batch of 2014 CPU purchases has been brought online.
  16 KB (1,741 words) - 13:24, 10 June 2015
• Operations Bulletin 080615
  * Tier-1problems with secondary database system for Castor - resolved quickly. ...ch/twiki/bin/view/LCG/GDBMeetingNotes20150512 summary of the pre-GDB about batch systems] is available.
  43 KB (5,271 words) - 13:02, 6 June 2015
• Operations Bulletin 150615
  * Tier-1problems with secondary database system for Castor - resolved quickly. ...ch/twiki/bin/view/LCG/GDBMeetingNotes20150512 summary of the pre-GDB about batch systems] is available.
  43 KB (5,391 words) - 15:50, 14 June 2015
• Operations Bulletin 220615
  * Tier-1problems with secondary database system for Castor - resolved quickly. ...9/ Agenda]. There will be presentations and discussions on the Information System.
  45 KB (5,632 words) - 13:32, 21 June 2015
• Tier1 Operations Report 2015-06-24
  * The batch job limit for Alice has been completely removed. (It was set at 6000). ...this 15-minute period all services will be unavailable. The Castor storage system will be stopped at 12:45 UTC before the network break, and restarted once t
  15 KB (1,738 words) - 13:30, 24 June 2015
• Operations Bulletin 290615
  * Highlights: Information System discussion started. Use cases and dependencies will be built up and reviewe * T2 feedback: UK response on Information System: Useful for service discovery; minor VO usage; contains too much informatio
  45 KB (5,792 words) - 21:55, 28 June 2015
• Operations Bulletin 060715
  ...setup for the discussion of batch and CE matters in WLCG: project-lcg-gdb-batch at cern.ch. * Highlights: Information System discussion started. Use cases and dependencies will be built up and reviewe
  45 KB (5,742 words) - 21:15, 5 July 2015
• Tier1 Operations Report 2015-07-15
  ...s down. Forcing the FTS system to use more typical settings unblocked the system. The backlog had cleared by the following morning. ...on (with grid middleware delivered via CVMFS) has been extended to a whole batch of WNs.
  12 KB (1,261 words) - 11:39, 15 July 2015
• Operations Bulletin 200715
  ...ntation proposing a new Task Force] studying the future of the Information System. ...tops the HTC solution until after CHEP. Is there interest in testing other batch systems? Raul mentioned SLURM. There is also SGE and Torque.
  46 KB (5,777 words) - 09:41, 20 July 2015
• Operations Bulletin 270715
  ...tops the HTC solution until after CHEP. Is there interest in testing other batch systems? Raul mentioned SLURM. There is also SGE and Torque. ...implement it involves additional complexity and possibly cost. The current system works fine and we therefore see no overriding reason to remove T1-T1 transi
  47 KB (5,972 words) - 08:49, 27 July 2015
• Tier1 Operations Report 2015-07-29
  ...iday morning (24th July) there was a warning level in the fire suppression system in the machine room. The cause seems to have been the failure of a PDU feed ...) redirection accessing Castor; Slow file open times using Xroot; and poor batch job efficiencies.
  13 KB (1,341 words) - 12:17, 29 July 2015
• Tier1 Operations Report 2015-08-12
  ...) redirection accessing Castor; Slow file open times using Xroot; and poor batch job efficiencies. * Deployed changes to remove glite-CLUSTER node from information system and shutdown cream-ce01 and cream-ce02.
  13 KB (1,380 words) - 13:20, 12 August 2015
• Tier1 Operations Report 2015-08-19
  ...ek triggered by the updates to the information provided to the information system by the ARC CEs. This was fixed on Thursday (13th). ...eferred to last week has improved data access rates for the worst cases of batch work (pile-up jobs).
  14 KB (1,580 words) - 13:55, 19 August 2015
• Operations Bulletin 100815
  * Info system: Implementing [https://twiki.cern.ch/twiki/bin/view/EGEE/AllAboutREBUS#REBU ...tops the HTC solution until after CHEP. Is there interest in testing other batch systems? Raul mentioned SLURM. There is also SGE and Torque.
  52 KB (6,730 words) - 22:58, 9 August 2015
• Operations Bulletin 030815
  * Info system: Implementing [https://twiki.cern.ch/twiki/bin/view/EGEE/AllAboutREBUS#REBU ...tops the HTC solution until after CHEP. Is there interest in testing other batch systems? Raul mentioned SLURM. There is also SGE and Torque.
  52 KB (6,730 words) - 23:00, 9 August 2015
• Operations Bulletin 170815
  * Info system: Implementing [https://twiki.cern.ch/twiki/bin/view/EGEE/AllAboutREBUS#REBU ...tops the HTC solution until after CHEP. Is there interest in testing other batch systems? Raul mentioned SLURM. There is also SGE and Torque.
  48 KB (6,103 words) - 23:03, 16 August 2015
• Operations Bulletin 240815
  * Info system: Implementing [https://twiki.cern.ch/twiki/bin/view/EGEE/AllAboutREBUS#REBU * Lydia's document - Setup a system to do data archiving using FTS3
  45 KB (5,578 words) - 19:59, 22 August 2015