Search results
Create the page "Batch System" on this wiki!
- * Last week there was a [http://indico.cern.ch/event/272785/ pre-GDB on batch systems] and a [http://indico.cern.ch/event/272619/other-view?view=standard ...is week there is a [http://indico.cern.ch/event/272785/ pre-GDB meeting on batch systems] and a [http://indico.cern.ch/event/272619/other-view?view=standard48 KB (6,293 words) - 07:36, 31 March 2014
- * Last week there was a [http://indico.cern.ch/event/272785/ pre-GDB on batch systems] and a [http://indico.cern.ch/event/272619/other-view?view=standard ...reviewed are capable of supporting multicore jobs however a tuning of each system is required to be able to absorb them (draining/reservation of resources) w45 KB (5,701 words) - 09:21, 7 April 2014
- * Last week there was a [http://indico.cern.ch/event/272785/ pre-GDB on batch systems] and a [http://indico.cern.ch/event/272619/other-view?view=standard * CERN batch capacity migrated to SLC6 was at 65% last week.52 KB (6,980 words) - 08:19, 15 April 2014
- ...ed. Multiple disk failures were being reported by the disk controller. The system was returned to production yesterday evening (8th April) and is being drain * The EMI3 Argus server is now in use everywehere in the batch farm.14 KB (1,599 words) - 11:33, 14 April 2014
- * CERN batch capacity migrated to SLC6 was at 65% last week. * The APEL accounting system has been undergoing database maintenance to improve performance and reliabi45 KB (5,796 words) - 22:44, 21 April 2014
- ... CMS deleting files to make space and a reduction in the number of running batch jobs relieved thd strain. ... brought into use. (Currently Atlas 3D/Frontier still uses the OGMA datase system, although this was also changed to update from CERN using Oracle Golden Gat14 KB (1,492 words) - 13:08, 10 December 2014
- ...bers of jobs (from T2K) submitted to the batch system by the WMSs. A batch system parameter (max number of gridftp connections on ARC CEs) has been increased | System be decommissioned. (Replaced my myproxy.gridpp.rl.ac.uk).14 KB (1,557 words) - 13:24, 30 April 2014
- * CERN batch capacity migrated to SLC6 was at 65% last week. * The APEL accounting system has been undergoing database maintenance to improve performance and reliabi41 KB (5,106 words) - 19:52, 5 May 2014
- * Testing CVMFS Client version 2.1.19 ongoing. This is now rolled out to one batch of worker nodes. So far so good. | Outage of tape system for update of tape library controller. (Postponed from 13th May).13 KB (1,393 words) - 10:46, 14 May 2014
- <!-- ******************Start Limits On Batch System Jobs***************** -----> ...; padding-top: 0.1em; padding-bottom: 0.1em;" | Limits on concurrent batch system jobs.17 KB (1,612 words) - 11:29, 27 February 2019
- ...onday covered some site reports and OS related updates. Tuesday's focus is batch systems. Wednesday covers IPv6, security and benchmarking. Thursday storage ...naged services from Quattor to a new Puppet based Configuration Management system.41 KB (5,148 words) - 09:38, 2 June 2014
- ...onday covered some site reports and OS related updates. Tuesday's focus is batch systems. Wednesday covers IPv6, security and benchmarking. Thursday storage ...naged services from Quattor to a new Puppet based Configuration Management system.41 KB (5,148 words) - 07:10, 9 June 2014
- * Today (11th June) a new tape controller system (ACSLS) is being installed. There have been some problems with the new serv | Castor (all SRM endpoints) and batch (all CEs)15 KB (1,592 words) - 12:26, 11 June 2014
- 0) Find and read the "ARC Computing Element System Administrator Guide". <br> 3) Ensure the machine can submit to the batch system & has all of the users. <br>11 KB (1,578 words) - 15:50, 12 June 2014
- ...ieve this by using the (Condor) Submit module of a glideinWMS as the batch system and then channeling the jobs via the glideinWMS to the gridpp cloud. <br>925 B (154 words) - 11:11, 23 August 2019
- ...r their resources into a ‘pool’ via the [https://e-grant.egi.eu eGrant system]. [https://wiki.egi.eu/wiki/Resource_Allocation_Process More information] i * Castor and batch services currently down for Castor Namserver Upgrade (to version 2.1.14). I39 KB (4,952 words) - 19:40, 13 June 2014
- ...n there is contention between other processes for physical memory will the system force physical memory into swap and push the physical memory used towards t1 KB (241 words) - 10:28, 11 February 2015
- ...] needs updating and a consensus! Could the SEs implement some reservation system internally? Is there merit in the suggestion to make use of [https://www.gr * KeyDocs are going to be reviewed (in next 4 weeks) as the system is not working (or not adding anything) in some areas.43 KB (5,584 words) - 12:52, 7 July 2014
- '''UKI-NORTHGRID-MAN-HEP''': Multicore and passing parameters to the batch system testing requested by the experiments through the WLCG Task Force Alessandra8 KB (1,155 words) - 11:09, 13 March 2015
- ...egi-trustanchors.repo Finally, for historical reasons related to our build system, we also installed these two repos from the glite 3.2 instructions - jpacka ...wever you do it, make a munge key using /usr/sbin/create-munge-key on some system that has munge installed on it (this one?) and use the resulting key on all15 KB (2,429 words) - 10:18, 31 July 2015
- | Email everyone on how to hack the publishing system to avoid publishing incorrect GlueSubClusterWNTmpDir. | Plan out the future of CE/Batch System integration. Torque/maui are not supported by EGI. Layout an agenda with pr33 KB (5,297 words) - 10:13, 15 November 2017
- ...lable, called HTCondor (or CONDOR for short). We also decided to front the system with an ARC CE. You'll need a copy of the ARC System Admin Manual.121 KB (17,569 words) - 08:26, 28 November 2019
- ...or allocation. It is a brokering service only. There is one request in the system for cloud resources. * News: CERN-IT to terminate the SLC5-based interactive and batch services (lxplus5 and lxbatch5) soon. The current target date is 30 Septemb42 KB (5,358 words) - 10:48, 1 September 2014
- ... jobs at CCIN2P3 and of the method to passing job requirement arguments to batch systems via CE. ([https://indico.cern.ch/event/339461/ Agenda]) * OSG following up on how to discover HTCondor CEs in the information system.46 KB (6,062 words) - 10:07, 15 September 2014
- ...ring Saturday evening. It was restarted and tested but no fault found. The system was returned to service yesterday (30th Sep). * One batch of worker nodes (64 machines) have had Linux cgroups configured to enforce13 KB (1,429 words) - 10:06, 8 October 2014
- ==RAL Tier1 Incident 20130626 Failure of RAL CVMFS Stratum1 Triggered Batch Farm Problems=====Description:=== ...s over to use other replicas. However this did not happen across the Tier1 batch farm where many nodes were running a version of the CVMFS client in which t12 KB (1,968 words) - 15:13, 16 September 2014
- ...ordinating/publicising local site-admin tools (Nagios plugins, local batch system dashboards)906 B (116 words) - 08:35, 5 June 2018
- ...of the systems affected was the argus server and this caused a problem for batch job submissions for an hour or so. * The Atlas Frontier service will be switched to use the new database system that updates from CERN using Oracle "GoldenGate" on 24th Sep.12 KB (1,195 words) - 14:07, 17 September 2014
- ... jobs at CCIN2P3 and of the method to passing job requirement arguments to batch systems via CE. ([https://indico.cern.ch/event/339461/ Agenda]) * OSG following up on how to discover HTCondor CEs in the information system.48 KB (6,422 words) - 08:45, 23 September 2014
- *** Durham: Batch system upgrade led to one outage and a University wide internet connection loss le * Ongoing tests ongoing with some batch jobs for the LHC VOs running in SL6 containers on worker nodes running SL7.42 KB (5,079 words) - 18:37, 19 March 2017
- ...h hosts the Atlas and GEN SRM databases) was moved to the standby database system. This required an outage of the Castor Atlas and GEN instances which lasted ...day morning (5th Oct). It was restarted and tested but no fault found. The system was returned to service this morning (8th Oct).15 KB (1,740 words) - 10:50, 15 October 2014
- ...completed in October 2008. The first is to provide information about batch system memory limits. The second is to give an update on networking issues that ca [[Background to batch system memory request for details:]]17 KB (2,669 words) - 11:14, 1 March 2016
- ...ol for use with both local batch systems and the DIRAC workload management system. It's maintained by Ulrik Egede (ulrik<AT>monash.edu) - please email if you ...want to use it to submit jobs to the grid rather than just for local batch system submission), there are a few steps you need to go through:15 KB (2,621 words) - 14:40, 27 May 2020
- <!-- ******************Start Limits On Batch System Jobs***************** -----> ...; padding-top: 0.1em; padding-bottom: 0.1em;" | Limits on concurrent batch system jobs.16 KB (1,535 words) - 13:37, 20 June 2018
- <!-- ******************Start Limits On Batch System Jobs***************** -----> ...; padding-top: 0.1em; padding-bottom: 0.1em;" | Limits on concurrent batch system jobs.16 KB (1,476 words) - 07:41, 16 May 2018
- ...y maximise throughput. Experiments show that, in order to fully utilize a system, it is often necessary to choose a number of slots that is higher than th Sites have to transmit (via the BDII and the accounting system) a couple more things; the power of the site and the amount of work done.8 KB (1,284 words) - 14:03, 2 October 2017
- ...tlasDataDisk - D1T0) had failed for the third time on around a month. This system has been completely drained and is undergoing further investigations. ...regular "PSU" patches will be applied to the Pluto Castor standby database system on Monday (27th Oct) and to the Pluto production database on Wednesday (29t14 KB (1,569 words) - 13:13, 29 October 2014
- * Machine/Job features: Concluded on a single architecture for cloud and batch implementations. * The OGMA database system (Atlas3D/Frontier) has been updated and switched to using Oracle GoldenGate40 KB (4,976 words) - 10:25, 27 October 2014
- * Machine/Job features: Concluded on a single architecture for cloud and batch implementations. * The OGMA database system (Atlas3D/Frontier) has been updated and switched to using Oracle GoldenGate42 KB (5,228 words) - 10:37, 4 November 2014
- * Machine/Job features: Concluded on a single architecture for cloud and batch implementations. LHCB having cvmfs trouble at IC, which was likely caused by a batch of naughty CMS jobs ruining it for everyone else. LHCB re-enabled IC to see48 KB (6,138 words) - 09:19, 10 November 2014
- * Multicore: Passing parameters to batch system discussion started. Limited tests. ATLAS 40% resources now MC. Still 37 sit39 KB (4,698 words) - 18:46, 16 November 2014
- ...caster test cluster runs using torque, interfacing with a DPM SE, so other batch/storage combinations are not as well tested. ''This assumes that the workernode has been setup to work within the batch system, and the users and groups have been set up. It would technically be possibl25 KB (4,174 words) - 09:57, 23 July 2015
- The tarball versions listed may look convoluted, but there is a system to them! The first part denotes what middleware was used to build the tarba ... vomses, CA and CRLs. For a WN you will have to set up the users and batch system yourself.11 KB (1,832 words) - 10:02, 23 January 2018
- * Multicore: Passing parameters to batch systems [https://indico.cern.ch/event/272779/session/0/contribution/8/mater ...n F ticketed the CA concerning a possible problem with the ticket reminder system. JK has responded with a reply, and asked that similar tickets in the futur50 KB (6,536 words) - 00:08, 7 December 2014
- ...on (but as he also notes - what's getting loaded and causing the problem - Batch, CE or WNs?). Kashif reckons the argus server, and suggests a handy glexec Sno+ spotted malloc errors at Lancaster. The problems seemed to survive one batch of fixes, but I asked again if they still see problems after running a good117 KB (18,736 words) - 11:05, 4 January 2016
- * Following a restriction on numbers of CMS batch jobs imposed during problems a week or so ago the CMS jobs limits on the fa ... brought into use. (Currently Atlas 3D/Frontier still uses the OGMA datase system, although this was also changed to update from CERN using Oracle Golden Gat14 KB (1,504 words) - 14:50, 17 December 2014
- ... brought into use. (Currently Atlas 3D/Frontier still uses the OGMA datase system, although this was also changed to update from CERN using Oracle Golden Gat | Due to Kernel patching of EGI ADV 20141217, the RAL tier1 batch farm worker nodes will need to be rebooted.17 KB (1,780 words) - 12:56, 7 January 2015
- WMS - Workload Managment System. The central part of the DIRAC system2 KB (306 words) - 12:29, 12 March 2015
- ...ostic tests were being run on the faulty router – however after that the system restarted and took over as the master router of the pair (which was not ant ...the week. Intermittent timeouts were seen on the tests. The number of LHCb batch jobs has been restricted to try and reduce the problem. In addition, during14 KB (1,559 words) - 10:52, 21 January 2015
- * We are now fully using cgroups to control job memory limits on the batch farm. ... brought into use. (Currently Atlas 3D/Frontier still uses the OGMA datase system, although this was also changed to update from CERN using Oracle Golden Gat13 KB (1,290 words) - 11:23, 11 February 2015
