QMUL Multicore Gridengine Configuration

From GridPP Wiki
Revision as of 14:58, 5 August 2014 by Daniel Traynor 06cc478329 (Talk | contribs)

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation, search



Create parallel environment (PE) with dynamic cores PE configuration and attach this to th equeue that will run the multicore jobs

qconf -sp smp, (man sge_pe for mor info)

pe_name smp slots 2448 user_lists NONE xuser_lists NONE start_proc_args /bin/true stop_proc_args /bin/true allocation_rule $pe_slots control_slaves FALSE job_is_first_task TRUE urgency_slots min accounting_summary FALSE

   reservations (draining nodes for multi core jobs) need to be enabled in addition
       '-R y' flag enabling reservations is not added by 'sge_submit.sh'
       current workaround is running 'qalter -R y $list_of_mc_jobs' by a cron 
  1. !/bin/bash
  2. reserve slots for jobs requesting 8 cores

. /etc/profile.d/sge.sh /usr/bin/qstat -u \* | grep " 8 " | awk '{ system("/usr/bin/qalter " $1 " -R y")}' /usr/bin/qstat -u \* | grep " 2 " | awk '{ system("/usr/bin/qalter " $1 " -R y")}' /usr/bin/qstat -u \* | grep " 4 " | awk '{ system("/usr/bin/qalter " $1 " -R y")}'


https://twiki.cern.ch/twiki/bin/view/LCG/SGE