Difference between revisions of "Example Build of an ARC/Condor Cluster"
Line 32: | Line 32: | ||
|2 gig | |2 gig | ||
|35 gig | |35 gig | ||
+ | |} | ||
+ | |||
+ | |||
+ | == Worker nodes == | ||
+ | |||
+ | The physical workernodes are described below. | ||
+ | |||
+ | {|border="1" cellpadding="1" | ||
+ | |+Head node hardware | ||
+ | |-style="background:#7C8AAF;color:white" | ||
+ | !Rack names | ||
+ | !CPU type | ||
+ | !CPUs Per Node | ||
+ | !Slots used per cpu | ||
+ | !Slots used per node | ||
+ | !Total nodes | ||
+ | !Total slots | ||
+ | !HepSpec per slot | ||
+ | !Total hepspec | ||
+ | !OS | ||
+ | !RAM | ||
+ | !Disk Space | ||
+ | |||
+ | |||
+ | |- | ||
+ | |r21-n01-4 | ||
+ | |E5620 | ||
+ | |2 | ||
+ | |5 | ||
+ | |10 | ||
+ | |4 | ||
+ | |8 | ||
+ | |12.05 | ||
+ | |482 | ||
+ | |SL6.4 | ||
+ | |24 GB | ||
+ | |1.5 TB | ||
|} | |} |
Revision as of 10:57, 29 August 2014
Introduction
A multi-core job is one which needs to use more than one processor on a node. Until recently, multi-core jobs have not been used on the grid infrastructure. This has all changed because Atlas and other large users have now asked sites to enable multi-core on their clusters.
Unfortunately, it is not just a simple task of setting some parameter on the head node and sitting back while jobs arrive. Different grid system have varying levels of support for multi-core, ranging from non-existent to virtually full support.
This report discusses the multi-core configuration at Liverpool. We decided to build a test cluster using one of the most capable batch systems currently available, called HTCondor (or condor for short). We also decided to fron the system with an ARC/Condor CE.
Infrastructure/Fabric
The multicore test cluster consists of an SL6 headnode to run the ARC CE and the Condor batch system. The headnode has a dedicated set of 11 workernodes of various types, providing a total of 96 single threads of execution.
Head Node
The headnode is a virtual system running on KVM.
Host Name | OS | CPUs | RAM | Disk Space
|
---|---|---|---|---|
hepgrid2.ph.liv.ac.uk | SL6.4 | 8 | 2 gig | 35 gig |
Worker nodes
The physical workernodes are described below.
Rack names | CPU type | CPUs Per Node | Slots used per cpu | Slots used per node | Total nodes | Total slots | HepSpec per slot | Total hepspec | OS | RAM | Disk Space
|
---|---|---|---|---|---|---|---|---|---|---|---|
r21-n01-4 | E5620 | 2 | 5 | 10 | 4 | 8 | 12.05 | 482 | SL6.4 | 24 GB | 1.5 TB |