Difference between revisions of "ARC HTCondor Accounting"

From GridPP Wiki
Jump to: navigation, search
 
Line 1: Line 1:
 +
== Introduction ==
 +
 
This page explains how APEL accounting is done at the RAL Tier-1 in order to ensure that CPU benchmarks are taken into account properly.
 
This page explains how APEL accounting is done at the RAL Tier-1 in order to ensure that CPU benchmarks are taken into account properly.
  

Latest revision as of 13:31, 8 September 2017

Introduction

This page explains how APEL accounting is done at the RAL Tier-1 in order to ensure that CPU benchmarks are taken into account properly.

HTCondor configuration

The HTCondor configuration on the worker nodes includes the following, for example:

RalScaling = 2.14
STARTD_ATTRS = $(STARTD_ATTRS) RalScaling

Here RalScaling is a scaling factor used to normalize the CPU benchmarks. Quattor is configured to do this automatically.

The HTCondor configuration on the ARC CEs contains:

# CPU benchmark scaling factor
MachineRalScaling = "$$([ifThenElse(isUndefined(RalScaling), 1.00, RalScaling)])"
SUBMIT_EXPRS = $(SUBMIT_EXPRS) MachineRalScaling

This causes the attribute MachineRalScaling to be added to job ClassAds, and is available as MATCH_EXP_MachineRalScaling.

ARC CE configuration

We include the following line in the [grid-manager] section of /etc/arc.conf:

authplugin="FINISHING timeout=60,onfailure=pass,onsuccess=pass /usr/local/bin/scaling_factors_plugin.py %S %C %I"

where scaling_factors_plugin.py is available here: https://raw.githubusercontent.com/alahiff/ral-arc-ce-plugins/master/scaling_factors_plugin.py. This scales the CPU and walltimes in the files from which the ARC CE extracts accounting information.

The following lines should be included in /etc/arc.conf in order to ensure that the ARC CE will send its accounting records to APEL:

jobreport="APEL:http://mq.cro-ngi.hr:6162"
jobreport_options="urbatch:1000,archiving:/var/run/arc/urs,topic:/queue/global.accounting.cpu.central,gocdb_name:RAL-LCG2,use_ssl:true,Network:PROD,benchmark_type:Si2k,benchmark_value:1006.00"
jobreport_credentials="/etc/grid-security/hostkey.pem /etc/grid-security/hostcert.pem /etc/grid-security/certificates"
jobreport_publisher="jura"

The site name and benchmark above should be modified as necessary of course.

APEL

In order for an ARC CE to have permission to send accounting records to the production APEL broker, the CE must be registered in the GOC DB as a glite-APEL node type with the host DN specified.