Difference between revisions of "RAL Tier1 Disk Accounting"

Latest revision as of 07:47, 22 August 2008

Introduction

An integrated system to account for disk usage at RAL Tier1 is in place. This currently includes accounting for disk accessed via NFS, dCache and CASTOR.

Service Discovery

A script that discovers configuration information for all types of storage is deployed on each disk server. This configuration can be published to and read from XML, and this allows certain fields to be replaced by information that cannot be automatically discovered.

NFS

The exported file systems are detected from the /etc/exports file on each server, and usage is determined using df.

dCache

The list of pools is determined from /opt/d-cache/config/hostname.poollist on the disk server.

Pool ownership is determined from http://dcache-head.gridpp.rl.ac.uk:2288/poolInfo/pools/*, pool sizes from the setup files on the disk servers, and pool usage from http://dcache-head.gridpp.rl.ac.uk:2288/usageInfo.

CASTOR

Only rudimentary accounting for CASTOR is currently available. Service classes are recognised, but no account is taken of file replication.

Publication

Configuration (e.g., exported file systems, dCache pools) and usage information is published into a MySQL database on a daily basis (for monthly accounting purposes), and usage metrics are published into Ganglia.

Links

• http://www.gridpp.rl.ac.uk/stats/dac/RAL/year.shtml
• http://www.gridpp.rl.ac.uk/stats/dac/RAL-LCG2/year.shtml (LCG experiments only)
• http://ganglia.gridpp.rl.ac.uk/cgi-bin/ganglia-dac/dac-page.pl (ganglia plots)
• http://ganglia.gridpp.rl.ac.uk/cgi-bin/ganglia-dac/dac-page.pl?t=servers (list of disk servers)