RAL Tier1 Disk Accounting
Introduction
An integrated system to account for disk usage at RAL Tier1 is in place. This currently includes accounting for disk accessed via NFS, dCache and CASTOR.
Service Discovery
A script that discovers configuration information for all types of storage is deployed on each disk server. This configuration can be published to and read from XML, and this allows certain fields to be replaced by information that cannot be automatically discovered.
NFS
The exported file systems are detected from the /etc/exports file on each server, and usage is determined using df.
dCache
The list of pools is determined from /opt/d-cache/config/hostname.poollist on the disk server.
Pool ownership is determined from http://dcache-head.gridpp.rl.ac.uk:2288/poolInfo/pools/*, pool sizes from the setup files on the disk servers, and pool usage from http://dcache-head.gridpp.rl.ac.uk:2288/usageInfo.
CASTOR
Only rudimentary accounting for CASTOR is currently available. Service classes are recognised, but no account is taken of file replication.
Publication
Configuration (e.g., exported file systems, dCache pools) and usage information is published into a MySQL database on a daily basis (for monthly accounting purposes), and usage metrics are published into Ganglia.
Links
- http://www.gridpp.rl.ac.uk/stats/dac/RAL/year.shtml
- http://www.gridpp.rl.ac.uk/stats/dac/RAL-LCG2/year.shtml (LCG experiments only)
- http://ganglia.gridpp.rl.ac.uk/cgi-bin/ganglia-dac/dac-page.pl (ganglia plots)
- http://ganglia.gridpp.rl.ac.uk/cgi-bin/ganglia-dac/dac-page.pl?t=servers (list of disk servers)
