RAL Tier1 weekly operations castor 25/08/2014

Operations News

Samneet's web query tool is under development, the alpha version is now available for use.
Plan to ensure PreProd represents production in terms of hardware generation are underway.
The database fix for active draining has been rolled out to all Tier 1 (not facilities)
Disk server redeployments continue (i.e. D1T0 reused in D0T1 etc)
one atlas disk server drained (remember we are currently not using passive draining because of issues / readonly and active draining only)

passive draining produces file duplication - fixed in castor 2.1.14-14
The rebalancer has been tested and found to cause problematically large transfermanager queues even with low thresholds set. We will not be using it further until we have a fix.

SL6 castor stalled due to resource limitations
grid ftp bug in SL6 - stops any globus copy if a client is using a particular library. This is a show stopper for SL6 on disk server.

2.1.14-14 testing in preprod
A Tier 1 Database cleanup is planned so as to eliminate a number of excess tables and other entities left over from previous CASTOR versions. This will be change-controlled in the near future.

Tasks

Possible future upgrade to CASTOR 2.1.14-15.
Come up with an SL6 configuration of CASTOR nodes implemented using Aquilon.
Resume draining on the ATLAS instance once draining issues resolved.
Switch from admin machines: lcgccvm02 to lcgcadm05
New VM configured to run against the standby CASTOR database will be created as a front-end for dark data etc queries.
Replace DLF with Elastic Search
Correct partitioning alignment issue (3rd CASTOR partition) on new castor disk servers

Interventions

Castor on Call person
- Rob until Tuesday 26th Aug
- Chris Tuesday 26th Aug – Monday 1st Sept

Staff absence/out of the office:
- Matt out all week
- Shaun out all week
- Brian out all week