RAL Tier1 weekly operations castor 26/01/2015

Operations News

certificates on fdsdss20 to fdsdss30 will be expiring 1st Feb - Gareth has raised with Fabric
castor functional test on lcgccvm02 causing problems - Gareth reviewing
storageD retrieval from castor problems - investigation ongoing
150k zero size files reported last week have almost all been dealt with, CMS files outstanding
Files with no ns or xattr checksum value in castor are failing transfers from RAL to BNL using the BNL FTS3 server.

grid ftp bug in SL6 - stops any globus copy if a client is using a particular library. This is a show stopper for SL6 on disk server.

Removal of redundant CASTOR DB tables Monday 26th 9am (Shaun)
Kernel upgrade on Castor SL5 disk/srm/tape. Tuesday 27/Wednesday 28/Thursday 29
Kernel upgrade on Castor facilities - scheduled for Monday 26th 9-10am
Oracle upgrade of preprod 2nd Feb - will require a short outage
Oracle PSU patching 3rd (Neptune)/4th (Pluto) - castor production at risk 4th Feb

Tasks

DB team need to plan some work which will result in the DBs being under load for approx 1h - not terribly urgent but needs to be done in new year.
Provide new VM? to provide castor client functionality to query the backup DBs
Plan to ensure PreProd represents production in terms of hardware generation are underway
Possible future upgrade to CASTOR 2.1.14-15 post-Christmas
Switch from admin machines: lcgccvm02 to lcgcadm05
Correct partitioning alignment issue (3rd CASTOR partition) on new castor disk servers

Interventions

Rob to pick up DB cleanup change control
Bruno to document processes to control services previously controlled by puppet
Gareth to arrange meeting castor/fab/production to discuss the decommissioning procedures