RAL Tier1 weekly operations castor 25/8/2017

Draft agenda

1. Problems encountered this week

2. Upgrades/improvements made this week

3. What are we planning to do next week?

4. Long-term project updates (if not already covered)

  1. SL7 upgrade on tape servers
  2. SL5 elimination from CASTOR functional test boxes and tape verification server
  3. CASTOR stress test improvement
  4. Generic CASTOR headnode setup

5. Special topics

6. Actions

7. Anything for CASTOR-Fabric?

8. AoTechnicalB

9. Availability for next week

10. On-Call

11. AoOtherB

Operation problems

Alice was blocking many tape-drives at the expense of other VOs, most notably CMS that had a problem migrating data to tape GGUS130193

gdss753 crashed due to hard drive failure RT194148

Operation news

The SRM/SL6 aquilon sandbox was deployed to prod

The new CASTOR functional test box castor-functional-test1.gridpp.rl.ac.uk has all Nagios callouts enabled

Plans for next week

Deployment of the new ral-castor tools version

Continue work on tape-server migration to aquilon

Long-term projects

Tape-server migration to aquilon and SL7 upgrade

CASTOR stress test improvement

Configure multiple instances of a CASTOR generic headnode

Drain and decomission/recomission the 12 generation disk servers

Actions

RA to check if the disk server setting, changed to bring disk servers back more quickly after a CASTOR shutdown, is still in place

Ensure that Fabric is on track with the deployment of the new DB hardware

RA to ensure that proper Nagios checks are in place for the xroot manager boxes

RA and JK to do the the new service checklist for the new functional test box (castor-functional-test1)

GP to talk to AL about service ownership/handover of the xroot manager boxes

Staffing

RA on call