RAL Tier1 weekly operations castor 30/6/2017

From GridPP Wiki
Jump to: navigation, search

Draft agenda

1. Problems encountered this week

2. Upgrades/improvements made this week

3. What are we planning to do next week?

4. Long-term project updates (if not already covered) 

  1. SL7 upgrade on tape servers
  2. SL5 elimination from CASTOR functional test boxes and tape verification server
  3. CASTOR stress test improvement
  4. Generic CASTOR headnode setup
  5. Virtualisation of the CASTOR headnodes

5. Special topics 

  1. OCF 14 firmware update

6. Actions

7. Anything for CASTOR-Fabric?

8. AoTechnicalB

9. Availability for next week

10. On-Call

11. AoOtherB

Operation problems

Problems with srmbed on Atlas SRMs RT190742

High rate of Atlas transfer failures of type "TRANSFER [70] TRANSFER globus_xio: Unable to connect to gdss644.gridpp.rl.ac.uk:51630 globus_xio: System error in connect: Connection refused globus_xio: A system call failed: Connection refused" GGUS129098

Operation news

A triger was deployed to the Atlas SRM DB to fix the issue of srmbed not staying up due to incoming requests with multiple slahes RT190742

Plans for next week

Roll-out of the WAN tuning params on all CASTOR Tier-1 instances

Long-term projects

SL6 upgrade on functional test boxes and tape verification server: aquilon configuration is complete for the functional test box, all Nagios tests are in place and a creation of HyperV VM is undeway to replace the old box. The test for tape verification server is pending.

Tape-server migration to aquilon and SL7 upgrade

CASTOR stress test improvement

Configure multiple instance of a CASTOR generic headnode

Virtualise CASTOR headnodes; currently enquiring whether we move to VMware or HyperV

Special actions

Future CASTOR upgrade methodology: CERN need to provide RAL with a customed DB downgrade script for the on-the-fly CASTOR upgrade procedure

Actions

Ensure that Fabric is on track with the deployment of the new DB hardware

Drain and decomission/recomission the 12 generation disk servers

RA to ensure that proper Nagios checks are in place for the xroot manager boxes

GP to talk to AL about service ownership/handover of the xroot manager boxes

RA to continue nagging Martin to replace Facilities headnodes

Staffing

RA on call until Thursday then GP

Retrieved from "https://www.gridpp.ac.uk/w/index.php?title=RAL_Tier1_weekly_operations_castor_30/6/2017&oldid=14866"