Difference between revisions of "RAL Tier1 weekly operations castor 11/8/2017"

From GridPP Wiki
Jump to: navigation, search
(Actions)
(Staffing)
Line 80: Line 80:
 
== Staffing ==
 
== Staffing ==
  
All in
+
RA, GP in
 +
 
 +
CP, MLF out

Revision as of 10:31, 11 August 2017

Draft agenda

1. Problems encountered this week

2. Upgrades/improvements made this week

3. What are we planning to do next week?

4. Long-term project updates (if not already covered)

  1. SL7 upgrade on tape servers
  2. SL5 elimination from CASTOR functional test boxes and tape verification server
  3. CASTOR stress test improvement
  4. Generic CASTOR headnode setup

5. Special topics

6. Actions

7. Anything for CASTOR-Fabric?

8. AoTechnicalB

9. Availability for next week

10. On-Call

11. AoOtherB

Operation problems

Atlas SRMs stop working on Thu evening with no apparent reason RT193370

Ongoing problem with low HC xrootd rates for CMS GGUS129883

gdss753 (atlasStripInput) was removed from production due to hdd failure

Operation news

Rolled out new version of ral-castor-tools

Tape verification servers have been upgraded to SL6

Plans for next week

CASTOR upgrade on Facilities on Thu 17/08/2017

Long-term projects

KH is sorting out access to the HyperV VM created for the CASTOR functional test box. The two tape verification server boxes (lcgcadm01 and lcgcadm02) are now running on SL6

Tape-server migration to aquilon and SL7 upgrade: Try an SL7 upgrade on lcgcts11

CASTOR stress test improvement

Configure multiple instances of a CASTOR generic headnode

Drain and decomission/recomission the 12 generation disk servers

Special actions

Future CASTOR upgrade methodology: CERN need to provide RAL with a customed DB downgrade script for the on-the-fly CASTOR upgrade procedure

Actions

RA to check if the disk server setting, changed to bring disk servers back more quickly after a CASTOR shutdown, is still in place

Ensure that Fabric is on track with the deployment of the new DB hardware

RA to ensure that proper Nagios checks are in place for the xroot manager boxes

GP to talk to AL about service ownership/handover of the xroot manager boxes

RA to continue nagging Martin to replace Facilities headnodes

Ensure that httpd on lcgcadm04 is up and running and the machine points to the right DB RT191377

Staffing

RA, GP in

CP, MLF out