Difference between revisions of "RAL Tier1 weekly operations castor 13/10/2017"

From GridPP Wiki
Jump to: navigation, search
(Created page with "Parent article: https://www.gridpp.ac.uk/wiki/RAL_Tier1_weekly_operations_castor == Draft agenda == 1. Problems encountered this week 2. Upgrades/improvements made this wee...")
 
 
Line 1: Line 1:
 
Parent article: https://www.gridpp.ac.uk/wiki/RAL_Tier1_weekly_operations_castor
 
Parent article: https://www.gridpp.ac.uk/wiki/RAL_Tier1_weekly_operations_castor
  
== Draft agenda ==
+
== Outline agenda ==
  
 
1. Problems encountered this week
 
1. Problems encountered this week
Line 32: Line 32:
 
== Operation problems ==
 
== Operation problems ==
  
gdss772 went out production
+
LHCb seeing problems with the BringOnline timeout (they want 24h, we always give them 4h)
  
fdsdss36 went out production
+
== Operation news ==
  
cmsDisk is full
+
We have submitted change controls for both the tape server upgrade and Facilities headnode upgrade. They have both now passed.
 
+
== Operation news ==
+
  
 
== Plans for next week ==
 
== Plans for next week ==
Line 44: Line 42:
 
== Long-term projects ==
 
== Long-term projects ==
  
Tape-server migration to aquilon and SL7 upgrade: successfull functional testing has ben done on prerprod
+
Tape-server migration to Aquilon and SL7 upgrade: successful functional testing has been done on preprod
  
 
CASTOR stress test improvement
 
CASTOR stress test improvement
  
Configure multiple instances of a CASTOR generic headnode
+
Implement 'microheadnodes' - multiple instances of a CASTOR generic headnode
  
Drain and decomission/recomission the 12 generation disk servers
+
Drain and decommission/recommission the 12 generation disk servers
  
 
== Actions ==  
 
== Actions ==  
Line 66: Line 64:
 
== Staffing ==
 
== Staffing ==
  
CP out on Mon
+
GP on call until Monday, then RA.
 
+
RA out on A/L
+
 
+
GP on call
+

Latest revision as of 16:12, 23 October 2017

Parent article: https://www.gridpp.ac.uk/wiki/RAL_Tier1_weekly_operations_castor

Outline agenda

1. Problems encountered this week

2. Upgrades/improvements made this week

3. What are we planning to do next week?

4. Long-term project updates (if not already covered)

  1. SL7 upgrade on tape servers
  2. SL5 elimination from CASTOR functional test boxes and tape verification server
  3. CASTOR stress test improvement
  4. Generic CASTOR headnode setup

5. Special topics

6. Actions

7. Anything for CASTOR-Fabric?

8. AoTechnicalB

9. Availability for next week

10. On-Call

11. AoOtherB

Operation problems

LHCb seeing problems with the BringOnline timeout (they want 24h, we always give them 4h)

Operation news

We have submitted change controls for both the tape server upgrade and Facilities headnode upgrade. They have both now passed.

Plans for next week

Long-term projects

Tape-server migration to Aquilon and SL7 upgrade: successful functional testing has been done on preprod

CASTOR stress test improvement

Implement 'microheadnodes' - multiple instances of a CASTOR generic headnode

Drain and decommission/recommission the 12 generation disk servers

Actions

RA to check if the disk server setting, changed to bring disk servers back more quickly after a CASTOR shutdown, is still in place

Ensure that Fabric is on track with the deployment of the new DB hardware

RA to ensure that proper Nagios checks are in place for the xroot manager boxes

RA and JK to do the the new service checklist for the new functional test box (castor-functional-test1)

GP to talk to AL about service ownership/handover of the xroot manager boxes

Staffing

GP on call until Monday, then RA.