RAL Tier1 weekly operations castor 14/09/2018

From GridPP Wiki
Jump to: navigation, search

Standing agenda

1. Problems encountered this week

2. Upgrades/improvements made this week

3. What are we planning to do next week?

4. Long-term project updates (if not already covered)

  1. SL5 elimination from CIP and tape verification server
  2. CASTOR stress test improvement
  3. Generic CASTOR headnode setup
  4. Aquilonised headnodes

5. Special topics

6. Actions

7. Review Fabric tasks

  1.   Link

8. AoTechnicalB

9. Availability for next week

10. On-Call

11. AoOtherB

Operation problems

LHCb issue again with failed downloads from CASTOR to WN GGUS137136


Operation news

 * Completed Oracle patching of preprod and vcert
 * Preprod instance is back up and running with the new host names
 * OPS tests are coming in for the srm-wlcgtape endpoint of the new CASTOR instance

Plans for next few weeks

  * Push gsi authentication for xrootd in production
  * Decommission gdss747

Long-term projects

gsi authentication for xrootd: 1) Return preprod to a working state 2) Ask Raja and Tim to test the gsi config on preprod 3) Perform a stress test

New CASTOR WLCGTape instance: Upgraded stagers and ns nodes to 2.1.17-35. Need to upgrade tape servers to make migrations/recalls to wirk

Things need doing: log rotation, xrootd for ALICE

Actions

JK to investigate why ralreplicas fails and submit a "bug" report

RA/BD: Run GFAL unit tests against CASTOR. Get them here: https://gitlab.cern.ch/dmc/gfal2/tree/develop/test/

GP/RA to write a Nagios test to check for large number of requests on the NewRequests DB table that remain for a long time - the check will run every xxx min (to be aggreed with Production) and issue an alarm if the number exceeds 1,000 for an extended period of time (15 min)

AOB

LHCb disk servers

Staffing