RAL Tier1 weekly operations castor 08/06/2018

Draft agenda

1. Problems encountered this week

2. Upgrades/improvements made this week

3. What are we planning to do next week?

4. Long-term project updates (if not already covered)

  1. SL5 elimination from CIP and tape verification server
  2. CASTOR stress test improvement
  3. Generic CASTOR headnode setup
  4. Aquilonised headnodes

5. Special topics

6. Actions

7. Review Fabric tasks

  1.   Link

8. AoTechnicalB

9. Availability for next week

10. On-Call

11. AoOtherB

Operation problems

  * Issues with the CIP

  * gdss733, gdss801 and gdss817 failed and went out of production

  * Roundabout route of diamond recalls via facD0T1 

Operation news

  * CASTOR Facilities DHCP patching done on Thu 31/05

  * Tape accounting system has been deployed and some feed back has been received

Plans for next few weeks

   * Leave gdss801 in RO because it has faulty battery 

   * RA to deploy the new information system for tape

   * Need to gracefully shut down the current information system

   * Sort out status of the remaining SL5 tape verification server 

Long-term projects

Vcert DB upgraded to the latest CASTOR schemas and VMware CASTOR headnodes passed functional tests CASTOR plan page

RA writing a new accounting system to match WLCG archival requirements

Actions

JK to investigate why ralreplicas fails and submit a "bug" report

RA/BD: Run GFAL unit tests against CASTOR. Get them here: https://gitlab.cern.ch/dmc/gfal2/tree/develop/test/

GP/RA to write a Nagios test to check for large number of requests on the NewRequests DB table that remain for a long time - the check will run every xxx min (to be aggreed with Production) and issue an alarm if the number exceeds 1,000 for an extended period of time (15 min)

Staffing

RA on call for next week