Difference between revisions of "RAL Tier1 weekly operations castor 25/05/2018"

From GridPP Wiki
Jump to: navigation, search
(Operation problems)
(Operation problems)
 
Line 33: Line 33:
 
   * gdss732 went out production
 
   * gdss732 went out production
  
   * CIP decommissioning created some complications [https://ggus.eu/index.php?mode=ticket_info&ticket_id=135293 GGUS135293] [https://helpdesk.gridpp.rl.ac.uk/Ticket/Display.html?id=208336 link RT208336]
+
   * CIP decommissioning created some complications [https://ggus.eu/index.php?mode=ticket_info&ticket_id=135293 GGUS135293] [https://helpdesk.gridpp.rl.ac.uk/Ticket/Display.html?id=208336 RT208336]
  
 
== Operation news ==
 
== Operation news ==

Latest revision as of 13:44, 25 May 2018

Draft agenda

1. Problems encountered this week

2. Upgrades/improvements made this week

3. What are we planning to do next week?

4. Long-term project updates (if not already covered)

  1. SL5 elimination from CIP and tape verification server
  2. CASTOR stress test improvement
  3. Generic CASTOR headnode setup
  4. Aquilonised headnodes

5. Special topics

6. Actions

7. Review Fabric tasks

  1.   Link

8. AoTechnicalB

9. Availability for next week

10. On-Call

11. AoOtherB

Operation problems

  * gdss732 went out production
  * CIP decommissioning created some complications GGUS135293 RT208336

Operation news

  * First round of DHCP patching on CASTOR nodes completed

Plans for next few weeks

   * CASTOR Facilities DHCP patching Thu 31/05
   * RA to deploy the new information system for tape
   * Need to gracefully shut down the current information system
   * Sort out status of the remaining SL5 tape verification server 

Long-term projects

Headnode migration to Aquilon - The former vcert headnodes have been configured as CASTOR macroheadnodes and they pass functional tests SL7 name severs installs ok and pass functional tests. The six VMware VMs for generic headnodes/nameservers requested RT ticket and DNS/MagDB entries added by Kash. Floating IP was obtained for vcert-stager-haproxy.gridpp.rl.ac.uk to test HAproxy

RA writing a new accounting system to match WLCG archival requirements

Actions

JK to investigate why ralreplicas fails and submit a "bug" report

RA/BD: Run GFAL unit tests against CASTOR. Get them here: https://gitlab.cern.ch/dmc/gfal2/tree/develop/test/

GP/RA to write a Nagios test to check for large number of requests on the NewRequests DB table that remain for a long time - the check will run every xxx min (to be aggreed with Production) and issue an alarm if the number exceeds 1,000 for an extended period of time (15 min)

Staffing

GP on call for next week RA away from mid-afternoon Thu to following Tue