Difference between revisions of "RAL Tier1 weekly operations castor 03/08/2018"

From GridPP Wiki
Jump to: navigation, search
(Created page with "== Draft agenda == 1. Problems encountered this week 2. Upgrades/improvements made this week 3. What are we planning to do next week? 4. Long-term project updates (if not ...")
 
 
Line 31: Line 31:
 
== Operation problems ==
 
== Operation problems ==
  
   * Problem ingesting Diamond data [https://helpdesk.gridpp.rl.ac.uk/Ticket/Display.html?id=209702 RT209702]
+
   * gdss772 went out prod
  * Power testing:
+
    * ATLAS headnode (lcgclsf01) lost power for 15 mins during machine room electrical testing. Restored after system offline for 15 mins.
+
    * Also a few disk servers
+
 
+
  
 
== Operation news ==
 
== Operation news ==
  
   * Ready to decommission CIP
+
   * CIP is *actually* decommissioned
 +
 
 +
  * Draining of 2014 ds from cmsDisk and atlasStripInput is in progress
  
 
== Plans for next few weeks ==
 
== Plans for next few weeks ==
 
    
 
    
 
   * Push gsi authentication for xrootd in production
 
   * Push gsi authentication for xrootd in production
 +
 +
  * Decommission gdss747
  
 
== Long-term projects ==
 
== Long-term projects ==
Line 50: Line 50:
  
 
Things need doing: log rotation, preparation in aquilon for new instance,...   
 
Things need doing: log rotation, preparation in aquilon for new instance,...   
 
RA writing a new accounting system to match WLCG archival requirements
 
  
 
== Actions ==  
 
== Actions ==  
Line 63: Line 61:
 
== Staffing ==
 
== Staffing ==
  
RA on call
+
GP on call

Latest revision as of 09:51, 3 August 2018

Draft agenda

1. Problems encountered this week

2. Upgrades/improvements made this week

3. What are we planning to do next week?

4. Long-term project updates (if not already covered)

  1. SL5 elimination from CIP and tape verification server
  2. CASTOR stress test improvement
  3. Generic CASTOR headnode setup
  4. Aquilonised headnodes

5. Special topics

6. Actions

7. Review Fabric tasks

  1.   Link

8. AoTechnicalB

9. Availability for next week

10. On-Call

11. AoOtherB

Operation problems

 * gdss772 went out prod

Operation news

 * CIP is *actually* decommissioned
 * Draining of 2014 ds from cmsDisk and atlasStripInput is in progress 

Plans for next few weeks

  * Push gsi authentication for xrootd in production
  * Decommission gdss747

Long-term projects

Oracle installation on Eris complete

Things need doing: log rotation, preparation in aquilon for new instance,...

Actions

JK to investigate why ralreplicas fails and submit a "bug" report

RA/BD: Run GFAL unit tests against CASTOR. Get them here: https://gitlab.cern.ch/dmc/gfal2/tree/develop/test/

GP/RA to write a Nagios test to check for large number of requests on the NewRequests DB table that remain for a long time - the check will run every xxx min (to be aggreed with Production) and issue an alarm if the number exceeds 1,000 for an extended period of time (15 min)

Staffing

GP on call