Difference between revisions of "RAL Tier1 weekly operations castor 13/04/2018"

From GridPP Wiki
Jump to: navigation, search
(Actions)
Line 31: Line 31:
 
== Operation problems ==
 
== Operation problems ==
  
   * CMS unroutable file issue which was dealt with
+
   * Load issue on genTape - possible fault with the recently deployed 2013 ds?
   * ChrisP reports that a functional test that used to run on lcgcadm05 doesn't work anymore (probably because the machine has been turned off)
+
  * Failed snopuls transfers; FTS point : either a issue with gdss766 or FTS/SRM mis-scheduled the transfers [https://helpdesk.gridpp.rl.ac.uk/Ticket/Display.html?id=206651 RT206651] 
 +
 
 +
   * ChrisP reports that a functional test that used to run on lcgcadm05 doesn't [http://www.example.com link title]work anymore (probably because the machine has been turned off)
 
       * Should have been ported to castor-functional-test1 - maybe just needs repointing?
 
       * Should have been ported to castor-functional-test1 - maybe just needs repointing?
  
Line 59: Line 61:
  
 
== Actions ==  
 
== Actions ==  
 +
 +
Investigate hte history of the failed files on gdss766
  
 
Tell whether a Facilities functional test which was running on on lcgcadm05 is running on castor-functional-test1
 
Tell whether a Facilities functional test which was running on on lcgcadm05 is running on castor-functional-test1

Revision as of 10:02, 13 April 2018

Draft agenda

1. Problems encountered this week

2. Upgrades/improvements made this week

3. What are we planning to do next week?

4. Long-term project updates (if not already covered)

  1. SL5 elimination from CIP and tape verification server
  2. CASTOR stress test improvement
  3. Generic CASTOR headnode setup
  4. Aquilonised headnodes

5. Special topics

6. Actions

7. Review Fabric tasks

  1.   Link

8. AoTechnicalB

9. Availability for next week

10. On-Call

11. AoOtherB

Operation problems

  * Load issue on genTape - possible fault with the recently deployed 2013 ds? 
  * Failed snopuls transfers; FTS point : either a issue with gdss766 or FTS/SRM mis-scheduled the transfers RT206651  
  * ChrisP reports that a functional test that used to run on lcgcadm05 doesn't  link titlework anymore (probably because the machine has been turned off)
     * Should have been ported to castor-functional-test1 - maybe just needs repointing?

Operation news

  * Phani confirmed that a DB flip-over to R26 is possible
  * Oracle patching on R26 and R89 DBs was successfully completed. Had a follow-up meeting to review...
  * Four 2013 generation disk servers deployed into genTape

Plans for next few weeks

  * Attend GridPP meeting
  * Review and submit the CC for macroheadnodes

Long-term projects

Headnode migration to Aquilon - Stager, scheduler, utility and nameserver configuration mainly complete. Stager, scheduler, utility tested seperately and all together on preprod. Combined Stager, scheduler, utility and SRM features in one node which passes functional tests

No point to move Atlas and CMS to the macroheadnode setup since their d1t0 data are moving to Echo over the next two months

HA-proxyfication of the CASTOR SRMs: HA proxy set up has been tested on the SRMs

Target: Combined headnodes running on SL7/Aquilon - implement CERN-style 'Macro' headnodes.

Actions

Investigate hte history of the failed files on gdss766

Tell whether a Facilities functional test which was running on on lcgcadm05 is running on castor-functional-test1

RA/BD: Run GFAL unit tests against CASTOR. Get them here: https://gitlab.cern.ch/dmc/gfal2/tree/develop/test/

RA to check if there is any outstanding action for Fabric

GP/RA to write a Nagios test to check for large number of requests that remain for a long time

Staffing

GP on call, RA on 15/4