Difference between revisions of "RAL Tier1 weekly operations castor 13/04/2018"
| Line 32: | Line 32: | ||
* Load issue on genTape - possible fault with the recently deployed 2013 ds? | * Load issue on genTape - possible fault with the recently deployed 2013 ds? | ||
| − | * Failed snopuls transfers; FTS point : either a issue with gdss766 or FTS/SRM mis-scheduled the transfers [https://helpdesk.gridpp.rl.ac.uk/Ticket/Display.html?id=206651 RT206651] | + | * Failed snopuls transfers; FTS point : either a issue with gdss766 or FTS/SRM mis-scheduled the transfers [https://helpdesk.gridpp.rl.ac.uk/Ticket/Display.html?id=206651 RT206651] |
| + | * fdsdss21 crashed and removed from production - it is now back in production | ||
| − | * ChrisP reports that a functional test that used to run on lcgcadm05 doesn't | + | * ChrisP reports that a functional test that used to run on lcgcadm05 doesn't work anymore (probably because the machine has been turned off) |
* Should have been ported to castor-functional-test1 - maybe just needs repointing? | * Should have been ported to castor-functional-test1 - maybe just needs repointing? | ||
== Operation news == | == Operation news == | ||
| − | * | + | * GridPP40 meeting |
| − | + | ||
| − | + | ||
== Plans for next few weeks == | == Plans for next few weeks == | ||
| − | * | + | * Incease the slot count on the 2013 genTape disk servers and run a tru to see if it makes a difference on performance |
| − | + | ||
== Long-term projects == | == Long-term projects == | ||
| Line 65: | Line 63: | ||
Tell whether a Facilities functional test which was running on on lcgcadm05 is running on castor-functional-test1 | Tell whether a Facilities functional test which was running on on lcgcadm05 is running on castor-functional-test1 | ||
| + | |||
| + | JK to investigate why ralreplicas fails and submit a "bug" report | ||
| + | |||
| + | JK to investigate castor functional test on facilities | ||
RA/BD: Run GFAL unit tests against CASTOR. Get them here: https://gitlab.cern.ch/dmc/gfal2/tree/develop/test/ | RA/BD: Run GFAL unit tests against CASTOR. Get them here: https://gitlab.cern.ch/dmc/gfal2/tree/develop/test/ | ||
| Line 70: | Line 72: | ||
RA to check if there is any outstanding action for Fabric | RA to check if there is any outstanding action for Fabric | ||
| − | GP/RA to write a Nagios test to check for large number of requests that remain for a long time | + | GP/RA to write a Nagios test to check for large number of requests on the NewRequests DB table that remain for a long time |
== Staffing == | == Staffing == | ||
| − | + | RA on call | |
Revision as of 10:22, 13 April 2018
Contents
Draft agenda
1. Problems encountered this week
2. Upgrades/improvements made this week
3. What are we planning to do next week?
4. Long-term project updates (if not already covered)
1. SL5 elimination from CIP and tape verification server 2. CASTOR stress test improvement 3. Generic CASTOR headnode setup 4. Aquilonised headnodes
5. Special topics
6. Actions
7. Review Fabric tasks
1. Link
8. AoTechnicalB
9. Availability for next week
10. On-Call
11. AoOtherB
Operation problems
* Load issue on genTape - possible fault with the recently deployed 2013 ds? * Failed snopuls transfers; FTS point : either a issue with gdss766 or FTS/SRM mis-scheduled the transfers RT206651 * fdsdss21 crashed and removed from production - it is now back in production
* ChrisP reports that a functional test that used to run on lcgcadm05 doesn't work anymore (probably because the machine has been turned off)
* Should have been ported to castor-functional-test1 - maybe just needs repointing?
Operation news
* GridPP40 meeting
Plans for next few weeks
* Incease the slot count on the 2013 genTape disk servers and run a tru to see if it makes a difference on performance
Long-term projects
Headnode migration to Aquilon - Stager, scheduler, utility and nameserver configuration mainly complete. Stager, scheduler, utility tested seperately and all together on preprod. Combined Stager, scheduler, utility and SRM features in one node which passes functional tests
No point to move Atlas and CMS to the macroheadnode setup since their d1t0 data are moving to Echo over the next two months
HA-proxyfication of the CASTOR SRMs: HA proxy set up has been tested on the SRMs
Target: Combined headnodes running on SL7/Aquilon - implement CERN-style 'Macro' headnodes.
Actions
Investigate hte history of the failed files on gdss766
Tell whether a Facilities functional test which was running on on lcgcadm05 is running on castor-functional-test1
JK to investigate why ralreplicas fails and submit a "bug" report
JK to investigate castor functional test on facilities
RA/BD: Run GFAL unit tests against CASTOR. Get them here: https://gitlab.cern.ch/dmc/gfal2/tree/develop/test/
RA to check if there is any outstanding action for Fabric
GP/RA to write a Nagios test to check for large number of requests on the NewRequests DB table that remain for a long time
Staffing
RA on call
