Difference between revisions of "RAL Tier1 weekly operations castor 11/8/2017"
(Created page with "== Draft agenda == 1. Problems encountered this week 2. Upgrades/improvements made this week 3. What are we planning to do next week? 4. Long-term project updates (if not ...") |
(→Operation news) |
||
| (7 intermediate revisions by one user not shown) | |||
| Line 32: | Line 32: | ||
Atlas SRMs stop working on Thu evening with no apparent reason [https://helpdesk.gridpp.rl.ac.uk/Ticket/Display.html?id=193370 RT193370] | Atlas SRMs stop working on Thu evening with no apparent reason [https://helpdesk.gridpp.rl.ac.uk/Ticket/Display.html?id=193370 RT193370] | ||
| − | Ongoing problem with low HC xrootd rates for CMS [https://ggus.eu/index.php?mode=ticket_info&ticket_id=129883 | + | Ongoing problem with low HC xrootd rates for CMS [https://ggus.eu/index.php?mode=ticket_info&ticket_id=129883 GGUS129883] |
| + | |||
| + | gdss753 (atlasStripInput) was removed from production due to hdd failure | ||
== Operation news == | == Operation news == | ||
| + | Rolled out new version of ral-castor-tools | ||
| + | |||
| + | Tape verification servers (lcgcadm01 and lcgcadm02) have been upgraded to SL6 | ||
== Plans for next week == | == Plans for next week == | ||
| + | CASTOR upgrade on Facilities on Thu 17/08/2017 | ||
== Long-term projects == | == Long-term projects == | ||
| − | + | KH is sorting out access to the HyperV VM created for the CASTOR functional test box. The two tape verification | |
| − | + | server boxes (lcgcadm01 and lcgcadm02) are now running on SL6 | |
| − | The | + | |
| − | Tape-server migration to aquilon and SL7 upgrade | + | Tape-server migration to aquilon and SL7 upgrade: Try an SL7 upgrade on lcgcts11 |
CASTOR stress test improvement | CASTOR stress test improvement | ||
| Line 60: | Line 65: | ||
== Actions == | == Actions == | ||
| + | |||
| + | RA to check if the disk server setting, changed to bring disk servers back more quickly after a CASTOR shutdown, is still in place | ||
Ensure that Fabric is on track with the deployment of the new DB hardware | Ensure that Fabric is on track with the deployment of the new DB hardware | ||
| Line 73: | Line 80: | ||
== Staffing == | == Staffing == | ||
| − | + | RA, GP in | |
| + | |||
| + | CP, MLF out | ||
Latest revision as of 10:34, 11 August 2017
Contents
Draft agenda
1. Problems encountered this week
2. Upgrades/improvements made this week
3. What are we planning to do next week?
4. Long-term project updates (if not already covered)
1. SL7 upgrade on tape servers 2. SL5 elimination from CASTOR functional test boxes and tape verification server 3. CASTOR stress test improvement 4. Generic CASTOR headnode setup
5. Special topics
6. Actions
7. Anything for CASTOR-Fabric?
8. AoTechnicalB
9. Availability for next week
10. On-Call
11. AoOtherB
Operation problems
Atlas SRMs stop working on Thu evening with no apparent reason RT193370
Ongoing problem with low HC xrootd rates for CMS GGUS129883
gdss753 (atlasStripInput) was removed from production due to hdd failure
Operation news
Rolled out new version of ral-castor-tools
Tape verification servers (lcgcadm01 and lcgcadm02) have been upgraded to SL6
Plans for next week
CASTOR upgrade on Facilities on Thu 17/08/2017
Long-term projects
KH is sorting out access to the HyperV VM created for the CASTOR functional test box. The two tape verification server boxes (lcgcadm01 and lcgcadm02) are now running on SL6
Tape-server migration to aquilon and SL7 upgrade: Try an SL7 upgrade on lcgcts11
CASTOR stress test improvement
Configure multiple instances of a CASTOR generic headnode
Drain and decomission/recomission the 12 generation disk servers
Special actions
Future CASTOR upgrade methodology: CERN need to provide RAL with a customed DB downgrade script for the on-the-fly CASTOR upgrade procedure
Actions
RA to check if the disk server setting, changed to bring disk servers back more quickly after a CASTOR shutdown, is still in place
Ensure that Fabric is on track with the deployment of the new DB hardware
RA to ensure that proper Nagios checks are in place for the xroot manager boxes
GP to talk to AL about service ownership/handover of the xroot manager boxes
RA to continue nagging Martin to replace Facilities headnodes
Ensure that httpd on lcgcadm04 is up and running and the machine points to the right DB RT191377
Staffing
RA, GP in
CP, MLF out
