Difference between revisions of "Tier1 Operations Report 2019-10-16"

From GridPP Wiki
Jump to: navigation, search
()
()
Line 186: Line 186:
 
| style="background-color: #b7f1ce; border-bottom: 1px solid silver; text-align: center; font-size: 1em; font-weight: bold; margin-top: 0; margin-bottom: 0; padding-top: 0.1em; padding-bottom: 0.1em;" | GGUS Tickets Closed Last week
 
| style="background-color: #b7f1ce; border-bottom: 1px solid silver; text-align: center; font-size: 1em; font-weight: bold; margin-top: 0; margin-bottom: 0; padding-top: 0.1em; padding-bottom: 0.1em;" | GGUS Tickets Closed Last week
 
|}
 
|}
 +
  
 
{| border=1 align=center
 
{| border=1 align=center
Line 217: Line 218:
 
| very urgent
 
| very urgent
 
| NGI_UK
 
| NGI_UK
| solved
+
| verified
| 2019-10-09 11:54:00
+
| 2019-10-14 12:47:00
 
| FTS3 problem for transfers executing at RAL FTS3 server
 
| FTS3 problem for transfers executing at RAL FTS3 server
 
| WLCG
 
| WLCG
Line 233: Line 234:
 
| WLCG
 
| WLCG
 
|-
 
|-
| 143402
+
| 143406
 
| USER
 
| USER
| none
+
| cms
 
| RAL-LCG2
 
| RAL-LCG2
 
| urgent
 
| urgent
 
| NGI_UK
 
| NGI_UK
| solved
+
| closed
| 2019-10-09 11:52:00
+
| 2019-10-15 23:59:00
| CVMFS IPv6 connection issues at RAL
+
| transfers failing to T1_UK_RAL_Disk
| EGI
+
| WLCG
 
|-
 
|-
| 143387
+
| 143402
 
| USER
 
| USER
| snoplus.snolab.ca
+
| none
 
| RAL-LCG2
 
| RAL-LCG2
| less urgent
+
| urgent
 
| NGI_UK
 
| NGI_UK
| solved
+
| verified
| 2019-10-04 12:35:00
+
| 2019-10-09 11:58:00
| Transfer issues to RAL
+
| CVMFS IPv6 connection issues at RAL
 
| EGI
 
| EGI
 
|-
 
|-
| 143324
+
| 143384
 
| TEAM
 
| TEAM
| lhcb
+
| atlas
 
| RAL-LCG2
 
| RAL-LCG2
 
| very urgent
 
| very urgent
 
| NGI_UK
 
| NGI_UK
 
| closed
 
| closed
| 2019-10-04 23:59:00
+
| 2019-10-10 23:59:00
| File recreation canceled since the file cannot be routed to tape
+
| Low efficiency of Atlas transfers to sites in UK cloud
 
| WLCG
 
| WLCG
 
|-
 
|-
| 143231
+
| 143379
 
| USER
 
| USER
| other
+
| cms
 
| RAL-LCG2
 
| RAL-LCG2
 
| urgent
 
| urgent
| EGI CVMFS Service
+
| NGI_UK
 
| closed
 
| closed
| 2019-10-04 23:59:00
+
| 2019-10-10 23:59:00
| CVMFS repo dirac.egi.eu updates are not propagated
+
| issues with RAL FTS?
| EGI
+
| WLCG
 
|-
 
|-
| 143218
+
| 142689
| TEAM
+
| USER
| lhcb
+
| cms
 
| RAL-LCG2
 
| RAL-LCG2
| urgent
+
| very urgent
 
| NGI_UK
 
| NGI_UK
 
| closed
 
| closed
| 2019-10-08 23:59:00
+
| 2019-10-15 23:59:00
| FTS3 transfers problem to GRIDKA for transfers executing at RAL FTS3 server
+
| Transfer failing to RAL_Disk
 
| WLCG
 
| WLCG
 
|-
 
|-
| 142835
+
| 140447
 
| USER
 
| USER
| snoplus.snolab.ca
+
| dteam
 
| RAL-LCG2
 
| RAL-LCG2
 
| less urgent
 
| less urgent
 
| NGI_UK
 
| NGI_UK
 
| closed
 
| closed
| 2019-10-02 23:59:00
+
| 2019-10-11 23:59:00
| Connection Issues
+
| packet loss outbound from RAL-LCG2 over IPv6
 
| EGI
 
| EGI
 
|}
 
|}
 +
 +
 +
  
 
<!-- **********************End Availability Report************************** ----->
 
<!-- **********************End Availability Report************************** ----->

Revision as of 11:43, 16 October 2019

RAL Tier1 Operations Report for 16th October 2019

Review of Issues during the week 9th October 2019 to the 15th October 2019.
  • New IPV6 IPv6 packet loss on SuperJanet from nonOPN sudneteed hosts. 8/10/2019
Current operational status and issues
Notable Changes made since the last meeting.
  • NTR
Entries in GOC DB starting since the last report.
Service ID Scheduled? Outage/At Risk Start End Duration Reason
Declared in the GOC DB
Service ID Scheduled? Outage/At Risk Start End Duration Reason
- - - - - - - -
  • No ongoing downtime
Advanced warning for other interventions
The following items are being discussed and are still to be formally scheduled and announced.


Listing by category:

  • DNS servers will be rolled out within the Tier1 network.
Open GGUS Tickets
Ticket-ID Type VO Site Priority Responsible Unit Status Last Update Subject Scope
143645 TEAM lhcb RAL-LCG2 very urgent NGI_UK in progress 2019-10-15 15:07:00 Jobs Failed to access files at RAL-LCG2 WLCG
143323 TEAM lhcb RAL-LCG2 top priority NGI_UK in progress 2019-10-14 08:45:00 File deletion at RAL ECHO WLCG
142350 TEAM lhcb RAL-LCG2 top priority NGI_UK in progress 2019-10-07 14:52:00 Proble accessing some LHCb files at RAL WLCG



GGUS Tickets Closed Last week


Ticket-ID Type VO Site Priority Responsible Unit Status Last Update Subject Scope
143569 TEAM atlas RAL-LCG2 top priority NGI_UK solved 2019-10-09 11:57:00 Problem with FTS at RAL WLCG
143567 TEAM lhcb RAL-LCG2 very urgent NGI_UK verified 2019-10-14 12:47:00 FTS3 problem for transfers executing at RAL FTS3 server WLCG
143565 USER cms RAL-LCG2 urgent NGI_UK solved 2019-10-09 11:53:00 RAL FTS is Down WLCG
143406 USER cms RAL-LCG2 urgent NGI_UK closed 2019-10-15 23:59:00 transfers failing to T1_UK_RAL_Disk WLCG
143402 USER none RAL-LCG2 urgent NGI_UK verified 2019-10-09 11:58:00 CVMFS IPv6 connection issues at RAL EGI
143384 TEAM atlas RAL-LCG2 very urgent NGI_UK closed 2019-10-10 23:59:00 Low efficiency of Atlas transfers to sites in UK cloud WLCG
143379 USER cms RAL-LCG2 urgent NGI_UK closed 2019-10-10 23:59:00 issues with RAL FTS? WLCG
142689 USER cms RAL-LCG2 very urgent NGI_UK closed 2019-10-15 23:59:00 Transfer failing to RAL_Disk WLCG
140447 USER dteam RAL-LCG2 less urgent NGI_UK closed 2019-10-11 23:59:00 packet loss outbound from RAL-LCG2 over IPv6 EGI



Availability Report

Day Atlas CMS LHCB Alice Comments
2019-10-02 100 100 100 96
2019-10-03 100 100 100 100
2019-10-04 100 100 100 100
2019-10-05 100 100 100 100
2019-10-06 100 100 100 100
2019-10-07 100 100 100 100
2019-10-08 100 100 100 100
Hammercloud Test Report
Target Availability for each site is 97.0%
Day Atlas HC CMS HC Comment
2019-10-02 100 100
2019-10-03 100 100
2019-10-04 100 99
2019-10-05 100 99
2019-10-06 100 100
2019-10-08 100 100
2019-10-09 100 100

Key: Atlas HC = Atlas HammerCloud (Queue RAL-LCG2_UCORE, Template 841); CMS HC = CMS HammerCloud

Notes from Meeting.