|
|
| (677 intermediate revisions by 17 users not shown) |
| Line 5: |
Line 5: |
| | {| width="100%" cellspacing="0" cellpadding="0" style="background-color: #ffffff; border: 1px solid silver; border-collapse: collapse; width: 100%; margin: 0 0 1em 0;" | | {| width="100%" cellspacing="0" cellpadding="0" style="background-color: #ffffff; border: 1px solid silver; border-collapse: collapse; width: 100%; margin: 0 0 1em 0;" |
| | |- | | |- |
| − | | style="background-color: #d8e8ff; border-bottom: 1px solid silver; text-align: center; font-size: 1em; font-weight: bold; margin-top: 0; margin-bottom: 0; padding-top: 0.1em; padding-bottom: 0.1em;" | Week commencing Monday 5th March 2018 | + | | style="background-color: #d8e8ff; border-bottom: 1px solid silver; text-align: center; font-size: 1em; font-weight: bold; margin-top: 0; margin-bottom: 0; padding-top: 0.1em; padding-bottom: 0.1em;" | Week commencing Monday 25th February 2019 |
| | |} | | |} |
| | | | |
| Line 27: |
Line 27: |
| | ====== ====== | | ====== ====== |
| | <!-- *********************************************************** -----> | | <!-- *********************************************************** -----> |
| | + | '''Tuesday 18th June''' |
| | + | * DPM Workshop last week - come to this week's storage meeting for an in-depth look. |
| | + | ** https://indico.cern.ch/event/776832/ |
| | + | * DIRAC downtime this week due to the move to Slough - good luck! |
| | + | * EGI Ops meeting this week. |
| | + | ** https://wiki.egi.eu/wiki/Agenda-2019-06-17 |
| | + | ** HTCondorCE commissioning ongoing, SRM decommissioning survey |
| | + | ** State of SRM usage at DPM sites? |
| | + | |
| | + | |
| | + | '''Tuesday 11th June''' |
| | + | |
| | + | * Technical Meeting last week about the New JSON based Information System: https://indico.cern.ch/event/821105/ |
| | + | * This week we will get round to looking at the outcome of the Security Day (and HEPSYSMAN). |
| | + | * The DPM Workshop is this week: https://indico.cern.ch/event/776832/ There's a Vidyo Room planned for people to listen in. |
| | + | * CentOS7 Migration https://twiki.cern.ch/twiki/bin/view/AtlasComputing/CentOS7Deployment |
| | <!-- ***********************Start General text*********************** ----->''' | | <!-- ***********************Start General text*********************** ----->''' |
| − | '''Monday 5th March''' | + | '''Tuesday 4th June 2019''' |
| − | * For the WLCG-HSF workshop: ideas, plans or proposals for technology watch activities requested. Please let Helge et. al. know by Monday 19 March. They would particularly appreciate proposals in the form of a single PowerPoint slide. | + | * The Security Day + HEPSYSMAN was on t'other week: https://indico.cern.ch/event/721692/ |
| − | * GridPP technical meeting this Friday will focus on CentOS7. (Here is a [https://indico.cern.ch/event/710666/ link to 2nd March agenda] for Vidyo details).
| + | * Please can sites review their GOCDB information: https://ggus.eu/?mode=ticket_info&ticket_id=141296 |
| − | * WLCG baseline for Singularity - 2.4.2 | + | * iris.ac.uk VO - Andrew explained this. |
| − | * Need for JISC list VO-ADMINS. | + | * New(-ish) HEPOSLib release - 7.2.9 https://twiki.cern.ch/twiki/bin/view/LCG/WLCGBaselineTable |
| − | * [https://espace.cern.ch/WLCG-document-repository/ReliabilityAvailability/2018/01-18/ WLCG T2 availability & reliability - January 2018] | + | * Gareth's query about the WS interface to ARC on TB-SUPPORT |
| | + | * Anything else? |
| | | | |
| − | '''Monday 26th February'''
| |
| − | * [https://indico.cern.ch/event/658060/overview WLCG-HSF Workshop in Naples]
| |
| − | * Minutes of the weekly WLCG weekly ops meeting are available [https://twiki.cern.ch/twiki/bin/view/LCG/WLCGOpsMeetingWeek180226 here].
| |
| − | * Alessandra: Mentioned here grid enabled GPU behind an ARC-CE implementation.
| |
| − | * GalDyn and GridPP. Would like to submit work to DiRAC and make use of GridPP resources.
| |
| − | * [https://indico.cern.ch/event/684659/ GridPP40 registration is open].
| |
| − | * Rajan: SL7 UI Machine
| |
| | | | |
| − | '''Monday 12th February'''
| |
| − | * Dan: New rack PDUs
| |
| − | * Rajan: SL7 UI Machine
| |
| − | * EGI A/R
| |
| − | * [https://indico.cern.ch/event/699602/ DPM workshop 2018 at CESNET] 31st May - 2nd June.
| |
| − | * Brian: Approaching end of support for dCache v2.16, v3.0 & v3.1
| |
| − | * Spectre/Meltdown experiment VM updates
| |
| − | * Thematic CERN School of Computing 2018 - [https://indico.cern.ch/e/tCSC-2018 applications are open]
| |
| − | * Notes from the [https://twiki.cern.ch/twiki/bin/view/LCG/WLCGOpsMeetingWeek180212 WLCG ops meeting on Monday].
| |
| − | * The February GDB is on Wednesday 14th with [https://indico.cern.ch/event/651350/ this agenda].
| |
| − | * There was a [https://indico.cern.ch/event/651338/ pre-GDB on 2nd February looking at HPC utilization].
| |
| − | * Tuesday 13th there is a [https://indico.cern.ch/event/689511/ pre-GDB discussion about GPU utilisation].
| |
| | | | |
| | <!-- **********************End General text************************** -----> | | <!-- **********************End General text************************** -----> |
| Line 70: |
Line 68: |
| | <!-- *********************************************************** -----> | | <!-- *********************************************************** -----> |
| | <!-- ***********************Start ops coord text*********************** -----> | | <!-- ***********************Start ops coord text*********************** -----> |
| − | '''Monday 5th March''' | + | '''Tuesday 11th June''' |
| − | * The [https://indico.cern.ch/event/708574/ agenda] and [https://twiki.cern.ch/twiki/bin/view/LCG/WLCGOpsMinutes180301 minutes] from the WLCG ops coordination meeting last week are available. | + | |
| − | * Special topics were: CNAF recovery update; SAM recalculation policy draft discussion and Progress on WLCG Storage Space Accounting Prototype including tape metrics. | + | * I got stuck (figuratively) in my machine room last Thursday afternoon so missed it. [https://indico.cern.ch/event/823800/ Agenda.] [https://twiki.cern.ch/twiki/bin/view/LCG/WLCGOpsMinutes190606 Minutes.] Ste was there - any observations? |
| | + | |
| | + | '''Tuesday 14th May''' |
| | + | * Next meeting this Thursday. |
| | + | |
| | + | '''Tuesday 9th April''' |
| | + | * Ops meeting last week: https://twiki.cern.ch/twiki/bin/view/LCG/WLCGOpsMinutes190404 |
| | + | |
| | + | |
| | + | '''Tuesday 26th March''' |
| | + | * For information, there was an Ops meeting on the 7th: https://twiki.cern.ch/twiki/bin/viewauth/LCG/WLCGOpsMinutes190307 (I think we might have dicussed this one). |
| | + | * Next meeting booked for 4th April |
| | + | |
| | + | '''Monday 11th February 2019''' |
| | + | * There was a WLCG ops coordination meeting last Thursday. You can view the meeting notes [https://twiki.cern.ch/twiki/bin/view/LCG/WLCGOpsMinutes190207 here]. |
| | + | ** End of CREAM support Dec 2020. |
| | + | ** Migration from CREAM to be discussed at the EGI conference 6-8 of May in Amsterdam. |
| | + | ** Operational intelligence discussion ([https://indico.cern.ch/event/795889/sessions/302520/attachments/1792600/2920978/Operational_Intelligence_-_WLCG_Ops_Coord-2.pdf see slides]). |
| | + | ** Experiment updates (see ATLAS discussion on DOMA) |
| | + | ** WG updates (few). |
| | + | |
| | + | |
| | + | |
| | | | |
| − | '''Tuesday 27th February'''
| |
| − | * Next WLCG Operations Coordination meeting will take place this [https://indico.cern.ch/event/708574/ Thursday 1st of March starting at 15:30 CEST].
| |
| | | | |
| − | '''Monday 29th January'''
| |
| − | * The majority of T1 sites and VOs confirmed that they do use SAM tests from the critical profiles and regularly check A/R reports.
| |
| − | Suggestions for improvements:
| |
| − | ** Propose policy for accepting A/R recalculation requests. The draft should be reviewed at the next meeting.
| |
| − | ** VO should have flexibility in the definition of the critical profile. Though the impact of the changes in the critical profile should be carefully tested by the VO and should be announced in advance to the sites, no approval of the MB is required.
| |
| − | ** Make tests as close as possible to the real production flow. ATLAS is planning some work in this direction.
| |
| − | ** The proposal to include real production flows in the critical profile was not supported.
| |
| − | ** Sites which do have local fabric monitoring like Nagios for example, are recommended to use an API to import test results into the local fabric monitoring. **This would help to avoid test failures staying unnoticed for months.
| |
| − | ** Transparent navigation from the SAM UI to the log files is required to facilitate test failure debugging. This feature has to be preserved in the new SAM UI being developed by the monitoring team.
| |
| | | | |
| | <!-- **********************End ops coord text************************** -----> | | <!-- **********************End ops coord text************************** -----> |
| Line 102: |
Line 111: |
| | <!-- *********************************************************** -----> | | <!-- *********************************************************** -----> |
| | <!-- ***********************Start T1 text*********************** -----> | | <!-- ***********************Start T1 text*********************** -----> |
| − | '''Tuesday 1st March''' | + | |
| − | Report from the last Tier1 - Experiments Liaison Meeting at on 21st February is [https://www.gridpp.ac.uk/wiki/Tier1_Operations_Report_2018-02-20 here]. | + | '''17 June 2019''' Report for the Experiments Liaison Report (17/06/2019) is [https://www.gridpp.ac.uk/wiki/Tier1_Operations_Report_2019-06-17 here]. |
| − | * RAL is experiencing an outage of 2 of its 3 OPN 10Gb lines (effective as of 01:03 this morning (27/2/18)). Currently services have not been adversely impacted. While is remains the case there will be no formal status/update broadcast therefore this should be taken as an informal advisory. JANET also inform us that this outage is also effecting Brunel University and Royal Holloway University. | + | <!-- *********************************************************** -----> |
| − | * There has been an outage on Castor announced for Thursday (1st March) while the database systems have Oracle patches applied. | + | |
| | <!-- **********************End T1 text************************** -----> | | <!-- **********************End T1 text************************** -----> |
| | + | * Ongoing, we are seeing high outbound packet loss over IPv6. Central networking performed a firmware update to the border routers but this didn’t resolve the issue. Plan to move connections to the new border routers in Mid June. Will do this before trying to debug any further. |
| | + | |
| | + | '''11 June 2019''' Report for the Experiments Liaison Report (10/06/2019) is [https://www.gridpp.ac.uk/wiki/Tier1_Operations_Report_2019-06-10 here]. |
| | <!-- *********************************************************** -----> | | <!-- *********************************************************** -----> |
| | + | <!-- **********************End T1 text************************** -----> |
| | + | * Ongoing, we are seeing high outbound packet loss over IPv6. Central networking performed a firmware update to the border routers but this didn’t resolve the issue. Plan to move connections to the new border routers in Mid June. Will do this before trying to debug any further. |
| | + | * Three certificates were revoked mistakenly on ARGUS on Thursday. All SAM tests failed until this was fixed the next morning. Batch farm also did not start any new jobs during this time. We used this accidental draining to reboot nodes that needed to pick up security patching. |
| | + | * LHCb Castor instance has been completely disabled for LHCb and will be decommissioned. |
| | + | * Brian Davies has transferred from his role as GridPP Tier-2 Storage Support Officer and has joined the Tier-1 Production Team. Although this has happened with immediate effect he will still be available for ad-hoc/informal storage support. |
| | + | |
| | |} | | |} |
| − | <!-- ****************End T1****************** ----->
| |
| | | | |
| | <!-- ****************Start Storage & DM****************** -----> | | <!-- ****************Start Storage & DM****************** -----> |
| Line 121: |
Line 137: |
| | <!-- ******************Edit start********************* -----> | | <!-- ******************Edit start********************* -----> |
| | | | |
| − | '''[http://storage.esc.rl.ac.uk/weekly/20171206-minutes.txt Wed 06 Dec]''' | + | '''[http://storage.esc.rl.ac.uk/weekly/20191030-minutes.txt Wed 30 Oct]''' |
| − | * Another success story - CERN@School running machine learning at QMUL | + | * DOME upgrade problems at Edinburgh |
| − | * Technical events coming up - hepsysman and cloud workshop at Crick. We ought to do something Useful or Interesting. | + | * Data management support/development for IRIS users |
| | + | |
| | + | '''[http://storage.esc.rl.ac.uk/weekly/20191023-minutes.txt Wed 23 Oct]''' |
| | + | * Rucio reporting |
| | + | |
| | + | '''Wed 16 Oct''' |
| | + | * CEPH workshop at CERN report |
| | + | |
| | + | '''[http://storage.esc.rl.ac.uk/weekly/20191002-minutes.txt Wed 02 Oct]''' |
| | + | * Safe to upgrade to DPM 1.13 but make sure the BDII is working if you support DIRAC |
| | + | * Roadmap for xroot and http TPC for RAL FTS(es) |
| | + | |
| | + | '''[http://storage.esc.rl.ac.uk/weekly/20190925-minutes.txt Wed 25 Sept]''' |
| | + | * Storage support for IRIS VOs? |
| | | | |
| − | '''[http://storage.esc.rl.ac.uk/weekly/20171115-minutes.txt Wed 15 Nov]''' | + | '''[http://storage.esc.rl.ac.uk/weekly/20190918-minutes.txt Wed 18 Sept]''' |
| − | * More xcache progress at some sites; less at others who may be blocking on dependencies or be busy with Other Things(tm) | + | * Report from yesterday's Rucio Face Meeting at Coseners |
| − | * Some interest in following the non-X.509 authentication/authorisation | + | * Suggestions for following up from yesterday's CEPH day hosted by CERN |
| | | | |
| − | '''[http://storage.esc.rl.ac.uk/weekly/20171108-minutes.txt Wed 08 Nov]''' | + | '''[http://storage.esc.rl.ac.uk/weekly/20190911-minutes.txt Wed 11 Sept]''' |
| − | * Not (very) modest at all progress on xcache testing... from Chris at RALPP | + | * Storage related stuff at the FNAL (pre-)GDBs |
| | + | * DOME upgrade tickets for non-DOME DPM sites |
| | | | |
| − | '''[http://storage.esc.rl.ac.uk/weekly/20171101-minutes.txt Wed 01 Nov]''' | + | '''[http://storage.esc.rl.ac.uk/weekly/20190904-minutes.txt Wed 04 Sept]''' |
| − | * (very) modest progress on xcache testing... | + | * Banning in SSC not entirely successful in non-DOME DPM, and end of support is nigh; tickets to upgrade will go out shortly. |
| − | * Except that RALPP has it fully working for dCache - hope to get full report next week | + | * Storage-and-data-management-wise, GridPP43 was interesting although no-one volunteered to install the next CEPH. |
| | | | |
| | | | |
| Line 151: |
Line 181: |
| | ====== ====== | | ====== ====== |
| | <!-- ******************Edit start********************* -----> | | <!-- ******************Edit start********************* -----> |
| − | '''Tuesday 6 Mar''' | + | '''Tuesday 30 Apr 2019''' |
| − | * Preparing Vac 3.0 release with Docker (and Singularity) container support, and updated Vacuum Pipes which allow VOs to define multiple types of VM without having to notify sites each time. | + | * ATLAS CernVM4 VMs (equivalent to CentOS 7.6) being tested |
| − | * Preparing Vcycle release with updated OpenStack API support, Vacuum Pipe support, and support for space-wide shutdown of VMs.
| + | |
| − | * LHCb DIRAC VMs have been updated to shutdown gracefully when signalled by OpenStack; GridPP DIRAC VMs to follow. This is part of a wider mechanism to allow sharing of resources between OpenStack projects of different priority, with eviction of lower priority VMs on demand.
| + | |
| | | | |
| | <!-- ******************Edit stop********************* -----> | | <!-- ******************Edit stop********************* -----> |
| Line 208: |
Line 236: |
| | <!-- ******************Edit start********************* -----> | | <!-- ******************Edit start********************* -----> |
| | | | |
| − | '''Tuesday 22nd Jan 2018''' | + | ''' Tue 9th July 2019''' |
| | | | |
| − | CHANGE TO APPROVED VOs
| + | LHCb has added this to their requirements: |
| − | **********************
| + | |
| | | | |
| − | * New Approved VO
| + | Sites not having an SRM installation must provide: |
| | | | |
| − | A VO, solidexperiment.org, has been included in the GridPP Approved VOs document. Sites are requested to support this experiment, resources permitting.
| + | * disk only storage |
| | + | * a GRIDFPT endpoint (a single dns entry) |
| | + | * an XROOT endpoint (a single dns entry) |
| | + | * a way to do the accounting (preferably following the WLCG TF standard: https://twiki.cern.ch/twiki/bin/view/LCG/StorageSpaceAccounting) |
| | | | |
| − | https://www.gridpp.ac.uk/wiki/GridPP_approved_VOs#Approved_Local_VOs
| + | ''' Tue 16th April 2019''' |
| | | | |
| − | * In the Ops Portal, LHCb mentions a new cvmfs mount, /cvmfs/lhcb-condb.cern.ch
| + | Minor change to LHCB requirements in Approved VOs: |
| | | | |
| − | * A voms server for magic, voms02.pic.es, has an updated DN. | + | * Sites having migrated to the Centos7 (including "Cern Centos7") operating system or later versions are requested to provide support for singularity containers. |
| | | | |
| − | '''Tuesday 9th Jan 2018'''
| + | https://www.gridpp.ac.uk/wiki/GridPP_approved_VOs#VO_Resource_Requirements |
| − | Changes to Approved VOs.
| + | |
| | | | |
| − | a) VOMS servers for planck, ipv6.hepix.org and enmr are now restored to as they were before the flooding at CNAF.
| + | '''Tue 2nd April 2019''' |
| − | b) The DN of a VOMS server for magic has changed.
| + | |
| | | | |
| − | https://www.gridpp.ac.uk/wiki/GridPP_approved_VOs
| + | Changes to Approved for DUNE (and LZ) |
| | | | |
| − | '''Tuesday 5th Sept 2017''' | + | There is a new "Approved VOs" document showing new settings for DUNE. And, since both LZ's voms servers now show up in the EGI Portal, I've removed the (now spurious) entry for voms.hep.wisc.edu that was formerly being inserted by hand. |
| | | | |
| − | New Approved VO. SKA European regional data centre, skatelescope.eu
| + | https://www.gridpp.ac.uk/wiki/GridPP_approved_VOs |
| | | | |
| | + | I've also created a new set of RPMs (each has all LSC, VOMS, and XML for one VO) for all approved VOs. See Approved VOs doc for details, version is 1.9. |
| | + | |
| | + | Sites with DUNE services need to update using whatever method they employ. |
| | + | |
| | + | Special note: Since voms1.fnal.gov changed yesterday, I've updated documentation for that right away. But voms2.fnal.gov remains as it is until 23rd April (3 weeks). I'll update documentation for that when it is closer. Staggering the updates like this gives a time margin, so any particular site can have at least one service properly configured at any time. But it does mean that two site updates are needed; one now, and one in three weeks. However, since it's sufficient for only one (of the two) voms servers to be configured properly, sites could save effort and wait until (say) 19th April, then update both at once. But I can't dictate what site admins should do. It's your call. |
| | + | |
| | + | Ste |
| | + | |
| | + | |
| | + | '''Tuesday 5th Mar 2019''' |
| | + | New VOMs details for Biomed: |
| | https://www.gridpp.ac.uk/wiki/GridPP_approved_VOs | | https://www.gridpp.ac.uk/wiki/GridPP_approved_VOs |
| | | | |
| − | This VO is ramping up and has requested support. Andrew McNab is the contact person for GridPP.
| + | New VOMs rpms to match. |
| | + | |
| | + | http://hep.ph.liv.ac.uk/~sjones/RPMS.voms/ |
| | + | |
| | + | '''Tuesday 12th Feb 2019''' |
| | + | Documentation done for HTCondor-CE apel accounting. |
| | + | https://twiki.cern.ch/twiki/bin/view/LCG/HtCondorCeAccounting |
| | + | |
| | + | |
| | + | '''Tuesday 12th Feb 2019''' |
| | + | New CA DN for Biomed |
| | + | <pre> |
| | + | < VOMS_CA_DN="'/C=FR/O=CNRS/CN=GRID2-FR' " |
| | + | --- |
| | + | > VOMS_CA_DN="'/C=FR/O=MENESR/OU=GRID-FR/CN=AC GRID-FR Services' " |
| | + | </pre> |
| | + | |
| | + | '''Tuesday 5th Feb 2019''' |
| | + | For enmr, certificate of voms-02.pd.infn.it |
| | + | |
| | + | New DN: /DC=org/DC=terena/DC=tcs/C=IT/L=Frascati/O=Istituto Nazionale di Fisica Nucleare/CN=voms-02.pd.infn.it, |
| | + | New CA_DN: /C=NL/ST=Noord-Holland/L=Amsterdam/O=TERENA/CN=TERENA eScience SSL CA 3 |
| | + | |
| | + | Please check approved VOs: https://www.gridpp.ac.uk/wiki/GridPP_approved_VOs |
| | + | |
| | + | |
| | | | |
| | '''General note''' | | '''General note''' |
| Line 255: |
Line 319: |
| | ===== ===== | | ===== ===== |
| | <!-- ******************Edit start********************* -----> | | <!-- ******************Edit start********************* -----> |
| − | Tuesday 27th February
| |
| − | * The next EGI [https://indico.egi.eu/indico/event/3849/ OMB is on Thursday 1st March at 10:00 CET].
| |
| | | | |
| − | '''Tuesday 30th January''' | + | ''' 14 May 2019 ''' |
| − | * The [https://indico.egi.eu/indico/event/3616/ next EGI OMB is this Thursday 2nd February]. | + | * Meeting for May cancelled. Next meeting is on 10th June. |
| − | ** we need someone to attend.... | + | |
| | + | ''' Monday 11th March ''' |
| | + | |
| | + | * Agenda: https://wiki.egi.eu/wiki/Agenda-2019-03-11 |
| | + | * UMD 4.8.2 released : ARC 15.03.19 - To address how ARC counts HELD job |
| | + | * DPM Legacy mode is going to end in June 2019 |
| | + | * EGI will open tickets after June |
| | + | * HTCondor CE accounting status? |
| | + | * http://egi.ui.argo.grnet.gr/ : https://ggus.eu/index.php?mode=ticket_info&ticket_id=139877 |
| | + | |
| | + | |
| | + | ''' Tuesday 12th February ''' |
| | + | * There was an EGI ops meeting yesterday - [https://indico.egi.eu/indico/event/4320/ Agenda]. We were asked to review the IPv6 readiness information ([https://wiki.egi.eu/w/index.php?title=IPV6_Assessment see here]). We should perhaps link in the GridPP IPv6 table for updates status. |
| | + | |
| | + | |
| | + | ''' Friday 1st February ''' |
| | + | |
| | + | * Early adopters needed for HTcondor CE , https://ggus.eu/index.php?mode=ticket_info&ticket_id=139377 |
| | + | |
| | + | ''' Thursday 17th January EGI OMB meeting ''' |
| | + | |
| | + | * CREAMCE to be out of support by Dec 2020 |
| | + | * More effort to fix accounting issue of HTCondor CE |
| | + | |
| | + | ''' Monday 14th January 2019 ''' |
| | + | * Agenda https://wiki.egi.eu/wiki/Agenda-2019-01-14 |
| | + | |
| | + | * No UK specific issue mentioned. |
| | | | |
| − | '''Tuesday 23rd January'''
| + | * IPv6 readiness plan is going to be summarized at OMB. |
| − | * There was an EGI Operations Meeting last Monday: [https://wiki.egi.eu/wiki/Agenda-2018-01-15 Agenda] | + | |
| | | | |
| − | * Middleware
| + | ' |
| − | ** Long list of updates in UMD 4.6
| + | |
| − | ** UMD3 deprecation - start using UMD4 as soon as possible
| + | |
| − | ** Products missing, let them know - this is a heads up
| + | |
| | | | |
| − | * Operations
| |
| − | ** <b>New weights in A/R</b>
| |
| − | ** "Several sites are still missing the necessary information for computing the weights: check on VAPOR the values published by your sites in order to properly publishing in the GLUE2 schema the number of logical CPUs and the Hep-Spec06 benchmark."
| |
| − | ** http://operations-portal.egi.eu/vapor/resources/GL2ResSummary
| |
| − | ** <b>IPv6</b>
| |
| − | ** https://wiki.egi.eu/w/index.php?title=IPV6_Assessment
| |
| − | ** <b>webdav probes in production</b>
| |
| − | ** "During the January OMB we are going to discuss the inclusion of the probes in the operators and in the critical profile" [may be superceded]
| |
| − | ** <b>Storage accounting deployment</b>
| |
| − | ** "IMPORTANT: be sure to have installed the star-accounting.py script v1.0.4"
| |
| | | | |
| − | * Next meeting: https://indico.egi.eu/indico/event/3564/
| |
| | <!-- ******************Edit stop********************* -----> | | <!-- ******************Edit stop********************* -----> |
| | <!-- *********************************************************** -----> | | <!-- *********************************************************** -----> |
| Line 325: |
Line 399: |
| | ===== ===== | | ===== ===== |
| | <!-- ******************Edit start********************* -----> | | <!-- ******************Edit start********************* -----> |
| − | '''Monday 5th March''' | + | '''Tuesday 5th February''' |
| − | * AM->GS. A quiet week last week. | + | * Birmingham decommissioning of SRM and BDII still going on so tickets are on hold. |
| | + | * Few availability tickets on hold |
| | + | * Lancaster has WebDav ticket on hold which seems to be effect of DOME rollout |
| | | | |
| − | '''Monday 29th January''' | + | '''Tuesday 14th August''' |
| − | * There were a couple of alarms which showed up on the dashboard, but not on the corresponding nagios. | + | * A couple of new availability tickets (QMUL and Lancaster), both for well-publicised reasons. Otherwise quiet. AM on shift this week. |
| − | * DB got fed up with Imperial failing the job-cancel test for CREAM -- the CE is just busy and returns the cancelled state about 30 s after the test 'fails' -- so she filed a ticket questioning the usefulness of the test: https://ggus.eu/?mode=ticket_info&ticket_id=133004.
| + | |
| | | | |
| − | '''Monday 20th November'''
| |
| − | * Generally quiet. There are three outstanding tickets: low availability at Birmingham, one at Liverpool which might just have gone green, and out-of-date IGTF CAs at Sheffield.
| |
| | | | |
| | <!-- ******************Edit stop********************* -----> | | <!-- ******************Edit stop********************* -----> |
| Line 374: |
Line 447: |
| | | | |
| | ===== ===== | | ===== ===== |
| − | '''Monday 5th March'''
| + | '''Tuesday 11th June |
| − | * memcached exploits and ...
| + | |
| − | | + | |
| − | | + | |
| − | '''Tuesday 6th February on 2018''' | + | |
| − | * Update on Meltdown/Spectre
| + | |
| − | * Security Team meeting this afternoon
| + | |
| − | | + | |
| − | | + | |
| | | | |
| | + | * NTR |
| | | | |
| | |} | | |} |
| Line 396: |
Line 462: |
| | {| style="background-color: #ffffff; border: 1px solid silver; border-collapse: collapse; width: 100%; margin: 0em 0 0 0.3em;" | | {| style="background-color: #ffffff; border: 1px solid silver; border-collapse: collapse; width: 100%; margin: 0em 0 0 0.3em;" |
| | |- | | |- |
| − | | style="background-color: #b7f1ce; border-bottom: 1px solid silver; text-align: left; font-size: 1em; font-weight: bold; margin-top: 0; margin-bottom: 0; padding-left: 0.4em; padding-top: 0.1em; padding-bottom: 0.1em;" | Services - [http://psmad.grid.iu.edu/maddash-webui/index.cgi?dashboard=UK%20Config PerfSonar production dashboard] |[http://maddash.aglt2.org/maddash-webui/index.cgi?dashboard=UK%20Config PerfSonar development dashboard] | [https://voms.gridpp.ac.uk:8443/vomses/ GridPP VOMS] | + | | style="background-color: #b7f1ce; border-bottom: 1px solid silver; text-align: left; font-size: 1em; font-weight: bold; margin-top: 0; margin-bottom: 0; padding-left: 0.4em; padding-top: 0.1em; padding-bottom: 0.1em;" | Services - [https://psmad.opensciencegrid.org/maddash-webui/index.cgi?dashboard=UK%20Mesh%20Config PerfSonar production dashboard] |[https://psetf.opensciencegrid.org/etf/check_mk/index.py?start_url=%2Fetf%2Fcheck_mk%2Fview.py%3Fhostgroup%3DUK%26opthost_group%3DUK%26view_name%3Dhostgroup PerfSonar ETF] | [http://opensciencegrid.org/networking/ OSG Networking and perfSONAR pages] | [https://voms.gridpp.ac.uk:8443/vomses/ GridPP VOMS] |
| | |- | | |- |
| | | style="padding: 0.4em 0.4em 0.4em 0.4em;" | | | | style="padding: 0.4em 0.4em 0.4em 0.4em;" | |
| Line 404: |
Line 470: |
| | - This includes notifying of (inter)national services that will have an outage in the coming weeks or will be impacted by work elsewhere. (Cross-check the Tier-1 update). | | - This includes notifying of (inter)national services that will have an outage in the coming weeks or will be impacted by work elsewhere. (Cross-check the Tier-1 update). |
| | | | |
| − | '''Monday 19th February''' | + | '''Monday 5th March''' |
| | + | * Next LHCOPN and LHCONE meeting: [https://indico.cern.ch/event/772031/ Umeå, Sweden, 4-5 Jun 2019]. Registration required. |
| | | | |
| − | Please could sites upgrade their perfsonar hosts to CentOS7. Instructions are [https://opensciencegrid.github.io/networking/perfsonar/installation/ here]. Current OS versions [https://tinyurl.com/y9eode2b here]. | + | '''Monday 10th September''' |
| | + | * Please check perfSONAR status [https://psetf.opensciencegrid.org/etf/check_mk/index.py?start_url=%2Fetf%2Fcheck_mk%2Fview.py%3Ffilled_in%3Dfilter%26host_regex%3Duk%26view_name%3Dsearchhost here] especially the mesh URL (should be http://psconfig.opensciencegrid.org/pub/auto/FQDN) |
| | | | |
| − | '''Monday 5th February''' | + | '''Monday 2nd July''' |
| − | * 'Campus network engineering for data-intensive science workshop' in October 2016, had this [https://www.jisc.ac.uk/events/campus-network-engineering-for-data-intensive-science-workshop-19-oct-2016 agenda]. Note particularly the Imperial and Cambridge overviews. | + | * Next LHCOPN and LHCONE meeting: [https://indico.cern.ch/event/725706/ Fermilab, Batavia US, 30-31October 2018]. Registration required. |
| − | * There is a [https://community.jisc.ac.uk/groups/janet-end-end-performance-initiative/document/network-expectations-data-intensive-science JISC document] which seeks to help set expectations for what the network can deliver.
| + | |
| | | | |
| | + | '''Monday 30th April''' |
| | + | * The [https://indico.cern.ch/event/725706/ next LHCOPN and LHCONE joint meeting] will take place on Tuesday the 30th and Wednesday the 31st of October 2018 |
| | | | |
| | + | '''Monday 19th February''' |
| | | | |
| − | '''Monday 22nd January'''
| + | Please could sites upgrade their perfsonar hosts to CentOS7. Instructions are [https://opensciencegrid.github.io/networking/perfsonar/installation/ here]. Current OS versions [https://tinyurl.com/y9eode2b here]. |
| − | * Registration is open for the [http://www.cvent.com/d/xtq4sy next LHCOPN and LHCONE meeting: RAL, Abingdon UK, 6-7 March 2018].
| + | |
| − | | + | |
| − | '''Monday 20th November'''
| + | |
| − | * perfSONAR: No news.
| + | |
| − | * GridPP DIRAC: DPM & xrootd version. Upgrade due 16th November.
| + | |
| − | * RIPE ATLAS probes: Status & tests TBC
| + | |
| − | * The next LHCOPN/LHCONE meeting will be at [https://indico.cern.ch/event/681168/ RAL 6-7th March 2018]. The UK position on LHCONE is being reviewed. RAL T1 will (likely) connect via the LHCOPN in the coming months. T2s watch this space!
| + | |
| − | | + | |
| − | | + | |
| − | '''Monday 23rd October'''
| + | |
| − | * The LHCOPN/ONE meeting took place last week at KEK, co-hosted with the HEPiX Fall meeting.
| + | |
| − | ** You can find a short report of the meeting [https://indico.cern.ch/event/646629/attachments/1544349/2423256/LHCOPNE-20171017-Tsukuba-meeting-report.pdf here.]
| + | |
| − | ** All the slides presented are available in the [https://indico.cern.ch/event/646629/ agenda.]
| + | |
| − | | + | |
| − | '''Tuesday 4th July'''
| + | |
| − | * Pete C is preparing another networking forward look document. Note that figures presented in the Manchester workshop were for a Tier-2 (not always a single site).
| + | |
| − | | + | |
| − | [http://www.perfsonar.net/release-notes/version-4-0/ here]
| + | |
| | | | |
| | * Duncan has recreated the UK perfSONAR mesh. [http://maddash.aglt2.org/maddash-webui/index.cgi?dashboard=UK%20Config Link here]! | | * Duncan has recreated the UK perfSONAR mesh. [http://maddash.aglt2.org/maddash-webui/index.cgi?dashboard=UK%20Config Link here]! |
| Line 449: |
Line 501: |
| | ===== ===== | | ===== ===== |
| | <!-- ******************Edit start********************* -----> | | <!-- ******************Edit start********************* -----> |
| − | '''Monday 5th March 2018, 14.30 GMT'''<br />
| |
| − | 4 Open Tickets this month.
| |
| − |
| |
| − | '''IPv6 Deployment Tickets'''<br />
| |
| − | '''Sussex:''' [https://ggus.eu/?mode=ticket_info&ticket_id=131617 131617]<br />
| |
| − | Possibly on hold until mid-2018.<br />
| |
| − | '''RALPP:''' [https://ggus.eu/?mode=ticket_info&ticket_id=131616 131616]<br />
| |
| − | Chris had an encouraging update back in January, but hit some snags with a new Perfsonar install. Any joy?<br />
| |
| − | '''OXFORD:''' [https://ggus.eu/?mode=ticket_info&ticket_id=131615 131615]<br />
| |
| − | No update since stating you had dual-stacked Perfsonar boxes back in November. Anything to add?<br />
| |
| − | '''CAMBRIDGE:''' [https://ggus.eu/?mode=ticket_info&ticket_id=131614 131614]<br />
| |
| − | No progress expected until the Summer of this year. Is this still the case?<br />
| |
| − | '''BRISTOL:''' [https://ggus.eu/?mode=ticket_info&ticket_id=131613 131613]<br />
| |
| − | Last update hoped progress could happen by February, any news?<br />
| |
| − | '''BIRMINGHAM:''' [https://ggus.eu/?mode=ticket_info&ticket_id=131612 131612]<br />
| |
| − | Some progress on the v6 infrastructure news, hopefully the bugs Mark described a few weeks back can be ironed out.<br />
| |
| − | '''GLASGOW:''' [https://ggus.eu/?mode=ticket_info&ticket_id=131611 131611]<br />
| |
| − | Gareth provided a recent, if not totally positive, update. <br />
| |
| − | '''ECDF:''' [https://ggus.eu/?mode=ticket_info&ticket_id=131610 131610]<br />
| |
| − | There were some interesting times last week when taking the first steps in dual-stacking the ECDF DPM broke things. Keeping to dual-stacking their test DPM for now.<br />
| |
| − | '''DURHAM:''' [https://ggus.eu/?mode=ticket_info&ticket_id=131609 131609]<br />
| |
| − | Last update at the end of January had no positive movement from central IT on v6 deployment.<br />
| |
| − | '''SHEFFIELD:''' [https://ggus.eu/?mode=ticket_info&ticket_id=131608 131608] <br />
| |
| − | This ticket really could do with an update - even an unexciting one.<br />
| |
| − | '''MANCHESTER:''' [https://ggus.eu/?mode=ticket_info&ticket_id=131607 131607]<br />
| |
| − | IIRC I think reverse lookup works only for the Perfsonar boxes - the ticket could do with an update about this.<br />
| |
| − | '''LIVERPOOL:''' [https://ggus.eu/?mode=ticket_info&ticket_id=131606 131606] <br />
| |
| − | Another ticket that could do with an update, even if it's a boring one.<br />
| |
| − | '''UCL:''' [https://ggus.eu/?mode=ticket_info&ticket_id=131604 131604]<br />
| |
| − | No news from central IT at last check back in January.<br />
| |
| − | '''RHUL:''' [https://ggus.eu/?mode=ticket_info&ticket_id=131603 131603]<br />
| |
| − | Perfsonar dual-stacked, but DNS lookup not supported yet.
| |
| − |
| |
| − | '''Common or Garden Tickets'''<br />
| |
| − |
| |
| − | '''SUSSEX'''<br />
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=122772 122772] (11/7/16)<br />
| |
| − | Webdav/Xroot ticket. Some good looking progress on getting this to work, although at last check Leo hit some more problems. In progress (7/2)
| |
| − |
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=133325 133325] (6/2)<br />
| |
| − | Availability ticket. Hopefully given another week of smooth running this can be closed. In progress (12/2)
| |
| − |
| |
| − | '''RALPP'''<br />
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=133819 133819] (4/3)<br />
| |
| − | LHCB asked RALPP to provide details of nodes without any SSE4.2 support. As Chris instructed the ticket was reopened by LHCB to request lhcb jobs do not land on these nodes. Reopened (4/3)
| |
| − |
| |
| − | '''OXFORD'''<br />
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=133809 133809] (3/3)<br />
| |
| − | Availability ticket, caused by the AC troubles. On hold (5/3)
| |
| − |
| |
| − | '''BRISTOL'''<br />
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=133762 133762] (1/3)<br />
| |
| − | CMS Transfer problems, on hold until Friday. On Hold (5/3)
| |
| − |
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=133806 133806] (2/3)<br />
| |
| − | CMS asked sites to deploy Singularity by March 2018, this ticket is the follow up. On hold (5/3)
| |
| − |
| |
| − | '''BIRMINGHAM'''<br />
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=129930 129930] (4/8/17)<br />
| |
| − | Atlas http SAM tests failing. Any luck with the puppet scripts Kashif shared with you? On hold (13/2)
| |
| − |
| |
| − | '''GLASGOW'''<br />
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=133667 133667] (23/2)<br />
| |
| − | LHCB data access problems at Glasgow. The ticket tailed off a bit, Andrew McNab has offered to help compare Glasgow and Manchester settings. In progress (5/3)
| |
| − |
| |
| − | '''DURHAM'''<br />
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=133338 133338] (7/2)<br />
| |
| − | Atlas jobs failing at Durham, with the problems likely to be related to the Arc Control Tower handling of pilots. Adam rolled out some changes, have these fixed things? In progress (21/2)
| |
| − |
| |
| − | '''SHEFFIELD'''<br />
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=133019 133019] (24/1)<br />
| |
| − | Availability ticket. Ticking along. On hold (1/3)
| |
| − |
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=133810 133810] (3/3)<br />
| |
| − | Sno+ jobs failing due to cvmfs errors on a node, which Elena has offline. I suspect that that's this ticket done with. In progress (4/3)
| |
| − |
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=133770 133770] (2/3)<br />
| |
| − | LHCB jobs failing due to problems on some WNs, Elena has been fixing them, hopefully it's all sorted now. In progress (3/3)
| |
| − |
| |
| − | '''MANCHESTER'''<br />
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=133716 133716] (27/2)<br />
| |
| − | Atlas deletion errors - it looks like this ticket has been missed. Assigned (27/2)
| |
| − |
| |
| − | '''QMUL'''<br />
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=133402 133402] (9/2)<br />
| |
| − | A good portion of Sno+ jobs failing at QM, due to stage in/out errors. This is likely caused by the reduced network bandwidth being hogged by atlas. Hopefully this will be fixed soon (by restoring the 20GB/s site connection). In progress (22/2)
| |
| − |
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=132713 132713] (4/1)<br />
| |
| − | hyperk.org support ticket. Any news? In progress (6/2)
| |
| − |
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=132929 132929] (18/1)<br />
| |
| − | CMS having problems due APEL's problem parsing slurm logs (or something like that). APEL support have been called in, but no news yet. In progress (29/1)
| |
| − |
| |
| − | '''IMPERIAL'''<br />
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=133683 133683] (24/2)<br />
| |
| − | Atlas seeing a high job failure at Imperial, due to problems with their AGIS configs that they have no control over. Elena proposes closing the ticket and moving the conversation to JIRA. In progress (5/3)
| |
| − |
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=133818 133818] (4/3)<br />
| |
| − | Another LHCB asking how many nodes do not have sse4.2 support. Simon reports there are no plans to decommission these nodes yet. Waiting for reply (5/3)
| |
| − |
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=133723 133723] (27/2)<br />
| |
| − | This is a ticket for the Cloud site, Sno+ saw problems. Simon was investigating, and has offlined the cloud site in Dirac to prevent further failures. In progress (27/2)
| |
| − |
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=132688 132688] (3/1)<br />
| |
| − | Another not really an Imperial ticket, I think this lost Pheno file ticket can be closed soon. In progress (29/1)
| |
| − |
| |
| − | '''TIER 1'''<br />
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=133719 133719] (27/2)<br />
| |
| − | Atlas spotted tranfers failing into Echo. It was being investigated, any news? In progress (27/2)
| |
| − |
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=133752 133752] (1/3)<br />
| |
| − | Atlas noticed the FTS was broken. Was investigating Alastair noted that it appears to be an IPv6 issue. In progress (1/3)
| |
| − |
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=133717 133717] (27/2)<br />
| |
| − | Likely related, a similar sounding CMS ticket. Any news? In progress (27/2)
| |
| − |
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=133619 133619] (21/2)<br />
| |
| − | Missing unmerged CMS files at RAL. Chris has been helping a lot, but has asked CMS to double check his working. Waiting for reply (5/3)
| |
| − |
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=133764 133764] (1/3)<br />
| |
| − | Sno+ ticket about the RAL BDII not having SFU information. It looks like the bdii information has recently changed (for the worse). Any news? In progress (2/3)
| |
| − |
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=132589 132589] (21/12/17)<br />
| |
| − | LHCB killed pilots ticket. Some more investigations into this show that the problem is getting worse. Any luck with your investigation? In progress (23/2)
| |
| − |
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=132708 132708] (4/1)<br />
| |
| − | WMS decommissioning ticket. Nothing to do here until next month I don't think. In progress (18/1)
| |
| − |
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=127597 127597] (7/4/17)<br />
| |
| − | CMS network performance ticket. No news since Chris' comprehensive update in January. On hold (29/1)
| |
| − |
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=124876 124876] (7/11/16)<br />
| |
| − | ECHO gridftp ROD tests not working, due to problems with the tests. No news on the counter ticket, still. On hold (13/11/17)
| |
| − |
| |
| − | [https://ggus.eu/?mode=ticket_info&ticket_id=117683 117683] (18/11/15)<br />
| |
| − | GLUE2 publishing for Castor. A quick update in January reports a prototype version is being tested. On hold (3/1)
| |
| | | | |
| | + | 32 Open Tickets this week, which is an in depth a look as I've been able to take. |
| | | | |
| | <!-- ******************Edit stop********************* -----> | | <!-- ******************Edit stop********************* -----> |
