Difference between revisions of "Perfsonar refresh"

From GridPP Wiki
Jump to: navigation, search
(Deployment)
(22 intermediate revisions by 8 users not shown)
Line 49: Line 49:
 
|<span style="color:orange">In progress</span>
 
|<span style="color:orange">In progress</span>
 
|
 
|
|New node was received and set up in our lab, has now been moved to the data centre and is ready for physical installation, along with some accompanying network equipment. No estimate yet as to when we could do this. (Simon)
+
|New node was received and set up in our lab, has now been moved to the data centre and is ready for physical installation, along with some accompanying network equipment. No estimate yet as to when we could do this. Currently (Jan 2021) only doing essential maintenance (Simon).
|2020-09-30
+
|2021-01-12
|-
+
|UKI-LT2-UCL-HEP
+
|<span style="color:red">Unknown</span>
+
|
+
|
+
|YYYY-MM-DD
+
 
|-
 
|-
 
|UKI-NORTHGRID-LANCS-HEP
 
|UKI-NORTHGRID-LANCS-HEP
|<span style="color:orange">In progress</span>
+
|<span style="color:green">Done</span>
 
|
 
|
|The new Lancaster perfsonar box is in the rack and cabled up, but the ports are on the wrong VLAN. Have a long standing ticket with our Networking guys to sort this - but not had much luck getting any networking effort the last few months. Update - networking resolved, box install and configuration underway
+
|The routing scripts, which set packets to "only go out the interface they came in", break our perfsonar if they are run so results might be affected by this.
|2020-10-01
+
|2020-12-04
 
|-
 
|-
 
|UKI-NORTHGRID-LIV-HEP
 
|UKI-NORTHGRID-LIV-HEP
|<span style="color:orange">In progress</span>
+
|<span style="color:green">Done</span>
 
|
 
|
|New node installed and wired in, awaiting installation instructions.
+
|New node installed with perfsonar, running bandwidth and latency tests. Old nodes shut down. Awaiting test results.
|2020-09-30
+
|2020-10-15
 
|-
 
|-
 
|UKI-NORTHGRID-MAN-HEP
 
|UKI-NORTHGRID-MAN-HEP
 
|<span style="color:blue">On hold</span>
 
|<span style="color:blue">On hold</span>
 
|
 
|
|Hardware ordered, but hasn't arrived yet. Installation also depending on network upgrade. No information by when this will be completed (also dependent on the University getting its 100G connections to JISC).
+
|Hardware arrived at office building, needs to be moved to machine room. Installation also depending on network upgrade. No information by when this will be completed (also dependent on the University getting its 100G connections to JISC).
|2020-09-20
+
|2020-12-15
 
|-
 
|-
 
|UKI-NORTHGRID-SHEF-HEP
 
|UKI-NORTHGRID-SHEF-HEP
|<span style="color:orange">In progress</span>
+
|<span style="color:green">Done</span>
 
|
 
|
|Sheffield Has installed new box and awaiting networking team to open firewall ports and deal with reverse lookup DNS which they are dragging their heels on.
+
|Sheffield Has installed new box and networking team have opened firewall ports and deal with reverse lookup DNS. The box is configured with bonded interface so may need separating out in the future. For now it is "working" attention needs to be elsewhere.
|2020-09-30
+
|2020-10-05
 
|-
 
|-
 
|UKI-SCOTGRID-DURHAM
 
|UKI-SCOTGRID-DURHAM
Line 101: Line 95:
 
|-
 
|-
 
|UKI-SOUTHGRID-BHAM-HEP
 
|UKI-SOUTHGRID-BHAM-HEP
|<span style="color:red">Unknown</span>
+
|<span style="color:green">Done</span>
|
+
|epgperf.ph.bham.ac.uk
|
+
|Reinstalled perfSONAR toolkit and it appears to be working. Previous server still available if needed.
|YYYY-MM-DD
+
|2021-01-28
 
|-
 
|-
 
|UKI-SOUTHGRID-BRIS
 
|UKI-SOUTHGRID-BRIS
|<span style="color:orange">In progress</span>
+
|<span style="color:green">Done</span>
|
+
| dice-io-37-00.acrc.bris.ac.uk
|new Perfsonar hardware in rack & iDRAC should be configured, no OS-load yet!
+
|Completed 1 NIC configuration (full replacement of the previous box). Next: request and configure new networks for 2nd NIC with new aliases.
|2020-10-01
+
|2020-10-30
|-
+
|UKI-SOUTHGRID-CAM-HEP
+
|<span style="color:red">Unknown</span>
+
|
+
|
+
|YYYY-MM-DD
+
 
|-
 
|-
 
|UKI-SOUTHGRID-OX-HEP
 
|UKI-SOUTHGRID-OX-HEP
Line 124: Line 112:
 
|Completed.
 
|Completed.
 
|2020-09-30
 
|2020-09-30
 +
|-
 +
|UKI-SOUTHGRID-SUSX
 +
|<span style="color:orange">In Progress</span>
 +
|grid-perfsonar.hpc.susx.ac.uk
 +
|Hardware arrived and installed in DC. Still sorting networking out and need to install and configure PerfSonar server
 +
|2020-11-17
 
|-
 
|-
 
|UKI-SOUTHGRID-RALPP
 
|UKI-SOUTHGRID-RALPP
|<span style="color:red">Unknown</span>
+
|<span style="color:green">Done</span>
 
|
 
|
 
|
 
|
|YYYY-MM-DD
+
|2020-11-12
 
|-
 
|-
|UKI-SOUTHGRID-SUSX
+
 
|<span style="color:red">Unknown</span>
+
|
+
|
+
|YYYY-MM-DD
+
 
|}
 
|}
  
 +
==Installation Caveats==
 +
 +
Please add any comments below.
  
 
[[Category:Sites Status]]
 
[[Category:Sites Status]]
 
[[Category:Networking]]
 
[[Category:Networking]]

Revision as of 09:35, 28 January 2021

Deployment

We are installing WLCG nodes and deployment instructions may be found on the OSG Networking pages. In the past large sites had two hosts, one for bandwidth tests and one for latency tests. In this refresh both tests run from one host using two NICs, each with its own FQDN. Details of how to configure this new dual-NIC configuration may be found on the OSG site here and in the official perfSONAR documentation. Please make sure to update the GOCDB if you change the names of the hosts. You can check basic operation of your hosts on the WLCG Check_MK service:

and also the UK dashboard here

With respect to the existing data, the WLCG installation guide states: "Local measurement archive backup is not needed as OSG/WLCG stores all measurements centrally. In case you'd like to perform the backup anyway please follow the migration guide."

Site Status New host names Notes Date last reviewed or updated
RAL Tier-1 In progress Hardware has been installed and cabled up. The 100Gb/s capable switch that it will connect to has not been installed yet. We are working on connecting it at 10Gb/s for now so we can get it working and will upgrade it to 100Gb/s when the switch arrives (~December). 2020-10-02
UKI-LT2-Brunel In progress The perfSONAR server has been delivered but access to the data centre has been restricted. Access to the data centre should be possible by mid October and we hope to have it running soon after. 2020-10-02
UKI-LT2-IC-HEP Done lt2ps00-lat.grid.hep.ph.ic.ac.uk lt2ps00-bw.grid.hep.ph.ic.ac.uk Joined WLCG 100G mesh 2020-09-30
UKI-LT2-QMUL In progress New 100Gb-capable perfSONAR hardware has been deployed into rack, connected to 100Gb switch and has IPv4/IPv6 connectivity w/ jumbo frames. We would like to migrate the PMA (perfSONAR Measurement Archive) from our existing perfSONAR hosts but if this is not necessary, we don’t have a problem in simply changing our DNS records to point to the new host and consider the PMA on the existing hosts as ‘lost’.

As the existing hosts require physical access in order to gain shell access, migrating the data is somewhat difficult as our Mile End campus is still under lockdown with limited access available to us.

2020-05-29
UKI-LT2-RHUL In progress New node was received and set up in our lab, has now been moved to the data centre and is ready for physical installation, along with some accompanying network equipment. No estimate yet as to when we could do this. Currently (Jan 2021) only doing essential maintenance (Simon). 2021-01-12
UKI-NORTHGRID-LANCS-HEP Done The routing scripts, which set packets to "only go out the interface they came in", break our perfsonar if they are run so results might be affected by this. 2020-12-04
UKI-NORTHGRID-LIV-HEP Done New node installed with perfsonar, running bandwidth and latency tests. Old nodes shut down. Awaiting test results. 2020-10-15
UKI-NORTHGRID-MAN-HEP On hold Hardware arrived at office building, needs to be moved to machine room. Installation also depending on network upgrade. No information by when this will be completed (also dependent on the University getting its 100G connections to JISC). 2020-12-15
UKI-NORTHGRID-SHEF-HEP Done Sheffield Has installed new box and networking team have opened firewall ports and deal with reverse lookup DNS. The box is configured with bonded interface so may need separating out in the future. For now it is "working" attention needs to be elsewhere. 2020-10-05
UKI-SCOTGRID-DURHAM Done They are seeing asymmetric routing, which is being investigated. 2020-05-29
UKI-SCOTGRID-ECDF Done Completed before Covid-19 caused problems. 2020-05-29
UKI-SCOTGRID-GLASGOW Done ps001.gla.scotgrid.ac.uk ps002.gla.scotgrid.ac.uk Hardware installed, highlighted problems with number of paths due to in process DC migration as well as IPv6 bandwidth issues. 2020-09-30
UKI-SOUTHGRID-BHAM-HEP Done epgperf.ph.bham.ac.uk Reinstalled perfSONAR toolkit and it appears to be working. Previous server still available if needed. 2021-01-28
UKI-SOUTHGRID-BRIS Done dice-io-37-00.acrc.bris.ac.uk Completed 1 NIC configuration (full replacement of the previous box). Next: request and configure new networks for 2nd NIC with new aliases. 2020-10-30
UKI-SOUTHGRID-OX-HEP Done t2ps-bandwidth2.physics.ox.ac.uk t2ps-latency2.physics.ox.ac.uk Completed. 2020-09-30
UKI-SOUTHGRID-SUSX In Progress grid-perfsonar.hpc.susx.ac.uk Hardware arrived and installed in DC. Still sorting networking out and need to install and configure PerfSonar server 2020-11-17
UKI-SOUTHGRID-RALPP Done 2020-11-12

Installation Caveats

Please add any comments below.