https://www.gridpp.ac.uk/w/index.php?title=Middleware_transition&feed=atom&action=historyMiddleware transition - Revision history2024-03-28T19:50:06ZRevision history for this page on the wikiMediaWiki 1.22.0https://www.gridpp.ac.uk/w/index.php?title=Middleware_transition&diff=2984&oldid=prevStephen jones at 09:35, 30 November 20122012-11-30T09:35:54Z<p></p>
<p><b>New page</b></p><div>== gLite to UMD/EMI middleware transition ==<br />
<br />
This is to collate information about site status and plans in moving from the gLite middleware stack to EMI-x/UMD-x. There is also [[Middleware_upgrades|information]] on the technical processes of EMI/UMD middleware transition, including an [[Example_Build_of_an_EMI-UMD_Cluster|example]] .<br />
<br />
== LondonGrid ==<br />
=== UKI-LT2-BRUNEL ===<br />
<br />
====gLite3.1/SL4====<br />
<br />
I have the following services on glite 3.1<br />
<br />
-> CEs dgc-grid-40, and dgc-grid-44<br />
<br />
Soon to be replace by CreamCEs<br />
<br />
-> CE dgc-grid-35<br />
<br />
it should be decommissioned by the end of the year<br />
<br />
-> BDII<br />
<br />
to be upgraded in the next few months<br />
<br />
-> SE dgc-grid-50<br />
<br />
it has only 2% of the data at the site. I'm planning an upgrade for the <br />
3rd week of December. Most of the data at Brunel is in dc2-grid-64, <br />
glite 3.2 SE.<br />
<br />
====gLite3.2/EMI====<br />
<br />
ARGUS<br />
<br />
. EMI Argus server running stable since May.<br />
<br />
BDII_site<br />
<br />
. Upgrading to glite 3.2 in October<br />
<br />
CE (CREAM/LCG)<br />
<br />
. dgc-grid-43 running on EMI CreamCE.<br />
. Other CEs on LCG, but to be upgraded before the end of the year <br />
<br />
glexec<br />
<br />
. Deployed in dgc-grid-43<br />
. To be deployed in all CEs when they are upgraded<br />
<br />
SE<br />
<br />
. Main SE (95%) of the storage running on SL5 DPM 1.8<br />
. Remaining SE will be upgraded in December<br />
<br />
UI<br />
<br />
. SL5 glite 3.2<br />
<br />
WN<br />
<br />
. All glite 3.2<br />
<br />
====Comments====<br />
<br />
<br />
<br />
=== UKI-LT2-IC-HEP ===<br />
<br />
I have a SL4 WMS (wms02.grid.hep.ph.ic.ac.uk) as there is no SL5 WMS in glite.<br />
I use wms01 to test the EMI WMS, but it took today's (9/8/11) update to get it working. I intend to keep the glite 3.2 WMS around for a while longer until the EMI version is stable.<br />
Note that our lcg-CEs are running SL5 (technically CentOS 5).<br />
<br />
====gLite3.2/EMI====<br />
<br />
ARGUS: none so far<br />
<br />
BDII_site: glite 3.2<br />
<br />
CE (CREAM/LCG): CREAM glite 3.2, no SGE support in EMI so far, lcg-CE 3.1 on CentOS 5<br />
<br />
glexec: not so far<br />
<br />
SE: dCache 1.9.12-8 (updates directly from dCache)<br />
<br />
UI: glite 3.2<br />
<br />
WMS: glite 3.1 and EMI <br />
<br />
WN: glite 3.2<br />
<br />
====Comments====<br />
<br />
<br />
<br />
=== UKI-LT2-QMUL ===<br />
<br />
lcg-CE (SL4): and having problems with CREAM (Glite 3.2 version), so will remain until that's done.<br />
* Will require sge support in CREAM to move to UMD release. <br />
<br />
<br />
====gLite3.2/EMI====<br />
<br />
ARGUS: Not yet<br />
<br />
BDII_site: Glite 3.2 version deployed. This had problems with stability, so now using openldap 2.4 - which seems much more stable. <br />
<br />
CE (CREAM/LCG): <br />
* ce01: lcg-CE (old hardware, remains for testing and through inertia)<br />
* ce02: lcg-CE (Old hardware, remains for testing and through inertia)<br />
* ce03: lcg-CE x5420 machine. In service, will be kept until CREAM problems solved<br />
* ce04: CREAM - having problems from time to time. See sge-cream discussion<br />
<br />
<br />
glexec : Not yet deployed. <br />
<br />
SE: <br />
* se01: Test - Storm 1.5 - to be decommissioned. <br />
* se02: Decomissioned<br />
* se03: Production - Storm 1.7.0 and 1.7.1. Frontend is EMI release, backend is previous EMI (and UMD) release. <br />
* se04: Test - StoRM 1.7.1 EMI release (I've submitted a staged rollout report recommending it fails). <br />
<br />
<br />
UI<br />
* Not run at the grid site. <br />
<br />
WMS<br />
* NA<br />
WN<br />
* 3.2.10 tarball release.<br />
<br />
====Comments====<br />
<br />
=== UKI-LT2-RHUL ===<br />
lcg-CE:- have to plan for this by finding a suitable hardware.<br />
<br />
====gLite3.2/EMI====<br />
<br />
ARGUS - 3.2.4-2<br />
<br />
BDII_site - 3.2.11-1<br />
<br />
CE (CREAM/LCG)3.2.10<br />
<br />
glexec 3.2.6-3<br />
<br />
SE 1.8.1<br />
<br />
UI<br />
<br />
<br />
WN 3.2.11<br />
<br />
====Comments====<br />
<br />
<br />
=== UKI-LT2-UCL-CENTRAL === <br />
<br />
====Comments====<br />
<br />
Site no longer exists!<br />
<br />
=== UKI-LT2-UCL-HEP ===<br />
<br />
====gLite3.2/EMI====<br />
<br />
ARGUS: not yet<br />
<br />
BDII_site: gLite 3.1<br />
<br />
CE (CREAM/LCG): CREAM CE on gLite 3.2, will soon retire LCG CE, which is on 3.1<br />
<br />
glexec: not yet<br />
<br />
SE: head node still gLite 3.1 on SLC4, to be upgraded soon<br />
<br />
UI<br />
<br />
WMS<br />
<br />
WN: gLite 3.2<br />
<br />
====Comments====<br />
<br />
== NorthGrid==<br />
=== UKI-NORTHGRID-LANCS-HEP ===<br />
<br />
<br />
<br />
====gLite3.2/EMI====<br />
<br />
ARGUS - Not yet, need to plan this one out.<br />
<br />
BDII_site - glite-BDII_site-3.2.10-1.sl5.x86_64<br />
<br />
CE (CREAM/LCG) - glite-CREAM-3.2.10-0.sl5 / lcg-CE-3.1.40-0<br />
<br />
glexec - Not yet (waiting on relocatable version)<br />
<br />
SE - DPM-server-mysql-1.7.4-7sec.sl5.x86_64 (will upgrade to 1.8 towards the end of the month/start of October)<br />
<br />
UI - SL5<br />
<br />
WMS -NA<br />
<br />
WN - glite-WN-3.2.9-0.sl5 tarball<br />
<br />
====Comments====<br />
We're planning to tentatively test the waters with UMD/EMI by installing a supplimentary cream CE with it, however like our peers we'd rather let the dust settle for a bit and only swap over when the benefits outweight the risks.<br />
<br />
=== UKI-NORTHGRID-LIV-HEP === <br />
<br />
====gLite3.2/EMI====<br />
<br />
APEL: x86_64, SL 5.5, emi-apel-1.0.0-0.sl5<br />
<br />
ARGUS: x86_64, SL 5.5, emi-argus-1.4.0-1.sl5<br />
<br />
BDII_site: x86_64, SL 5.5, emi-bdii-site-1.0.0-1.sl5<br />
<br />
CE (CREAM/LCG):<br />
hepgrid10: x86_64, SL 5.5, emi-cream-ce-1.1.0-4.sl5 (emi2)<br />
hepgrid6: x86_64, SL 5.5, emi-cream-ce-1.1.0-4.sl5 (emi2)<br />
hepgrid5: x86_64, SL 5.5, emi-cream-ce-1.1.0-4.sl5 (emi2)<br />
<br />
glexec: x86_64, SL 5.3, emi-glexec_wn-1.1.1-2.sl5<br />
<br />
SE (Headnode): x86_64, SL 6.3, dpm-1.8.4-1.el6.x86_64 (emi2)<br />
SE (Disknodes): x86_64, SL 6.3, emi-dpm_disk-1.8.4-1.el6.x86_64<br />
<br />
WMS: na<br />
<br />
WN: x86_64, SL 5.3, emi-wn-2.0.1-1.el5<br />
<br />
UI: i386, SL 4.7, glite-UI-3.1.45-0; x86_64, SL 5.5, glite-UI-3.2.10 (tarball)<br />
<br />
====Comments====<br />
<br />
Current planning: Our current baseline is stable at present. We have done a staged transition of grid servers to a new EMI baseline.<br />
Next plan is to move all to EMI2 (form EMI1) in UI, and use SL6 on all server except WN. Eventual move WN to SL6.<br />
<br />
=== UKI-NORTHGRID-MAN-HEP === <br />
<br />
All services are x86_64, SL5 and glite3.2<br />
<br />
====gLite3.2/EMI====<br />
<br />
ARGUS glite-ARGUS-3.2.4-2<br />
<br />
BDII_site glite-BDII_site-3.2.11-1.sl5<br />
<br />
BDII_top glite-BDII_top-3.2.11-1.sl5<br />
<br />
CE (CREAM) glite-CREAM-3.2.10-0.sl5 (ce01), glite-CREAM-3.2.11-2.sl5 (ce02)<br />
<br />
glexec glite-security-glexec-0.7.0-2.sl5 (ce02)<br />
<br />
SE glite-SE_dpm_mysql-3.2.7-2.sl5 (head node), glite-SE_dpm_disk-1.8.0-1.sl5 (data servers)<br />
<br />
UI glite-UI-version-3.2.8-0.sl5<br />
<br />
WN glite-WN-version-3.2.10-0.sl5<br />
<br />
====Comments====<br />
<br />
Same as Liverpool.<br />
<br />
=== UKI-NORTHGRID-SHEF-HEP ===<br />
<br />
glite 3.1 ce <br />
will be reinstalled as EMI CREAM CE in October<br />
<br />
====gLite3.2/EMI====<br />
<br />
ARGUS<br />
glite 3.2 installed<br />
<br />
BDII_site<br />
glite 3.2<br />
<br />
CE (CREAM/LCG)<br />
CREAM CE glite 3.2<br />
<br />
glexec<br />
glite 3.2 installed<br />
<br />
SE<br />
DPM 1.8.0 on DPM headnode and all disk servers<br />
<br />
UI<br />
<br />
WMS<br />
<br />
WN<br />
glite 3.2<br />
<br />
====Comments====<br />
<br />
== ScotGrid==<br />
=== UKI-SCOTGRID-DURHAM === <br />
<br />
====gLite3.2/EMI====<br />
<br />
ARGUS<br />
<br />
BDII_site<br />
<br />
CE (CREAM/LCG)<br />
<br />
glexec<br />
<br />
SE<br />
<br />
UI<br />
<br />
WMS<br />
<br />
WN<br />
<br />
====Comments====<br />
<br />
<br />
=== UKI-SCOTGRID-ECDF === <br />
<br />
====gLite3.2/EMI====<br />
<br />
ARGUS<br />
Look to deploy over the next couple of months. Place in production once verifed support. <br />
<br />
BDII_site<br />
glite-BDII_site-3.2.11-1<br />
<br />
CE (CREAM/LCG)<br />
2 x glite 3.2 CreamCE (one virtual based, one real), 1 LCG-CE<br />
Virtual instance suffering from performance issues, likely to migrate this service to a non-virtual host. <br />
LCG-CE host will be decomissioned when two stable CreamCE services are in place.<br />
<br />
glexec<br />
No plans yet. Will look to deploy gLExec-WN tarball when officially available and once gLExec is fully validated by ATLAS and LHCb.<br />
<br />
SE<br />
production SE: SL4 glite 3.1 (plan to move to SL5 glite 3.2 before the end of the year) <br />
test SE: EMI 1.0 SL5<br />
<br />
UI<br />
No UI - we use our local T3 setup to get user level access to grid services. <br />
<br />
WN <br />
Use tarball version. Plan to upgrade 3.2.11 in the next couple of months.<br />
<br />
====Comments====<br />
<br />
=== UKI-SCOTGRID-GLASGOW ===<br />
<br />
*DPM MySQL head node. Upgrade planned.<br />
*Some DPM pool nodes - rolling update to SL5 (around half of the oldest disk servers to be decommissioned after next procurement).<br />
*WMS & L&B servers. Will remain until there is a supported combination of L&B and WMS that will run on the same host.<br />
*VOMS server (already under threat of upgrade due to incident) - upgrade planned.<br />
*SL4 VOBOX for PANDA. In discussion with the VO on that one.<br />
<br />
No problems anticipated in update to SL5, once software requirements are handled<br />
<br />
====gLite3.2/EMI====<br />
<br />
ARGUS: Will deploy when CREAM/DPM have Argus support (currently use SCAS)<br />
<br />
BDII_site: glite 3.2: glite-BDII-3.2.9-0<br />
<br />
CE (CREAM/LCG): glite 3.2: glite-CREAM-3.2.8-2 <br />
<br />
glexec: glite-3.2 glite-security-glexec-0.7.0-2<br />
<br />
SE: glite-3.2 DPM 1.8.0-1<br />
<br />
UI: glite3.2: glite-UI-version-3.2.8-0<br />
<br />
WMS: glite 3.1: glite-WMS-3.1.31-0<br />
<br />
WN: glite 3.2: glite-WN-3.2.9 through 11 (rolling upgrade)<br />
<br />
LB: glite 3.1: glite-LB-3.1.20-2<br />
<br />
VOMS: glite 3.1: Voms-Admin version 2.0.15<br />
<br />
====Comments====<br />
WMS and LB will be updated once stable release version for SL5 (EMI)<br />
<br />
We have an EMI CREAM instance and ARC CEs under testing<br />
<br />
We have a test version of DPM running on svr025<br />
<br />
== SouthGrid==<br />
=== UKI-SOUTHGRID-BHAM-HEP ===<br />
<br />
* An overhaul is pending in the following weeks (9/11 - 10/11) where we hope to shift all service nodes to a new set of hardware and retire the LCG CEs<br />
<br />
* All nodes are on SL5 (.4 or .5) except the LCG-CEs which are SL4.<br />
<br />
====gLite3.2/EMI====<br />
<br />
ARGUS : gLite 3.2<br />
<br />
BDII_site : gLite 3.2<br />
<br />
CE (CREAM) : 2 x gLite 3.2<br />
<br />
CE (LCG) : 2 x gLite 3.1<br />
<br />
glexec : gLite 3.2<br />
<br />
SE : gLite 3.2, DPM 1.8<br />
<br />
UI : gLite 3.2<br />
<br />
WMS (No WMS) : N/A<br />
<br />
WN : gLite 3.2<br />
<br />
====Comments====<br />
<br />
* This is probably available somewhere and I just don't know, but a comprehensive, one stop guide for versions of software that should running and also expected loads/requirements would be *very* useful!<br />
<br />
=== UKI-SOUTHGRID-BRIS-HEP ===<br />
<br />
* StoRM v1.3 SE (lcgse02.phy.bris.ac.uk) is still SL4 as is its slave gridftp server gridftp01.phy.bris.ac.uk. StoRM v1.4 & 1.5 are not supported on SL5, and StoRM v1.6 & 1.7 (supported on SL5) are very unstable & not production ready yet (just ask Chris Walker who's had ++painful experience with them). Waiting on stable StoRM for SL5 - soon hopefuly.<br />
<br />
* lcgnetmon (owned+operated by RAL) is still SL4 AFAIK<br />
<br />
====gLite3.2/EMI====<br />
<br />
ARGUS : Not yet<br />
<br />
BDII_site : gLite 3.2<br />
<br />
CE (CREAM/LCG) : 2 x gLite 3.2 CREAM-CE<br />
<br />
glexec : Not yet<br />
<br />
SE : see above<br />
<br />
UI : gLite 3.2<br />
<br />
WMS : Ain't got one (content to use others')<br />
<br />
WN : gLite 3.2<br />
<br />
====Comments====<br />
<br />
=== UKI-SOUTHGRID-CAM-HEP ===<br />
All nodes running SL5, exceptfollowing nodes: <br />
* lcgCE 3.1 (condor)<br />
* SE (DPM)<br />
<br />
running SL4<br />
Upgrading <br />
<br />
SE under progress. the lcgCE would stay longer I imagine.<br />
<br />
====gLite3.2/EMI====<br />
<br />
ARGUS/glexec <br />
Not yet installed<br />
<br />
BDII_site <br />
gLite 3.2<br />
<br />
CE (CREAM/LCG)<br />
1 LCG CE (condor)<br />
1 CREAM CE (torque) <br />
<br />
SE<br />
The SE itself running DPM v1.7.4 (SL4)<br />
All the disk servers running v1.8 (SL5)<br />
<br />
UI<br />
gLite 3.2<br />
<br />
WMS<br />
N/A<br />
<br />
WN<br />
gLite 3.2<br />
<br />
====Comments====<br />
<br />
=== EFDA-JET ===<br />
All nodes running SL5<br />
<br />
====gLite3.2/EMI====<br />
<br />
ARGUS<br />
<br />
BDII_site<br />
<br />
CE (CREAM/LCG)<br />
<br />
glexec<br />
<br />
SE<br />
<br />
UI<br />
<br />
WMS<br />
<br />
WN<br />
<br />
====Comments====<br />
<br />
<br />
=== UKI-SOUTHGRID-OX-HEP ===<br />
*SL4 DPM head nodes still in use<br />
*Some DPM pool nodes , although we are in the process of draining an migrating to SL5 based nodes.<br />
*All old LCG-ce's have been decommissioned.<br />
* On the UK Nagios monitoring we use an SL4 based my proxy server as it is not yet available on SL5<br />
<br />
====gLite3.2/EMI====<br />
<br />
'''ARGUS''' : gLite3.2<br />
<br />
'''BDII_site''': gLite 3.2 <br />
<br />
'''CE (CREAM/LCG)''':<br />
<br />
2 CE's gLite3.2<br />
<br />
1 CE EMI (latest release under stage rollout ) <br />
<br />
'''glexec''': gLite3.2<br />
<br />
'''SE''':<br />
<br />
'''UI''' : gLite3.2<br />
<br />
'''WMS''': gLite3.1 ( Used only by gridppnagios only)<br />
<br />
'''WN''' : glite3.2<br />
<br />
====Comments====<br />
<br />
=== UKI-SOUTHGRID-RALPP ===<br />
<br />
2 lcg-CE's, Both now decommissioned and reinstalled as CreamCEs.<br />
<br />
====gLite3.2/EMI====<br />
<br />
'''ARGUS''': gLite-3.2<br />
<br />
Will replace with second VM and transition service to that<br />
<br />
'''BDII_site''': gLite-3.2<br />
<br />
Will replace with second VM and transition service to that<br />
<br />
'''Cluster Publisher''': UMD 1.1<br />
<br />
'''CE (CREAM/LCG)''': 1x gLite 3.2 2 x UMD 1.1 <br />
<br />
gLite CreamCE will be decommissioned soon and another UMD CreamCE installed to replace it<br />
<br />
'''WN/glexec''': gLite 3.2<br />
<br />
Believe there are current issues with the UMD release of WN and it is not currently recommended, will do a rolling reinstall/upgrade once it is.<br />
gLexec version will follow WNs<br />
<br />
'''SE''': dCache 1.9.5<br />
<br />
Starting testing update to 1.9.12<br />
<br />
'''UI''': gLite 3.2 <br />
<br />
No current plans for update, will probably do a rolling reinstall<br />
<br />
====Comments====<br />
<br />
== Tier1==<br />
=== RAL-LCG2-Tier-1 ===<br />
<br />
====gLite3.1/SL4====<br />
<br />
WMS - 3 nodes v3.1.32-0.slc4<br />
<br />
LCG-CE - 1 node v3.1.37-0 (planned to be migrated to glite3.2 CREAM, not scheduled yet)<br />
<br />
PROXY - v3.1.29-0<br />
<br />
====gLite3.2/EMI====<br />
<br />
APEL - v3.2.5-0.sl5<br />
<br />
ARGUS - n/a<br />
<br />
BDII_site - 3 nodes v3.2.10-1.sl5<br />
<br />
BDII_top - 5 nodes v3.2.10-3.sl5<br />
<br />
CE (CREAM/LCG) - 4 CREAM nodes v3.2.10-0.sl5, 1 CREAM node v3.2.6-0.sl5<br />
<br />
FTS - v3.2.1-2.sl5 (Oracle backend)<br />
<br />
glexec - v3.2.2-2.sl5<br />
<br />
LB - 2 nodes v3.2.12-11.sl5<br />
<br />
LFC - 7 nodes v3.2.7-2 (Oracle backend)<br />
<br />
SE - Castor 2.1.10-0<br />
<br />
UI - v3.2.10-1.sl5<br />
<br />
VOBOX - v3.2.11-0.sl5<br />
<br />
WMS - n/a<br />
<br />
WN - v3.2.7-0<br />
<br />
====Comments====<br />
<br />
Plan to virtualize further Grid Services deployments using Microsoft Hyper-V<br />
<br />
Regarding migration to EMI/UMD, no work yet, but would prefer to have access to some installation and maintenance recipes supported by developers (similar to what does exist for gLite).</div>Stephen jones