Difference between revisions of "Main Page"

From GridPP Wiki
Jump to: navigation, search
m
(Middleware)
 
(73 intermediate revisions by 21 users not shown)
Line 1: Line 1:
==NGS-GridPP interoperability==
+
==Sites in GridPP==
*[[Interoperation activities]]
+
* [[ScotGrid]] Tier2 - [http://www.scotgrid.ac.uk/wiki Glasgow], [[Edinburgh]], [[Durham]]
 
+
==Sites in GridPP==
+
* [[ScotGrid]] Tier2 - [http://www.scotgrid.ac.uk/wiki Glasgow], [[Edinburgh]], [[Durham]]  
+
 
* [[NorthGrid]] Tier2 - [[Lancaster]], [[Liverpool]], [[Manchester]], [[Sheffield]], Daresbury Laboratory
 
* [[NorthGrid]] Tier2 - [[Lancaster]], [[Liverpool]], [[Manchester]], [[Sheffield]], Daresbury Laboratory
 
* [[SouthGrid]] Tier2 - [[Birmingham]], [[Bristol]], [[Cambridge]], [[Oxford]], [[Warwick]], [http://www.gridpp.ac.uk/wiki/RAL_Tier2 Rutherford Appleton Laboratory], [[EFDA-JET]], [[Sussex]]
 
* [[SouthGrid]] Tier2 - [[Birmingham]], [[Bristol]], [[Cambridge]], [[Oxford]], [[Warwick]], [http://www.gridpp.ac.uk/wiki/RAL_Tier2 Rutherford Appleton Laboratory], [[EFDA-JET]], [[Sussex]]
* [[London Tier2]] Tier2 - [[Brunel]], [https://www.gridpp.ac.uk/wiki/UCL-HEP UCL], [https://www.gridpp.ac.uk/wiki/IC-HEP Imperial College ], [https://www.gridpp.ac.uk/wiki/QMUL Queen Mary], [https://www.gridpp.ac.uk/wiki/RHUL Royal Holloway]
+
* [[London Tier2]] Tier2 - [[Brunel]], [[UCL-HEP]], [https://www.gridpp.ac.uk/wiki/IC-HEP Imperial College ], [https://www.gridpp.ac.uk/wiki/QMUL Queen Mary], [https://www.gridpp.ac.uk/wiki/RHUL Royal Holloway]
 
* [[RAL Tier1]] - Rutherford Appleton Laboratory
 
* [[RAL Tier1]] - Rutherford Appleton Laboratory
 +
* [https://www.gridpp.ac.uk/wiki/Category:Sites_Status The Site Status] category. Pages that Jeremy would like the sites to keep up to date :-)
  
 
==Security==
 
==Security==
Line 13: Line 11:
 
* How to [[Report_Software_Vulnerability | Report a Software Vulnerability ]]
 
* How to [[Report_Software_Vulnerability | Report a Software Vulnerability ]]
 
* How to ban or blacklist a user on a CE or SE [[How to ban/blacklist user on CE and SE]]
 
* How to ban or blacklist a user on a CE or SE [[How to ban/blacklist user on CE and SE]]
* Other [[Security_Information | Security Information ]]
+
* Other [[Security_Information | Security Information, errors and workarounds ]]
 
+
* Info on  [[Problems_After_CA_1.88-1| some problems after the release of lcg-CA 1.88-1]]
==GridPP grid services==
+
* Info on [[Tracing_Jobs | Tracing Jobs]]
*[[Grid services]]
+
  
 
==Key Documents==
 
==Key Documents==
  
Important documents are called [https://www.gridpp.ac.uk/php/KeyDocs.php Key Docs]. This describes  how
+
Important documents are called [https://www.gridpp.ac.uk/keydocs Key Docs]. This describes  how
 
to make sure the core  documents get maintained well.
 
to make sure the core  documents get maintained well.
  
Line 26: Line 23:
  
 
==GridPP Cloud==
 
==GridPP Cloud==
* [[GridPP Cloud]]
+
* [[:Category:Cloud & VM|Cloud & VM pages]]
* [[Cloud Work at Imperial ]]
+
* [[Cloud Work at Imperial]] (includes glideinWMS)
 +
 
 +
==Project Management Pages==
 +
 
 +
* [[Current Activities]]
 +
* [[Historical Archive]]
 +
* [[Engagements and commitments]]
  
 
==GridPP Tier2 Support==
 
==GridPP Tier2 Support==
Line 36: Line 39:
  
 
===Middleware===
 
===Middleware===
 
+
* [https://www.gridpp.ac.uk/wiki/Dirac GridPP DIRAC] (for users and admins)
 +
* [[ Rucio ]]
 
* [[ Argus Server ]]
 
* [[ Argus Server ]]
 
* [[Grid Certificate]]
 
* [[Grid Certificate]]
 
* [[Data Management]]
 
* [[Data Management]]
 
* [[Grid Storage]]
 
* [[Grid Storage]]
 +
* [[New Information System]]
 +
* [[GitHub Repositories ]]
 
* [[Cluster Management]]
 
* [[Cluster Management]]
 
* [[:Category:Batch_Systems|Batch Systems]]
 
* [[:Category:Batch_Systems|Batch Systems]]
Line 46: Line 52:
 
* [https://grid-deployment.web.cern.ch/grid-deployment/cgi-bin/dashboard.cgi Glite software builds]
 
* [https://grid-deployment.web.cern.ch/grid-deployment/cgi-bin/dashboard.cgi Glite software builds]
 
* [[Yaim - GridPP specific settings]]
 
* [[Yaim - GridPP specific settings]]
 +
* [[https with PerfSonar 4.3.4]]
 +
* [[DPM to DCache Migration]]
 
* [[Puppet]]
 
* [[Puppet]]
* [https://www.gridpp.ac.uk/wiki/Staged_rollout Staged Rollout]
+
* [[XRootD-2024]]
 +
* [https://www.gridpp.ac.uk/wiki/Staged_rollout Staged Rollout] (obsolete)
 
* Also see  [[Security_Information | Security Information ]] for some of the security middleware
 
* Also see  [[Security_Information | Security Information ]] for some of the security middleware
  
Line 55: Line 64:
 
* [[Batch system status]]
 
* [[Batch system status]]
 
* [[Procedures]]
 
* [[Procedures]]
* [[Site information]]
 
* [[Site status and plans]]
 
 
* [[Protected Site networking|Site networking]]
 
* [[Protected Site networking|Site networking]]
 
* [[:Category:Incidents]]
 
* [[:Category:Incidents]]
 
* [[Regional operations]]
 
* [[Regional operations]]
 
* [[HEPSPEC06]]
 
* [[HEPSPEC06]]
 +
** [[Benchmarking procedure]]
 
** [[Publishing tutorial]]
 
** [[Publishing tutorial]]
 +
* [[RHEL9 systems]]
 +
* [[ARC6 EL9]]
  
* [[Middleware transition]]
 
 
* [[Compatibility table for EMI2/3 and SL5/6 ]]
 
* [[Compatibility table for EMI2/3 and SL5/6 ]]
  
 
===Middleware - early adoption & testing===
 
===Middleware - early adoption & testing===
  
 +
* [[Centos7 Adoption]]
 
* [https://www.gridpp.ac.uk/wiki/Staged_rollout Staged Rollout]
 
* [https://www.gridpp.ac.uk/wiki/Staged_rollout Staged Rollout]
 
* [https://www.gridpp.ac.uk/wiki/IPv6 IPv6 TestBed]
 
* [https://www.gridpp.ac.uk/wiki/IPv6 IPv6 TestBed]
 +
* [https://www.gridpp.ac.uk/wiki/IPv6_Fallback IPv6 Fallback]
  
 
===VO Support===
 
===VO Support===
Line 76: Line 87:
 
** [[Adoption of Backup GridPP Voms Servers]]
 
** [[Adoption of Backup GridPP Voms Servers]]
 
** [[Maintaining GridPP approved VOs]]
 
** [[Maintaining GridPP approved VOs]]
 +
** [[GridPP VO Incubator]]
 
** [[Policies for GridPP approved VOs]]
 
** [[Policies for GridPP approved VOs]]
 
***[https://www.gridpp.ac.uk/wiki/EGI_VO_registration EGI policies and registration ]
 
***[https://www.gridpp.ac.uk/wiki/EGI_VO_registration EGI policies and registration ]
 
** [[VomsSnooper Tools]] - Generate and check your config from the [http://operations-portal.egi.eu/vo Operations portal]
 
** [[VomsSnooper Tools]] - Generate and check your config from the [http://operations-portal.egi.eu/vo Operations portal]
** [[Non LHC VO Status and Plans]]
+
** [[GridPP_VO_Incubator|Non LHC VO Status and Plans]]
 
* [[Current VO Fairshares at T2/T1]]
 
* [[Current VO Fairshares at T2/T1]]
* [[New VO deployment]]  
+
* [[New VO deployment]] - covers the ''creation'' of new VOs (what information is needed) and the steps taken for the deployment
 
* [[Instruction for VO administrators]]
 
* [[Instruction for VO administrators]]
 
* [[VOMS proxy time limited and how to request an extension]]
 
* [[VOMS proxy time limited and how to request an extension]]
Line 107: Line 119:
  
 
==== Getting up and running on the grid - users ====
 
==== Getting up and running on the grid - users ====
 +
* [[GridPP - Start Here|START HERE]]
 
* [[Grid user crash course]]
 
* [[Grid user crash course]]
* [[Quick Guide to Dirac]]
+
* [[Quick Guide to Dirac|A quick guide to DIRAC]]
* http://wiki.egee-see.org/index.php/Quick_User_Guide_for_Submitting_Jobs - another take on getting started
+
* [[A quick guide to CVMFS]]
 +
* [[RALnonLHCCVMFS|RAL non-LHC CVMFS, i.e. the Gridpp Repository]]
 +
* [[Guide to Ganga]]
 +
* [[GridPP and the CERN VM service]]
  
 
* Job management - managing the lifecycle of jobs
 
* Job management - managing the lifecycle of jobs
 
** [[Long running jobs using myproxy]]
 
** [[Long running jobs using myproxy]]
 
** http://www.gridpp.ac.uk/deployment/users/gridsite-admin.cgi?cmd=print&file=myproxy.html Good explanation about running jobs using myproxy,
 
** http://www.gridpp.ac.uk/deployment/users/gridsite-admin.cgi?cmd=print&file=myproxy.html Good explanation about running jobs using myproxy,
 
+
** [[Delegating Proxies to ARC CEs]]
 
** [[Requiring software]]
 
** [[Requiring software]]
 
** [[Requiring Data]]
 
** [[Requiring Data]]
  
 
==== Getting up and running on the grid - new VOs ====
 
==== Getting up and running on the grid - new VOs ====
 +
 +
''Note - this section is under development.''
 +
 +
* [[Start_Here_-_Creating_a_new_VO|START HERE - Registering the VO]]
 +
 +
<!--
  
 
* [[Setting up a new Virtual Organisation (VO)]]
 
* [[Setting up a new Virtual Organisation (VO)]]
 
* [[Where to get help]]
 
* [[Where to get help]]
* [[Setting up the VO]]  
+
* [[Start_Here_-_Creating_a_new_VO|Registering the VO]]  
 
* [[Wearing different hats]]
 
* [[Wearing different hats]]
 
* [[Data Management]]
 
* [[Data Management]]
Line 134: Line 156:
 
* [[Other Useful VO links]]
 
* [[Other Useful VO links]]
  
===Monitoring===
+
-->
  
* [[ UKI WLCG Regional Nagios]]
+
===Monitoring===
* [[ Backup Regional Nagios ]]
+
* [[ ARGO Nagios Monitoring ]]
 
* [[Nagios]]
 
* [[Nagios]]
 +
* [https://www.gridpp.ac.uk/wiki/PerfSonarInstall perfSonar]
 +
* [http://vacmon.gridpp.ac.uk/ VacMon for Vac and Vcycle sites]
 
* [[MonAMI]]: [[MonAMI_by_example|MonAMI by example]] tutorial, and how to monitor [[MonAMI_dCache_plugin|dCache]] and [[MonAMI_DPM_plugin|DPM]].
 
* [[MonAMI]]: [[MonAMI_by_example|MonAMI by example]] tutorial, and how to monitor [[MonAMI_dCache_plugin|dCache]] and [[MonAMI_DPM_plugin|DPM]].
 
* [[Links_Monitoring_pages]]
 
* [[Links_Monitoring_pages]]
Line 146: Line 170:
 
* [[MonitoringTools|Monitoring Tools]]
 
* [[MonitoringTools|Monitoring Tools]]
 
* [[Monitoring]]
 
* [[Monitoring]]
 +
* [[Monitoring_FAQs]]
  
 
===Availability===
 
===Availability===
  
 +
* [[ATLAS Site Availability and Performance (ASAP)]]
 
* [[SL ATLAS tests]]
 
* [[SL ATLAS tests]]
 
* [[Atlas_FCR_Procedure]]
 
* [[Atlas_FCR_Procedure]]
 
* [[Steve Lloyd SAM availability]] (summary graphs)
 
* [[Steve Lloyd SAM availability]] (summary graphs)
* [[EGEE_availability_reports]]
 
* [[Availability graphs]]
 
  
 
===Hardware===
 
===Hardware===
Line 173: Line 197:
 
*[[Discussion and tasks list]]
 
*[[Discussion and tasks list]]
 
*[[GDB reports]]
 
*[[GDB reports]]
*[[Working with NGS]]
 
*[[NGS Surgery Reports]]
 
 
*[[:Category:UKI Testzone|UKI Testzone]]
 
*[[:Category:UKI Testzone|UKI Testzone]]
 
*[[EVO Tips and Tricks]]
 
*[[EVO Tips and Tricks]]
Line 187: Line 209:
 
* [[GridPP blogs]]
 
* [[GridPP blogs]]
  
== Test Pages (experimental) ==
 
[[Separate Site Status Pages]]
 
  
 
==GridPP Wiki Categories==
 
==GridPP Wiki Categories==

Latest revision as of 17:05, 28 February 2024

Sites in GridPP

Security

Key Documents

Important documents are called Key Docs. This describes how to make sure the core documents get maintained well.

Deletions or other major changes can be listed for discussion in Stale documents.

GridPP Cloud

Project Management Pages

GridPP Tier2 Support

Experiment

Middleware

Operations

Middleware - early adoption & testing

VO Support

Getting up and running on the grid - site admins

A tool, Instant UI, has been written to set up a User Interface (UI) quickly and easily. Instructions are available here:

For those who wish to "roll their own", a routinely updated tarball of a typical site-info.def/vo.d is available here:

This setup contains all the GridPP approved VOs and should be up to date.

Manual ways to setup a UI are also documented here:

Getting up and running on the grid - users

Getting up and running on the grid - new VOs

Note - this section is under development.


Monitoring

Availability

Hardware

LCG Service Challenges

Operations Team

Deployment Team pages

Useful Links


GridPP Wiki Categories

About GridPPWiki