Difference between revisions of "Main Page"
From GridPP Wiki
(→Getting up and running on the grid - users: - added a link to the GridPP CERN VM guide.) |
(→Sites in GridPP) |
||
| (50 intermediate revisions by 16 users not shown) | |||
| Line 1: | Line 1: | ||
| − | ==Sites in GridPP== | + | ==Sites in GridPP== |
* [[ScotGrid]] Tier2 - [http://www.scotgrid.ac.uk/wiki Glasgow], [[Edinburgh]], [[Durham]] | * [[ScotGrid]] Tier2 - [http://www.scotgrid.ac.uk/wiki Glasgow], [[Edinburgh]], [[Durham]] | ||
| − | * [[NorthGrid]] Tier2 - [[Lancaster]], [[Liverpool]], [[Manchester]], [[Sheffield]] | + | * [[NorthGrid]] Tier2 - [[Lancaster]], [[Liverpool]], [[Manchester]], [[Sheffield]] |
| − | * [[SouthGrid]] Tier2 - [[Birmingham]], [[Bristol]], [[Cambridge]], [[Oxford | + | * [[SouthGrid]] Tier2 - [[Birmingham]], [[Bristol]], [[Cambridge]], [[Oxford]], [http://www.gridpp.ac.uk/wiki/RAL_Tier2 Rutherford Appleton Laboratory], [[Sussex]] |
| − | * [[London Tier2]] Tier2 - [[Brunel] | + | * [[London Tier2]] Tier2 - [[Brunel]], [https://www.gridpp.ac.uk/wiki/IC-HEP Imperial College ], [https://www.gridpp.ac.uk/wiki/QMUL Queen Mary], [https://www.gridpp.ac.uk/wiki/RHUL Royal Holloway] |
* [[RAL Tier1]] - Rutherford Appleton Laboratory | * [[RAL Tier1]] - Rutherford Appleton Laboratory | ||
| + | * [https://www.gridpp.ac.uk/wiki/Category:Sites_Status The Site Status] category. Pages that Jeremy would like the sites to keep up to date :-) | ||
==Security== | ==Security== | ||
| Line 10: | Line 11: | ||
* How to [[Report_Software_Vulnerability | Report a Software Vulnerability ]] | * How to [[Report_Software_Vulnerability | Report a Software Vulnerability ]] | ||
* How to ban or blacklist a user on a CE or SE [[How to ban/blacklist user on CE and SE]] | * How to ban or blacklist a user on a CE or SE [[How to ban/blacklist user on CE and SE]] | ||
| − | * Other [[Security_Information | Security Information ]] | + | * Other [[Security_Information | Security Information, errors and workarounds ]] |
| − | + | * Info on [[Tracing_Jobs | Tracing Jobs]] | |
| − | + | ||
| − | *[[ | + | |
==Key Documents== | ==Key Documents== | ||
| − | Important documents are called [https://www.gridpp.ac.uk/ | + | Important documents are called [https://www.gridpp.ac.uk/keydocs Key Docs]. This describes how |
to make sure the core documents get maintained well. | to make sure the core documents get maintained well. | ||
| Line 23: | Line 22: | ||
==GridPP Cloud== | ==GridPP Cloud== | ||
| − | * [[ | + | * [[:Category:Cloud & VM|Cloud & VM pages]] |
| − | * [[Cloud Work at Imperial ]] (includes glideinWMS) | + | * [[Cloud Work at Imperial]] (includes glideinWMS) |
==Project Management Pages== | ==Project Management Pages== | ||
| Line 30: | Line 29: | ||
* [[Current Activities]] | * [[Current Activities]] | ||
* [[Historical Archive]] | * [[Historical Archive]] | ||
| + | * [[Engagements and commitments]] | ||
==GridPP Tier2 Support== | ==GridPP Tier2 Support== | ||
| Line 38: | Line 38: | ||
===Middleware=== | ===Middleware=== | ||
| − | + | * [https://www.gridpp.ac.uk/wiki/Dirac GridPP DIRAC] (for users and admins) | |
| + | * [[ Rucio ]] | ||
* [[ Argus Server ]] | * [[ Argus Server ]] | ||
* [[Grid Certificate]] | * [[Grid Certificate]] | ||
* [[Data Management]] | * [[Data Management]] | ||
* [[Grid Storage]] | * [[Grid Storage]] | ||
| + | * [[New Information System]] | ||
* [[GitHub Repositories ]] | * [[GitHub Repositories ]] | ||
* [[Cluster Management]] | * [[Cluster Management]] | ||
| Line 49: | Line 51: | ||
* [https://grid-deployment.web.cern.ch/grid-deployment/cgi-bin/dashboard.cgi Glite software builds] | * [https://grid-deployment.web.cern.ch/grid-deployment/cgi-bin/dashboard.cgi Glite software builds] | ||
* [[Yaim - GridPP specific settings]] | * [[Yaim - GridPP specific settings]] | ||
| + | * [[https with PerfSonar 4.3.4]] | ||
| + | * [[DPM to DCache Migration]] | ||
* [[Puppet]] | * [[Puppet]] | ||
| − | * [[ | + | * [[XRootD-2024]] |
| − | * [https://www.gridpp.ac.uk/wiki/Staged_rollout Staged Rollout] | + | * [https://www.gridpp.ac.uk/wiki/Staged_rollout Staged Rollout] (obsolete) |
* Also see [[Security_Information | Security Information ]] for some of the security middleware | * Also see [[Security_Information | Security Information ]] for some of the security middleware | ||
| Line 63: | Line 67: | ||
* [[Regional operations]] | * [[Regional operations]] | ||
* [[HEPSPEC06]] | * [[HEPSPEC06]] | ||
| + | ** [[Benchmarking procedure]] | ||
** [[Publishing tutorial]] | ** [[Publishing tutorial]] | ||
| + | * [[RHEL9 systems]] | ||
| + | * [[ARC6 EL9]] | ||
* [[Compatibility table for EMI2/3 and SL5/6 ]] | * [[Compatibility table for EMI2/3 and SL5/6 ]] | ||
| Line 69: | Line 76: | ||
===Middleware - early adoption & testing=== | ===Middleware - early adoption & testing=== | ||
| + | * [[Centos7 Adoption]] | ||
* [https://www.gridpp.ac.uk/wiki/Staged_rollout Staged Rollout] | * [https://www.gridpp.ac.uk/wiki/Staged_rollout Staged Rollout] | ||
* [https://www.gridpp.ac.uk/wiki/IPv6 IPv6 TestBed] | * [https://www.gridpp.ac.uk/wiki/IPv6 IPv6 TestBed] | ||
| + | * [https://www.gridpp.ac.uk/wiki/IPv6_Fallback IPv6 Fallback] | ||
===VO Support=== | ===VO Support=== | ||
| Line 77: | Line 86: | ||
** [[Adoption of Backup GridPP Voms Servers]] | ** [[Adoption of Backup GridPP Voms Servers]] | ||
** [[Maintaining GridPP approved VOs]] | ** [[Maintaining GridPP approved VOs]] | ||
| + | ** [[GridPP VO Incubator]] | ||
** [[Policies for GridPP approved VOs]] | ** [[Policies for GridPP approved VOs]] | ||
***[https://www.gridpp.ac.uk/wiki/EGI_VO_registration EGI policies and registration ] | ***[https://www.gridpp.ac.uk/wiki/EGI_VO_registration EGI policies and registration ] | ||
** [[VomsSnooper Tools]] - Generate and check your config from the [http://operations-portal.egi.eu/vo Operations portal] | ** [[VomsSnooper Tools]] - Generate and check your config from the [http://operations-portal.egi.eu/vo Operations portal] | ||
| − | ** [[Non LHC VO Status and Plans]] | + | ** [[GridPP_VO_Incubator|Non LHC VO Status and Plans]] |
* [[Current VO Fairshares at T2/T1]] | * [[Current VO Fairshares at T2/T1]] | ||
| − | * [[New VO deployment]] | + | * [[New VO deployment]] - covers the ''creation'' of new VOs (what information is needed) and the steps taken for the deployment |
* [[Instruction for VO administrators]] | * [[Instruction for VO administrators]] | ||
* [[VOMS proxy time limited and how to request an extension]] | * [[VOMS proxy time limited and how to request an extension]] | ||
| Line 108: | Line 118: | ||
==== Getting up and running on the grid - users ==== | ==== Getting up and running on the grid - users ==== | ||
| + | * [[GridPP - Start Here|START HERE]] | ||
* [[Grid user crash course]] | * [[Grid user crash course]] | ||
* [[Quick Guide to Dirac|A quick guide to DIRAC]] | * [[Quick Guide to Dirac|A quick guide to DIRAC]] | ||
* [[A quick guide to CVMFS]] | * [[A quick guide to CVMFS]] | ||
* [[RALnonLHCCVMFS|RAL non-LHC CVMFS, i.e. the Gridpp Repository]] | * [[RALnonLHCCVMFS|RAL non-LHC CVMFS, i.e. the Gridpp Repository]] | ||
| − | |||
* [[Guide to Ganga]] | * [[Guide to Ganga]] | ||
* [[GridPP and the CERN VM service]] | * [[GridPP and the CERN VM service]] | ||
| Line 124: | Line 134: | ||
==== Getting up and running on the grid - new VOs ==== | ==== Getting up and running on the grid - new VOs ==== | ||
| + | |||
| + | ''Note - this section is under development.'' | ||
| + | |||
| + | * [[Start_Here_-_Creating_a_new_VO|START HERE - Registering the VO]] | ||
| + | |||
| + | <!-- | ||
* [[Setting up a new Virtual Organisation (VO)]] | * [[Setting up a new Virtual Organisation (VO)]] | ||
* [[Where to get help]] | * [[Where to get help]] | ||
| − | * [[ | + | * [[Start_Here_-_Creating_a_new_VO|Registering the VO]] |
* [[Wearing different hats]] | * [[Wearing different hats]] | ||
* [[Data Management]] | * [[Data Management]] | ||
| Line 139: | Line 155: | ||
* [[Other Useful VO links]] | * [[Other Useful VO links]] | ||
| − | + | --> | |
| − | + | ===Monitoring=== | |
| − | * [[ | + | * [[ ARGO Nagios Monitoring ]] |
* [[Nagios]] | * [[Nagios]] | ||
| + | * [https://www.gridpp.ac.uk/wiki/PerfSonarInstall perfSonar] | ||
| + | * [http://vacmon.gridpp.ac.uk/ VacMon for Vac and Vcycle sites] | ||
* [[MonAMI]]: [[MonAMI_by_example|MonAMI by example]] tutorial, and how to monitor [[MonAMI_dCache_plugin|dCache]] and [[MonAMI_DPM_plugin|DPM]]. | * [[MonAMI]]: [[MonAMI_by_example|MonAMI by example]] tutorial, and how to monitor [[MonAMI_dCache_plugin|dCache]] and [[MonAMI_DPM_plugin|DPM]]. | ||
* [[Links_Monitoring_pages]] | * [[Links_Monitoring_pages]] | ||
| Line 151: | Line 169: | ||
* [[MonitoringTools|Monitoring Tools]] | * [[MonitoringTools|Monitoring Tools]] | ||
* [[Monitoring]] | * [[Monitoring]] | ||
| + | * [[Monitoring_FAQs]] | ||
===Availability=== | ===Availability=== | ||
| Line 158: | Line 177: | ||
* [[Atlas_FCR_Procedure]] | * [[Atlas_FCR_Procedure]] | ||
* [[Steve Lloyd SAM availability]] (summary graphs) | * [[Steve Lloyd SAM availability]] (summary graphs) | ||
| − | |||
| − | |||
===Hardware=== | ===Hardware=== | ||
| Line 179: | Line 196: | ||
*[[Discussion and tasks list]] | *[[Discussion and tasks list]] | ||
*[[GDB reports]] | *[[GDB reports]] | ||
| − | |||
| − | |||
*[[:Category:UKI Testzone|UKI Testzone]] | *[[:Category:UKI Testzone|UKI Testzone]] | ||
*[[EVO Tips and Tricks]] | *[[EVO Tips and Tricks]] | ||
Latest revision as of 17:31, 17 April 2024
Sites in GridPP
- ScotGrid Tier2 - Glasgow, Edinburgh, Durham
- NorthGrid Tier2 - Lancaster, Liverpool, Manchester, Sheffield
- SouthGrid Tier2 - Birmingham, Bristol, Cambridge, Oxford, Rutherford Appleton Laboratory, Sussex
- London Tier2 Tier2 - Brunel, Imperial College , Queen Mary, Royal Holloway
- RAL Tier1 - Rutherford Appleton Laboratory
- The Site Status category. Pages that Jeremy would like the sites to keep up to date :-)
Security
- How to Report a Security Incident
- How to Report a Software Vulnerability
- How to ban or blacklist a user on a CE or SE How to ban/blacklist user on CE and SE
- Other Security Information, errors and workarounds
- Info on Tracing Jobs
Key Documents
Important documents are called Key Docs. This describes how to make sure the core documents get maintained well.
Deletions or other major changes can be listed for discussion in Stale documents.
GridPP Cloud
- Cloud & VM pages
- Cloud Work at Imperial (includes glideinWMS)
Project Management Pages
GridPP Tier2 Support
Experiment
Middleware
- GridPP DIRAC (for users and admins)
- Rucio
- Argus Server
- Grid Certificate
- Data Management
- Grid Storage
- New Information System
- GitHub Repositories
- Cluster Management
- Batch Systems
- Virtualisation
- Glite software builds
- Yaim - GridPP specific settings
- https with PerfSonar 4.3.4
- DPM to DCache Migration
- Puppet
- XRootD-2024
- Staged Rollout (obsolete)
- Also see Security Information for some of the security middleware
Operations
- ARGUS deployment
- Batch system status
- Procedures
- Site networking
- Category:Incidents
- Regional operations
- HEPSPEC06
- RHEL9 systems
- ARC6 EL9
Middleware - early adoption & testing
VO Support
- GridPP approved VOs
- Current VO Fairshares at T2/T1
- New VO deployment - covers the creation of new VOs (what information is needed) and the steps taken for the deployment
- Instruction for VO administrators
- VOMS proxy time limited and how to request an extension
- ATLAS Software Installation
- CMS in the UK
- Setting up an Automatic Blacklisting Service with ganga
Getting up and running on the grid - site admins
A tool, Instant UI, has been written to set up a User Interface (UI) quickly and easily. Instructions are available here:
- User Interface (UI) to support approved VOs (tested on EMI3/SL6)
For those who wish to "roll their own", a routinely updated tarball of a typical site-info.def/vo.d is available here:
This setup contains all the GridPP approved VOs and should be up to date.
Manual ways to setup a UI are also documented here:
- Installing a UI for Grid Submission (tested on EMI3/SL6)
- Installing a UI
- Configuring a UI
Getting up and running on the grid - users
- START HERE
- Grid user crash course
- A quick guide to DIRAC
- A quick guide to CVMFS
- RAL non-LHC CVMFS, i.e. the Gridpp Repository
- Guide to Ganga
- GridPP and the CERN VM service
- Job management - managing the lifecycle of jobs
- Long running jobs using myproxy
- http://www.gridpp.ac.uk/deployment/users/gridsite-admin.cgi?cmd=print&file=myproxy.html Good explanation about running jobs using myproxy,
- Delegating Proxies to ARC CEs
- Requiring software
- Requiring Data
Getting up and running on the grid - new VOs
Note - this section is under development.
Monitoring
- ARGO Nagios Monitoring
- Nagios
- perfSonar
- VacMon for Vac and Vcycle sites
- MonAMI: MonAMI by example tutorial, and how to monitor dCache and DPM.
- Links_Monitoring_pages
- Ranked Monitoring pages
- ATLAS Monitoring For Sites
- ROD rota
- Monitoring Tools
- Monitoring
- Monitoring_FAQs
Availability
- ATLAS Site Availability and Performance (ASAP)
- SL ATLAS tests
- Atlas_FCR_Procedure
- Steve Lloyd SAM availability (summary graphs)
Hardware
LCG Service Challenges
Operations Team
- Agenda's for the meetings will be on indico here: https://indico.cern.ch/categoryDisplay.py?categId=4592
- Action items
- Issues log
- Discussion and tasks list
- GDB reports
- UKI Testzone
- EVO Tips and Tricks
- Resiliency and Disaster Planning
- Bulletin Latest
Deployment Team pages
Useful Links
- FootPrints HelpDesk: http://helpdesk.grid-support.ac.uk
- GridPP blogs
GridPP Wiki Categories
- Special:Categories (List of all categories)
- Special:Allpages (List of all pages)
- Category:Top Level
- Category:Glossary
About GridPPWiki
- If you want to add content to this Wiki, then see advice on basic markup.
- Before you add a section it's worth browsing the names of all pages in the wiki to be sure that someone hasn't started an article with a slightly different name.
- Please use wiki categories to help organise the information in wiki. You can make categories hierarchical by adding the category to another category (a good example is that Category:File Catalog is a subcategory of Category:Data Management which is a subcategory of Category:Grid Middleware which is a subcategory of Category:Top Level). General Documentation on categories is useful.
