Difference between revisions of "Main Page"
From GridPP Wiki
(→Middleware) |
|||
(38 intermediate revisions by 13 users not shown) | |||
Line 1: | Line 1: | ||
− | ==Sites in GridPP== | + | ==Sites in GridPP== |
* [[ScotGrid]] Tier2 - [http://www.scotgrid.ac.uk/wiki Glasgow], [[Edinburgh]], [[Durham]] | * [[ScotGrid]] Tier2 - [http://www.scotgrid.ac.uk/wiki Glasgow], [[Edinburgh]], [[Durham]] | ||
* [[NorthGrid]] Tier2 - [[Lancaster]], [[Liverpool]], [[Manchester]], [[Sheffield]], Daresbury Laboratory | * [[NorthGrid]] Tier2 - [[Lancaster]], [[Liverpool]], [[Manchester]], [[Sheffield]], Daresbury Laboratory | ||
* [[SouthGrid]] Tier2 - [[Birmingham]], [[Bristol]], [[Cambridge]], [[Oxford]], [[Warwick]], [http://www.gridpp.ac.uk/wiki/RAL_Tier2 Rutherford Appleton Laboratory], [[EFDA-JET]], [[Sussex]] | * [[SouthGrid]] Tier2 - [[Birmingham]], [[Bristol]], [[Cambridge]], [[Oxford]], [[Warwick]], [http://www.gridpp.ac.uk/wiki/RAL_Tier2 Rutherford Appleton Laboratory], [[EFDA-JET]], [[Sussex]] | ||
− | * [[London Tier2]] Tier2 - [[Brunel]], [ | + | * [[London Tier2]] Tier2 - [[Brunel]], [[UCL-HEP]], [https://www.gridpp.ac.uk/wiki/IC-HEP Imperial College ], [https://www.gridpp.ac.uk/wiki/QMUL Queen Mary], [https://www.gridpp.ac.uk/wiki/RHUL Royal Holloway] |
* [[RAL Tier1]] - Rutherford Appleton Laboratory | * [[RAL Tier1]] - Rutherford Appleton Laboratory | ||
+ | * [https://www.gridpp.ac.uk/wiki/Category:Sites_Status The Site Status] category. Pages that Jeremy would like the sites to keep up to date :-) | ||
==Security== | ==Security== | ||
Line 10: | Line 11: | ||
* How to [[Report_Software_Vulnerability | Report a Software Vulnerability ]] | * How to [[Report_Software_Vulnerability | Report a Software Vulnerability ]] | ||
* How to ban or blacklist a user on a CE or SE [[How to ban/blacklist user on CE and SE]] | * How to ban or blacklist a user on a CE or SE [[How to ban/blacklist user on CE and SE]] | ||
− | * Other [[Security_Information | Security Information ]] | + | * Other [[Security_Information | Security Information, errors and workarounds ]] |
− | + | * Info on [[Problems_After_CA_1.88-1| some problems after the release of lcg-CA 1.88-1]] | |
− | + | * Info on [[Tracing_Jobs | Tracing Jobs]] | |
− | *[[ | + | |
==Key Documents== | ==Key Documents== | ||
− | Important documents are called [https://www.gridpp.ac.uk/ | + | Important documents are called [https://www.gridpp.ac.uk/keydocs Key Docs]. This describes how |
to make sure the core documents get maintained well. | to make sure the core documents get maintained well. | ||
Line 30: | Line 30: | ||
* [[Current Activities]] | * [[Current Activities]] | ||
* [[Historical Archive]] | * [[Historical Archive]] | ||
+ | * [[Engagements and commitments]] | ||
==GridPP Tier2 Support== | ==GridPP Tier2 Support== | ||
Line 38: | Line 39: | ||
===Middleware=== | ===Middleware=== | ||
− | + | * [https://www.gridpp.ac.uk/wiki/Dirac GridPP DIRAC] (for users and admins) | |
+ | * [[ Rucio ]] | ||
* [[ Argus Server ]] | * [[ Argus Server ]] | ||
* [[Grid Certificate]] | * [[Grid Certificate]] | ||
* [[Data Management]] | * [[Data Management]] | ||
* [[Grid Storage]] | * [[Grid Storage]] | ||
+ | * [[New Information System]] | ||
* [[GitHub Repositories ]] | * [[GitHub Repositories ]] | ||
* [[Cluster Management]] | * [[Cluster Management]] | ||
Line 49: | Line 52: | ||
* [https://grid-deployment.web.cern.ch/grid-deployment/cgi-bin/dashboard.cgi Glite software builds] | * [https://grid-deployment.web.cern.ch/grid-deployment/cgi-bin/dashboard.cgi Glite software builds] | ||
* [[Yaim - GridPP specific settings]] | * [[Yaim - GridPP specific settings]] | ||
+ | * [[https with PerfSonar 4.3.4]] | ||
+ | * [[DPM to DCache Migration]] | ||
* [[Puppet]] | * [[Puppet]] | ||
− | * [[ | + | * [[XRootD-2024]] |
− | * [https://www.gridpp.ac.uk/wiki/Staged_rollout Staged Rollout] | + | * [https://www.gridpp.ac.uk/wiki/Staged_rollout Staged Rollout] (obsolete) |
* Also see [[Security_Information | Security Information ]] for some of the security middleware | * Also see [[Security_Information | Security Information ]] for some of the security middleware | ||
Line 63: | Line 68: | ||
* [[Regional operations]] | * [[Regional operations]] | ||
* [[HEPSPEC06]] | * [[HEPSPEC06]] | ||
+ | ** [[Benchmarking procedure]] | ||
** [[Publishing tutorial]] | ** [[Publishing tutorial]] | ||
+ | * [[RHEL9 systems]] | ||
+ | * [[ARC6 EL9]] | ||
* [[Compatibility table for EMI2/3 and SL5/6 ]] | * [[Compatibility table for EMI2/3 and SL5/6 ]] | ||
Line 69: | Line 77: | ||
===Middleware - early adoption & testing=== | ===Middleware - early adoption & testing=== | ||
+ | * [[Centos7 Adoption]] | ||
* [https://www.gridpp.ac.uk/wiki/Staged_rollout Staged Rollout] | * [https://www.gridpp.ac.uk/wiki/Staged_rollout Staged Rollout] | ||
* [https://www.gridpp.ac.uk/wiki/IPv6 IPv6 TestBed] | * [https://www.gridpp.ac.uk/wiki/IPv6 IPv6 TestBed] | ||
+ | * [https://www.gridpp.ac.uk/wiki/IPv6_Fallback IPv6 Fallback] | ||
===VO Support=== | ===VO Support=== | ||
Line 83: | Line 93: | ||
** [[GridPP_VO_Incubator|Non LHC VO Status and Plans]] | ** [[GridPP_VO_Incubator|Non LHC VO Status and Plans]] | ||
* [[Current VO Fairshares at T2/T1]] | * [[Current VO Fairshares at T2/T1]] | ||
− | * [[New VO deployment]] | + | * [[New VO deployment]] - covers the ''creation'' of new VOs (what information is needed) and the steps taken for the deployment |
* [[Instruction for VO administrators]] | * [[Instruction for VO administrators]] | ||
* [[VOMS proxy time limited and how to request an extension]] | * [[VOMS proxy time limited and how to request an extension]] | ||
Line 114: | Line 124: | ||
* [[A quick guide to CVMFS]] | * [[A quick guide to CVMFS]] | ||
* [[RALnonLHCCVMFS|RAL non-LHC CVMFS, i.e. the Gridpp Repository]] | * [[RALnonLHCCVMFS|RAL non-LHC CVMFS, i.e. the Gridpp Repository]] | ||
− | |||
* [[Guide to Ganga]] | * [[Guide to Ganga]] | ||
* [[GridPP and the CERN VM service]] | * [[GridPP and the CERN VM service]] | ||
Line 150: | Line 159: | ||
===Monitoring=== | ===Monitoring=== | ||
− | + | * [[ ARGO Nagios Monitoring ]] | |
− | * [[ | + | |
− | + | ||
* [[Nagios]] | * [[Nagios]] | ||
+ | * [https://www.gridpp.ac.uk/wiki/PerfSonarInstall perfSonar] | ||
+ | * [http://vacmon.gridpp.ac.uk/ VacMon for Vac and Vcycle sites] | ||
* [[MonAMI]]: [[MonAMI_by_example|MonAMI by example]] tutorial, and how to monitor [[MonAMI_dCache_plugin|dCache]] and [[MonAMI_DPM_plugin|DPM]]. | * [[MonAMI]]: [[MonAMI_by_example|MonAMI by example]] tutorial, and how to monitor [[MonAMI_dCache_plugin|dCache]] and [[MonAMI_DPM_plugin|DPM]]. | ||
* [[Links_Monitoring_pages]] | * [[Links_Monitoring_pages]] | ||
Line 169: | Line 178: | ||
* [[Atlas_FCR_Procedure]] | * [[Atlas_FCR_Procedure]] | ||
* [[Steve Lloyd SAM availability]] (summary graphs) | * [[Steve Lloyd SAM availability]] (summary graphs) | ||
− | |||
− | |||
===Hardware=== | ===Hardware=== | ||
Line 190: | Line 197: | ||
*[[Discussion and tasks list]] | *[[Discussion and tasks list]] | ||
*[[GDB reports]] | *[[GDB reports]] | ||
− | |||
− | |||
*[[:Category:UKI Testzone|UKI Testzone]] | *[[:Category:UKI Testzone|UKI Testzone]] | ||
*[[EVO Tips and Tricks]] | *[[EVO Tips and Tricks]] |
Revision as of 17:05, 28 February 2024
Sites in GridPP
- ScotGrid Tier2 - Glasgow, Edinburgh, Durham
- NorthGrid Tier2 - Lancaster, Liverpool, Manchester, Sheffield, Daresbury Laboratory
- SouthGrid Tier2 - Birmingham, Bristol, Cambridge, Oxford, Warwick, Rutherford Appleton Laboratory, EFDA-JET, Sussex
- London Tier2 Tier2 - Brunel, UCL-HEP, Imperial College , Queen Mary, Royal Holloway
- RAL Tier1 - Rutherford Appleton Laboratory
- The Site Status category. Pages that Jeremy would like the sites to keep up to date :-)
Security
- How to Report a Security Incident
- How to Report a Software Vulnerability
- How to ban or blacklist a user on a CE or SE How to ban/blacklist user on CE and SE
- Other Security Information, errors and workarounds
- Info on some problems after the release of lcg-CA 1.88-1
- Info on Tracing Jobs
Key Documents
Important documents are called Key Docs. This describes how to make sure the core documents get maintained well.
Deletions or other major changes can be listed for discussion in Stale documents.
GridPP Cloud
- Cloud & VM pages
- Cloud Work at Imperial (includes glideinWMS)
Project Management Pages
GridPP Tier2 Support
Experiment
Middleware
- GridPP DIRAC (for users and admins)
- Rucio
- Argus Server
- Grid Certificate
- Data Management
- Grid Storage
- New Information System
- GitHub Repositories
- Cluster Management
- Batch Systems
- Virtualisation
- Glite software builds
- Yaim - GridPP specific settings
- https with PerfSonar 4.3.4
- DPM to DCache Migration
- Puppet
- XRootD-2024
- Staged Rollout (obsolete)
- Also see Security Information for some of the security middleware
Operations
- ARGUS deployment
- Batch system status
- Procedures
- Site networking
- Category:Incidents
- Regional operations
- HEPSPEC06
- RHEL9 systems
- ARC6 EL9
Middleware - early adoption & testing
VO Support
- GridPP approved VOs
- Current VO Fairshares at T2/T1
- New VO deployment - covers the creation of new VOs (what information is needed) and the steps taken for the deployment
- Instruction for VO administrators
- VOMS proxy time limited and how to request an extension
- ATLAS Software Installation
- CMS in the UK
- Setting up an Automatic Blacklisting Service with ganga
Getting up and running on the grid - site admins
A tool, Instant UI, has been written to set up a User Interface (UI) quickly and easily. Instructions are available here:
- User Interface (UI) to support approved VOs (tested on EMI3/SL6)
For those who wish to "roll their own", a routinely updated tarball of a typical site-info.def/vo.d is available here:
This setup contains all the GridPP approved VOs and should be up to date.
Manual ways to setup a UI are also documented here:
- Installing a UI for Grid Submission (tested on EMI3/SL6)
- Installing a UI
- Configuring a UI
Getting up and running on the grid - users
- START HERE
- Grid user crash course
- A quick guide to DIRAC
- A quick guide to CVMFS
- RAL non-LHC CVMFS, i.e. the Gridpp Repository
- Guide to Ganga
- GridPP and the CERN VM service
- Job management - managing the lifecycle of jobs
- Long running jobs using myproxy
- http://www.gridpp.ac.uk/deployment/users/gridsite-admin.cgi?cmd=print&file=myproxy.html Good explanation about running jobs using myproxy,
- Delegating Proxies to ARC CEs
- Requiring software
- Requiring Data
Getting up and running on the grid - new VOs
Note - this section is under development.
Monitoring
- ARGO Nagios Monitoring
- Nagios
- perfSonar
- VacMon for Vac and Vcycle sites
- MonAMI: MonAMI by example tutorial, and how to monitor dCache and DPM.
- Links_Monitoring_pages
- Ranked Monitoring pages
- ATLAS Monitoring For Sites
- ROD rota
- Monitoring Tools
- Monitoring
- Monitoring_FAQs
Availability
- ATLAS Site Availability and Performance (ASAP)
- SL ATLAS tests
- Atlas_FCR_Procedure
- Steve Lloyd SAM availability (summary graphs)
Hardware
LCG Service Challenges
Operations Team
- Agenda's for the meetings will be on indico here: https://indico.cern.ch/categoryDisplay.py?categId=4592
- Action items
- Issues log
- Discussion and tasks list
- GDB reports
- UKI Testzone
- EVO Tips and Tricks
- Resiliency and Disaster Planning
- Bulletin Latest
Deployment Team pages
Useful Links
- FootPrints HelpDesk: http://helpdesk.grid-support.ac.uk
- GridPP blogs
GridPP Wiki Categories
- Special:Categories (List of all categories)
- Special:Allpages (List of all pages)
- Category:Top Level
- Category:Glossary
About GridPPWiki
- If you want to add content to this Wiki, then see advice on basic markup.
- Before you add a section it's worth browsing the names of all pages in the wiki to be sure that someone hasn't started an article with a slightly different name.
- Please use wiki categories to help organise the information in wiki. You can make categories hierarchical by adding the category to another category (a good example is that Category:File Catalog is a subcategory of Category:Data Management which is a subcategory of Category:Grid Middleware which is a subcategory of Category:Top Level). General Documentation on categories is useful.