Difference between revisions of "DCache"
From GridPP Wiki
(→Installation) |
(→Useful resources) |
||
| (10 intermediate revisions by one user not shown) | |||
| Line 3: | Line 3: | ||
== Installation == | == Installation == | ||
* [https://www.dcache.org/manuals/Book-2.16/index-fhs.shtml dCache Book] is least old page for installation. | * [https://www.dcache.org/manuals/Book-2.16/index-fhs.shtml dCache Book] is least old page for installation. | ||
| − | * [http://www.dcache.org/downloads/IAgree.shtml dCache sources] and [http://www.dcache.org/manuals/dCacheSoftwareLicence.html license | + | * [http://www.dcache.org/downloads/IAgree.shtml dCache sources] and [http://www.dcache.org/manuals/dCacheSoftwareLicence.html license |
| − | + | ||
=== Upgrading to a new release of dCache === | === Upgrading to a new release of dCache === | ||
| Line 74: | Line 73: | ||
== Access to the dCache == | == Access to the dCache == | ||
| − | + | Various different access methods can be used, from FTS service to a CLI such as gfal-* commaands. SOme other useful methods for debugging locally are below: | |
| − | * | + | |
* [[Globus Commands]] | * [[Globus Commands]] | ||
* [[SRM commands]] | * [[SRM commands]] | ||
| Line 81: | Line 79: | ||
* [[Removing files from dCache]] | * [[Removing files from dCache]] | ||
* Latest srmcp client from FNAL can be found [https://srm.fnal.gov/twiki/bin/view/SrmProject/SrmcpClient here] | * Latest srmcp client from FNAL can be found [https://srm.fnal.gov/twiki/bin/view/SrmProject/SrmcpClient here] | ||
| + | Documentation for gfal-* commands can be found [https://dmc.web.cern.ch/projects/gfal-2/documentation here] and replace the lcg-* coammands for most use cases. | ||
== Heirarchical Storage Manager (HSM) == | == Heirarchical Storage Manager (HSM) == | ||
| Line 91: | Line 90: | ||
* [http://www.jiscmail.ac.uk/archives/gridpp-storage.html GRIDPP-STORAGE archive] - mailing list for the discussion of storage issues. | * [http://www.jiscmail.ac.uk/archives/gridpp-storage.html GRIDPP-STORAGE archive] - mailing list for the discussion of storage issues. | ||
| − | |||
* [http://storage.esc.rl.ac.uk/ GridPP2 Storage] - useful information about storage issues in general and dCache in particular, including HowTo. | * [http://storage.esc.rl.ac.uk/ GridPP2 Storage] - useful information about storage issues in general and dCache in particular, including HowTo. | ||
* [http://www.e-science.clrc.ac.uk/web/projects/storage_element eScience Storage Management (limited dCache information).] | * [http://www.e-science.clrc.ac.uk/web/projects/storage_element eScience Storage Management (limited dCache information).] | ||
| − | |||
| − | |||
| − | |||
| − | |||
* [[Recognise SRM]] - Whether a remote SRM is a dCache? | * [[Recognise SRM]] - Whether a remote SRM is a dCache? | ||
==== Other institutions/organisations experience of using dCache ==== | ==== Other institutions/organisations experience of using dCache ==== | ||
| − | + | Old links to US sites now no longer working. If you find a new link please add here. | |
| − | + | ||
| − | + | ||
| − | + | ||
==== Workshops and presentations ==== | ==== Workshops and presentations ==== | ||
| − | * [ | + | * [https://indico.desy.de/indico/event/19920/ dCache workshop] |
| − | * [ | + | * [https://www.dcache.org/news.shtml This] is the best link to recent presentations which is kept up to dat e by the dCache developers. |
| − | + | ||
| − | + | == New Features == | |
| − | + | For further investigation | |
| + | ===Macaroons=== | ||
| + | ===NFS4.1=== | ||
| + | ===Geographically Distibuted=== | ||
| + | Not really a new feature but is of interst/USed at NDGF-T1 | ||
<!-- Categories --> | <!-- Categories --> | ||
| Line 119: | Line 114: | ||
[[Category:DCache]] | [[Category:DCache]] | ||
| − | {{KeyDocs|responsible=Brian Davies|reviewdate=2018- | + | {{KeyDocs|responsible=Brian Davies|reviewdate=2018-07-25|accuratedate=(never)|percentage=40}} |
Latest revision as of 16:59, 3 January 2019
dCache is a disk pool management system with a SRM interface (currently v1), jointly developed by DESY and Fermilab. It is one of the currently accepted solutions that UK sites involved in the LCG are deploying to provide an SRM interface to the Grid (the other being Disk Pool Manager). This page intends to provide information for Tier-2 sites who are deploying dCache as their SRM. Installation/configuration/administration instructions will all appear here in due course.
Contents
Installation
- dCache Book is least old page for installation.
- dCache sources and [http://www.dcache.org/manuals/dCacheSoftwareLicence.html license
Upgrading to a new release of dCache
This can be found of dCache page but varies depending on which release you are upgrading from and to which release you wish to upgrade.
Chimera
Troubleshooting
- dCache FAQ
- dCache Problems and Workarounds
- dCache bugs in CERN Savannah
- dCache4SiteAdmins.pdf: A very useful document, giving fairly detailed infor mation about all parts of the dCache system.
- dCache Book: From the dCache developers.
Common administration tasks
- dCache Administration Interface
- Disk Pool Contents
- Renaming a dCache pool node
- Draining a dCache pool
- dCache Administration Scripts
- Splitting the dCache head node
- Upgrade Experience
Database administration
Log files and database
- dCache logfile output level
- dCache Logs
- dCache Log Message Archive
- dCache Billing Information
- dCache Security Service Challenge
Monitoring
SRM v2.2
- dCache SRM v2.2 Status
- dCache SRM v2.2 Testing
- dCache SRM v2.2 GFAL Testing
- dCache SRM v2.2 Configuration - How to setup your SRM2.2 server
VOMS
Generic Information Provider (GIP) plugin
Optimisation
- Optimising dCache Performance - see also Performance and Tuning for general tips and tricks
Access to the dCache
Various different access methods can be used, from FTS service to a CLI such as gfal-* commaands. SOme other useful methods for debugging locally are below:
- Globus Commands
- SRM commands
- dcap commands
- Removing files from dCache
- Latest srmcp client from FNAL can be found here
Documentation for gfal-* commands can be found here and replace the lcg-* coammands for most use cases.
Heirarchical Storage Manager (HSM)
One of the advantages of using dCache to manage a sites storage resources is that it can act as a front end disk cache behind which sits some hierarchical storage system, such as a tape robot (Enstore, HPSS...). While this is not necessarily relevant for Tier-2 sites which do not (typically) have tape, this functionality can be useful in order to optimally utilise available storage resources.
- Using dCache with an HSM.
Useful resources
- GRIDPP-STORAGE archive - mailing list for the discussion of storage issues.
- GridPP2 Storage - useful information about storage issues in general and dCache in particular, including HowTo.
- eScience Storage Management (limited dCache information).
- Recognise SRM - Whether a remote SRM is a dCache?
Other institutions/organisations experience of using dCache
Old links to US sites now no longer working. If you find a new link please add here.
Workshops and presentations
- dCache workshop
- This is the best link to recent presentations which is kept up to dat e by the dCache developers.
New Features
For further investigation
Macaroons
NFS4.1
Geographically Distibuted
Not really a new feature but is of interst/USed at NDGF-T1
This page is a Key Document, and is the responsibility of Brian Davies. It was last reviewed on 2018-07-25 when it was considered to be 40% complete. It was last judged to be accurate on (never).
