Disk Pool Manager

From GridPPwiki

The Disk Pool Manager (DPM) is a lightweight solution for disk storage management. If offers the required SRM interfaces, hopefully without being complicated by other modes of access or complications such as tape storage systems.

It has been developed at CERN (http://user.web.cern.ch/user/Welcome.html). Information on DPM and an installation guide can be found in the GOC Wiki (http://goc.grid.sinica.edu.tw/gocwiki/How_to_install_the_Disk_Pool_Manager_%28DPM%29) and, more particularly, the DPM Admin guide (https://twiki.cern.ch/twiki/bin/view/LCG/DpmAdminGuide).

Table of contents

1 Installation 2 DPM Testing 3 Other Topics 3.1 Releases 3.2 Care and Feeding 3.3 Information and Statistics 3.4 Security 3.5 Miscellanea 3.6 SRMv2 4 Other Useful Resources 5 Older Material

Installation

DPM can most easily be installed via YAIM. We try and keep track of known bugs and gotchas. If this is your first time with DPM then the DPM Glossary will be of help. Older guides that previously appeared in this section can now be found at the bottom of this page.

• DPM Install - A HOWTO for a basic DPM Install.
• DPM Install Checklist - What you should have after an install.
• DPM 1.7 Upgrade - A guide to upgrading from v 1.6 to 1.7

DPM Testing

• DPM Bugs - Current issues with the DPM servers.
• DPM Testing - Some tests to verify that DPM is working.
• DPM Certificates - Where certificates for DPM need to go - and how to update them.
• RFIO Performance Testing - Stress testing LAN access to your DPM
• Random DPM errors in SAM - Collection of intermittent failures seen in SAM

Other Topics

Releases

• Most up to date version (http://jra1mw.cvs.cern.ch:8180/cgi-bin/jra1mw.cgi/LCG-DM/VERSION?rev=HEAD&content-type=text/vnd.viewcvs-markup) in cvs (may not be in production yet).
• Basic change-log (http://jra1mw.cvs.cern.ch:8180/cgi-bin/jra1mw.cgi/LCG-DM/CHANGES?rev=HEAD&content-type=text/vnd.viewcvs-markup) from cvs.
• Long change-log (http://jra1mw.cvs.cern.ch:8180/cgi-bin/jra1mw.cgi/LCG-DM/CHANGES-long?rev=HEAD&content-type=text/vnd.viewcvs-markup) from cvs.

Care and Feeding

• DPM Disk Pool - adding more file servers to your DPM.
• DPM VO Specific Pools - how to stop VOs from filling all your storage space.
• Removing files from a DPM - clearing out the junk
• Recognise SRM - check if a remote SRM is a DPM
• Performance and Tuning - how to optimise DPM.
• DPM Gotcha's - Problems encountered keeping a DPM running.
• DPM-admin-tools - Toolkit to help sites manage DPM.
• DPM Utilities - Utility scripts to manipulate the DPNS databases
• DPM MySQL database - Description of the DPM MySQL database tables.
• DPM Consistency Checker (http://twiki.cern.ch/twiki/bin/view/LCG/CheckDpmConsistency) - Checks that the namespace and disk pool contents are synchronised.
• DPM Filesystem Access Control Lists - Control access to any branch of the DPM namespace filesystem.

Information and Statistics

• DPM Monitoring - giving you a view inside the black-box of DPM.
• DPM Information Publishing - getting your DPM to publish storage information to the BDII.
• DPM Enabling Gridview - publishing DPM gridftp statistics to GridView  (http://gridview.cern.ch/GRIDVIEW/)

Security

• DPM Log File Tracing - Reading the tea leaves with DPM
• DPM and chroot - Putting DPM in jail

Miscellanea

• DPM Dual Homing - a test of dual homing with DPM.
• Building DPM - if you want to do it from source.

SRMv2

• DPM Space Tokens - Enabling and publishing SRMv2 space tokens with DPM

Other Useful Resources

• The general GridPP Storage Resources.
• Experiences with DPM at the University of Edinburgh: DPM Edinbugh Install
• DPM CERN service: hep-service-dpm@cern.ch.
• DPM user forum: dpm-users-forum@cern.ch
• DPM in Service Challenges: https://twiki.cern.ch/twiki/bin/view/LCG/DpmInformation
• DPM Admin Guide: https://twiki.cern.ch/twiki/bin/view/LCG/DpmAdminGuide
• DPM (+LFC) official docs: https://twiki.cern.ch/twiki/bin/view/LCG/DataManagementDocumentation

Older Material

• DPM Yaim Install - An older HOWTO for a basic DPM Install.
• DPM Upgrades - Upgrading to a new version of DPM.
• Classic SE Migration - if you have a Classic SE and wish to replace it with DPM.
• DPM Yaim Issues - Some problems with the YAIM scripts.
• Installing SL3 build of DPM on SL4

DPM on true 64bit

• Experiences of 64bit (http://twiki.cern.ch/twiki/bin/view/LCG/Dpm64Experiences)
• Release candidate rpms (http://twiki.cern.ch/twiki/bin/view/EGEE/DMRCRpmsUse)

• DPM SRMv2 Status - Current status of the SRMv2 interface.
• DPM SRMv2.2 Testing - Log of the issues that arose from testing SRMv2.2 in DPM 1.6.3