Dark Data clearance

From GridPP Wiki
Jump to: navigation, search

This Page details the plan for clearing dark data

Plan

Evaluate workload between VO and sysadmin

  • Speak to VOs about their needs/plans
    • ATLAS
    • CMS
    • Other VOs

Current Capabilities

  • What tools do VO already have?
    • ATLAS
    • CMS
    • Other VOS
  • What tools/scripts do sys-admin have?
    • What is missing?

Ascertain What VO needs from site admin

  • Already agreed list of SURLs?

Common Format of file from Site

  • Agreed on syncat?
    • Alternatives
  • Method to create file from SE
    • DPM
    • StoRM
    • dCache
    • CASTOR

Site produces

Convert to format for VO to use?

  • If different from generally agreed format.
  • Converison tool creation
  • Who does conversion.

Agree schedule for cleanup with VOs/Site Admins

  • Single/rolling campaign
    • Periodicity?
    • ATLAS
    • CMS
    • Other VOs
      • Once a year

What work is already being done in other clouds?

Central co-ordination?