StorageGroupActivities

This is a list as of September 2013. Consider it widely as Data/Storage related activities by GridPP people in the UK - even if not reporting into the storage group.

Middleware development / testing etc.

DPM collaboration including

• Community workshop in Ed in Dec.
• Testing "framework" for
  • regular epel-test and testbed testing
  • http / dav improvements
• latest release (1.8.7) testing.
• Admin-Toolkit / DMLite interfaces
• Rebalancing tools (sam ..)
• IPV6 testing and developments

Storm

• Cutting edge version testing and feedback (QM)

Hardware Industry Interaction

• DDN embedded processing work (sam)
• Dell stuff at Lancs (historical now really)

"Big data" Industry / Academic Interaction

• interfacing with wider communities (e.g Workshop)
• Hepdoop - physics analysis using industry big data tools

Metadata management

• Dark data tools
  • mainly for small-VOs who don't have anything (Sam , chris et al) .
• gFal2 - quite a bit of cutting use / testing for local users (e.g. Liverpool / John ) - also related to above dark data and below interfaces usage.

Future Technology tracking

• Filesystems: CEPH/HDFS
• WOS etc
• Hardware

"Future(-looking)" interfaces

Xrootd

• Atlas Fax (most involved region outside US).
  • fallback to fax and other feature pushing - wahid
  • T1 / castor - Alastair , Shaun , Andrew L
  • T2s - many people Ewan , John , Sam
• AAA
  • I know andrew and Imperial are involved but I don't know the latest details.

WebDAV

• DPM development
• Davix client development
• ATLAS renaming (first DPM sites to work )

Cloud storage

• with DPM
• testing of job direct access (not much done)
• development of "cloud-like" features inspired by existing distributed storage systems for existing LFC->SE architecture (Sam)

Networking

• Developed/ing experience in transferring large amount of data.
• IPv6
• PerfSonar
• Lots of networking developments (e.g. work by Alessandra , Brian, Duncan etc.)
• WAN Tuning
• FTS3 testing (brian and andrew L may want to add some details here).
  • Configuration
  • Monitoring
  • Scalability Testing
  • Failure Analysis and tracking

A huge amount of "operations" activities (obviously)

• Middleware installations and upgrades (e.g. recent DPM to 1.8.7)
• Webdav , xrootd enabling for production
• Spacetokens (re)configuration / deleting
• Hardware installations
• Networking installations / debugging etc.
• Consistency Checking
• Dark Data Deletion
• FTS failure debugging
• GGUS Ticket tracking
• Data Storage/Transfer Knowledge Base. Advice etc.

Liason

• VOs - LHC; "small" VOs.
• WLCG - TEGs; Chair data WG etc.
• NGI, EGI ,EMI OSG etc.
• Big data ; Networking SiGs

Publicity and Outreach

• Conference presentations / publications
• blog
• public events

Previous activities

Not at all complete list

• ROOT I/O Tuning

• Metrics - HammerCloudInaBox.

• Filesystem evaluations (e.g. ceph , hdfs etc).

Future Activities

Not at all complete list

New things:

• Easy user tools: management layer (in particular small VOs)

• Wider products (Irods etc.) integration

• Catching the long tail (users not affiliated with VOs)?

Important current things

• Interoperation with other communities (what is the balance between this and WLCG? )

• Interoperation with "common" technologies :