LZ

From GridPP Wiki
Jump to: navigation, search

PoC: Elena K, Daniela B (on emails please also cc David Colling)

Elena is the production manager.

Mission: LZ UK Data Centre which is based on GridPP CPU resources passed its Final Design Review on 10.03.2017:
Imperial will host a complete copy of the LZ data (GridPP funding be willing). An outline of this can be found in the LZ conceptual design report: CDR (page 258/Chapter 15).

Updates:

[11.07.2017]
Summary of the Monte Carlo production run for Mock Data Challenge 1:

Looking at the result, the Monte Carlo production for MDC1 at the UKDC has been a success: We produced 132.77 TiB of data comprising 732288 files. All seeds have been processed. About 90% of the data was produced in the allotted time frame, and the last file was transferred to NERSC on July 10th.

The GridPP DIRAC instance was able to handle the LZ workflow, though we had to adjust the configuration to insure that the resources at the UKDC proper were used to the full extent.

The data transfer from UKDC to NERSC using a combination of the UKDC FTS server and the DTN transfer nodes worked very well. We have made some minor optimisations (database cache, number of threads etc) on the UK side and have enquired with NERSC about the possibility of raising the number of concurrent transfers.

The UKDC (Daniela, Simon, Alex) estimates to have spent about 4 weeks FTE between their staff on LZ work during the production run.

The production run has uncovered a number of issues, which should be resolved before MDC2.

[June 2017]
Work ongoing at Imperial on production job submission interface (see page 9-11 in CHEP 2016 talk)

Permanent links

Experiment Website
LZ UK Webpage
TDR
For configuration, please use the entry in the Approved VOs Wiki page.