Difference between revisions of "Accounting"

From GridPP Wiki
Jump to: navigation, search
 
(10 intermediate revisions by 3 users not shown)
Line 1: Line 1:
Task outline:
+
== Sites' Task outline ==
  
 
1) Check weekly to ensure that GridPP sites are publishing accounting data
 
1) Check weekly to ensure that GridPP sites are publishing accounting data
- Using the VO vs date view on http://accounting.egi.eu/egi.php
+
 
- By checking the APEL-Pub results in Nagios
+
- Using the Sub-region vs VO view on https://accounting.egi.eu/
 +
- On the LHS Click EGI View and then NGI_UK
 +
NOTE The gantt chart view does not seem to be available on the new accounting portal here:
 +
https://accounting-next.egi.eu/wlcg/country/United%20Kingdom/
  
 
2) Follow GridPP site accounting issues in GGUS
 
2) Follow GridPP site accounting issues in GGUS
Line 9: Line 12:
  
 
3) Represent GridPP interests in the HEPiX benchmarking working group
 
3) Represent GridPP interests in the HEPiX benchmarking working group
- http://w3.hepix.org/processors/dokuwiki/doku.php?id=benchmarks:introduction
+
- https://www.hepix.org/e10227/e10327/e10325
  
 
Running the HEPSPEC benchmark is described here:
 
Running the HEPSPEC benchmark is described here:
http://w3.hepix.org/benchmarks/doku.php?id=homepage
 
  
  
 
4) Monitor results in the Tier-2 accounting period and escalate any issues
 
4) Monitor results in the Tier-2 accounting period and escalate any issues
- http://pprc.qmul.ac.uk/~lloyd/gridpp/metrics.html
+
- http://pprc.qmul.ac.uk/~lloyd/gridpp/metrics2.html
 +
 
 +
== APEL ==
  
Other thoughts from F2F@QMUL...
+
The basis for storage accounting is, perhaps unsurprisingly, the [https://www.ogf.org/Public_Comment_Docs/Documents/2012-02/EMI-StAR-OGF-info-doc-v2.pdf Storage Accounting Record]. EGI has come up with a specification for how these should be published, which boil down to:
  
Working on trying to understand where future accounting is going (and report to Ops Team). (See point 3.) Know what is coming up in changes to APEL.
+
* Group MUST exist and MUST be set to VO name.
 +
* Site MUST exist and MUST be set to GOCDB name for site.  
 +
* Capacity Fields MUST exist (although not all publishers honour this?)
  
Look for ongoing issues and discrepancies and investigate ways to fix.
+
This accounting data is written within a <StorageUsageRecords> ... </StorageUsageRecords> into a file; the site should then run [https://github.com/apel/ssm SSM] which will pick up the data and send it to APEL.
  
Document different ways to set up clusters and accounting.
+
Note also that the [[Information System]] can publish accounting data.
  
Keep hassling people to update benchmarks on Wiki.
+
== Other thoughts from F2F@QMUL... ==
  
Is it worth working much on APEL given that LHC VOs are doing their own thing?  Probably yes, if only in order to have basis for international comparison.
+
* Working on trying to understand where future accounting is going (and report to Ops Team).  (See point 3.)  Know what is coming up in changes to APEL.
 +
* Look for ongoing issues and discrepancies and investigate ways to fix.
 +
* Document different ways to set up clusters and accounting.
 +
* Keep hassling people to update benchmarks on Wiki.
 +
* Is it worth working much on APEL given that LHC VOs are doing their own thing?  Probably yes, if only in order to have basis for international comparison.
  
 
[[Category:GridPP Operations]]
 
[[Category:GridPP Operations]]
  
{{KeyDocs|responsible=Pete Gronbech|reviewdate=2015-05-06|accuratedate=2015-05-06|percentage=90}}
+
{{KeyDocs|responsible=Pete Gronbech|reviewdate=2018-12-31|accuratedate=2018-12-31|percentage=60}}

Latest revision as of 10:57, 31 December 2018

Sites' Task outline

1) Check weekly to ensure that GridPP sites are publishing accounting data

- Using the Sub-region vs VO view on https://accounting.egi.eu/ - On the LHS Click EGI View and then NGI_UK NOTE The gantt chart view does not seem to be available on the new accounting portal here: https://accounting-next.egi.eu/wlcg/country/United%20Kingdom/

2) Follow GridPP site accounting issues in GGUS - Your email address will be included in cc on tickets

3) Represent GridPP interests in the HEPiX benchmarking working group - https://www.hepix.org/e10227/e10327/e10325

Running the HEPSPEC benchmark is described here:


4) Monitor results in the Tier-2 accounting period and escalate any issues - http://pprc.qmul.ac.uk/~lloyd/gridpp/metrics2.html

APEL

The basis for storage accounting is, perhaps unsurprisingly, the Storage Accounting Record. EGI has come up with a specification for how these should be published, which boil down to:

  • Group MUST exist and MUST be set to VO name.
  • Site MUST exist and MUST be set to GOCDB name for site.
  • Capacity Fields MUST exist (although not all publishers honour this?)

This accounting data is written within a <StorageUsageRecords> ... </StorageUsageRecords> into a file; the site should then run SSM which will pick up the data and send it to APEL.

Note also that the Information System can publish accounting data.

Other thoughts from F2F@QMUL...

  • Working on trying to understand where future accounting is going (and report to Ops Team). (See point 3.) Know what is coming up in changes to APEL.
  • Look for ongoing issues and discrepancies and investigate ways to fix.
  • Document different ways to set up clusters and accounting.
  • Keep hassling people to update benchmarks on Wiki.
  • Is it worth working much on APEL given that LHC VOs are doing their own thing? Probably yes, if only in order to have basis for international comparison.

This page is a Key Document, and is the responsibility of Pete Gronbech. It was last reviewed on 2018-12-31 when it was considered to be 60% complete. It was last judged to be accurate on 2018-12-31.