WLCG Accounting Task Force

Motivation

The WLCG Accounting Task Force is set up following the outcome of the WLCG Accounting Review at the (pre-)GDB in April 2016.

• Summary for CPU/wall clock accounting
• Draft of the document on storage resource reporting

The highest priority task for the Task Force is to address current issues with CPU/Wall clock accounting. Storage Space accounting should be also addressed in particular of what concerns understanding of the requirements of the experiments and sites, however with lower priority.

Mandate

CPU/Wall clock accounting

• to agree with all stakeholders on the content of the accounting portal and accounting reports (metrics, units, aggregation in terms of time and set of attributes like site, VO, country, etc…);
• coordinate with APEL and accounting portal development team and follow up on the progress
• validate the new version of the portal, ideally a dedicated customized UI for WLCG, and make sure that the requirements of the stakeholders are addressed
• validate accounting data, ensure that it is correct in the APEL repository and manual fixes could be avoided
• follow up of on whether/ how we enable injection of the opportunistic resources to APEL and accounting portal
• coordinate with sites which provide their resources through cloud interfaces making sure that their resources are properly published in APEL. Debug corner cases when they are not properly published

Storage space accounting

• agree with the experiments and sites on the functionality which is required for the WLCG storage space accounting system considering the use case of the high level overview of the total and available space

Areas of work

Storage Space Accounting

CPU Accounting

Data validation

Follow up on sites which apparently do not correctly report to APEL

Automation of data validation

CRIC instruction for validation of auto-generated data

Data Quality Checks

New portal testing and validation

Normalization of CPU and wall clock

Accounting of non-pledged resources

Accounting data from from the primary information source to the accounting portal

How to enable accounting for jobs submitted with BOINC

HTCondor accounting instructions for OSG sites

HTCondor accounting , general instructions for sites

Deployment of HEPscore benchmark in production and changes in the accounting workflow

Changes For HEPscore

Accounting FAQ from sites

Task Force meetings

WLCG Accounting Task Force meetings take place be-weekly on Thursday starting at 15 o'clock Geneva time

• Meeting 24.11.2016
• Meeting 27.10.2016
• Meeting 06.10.2016
• Meeting 15.09.2016
• Meeting 25.08.2016
• Meeting 11.08.2016
• Meeting 04.08.2016
• Meeting 28.07.2016
• Meeting 14.07.2016
• Meeting 23.06.2016
• Kick-up meeting 09.06.2016

Membership

• LHC experiments
• WLCG sites including T0
• WLCG operations
• WLCG Monitoring team
• APEL & EGI accounting portal developers

Members

• Julia Andreeva (WLCG ops)
• Alessandra Forti (WLCG ops & sites)
• Maria Alandes Pradillo (WLCG ops & CMS)
• Alessandro Di Girolamo (WLCG ops for storage accounting)
• Giampaolo Carlino (ATLAS)
• Costin Grigoras (ALICE)
• Andrew McNab (LHCb)
• Josep Flix (CMS)
• Antonio Perez-Calero Yzquierdo (Sites & CMS)
• Olga Kodolova (Data quality)
• Adrian Coveney (APEL)
• John Gordon (EGI portal & APEL)
• Ivan Diaz Alvarez (EGI Accounting Portal)

-- JuliaAndreeva - 2016-05-25