Introduction

There are two main use cases related to space accounting which are being addressed by the systems developed in the experiments:

• global view of the occupied and free space at the site, can imply details as space by space token, quota or certain level of the directory tree
• complete storage dump, listing all files with their sizes

The first one is required for everyday processing and planning and should be updated quite often (order of half an hour or so), while the second one is required to discover so called dark data and in general to detect inconsistencies between local storage and experiment's file catalogues. Full storage dump is a heavy operation and is normally performed once a month or so.

Known formats used for storage dumps and space accounting overview

We need to align here between the experiments, storage providers and various methods which are currently used to obtain this information.

WebDAV

Some introductory information to WevDAV can be found here

Known formats used to provide storage dumps and space accounting information

DPM

Storage dump script evaluation

CMS

ATLAS

Others?

Status of providing space accounting information with WebDAV

Status of publishing space accounting info to the EGI accounting portal

dCache

Storage dump script evaluation

CMS

ATLAS

Others?

Status of providing space accounting information with WebDAV

Status of publishing space accounting info to the EGI accounting portal

EOS

Storage dump script evaluation

CMS

ATLAS

Others?

Status of providing space accounting information with WebDAV

Status of publishing space accounting info to the EGI accounting portal

StoRM

Storage dump script evaluation

CMS

ATLAS

Others?

Status of providing space accounting information with WebDAV

Status of publishing space accounting info to the EGI accounting portal

Posix-like (NFS,GPFS,Lustre,PVFS)

Storage dump script evaluation

CMS

ATLAS

Others?

Status of providing space accounting information with WebDAV

Status of publishing space accounting info to the EGI accounting portal

LStore (ACCRE)

Storage dump script evaluation

CMS

ATLAS

Others?

Status of providing space accounting information with WebDAV

Status of publishing space accounting info to the EGI accounting portal

Posix-light with FUSE (xrootd, HDFS)

Storage dump script evaluation

CMS

ATLAS

Others?

Status of providing space accounting information with WebDAV

Status of publishing space accounting info to the EGI accounting portal

-- JuliaAndreeva - 2016-04-01