TWiki
>
LCG Web
>
WLCGCommonComputingReadinessChallenges
>
CCRC08SSWGCASTORDUMPS
(2008-09-12,
FlaviaDonno
)
(raw view)
E
dit
A
ttach
P
DF
---++ CASTOR dumps at CERN by Ignacio Reguero <pre> Dear Flavia and all, As just discussed, I temporarily put a couple of the scripts that we use at CERN in </pre> [[http://castor.web.cern.ch/castor/DIST/dumpDiskPool.pl][http://castor.web.cern.ch/castor/DIST/dumpDiskPool.pl]]<br> [[http://castor.web.cern.ch/castor/DIST/dumpDiskPoolavail][http://castor.web.cern.ch/castor/DIST/dumpDiskPoolavail]] <pre> - dumpDiskPool.pl is the one generally used where you get a sorted listing of the paths of the files in the disk pool with fileid, size, status, diskcopy creation time and file last access time. - dumpDiskPoolavail is a version developed for a special case where we list all diskcopies (so you may have several entries for the same path and fileid) with their availability information (based on the filesystem+diskserver one). Both scripts assume that there is a one to one mapping of Castor diskpool to service class. We run the scripts once a day early in the morning on weekdays (not in the weekend) to minimize impact on the stager DB. They both put the dump in a directory in AFS that is accessed through http://cern.ch/castor Website. We have a convention where the URLs are http://castor.web.cern.ch/castor/DiskPoolDump/<stager>.<diskpool>.last this is pointing to the latest instance of http://castor.web.cern.ch/castor/DiskPoolDump/atlas.<poolname>.<date> for each pool so that you can bookmark the reference. Please note that older outputs are removed when creating the latest one. For instance http://castor.web.cern.ch/castor/DiskPoolDump/cms.t0input.last or http://castor.web.cern.ch/castor/DiskPoolDump/atlas.default.last As you get a sorted list of the paths in the pool with their associated information, you can exploit them in your own framework or use simple scripts to do resource consumption queries For instance - The total file size of files in atlt3 in GB cat atlas.atlt3.last | awk 'SUM+=$4 {printf("%f\n",SUM/1.e9)}' |tail -1 905.836689 - The total file size of the files in atlt3 in the hierarchy under /castor/cern.ch/grid/atlas/atlt3/scratch in GB cat atlas.atlt3.last | grep /castor/cern.ch/grid/atlas/atlt3/scratch | awk 'SUM+=$4 {printf("%f\n",SUM/1.e9)}' |tail -1 248.180882 </pre> -- Main.FlaviaDonno - 08 Jul 2008
E
dit
|
A
ttach
|
Watch
|
P
rint version
|
H
istory
: r2
<
r1
|
B
acklinks
|
V
iew topic
|
WYSIWYG
|
M
ore topic actions
Topic revision: r2 - 2008-09-12
-
FlaviaDonno
Log In
LCG
LCG Wiki Home
LCG Web Home
Changes
Index
Search
LCG Wikis
LCG Service
Coordination
LCG Grid
Deployment
LCG
Apps Area
Public webs
Public webs
ABATBEA
ACPP
ADCgroup
AEGIS
AfricaMap
AgileInfrastructure
ALICE
AliceEbyE
AliceSPD
AliceSSD
AliceTOF
AliFemto
ALPHA
Altair
ArdaGrid
ASACUSA
AthenaFCalTBAna
Atlas
AtlasLBNL
AXIALPET
CAE
CALICE
CDS
CENF
CERNSearch
CLIC
Cloud
CloudServices
CMS
Controls
CTA
CvmFS
DB
DefaultWeb
DESgroup
DPHEP
DM-LHC
DSSGroup
EGEE
EgeePtf
ELFms
EMI
ETICS
FIOgroup
FlukaTeam
Frontier
Gaudi
GeneratorServices
GuidesInfo
HardwareLabs
HCC
HEPIX
ILCBDSColl
ILCTPC
IMWG
Inspire
IPv6
IT
ItCommTeam
ITCoord
ITdeptTechForum
ITDRP
ITGT
ITSDC
LAr
LCG
LCGAAWorkbook
Leade
LHCAccess
LHCAtHome
LHCb
LHCgas
LHCONE
LHCOPN
LinuxSupport
Main
Medipix
Messaging
MPGD
NA49
NA61
NA62
NTOF
Openlab
PDBService
Persistency
PESgroup
Plugins
PSAccess
PSBUpgrade
R2Eproject
RCTF
RD42
RFCond12
RFLowLevel
ROXIE
Sandbox
SocialActivities
SPI
SRMDev
SSM
Student
SuperComputing
Support
SwfCatalogue
TMVA
TOTEM
TWiki
UNOSAT
Virtualization
VOBox
WITCH
XTCA
Welcome Guest
Login
or
Register
Cern Search
TWiki Search
Google Search
LCG
All webs
Copyright &© 2008-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
or Ideas, requests, problems regarding TWiki? use
Discourse
or
Send feedback