Steve's Notes DQ2 Data Location & Retrieval

Find some data with DQ2 at CERN

See more detailed instructions at DQ2ClientsHowTo . The DQ2 Dataset Browser provides a web interface. James Catmore's wiki on finding data: DataPreparationReprocessing .

1. Set up the environmental variables.

   source /afs/cern.ch/atlas/offline/external/GRID/ddm/DQ2Clients/setup.sh
      

2. Initialize the ATLAS VO proxy.

   voms-proxy-init -voms atlas
      

3. Search for some Zmumu data

   dq2-ls mc12.\*Zmumu\*
   dq2-ls mc12.\*Zmumu\*RDO\*
   dq2-ls mc12.\*Zmumu\*AOD\*
   dq2-ls -f mc12.005145.PythiaZmumu.genfast.AOD.v12000702
      

4. Retrieve a dataset from the grid to local directory

   cd /tmp/myusername
   dq2-get mc12.005145.PythiaZmumu.genfast.AOD.v12000702
   dq2-get data08_cosmag.00091639.physics_RPCwBeam.recon.ESD.o4_f71_T1224030946
      

5. Retrieve a file from the grid to local directory

   cd /tmp/myusername
   dq2-get -f valid1.005145.PythiaZmumu.digit.RDO.e322_s483 mc12.005145.PythiaZmumu.genfast.AOD.v12000702
      

Using AMI to Get Dataset Information

The AMI browser can provide important information about various physics data sets, including what geometry was used in production.

1. Find the geometry used for valid1.005145.PythiaZmumu.digit.RDO.e322_s483
   • Open AMI in a browser.
   • Enter valid1.005145.PythiaZmumu.digit.RDO.e322_s483 in the top window.
   • Click on "Search Datasets"
   • Click on "Details"

Some Castor Commands

If data has been retrieved to castor, files can be manipulated with a few simple commands. See WorkBookCastor for a listing. Here are some examples:

1. List a directory

   rfdir /castor/cern.ch/user/g/goldfarb/Analysis/Zmumu
      

2. Copy a file to/from/within castor

   rfcp /tmp/myusername/mc12.005145.PythiaZmumu.genfast.AOD.v12000702/valid1.005145.PythiaZmumu.digit.RDO.e322_s483 /castor/cern.ch/user/g/goldfarb/Analysis/Zmumu
   rfcp /castor/cern.ch/user/g/goldfarb/Analysis/Zmumu/valid1.005145.PythiaZmumu.digit.RDO.e322_s483 ~/TestArea
      

3. Move a file within castor

   rfrename rfcp /castor/cern.ch/user/g/goldfarb/Analysis/Zmumu/ZmumuPythiaEndCapOnlySim09950.pool.root /castor/cern.ch/user/g/goldfarb/Analysis/Zmumu/StevesFavoriteFile.pool.root
      

4. Remove a file from castor

   rfrm /castor/cern.ch/user/g/goldfarb/Analysis/Zmumu/StevesFavoriteFile.pool.root