CurrentStatusOfDQ2

From ATLAS-TRIUMF

Jump to: navigation, search

[edit] Current Statue of DQ2 in the TRIUMF ATLAS Group

This is a new page where I can vent my frustrations with this tool. I am trying to get the DQ2 end user tools working properly on my desktop again. They did work before, with SL3.0.8, dq2 0.2 and gLite 3.0 (I think). Not sure about the gLite version, it may have been an LCG UI rather than gLite.

If I log on to lxplus, I can do the following:

  • source /afs/cern.ch/project/gd/LCG-share/current/etc/profile.d/grid_env.sh
  • voms-proxy-init --voms atlas:/atlas/ca
  • source /afs/cern.ch/atlas/offline/external/GRID/ddm/endusers/setup.sh.CERN
  • dq2_get -r -v -n 1 ideal2_valid1.006384.PythiaH120gamgam.recon.AOD.v13002001 (I had to try various datasets to get a selection of sites and transfer methods; this one does not work for all the examples below).
  • for the source, there is typically a choice of sites:
  • BNL returns this error:
lcg-cp -v --vo atlas gsiftp://dcgftp.usatlas.bnl.gov:2811/pnfs/usatlas.bnl.gov/others02/2007/34/misal1_valid1.006384.PythiaH120gamgam.recon.ESD.v13002001_tid012707_sub0/AOD.012707._00001.pool.root.1 file:////afs/cern.ch/user/i/itrigger/./AOD.012707._00001.pool.root.1
the server sent an error response: 530 530 User Name for GSI Identity/C=CA/O=Grid/OU=westgrid.ca/CN=Isabel Trigger_95/EMAIL=myemail@triumf.ca not found.

I have tried to complain but do not yet seem to have found the right place to submit this ticket.

  • CNAF works but uses castor rfcp when I submit the command from lxplus, so it is not really a fair test since I want this to work from a computer that does not run castor.
  • SARA uses lcg-cp, and this works from lxplus.

So I would hope to be able to do the same from my desktop setup at TRIUMF, with SL4, gLite 3.1 from the UI tarball for SL4, and the latest dq2 enduser tools, presumably DQ2 0.3. I need to run on a 32-bit machine because I have not yet figured out how to run 32-bit python just for dq2 on my 64-bit machine, and the lfc.py module needs 32-bit python... So I run on a 32-bit machine:

  • . /home/itrigger/gLite/external/etc/profile.d/grid-env.sh
  • . /home/itrigger/gLite/external/etc/profile.d/lcgenv.sh
  • voms-proxy-init -voms atlas:/atlas/ca
  • source /data/donquijote/dq2.new/endusers/setup.sh.any
  • dq2_get -r -v -n 1 ideal2_valid1.006384.PythiaH120gamgam.recon.AOD.v13002001
  • it complains "could not finish 'srmcp ' ..." which wasn't what I wanted anyway, so I do:
  • export DQ2_COPY_COMMAND='lcg-cp -v --vo atlas'
  • and try again with SARA
  • but get an error:
lcg-cp -v --vo atlas srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/disk/atlas/dq2/ideal2_valid1_V1/AOD/ideal2_valid1_V1.006384.PythiaH120gamgam.recon.AOD.v13002001_tid012945/AOD.012945._00006.pool.root.2 file:////home/itrigger/./AOD.012945._00006.pool.root.2
httpg://srm.grid.sara.nl:8443/srm/managerv1: java.rmi.RemoteException: SRM Authorization failed; nested exception is:
        org.dcache.srm.SRMAuthorizationException: diskCacheV111.services.authorization.AuthorizationServiceException:
Exception thrown by dis
lcg_cp: Communication error on send
could not finish 'lcg-cp -v --vo atlas srm://srm.grid.sara.nl:8443/pnfs/grid.sara.nl/disk/atlas/dq2/ideal2_valid1_V1/AOD/ideal2_valid1_V1.006384.PythiaH120gamgam.recon.AOD.v13002001_tid012945/AOD.012945._00006.pool.root.2 file:////home/itrigger/./AOD.012945._00006.pool.root.2' with 256

This is frustrating!

What I Want I would like to have a pre-tested combination of the gLite-UI and DQ2 end-user tools, with a list of parameters for the config and setup scripts which was known to work on SL4 at random sites that don't run CASTOR, d-Cache, etc. I would like to install it and keep it up to date with yum, like the rest of the system. The tarball installations are easy to do, but impossible to maintain... Ideally I would like to be able to run this on my 64-bit machine without worrying about screwing up the python version for athena.

--Isabel 11:23, 20 September 2007 (PDT)

Personal tools