Transfer Test Python Script HOWTO

From GridPP Wiki
Jump to: navigation, search
 $ export MYPROXY_SERVER=lcgrbp01.gridpp.rl.ac.uk
 $ grid-proxy-init -valid 48:00         # This needs to be long enough to live through the transfer
 $ myproxy-init -d
  • Submit a 1TB transfer test as 1000x1GB files (FTS cannot accept more that ~1000 files in a single request, by default). N.B. The --ignore-status-error option is required as there's a bug in FTS causing glite-transfer-status -l to have a non-zero exit code when transferring more than ~50 files.
 $ filetransfer.py --number=1000 --background --delete --ignore-status-error \
 srm://dcache.gridpp.rl.ac.uk:8443/pnfs/gridpp.rl.ac.uk/data/dteam/tfr2tier2/canned1G \
 srm://my.srm.host:8443/pnfs/domain/data/dteam/ftstest

If you are testing your DPM from Glasgow then

 $ filetransfer.py --number=1000 --background --delete --ignore-status-error \
 srm://se2-gla.scotgrid.ac.uk:8443/dpm/scotgrid.ac.uk/data/dteam/tfr2tier2/canned1G \
 srm://my.srm.host:8443/dpm/domain/home/dteam/ftstest

The --background means the script runs in the background and can be monitored with tail -f on its logfile (filetransfer.log by default). This is good if you're logging in from home to check on progress!