RETRIEVING RAW DATA ARCHIVED ON WESTGRID (DSM)
Konstantin Olchanski, May 6, 2004 
https://twist.phys.ualberta.ca/forum/view.php?site=twist&bn=twist_software&key=1083863732
Last Update, details, corrections, etc: April 9, 2006 by Mina Nozar  

1) Use the script 'wg-rawdata-retrieve.perl' to retrieve raw data from DSM:

a) to restore data set1: wg-rawdata-retrieve.perl set1
b) to restore runs 1000-2000: wg-rawdata-retrieve.perl 1000-2000
c) to restore runs 1, 2 and 3: wg-rawdata-retrieve.perl 1 2 3

All three types of operations can be combined, for example:
wg-rawdata-retrieve.perl set1 3000-3500 set4 8900 set6

NOTE: "/global/home/e614/rundb-dev/RunRangeInSet.new.list" is used for setNNN
to run range mapping.  This file (in CVS) needs to be updates during/after
each data running period.

The files are restored into 
  /global/scratch/twist/rawdata/NNNNN/runNNNNN.ybs

The log of "dsmc" activity is kept in 
  /global/scratch/home/e614/logs/wg-dsm/retrieve


Alternative is to use the dsm gui running from guide.
You may select entire save sets or individual files (rawdata, trees etc) from the gui. 
individual files.

2) Use 'build_rawdata_links.pl' to create soft links to /global/scratch/twist/rawdata_symlinks/set1
   

3) To find missing runs for set1:  
   Use: tail /global/home/e614/logs/SetLinks.log

4) To delete the rawdata for set1:

   Use: delete_rawdata_set.pl 1 
   This will delete both the soft links and rawdata.