Restoring MC data from SFU 
Mina Nozar 
April 1 2006

Once the MC data files are archived at SFU, they are deleted from the
local nodes to free up space for data from additional MC gens.  In
case of further analysis on the deleted MC data, the MC data files
stored on disk at SFU first need to be restored at WestGrid.

The restoration need falls into two categories:

1) There may be a need to bring all the data files for a given gen,
   genxxx, for a re-analysis.

2) There may be a need to bring back some "missing" files due to the
   local node disk failure.


1) In case the entire gen data files need to be restored: 
  - Get a valid "e614" proxy.
  - Log into blackhole.westgrid.ca as "e614".
  - Get a listing of the files for genxxx:
    - ls /data/e614/mc/genxxx/data
  - Use the script getMCsfu.pl to copy the files from
    /data/e614/mc/genxxx/data on SFU to /global/scratch/twist/mc/genxxx/data
    - getMCsfu.pl  /data/e614/mc/genxxx/data

2) In case of the need to bring back a few missing files:
  - Find out which runs are missing in the local nodes.
  - On blackhole, make directory containing softlinks to the runs (with
    missing data on the local nodes). 
    - On the command line, do:
      cd /data/e614/mc/genxxx ; mkdir resotre ; cd restore
      foreach run (16788 16901 16956) ; ln -s ../data/genxxxrun{$run}.dat run{$run}.dat ; end
      ls restore 
    - You should be able to see links to the "missing" runs under "restore".
 - On glacier (nunatak1, nunatak2, ...) run:
   getMCsfu.pl  /data/e614/mc/genxxx/restore

 - The files will be copied from SFU to
   /global/scratch/twist/mc/genxxx/restore

 - The analysis jobs can then be submitted with the input directory set to: 
   /global/scratch/twist/mc/genxxx/restore