NAMD Wiki: NamdAtOakRidge

  You are encouraged to improve NamdWiki by adding content, correcting errors, or removing spam.

Transferring files

bbcp (https://www.slac.stanford.edu/~abh/bbcp/) works well for transfers from outside machines. It must be installed both locally (home/jim/bin/Linux/bbcp) and at OLCF (/ccs/home/jimp/bin/bbcp) and in your path on both ends (e.g, add "export PATH=$HOME/bin:$PATH" to ~.bashrc).

Upload to Titan/Rhea (note hostname needed):

bbcp -V -T 'ssh jimp@dtn35.ccs.ornl.gov bbcp' 210stmv.coor dtn35.ccs.ornl.gov:/lustre/atlas1/bip115/scratch/jimp/

Download from Titan/Rhea (note -z AND hostname needed):

bbcp -V -S 'ssh jimp@dtn35.ccs.ornl.gov bbcp' -z dtn35.ccs.ornl.gov:/lustre/atlas1/bip115/scratch/jimp/foo.coor foo.coor

Download a directory of files by piping tar through bbcp:

bbcp -V -S 'ssh jimp@dtn35.ccs.ornl.gov bbcp' -N io "dtn35.ccs.ornl.gov:tar -c -O -C /lustre/atlas1/bio024/scratch/jimp/mar2014 foodir" 'tar -x'

To move between Titan/Rhea and Summit by staging to archive:

hsi put foo

hsi get foo

htar cvf foodir.tar foodir

htar xvf foodir.tar

See https://www.olcf.ornl.gov/for-users/system-user-guides/rhea/file-systems/#remote-transfers and https://www.olcf.ornl.gov/for-users/system-user-guides/rhea/file-systems/#hpss-best-practices