Transferring files to (and from) CREATE¶

Using scp¶

One of the easiest and quickest ways to transfer files is using scp (secure copy).

It is strongly recommended that you use an ~/.ssh/config file as outlined in the relevant sections for MacOS and linux or Windows on the Accessing CREATE page.

Using the config file in the same format as the example given means that to copy a file called hello_world.sh from your local machine to your home directory on CREATE would be as simple as opening a terminal in the directory the file was in and running the command:

Linux and MacOS

$scp hello_world.sh create:/users/<your k-number>/hello_world.sh

Windows

$scp -m hmac-sha2-512 hello_world.sh create:/users/<your k-number>/hello_world.sh

To copy a file called hello_er.out from the scratch users area to the directory the shell was open in would be:

Take note

scp has been reactivated on the login nodes, to use scp you no longer need to use erc-hpc-dm1

Linux and MacOS

$scp create:/scratch/users/<your k-number>/hello_er.out ./hello_er.out

Windows

$scp -m hmac-sha2-512 create:/scratch/users/<your k-number>/hello_er.out ./hello_er.out

rsync¶

For more advanced copy and file transfer capabilities rsync is available and well documented here.

SFTP¶

It is strongly recommended that you use an ~/.ssh/config file as outlined in the relevant sections for MacOS and linux or Windows on the Accessing CREATE page.

SFTP ensures that the data you send is encrypted.

If you have created a config file as specified above then to open an SFTP connection you can simply use:

$ sftp create

else use:

$ sftp <your k-number>@hpc.create.kcl.ac.uk

To use the FileZilla GUI client see here

Transferring files from Rosalind to CREATE¶

For larger file transfers, especially between Rosalind and CREATE, erc-hpc-dm1 should be used. When connecting use the usual password for your k-number.

k1234567@erc-hpc-login1:~$ ssh erc-hpc-dm1
k1234567@erc-hpc-dm1's password:
...
k1234567@erc-hpc-dm1:~$rsync -avHS /rosalind_ro/scratch/users/k1234567/example_project /scratch/prj/operations/

An example of using rsync to copy a directory called example_project from users k1234567 scratch space on Rosalind to a project space on CREATE for a fictional project called operations is included.