Jupyter lab (Open OnDemand)

Access

The Jupyter apps are available at https://hpc-web.create.kcl.ac.uk/ under Interactive Apps.

The site authenticates users with their KCL account (Single Sign-On).

Features

There are two main apps, the basic Jupyter Lab and its Advanced version.

The basic app is supposed to cover most use-cases: you can choose from the most used queues, and you are allocated 1 GPU if you choose any of the gpu ones.

The Advanced version allows you to choose from all the partitions you have access to, and optionally select the number of GPUs, and further constraints such as CPU architecture and GPU model.

Usage

Make Jupyter available in a virtual environment

Before using Open On-Demand for the first time, you must ensure you have a virtual environment with jupyterlab installed.

k1234567@erc-hpc-login1:/scratch/users/k1234567$ module load python/3.11.6-gcc-13.2.0
k1234567@erc-hpc-login1:/scratch/users/k1234567$ virtualenv jvenv -p `which python`
k1234567@erc-hpc-login1:/scratch/users/k1234567$ source jvenv/bin/activate
k1234567@erc-hpc-login1:/scratch/users/k1234567$ pip install jupyterlab
Collecting jupyterlab
...
Successfully built json5
...
(jvenv) k1234567@erc-hpc-login1:/scratch/users/k1234567$ deactivate

Once this is done, you can reuse this for all your sessions. You can also install jupyterlab in an existing environment.

Use virtualenv to start a session

1. Navigate to one of the Interactive apps at https://hpc-web.create.kcl.ac.uk/
2. Choose the queue and resources you need

3. Finally, add the following setup command (matching the environment you want to use):

   source /users/k1234567/jvenv/bin/activate
   

   and click Launch.

4. Once the session changed from Queued > Starting > Running, click the Connect to Jupyter button