Workflows on HPC

 

search Content

Running a job on an HPC system is typically not that hard, but  executing a non-trivial workflow that involves both data movement  and various computations is not so trivial. In this  training you will get an overview of tools that can help you to  efficiently and conveniently run workflows on supercomputers.

More info

language English
location_on hybrid
school Geert Jan Bex
calendar_month half a day - see data

Register

account_circle Target group & Prior knowledge

  • KU Leuven staff, Association KU Leuven staff, students, externals (VSC)
  • Anyone who wants to run non-trivial workflows on HPC systems
  • You should be familiar with the basics of running jobs on an HPC system and know your way around the command line. You  should also be familiar with the basics of the SLURM job scheduler.

schedule Dates & Location

Y​​​​​ou can take the training online or at the training site.

You will be sent the link a few days before the start of the course.

The training location is: ICTS, W. de Croylaan 52 A, 3001 Heverlee.

  • 19/10/2026: 9 a.m.-1 p.m.

Training content

sports_score Learning objectives

When you complete this training you will:

  • be able to schedule tasks that run on a login node at given time(s);
  • be able to run SLURM jobs at given time(s);
  • know how to break down a computation that consists of multiple tasks that require specific resources into a set of SLURM  jobs using job dependencies;
  • understand how to use job dependencies to restart jobs that checkpoint their state;
  • understand how to SLURM job arrays to run multiple jobs with similar resource requirements;
  • be able to use either worker-ng or atools to simplify managing such as parallel workflows; 
  • use a workflow manager to run a workflow that consists of multiple tasks that require specific resources.

Register & cancel

app_registration Register
 KU Leuven staff: via KU Loket
Association KU Leuven staff, students, externals (VSC): via form
cancel Cancel

Courses will take place if, one week before the start, there are sufficient registrations. If a course does not take place you will be notified personally.

If you cannot attend, you can cancel via the training portal (up to four days before the start of the course). 
If this is no longer possible, the ICTS  Administrative Office can still cancel your registration.
hourglass_bottom Waiting list

Everyone on the waiting list will be notified if someone cancels. Those who register first can then participate.

Practical information

euro_symbol Price
 free
diversity_3 Number of participants

min. 5 persons and max. 60 persons
verified Certificates
 Upon completion of the course, you will receive an email with the certificate of participation. This certificate can also be found in KU Loket under the link My training history.
topic Material
 Slides are available in the GitHub repository, as well as example code and hands-on material.

Additional information

Questions?