Watch the recording of the online session.
Once you have **claimed a MN5 account,** set up a passwordless connection with the HPC. To that end, follow the instructions of the updated version of the Setup Hands-on Notebook in the EDITO Model Lab. Keep in mind the reservation name, also mentioned in the linked spreadsheet.
A workflow manager helps submit and manage experiments accross different HPC platforms. It does so by enabling automatic handling of job submission, dependencies among different jobs, dependencies, monitoring, error recovery, diagnostics, among others.
These features help towards building a scalable application that performs complex tasks. In addition, an important aspect that this brings is traceability.
To EDITO, the workflow manager used is Autosubmit, developed by the Earth Sciences department of the BSC. In addition, Autosubmit serves as the entry point to HPC clusters in the EDITO Model Lab.
In order to connect to the different platforms, Autosubmit needs the credentials in order to log in via SSH to the remote platforms. This is done via the ~/platforms.yml file and the SSH configuration file, i.e. ~/.ssh/config.
In order to create and launch experiments with Autosubmit, an important aspect is configuring the workflow and preparing the so-called templates.
Creating an experiment with a minimal configuration file can be done with the command:
autosubmit expid -min -H "<main platform>" -d "<An experiment description>"
The experiment directory contains a few top level directories, i.e.
conf/, for configuration filesproj/, for the workflow files, templates, etc. This is the project itselfplot/, for visualizations of the workflowtmp/, for logs, and parsed executablesstatus/, for internalspkl/, for internalsconf/ directory