Athena supercomputer
Access to Athena
Computing resources on Athena are assigned based on PLGrid computing grants. To perform computations on Athena you need to obtain a computing grant through the PLGrid Portal and apply for access to Athena.
If your grant is active, and you have applied for the service access, the request should be accepted in about half an hour. Please report any issues through the helpdesk.
Available login nodes:
athena.cyfronet.pl
Nodes details
Athena is built with Infiniband HDR interconnect and nodes of the following specifications:
| Partition | Number of nodes | CPU | RAM | RAM available for job allocations | Proportional RAM for one GPU | Proportional CPU for one GPU | Accelerator |
|---|---|---|---|---|---|---|---|
| plgrid-gpu-a100 | 48 | 128 cores, 2x AMD EPYC 7742 64-Core Processor @ 2.25 GHz | 1024 GB | 1024000 MB | 128000 MB | 16 | 8x NVIDIA A100-SXM4-40GB |
Job submission
Athena is using Slurm resource manager, jobs should be submitted to the following partitions:
| Name | Time limit | Resource type (account suffix) | Description |
|---|---|---|---|
| plgrid-gpu-a100 | 48 h | -gpu-a100 | GPU A100 partition. |
Important
Please use Athena only for GPU-enabled jobs. Running extensive workloads not using GPUs will result in account suspension.
Accounts and computing grants
Please, get familiar how to specify an account: Accounts and grants.
Sample job scripts
Example job scripts are available on this page: Examples.
Important
Please note that Athena is a GPU cluster, so please submit only jobs using GPUs!
Billing
General billing process is described here: Billing.
Storage
To avoid problems use variables instead of full path to the filesystems.
Current usage, capacity and other storage attributes can be checked by issuing the hpc-fs command. Check HPC tools page.
Important
In the $SCRATCH space, data older than 30 days and job directories older than 7 days are automatically deleted.
Important
$PLG_GROUPS_STORAGE uses transparent compression.
Please note that if a storage space uses transparent compression, the data stored on physical disks is compressed on the fly. The compression might manifest as different sizes reported by utilities like ls and du, where ls by default reports apparent file size (the amount of data in the file), and du shows actual disk usage. In most cases, the apparent file size is larger than the disk usage. The actual disk usage (as reported by du) is used for quota calculation.
Software
Software is organized in Modules.
The module tree on Athena is unsupported.
Compilation should be done on a worker node inside of a computing job. It is most convenient to use an interactive job to do all compilation and application setup.
Login node doesn't include development libraries!
For the time being, please install your own software in the $HOME or the group directory.
Support
Keep in mind general rules.
In case of problems check the Support page.