Agate

Agate is a heterogeneous high-performance Linux cluster. It features nodes with AMD processors and NVIDIA GPUs with a high-speed communication network. All nodes have local solid-state scratch storage and AMD 7763 processors with 64-128 CPU cores per node. For more details, visit the Partitions Page.

Compute infrastructure:

• GPU Compute Nodes:
  • 8 nodes configured with 4 H100 GPUs per node for a total of 32 H100 GPUs
  • 8 nodes configures with 4 L40s GPUs per node for a total of 32 L40s GPUs
  • 58 A100 GPU nodes for a total of 264 A100 GPUs
    • 50 nodes configured with 4 A100 GPUs per node
    • 8 nodes configured with 8 A100 GPUs per node
  • 10 nodes configured with 8 A40 GPUs per node for a total of 80 A40 GPUs
• CPU Compute Nodes: A total of 408 CPU-only compute nodes are available.
  • 244 have 512 GB of memory
  • 100 have 2 TB of memory
  • 32 have 384 GB of memory
  • 32 have 768 of memory
• Interactive GPU Nodes: This hardware is reserved for Interactive Computing
  • 8 A40 GPU nodes with 8 A40 GPU, 128 cores AMD Milan and 512 GB memory per node
  • 8 L40s GPU nodes with 4 L40s GPU, 128 cores AMD Genoa, 768 GB memory per node

The name Agate comes from the Minnesota state rock, the Lake Superior Agate.

What can I do with Agate?

Agate features a heterogeneous architecture described in more detail on the Agate topology page.  You can schedule single-core, multi-core, or multi-node jobs as parallel threaded or MPI jobs. The scheduler options are detailed on the partitions page.

All of the nodes are connected with an HDR100 Infiniband to primary storage and global scratch. In addition to these filesystems, multi-node jobs can allocate an ephemeral storage space using BeeOND.

How do I access Agate?

Agate can be accessed through a terminal environment or web-based interfaces such as Jupyter. Once connected to Agate, you can submit jobs to the scheduling system and run interactive applications.

Check out these Related Agate Pages
Agate Topology
Agate Partitions
Agate Interactive HPC
Agate GPU - A100 and A40
Agate CPU - AMD Milan
BeeOND on Agate