HPC¶

In order to use the following LSU HPC computational resources, a user must first request a LSU HPC account. Any LSU affiliate or a collaborator of a LSU affiliate may request a LSU HPC account. An HPC account may be requested from the from the login request page.

View our cluster usage guide to see how to access and submit jobs

See all our available software

Available Partitions¶

Partitions were previously known as queues in PBS.

SuperMike-III Partitions¶

**Note: Starting on July 1, 2023, jobs running in the gpu queue on SuperMike-3 will be charged for 64 SUs for each GPU-hour it consumes. For instance, if a job runs two hours with two GPU devices in the gpu queue, it will be charged 2 hours * 2 GPUs * 64 = 256 SUs.**

Deep Bayou Partitions¶

nvlink - Used for jobs that run applications that are capable for utilizing the Nvidia GPUs and nvlink interconnect.

**Note: Starting on August 14, 2023, jobs running in the gpu and nvlink queue on Deep Bayou will be charged for 48 SUs for each GPU-hour it consumes. For instance, if a job runs two hours with two GPU devices in the gpu queue, it will be charged 2 hours * 2 GPUs * 48 = 192 SUs.**

SuperMIC Partitions¶

Production Systems¶

SuperMike-III¶

SuperMike-III is a 1.3 PetaFlop peak performance cluster with 11,712 CPU cores, comprised of 183 compute nodes connected by 200 Gbps Infiniband fabric. It entered production in the summer of 2022. SuperMike-III is housed in the Frey Computing Services building in LSU.

• Common Features
  • RedHat Enterprise Linux 8 Operating System
  • 200 Gb/sec (HDR) InfiniBand
• 171 CPU Compute Nodes, each with:
  • Two 32-core Intel Ice Lake (Intel® Xeon® Platinum 8358 Processor) CPUs.
  • 256 GB memory
• 8 GPU Compute Nodes, each with:
  • Two 32-core Intel Ice Lake (Intel® Xeon® Platinum 8358 Processor) CPUs.
  • 256 GB memory
  • 4 NVIDIA Ampere A100 GPU's with NVLink interconnect
• 4 Big Memory Nodes, each with:
  • Two 32-core Intel Ice Lake (Intel® Xeon® Platinum 8358 Processor) CPUs.
  • 2 TB memory
• 2 Login Nodes, with:
  • Two 32-core Intel Ice Lake (Intel® Xeon® Platinum 8358 Processor) CPUs.
  • 256 GB memory
• Cluster Storage
  • 2 PB Lustre file system

Deep Bayou¶

Deep Bayou, the latest addition to LSU HPC's pool of resources, is a 13-node GPU cluster funded by the NSF CC* award #2020446. Each Deep Bayou compute node is equipped with at least two NVIDIA V100S GPUs and a 1.5 TB NVMe solid state drive. Two of the compute nodes are equipped with four NVIDIA V100S GPUs connected by NVLink, which boosts the data exchange performance between GPUs. These features make Deep Bayou a powerful platform for deep learning and AI workloads.

The compute time on Deep Bayou is allocated separately from SuperMike and SuperMIC. Given its limited number of nodes and hardware features, when requesting an allocation on Deep Bayou, PIs should describe how their intended workloads will use the GPU devices.

Deep Bayou went into general production in March 2021 and is available to all LSU HPC users.

Deep Bayou

• Common Features
  • RedHat Enterprise Linux 7 Operating System
  • 100 Gb/sec (HDR100) InfiniBand
• 11 GPU Compute Nodes, each with:
  • Two 24-core Intel Cascade Lake (Intel® Xeon® Gold 6248R Processor) CPUs.
  • 192 GB memory
  • Two NVIDIA V100S GPUs (each with 32 GB memory)
  • 1.5TB NVMe SSD drive
• 2 GPU NVLink Compute Nodes, each with:
  • Two 24-core Intel Cascade Lake (Intel® Xeon® Gold 6240R Processor) CPUs.
  • 384 GB memory
  • Four NVIDIA V100S GPUs (each with 32 GB memory, SXM2 with NVLINK)
  • 1.5TB NVMe SSD drive
• 1 Login Nodes, with:
  • Two 24-core Intel Cascade Lake (Intel® Xeon® Gold 6226R Processor) CPUs.
  • 192 GB Ram
• Cluster Storage
  • 840 TB Lustre file system (shared with the SuperMIC cluster)

SuperMIC¶

SuperMIC (pronounced as Super Mick) is an LSU supercomputer funded by an National Science Foundation's (NSF) Major Research Instrumentation (MRI) award to the Center for Computation & Technology.

SuperMIC is capable of a peak theoretical performance of over 925 TF. It achieved a performance of 557 TF during testing, which placed it as number 65 in the June 2014 Top500 List.

SuperMIC went operational on October 1, 2014. It contains a total of 382 nodes, each with two 10-core 2.8GHz Intel Ivy Bridge-EP processors. 380 compute nodes each have 64 GB of memory and 500 GB of local HDD storage. 360 of the compute nodes have 2 Intel Xeon Phi 7120P coprocessors. 20 of the compute nodes have 1 Intel Xeon Phi 7120P coprocessor and 1 NVIDIA Tesla K20X. LSU users will need to use their LSU HPC credentials to gain access to SuperMIC (see: LSU HPC account request), and require access to an LSU HPC allocation (see: LSU HPC allocation request) to run production jobs on the system.

Four compute nodes, each equipped with two Intel Skylake processors, two NVIDIA V100 GPU devices and 2 TB of NVMe SSD, were recently added to SuperMIC. Detailed description of these nodes can be found below.

As of 2020, the Intel Phi coprocessors are no longer supported or available

The SuperMIC system includes:

• 1 Login Node
  • Two 2.8GHz 10-Core Ivy Bridge-EP E5-2680 Xeon 64-bit Processors
  • One Intel Xeon Phi 7120P Coprocessors
  • 128GB DDR3 1866MHz Ram
  • 1TB HD
  • 56 Gigabit/sec Infiniband network interface
  • 10 Gigabit Ethernet network interface
  • Red Hat Enterprise Linux 6
• 1 Login Node
  • Two 2.8GHz 10-Core Ivy Bridge-EP E5-2680 Xeon 64-bit Processors
  • One NVIDIA Tesla K20X 6GB GPU
  • 128GB DDR3 1866MHz Ram
  • 1TB HD
  • 56 Gigabit/sec Infiniband network interface
  • 10 Gigabit Ethernet network interface
  • Red Hat Enterprise Linux 6
• 360 Compute Nodes
  • Two 2.8GHz 10-Core Ivy Bridge-EP E5-2680 Xeon 64-bit Processors
  • Two Intel Xeon Phi 7120P Coprocessors
  • 64GB DDR3 1866MHz Ram
  • 500GB HD
  • 56 Gigabit/sec Infiniband network interface
  • 1 Gigabit Ethernet network interface
  • Red Hat Enterprise Linux 6
• 20 Hybrid Compute Nodes
  • Two 2.8GHz 10-Core Ivy Bridge-EP E5-2680 Xeon 64-bit Processors
  • One Intel Xeon Phi 7120P Coprocessors
  • One NVIDIA Tesla K20X 6GB GPU with GPUDirect Support
  • 64GB DDR3 1866MHz Ram
  • 500GB HD
  • 56 Gigabit/sec Infiniband network interface
  • 1 Gigabit Ethernet network interface
  • Red Hat Enterprise Linux 6
• 3 Big Memory Compute Nodes
  • Two 2.6GHz 14-Core Broadwell E5-2690 v4 Xeon 64-bit Processors
  • 256GB DDR4 2400MHz Ram
  • 56 Gigabit/sec Infiniband network interface
  • Red Hat Enterprise Linux 6
• 4 V100 Compute Nodes
  • Two 2.7GHz 18-Core Skylake Gold 6150 Xeon 64-bit Processors
  • Two NVIDIA V100 16GB GPU
  • 384GB DDR4 2666MHz Ram
  • 2TB NVMe Solid State Drive
  • 56 Gigabit/sec Infiniband network interface
  • Red Hat Enterprise Linux 6
• Cluster Storage
  • 840TB Lustre High-Performance disk
  • 5TB NFS-mounted /home disk storage