Job Partitions/Queues on Schooner

This partition/queue is for jobs that use multiple compute nodes (e.g., MPI parallel jobs), or jobs that fit in a single compute node, and only need up to 20 CPU cores in each node and up to ~30 GB RAM in each node.

Jobs in this partition/queue should be limited to 240 CPU cores (12 compute nodes).

This partition/queue has general-use compute nodes that each have dual Intel Xeon Haswell 10-core CPUs (20 cores per node) and 32 GB RAM.

This partition/queue is for jobs that use multiple compute nodes (e.g., MPI parallel jobs), or jobs that fit in a single compute node, and need 21 to 24 CPU cores in each node and/or ~31 to ~60 GB RAM in each node.

Jobs in this partition/queue should be limited to 240 CPU cores (10 compute nodes).

This partition/queue has general-use compute nodes that each have dual Intel Xeon Haswell 12-core CPUs (24 cores per node) and 64 GB RAM.

This partition/queue is for jobs that use multiple compute nodes (e.g., MPI parallel jobs), or jobs that fit in a single compute node, and need 25 to 64 CPU cores in each node and/or ~61 to ~125 GB RAM in each node.

Jobs in this partition/queue should be limited to 256 CPU cores (4 compute nodes).

This partition/queue has general-use compute nodes that each have dual Intel Icelake 32-core CPUs (64 cores per node) or dual AMD Rome 32-core CPUs (64 cores per node) and 128 GB RAM.

This partition/queue is for jobs that use multiple compute nodes (e.g., MPI parallel jobs), or jobs that fit in a single compute node, and need 25 to 64 CPU cores in each node and/or ~126 to ~250 GB RAM in each node.

Jobs in this partition/queue should be limited to 256 CPU cores (4 compute nodes).

This partition/queue has general-use compute nodes that each have dual Intel Icelake 32-core CPUs (64 cores per node) or dual AMD Rome 32-core CPUs (64 cores per node) and 256 GB RAM.

This partition/queue is for jobs that use multiple compute nodes (e.g., MPI parallel jobs), or jobs that fit in a single compute node, and only need up to 64 CPU cores in each node and up to ~250 GB in each node.

Jobs in this partition/queue should be limited to 256 CPU cores (13 20-core compute nodes or 11 24-core compute nodes or 4 64-core compute nodes).

This is the default partition/queue, combining all of the compute nodes in all of the above partitions.

This partition/queue is for running executables that have AVX-512 instructions, which work on the following CPU families: Intel: Skylake, Cascade Lake, Ice Lake, Sapphire Rapids; AMD: Genoa.

Jobs in this partition/queue should be limited to 256 CPU cores (4 compute nodes).

This partition/queue has general-use compute nodes that each have dual Intel Ice Lake or Sapphire Rapids 32-core CPUs (64 cores per node) and 128 - 256 GB of RAM.

This partition/queue is the combination of 32gb_20core and 64gb_24core partitions.

Jobs in this partition/queue should be limited to 240 CPU cores.

This partition/queue has general-use compute nodes that each have dual Intel Xeon Haswell CPUs (20-24 cores per node) and 32-64GB RAM. Nodes in this partition are connected to FDR10 InfiniBand network switches, at 40 Gigabits per second.

This partition/queue is the combination of 128gb_64core and 256gb_64core partitions.

Jobs in this partition/queue should be limited to 256 CPU cores (4 compute nodes)

This partition/queue has general-use compute nodes that each have dual Intel Ice Lake or Sapphire Rapids 32-core CPUs or dual AMD Rome or Milan 32-core CPUs (64 cores per node) and 128 to 256 GB of RAM. Nodes in this partition are connected to HDR100 InfiniBand network switches, at 100 Gigabits per second.

This partition/queue is for jobs that each fit in a single (but big) compute node and that need 25 to 32 CPU cores and/or ~500 to ~2000 GB RAM.

This partition/queue has Schooner's only general-use large RAM node, which has quad Intel Xeon Haswell 8-core CPUs (32 cores total) and 2048 GB (2 TB) RAM.

This partition/queue is for jobs that need to run for 2 to 7 days, specifically:

* jobs that use up to 41 compute nodes (e.g., MPI parallel jobs), or jobs that each fit in a single compute node, and that need up to 20 CPU cores in each node and up to ~30 GB in each node,

OR

* jobs that use up to 3 compute nodes (e.g., MPI parallel jobs), or jobs that fit in a single compute node, and that need 21 to 24 CPU cores in each node and/or ~41 to ~60 GB in each node.

This partition/queue has 41 general-use compute nodes:

* 38 general-use compute nodes that each have dual Intel Xeon Haswell 10-core CPUs (20 cores total) and 32 GB RAM

PLUS

* 3 general-use compute nodes that each have dual Intel Xeon Haswell 12-core CPUs (24 cores total) and 64 GB RAM.

The nodes in this partition/queue are a subset of the nodes in the normal partition/queue and other general-use partitions/queues.

longlargemem
OR
largelongmem

This partition/queue is for multi-node parallel jobs (e.g., MPI parallel jobs) that need either

* 241 to 6000 CPU cores/13 to 300 compute nodes, in nodes that each use up to 20 CPU cores and up to ~30 GB RAM,

OR

* 241 to 840 CPU cores/11 to 35 compute nodes, in nodes that each use 21 to 24 CPU cores and/or ~30 to ~60 GB RAM.

NOTE: Jobs of up to 240 CPU cores/12 compute nodes should be submitted to the other general-use queues, NOT to largejobs.

This partition/queue has all of the compute nodes found in both the 32gb_20core partition/queue and the 64gb_24core partition/queue.

For testing, debugging and performance benchmarking of your software, for up to 30 minutes per job on up to 3 compute nodes, specifically:

* 2 compute nodes of 20 CPU cores and 32 GB each

AND

* 1 compute node of 24 CPU cores and 64 GB each.

Almost always, jobs submitted to the debug queue start within 30 minutes of being submitted, but of course this ISN'T GUARANTEED.

For very quick testing, debugging and performance benchmarking of your software, for up to 5 minutes per job on up to 3 compute nodes, specifically:

* 2 compute nodes of 20 CPU cores and 32 GB each

Almost always, jobs submitted to the debug_5min queue start within 5 minutes of being submitted, but of course this ISN'T GUARANTEED.