Difference between revisions of "GPU Hardware"
Jump to navigation
Jump to search
| Line 1: | Line 1: | ||
| − | ===GPU Hardware on | + | ===GPU Hardware on Sapelo2=== |
| + | |||
| + | ====GPU resources on open-access nodes==== | ||
* 16 NVIDIA K40m GPU cards. These cards are installed on 2 hosts, each of which has dual 8-core Intel Xeon CPUs and 128GB of RAM; there are 8 GPU cards per host. The output of NVIDIA SDK deviceQuery for one such GPU card is | * 16 NVIDIA K40m GPU cards. These cards are installed on 2 hosts, each of which has dual 8-core Intel Xeon CPUs and 128GB of RAM; there are 8 GPU cards per host. The output of NVIDIA SDK deviceQuery for one such GPU card is | ||
| Line 7: | Line 9: | ||
<pre class="gscript"> | <pre class="gscript"> | ||
Device 0: "Tesla K40m" | Device 0: "Tesla K40m" | ||
| − | CUDA Driver Version / Runtime Version | + | CUDA Driver Version / Runtime Version 9.1 / 9.0 |
CUDA Capability Major/Minor version number: 3.5 | CUDA Capability Major/Minor version number: 3.5 | ||
| − | Total amount of global memory: | + | Total amount of global memory: 11441 MBytes (11996954624 bytes) |
(15) Multiprocessors, (192) CUDA Cores/MP: 2880 CUDA Cores | (15) Multiprocessors, (192) CUDA Cores/MP: 2880 CUDA Cores | ||
| − | GPU Clock rate: | + | GPU Max Clock rate: 745 MHz (0.75 GHz) |
Memory Clock rate: 3004 Mhz | Memory Clock rate: 3004 Mhz | ||
Memory Bus Width: 384-bit | Memory Bus Width: 384-bit | ||
| Line 35: | Line 37: | ||
Device has ECC support: Enabled | Device has ECC support: Enabled | ||
Device supports Unified Addressing (UVA): Yes | Device supports Unified Addressing (UVA): Yes | ||
| − | Device PCI Bus ID / | + | Supports Cooperative Kernel Launch: No |
| + | Supports MultiDevice Co-op Kernel Launch: No | ||
| + | Device PCI Domain ID / Bus ID / location ID: 0 / 4 / 0 | ||
Compute Mode: | Compute Mode: | ||
| − | < | + | < Default (multiple host threads can use ::cudaSetDevice() with device simultaneously) > |
| + | |||
</pre> | </pre> | ||
| − | + | * 28 NVIDIA Tesla (Kepler) K20Xm GPU cards (2688 GPU cores per card). These cards are installed on 4 hosts each of which has dual 6-core Intel Xeon CPUs and 96GB of RAM; there are 7 GPU cards per host. The output of NVIDIA SDK deviceQuery for one such GPU card is | |
| − | |||
| − | |||
| − | |||
| − | * | ||
| − | |||
<pre class="gscript"> | <pre class="gscript"> | ||
| − | Device 0: "Tesla | + | Device 0: "Tesla K20Xm" |
| − | CUDA Driver Version / Runtime Version 9. | + | CUDA Driver Version / Runtime Version 9.0 / 9.0 |
CUDA Capability Major/Minor version number: 3.5 | CUDA Capability Major/Minor version number: 3.5 | ||
| − | Total amount of global memory: | + | Total amount of global memory: 5700 MBytes (5976424448 bytes) |
| − | ( | + | (14) Multiprocessors, (192) CUDA Cores/MP: 2688 CUDA Cores |
| − | GPU Max Clock rate: | + | GPU Max Clock rate: 732 MHz (0.73 GHz) |
| − | Memory Clock rate: | + | Memory Clock rate: 2600 Mhz |
Memory Bus Width: 384-bit | Memory Bus Width: 384-bit | ||
L2 Cache Size: 1572864 bytes | L2 Cache Size: 1572864 bytes | ||
| Line 79: | Line 79: | ||
Supports Cooperative Kernel Launch: No | Supports Cooperative Kernel Launch: No | ||
Supports MultiDevice Co-op Kernel Launch: No | Supports MultiDevice Co-op Kernel Launch: No | ||
| − | Device PCI Domain ID / Bus ID / location ID: 0 / | + | Device PCI Domain ID / Bus ID / location ID: 0 / 12 / 0 |
Compute Mode: | Compute Mode: | ||
| − | < | + | < Exclusive Process (many threads in one process is able to use ::cudaSetDevice() with this device) > |
</pre> | </pre> | ||
| + | ====GPU resources on buyin nodes==== | ||
| + | |||
| + | Some research groups purchased nodes with GPU card(s) for their use. | ||
| − | * | + | * Two nodes with Intel Xeon processors (24 CPU cores and 128GB RAM per node) have two NVIDIA Tesla (Kepler) K80 GPU cards per node (2496 GPU cores per card). The output of NVIDIA SDK deviceQuery for one such GPU card is |
<pre class="gscript"> | <pre class="gscript"> | ||
| − | Device 0: "Tesla | + | Device 0: "Tesla K80" |
| − | CUDA Driver Version / Runtime Version 9. | + | CUDA Driver Version / Runtime Version 9.2 / 9.0 |
| − | CUDA Capability Major/Minor version number: 3. | + | CUDA Capability Major/Minor version number: 3.7 |
| − | Total amount of global memory: | + | Total amount of global memory: 11441 MBytes (11996954624 bytes) |
| − | ( | + | (13) Multiprocessors, (192) CUDA Cores/MP: 2496 CUDA Cores |
| − | GPU Max Clock rate: | + | GPU Max Clock rate: 824 MHz (0.82 GHz) |
| − | Memory Clock rate: | + | Memory Clock rate: 2505 Mhz |
Memory Bus Width: 384-bit | Memory Bus Width: 384-bit | ||
L2 Cache Size: 1572864 bytes | L2 Cache Size: 1572864 bytes | ||
| Line 119: | Line 122: | ||
Supports Cooperative Kernel Launch: No | Supports Cooperative Kernel Launch: No | ||
Supports MultiDevice Co-op Kernel Launch: No | Supports MultiDevice Co-op Kernel Launch: No | ||
| − | Device PCI Domain ID / Bus ID / location ID: 0 / | + | Device PCI Domain ID / Bus ID / location ID: 0 / 4 / 0 |
Compute Mode: | Compute Mode: | ||
< Exclusive Process (many threads in one process is able to use ::cudaSetDevice() with this device) > | < Exclusive Process (many threads in one process is able to use ::cudaSetDevice() with this device) > | ||
| + | > Peer access from Tesla K80 (GPU0) -> Tesla K80 (GPU1) : Yes | ||
| + | > Peer access from Tesla K80 (GPU1) -> Tesla K80 (GPU0) : Yes | ||
| + | |||
| + | deviceQuery, CUDA Driver = CUDART, CUDA Driver Version = 9.2, CUDA Runtime Version = 9.0, NumDevs = 2 | ||
| + | Result = PASS | ||
</pre> | </pre> | ||
| − | |||
| − | |||
| − | |||
* Two nodes with Intel Xeon processors (28 CPU cores and 256GB RAM per node) have one NVIDIA Tesla (Pascal) P100 GPU card per node (3584 GPU cores per card). The output of NVIDIA SDK deviceQuery for one such GPU card is | * Two nodes with Intel Xeon processors (28 CPU cores and 256GB RAM per node) have one NVIDIA Tesla (Pascal) P100 GPU card per node (3584 GPU cores per card). The output of NVIDIA SDK deviceQuery for one such GPU card is | ||
Revision as of 11:24, 17 October 2018
GPU Hardware on Sapelo2
GPU resources on open-access nodes
- 16 NVIDIA K40m GPU cards. These cards are installed on 2 hosts, each of which has dual 8-core Intel Xeon CPUs and 128GB of RAM; there are 8 GPU cards per host. The output of NVIDIA SDK deviceQuery for one such GPU card is
Device 0: "Tesla K40m"
CUDA Driver Version / Runtime Version 9.1 / 9.0
CUDA Capability Major/Minor version number: 3.5
Total amount of global memory: 11441 MBytes (11996954624 bytes)
(15) Multiprocessors, (192) CUDA Cores/MP: 2880 CUDA Cores
GPU Max Clock rate: 745 MHz (0.75 GHz)
Memory Clock rate: 3004 Mhz
Memory Bus Width: 384-bit
L2 Cache Size: 1572864 bytes
Maximum Texture Dimension Size (x,y,z) 1D=(65536), 2D=(65536, 65536), 3D=(4096, 4096, 4096)
Maximum Layered 1D Texture Size, (num) layers 1D=(16384), 2048 layers
Maximum Layered 2D Texture Size, (num) layers 2D=(16384, 16384), 2048 layers
Total amount of constant memory: 65536 bytes
Total amount of shared memory per block: 49152 bytes
Total number of registers available per block: 65536
Warp size: 32
Maximum number of threads per multiprocessor: 2048
Maximum number of threads per block: 1024
Max dimension size of a thread block (x,y,z): (1024, 1024, 64)
Max dimension size of a grid size (x,y,z): (2147483647, 65535, 65535)
Maximum memory pitch: 2147483647 bytes
Texture alignment: 512 bytes
Concurrent copy and kernel execution: Yes with 2 copy engine(s)
Run time limit on kernels: No
Integrated GPU sharing Host Memory: No
Support host page-locked memory mapping: Yes
Alignment requirement for Surfaces: Yes
Device has ECC support: Enabled
Device supports Unified Addressing (UVA): Yes
Supports Cooperative Kernel Launch: No
Supports MultiDevice Co-op Kernel Launch: No
Device PCI Domain ID / Bus ID / location ID: 0 / 4 / 0
Compute Mode:
< Default (multiple host threads can use ::cudaSetDevice() with device simultaneously) >
- 28 NVIDIA Tesla (Kepler) K20Xm GPU cards (2688 GPU cores per card). These cards are installed on 4 hosts each of which has dual 6-core Intel Xeon CPUs and 96GB of RAM; there are 7 GPU cards per host. The output of NVIDIA SDK deviceQuery for one such GPU card is
Device 0: "Tesla K20Xm"
CUDA Driver Version / Runtime Version 9.0 / 9.0
CUDA Capability Major/Minor version number: 3.5
Total amount of global memory: 5700 MBytes (5976424448 bytes)
(14) Multiprocessors, (192) CUDA Cores/MP: 2688 CUDA Cores
GPU Max Clock rate: 732 MHz (0.73 GHz)
Memory Clock rate: 2600 Mhz
Memory Bus Width: 384-bit
L2 Cache Size: 1572864 bytes
Maximum Texture Dimension Size (x,y,z) 1D=(65536), 2D=(65536, 65536), 3D=(4096, 4096, 4096)
Maximum Layered 1D Texture Size, (num) layers 1D=(16384), 2048 layers
Maximum Layered 2D Texture Size, (num) layers 2D=(16384, 16384), 2048 layers
Total amount of constant memory: 65536 bytes
Total amount of shared memory per block: 49152 bytes
Total number of registers available per block: 65536
Warp size: 32
Maximum number of threads per multiprocessor: 2048
Maximum number of threads per block: 1024
Max dimension size of a thread block (x,y,z): (1024, 1024, 64)
Max dimension size of a grid size (x,y,z): (2147483647, 65535, 65535)
Maximum memory pitch: 2147483647 bytes
Texture alignment: 512 bytes
Concurrent copy and kernel execution: Yes with 2 copy engine(s)
Run time limit on kernels: No
Integrated GPU sharing Host Memory: No
Support host page-locked memory mapping: Yes
Alignment requirement for Surfaces: Yes
Device has ECC support: Enabled
Device supports Unified Addressing (UVA): Yes
Supports Cooperative Kernel Launch: No
Supports MultiDevice Co-op Kernel Launch: No
Device PCI Domain ID / Bus ID / location ID: 0 / 12 / 0
Compute Mode:
< Exclusive Process (many threads in one process is able to use ::cudaSetDevice() with this device) >
GPU resources on buyin nodes
Some research groups purchased nodes with GPU card(s) for their use.
- Two nodes with Intel Xeon processors (24 CPU cores and 128GB RAM per node) have two NVIDIA Tesla (Kepler) K80 GPU cards per node (2496 GPU cores per card). The output of NVIDIA SDK deviceQuery for one such GPU card is
Device 0: "Tesla K80"
CUDA Driver Version / Runtime Version 9.2 / 9.0
CUDA Capability Major/Minor version number: 3.7
Total amount of global memory: 11441 MBytes (11996954624 bytes)
(13) Multiprocessors, (192) CUDA Cores/MP: 2496 CUDA Cores
GPU Max Clock rate: 824 MHz (0.82 GHz)
Memory Clock rate: 2505 Mhz
Memory Bus Width: 384-bit
L2 Cache Size: 1572864 bytes
Maximum Texture Dimension Size (x,y,z) 1D=(65536), 2D=(65536, 65536), 3D=(4096, 4096, 4096)
Maximum Layered 1D Texture Size, (num) layers 1D=(16384), 2048 layers
Maximum Layered 2D Texture Size, (num) layers 2D=(16384, 16384), 2048 layers
Total amount of constant memory: 65536 bytes
Total amount of shared memory per block: 49152 bytes
Total number of registers available per block: 65536
Warp size: 32
Maximum number of threads per multiprocessor: 2048
Maximum number of threads per block: 1024
Max dimension size of a thread block (x,y,z): (1024, 1024, 64)
Max dimension size of a grid size (x,y,z): (2147483647, 65535, 65535)
Maximum memory pitch: 2147483647 bytes
Texture alignment: 512 bytes
Concurrent copy and kernel execution: Yes with 2 copy engine(s)
Run time limit on kernels: No
Integrated GPU sharing Host Memory: No
Support host page-locked memory mapping: Yes
Alignment requirement for Surfaces: Yes
Device has ECC support: Enabled
Device supports Unified Addressing (UVA): Yes
Supports Cooperative Kernel Launch: No
Supports MultiDevice Co-op Kernel Launch: No
Device PCI Domain ID / Bus ID / location ID: 0 / 4 / 0
Compute Mode:
< Exclusive Process (many threads in one process is able to use ::cudaSetDevice() with this device) >
> Peer access from Tesla K80 (GPU0) -> Tesla K80 (GPU1) : Yes
> Peer access from Tesla K80 (GPU1) -> Tesla K80 (GPU0) : Yes
deviceQuery, CUDA Driver = CUDART, CUDA Driver Version = 9.2, CUDA Runtime Version = 9.0, NumDevs = 2
Result = PASS
- Two nodes with Intel Xeon processors (28 CPU cores and 256GB RAM per node) have one NVIDIA Tesla (Pascal) P100 GPU card per node (3584 GPU cores per card). The output of NVIDIA SDK deviceQuery for one such GPU card is
Device 0: "Tesla P100-PCIE-16GB"
CUDA Driver Version / Runtime Version 9.0 / 9.0
CUDA Capability Major/Minor version number: 6.0
Total amount of global memory: 16276 MBytes (17066885120 bytes)
(56) Multiprocessors, ( 64) CUDA Cores/MP: 3584 CUDA Cores
GPU Max Clock rate: 1329 MHz (1.33 GHz)
Memory Clock rate: 715 Mhz
Memory Bus Width: 4096-bit
L2 Cache Size: 4194304 bytes
Maximum Texture Dimension Size (x,y,z) 1D=(131072), 2D=(131072, 65536), 3D=(16384, 16384, 16384)
Maximum Layered 1D Texture Size, (num) layers 1D=(32768), 2048 layers
Maximum Layered 2D Texture Size, (num) layers 2D=(32768, 32768), 2048 layers
Total amount of constant memory: 65536 bytes
Total amount of shared memory per block: 49152 bytes
Total number of registers available per block: 65536
Warp size: 32
Maximum number of threads per multiprocessor: 2048
Maximum number of threads per block: 1024
Max dimension size of a thread block (x,y,z): (1024, 1024, 64)
Max dimension size of a grid size (x,y,z): (2147483647, 65535, 65535)
Maximum memory pitch: 2147483647 bytes
Texture alignment: 512 bytes
Concurrent copy and kernel execution: Yes with 2 copy engine(s)
Run time limit on kernels: No
Integrated GPU sharing Host Memory: No
Support host page-locked memory mapping: Yes
Alignment requirement for Surfaces: Yes
Device has ECC support: Enabled
Device supports Unified Addressing (UVA): Yes
Supports Cooperative Kernel Launch: Yes
Supports MultiDevice Co-op Kernel Launch: Yes
Device PCI Domain ID / Bus ID / location ID: 0 / 3 / 0
Compute Mode:
< Exclusive Process (many threads in one process is able to use ::cudaSetDevice() with this device) >
deviceQuery, CUDA Driver = CUDART, CUDA Driver Version = 9.0, CUDA Runtime Version = 9.0, NumDevs = 1
Result = PASS
- Two nodes with Intel Xeon processors (28 CPU cores and 192GB RAM per node) have one NVIDIA Tesla (Volta) V100 GPU card per node (5120 GPU cores per card). The output of NVIDIA SDK deviceQuery for one such GPU card is
Device 0: "Tesla V100-PCIE-16GB"
CUDA Driver Version / Runtime Version 9.1 / 9.0
CUDA Capability Major/Minor version number: 7.0
Total amount of global memory: 16160 MBytes (16945512448 bytes)
(80) Multiprocessors, ( 64) CUDA Cores/MP: 5120 CUDA Cores
GPU Max Clock rate: 1380 MHz (1.38 GHz)
Memory Clock rate: 877 Mhz
Memory Bus Width: 4096-bit
L2 Cache Size: 6291456 bytes
Maximum Texture Dimension Size (x,y,z) 1D=(131072), 2D=(131072, 65536), 3D=(16384, 16384, 16384)
Maximum Layered 1D Texture Size, (num) layers 1D=(32768), 2048 layers
Maximum Layered 2D Texture Size, (num) layers 2D=(32768, 32768), 2048 layers
Total amount of constant memory: 65536 bytes
Total amount of shared memory per block: 49152 bytes
Total number of registers available per block: 65536
Warp size: 32
Maximum number of threads per multiprocessor: 2048
Maximum number of threads per block: 1024
Max dimension size of a thread block (x,y,z): (1024, 1024, 64)
Max dimension size of a grid size (x,y,z): (2147483647, 65535, 65535)
Maximum memory pitch: 2147483647 bytes
Texture alignment: 512 bytes
Concurrent copy and kernel execution: Yes with 7 copy engine(s)
Run time limit on kernels: No
Integrated GPU sharing Host Memory: No
Support host page-locked memory mapping: Yes
Alignment requirement for Surfaces: Yes
Device has ECC support: Enabled
Device supports Unified Addressing (UVA): Yes
Supports Cooperative Kernel Launch: Yes
Supports MultiDevice Co-op Kernel Launch: Yes
Device PCI Domain ID / Bus ID / location ID: 0 / 59 / 0
Compute Mode:
< Default (multiple host threads can use ::cudaSetDevice() with device simultaneously) >
deviceQuery, CUDA Driver = CUDART, CUDA Driver Version = 9.1, CUDA Runtime Version = 9.0, NumDevs = 1
Result = PASS