Difference between revisions of "GPU Hardware"

From Research Computing Center Wiki
Jump to navigation Jump to search
 
(4 intermediate revisions by the same user not shown)
Line 5: Line 5:
 
====GPU resources on open-access nodes====
 
====GPU resources on open-access nodes====
  
 +
* 9 nodes with 4 NVIDIA A100 GPU cards each. Each of these nodes has two 32-core AMD EPYC 7543 processors (64 CPU cores per node) and 1TB of RAM. The output of NVIDIA SDK deviceQuery for one such GPU card is
 +
 +
<pre class="gscript">
 +
Device 0: "NVIDIA A100-SXM-80GB"EPYC 7543
 +
  CUDA Driver Version / Runtime Version          12.2 / 12.2
 +
  CUDA Capability Major/Minor version number:    8.0
 +
  Total amount of global memory:                81251 MBytes (85198045184 bytes)
 +
MapSMtoCores for SM 8.0 is undefined.  Default to use 64 Cores/SM
 +
MapSMtoCores for SM 8.0 is undefined.  Default to use 64 Cores/SM
 +
  (108) Multiprocessors, ( 64) CUDA Cores/MP:    6912 CUDA Cores
 +
  GPU Max Clock rate:                            1410 MHz (1.41 GHz)
 +
  Memory Clock rate:                            1593 Mhz
 +
  Memory Bus Width:                              5120-bit
 +
  L2 Cache Size:                                41943040 bytes
 +
  Maximum Texture Dimension Size (x,y,z)        1D=(131072), 2D=(131072, 65536), 3D=(16384, 16384, 16384)
 +
  Maximum Layered 1D Texture Size, (num) layers  1D=(32768), 2048 layers
 +
  Maximum Layered 2D Texture Size, (num) layers  2D=(32768, 32768), 2048 layers
 +
  Total amount of constant memory:              65536 bytes
 +
  Total amount of shared memory per block:      49152 bytes
 +
  Total number of registers available per block: 65536
 +
  Warp size:                                    32
 +
  Maximum number of threads per multiprocessor:  2048
 +
  Maximum number of threads per block:          1024
 +
  Max dimension size of a thread block (x,y,z): (1024, 1024, 64)
 +
  Max dimension size of a grid size    (x,y,z): (2147483647, 65535, 65535)
 +
  Maximum memory pitch:                          2147483647 bytes
 +
  Texture alignment:                            512 bytes
 +
  Concurrent copy and kernel execution:          Yes with 5 copy engine(s)
 +
  Run time limit on kernels:                    No
 +
  Integrated GPU sharing Host Memory:            No
 +
  Support host page-locked memory mapping:      Yes
 +
  Alignment requirement for Surfaces:            Yes
 +
  Device has ECC support:                        Enabled
 +
  Device supports Unified Addressing (UVA):      Yes
 +
  Device supports Compute Preemption:            Yes
 +
  Supports Cooperative Kernel Launch:            Yes
 +
  Supports MultiDevice Co-op Kernel Launch:      Yes
 +
  Device PCI Domain ID / Bus ID / location ID:  0 / 1 / 0
 +
  Compute Mode:
 +
    < Default (multiple host threads can use ::cudaSetDevice() with device simultaneously) >
 +
</pre>
 +
 +
* 2 nodes with Intel Xeon processors (32 CPU cores and 192GB RAM per node) have one NVIDIA Tesla (Pascal) P100 GPU card per node (3584 GPU cores per card). The output of NVIDIA SDK deviceQuery for one such GPU card is
 +
 +
<pre class="gscript">
 +
Device 0: "Tesla P100-PCIE-16GB"
 +
  CUDA Driver Version / Runtime Version          12.2 / 12.2
 +
  CUDA Capability Major/Minor version number:    6.0
 +
  Total amount of global memory:                16281 MBytes (17071734784 bytes)
 +
  (56) Multiprocessors, ( 64) CUDA Cores/MP:    3584 CUDA Cores
 +
  GPU Max Clock rate:                            1329 MHz (1.33 GHz)
 +
  Memory Clock rate:                            715 Mhz
 +
  Memory Bus Width:                              4096-bit
 +
  L2 Cache Size:                                4194304 bytes
 +
  Maximum Texture Dimension Size (x,y,z)        1D=(131072), 2D=(131072, 65536), 3D=(16384, 16384, 16384)
 +
  Maximum Layered 1D Texture Size, (num) layers  1D=(32768), 2048 layers
 +
  Maximum Layered 2D Texture Size, (num) layers  2D=(32768, 32768), 2048 layers
 +
  Total amount of constant memory:              65536 bytes
 +
  Total amount of shared memory per block:      49152 bytes
 +
  Total number of registers available per block: 65536
 +
  Warp size:                                    32
 +
  Maximum number of threads per multiprocessor:  2048
 +
  Maximum number of threads per block:          1024
 +
  Max dimension size of a thread block (x,y,z): (1024, 1024, 64)
 +
  Max dimension size of a grid size    (x,y,z): (2147483647, 65535, 65535)
 +
  Maximum memory pitch:                          2147483647 bytes
 +
  Texture alignment:                            512 bytes
 +
  Concurrent copy and kernel execution:          Yes with 2 copy engine(s)
 +
  Run time limit on kernels:                    No
 +
  Integrated GPU sharing Host Memory:            No
 +
  Support host page-locked memory mapping:      Yes
 +
  Alignment requirement for Surfaces:            Yes
 +
  Device has ECC support:                        Enabled
 +
  Device supports Unified Addressing (UVA):      Yes
 +
  Device supports Compute Preemption:            Yes
 +
  Supports Cooperative Kernel Launch:            Yes
 +
  Supports MultiDevice Co-op Kernel Launch:      Yes
 +
  Device PCI Domain ID / Bus ID / location ID:  0 / 59 / 0
 +
  Compute Mode:
 +
    < Default (multiple host threads can use ::cudaSetDevice() with device simultaneously) >
 +
</pre>
 +
<!--
 
* 16 NVIDIA K40m GPU cards. These cards are installed on 2 hosts, each of which has dual 8-core Intel Xeon CPUs and 128GB of RAM; there are 8 GPU cards per host. The output of NVIDIA SDK deviceQuery for one such GPU card is
 
* 16 NVIDIA K40m GPU cards. These cards are installed on 2 hosts, each of which has dual 8-core Intel Xeon CPUs and 128GB of RAM; there are 8 GPU cards per host. The output of NVIDIA SDK deviceQuery for one such GPU card is
  
 
<pre class="gscript">
 
<pre class="gscript">
 
Device 0: "Tesla K40m"
 
Device 0: "Tesla K40m"
−
   CUDA Driver Version / Runtime Version          9.1 / 9.0
+
   CUDA Driver Version / Runtime Version          11.4 / 11.1
 
   CUDA Capability Major/Minor version number:    3.5
 
   CUDA Capability Major/Minor version number:    3.5
 
   Total amount of global memory:                11441 MBytes (11996954624 bytes)
 
   Total amount of global memory:                11441 MBytes (11996954624 bytes)
Line 49: Line 131:
 
<pre class="gscript">
 
<pre class="gscript">
 
Device 0: "Tesla K20Xm"
 
Device 0: "Tesla K20Xm"
−
   CUDA Driver Version / Runtime Version          9.0 / 9.0
+
   CUDA Driver Version / Runtime Version          11.4 / 11.1
 
   CUDA Capability Major/Minor version number:    3.5
 
   CUDA Capability Major/Minor version number:    3.5
 
   Total amount of global memory:                5700 MBytes (5976424448 bytes)
 
   Total amount of global memory:                5700 MBytes (5976424448 bytes)
Line 84: Line 166:
  
 
</pre>
 
</pre>
 +
-->
  
 
====GPU resources on buyin nodes====
 
====GPU resources on buyin nodes====
  
 
Some research groups purchased nodes with GPU card(s) for their use.
 
Some research groups purchased nodes with GPU card(s) for their use.
−
 
+
<!--
 
* Two nodes with Intel Xeon processors (24 CPU cores and 128GB RAM per node) have two NVIDIA Tesla (Kepler) K80 GPU cards per node (2496 GPU cores per card). The output of NVIDIA SDK deviceQuery for one such GPU card is
 
* Two nodes with Intel Xeon processors (24 CPU cores and 128GB RAM per node) have two NVIDIA Tesla (Kepler) K80 GPU cards per node (2496 GPU cores per card). The output of NVIDIA SDK deviceQuery for one such GPU card is
 
<pre class="gscript">
 
<pre class="gscript">
 
Device 0: "Tesla K80"
 
Device 0: "Tesla K80"
−
   CUDA Driver Version / Runtime Version          9.2 / 9.0
+
   CUDA Driver Version / Runtime Version          11.4 / 11.1
 
   CUDA Capability Major/Minor version number:    3.7
 
   CUDA Capability Major/Minor version number:    3.7
 
   Total amount of global memory:                11441 MBytes (11996954624 bytes)
 
   Total amount of global memory:                11441 MBytes (11996954624 bytes)
Line 137: Line 220:
 
<pre class="gscript">
 
<pre class="gscript">
 
Device 0: "Tesla P100-PCIE-16GB"
 
Device 0: "Tesla P100-PCIE-16GB"
−
   CUDA Driver Version / Runtime Version          9.0 / 9.0
+
   CUDA Driver Version / Runtime Version          11.4 / 11.1
 
   CUDA Capability Major/Minor version number:    6.0
 
   CUDA Capability Major/Minor version number:    6.0
 
   Total amount of global memory:                16276 MBytes (17066885120 bytes)
 
   Total amount of global memory:                16276 MBytes (17066885120 bytes)
Line 175: Line 258:
  
 
</pre>
 
</pre>
 +
-->
  
−
* Two nodes with Intel Xeon processors (28 CPU cores and 192GB RAM per node) have one NVIDIA Tesla (Volta) V100 GPU card per node (5120 GPU cores per card). The output of NVIDIA SDK deviceQuery for one such GPU card is
+
* Specifications of NVIDIA Tesla (Volta) V100 and V100S GPU cards (5120 GPU cores per card). The output of NVIDIA SDK deviceQuery for these GPU cards are
 
<pre class="gscript">
 
<pre class="gscript">
 
Device 0: "Tesla V100-PCIE-16GB"
 
Device 0: "Tesla V100-PCIE-16GB"
−
   CUDA Driver Version / Runtime Version          9.1 / 9.0
+
   CUDA Driver Version / Runtime Version          12.2 / 12.2
 
   CUDA Capability Major/Minor version number:    7.0
 
   CUDA Capability Major/Minor version number:    7.0
 
   Total amount of global memory:                16160 MBytes (16945512448 bytes)
 
   Total amount of global memory:                16160 MBytes (16945512448 bytes)
Line 207: Line 291:
 
   Device has ECC support:                        Enabled
 
   Device has ECC support:                        Enabled
 
   Device supports Unified Addressing (UVA):      Yes
 
   Device supports Unified Addressing (UVA):      Yes
 +
  Device supports Compute Preemption:            Yes
 
   Supports Cooperative Kernel Launch:            Yes
 
   Supports Cooperative Kernel Launch:            Yes
 
   Supports MultiDevice Co-op Kernel Launch:      Yes
 
   Supports MultiDevice Co-op Kernel Launch:      Yes
Line 213: Line 298:
 
     < Default (multiple host threads can use ::cudaSetDevice() with device simultaneously) >
 
     < Default (multiple host threads can use ::cudaSetDevice() with device simultaneously) >
  
−
deviceQuery, CUDA Driver = CUDART, CUDA Driver Version = 9.1, CUDA Runtime Version = 9.0, NumDevs = 1
+
deviceQuery, CUDA Driver = CUDART, CUDA Driver Version = 11.4, CUDA Runtime Version = 11.1, NumDevs = 1
 
Result = PASS
 
Result = PASS
 +
</pre>
  
 +
<pre class="gscript">
 +
Device 0: "Tesla V100-PCIE-32GB"
 +
  CUDA Driver Version / Runtime Version          12.2 / 12.2
 +
  CUDA Capability Major/Minor version number:    7.0
 +
  Total amount of global memory:                32510 MBytes (34089730048 bytes)
 +
  (80) Multiprocessors, ( 64) CUDA Cores/MP:    5120 CUDA Cores
 +
  GPU Max Clock rate:                            1380 MHz (1.38 GHz)
 +
  Memory Clock rate:                            877 Mhz
 +
  Memory Bus Width:                              4096-bit
 +
  L2 Cache Size:                                6291456 bytes
 +
  Maximum Texture Dimension Size (x,y,z)        1D=(131072), 2D=(131072, 65536), 3D=(16384, 16384, 16384)
 +
  Maximum Layered 1D Texture Size, (num) layers  1D=(32768), 2048 layers
 +
  Maximum Layered 2D Texture Size, (num) layers  2D=(32768, 32768), 2048 layers
 +
  Total amount of constant memory:              65536 bytes
 +
  Total amount of shared memory per block:      49152 bytes
 +
  Total number of registers available per block: 65536
 +
  Warp size:                                    32
 +
  Maximum number of threads per multiprocessor:  2048
 +
  Maximum number of threads per block:          1024
 +
  Max dimension size of a thread block (x,y,z): (1024, 1024, 64)
 +
  Max dimension size of a grid size    (x,y,z): (2147483647, 65535, 65535)
 +
  Maximum memory pitch:                          2147483647 bytes
 +
  Texture alignment:                            512 bytes
 +
  Concurrent copy and kernel execution:          Yes with 7 copy engine(s)
 +
  Run time limit on kernels:                    No
 +
  Integrated GPU sharing Host Memory:            No
 +
  Support host page-locked memory mapping:      Yes
 +
  Alignment requirement for Surfaces:            Yes
 +
  Device has ECC support:                        Enabled
 +
  Device supports Unified Addressing (UVA):      Yes
 +
  Device supports Compute Preemption:            Yes
 +
  Supports Cooperative Kernel Launch:            Yes
 +
  Supports MultiDevice Co-op Kernel Launch:      Yes
 +
  Device PCI Domain ID / Bus ID / location ID:  0 / 59 / 0
 +
  Compute Mode:
 +
    < Default (multiple host threads can use ::cudaSetDevice() with device simultaneously) >
 +
 +
deviceQuery, CUDA Driver = CUDART, CUDA Driver Version = 11.4, CUDA Runtime Version = 11.1, NumDevs = 1
 +
Result = PASS
 +
</pre>
 +
 +
<pre class="gscript">
 +
Device 0: "Tesla V100S-PCIE-32GB"
 +
  CUDA Driver Version / Runtime Version          12.2 / 12.2
 +
  CUDA Capability Major/Minor version number:    7.0
 +
  Total amount of global memory:                32510 MBytes (34089730048 bytes)
 +
  (80) Multiprocessors, ( 64) CUDA Cores/MP:    5120 CUDA Cores
 +
  GPU Max Clock rate:                            1597 MHz (1.60 GHz)
 +
  Memory Clock rate:                            1107 Mhz
 +
  Memory Bus Width:                              4096-bit
 +
  L2 Cache Size:                                6291456 bytes
 +
  Maximum Texture Dimension Size (x,y,z)        1D=(131072), 2D=(131072, 65536), 3D=(16384, 16384, 16384)
 +
  Maximum Layered 1D Texture Size, (num) layers  1D=(32768), 2048 layers
 +
  Maximum Layered 2D Texture Size, (num) layers  2D=(32768, 32768), 2048 layers
 +
  Total amount of constant memory:              65536 bytes
 +
  Total amount of shared memory per block:      49152 bytes
 +
  Total number of registers available per block: 65536
 +
  Warp size:                                    32
 +
  Maximum number of threads per multiprocessor:  2048
 +
  Maximum number of threads per block:          1024
 +
  Max dimension size of a thread block (x,y,z): (1024, 1024, 64)
 +
  Max dimension size of a grid size    (x,y,z): (2147483647, 65535, 65535)
 +
  Maximum memory pitch:                          2147483647 bytes
 +
  Texture alignment:                            512 bytes
 +
  Concurrent copy and kernel execution:          Yes with 7 copy engine(s)
 +
  Run time limit on kernels:                    No
 +
  Integrated GPU sharing Host Memory:            No
 +
  Support host page-locked memory mapping:      Yes
 +
  Alignment requirement for Surfaces:            Yes
 +
  Device has ECC support:                        Enabled
 +
  Device supports Unified Addressing (UVA):      Yes
 +
  Device supports Compute Preemption:            Yes
 +
  Supports Cooperative Kernel Launch:            Yes
 +
  Supports MultiDevice Co-op Kernel Launch:      Yes
 +
  Device PCI Domain ID / Bus ID / location ID:  0 / 196 / 0
 +
  Compute Mode:
 +
    < Default (multiple host threads can use ::cudaSetDevice() with device simultaneously) >
 +
 +
deviceQuery, CUDA Driver = CUDART, CUDA Driver Version = 11.4, CUDA Runtime Version = 11.1, NumDevs = 1
 +
Result = PASS
 
</pre>
 
</pre>

Latest revision as of 11:35, 8 September 2023


GPU Hardware on Sapelo2

GPU resources on open-access nodes

  • 9 nodes with 4 NVIDIA A100 GPU cards each. Each of these nodes has two 32-core AMD EPYC 7543 processors (64 CPU cores per node) and 1TB of RAM. The output of NVIDIA SDK deviceQuery for one such GPU card is
Device 0: "NVIDIA A100-SXM-80GB"EPYC 7543
  CUDA Driver Version / Runtime Version          12.2 / 12.2
  CUDA Capability Major/Minor version number:    8.0
  Total amount of global memory:                 81251 MBytes (85198045184 bytes)
MapSMtoCores for SM 8.0 is undefined.  Default to use 64 Cores/SM
MapSMtoCores for SM 8.0 is undefined.  Default to use 64 Cores/SM
  (108) Multiprocessors, ( 64) CUDA Cores/MP:     6912 CUDA Cores
  GPU Max Clock rate:                            1410 MHz (1.41 GHz)
  Memory Clock rate:                             1593 Mhz
  Memory Bus Width:                              5120-bit
  L2 Cache Size:                                 41943040 bytes
  Maximum Texture Dimension Size (x,y,z)         1D=(131072), 2D=(131072, 65536), 3D=(16384, 16384, 16384)
  Maximum Layered 1D Texture Size, (num) layers  1D=(32768), 2048 layers
  Maximum Layered 2D Texture Size, (num) layers  2D=(32768, 32768), 2048 layers
  Total amount of constant memory:               65536 bytes
  Total amount of shared memory per block:       49152 bytes
  Total number of registers available per block: 65536
  Warp size:                                     32
  Maximum number of threads per multiprocessor:  2048
  Maximum number of threads per block:           1024
  Max dimension size of a thread block (x,y,z): (1024, 1024, 64)
  Max dimension size of a grid size    (x,y,z): (2147483647, 65535, 65535)
  Maximum memory pitch:                          2147483647 bytes
  Texture alignment:                             512 bytes
  Concurrent copy and kernel execution:          Yes with 5 copy engine(s)
  Run time limit on kernels:                     No
  Integrated GPU sharing Host Memory:            No
  Support host page-locked memory mapping:       Yes
  Alignment requirement for Surfaces:            Yes
  Device has ECC support:                        Enabled
  Device supports Unified Addressing (UVA):      Yes
  Device supports Compute Preemption:            Yes
  Supports Cooperative Kernel Launch:            Yes
  Supports MultiDevice Co-op Kernel Launch:      Yes
  Device PCI Domain ID / Bus ID / location ID:   0 / 1 / 0
  Compute Mode:
     < Default (multiple host threads can use ::cudaSetDevice() with device simultaneously) >
  • 2 nodes with Intel Xeon processors (32 CPU cores and 192GB RAM per node) have one NVIDIA Tesla (Pascal) P100 GPU card per node (3584 GPU cores per card). The output of NVIDIA SDK deviceQuery for one such GPU card is
Device 0: "Tesla P100-PCIE-16GB"
  CUDA Driver Version / Runtime Version          12.2 / 12.2
  CUDA Capability Major/Minor version number:    6.0
  Total amount of global memory:                 16281 MBytes (17071734784 bytes)
  (56) Multiprocessors, ( 64) CUDA Cores/MP:     3584 CUDA Cores
  GPU Max Clock rate:                            1329 MHz (1.33 GHz)
  Memory Clock rate:                             715 Mhz
  Memory Bus Width:                              4096-bit
  L2 Cache Size:                                 4194304 bytes
  Maximum Texture Dimension Size (x,y,z)         1D=(131072), 2D=(131072, 65536), 3D=(16384, 16384, 16384)
  Maximum Layered 1D Texture Size, (num) layers  1D=(32768), 2048 layers
  Maximum Layered 2D Texture Size, (num) layers  2D=(32768, 32768), 2048 layers
  Total amount of constant memory:               65536 bytes
  Total amount of shared memory per block:       49152 bytes
  Total number of registers available per block: 65536
  Warp size:                                     32
  Maximum number of threads per multiprocessor:  2048
  Maximum number of threads per block:           1024
  Max dimension size of a thread block (x,y,z): (1024, 1024, 64)
  Max dimension size of a grid size    (x,y,z): (2147483647, 65535, 65535)
  Maximum memory pitch:                          2147483647 bytes
  Texture alignment:                             512 bytes
  Concurrent copy and kernel execution:          Yes with 2 copy engine(s)
  Run time limit on kernels:                     No
  Integrated GPU sharing Host Memory:            No
  Support host page-locked memory mapping:       Yes
  Alignment requirement for Surfaces:            Yes
  Device has ECC support:                        Enabled
  Device supports Unified Addressing (UVA):      Yes
  Device supports Compute Preemption:            Yes
  Supports Cooperative Kernel Launch:            Yes
  Supports MultiDevice Co-op Kernel Launch:      Yes
  Device PCI Domain ID / Bus ID / location ID:   0 / 59 / 0
  Compute Mode:
     < Default (multiple host threads can use ::cudaSetDevice() with device simultaneously) >

GPU resources on buyin nodes

Some research groups purchased nodes with GPU card(s) for their use.

  • Specifications of NVIDIA Tesla (Volta) V100 and V100S GPU cards (5120 GPU cores per card). The output of NVIDIA SDK deviceQuery for these GPU cards are
Device 0: "Tesla V100-PCIE-16GB"
  CUDA Driver Version / Runtime Version          12.2 / 12.2
  CUDA Capability Major/Minor version number:    7.0
  Total amount of global memory:                 16160 MBytes (16945512448 bytes)
  (80) Multiprocessors, ( 64) CUDA Cores/MP:     5120 CUDA Cores
  GPU Max Clock rate:                            1380 MHz (1.38 GHz)
  Memory Clock rate:                             877 Mhz
  Memory Bus Width:                              4096-bit
  L2 Cache Size:                                 6291456 bytes
  Maximum Texture Dimension Size (x,y,z)         1D=(131072), 2D=(131072, 65536), 3D=(16384, 16384, 16384)
  Maximum Layered 1D Texture Size, (num) layers  1D=(32768), 2048 layers
  Maximum Layered 2D Texture Size, (num) layers  2D=(32768, 32768), 2048 layers
  Total amount of constant memory:               65536 bytes
  Total amount of shared memory per block:       49152 bytes
  Total number of registers available per block: 65536
  Warp size:                                     32
  Maximum number of threads per multiprocessor:  2048
  Maximum number of threads per block:           1024
  Max dimension size of a thread block (x,y,z): (1024, 1024, 64)
  Max dimension size of a grid size    (x,y,z): (2147483647, 65535, 65535)
  Maximum memory pitch:                          2147483647 bytes
  Texture alignment:                             512 bytes
  Concurrent copy and kernel execution:          Yes with 7 copy engine(s)
  Run time limit on kernels:                     No
  Integrated GPU sharing Host Memory:            No
  Support host page-locked memory mapping:       Yes
  Alignment requirement for Surfaces:            Yes
  Device has ECC support:                        Enabled
  Device supports Unified Addressing (UVA):      Yes
  Device supports Compute Preemption:            Yes
  Supports Cooperative Kernel Launch:            Yes
  Supports MultiDevice Co-op Kernel Launch:      Yes
  Device PCI Domain ID / Bus ID / location ID:   0 / 59 / 0
  Compute Mode:
     < Default (multiple host threads can use ::cudaSetDevice() with device simultaneously) >

deviceQuery, CUDA Driver = CUDART, CUDA Driver Version = 11.4, CUDA Runtime Version = 11.1, NumDevs = 1
Result = PASS

Device 0: "Tesla V100-PCIE-32GB"
  CUDA Driver Version / Runtime Version          12.2 / 12.2
  CUDA Capability Major/Minor version number:    7.0
  Total amount of global memory:                 32510 MBytes (34089730048 bytes)
  (80) Multiprocessors, ( 64) CUDA Cores/MP:     5120 CUDA Cores
  GPU Max Clock rate:                            1380 MHz (1.38 GHz)
  Memory Clock rate:                             877 Mhz
  Memory Bus Width:                              4096-bit
  L2 Cache Size:                                 6291456 bytes
  Maximum Texture Dimension Size (x,y,z)         1D=(131072), 2D=(131072, 65536), 3D=(16384, 16384, 16384)
  Maximum Layered 1D Texture Size, (num) layers  1D=(32768), 2048 layers
  Maximum Layered 2D Texture Size, (num) layers  2D=(32768, 32768), 2048 layers
  Total amount of constant memory:               65536 bytes
  Total amount of shared memory per block:       49152 bytes
  Total number of registers available per block: 65536
  Warp size:                                     32
  Maximum number of threads per multiprocessor:  2048
  Maximum number of threads per block:           1024
  Max dimension size of a thread block (x,y,z): (1024, 1024, 64)
  Max dimension size of a grid size    (x,y,z): (2147483647, 65535, 65535)
  Maximum memory pitch:                          2147483647 bytes
  Texture alignment:                             512 bytes
  Concurrent copy and kernel execution:          Yes with 7 copy engine(s)
  Run time limit on kernels:                     No
  Integrated GPU sharing Host Memory:            No
  Support host page-locked memory mapping:       Yes
  Alignment requirement for Surfaces:            Yes
  Device has ECC support:                        Enabled
  Device supports Unified Addressing (UVA):      Yes
  Device supports Compute Preemption:            Yes
  Supports Cooperative Kernel Launch:            Yes
  Supports MultiDevice Co-op Kernel Launch:      Yes
  Device PCI Domain ID / Bus ID / location ID:   0 / 59 / 0
  Compute Mode:
     < Default (multiple host threads can use ::cudaSetDevice() with device simultaneously) >

deviceQuery, CUDA Driver = CUDART, CUDA Driver Version = 11.4, CUDA Runtime Version = 11.1, NumDevs = 1
Result = PASS

Device 0: "Tesla V100S-PCIE-32GB"
  CUDA Driver Version / Runtime Version          12.2 / 12.2
  CUDA Capability Major/Minor version number:    7.0
  Total amount of global memory:                 32510 MBytes (34089730048 bytes)
  (80) Multiprocessors, ( 64) CUDA Cores/MP:     5120 CUDA Cores
  GPU Max Clock rate:                            1597 MHz (1.60 GHz)
  Memory Clock rate:                             1107 Mhz
  Memory Bus Width:                              4096-bit
  L2 Cache Size:                                 6291456 bytes
  Maximum Texture Dimension Size (x,y,z)         1D=(131072), 2D=(131072, 65536), 3D=(16384, 16384, 16384)
  Maximum Layered 1D Texture Size, (num) layers  1D=(32768), 2048 layers
  Maximum Layered 2D Texture Size, (num) layers  2D=(32768, 32768), 2048 layers
  Total amount of constant memory:               65536 bytes
  Total amount of shared memory per block:       49152 bytes
  Total number of registers available per block: 65536
  Warp size:                                     32
  Maximum number of threads per multiprocessor:  2048
  Maximum number of threads per block:           1024
  Max dimension size of a thread block (x,y,z): (1024, 1024, 64)
  Max dimension size of a grid size    (x,y,z): (2147483647, 65535, 65535)
  Maximum memory pitch:                          2147483647 bytes
  Texture alignment:                             512 bytes
  Concurrent copy and kernel execution:          Yes with 7 copy engine(s)
  Run time limit on kernels:                     No
  Integrated GPU sharing Host Memory:            No
  Support host page-locked memory mapping:       Yes
  Alignment requirement for Surfaces:            Yes
  Device has ECC support:                        Enabled
  Device supports Unified Addressing (UVA):      Yes
  Device supports Compute Preemption:            Yes
  Supports Cooperative Kernel Launch:            Yes
  Supports MultiDevice Co-op Kernel Launch:      Yes
  Device PCI Domain ID / Bus ID / location ID:   0 / 196 / 0
  Compute Mode:
     < Default (multiple host threads can use ::cudaSetDevice() with device simultaneously) >

deviceQuery, CUDA Driver = CUDART, CUDA Driver Version = 11.4, CUDA Runtime Version = 11.1, NumDevs = 1
Result = PASS
Retrieved from "https://wiki.gacrc.uga.edu/index.php?title=GPU_Hardware&oldid=21525"