Lenovo ThinkSystem NVIDIA A100 PCIe 4.0 Passive GPU User Guide

Lenovo ThinkSystem NVIDIA A100 PCIe 4.0 Passive GPU

Product Information

The ThinkSystem NVIDIA A100 PCIe 4.0 Passive GPU is a high-performance graphics processing unit designed to deliver outstanding acceleration and flexibility for AI, data analytics, and HPC applications. It features the NVIDIA A100 Tensor Core GPU that provides up to 20X higher performance over V100 GPUs and can efficiently scale up to thousands of GPUs. The A100 also comes with Multi-Instance GPU (MIG) capability that can partition into seven isolated GPU instances to accelerate workloads of all sizes.

The A100’s third-generation Tensor Core technology supports a broad range of math precisions, providing a unified workload accelerator for data analytics, AI training, AI inference, and HPC. It is part of the complete NVIDIA data center solution that incorporates building blocks across hardware, networking, software, libraries, and optimized AI models and applications from the NVIDIA NGCTM catalog.

The A100 is available in both double-wide PCIe adapter form factor and in SXM form factor. The PCIe option part numbers include one NVIDIA A100 GPU with full-height (3U) adapter bracket attached documentation.

Product Usage Instructions

The ThinkSystem NVIDIA A100 PCIe 4.0 Passive GPU is easy to use. Follow the steps below:

1. Install the ThinkSystem NVIDIA A100 PCIe 4.0 Passive GPU in your server or workstation according to the manufacturer’s instructions.
2. Install the necessary drivers and software for the A100 GPU.
3. Configure the A100 using the NVIDIA Control Panel or other supported software.
4. Start using the A100 for your AI, data analytics, and HPC applications

Note that the A100’s third-generation Tensor Core technology supports a broad range of math precisions, providing a single accelerator for every workload. Whether using MIG to partition an A100 GPU into smaller instances or NVLink to connect multiple GPUs to speed large-scale workloads, A100 can readily handle different-sized acceleration needs, from the smallest job to the biggest multi-node workload.

NVIDIA A100 Tensor Core GPU delivers outstanding acceleration and flexibility to power the world’s highest-performing elastic data centers for AI, data analytics, and HPC applications. As the engine of the NVIDIA data center platform, A100 provides up to 20X higher performance over V100 GPUs and can efficiently scale up to thousands of GPUs, or be partitioned into seven isolated GPU instances with new Multi-Instance GPU (MIG) capability to accelerate workloads of all sizes.
A100’s third-generation Tensor Core technology supports a broad range of math precisions providing a unified workload accelerator for data analytics, AI training, AI inference, and HPC. Accelerating both scale-up and scale-out workloads on one platform enables elastic data centers that can dynamically adjust to shifting application workload demands. This simultaneously boosts throughput and drives down the cost of data centers. The following figure shows the ThinkSystem NVIDIA A100 PCIe 4.0 Passive GPU .

Did you know?
The NVIDIA A100 is available in both double-wide PCIe adapter form factor and in SXM form factor. The latter is used in Lenovo’s Neptune direct-water-cooled ThinkSystem SD650-N V2 server for the ultimate in GPU performance and heat management.

Part number information

The following table shows the part numbers for the H100 GPUs.

Table 1. Ordering information

PCIe double-wide adapters
4X67A13135| BEL5| ThinkSystem NVIDIA A100 40GB PCIe Gen4 Passive GPU
4X67A76715| BQZP| ThinkSystem NVIDIA A100 80GB PCIe Gen4 Passive GPU w/o CEC
SXM modules
None| BCSL| ThinkSystem NVIDIA HGX A100 40GB 400W 4-GPU Board
None| BHT3| ThinkSystem NVIDIA HGX A100 80GB 500W 4-GPU Board

The PCIe option part numbers includes the following:

• One NVIDIA A100 GPU with full-height (3U) adapter bracket attached
• Documentation

GPUs without a CEC chip: The NVIDIA A100 GPU is offered without a CEC chip (look for “w/o CEC” in the name). The CEC is a secondary Hardware Root of Trust (RoT) module that provides an additional layer of security, which can be used by customers who have high regulatory requirements or high security standards. NVIDIA uses a multi-layered security model and hence the protection offered by the primary Root of Trust embedded in the GPU is expected to be sufficient for most customers. The CEC defeatured products still offer Secure Boot, Secure Firmware Update, Firmware Rollback Protection, and In-Band Firmware Update Disable. Specifically, without the CEC chip, the GPU does not support Key Revocation or Firmware Attestation. CEC and non-CEC GPUs of the same type of GPU can be mixed in field upgrades. The following figure shows the NVIDIA H100 SXM5 4-GPU Board installed in the ThinkSystem SD665-N V3 server

Figure 2. NVIDIA HGX A100 4-GPU Board in the water-cooled ThinkSystem SD650-N V2 server

Features

The NVIDIA A100 Tensor Core GPU delivers unprecedented acceleration—at every scale—to power the world’s highest-performing elastic data centers for AI, data analytics, and high-performance computing (HPC) applications. As the engine of the NVIDIA data center platform, A100 provides up to 20X higher performance over the prior NVIDIA Volta™ generation. A100 can efficiently scale up or be partitioned into seven isolated GPU instances with Multi- Instance GPU (MIG), providing a unified platform that enables elastic data centers to dynamically adjust to shifting workload demands. NVIDIA A100 Tensor Core technology supports a broad range of math precisions, providing a single accelerator for every workload. The latest generation A100 80GB doubles GPU memory and debuts the world’s fastest memory bandwidth at 2 terabytes per second (TB/s), speeding time to solution for the largest models and most massive datasets. A100 is part of the complete NVIDIA data center solution that incorporates building blocks across hardware, networking, software, libraries, and optimized AI models and applications from the NVIDIA NGC™ catalog. Representing the most powerful end-to-end AI and HPC platform for data centers, it allows researchers to deliver real-world results and deploy solutions into production at scale.

• NVIDIA Ampere Architecture
  Whether using MIG to partition an A100 GPU into smaller instances or NVLink to connect multiple GPUs to speed large-scale workloads, A100 can readily handle different-sized acceleration needs, from the smallest job to the biggest multi-node workload. A100’s versatility means IT managers can maximize the utility of every GPU in their data center, around the clock.

• Third-Generation Tensor Cores
  NVIDIA A100 delivers 312 teraFLOPS (TFLOPS) of deep learning performance. That’s 20X the Tensor floating-point operations per second (FLOPS) for deep learning training and 20X the Tensor tera operations per second (TOPS) for deep learning inference compared to NVIDIA Volta GPUs.

• Next-Generation NVLink
  NVIDIA NVLink in A100 delivers 2X higher throughput compared to the previous generation. When combined with NVIDIA NVSwitch, up to 16 A100 GPUs can be interconnected at up to 600 gigabytes per second (GB/sec), unleashing the highest application performance possible on a single server. NVLink is available in A100 SXM GPUs via HGX A100 server boards and in PCIe GPUs via an NVLink Bridge for up to 2 GPUs.

• Multi-Instance GPU (MIG)
  An A100 GPU can be partitioned into as many as seven GPU instances, fully isolated at the hardware level with their own high-bandwidth memory, cache, and compute cores. MIG gives developers access to breakthrough acceleration for all their applications, and IT administrators can offer right-sized GPU acceleration for every job, optimizing utilization and expanding access to every user and application.

• High-Bandwidth Memory (HBM2E)
  With up to 80 GB of HBM2e, A100 delivers the world’s fastest GPU memory bandwidth of over 2TB/s, as well as a DRAM utilization efficiency of 95%. A100 delivers 1.7X higher memory bandwidth over the previous generation.

• Structural Sparsity
  AI networks have millions to billions of parameters. Not all of these parameters are needed for accurate predictions, and some can be converted to zeros, making the models “sparse” without compromising accuracy. Tensor Cores in A100 can provide up to 2X higher performance for sparse models. While the sparsity feature more readily benefits AI inference, it can also improve the performance of model training.

Technical specifications

The following table lists the NVIDIA A100 GPU specifications.

Table 2. A100 specifications

Feature

|

A100 40GB PCIe

|

A100 80GB PCIe

| A100 40GB SXM 4-

GPU board (per GPU)

| A100 80GB SXM 4-

GPU board (per GPU)

---|---|---|---|---
GPU Architecture| NVIDIA Ampere
NVIDIA Tensor Cores| 512 third-generation Tensor Cores per GPU
NVIDIA CUDA Cores| 8192 FP32 CUDA Cores per GPU
Double-Precision Performance| FP64: 9.7 TFLOPS

FP64 Tensor Core: 19.5 TFLOPS

Single-Precision Performance| FP32: 19.5 TFLOPS

Tensor Float 32 (TF32): 156 TFLOPS, 312 TFLOPS*

Half-Precision Performance| 312 TFLOPS, 624 TFLOPS
Bfloat16| 312 TFLOPS, 624 TFLOPS
Integer Performance| INT8: 624 TOPS, 1,248 TOPS*

INT4: 1,248 TOPS, 2,496 TOPS*

GPU Memory| 40 GB HBM2| 80 GB HBM2| 40 GB HBM2| 80 GB HBM2
Memory Bandwidth| 1,555 GB/s| 1,935 GB/s| 1,555 GB/s| 2,039 GB/s
ECC| Yes
Interconnect Bandwidth| NVLink: 600 GB/s

PCIe: 64 GB/s

| NVLink: 600 GB/s

PCIe: 64 GB/s

System Interface| PCIe Gen 4, x16 lanes
Form Factor| PCIe full height/length, double width| 4x SXM4 modules
Multi-Instance GPU (MIG)| Up to 7 GPU instances, 5GB each| Up to 7 GPU instances, 10GB each| Up to 7 GPU instances, 5GB each| Up to 7 GPU instances, 10GB each
Max Power Consumption| 250 W| 300 W| 400W| 500W
Thermal Solution| Passive| Water cooled
Compute APIs| CUDA, DirectCompute, OpenCL, OpenACC

• With structural sparsity enabled

Server support
The following tables list the ThinkSystem servers that are compatible.

Table 3. Server support (Part 1 of 3)

Part Number

|

Description

|

Edge

| 1S Intel V2|

AMD V3

|

Intel V3

|

Dense V3

---|---|---|---|---|---|---
SE350 (7Z46 / 7D1X)| SE450 (7D8T)| ST50 V2 (7D8K / 7D8J)| ST250 V2 (7D8G / 7D8F)| SR250 V2 (7D7R / 7D7Q)| SR635 V3 (7D9H / 7D9G)| SR655 V3 (7D9F / 7D9E)| SR645 V3 (7D9D / 7D9C)| SR665 V3 (7D9B / 7D9A)| SR675 V3 (7D9Q / 7D9R)| ST650 V3 (7D7B / 7D7A)| SR630 V3 (7D72 / 7D73)| SR650 V3 (7D75 / 7D76)| SR850 V3 (7D97 / 7D96)| SR860 V3 (7D94 / 7D93)| SD665 V3 (7D9P)| SD665-N V3 (7DAZ)| SD650 V3 (7D7M)| SD650-I V3 (7D7L)
4X67A13135| ThinkSystem NVIDIA A100 40GB PCIe Gen4 Passive GPU| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N
4X67A76715| ThinkSystem NVIDIA A100 80GB PCIe Gen4 Passive GPU w/o CEC| N| N| N| N| N| N| 3| N| 3| 8| N| N| 3| 2| 4| N| N| N| N
BCSL| ThinkSystem NVIDIA HGX A100 40GB 400W 4-GPU Board| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N
BHT3| ThinkSystem NVIDIA HGX A100 80GB 500W 4-GPU Board| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N

Table 4. Server support (Part 2 of 3)

Part Number

|

Description

|

2S Intel V2

|

AMD V1

|

Dense V2

| 4S V2|

8S

|

4S V1

---|---|---|---|---|---|---|---
ST650 V2 (7Z75 / 7Z74)| SR630 V2 (7Z70 / 7Z71)| SR650 V2 (7Z72 / 7Z73)| SR670 V2 (7Z22 / 7Z23)| SR635 (7Y98 / 7Y99)| SR655 (7Y00 / 7Z01)| SR655 Client OS| SR645 (7D2Y / 7D2X)| SR665 (7D2W / 7D2V)| SD630 V2 (7D1K)| SD650 V2 (7D1M)| SD650-N V2 (7D1N)| SN550 V2 (7Z69)| SR850 V2 (7D31 / 7D32)| SR860 V2 (7Z59 / 7Z60)| SR950 (7X11 / 7X12)| SR850 (7X18 / 7X19)| SR850P (7D2F / 2D2G)| SR860 (7X69 / 7X70)
4X67A13135| ThinkSystem NVIDIA A100 40GB PCIe Gen4 Passive GPU| N| N| 3| 8| N| 2| N| N| 31| N| N| N| N| N| 4| N| N| N| N
4X67A76715| ThinkSystem NVIDIA A100 80GB PCIe Gen4 Passive GPU w/o CEC| N| N| 3| 8| N| 2| N| N| 3| N| N| N| N| N| 4| N| N| N| N
BCSL| ThinkSystem NVIDIA HGX A100 40GB 400W 4-GPU Board| N| N| N| 12| N| N| N| N| N| N| N| 12| N| N| N| N| N| N| N
BHT3| ThinkSystem NVIDIA HGX A100 80GB 500W 4-GPU Board| N| N| N| 12| N| N| N| N| N| N| N| 12| N| N| N| N| N| N| N

1. For SR665 systems with AMD EPYC 7003 “Milan” processors, the A100 is supported in either factory orders (CTO) or field upgrades. For SR665 systems with AMD EPYC 7002 “Rome” processors, the A100 is only supported under Special Bid conditions and is not supported as a field upgrade. Requires the refreshed system board.
2. Contains 4 separate GPUs connected via high-speed interconnects

Table 5. Server support (Part 3 of 3)

Part Number

|

Description

| 1S Intel V1| 2S Intel V1| Dense V1
---|---|---|---|---
ST50 (7Y48 / 7Y50)| ST250 (7Y45 / 7Y46)| SR150 (7Y54)| SR250 (7Y52 / 7Y51)| ST550 (7X09 / 7X10)| SR530 (7X07 / 7X08)| SR550 (7X03 / 7X04)| SR570 (7Y02 / 7Y03)| SR590 (7X98 / 7X99)| SR630 (7X01 / 7X02)| SR650 (7X05 / 7X06)| SR670 (7Y36 / 7Y37)| SD530 (7X21)| SD650 (7X58)| SN550 (7X16)| SN850 (7X15)
4X67A13135| ThinkSystem NVIDIA A100 40GB PCIe Gen4 Passive GPU| N| N| N| N| N| N| N| N| N| N| 2| 4| N| N| N| N
4X67A76715| ThinkSystem NVIDIA A100 80GB PCIe Gen4 Passive GPU w/o CEC| N| N| N| N| N| N| N| N| N| N| 2| N| N| N| N| N
BCSL| ThinkSystem NVIDIA HGX A100 40GB 400W

4-GPU Board

| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N
BHT3| ThinkSystem NVIDIA HGX A100 80GB 500W

4-GPU Board

| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N

Operating system support

The following table lists the supported operating systems:

• ThinkSystem NVIDIA A100 40GB PCIe Gen4 Passive GPU, 4X67A13135
• ThinkSystem NVIDIA A100 80GB PCIe Gen4 Passive GPU, 4X67A76715

Tip: These tables are automatically generated based on data from Lenovo ServerProven.

Table 6. Operating system support for ThinkSystem NVIDIA A100 40GB PCIe Gen4 Passive GPU, 4X67A13135

Operating systems

| SR650 V2| SR670 V2| SR860 V2| SR655| SR665| SR650 (Gen 2)| SR670 (Gen 2)| SR650 (Gen 1)| SR670 (Gen 1)
---|---|---|---|---|---|---|---|---|---
Microsoft Windows 10| N| N| N| Y 1| N| N| N| N| N
Microsoft Windows 11| N| N| N| Y| N| N| N| N| N
Microsoft Windows Server 2016| Y| Y| Y| Y| Y 3| Y| N| Y| N
Microsoft Windows Server 2019| Y| Y| Y| Y| Y 3| Y| N| Y| N
Microsoft Windows Server 2022| Y| Y| Y| Y| Y 3| Y| Y| Y| Y
Red Hat Enterprise Linux 7.7| N| N| N| Y 2| Y 4| Y| Y| Y| Y
Red Hat Enterprise Linux 7.8| N| N| N| Y 2| Y 4| Y| Y| Y| Y
Red Hat Enterprise Linux 7.9| Y| Y| Y| Y 2| Y 4| Y| Y| Y| Y
Red Hat Enterprise Linux 8.0| N| N| N| Y 2| N| Y| Y| Y| Y
Red Hat Enterprise Linux 8.1| N| N| N| Y 2| Y 4| Y| Y| Y| Y
Red Hat Enterprise Linux 8.2| Y| Y| Y| Y 2| Y 4| Y| Y| Y| Y

Operating systems

| SR650 V2| SR670 V2| SR860 V2| SR655| SR665| SR650 (Gen 2)| SR670 (Gen 2)| SR650 (Gen 1)| SR670 (Gen 1)
---|---|---|---|---|---|---|---|---|---
Red Hat Enterprise Linux 8.3| Y| Y| Y| Y| Y 3| Y| Y| Y| Y
Red Hat Enterprise Linux 8.4| Y| Y| Y| Y| Y 3| Y| Y| Y| Y
Red Hat Enterprise Linux 8.5| Y| Y| Y| Y| Y 3| Y| Y| Y| Y
Red Hat Enterprise Linux 8.6| Y| Y| Y| Y| Y 3| Y| Y| Y| Y
Red Hat Enterprise Linux 8.7| Y| Y| Y| Y| Y 3| Y| Y| Y| Y
Red Hat Enterprise Linux 9.0| Y| Y| Y| Y| Y 3| Y| Y| Y| Y
Red Hat Enterprise Linux 9.1| Y| Y| Y| Y| Y 3| Y| Y| Y| Y
SUSE Linux Enterprise Server 12 SP2| N| N| N| N| N| N| N| Y| N
SUSE Linux Enterprise Server 15| N| N| N| N| N| Y| N| Y| N
SUSE Linux Enterprise Server 15 SP1| N| N| N| Y 2| Y 4| Y| Y| Y| Y
SUSE Linux Enterprise Server 15 SP2| Y| Y| Y| Y| Y 3| Y| Y| Y| Y
SUSE Linux Enterprise Server 15 SP3| Y| Y| Y| Y| Y 3| Y| Y| Y| Y
SUSE Linux Enterprise Server 15 SP4| Y| Y| Y| Y| Y 3| Y| Y| Y| Y
Ubuntu 18.04.5 LTS| Y| Y| N| N| N| N| N| N| N
Ubuntu 20.04 LTS| Y| N| N| N| N| N| N| N| N
Ubuntu 22.04 LTS| Y| Y| Y| Y| Y 3| Y| Y| Y| Y
VMware vSphere Hypervisor (ESXi) 6.5| N| N| N| N| N| N| N| Y| N
VMware vSphere Hypervisor (ESXi) 6.5 U1| N| N| N| N| N| N| N| Y| N
VMware vSphere Hypervisor (ESXi) 6.5 U2| N| N| N| N| N| Y| N| Y| N
VMware vSphere Hypervisor (ESXi) 6.5 U3| N| N| N| Y 2| N| Y| N| Y| N
VMware vSphere Hypervisor (ESXi) 6.7| N| N| N| N| N| N| N| Y| N
VMware vSphere Hypervisor (ESXi) 6.7 U1| N| N| N| N| N| Y| N| Y| N
VMware vSphere Hypervisor (ESXi) 6.7 U2| N| N| N| N| N| Y| N| Y| N
VMware vSphere Hypervisor (ESXi) 6.7 U3| Y| Y| N| Y| Y 3| Y| Y| Y| Y
VMware vSphere Hypervisor (ESXi) 7.0| N| N| N| Y 2| Y 4| Y| Y| Y| Y
VMware vSphere Hypervisor (ESXi) 7.0 U1| N| N| Y| Y 2| Y 3| Y| Y| Y| Y
VMware vSphere Hypervisor (ESXi) 7.0 U2| Y| Y| Y| Y| Y 3| Y| Y| Y| Y
VMware vSphere Hypervisor (ESXi) 7.0 U3| Y| Y| Y| Y| Y 3| Y| Y| Y| Y
VMware vSphere Hypervisor (ESXi) 8.0| Y| Y| Y| Y| Y 3| Y| Y| Y| Y

1. ISG will not sell/preload this OS, but compatibility and cert only.
2. The OS is not supported with EPYC 7003 processors.
3. For SR665 systems with AMD EPYC 7002 “Rome” processors, the A100 is only supported under Special Bid conditions and is not supported as a field upgrade.
4.  The OS is not supported with EPYC 7003 processors. 2. For SR665 systems with AMD EPYC 7002 “Rome” processors, the A100 is only supported under Special Bid conditions and is not supported as a field upgrade.

Table 7. Operating system support for ThinkSystem NVIDIA A100 80GB PCIe Gen4 Passive GPU w/o CEC, 4X67A76715

Operating systems

| SR650 V3| SR655 V3| SR665 V3| SR650 V2| SR670 V2| SR860 V2| SR655| SR665| SR650 (Gen 2)| SR650 (Gen 1)
---|---|---|---|---|---|---|---|---|---|---
Microsoft Windows 10| Y| Y| N| N| N| N| Y 1| N| N| N
Microsoft Windows 11| Y| Y| Y| N| N| N| Y| N| N| N
Microsoft Windows Server 2016| N| N| N| Y| Y| Y| Y| Y 3| Y| Y
Microsoft Windows Server 2019| Y| Y| Y| Y| Y| Y| Y| Y 3| Y| Y
Microsoft Windows Server 2022| Y| Y| Y| Y| Y| Y| Y| Y 3| Y| Y
Red Hat Enterprise Linux 7.7| N| N| N| N| N| N| Y 2| N| Y| Y
Red Hat Enterprise Linux 7.8| N| N| N| N| N| N| Y 2| N| Y| Y
Red Hat Enterprise Linux 7.9| N| N| N| Y| Y| Y| Y 2| N| Y| Y
Red Hat Enterprise Linux 8.0| N| N| N| N| N| N| Y 2| N| Y| Y
Red Hat Enterprise Linux 8.1| N| N| N| N| N| N| Y 2| N| Y| Y
Red Hat Enterprise Linux 8.2| N| N| N| Y| Y| Y| Y 2| N| Y| Y
Red Hat Enterprise Linux 8.3| N| N| N| Y| Y| Y| Y| Y 3| Y| Y
Red Hat Enterprise Linux 8.4| N| N| N| Y| Y| Y| Y| Y 3| Y| Y
Red Hat Enterprise Linux 8.5| N| N| N| Y| Y| Y| Y| Y 3| Y| Y
Red Hat Enterprise Linux 8.6| Y| Y| Y| Y| Y| Y| Y| Y 3| Y| Y
Red Hat Enterprise Linux 8.7| Y| Y| Y| Y| Y| Y| Y| Y 3| Y| Y
Red Hat Enterprise Linux 9.0| Y| Y| Y| Y| Y| Y| Y| Y 3| Y| Y
Red Hat Enterprise Linux 9.1| Y| Y| Y| Y| Y| Y| Y| Y 3| Y| Y
SUSE Linux Enterprise Server 15 SP1| N| N| N| N| N| N| Y 2| N| Y| Y
SUSE Linux Enterprise Server 15 SP2| N| N| N| Y| Y| Y| Y| Y 3| Y| Y
SUSE Linux Enterprise Server 15 SP3| N| N| N| Y| Y| Y| Y| Y 3| Y| Y
SUSE Linux Enterprise Server 15 SP4| Y| Y| Y| Y| Y| Y| Y| Y 3| Y| Y
Ubuntu 18.04.5 LTS| N| N| N| Y| Y| N| N| N| N| N
Ubuntu 20.04 LTS| N| N| N| Y| N| N| N| N| N| N
Ubuntu 20.04.5 LTS| N| Y| Y| N| N| N| N| N| N| N
Ubuntu 22.04 LTS| Y| Y| Y| Y| Y| Y| Y| Y 3| Y| Y
VMware vSphere Hypervisor (ESXi) 6.5| N| N| N| N| N| N| N| N| N| Y
VMware vSphere Hypervisor (ESXi) 6.5 U1| N| N| N| N| N| N| N| N| N| Y
VMware vSphere Hypervisor (ESXi) 6.5 U2| N| N| N| N| N| N| N| N| Y| Y
VMware vSphere Hypervisor (ESXi) 6.5 U3| N| N| N| N| N| N| Y 2| N| Y| Y
VMware vSphere Hypervisor (ESXi) 6.7| N| N| N| N| N| N| N| N| N| Y
VMware vSphere Hypervisor (ESXi) 6.7 U1| N| N| N| N| N| N| N| N| Y| Y
VMware vSphere Hypervisor (ESXi) 6.7 U2| N| N| N| N| N| N| N| N| Y| Y
VMware vSphere Hypervisor (ESXi) 6.7 U3| N| N| N| Y| Y| N| Y| Y 3| Y| Y
VMware vSphere Hypervisor (ESXi) 7.0| N| N| N| N| N| N| Y 2| N| Y| Y

Operating systems

| SR650 V3| SR655 V3| SR665 V3| SR650 V2| SR670 V2| SR860 V2| SR655| SR665| SR650 (Gen 2)| SR650 (Gen 1)
---|---|---|---|---|---|---|---|---|---|---
VMware vSphere Hypervisor (ESXi) 7.0 U1| N| N| N| N| N| Y| Y 2| Y 3| Y| Y
VMware vSphere Hypervisor (ESXi) 7.0 U2| N| N| N| Y| Y| Y| Y| Y 3| Y| Y
VMware vSphere Hypervisor (ESXi) 7.0 U3| Y| Y| Y| Y| Y| Y| Y| Y 3| Y| Y
VMware vSphere Hypervisor (ESXi) 8.0| Y| Y| Y| Y| Y| Y| Y| Y 3| Y| Y

1. ISG will not sell/preload this OS, but compatibility and cert only.
2. The OS is not supported with EPYC 7003 processors.
3. HW is not supported with EPYC 7002 processors.

NVIDIA GPU software

This section lists the NVIDIA software that is available from Lenovo.

• NVIDIA vGPU Software (vApps, vPC, RTX vWS, and vCS)
• VIDIA Omniverse Software (OVE)
• NVIDIA AI Enterprise Software (NVAIE)
• NVIDIA HPC Compiler Software

NVIDIA vGPU Software (vApps, vPC, RTX vWS, and vCS)
Lenovo offers the following virtualization software for NVIDIA GPUs:

• Virtual Applications (vApps)
  For organizations deploying Citrix XenApp, VMware Horizon RDSH or other RDSH solutions. Designed to deliver PC Windows applications at full performance. NVIDIA Virtual Applications allows users to access any Windows application at full performance on any device, anywhere. This edition is suited for users who would like to virtualize applications using XenApp or other RDSH solutions. Windows Server hosted RDSH desktops are also supported by vApps.

• Virtual PC (vPC)
  This product is ideal for users who want a virtual desktop but need great user experience leveraging PC Windows® applications, browsers and high-definition video. NVIDIA Virtual PC delivers a native experience to users in a virtual environment, allowing them to run all their PC applications at full performance.

• NVIDIA RTX Virtual Workstation (RTX vWS)
  NVIDIA RTX vWS is the only virtual workstation that supports NVIDIA RTX technology, bringing advanced features like ray tracing, AI-denoising, and Deep Learning Super Sampling (DLSS) to a virtual environment. Supporting the latest generation of NVIDIA GPUs unlocks the best performance possible, so designers and engineers can create their best work faster. IT can virtualize any application from the data center with an experience that is indistinguishable from a
  physical workstation — enabling workstation performance from any device.

• Virtual Compute Server (vCS)
  NVIDIA Virtual Compute Server (vCS) enables data centers running on Red Hat Enterprise Linux, Red Hat Virtualization, and other supported KVM-based hypervisors to accelerate server virtualization with the latest NVIDIA data center GPUs, including NVIDIA A100 Tensor Core GPU and A30, so that the most compute-intensive workloads, such as artificial intelligence, deep learning, and data science, can be run in a virtual machine (VM) powered by NVIDIA vGPU technology.

The following license types are offered:

• Perpetual license
  A non-expiring, permanent software license that can be used on a perpetual basis without the need to renew. Each Lenovo part number includes a fixed number of years of Support, Upgrade and Maintenance (SUMS).

• Annual subscription
  A software license that is active for a fixed period as defined by the terms of the subscription license, typically yearly. The subscription includes Support, Upgrade and Maintenance (SUMS) for the duration of the license term.

• Concurrent User (CCU)
  A method of counting licenses based on active user VMs. If the VM is active and the NVIDIA GRID vGPU software is running, then this counts as one CCU. A vGPU CCU is independent of the connection to the VM.

The following table lists the ordering part numbers and feature codes.

Table 8. NVIDIA vGPU Software

NVIDIA vApps
7S020003WW| B1MP| NVIDIA vApps Perpetual License and SUMS 5Yr, 1 CCU
7S020004WW| B1MQ| NVIDIA vApps Subscription License 1 Year, 1 CCU
7S020005WW| B1MR| NVIDIA vApps Subscription License 3 Years, 1 CCU
7S02003DWW| S832| NVIDIA vApps Subscription License 4 Years, 1 CCU
7S02003EWW| S833| NVIDIA vApps Subscription License 5 Years, 1 CCU
NVIDIA vPC
7S020009WW| B1MV| NVIDIA vPC Perpetual License and SUMS 5Yr, 1 CCU
7S02000AWW| B1MW| NVIDIA vPC Subscription License 1 Year, 1 CCU
7S02000BWW| B1MX| NVIDIA vPC Subscription License 3 Years, 1 CCU
7S02003FWW| S834| NVIDIA vPC Subscription License 4 Years, 1 CCU
7S02003GWW| S835| NVIDIA vPC Subscription License 5 Years, 1 CCU
NVIDIA RTX vWS
7S02000FWW| B1N1| NVIDIA RTX vWS Perpetual License and SUMS 5Yr, 1 CCU
7S02000GWW| B1N2| NVIDIA RTX vWS Subscription License 1 Year, 1 CCU
7S02000HWW| B1N3| NVIDIA RTX vWS Subscription License 3 Years, 1 CCU
7S02000LWW| B1N6| NVIDIA RTX vWS EDU Perpetual License and SUMS 5Yr, 1 CCU
7S02000MWW| B1N7| NVIDIA RTX vWS EDU Subscription License 1 Year, 1 CCU
7S02000NWW| B1N8| NVIDIA RTX vWS EDU Subscription License 3 Years, 1 CCU
7S02003BWW| S830| NVIDIA RTX vWS EDU Subscription License 4 Years, 1 CCU
Part number| Feature code| Description
---|---|---
7S02003CWW| S831| NVIDIA RTX vWS EDU Subscription License 5 Years, 1 CCU
7S02000XWW| S6YJ| NVIDIA RTX vWS Subscription License 4 Years, 1 CCU
7S02000YWW| S6YK| NVIDIA RTX vWS Subscription License 5 Years, 1 CCU
NVIDIA vCS
7S02000ZWW| S6YL| NVIDIA Virtual Compute Server Subscription, 1 GPU (Max 10 CC VMs), 1 Year
7S020010WW| S6YM| NVIDIA Virtual Compute Server Subscription, 1 GPU (Max 10 CC VMs), 3 Years
7S020011WW| S6YN| NVIDIA Virtual Compute Server Subscription, 1 GPU (Max 10 CC VMs), 5 Years
7S020012WW| S6YP| NVIDIA Virtual Compute Server Subscription, 1 GPU (Max 10 CC VMs), EDU, 1 Year
7S020013WW| S6YQ| NVIDIA Virtual Compute Server Subscription, 1 GPU (Max 10 CC VMs), EDU, 3 Years
7S020014WW| S6YR| NVIDIA Virtual Compute Server Subscription, 1 GPU (Max 10 CC VMs), EDU, 5 Years

NVIDIA Omniverse Software (OVE)

Lenovo offers the following NVIDIA Omniverse Software software. 3D workflows are now an essential component of every industry. Efficient design collaboration between teams is crucial. NVIDIA Omniverse™ Enterprise is an end-to-end collaboration and simulation platform that fundamentally transforms complex design workflows, creating a more harmonious environment for creative teams.

• NVIDIA Omniverse Enterprise Nucleus
  Collaboration service which enables a variety of Omniverse Enterprise-enabled client applications (Apps, Connectors, and others) to share and modify authoritative representations of virtual worlds in USD. Omniverse Nucleus is built for collaboration across multiple users. Omniverse Nucleus is the database and collaboration engine of Omniverse.
  Includes:

  • Collaboration and scalable core microservices deployed on servers and/or workstations.
  • Nucleus Workstation
  • Enterprise Nucleus Server
  • NVIDIA Enterprise Support
    Note: The Omniverse Enterprise Nucleus Subscription is priced and licensed per named user.

• NVIDIA Omniverse Enterprise Creator
  App for accelerated advanced scene composition and world building. Creator enables scene composition, simulation, and rendering on workstations and virtual workstations.
  Includes:

  • Omniverse Create
  • Omniverse Kit
  • Omniverse Extensions
  • Batch microservices (on up to 64 GPUs)
  • NVIDIA Enterprise Support

Note: Collaboration via Nucleus requires a Nucleus subscription.

• NVIDIA Omniverse Enterprise Reviewer
  Simple app designed to visualize projects in stunning, physically accurate photorealism and enable minor editing and comment permissions. Reviewer enables review and approval for workstations and virtual workstations.
  Includes:

  • Omniverse View
  • NVIDIA Enterprise Support

Note: Editing and commenting via Nucleus requires a Nucleus subscription.

The following license types are offered:

• Concurrent User (CCU) License
  A method of allocating licenses based on the number of users that are concurrently using the software. As an example, one CCU license allows only one concurrent user to use the software.

• Floating User License
  For licensing, same as Concurrent User License.

• Named User License
  A method of licensing based on the number of named authorized users who may not re-assign or share the license with any other person.

• Subscription
  A software license that is active for a fixed period as defined by the terms of the subscription. An annual subscription includes SUMS for the duration of the license term.

The following table lists the ordering part numbers and feature codes.

Table 9. NVIDIA Omniverse Software (OVE)

Omniverse Enterprise Nucleus
7S02002MWW| S82A| NVIDIA Omniverse Enterprise Nucleus Subscription per Named User, 1 Year
7S02002NWW| S82B| NVIDIA Omniverse Enterprise Nucleus Subscription per Named User, 3 Years
7S02002PWW| S82C| NVIDIA Omniverse Enterprise Nucleus Subscription per Named User, 4 Years
7S02002QWW| S82D| NVIDIA Omniverse Enterprise Nucleus Subscription per Named User, 5 Years
7S02002RWW| S82E| NVIDIA Omniverse Enterprise Nucleus Subscription per Named User, EDU, 1 Year
7S02002SWW| S82F| NVIDIA Omniverse Enterprise Nucleus Subscription per Named User, EDU, 3 Years
7S02002TWW| S82G| NVIDIA Omniverse Enterprise Nucleus Subscription per Named User, EDU, 4 Years
7S02002UWW| S82H| NVIDIA Omniverse Enterprise Nucleus Subscription per Named User, EDU, 5 Years
Omniverse Enterprise Creator
7S02002VWW| S82J| NVIDIA Omniverse Enterprise Creator Subscription per CCU, 1 Year
7S02002WWW| S82K| NVIDIA Omniverse Enterprise Creator Subscription per CCU, 3 Years
7S02002XWW| S82L| NVIDIA Omniverse Enterprise Creator Subscription per CCU, 4 Years
7S02002YWW| S82M| NVIDIA Omniverse Enterprise Creator Subscription per CCU, 5 Years
7S02002ZWW| S82N| NVIDIA Omniverse Enterprise Creator Subscription per CCU, EDU, 1 Year
7S020030WW| S82P| NVIDIA Omniverse Enterprise Creator Subscription per CCU, EDU, 3 Years
7S020031WW| S82Q| NVIDIA Omniverse Enterprise Creator Subscription per CCU, EDU, 4 Years
7S020032WW| S82R| NVIDIA Omniverse Enterprise Creator Subscription per CCU, EDU, 5 Years
Omniverse Enterprise Reviewer
7S020033WW| S82S| NVIDIA Omniverse Enterprise Reviewer Subscription per CCU, 1 Year
7S020034WW| S82T| NVIDIA Omniverse Enterprise Reviewer Subscription per CCU, 3 Years
7S020035WW| S82U| NVIDIA Omniverse Enterprise Reviewer Subscription per CCU, 4 Years
7S020036WW| S82V| NVIDIA Omniverse Enterprise Reviewer Subscription per CCU, 5 Years
7S020037WW| S82W| NVIDIA Omniverse Enterprise Reviewer Subscription per CCU, EDU, 1 Year
7S020038WW| S82X| NVIDIA Omniverse Enterprise Reviewer Subscription per CCU, EDU, 3 Years
7S020039WW| S82Y| NVIDIA Omniverse Enterprise Reviewer Subscription per CCU, EDU, 4 Years
7S02003AWW| S82Z| NVIDIA Omniverse Enterprise Reviewer Subscription per CCU, EDU, 5 Years

NVIDIA AI Enterprise Software (NVAIE)
Lenovo offers the NVIDIA AI Enterprise cloud-native enterprise software. NVIDIA AI Enterprise is an end-to-end, cloud-native suite of  AI and data analytics software, optimized, certified, and supported by NVIDIA to run on VMware vSphere and bare-metal  with NVIDIA-Certified  Systems™.  It includes key enabling technologies from NVIDIA for rapid deployment, management, and scaling of AI workloads in the modern hybrid cloud. NVIDIA AI Enterprise is licensed on a per-CPU Socket basis and can be purchased through the Power of 2 partnership between Lenovo and NVIDIA.

NVIDIA AI Enterprise products can be purchased as either a perpetual license with support services, or as an annual or multi-year subscription.

• The perpetual license provides the right to use the NVIDIA AI Enterprise software indefinitely, with no expiration. NVIDIA AI Enterprise with perpetual licenses must be purchased in conjunction with one-year, three-year, or five-year support services. A one-year support service is also available for renewals.
• The subscription offerings are an affordable option to allow IT departments to better manage the flexibility of license volumes. NVIDIA AI Enterprise software products with subscription includes support services for the duration of the software’s subscription license
• The features of NVIDIA AI Enterprise Software are listed in the following table.

Table 10. Features of NVIDIA AI Enterprise Software (NVAIE)

Note: Maximum 10 concurrent VMs per product license The following table lists the ordering part numbers and feature codes.

Table 11. NVIDIA AI Enterprise Software (NVAIE)

AI Enterprise Perpetual License
7S020019WW| S6YW| NVIDIA AI Enterprise Perpetual License and Support per CPU Socket, 1 Year
7S02001AWW| S6YX| NVIDIA AI Enterprise Perpetual License and Support per CPU Socket, 3 Years
7S02001BWW| S6YY| NVIDIA AI Enterprise Perpetual License and Support per CPU Socket, 5 Years
7S02001CWW| S6YZ| NVIDIA AI Enterprise Perpetual License and Support per CPU Socket, EDU, 1 Year
7S02001DWW| S6Z0| NVIDIA AI Enterprise Perpetual License and Support per CPU Socket, EDU, 3 Years
Part number| Feature code| Description
---|---|---
7S02001EWW| S6Z1| NVIDIA AI Enterprise Perpetual License and Support per CPU Socket, EDU, 5 Years
AI Enterprise Subscription License
7S02001FWW| S6Z2| NVIDIA AI Enterprise Subscription License and Support per CPU Socket, 1 Year
7S02001GWW| S6Z3| NVIDIA AI Enterprise Subscription License and Support per CPU Socket, 3 Years
7S02001HWW| S6Z4| NVIDIA AI Enterprise Subscription License and Support per CPU Socket, 5 Years
7S02001JWW| S6Z5| NVIDIA AI Enterprise Subscription License and Support per CPU Socket, EDU, 1 Year
7S02001KWW| S6Z6| NVIDIA AI Enterprise Subscription License and Support per CPU Socket, EDU, 3 Years
7S02001LWW| S6Z7| NVIDIA AI Enterprise Subscription License and Support per CPU Socket, EDU, 5 Years

Find more information in the NVIDIA AI Enterprise Sizing Guide.

NVIDIA HPC Compiler Software

Table 12. NVIDIA HPC Compiler

HPC Compiler Support Services
7S090014WW| S924| NVIDIA HPC Compiler Support Services, 1 Year
7S090015WW| S925| NVIDIA HPC Compiler Support Services, 3 Years
7S09002GWW| S9UQ| NVIDIA HPC Compiler Support Services, 5 Years
7S090016WW| S926| NVIDIA HPC Compiler Support Services, EDU, 1 Year
7S090017WW| S927| NVIDIA HPC Compiler Support Services, EDU, 3 Years
7S09002HWW| S9UR| NVIDIA HPC Compiler Support Services, EDU, 5 Years
7S090018WW| S928| NVIDIA HPC Compiler Support Services – Additional Contact, 1 Year
7S09002JWW| S9US| NVIDIA HPC Compiler Support Services – Additional Contact, 3 Years
7S09002KWW| S9UT| NVIDIA HPC Compiler Support Services – Additional Contact, 5 Years
7S090019WW| S929| NVIDIA HPC Compiler Support Services – Additional Contact, EDU, 1 Year
7S09002LWW| S9UU| NVIDIA HPC Compiler Support Services – Additional Contact, EDU, 3 Years
7S09002MWW| S9UV| NVIDIA HPC Compiler Support Services – Additional Contact, EDU, 5 Years
HPC Compiler Premier Support Services
7S09001AWW| S92A| NVIDIA HPC Compiler Premier Support Services, 1 Year
7S09002NWW| S9UW| NVIDIA HPC Compiler Premier Support Services, 3 Years
7S09002PWW| S9UX| NVIDIA HPC Compiler Premier Support Services, 5 Years
7S09001BWW| S92B| NVIDIA HPC Compiler Premier Support Services, EDU, 1 Year
7S09002QWW| S9UY| NVIDIA HPC Compiler Premier Support Services, EDU, 3 Years
7S09002RWW| S9UZ| NVIDIA HPC Compiler Premier Support Services, EDU, 5 Years
7S09001CWW| S92C| NVIDIA HPC Compiler Premier Support Services – Additional Contact, 1 Year
Part number| Feature code| Description
---|---|---
7S09002SWW| S9V0| NVIDIA HPC Compiler Premier Support Services – Additional Contact, 3 Years
7S09002TWW| S9V1| NVIDIA HPC Compiler Premier Support Services – Additional Contact, 5 Years
7S09001DWW| S92D| NVIDIA HPC Compiler Premier Support Services – Additional Contact, EDU, 1 Year
7S09002UWW| S9V2| NVIDIA HPC Compiler Premier Support Services – Additional Contact, EDU, 3 Years
7S09002VWW| S9V3| NVIDIA HPC Compiler Premier Support Services – Additional Contact, EDU, 5 Years

Auxiliary power cables

The power cables needed for the A100 SXM GPUs are included with the supported servers. The A100 PCIe adapter option part number do not ship with auxiliary power cables. Cables are server-specific due to length requirements. For CTO orders, auxiliary power cables are derived by the configurator. For field upgrades, cables will need to be ordered separately as listed in the table below.

Table 13. Auxiliary power cables for A100 (click images to show larger versions)

Regulatory approvals

The NVIDIA A100 GPU has the following regulatory approvals:

• RCM
• BSMI
• CE
• FCC
• ICES
• KCC
• cUL, UL
• VCCI

Operating environment

The NVIDIA A100 GPU has the following operating characteristics:

• Ambient temperature
  • Operational: 0°C to 50°C (-5°C to 55°C for short term*)
  • Storage: -40°C to 75°C
• Relative humidity:
  • Operational: 5-85% (5-93% short term*)
  • Storage: 5-95%

A period not more than 96 hours consecutive, not to exceed 15 days per year.

Warranty

One year limited warranty. When installed in a Lenovo server, the GPU assumes the server’s base warranty and any warranty upgrades.

Related publications
For more information, refer to these documents:

• ThinkSystem and ThinkAgile GPU Summary:
  https://lenovopress.lenovo.com/lp0768-thinksystem-thinkagile-gpu-summary

• ServerProven compatibility:
  https://serverproven.lenovo.com/

• NVIDIA A100 product page:
  https://www.nvidia.com/en-us/data-center/a100/

• NVIDIA Ampere Architecture page
  https://www.nvidia.com/en-us/data-center/ampere-architecture/

Related product families
Product families related to this document are the following:

• GPU adapters

Notices

Lenovo may not offer the products, services, or features discussed in this document in all countries. Consult your local Lenovo representative for information on the products and services currently available in your area. Any reference to a Lenovo product, program, or service is not intended to state or imply that only that Lenovo product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any Lenovo intellectual property right may be used instead. However, it is the user’s responsibility to evaluate and verify the operation of any other product, program, or service. Lenovo may have patents or pending patent applications covering subject matter described in this document. The furnishing of this document does not give you any license to these patents. You can send license inquiries, in writing, to:

• Lenovo (United States), Inc.
• 8001 Development Drive
• Morrisville, NC 27560
• U.S.A.

Attention: Lenovo Director of Licensing
LENOVO PROVIDES THIS PUBLICATION ”AS IS” WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some jurisdictions do not allow disclaimer of express or implied warranties in certain transactions, therefore, this statement may not apply to you.
This information could include technical inaccuracies or typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in new editions of the publication. Lenovo may make improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time without notice. The products described in this document are not intended for use in implantation or other life support applications where malfunction may result in injury or death to persons. The information contained in this document does not affect or change Lenovo product specifications or warranties. Nothing in this document shall operate as an express or implied license or indemnity under the intellectual property rights of Lenovo or third parties. All information contained in this document was obtained in specific environments and is presented as an illustration. The result obtained in other operating environments may vary. Lenovo may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you.

Any references in this publication to non-Lenovo Web sites are provided for convenience only and do not in any manner serve as an endorsement of those Web sites. The materials at those Web sites are not part of the materials for this Lenovo product, and use of those Web sites is at your own risk. Any performance data contained herein was determined in a controlled environment. Therefore, the result obtained in other operating environments may vary significantly. Some measurements may have been made on development-level systems and there is no guarantee that these measurements will be the same on generally available systems. Furthermore, some measurements may have been estimated through extrapolation. Actual results may vary. Users of this document should verify the applicable data for their specific environment.

• Copyright Lenovo 2023. All rights reserved. This document, LP1734, was created or updated on May 8, 2023. Send us your comments in one of the following ways:
  • Use the online Contact us review form found at: https://lenovopress.lenovo.com/LP1734
  • Send your comments in an e-mail to: [email protected]
• This document is available online at https://lenovopress.lenovo.com/LP1734.

Trademarks
Lenovo and the Lenovo logo are trademarks or registered trademarks of Lenovo in the United States, other countries, or both. A current list of Lenovo trademarks is available on the Web at
https://www.lenovo.com/us/en/legal/copytrade/.

The following terms are trademarks of Lenovo in the United States, other countries, or both:

• Lenovo®
• ServerProven®
• ThinkAgile®
• ThinkSystem®

The following terms are trademarks of other companies: Intel® is a trademark of Intel Corporation or its subsidiaries. Linux® is the trademark of Linus Torvalds in the U.S. and other countries. Microsoft®, Windows Server®, and Windows® are trademarks of Microsoft Corporation in the United States, other countries, or both. Other company, product, or service names may be trademarks or service marks of others.

References

• ThinkSystem NVIDIA A100 PCIe 4.0 Passive GPU Product Guide > Lenovo Press
• ThinkSystem NVIDIA A100 PCIe 4.0 Passive GPU > Lenovo Press
• Welcome | ServerProven
• Copyright and Trademark Information | Lenovo US | Lenovo US
• Welcome | ServerProven
• NVIDIA A100 | NVIDIA

Read User Manual Online (PDF format)

Download This Manual (PDF format)

Download this manual  >>