Lenovo 4X67A90669 ThinkSystem NVIDIA L40S 48GB PCIe Gen4 Passive GPU User Guide

**Lenovo 4X67A90669 ThinkSystem NVIDIA L40S 48GB PCIe Gen4 Passive GPU User Guide

**

ThinkSystem NVIDIA L40S 48GB PCIe Gen4 Passive GPU

The Think System NVIDIA L40S 48GB PCIe Gen4 Passive GPU based on the Ada Lovelace architecture, is
a powerful universal GPU for the data center, delivering breakthrough multi- workload acceleration for large
language model (LLM) inference and training, graphics, and video applications. As the premier platform for multi-modal generative AI, the L40S GPU provides end-to-end acceleration for inference, training, graphics, and video workflows to power the next generation of AI-enabled audio, speech, 2D, video, and 3D applications.

The following figure shows the ThinkSystem NVIDIA L40S 48GB PCIe Gen4 Passive GPU.

Figure 1. ThinkSystem NVIDIA L40S 48GB PCIe Gen4 Passive GPU

Did you know?

AI models are exploding in complexity and popularity with the disruption led by large language models (LLMs) such as ChatGPT and generative AI diffusion models. L40S’s fourth-generation Tensor Cores with the Transformer Engine and new FP8 data format enable AI performance that exceeds the NVIDIA A100 Tensor Core GPUs for many AI training and inference workloads.

Part number information

The following table shows the ordering information for the NVIDIA L40S GPU.

Table 1. Ordering information

The option part number includes the following:

• One NVIDIA L40S GPU with full-height (3U) adapter bracket attached
• Documentation

Features

Generative AI is fueling transformative change, unlocking a new frontier of opportunities for enterprises across every industry. To transform with AI, enterprises need more compute resources, greater scale, and a broad set of capabilities to meet the demands of an ever-increasing set of diverse and complex workloads.

The NVIDIA L40S GPU is the most powerful universal GPU for the data center, delivering end-to-end acceleration for the next generation of AI-enabled applications—from generative AI and model training and inference to 3D graphics, rendering, and video applications.

Enterprises are looking to use mainstream infrastructure to satisfy their compute needs, but training state of the-art models requires massive compute capability. For LLM models, eight L40S’s in mainstream servers bring up to 1.7X the training performance of an NVIDIA HGX™ A100 8-GPU system, giving enterprises fast time to solution with traditional infrastructure. When compared to the A100 80GB SXM for inference, the L40S delivers up to 1.2X more generative AI inference performance using Stable Diffusion and up to 1.5X inference performance on popular networks, such as those included within the MLPerf benchmark.

Key use cases of the NVIDIA L40S GPU:

Generative AI
The AI, graphics, and media acceleration capabilities of the L40S GPU make it the premier platform for multi-modal generative AI pipelines. With powerful inferencing capabilities, combined with NVIDIA RTX™-accelerated ray tracing and dedicated encode and decode engines, the L40S accelerates AIenabled audio, speech, 2D, video, and 3D generative AI applications.

For image generative AI inference, the L40S GPU delivers more than 5X higher performance than the previous-generation NVIDIA A40 GPU and 1.2X more performance than the HGX A100. This breakthrough performance, combined with 48GB of memory capacity, makes the L40S GPU the ideal generative AI platform for high-quality images and immersive visual content.

LLM Inference and Training
Accelerate training, fine tuning, and inference workloads with powerful throughput and floating-point performance to build and deploy state-of-the-art AI models. Powerful NVIDIA-Certified Systems™ with eight L40 GPUs can train foundational models with up to 175 billion parameters to convergence and accelerate fine-tuning and retraining of existing large-scale models to adapt them for new tasks.

Combining NVIDIA’s full stack of inference serving software with the compute capabilities of the L40S provides a powerful platform for trained models ready for inference. With support for structural sparsity and a broad range of precisions, including TF32, INT8, and FP8, the L40S delivers over 1 petaFLOPS of inference operation performance, delivering actionable insights with speed and precision.

AI-Ready Development Platform with NVIDIA AI Enterprise
Enterprise adoption of AI is now mainstream and leading to an increased demand for skilled AI developers and data scientists. Organizations require a flexible, high-performance platform consisting of optimized hardware and software to maximize productivity and accelerate AI development.

NVIDIA AI Enterprise is an end-to-end, enterprise-grade AI software platform that offers 100+  frameworks, pretrained models, and libraries to streamline development and deployment of production AI, including generative AI, computer vision, and speech AI. Optimized and certified for reliable performance, NVIDIA AI Enterprise, together with the L40S, provides a unified platform to develop applications once and deploy anywhere, reducing the risks involved with moving from pilot to production.

Rendering and 3D Graphics
Running professional 3D visualization applications with NVIDIA L40S enables creative professionals to iterate more, render faster, and unlock tremendous performance advantages that increase productivity and speed up project completion. The NVIDIA L40S’s third-generation RT Cores and industry-leading 48GB of GDDR6 memory deliver up to 2X the real-time ray-tracing performance of the previous generation.

With these capabilities, artists and designers can work with complex geometry and high-resolution textures in real time to generate photorealistic designs and power full-fidelity creative workflows, from interactive rendering to virtual production.

NVIDIA Omniverse
NVIDIA Omniverse is a multi-GPU-enabled open platform for Universal Scene Description (USD)- based collaboration and real-time photorealistic simulation. The full-stack platform based on USD and NVIDIA RTX is the powerful culmination of NVIDIA’s core graphics, compute, and AI technologies. NVIDIA L40S GPUs bring powerful AI and RTX capabilities to accelerate 3D content creation and industrial digitalization.

For the most complex Omniverse workloads like extended reality (XR), multi- user design collaboration, and digital twins, the NVIDIA L40S enables ray- traced and path-traced rendering of materials, physically accurate simulations, and generation of photorealistic 3D synthetic data.

Streaming and Video Content
The NVIDIA L40S takes streaming and video content workloads to the next level, delivering breakthrough media acceleration capabilities with three video encode and three video decode engines. With the addition of AV1 encoding, the L40S delivers up to 2X the performance and improved TCO for broadcast streaming, video production, and transcription workloads.

Virtual Workstations
When combined with NVIDIA RTX Virtual Workstation (vWS) software, the NVIDIA L40S can be virtualized to deliver high-performance workstation instances to remote users for high-end design, AI, and compute workloads. With 48GB of GPU memory, the NVIDIA L40S with vWS enables flexible, work-from-anywhere solutions for GPU memory-intensive workloads.

Technical specifications

The NVIDIA L40S GPU has the following specifications:

• Form factor
  • PCIe Full Height Full Length adapter (4.4-in x 10.5-in), Double-width (dual slot)
  • NVIDIA Form Factor
• Host interface:
  • PCIe 4.0 x16
  • MSI-X interrupt messaging protocol (MSI not supported)
  • PCIe Lane Polarity Inversion and Lane Reversal
• Single Root I/O Virtualization (SR-IOV) support
  • 256 virtual functions (VFs)
  • ARI Forwarding
• Hardware Root of Trust
  • Secure boot
  • Secure firmware upgrade
  • Firmware rollback protection
  • Support for in-band firmware update disable (established after each GPU reset)
  • Secure application processor recovery

The following table lists the GPU processing specifications and performance of the NVIDIA L40S  GPU.

Table 2. Specifications of the NVIDIA L40S GPU

displays @ 60Hz (requires DisplayPort 1.4 DSC); Each display port can support 4K at 120 Hz with 30-bit color
Graphics APIs| DirectX 12 Ultimate, Shader Model 6.6, OpenGL 4.6, Vulkan 1.3
Compute APIs| CUDA 12.0, Direct Compute, OpenCL 3.0

• With structural sparsity enabled

Server support
The following tables list the ThinkSystem servers that are compatible.

Table 3. Server support (Part 1 of 3)

Part Number| Description| Edge| 1S Intel V2| AMD V3| Intel V3
---|---|---|---|---|---
SE350 (7Z46 / 7D1X)| SE350 V2 (7DA9)| SE360 V2 (7DAM)| SE450 (7D8T)| ST50 V2 (7D8K / 7D8J)| ST250 V2 (7D8G / 7D8F)| SR250 V2 (7D7R / 7D7Q)| SR635 V3 (7D9H / 7D9G)| SR655 V3 (7D9F / 7D9E)| SR645 V3 (7D9D / 7D9C)| SR665 V3 (7D9B / 7D9A)| SR675 V3 (7D9Q / 7D9R)| ST650 V3 (7D7B / 7D7A)| SR630 V3 (7D72 / 7D73)| SR650 V3 (7D75 / 7D76)| SR850 V3 (7D97 / 7D96)| SR860 V3 (7D94 / 7D93)| SR950 V3 (7DC5 / 7DC4)
4X67A90669| ThinkSystem NVIDIA L40S 48GB PCIe Gen4 Passive GPU| N| N| N| N| N| N| N| N| N| N| N| 8| N| N| N| N| N| N

Table 4. Server support (Part 2 of 3)

Part Number| Description| Dense V3| 2S Intel V2| AMD V1| Dense V2| 4S V2| 8S
---|---|---|---|---|---|---|---
SD665 V3 (7D9P)| SD665-N V3 (7DAZ)| SD650 V3 (7D7M)| SD650-I V3 (7D7L)| ST650 V2 (7Z75 / 7Z74)| SR630 V2 (7Z70 / 7Z71)| SR650 V2 (7Z72 / 7Z73)| SR670 V2 (7Z22 / 7Z23)| SR635 (7Y98 / 7Y99)| SR655 (7Y00 / 7Z01)| SR655 Client OS| SR645 (7D2Y / 7D2X)| SR665 (7D2W / 7D2V)| SD630 V2 (7D1K)| SD650 V2 (7D1M)| SD650-N V2 (7D1N)| SN550 V2 (7Z69)| SR850 V2 (7D31 / 7D32)| SR860 V2 (7Z59 / 7Z60)| SR950 (7X11 / 7X12)
4X67A90669| ThinkSystem NVIDIA L40S 48GB PCIe Gen4 Passive GPU| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N

Table 5. Server support (Part 3 of 3)

Part Number| Description| 4S V1| 1S Intel V1| 2S Intel V1| Dense V1
---|---|---|---|---|---
SR850 (7X18 / 7X19)| SR850P (7D2F / 2D2G)| SR860 (7X69 / 7X70)| ST50 (7Y48 / 7Y50)| ST250 (7Y45 / 7Y46)| SR150 (7Y54)| SR250 (7Y52 / 7Y51)| ST550 (7X09 / 7X10)| SR530 (7X07 / 7X08)| SR550 (7X03 / 7X04)| SR570 (7Y02 / 7Y03)| SR590 (7X98 / 7X99)| SR630 (7X01 / 7X02)| SR650 (7X05 / 7X06)| SR670 (7Y36 / 7Y37)| SD530 (7X21)| SD650 (7X58)| SN550 (7X16)| SN850 (7X15)
4X67A90669| ThinkSystem NVIDIA L40S 48GB PCIe Gen4 Passive GPU| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N| N

NVIDIA GPU software

This section lists the NVIDIA software that is available from Lenovo.

• NVIDIA vGPU Software (vApps, vPC, RTX vWS, and vCS)
• NVIDIA Omniverse Software (OVE)
• NVIDIA AI Enterprise Software
• NVIDIA HPC Compiler Software

NVIDIA vGPU Software (vApps, vPC, RTX vWS, and vCS)
Lenovo offers the following virtualization software for NVIDIA GPUs:

• Virtual Applications (vApps)
  For organizations deploying Citrix XenApp, VMware Horizon RDSH or other RDSH solutions. Designed to deliver PC Windows applications at full performance. NVIDIA Virtual Applications allows users to access any Windows application at full performance on any device, anywhere. This edition is suited for users who would like to virtualize applications using XenApp or other RDSH solutions. Windows Server hosted RDSH desktops are also supported by vApps.

• Virtual PC (vPC)
  This product is ideal for users who want a virtual desktop but need great user experience leveraging PC Windows® applications, browsers and high-definition video. NVIDIA Virtual PC delivers a native experience to users in a virtual environment, allowing them to run all their PC applications at full performance.

• NVIDIA RTX Virtual Workstation (RTX vWS)
  NVIDIA RTX vWS is the only virtual workstation that supports NVIDIA RTX technology, bringing advanced features like ray tracing, AI-denoising, and Deep Learning Super Sampling (DLSS) to a virtual environment. Supporting the latest generation of NVIDIA GPUs unlocks the best performance possible, so designers and engineers can create their best work faster. IT can virtualize any application from the data center with an experience that is indistinguishable from a physical workstation — enabling workstation performance from any device.

• Virtual Compute Server (vCS)
  NVIDIA Virtual Compute Server (vCS) enables data centers running on Red Hat Enterprise Linux, Red Hat Virtualization, and other supported KVM-based hypervisors to accelerate server virtualization with the latest NVIDIA data center GPUs, so that the most compute-intensive workloads, such as artificial intelligence, deep learning, and data science, can be run in a virtual machine (VM) powered by NVIDIA vGPU technology.

The following license types are offered:

• Perpetual license
  A non-expiring, permanent software license that can be used on a perpetual basis without the need to renew. Each Lenovo part number includes a fixed number of years of Support, Upgrade and Maintenance (SUMS).

• Annual subscription
  A software license that is active for a fixed period as defined by the terms of the subscription license, typically yearly. The subscription includes Support, Upgrade and Maintenance (SUMS) for the duration of the license term.

• Concurrent User (CCU)
  A method of counting licenses based on active user VMs. If the VM is active and the NVIDIA GRID vGPU software is running, then this counts as one CCU. A vGPU CCU is independent of the connection to the VM.

The following table lists the ordering part numbers and feature codes.

Table 6. NVIDIA vGPU Software

NVIDIA vApps
7S020003WW| B1MP| NVIDIA vApps Perpetual License and SUMS 5Yr, 1 CCU
7S020004WW| B1MQ| NVIDIA vApps Subscription License 1 Year, 1 CCU
7S020005WW| B1MR| NVIDIA vApps Subscription License 3 Years, 1 CCU
7S02003DWW| S832| NVIDIA vApps Subscription License 4 Years, 1 CCU
7S02003EWW| S833| NVIDIA vApps Subscription License 5 Years, 1 CCU
NVIDIA vPC
7S020009WW| B1MV| NVIDIA vPC Perpetual License and SUMS 5Yr, 1 CCU
7S02000AWW| B1MW| NVIDIA vPC Subscription License 1 Year, 1 CCU
7S02000BWW| B1MX| NVIDIA vPC Subscription License 3 Years, 1 CCU
7S02003FWW| S834| NVIDIA vPC Subscription License 4 Years, 1 CCU
7S02003GWW| S835| NVIDIA vPC Subscription License 5 Years, 1 CCU
NVIDIA RTX vWS
7S02000FWW| B1N1| NVIDIA RTX vWS Perpetual License and SUMS 5Yr, 1 CCU
7S02000GWW| B1N2| NVIDIA RTX vWS Subscription License 1 Year, 1 CCU
7S02000HWW| B1N3| NVIDIA RTX vWS Subscription License 3 Years, 1 CCU
7S02000LWW| B1N6| NVIDIA RTX vWS EDU Perpetual License and SUMS 5Yr, 1 CCU
7S02000MWW| B1N7| NVIDIA RTX vWS EDU Subscription License 1 Year, 1 CCU
7S02000NWW| B1N8| NVIDIA RTX vWS EDU Subscription License 3 Years, 1 CCU
7S02003BWW| S830| NVIDIA RTX vWS EDU Subscription License 4 Years, 1 CCU
7S02003CWW| S831| NVIDIA RTX vWS EDU Subscription License 5 Years, 1 CCU
7S02000XWW| S6YJ| NVIDIA RTX vWS Subscription License 4 Years, 1 CCU
7S02000YWW| S6YK| NVIDIA RTX vWS Subscription License 5 Years, 1 CCU
NVIDIA vCS
7S02000ZWW| S6YL| NVIDIA Virtual Compute Server Subscription, 1 GPU (Max 10 CC VMs), 1 Year
7S020010WW| S6YM| NVIDIA Virtual Compute Server Subscription, 1 GPU (Max 10 CC VMs), 3 Years
7S020011WW| S6YN| NVIDIA Virtual Compute Server Subscription, 1 GPU (Max 10 CC VMs), 5 Years
7S020012WW| S6YP| NVIDIA Virtual Compute Server Subscription, 1 GPU (Max 10 CC VMs), EDU, 1 Year
7S020013WW| S6YQ| NVIDIA Virtual Compute Server Subscription, 1 GPU (Max 10 CC VMs), EDU, 3 Years
7S020014WW| S6YR| NVIDIA Virtual Compute Server Subscription, 1 GPU (Max 10 CC VMs), EDU, 5 Years

NVIDIA Omniverse Software (OVE)

Lenovo offers the following NVIDIA Omniverse Software software. 3D workflows are now an essential component of every industry. Efficient design collaboration between teams is crucial. NVIDIA Omniverse™ Enterprise is an end-to-end collaboration and simulation platform that fundamentally transforms complex design workflows, creating a more harmonious environment for creative teams.

NVIDIA Omniverse Enterprise Nucleus
Collaboration service which enables a variety of Omniverse Enterprise-enabled client applications (Apps, Connectors, and others) to share and modify authoritative representations of virtual worlds in USD. Omniverse Nucleus is built for collaboration across multiple users. Omniverse Nucleus is the database and collaboration engine of Omniverse.

Includes:

• Collaboration and scalable core microservices deployed on servers and/or workstations.
• Nucleus Workstation
• Enterprise Nucleus Server
• NVIDIA Enterprise Support

Note: The Omniverse Enterprise Nucleus Subscription is priced and licensed per named user.

NVIDIA Omniverse Enterprise Creator
App for accelerated advanced scene composition and world building. Creator enables scene composition, simulation, and rendering on workstations and virtual workstations.

Includes:

• Omniverse Create
• Omniverse Kit
• Omniverse Extensions
• Batch microservices (on up to 64 GPUs)
• NVIDIA Enterprise Support

Note: Collaboration via Nucleus requires a Nucleus subscription.

NVIDIA Omniverse Enterprise Reviewer
Simple app designed to visualize projects in stunning, physically accurate photorealism and enable minor editing and comment permissions. Reviewer enables review and approval for workstations and

• virtual workstations.
• Includes:
• Omniverse View
• NVIDIA Enterprise Support

Note: Editing and commenting via Nucleus requires a Nucleus subscription.

The following license types are offered:

• Concurrent User (CCU) License
  A method of allocating licenses based on the number of users that are concurrently using the software. As an example, one CCU license allows only one concurrent user to use the software.

• Floating User License
  For licensing, same as Concurrent User License.

• Named User License
  A method of licensing based on the number of named authorized users who may not re-assign or share the license with any other person.

• Subscription
  A software license that is active for a fixed period as defined by the terms of the subscription. An annual subscription includes SUMS for the duration of the license term.

The following table lists the ordering part numbers and feature codes.

Table 7. NVIDIA Omniverse Software (OVE)

Omniverse Enterprise Nucleus
7S02002MWW| S82A| NVIDIA Omniverse Enterprise Nucleus Subscription per Named User, 1 Year
7S02002NWW| S82B| NVIDIA Omniverse Enterprise Nucleus Subscription per Named User, 3 Years
7S02002PWW| S82C| NVIDIA Omniverse Enterprise Nucleus Subscription per Named User, 4 Years
7S02002QWW| S82D| NVIDIA Omniverse Enterprise Nucleus Subscription per Named User, 5 Years
7S02002RWW| S82E| NVIDIA Omniverse Enterprise Nucleus Subscription per Named User, EDU, 1 Year
7S02002SWW| S82F| NVIDIA Omniverse Enterprise Nucleus Subscription per Named User, EDU, 3 Years
7S02002TWW| S82G| NVIDIA Omniverse Enterprise Nucleus Subscription per Named User, EDU, 4 Years
7S02002UWW| S82H| NVIDIA Omniverse Enterprise Nucleus Subscription per Named User, EDU, 5 Years
Omniverse Enterprise Creator
7S02002VWW| S82J| NVIDIA Omniverse Enterprise Creator Subscription per CCU, 1 Year
7S02002WWW| S82K| NVIDIA Omniverse Enterprise Creator Subscription per CCU, 3 Years
7S02002XWW| S82L| NVIDIA Omniverse Enterprise Creator Subscription per CCU, 4 Years
7S02002YWW| S82M| NVIDIA Omniverse Enterprise Creator Subscription per CCU, 5 Years
7S02002ZWW| S82N| NVIDIA Omniverse Enterprise Creator Subscription per CCU, EDU, 1 Year
7S020030WW| S82P| NVIDIA Omniverse Enterprise Creator Subscription per CCU, EDU, 3 Years
7S020031WW| S82Q| NVIDIA Omniverse Enterprise Creator Subscription per CCU, EDU, 4 Years
7S020032WW| S82R| NVIDIA Omniverse Enterprise Creator Subscription per CCU, EDU, 5 Years
Omniverse Enterprise Reviewer
7S020033WW| S82S| NVIDIA Omniverse Enterprise Reviewer Subscription per CCU, 1 Year
7S020034WW| S82T| NVIDIA Omniverse Enterprise Reviewer Subscription per CCU, 3 Years
7S020035WW| S82U| NVIDIA Omniverse Enterprise Reviewer Subscription per CCU, 4 Years
7S020036WW| S82V| NVIDIA Omniverse Enterprise Reviewer Subscription per CCU, 5 Years
7S020037WW| S82W| NVIDIA Omniverse Enterprise Reviewer Subscription per CCU, EDU, 1 Year
7S020038WW| S82X| NVIDIA Omniverse Enterprise Reviewer Subscription per CCU, EDU, 3 Years
7S020039WW| S82Y| NVIDIA Omniverse Enterprise Reviewer Subscription per CCU, EDU, 4 Years
7S02003AWW| S82Z| NVIDIA Omniverse Enterprise Reviewer Subscription per CCU, EDU, 5 Years

NVIDIA AI Enterprise Software

Lenovo offers the NVIDIA AI Enterprise (NVAIE) cloud-native enterprise software. NVIDIA AI Enterprise is an end-to-end, cloud-native suite of AI and data analytics software, optimized, certified, and supported by NVIDIA to run on VMware vSphere and bare-metal withNVIDIA-Certified Systems™. It includes key enabling technologies from NVIDIA for rapid deployment, management, and scaling of AI workloads in the modern hybrid cloud.

NVIDIA AI Enterprise is licensed on a per-GPU basis. NVIDIA AI Enterprise products can be purchased as either a perpetual license with support services, or as an annual or multi-year subscription.

• The perpetual license provides the right to use the NVIDIA AI Enterprise software indefinitely, with no expiration. NVIDIA AI Enterprise with perpetual licenses must be purchased in conjunction with one-year, three-year, or five-year support services. A one-year support service is also available for renewals.
• The subscription offerings are an affordable option to allow IT departments to better manage the flexibility of license volumes. NVIDIA AI Enterprise software products with subscription includes support services for the duration of the software’s subscription license

The features of NVIDIA AI Enterprise Software are listed in the following table.

Table 8. Features of NVIDIA AI Enterprise Software (NVAIE)

Note: Maximum 10 concurrent VMs per product license

The following table lists the ordering part numbers and feature codes.

Table 9. NVIDIA AI Enterprise Software (NVAIE)

AI Enterprise Perpetual License
7S020019WW| S6YW| NVIDIA AI Enterprise Perpetual License and Support per GPU, 1 Year
7S02001AWW| S6YX| NVIDIA AI Enterprise Perpetual License and Support per GPU, 3 Years
7S02001BWW| S6YY| NVIDIA AI Enterprise Perpetual License and Support per GPU, 5 Years
7S02001CWW| S6YZ| NVIDIA AI Enterprise Perpetual License and Support per GPU, EDU, 1 Year
7S02001DWW| S6Z0| NVIDIA AI Enterprise Perpetual License and Support per GPU, EDU, 3 Years
7S02001EWW| S6Z1| NVIDIA AI Enterprise Perpetual License and Support per GPU, EDU, 5 Years
AI Enterprise Subscription License
7S02001FWW| S6Z2| NVIDIA AI Enterprise Subscription License and Support per GPU, 1 Year
7S02001GWW| S6Z3| NVIDIA AI Enterprise Subscription License and Support per GPU, 3 Years
7S02001HWW| S6Z4| NVIDIA AI Enterprise Subscription License and Support per GPU, 5 Years
7S02001JWW| S6Z5| NVIDIA AI Enterprise Subscription License and Support per GPU, EDU, 1 Year
7S02001KWW| S6Z6| NVIDIA AI Enterprise Subscription License and Support per GPU, EDU, 3 Years
7S02001LWW| S6Z7| NVIDIA AI Enterprise Subscription License and Support per GPU, EDU, 5 Years

Find more information in the NVIDIA AI Enterprise Sizing Guide.

NVIDIA HPC Compiler Software

Table 10. NVIDIA HPC Compiler

HPC Compiler Support Services
7S090014WW| S924| NVIDIA HPC Compiler Support Services, 1 Year
7S090015WW| S925| NVIDIA HPC Compiler Support Services, 3 Years
7S09002GWW| S9UQ| NVIDIA HPC Compiler Support Services, 5 Years
7S090016WW| S926| NVIDIA HPC Compiler Support Services, EDU, 1 Year
7S090017WW| S927| NVIDIA HPC Compiler Support Services, EDU, 3 Years
7S09002HWW| S9UR| NVIDIA HPC Compiler Support Services, EDU, 5 Years
7S090018WW| S928| NVIDIA HPC Compiler Support Services – Additional Contact, 1 Year
7S09002JWW| S9US| NVIDIA HPC Compiler Support Services – Additional Contact, 3 Years
7S09002KWW| S9UT| NVIDIA HPC Compiler Support Services – Additional Contact, 5 Years
7S090019WW| S929| NVIDIA HPC Compiler Support Services – Additional Contact, EDU, 1 Year
7S09002LWW| S9UU| NVIDIA HPC Compiler Support Services – Additional Contact, EDU, 3 Years
7S09002MWW| S9UV| NVIDIA HPC Compiler Support Services – Additional Contact, EDU, 5 Years
HPC Compiler Premier Support Services
7S09001AWW| S92A| NVIDIA HPC Compiler Premier Support Services, 1 Year
7S09002NWW| S9UW| NVIDIA HPC Compiler Premier Support Services, 3 Years
7S09002PWW| S9UX| NVIDIA HPC Compiler Premier Support Services, 5 Years
7S09001BWW| S92B| NVIDIA HPC Compiler Premier Support Services, EDU, 1 Year
7S09002QWW| S9UY| NVIDIA HPC Compiler Premier Support Services, EDU, 3 Years
7S09002RWW| S9UZ| NVIDIA HPC Compiler Premier Support Services, EDU, 5 Years
7S09001CWW| S92C| NVIDIA HPC Compiler Premier Support Services – Additional Contact, 1 Year
7S09002SWW| S9V0| NVIDIA HPC Compiler Premier Support Services – Additional Contact, 3 Years
7S09002TWW| S9V1| NVIDIA HPC Compiler Premier Support Services – Additional Contact, 5 Years
7S09001DWW| S92D| NVIDIA HPC Compiler Premier Support Services – Additional Contact, EDU, 1 Year
7S09002UWW| S9V2| NVIDIA HPC Compiler Premier Support Services – Additional Contact, EDU, 3 Years
7S09002VWW| S9V3| NVIDIA HPC Compiler Premier Support Services – Additional Contact, EDU, 5 Years

Auxiliary power cables

The GPU option part number does not ship with auxiliary power cables. Cables are server-specific due to length requirements and the connector on the server end of the cable. For CTO orders, auxiliary power cables are derived by the configurator. For field upgrades, cables will need to be ordered separately as listed in the table below.

Tip: The names of the cable options below may only include the H100 or L40 GPU, however these cables are also supported with the L40S.

Table 11. Auxiliary power cables for NVIDIA L40S GPU

Auxiliary power cable needed with the SR675 V3

• 235mm 16-pin (2×6+4) cable
• Option: 4X97A84510,
• ThinkSystem SR675 V3
• Supplemental Power Cable for H100 GPU Option
• Feature: BSD2
• SBB: SBB7A65299
• Base: SC17B39301
• FRU: 03LE554

Regulatory approvals

The NVIDIA L40S GPU has the following regulatory approvals:

• RCM
• BSMI
• CE
• FCC
• ICES
• KCC
• cUL, UL
• VCCI

Operating environment

The NVIDIA L40S GPU has the following operating characteristics:

• Ambient temperature

  • Operational: 0°C to 50°C (-5°C to 55°C for short term*)
  • Storage: -40°C to 75°C

• Relative humidity:

  • Operational: 5 to 85% (5 to 93% short term*)
  • Storage: 5 to 95%

• A period not more than 96 hours consecutive, not to exceed 15 days per year.

Warranty

One year limited warranty. When installed in a Lenovo server, the GPU assumes the server’s base warranty and any warranty upgrade

Related publications

For more information, refer to these documents:

• ThinkSystem and ThinkAgile GPU Summary: https://lenovopress.lenovo.com/lp0768-thinksystemthinkagile-gpu-summary
• ServerProven compatibility: http://www.lenovo.com/us/en/serverproven
• Lenovo Reference Architecture for Generative AI Based on Large Language Models (LLMs) https://lenovopress.lenovo.com/lp1798-reference-architecture-for-generative-ai-based-onlargelanguage-models
• NVIDIA L40S product page: https://www.nvidia.com/en-us/data-center/l40s/

Related product families
Product families related to this document are the following:

• GPU adapters

Notices

Lenovo may not offer the products, services, or features discussed in this document in all countries. Consult your local Lenovo representative for information on the products and services currently available in your area. Any reference to a Lenovo product, program, or service is not intended to state or imply that only that Lenovo product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any

Lenovo intellectual property right may be used instead. However, it is the user’s responsibility to evaluate and verify the operation of any other product, program, or service. Lenovo may have patents or pending patent applications covering subject matter described in this document. The furnishing of this document does not give you any license to these patents. You can send license inquiries, in writing, to:

Lenovo (United States), Inc.
8001 Development Drive
Morrisville, NC 27560
U.S.A.
Attention: Lenovo Director of Licensing

LENOVO PROVIDES THIS PUBLICATION ”AS IS” WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE. Some jurisdictions do not allow disclaimer of express or implied warranties in certain transactions, therefore, this statement may not apply to you.

This information could include technical inaccuracies or typographical errors. Changes are periodically made to the information herein; these changes will be incorporated in new editions of the publication. Lenovo may make improvements and/or changes in the product(s) and/or the program(s) described in this publication at any time without notice.

The products described in this document are not intended for use in implantation or other life support applications where malfunction may result in injury or death to persons. The information contained in this document does not affect or change Lenovo product specifications or warranties. Nothing in this document shall operate as an express or implied license or indemnity under the intellectual property rights of Lenovo or third parties. All information contained in this document was obtained in specific environments and is presented as an illustration. The result obtained in other operating environments may vary. Lenovo may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you.

Any references in this publication to non-Lenovo Web sites are provided for convenience only and do not in any manner serve as an endorsement of those Web sites. The materials at those Web sites are not part of the materials for this Lenovo product, and use of those Web sites is at your own risk. Any performance data contained herein was determined in a controlled environment. Therefore, the result obtained in other operating environments may vary significantly. Some measurements may have been made on development-level systems and there is no guarantee that these measurements will be the same on generally available systems. Furthermore, some measurements may have been estimated through extrapolation. Actual results may vary. Users of this document should verify the applicable data for their specific environment.

© Copyright Lenovo 2023. All rights reserved.

This document, LP1812, was created or updated on September 12, 2023.

Send us your comments in one of the following ways:

• Use the online Contact us review form found at: https://lenovopress.lenovo.com/LP1812
• Send your comments in an e-mail to: comments@lenovopress.com

This document is available online at https://lenovopress.lenovo.com/LP1812.

Trademarks

Lenovo and the Lenovo logo are trademarks or registered trademarks of Lenovo in the United States, other countries, or both. A current list of Lenovo trademarks is available on the Web at https://www.lenovo.com/us/en/legal/copytrade/.

• The following terms are trademarks of Lenovo in the United States, other countries, or both:
• Lenovo®
• ServerProven®
• ThinkAgile®
• ThinkSystem®

The following terms are trademarks of other companies:

Intel® is a trademark of Intel Corporation or its subsidiaries.

Linux® is the trademark of Linus Torvalds in the U.S. and other countries.

DirectX®, Windows Server®, and Windows® are trademarks of Microsoft Corporation in the United States, other countries, or both.

Other company, product, or service names may be trademarks or service marks of others.

ThinkSystem NVIDIA L40S 48GB PCIe Gen4 Passive GPU

References

• Reference Architecture for Generative AI Based on Large Language Models (LLMs) > Lenovo Press
• Reference Architecture for Generative AI Based on Large Language Models (LLMs) > Lenovo Press
• ThinkSystem NVIDIA L40S 48GB PCIe Gen4 Passive GPU Product Guide > Lenovo Press
• ThinkSystem NVIDIA L40S 48GB PCIe Gen4 Passive GPU > Lenovo Press
• Copyright and Trademark Information | Lenovo US | Lenovo US
• L40S GPU for AI and Graphics Performance | NVIDIA

Read User Manual Online (PDF format)

Download This Manual (PDF format)

Download this manual  >>