Lenovo Mellanox ConnectX-3 and EN6132 2 Port 40Gb Ethernet Adapters for Flex System User Guide
- June 3, 2024
- Lenovo
Table of Contents
ConnectX-3 and EN6132 2 Port 40Gb Ethernet Adapters for Flex System
User Guide
Mellanox ConnectX-3 and EN6132 2 Port 40Gb Ethernet Adapters for Flex
System
The Flex System EN6132 2-port 40Gb Ethernet Adapter and Mellanox ConnectX-3
Mezz 40Gb 2-Port Ethernet Adapter in conjunction with the EN6131 40Gb Ethernet
Switch offer the performance that you need to support clustered databases,
parallel processing, transactional services, and high-performance embedded I/O
applications, which reduces task completion time and lowers the cost per
operation. The EN6132 and ConnectX-3 adapters can help you achieve efficient
computing by offloading protocol processing from the CPU and data movement
impact, such as RDMA over Converged Ethernet and Send/Receive semantics, which
allows more processor power for the application.
The EN6132 2-port 40Gb Ethernet Adapter is shown in Figure 1.
Did you know?
The 40 Gb Ethernet solution that is offered by Flex System can deploy more
workloads per server without running into I/O bottlenecks. If there are
failures or server maintenance, clients can move their virtual machines much
faster by using 40 Gb interconnects within the chassis. The 40 GbE switch and
adapter are designed for low latency, high bandwidth, and computing efficiency
for performance-driven server and storage clustering applications. They
provide extreme scalability for low-latency clustered solutions with reduced
packet hops.
Part number information
Table 1 shows the part numbers for ordering
Withdrawn: Both adapters listed in this product guide are now withdrawn from
marketing.
Table 1. Part numbers and feature codes for ordering
| Part number | Feature code | Description |
|---|---|---|
| 90Y3482 | A3HK | Flex System EN6132 2-port 40Gb Ethernet Adapter |
| 7ZT7A00502 | AVEC | ThinkSystem Mellanox ConnectX-3 Mezz 40Gb 2-Port Ethernet |
Adapter
The part numbers include the following items:
- One adapter for use in ThinkSystem and Flex System compute nodes
- Documentation
Benefits
The ConnectX-3 Mezz 40Gb 2-Port Ethernet Adapter and EN6132 2-port 40Gb
Ethernet Adapter offer the following benefits:
- 10 GbE and 40 GbE connectivity to servers and storage
- Industry-leading throughput performance with low latency
- Ideal for clients running Ethernet infrastructure in high-speed trading, Web 2.0, virtualization, and cloud computing
- Enables clients to maximize compute usage by removing I/O bottlenecks
- Improved application productivity and efficiency with support for protocol offload and RDMA over Converged Ethernet
- Support for industry-standard SR-IO Virtualization technology to deliver VM protection and granular levels of I/O services to applications
- High availability and high performance for data center networking
- Software compatibility with standard TCP/UDP/IP and iSCSI stacks
- Low power, low cost, and high reliability
Features and specifications
The adapters have the following features and specifications:
- Based on Mellanox ConnectX-3 technology
- PCI Express 3.0 x8 host-interface
- Two 40 Gb Ethernet ports that can operate at 10 Gbps or 40 Gbps speeds
- CPU offload of transport operations
- RDMA over Converged Ethernet (RoCE).
- TCP/UDP/IP stateless offload.
- TCP/UDP/IP checksum offload
- TCP Large Send or Giant Send offload for segmentation
- Receive Side Scaling (RSS)
- End-to-end quality of service (QoS) and congestion control Support for IEEE 802.1p and IP DSCP/TOS traffic processing based on the class of service. Support for 802.3x flow control.
- Congestion Notification (IEEE Std 802.3Qau) limits the transmission rate to avoid frame losses in case of congestion in the network.
- Priority-Based Flow Control (PFC) (IEEE 802.1Qbb) extends 802.3x standard flow control to allow the switch to pause traffic based on the 802.1p priority value in each packet’s VLAN tag. Enhanced Transmission Selection (ETS) (IEEE 802.1Qaz) provides a method for allocating link bandwidth based on 802.
- 1p priority value in each packet’s VLAN tag. Hardware-based I/O virtualization
- Jumbo frame support (up to 10 KB)
- 802.1Q VLAN tagging
- NIC teaming and failover (static and LACP)
- Support for Wake on LAN (WoL)
Supported standards
The adapters support the following Ethernet standards:
- IEEE 802.1p Class of Service (CoS) prioritization
- IEEE 802.1Q Tagged VLAN
- IEEE 802.1Qbb Priority-Based Flow Control (PFC)
- IEEE 802.1Qaz Enhanced Transmission Selection (ETS)
- IEEE 802.3ad Link Aggregation Control Protocol
- IEEE 802.3ae 10GBASE-KR backplane 10 Gb Ethernet
- IEEE 802.3ba 40GBASE-KR4 backplane 40 Gb Ethernet
- IEEE 802.3Qau Congestion Notification
- IEEE 802.3x Full-duplex Flow Control
Supported servers
The following table lists the ThinkSystem and Flex System compute nodes that support the adapters. Table 2. Support for ThinkSystem and Flex System compute nodes:
Supported I/O modules
The EN6132 2-port 40Gb Ethernet Adapter supports the I/O modules that are
listed in the following table.
Table 3. Supported I/O modules
| Part number | Feature code | Description |
|---|---|---|
| 90Y9346 | A3HJ | Flex System EN6131 40Gb Ethernet Switch |
Other I/O modules: Other I/O modules that are not listed in Table 3 are
not supported.
The supported I/O modules are installed in the I/O bays in the rear of the
Flex System Enterprise Chassis, as shown in the following figure.
Figure 2. Location of the I/O module bays in the Flex System Enterprise
Chassis.
The connections between the EN6132 adapters that are installed in the compute
nodes to the supported I/O modules that are installed in the chassis I/O bays
are shown in the igure below. The figure also shows both half-wide compute
nodes, such as the SN550 with two adapters, and full-wide compute nodes, such
as the SN850 with four dapters.
Figure 3. Logical layout of the interconnects between adapters and I/O modules
The adapters can be installed in slots A1 and A2 of the half-wide compute
nodes (such as x240 M5 and SN550), and slots A1, A2, A3, and A4 of the full-
wide compute nodes (such as x440 and SN850). A supported Ethernet I/O module
must be installed in the corresponding I/O bay of the chassis (bays 1 and 2
when the adapter is installed slot A1 or A3 or bays 3 and 4 when the adapter
is installed in slot A2 or A4). In the compute nodes that have an integrated
dual-port 10 GbE network interface controller (NIC), NIC ports are routed to
bays 1 and 2 with a specialized periscope connector, and the adapter in slot
A1 is not required. However, when needed, the periscope connector can be
replaced with the EN6132 adapter. In such a case, integrated NIC is disabled.
The following table shows the connections between the adapters that are
installed in the compute nodes to the supported I/O modules that are installed
in the chassis.
Table 4. Adapter to I/O bay correspondence
I/O adapter slot in the server| The port on the adapter|
Corresponding I/O module bay in the chassis
---|---|---
Bay 1| Bay 2| Bay 3| Bay 4
Slot 1| Port 1| Yes| | |
Port 2| | Yes| |
Slot 2| Port 1| | | Yes|
Port 2| | | | Yes
Slot 3 (full-wide compute nodes only)| Port 1| Yes| | |
Port 2| | Yes| |
Slot 4 (full-wide compute nodes only)| Port 1| | | Yes|
Port 2| | | | Yes
The adapters are installed in slots in a supported compute node. The following shows the locations of the slots in the x240 Compute Node. The positions of the adapters in the other supported compute nodes are similar.
Figure 4. Location of the I/O adapter slots in the Flex System x240 Compute Node
Supported operating systems
The ThinkSystem Mellanox ConnectX-3 Mezz 40Gb 2-Port Ethernet Adapter supports the following operating systems:
- Microsoft Windows Server 2012 R2
- Microsoft Windows Server 2016
- Microsoft Windows Server 2019
- Microsoft Windows Server version 1709
- Microsoft Windows Server version 1803
- Red Hat Enterprise Linux 6.10
- Red Hat Enterprise Linux 6.9
- Red Hat Enterprise Linux 7.3
- Red Hat Enterprise Linux 7.4
- Red Hat Enterprise Linux 7.5
- Red Hat Enterprise Linux 7.6
- SUSE Linux Enterprise Server 11 SP4
- SUSE Linux Enterprise Server 11 SP4 with Xen
- SUSE Linux Enterprise Server 12 SP2
- SUSE Linux Enterprise Server 12 SP2 with Xen
- SUSE Linux Enterprise Server 12 SP3
- SUSE Linux Enterprise Server 12 SP3 with Xen
- SUSE Linux Enterprise Server 15
- VMware vSphere Hypervisor (ESXi) 6.0 U3
- VMware vSphere Hypervisor (ESXi) 6.5 U2
- VMware vSphere Hypervisor (ESXi) 6.7
- VMware vSphere Hypervisor (ESXi) 6.7 U1
The EN6132 2-port 40Gb Ethernet Adapter supports the following operating
systems:
- Microsoft Windows Server 2016
- Microsoft Windows Server 2019
- Microsoft Windows Server version 1709
- Red Hat Enterprise Linux 6 Server x64 Edition
- SUSE Linux Enterprise Server 11 for AMD64/EM64T
- SUSE Linux Enterprise Server 12
- SUSE Linux Enterprise Server 15
- VMware vSphere 5.1 (ESXi)
- VMware vSphere Hypervisor (ESXi) 5.5
- VMware vSphere Hypervisor (ESXi) 6.0
- VMware vSphere Hypervisor (ESXi) 6.5
- VMware vSphere Hypervisor (ESXi) 6.7
Operating system support may vary by server. For more information, see ServerProven at http://www.lenovo.com/us/en/serverproven/. Select the server in question, scroll own to the adapter, and click the + icon in that row to show the supported operating systems.
Warranty
The adapters have a 1-year, customer-replaceable unit (CRU) limited warranty.
When installed in a supported server, these adapters assume the server’s base
warranty and any Lenovo warranty service upgrade.
Physical specifications
The adapters have the following physical specifications:
Dimensions and weight (approximate):
- Width: 100 mm (3.9 in.)
- Depth: 80 mm (3.1 in.)
- Weight: 13 g (0.3 lb)
Shipping dimensions and weight (approximate):
- Height: 58 mm (2.3 in.)
- Width: 229 mm (9.0 in.)
- Depth: 208 mm (8.2 in.)
- Weight: 0.4 kg (0.89 lb)
Agency approvals
The adapters conform to the following standards:
- IEC/EN 60950-1:2006
- ETSI EN 300 019-2-2
- IEC 60068-2- 64, 29, 32
Related publications
For more information, see the following resources:
- Flex System Information Center (User’s Guides for servers and http://flexsystem.lenovofiles.com/help/index.jsp
- Flex System Interoperability Guide http://lenovopress.com/fsig
- Flex System Products and Technology Guide: http://lenovopress.com/sg248255
- ServerProven for Flex System: http://www.lenovo.com/us/en/serverproven/flexsystem.shtml
Related product families
Product families related to this document are the following: 40 Gb Embedded
Connectivity Blade Network Adapters
Notices
Lenovo may not offer the products, services, or features discussed in this
document in all countries. Consult your local Lenovo representative for
information on the products and services currently available in your area. Any
reference to a Lenovo product, program, or service is not intended to state or
imply that only the Lenovo product, program, or service may be used. Any
functionally equivalent product, program, or service that does not infringe
any Lenovo intellectual property right may be used instead. However, it is the
user’s responsibility to evaluate and verify the operation of any other
product, program, or service. Lenovo may have patents or pending patent
applications covering the subject matter described in this document. The
furnishing of this document does not give you any license to these patents.
You can send license inquiries, in writing, to:
Lenovo (United States), Inc.
8001 Development Drive
Morrisville, NC 27560
U.S.A.
Attention: Lenovo Director of Licensing
LENOVO PROVIDES
THIS PUBLICATION ”AS IS” WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESS OR
IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF NON-
INFRINGEMENT, MERCHANTABILITY OR FITNESS FOR A PARTICULAR PURPOSE.
Some jurisdictions do not allow disclaimer of express or implied warranties in
certain transactions, therefore, this statement may not apply to you. This
information could include technical inaccuracies or typographical errors.
Changes are periodically made to the information herein; these changes will be
incorporated in new editions of the publication. Lenovo may make improvements
and/or changes in the product(s) and/or the program(s) described in this
publication at any time without notice. The products described in this
document are not intended for use in implantation or other life support
applications where malfunction may result in injury or death to persons. The
information contained in this document does not affect or change Lenovo
product specifications or warranties.
Nothing in this document shall operate as an express or implied license or
indemnity under the intellectual property rights of Lenovo or third parties.
All information contained in this document was obtained in specific
environments and is presented as an illustration. The result obtained in other
operating environments may vary. Lenovo may use or distribute any of the
information you supply in any way it believes appropriate without incurring
any obligation to you. Any references in this publication to non-Lenovo Web
sites are provided for convenience only and do not in any manner serve as an
endorsement of those Web sites.
The materials at those Web sites are not part of the materials for this Lenovo
product, and use of those Web sites is at your own risk. Any performance data
contained herein was determined in a controlled environment. Therefore, the
result obtained in other operating environments may vary significantly. Some
measurements may have been made on development-level systems and there is no
guarantee that these measurements will be the same on generally available
systems. Furthermore, some measurements may have been estimated through
extrapolation. Actual results may vary. Users of this document should verify
the applicable data for their specific environment.
© Copyright Lenovo 2022. All rights reserved.
This document, TIPS0912, was created or updated on March 9, 2020. Send us
your comments in one of the following ways:
- Use the online Contact us review form found at: https://lenovopress.lenovo.com/TIPS0912
- Send your comments in an e-mail to: comments@lenovopress.com
This document is available online at https://lenovopress.lenovo.com/TIPS0912.
Trademarks
Lenovo and the Lenovo logo are trademarks or registered trademarks of Lenovo
in the United States, other countries, or both. A current list of Lenovo
trademarks is available n the Web at
https://www.lenovo.com/us/en/legal/copytrade/.
The following terms are trademarks of Lenovo in the United States, other
countries, or both: Lenovo® Flex System ServerProven® ThinkSystem®
The following terms are trademarks of other companies: Linux® is the trademark
of Linus Torvalds in the U.S. and other countries.
Microsoft®, Windows Server®, and Windows® are trademarks of Microsoft
Corporation in the United States, other countries, or both. Other company,
product, or service names may be trademarks or service marks of others.
References
- Lenovo Flex System Documentation
- Flex System Interoperability Guide > Lenovo Press
- Lenovo Flex System Products and Technology > Lenovo Press
- Welcome | ServerProven
- Welcome | ServerProven
- 40 Gb Embedded Connectivity > Lenovo Press
- Blade Network Adapters > Lenovo Press
- Mellanox ConnectX-3 and EN6132 2-port 40Gb Ethernet Adapters for Flex System Product Guide (withdrawn product) > Lenovo Press
- Copyright and Trademark Information | Lenovo US | Lenovo US
Read User Manual Online (PDF format)
Read User Manual Online (PDF format) >>