SUPERMICRO AOC-2UR68G4-M2TS Ultra Riser Card User Guide

: June 3, 2024
: SuperMicro

Table of Contents

SUPERMICRO AOC-2UR68G4-M2TS Ultra Riser Card
Preface
Conventions Used in the User’s Guide
Naming Convention
Contacting Supermicro
Overview
Key Features
Specifications
Hardware Components
- Jumpers
Installation
(Disclaimer Continued)
References
Read User Manual Online (PDF format)
Download This Manual (PDF format)

SUPERMICRO AOC-2UR68G4-M2TS Ultra Riser Card

The information in this user’s guide has been carefully reviewed and is believed to be accurate. The manufacturer’s assumes no responsibility for any inaccuracies that may be contained in this document, and makes no commitment to update or to keep current the information in this user’s guide, or to notify any person or organization of the updates. Please Note: For the most up-to-date version of this user’s guide, please see our Website at www.supermicro.com. Super Micro Computer, Inc. (“Supermicro”) reserves the right to make changes to the product described in this user’s guide at any time and without notice. This product, including software and documentation, is the property of Supermicro and/or its licensors, and is supplied only under a license. Any use or reproduction of this product is not allowed, except as expressly permitted by the terms of said license.

IN NO EVENT WILL SUPER MICRO COMPUTER, INC. BE LIABLE FOR DIRECT, INDIRECT, SPECIAL, INCIDENTAL, SPECULATIVE OR CONSEQUENTIAL DAMAGES ARISING FROM THE USE OR INABILITY TO USE THIS PRODUCT OR DOCUMENTATION, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. IN PARTICULAR, SUPER MICRO COMPUTER, INC. SHALL NOT HAVE LIABILITY FOR ANY HARDWARE, SOFTWARE, OR DATA STORED OR USED WITH THE PRODUCT, INCLUDING THE COSTS OF REPAIRING, REPLACING, INTEGRATING, INSTALLING OR RECOVERING SUCH HARDWARE, SOFTWARE, OR DATA.

Any disputes arising between the manufacturer and the customer shall be governed by the laws of Santa Clara County in the State of California, USA. The State of California, County of Santa Clara shall be the exclusive venue for the resolution of any such disputes. Supermicro’s total liability for all claims will not exceed the price paid for the hardware product.

FCC Statement: This equipment has been tested and found to comply with the limits for a Class A digital device pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in an industrial environment. This equipment generates, uses, and can radiate radio frequency energy and, if not installed and used in accordance with the manufacturer’s instruction manual, may cause harmful interference with radio communications. Operation of this equipment in a residential area is likely to cause harmful interference, in which case you will be required to correct the interference at your own expense.

WARNING: This product can expose you to chemicals including lead, known to the State of California to cause cancer and birth defects or other reproducve harm. For more informaon, go to www.P65Warnings.ca.gov.

User’s Guide Revision 1.0
Release Date: November 18, 2021
Unless you request and receive written permission from Super Micro Computer, Inc., you may not copy any part of this document.
Information in this document is subject to change without notice. Other products and companies referred to herein are trademarks or registered trademarks of their respective companies or mark holders.
Copyright © 2021 by Super Micro Computer, Inc. All rights reserved.
Printed in the United States of America

Preface

About this User’s Guide
This user’s guide is written for system integrators, PC technicians, and knowledgeable PC users. It provides information for the installation and use of the AOC-2UR68G4-m2TS add-on card.
About this Add-on Card
The Supermicro AOC-2UR68G4-m2TS is the most advanced networking ultra riser card in the market. It provides PCI-E Gen. 4 expansion slots for the latest Gen. 4 PCI-E support while also functioning as a networking device that can accommodate various LAN controllers. The AOC-2UR68G4-m2TS has two 25GbE ports based on Mellanox ConnectX-6 LX and three PCIe Gen. 4 slots which offers the flexibility for diverse Supermicro Ultra system configurations.
An Important Note to the User
All images and layouts shown in this user’s guide are based upon the latest PCB Revision available at the time of publishing. The card you have received may or may not look exactly the same as the graphics shown in this user’s guide.
Returning Merchandise for Service
A receipt or copy of your invoice marked with the date of purchase is required before any warranty service will be rendered. You can obtain service by calling your ven-dor for a Returned Merchandise Authorization (RMA) number. When returning the motherboard to the manufacturer, the RMA number should be prominently displayed on the outside of the shipping carton, and the shipping package is mailed prepaid or hand-carried. Shipping and handling charges will be applied for all orders that must be mailed when service is complete. For faster service, You can also request a RMA authorization online (http://www.supermicro.com/RmaForm/). This warranty only covers normal consumer use and does not cover damages in-curred in shipping or from failure due to the alternation, misuse, abuse or improper maintenance of products. During the warranty period, contact your distributor first for any product problems.

Conventions Used in the User’s Guide

Pay special attention to the following symbols for proper system installation and to prevent damage to the system or injury to yourself:

Warning: Important information given to ensure proper system installation or to prevent damage to the components or injury to yourself.
Note: Additional information given to differentiate between various models or provides information for correct system setup.

Naming Convention

SUPERMICRO AOC-2UR68G4-M2TS Ultra Riser Card-fig6

Contacting Supermicro

Headquarters
- Address: Super Micro Computer, Inc. 980 Rock Ave. San Jose, CA 95131 U.S.A.
- Tel: +1 408-503-8000
- Fax: +1 408-503-8008
- Email: [email protected] (General Information) [email protected] (Technical Support)
- Website: www.supermicro.com
Europe
- Address: Super Micro Computer B.V. Het Sterrenbeeld 28, 5215 ML ‘s-Hertogenbosch, The Netherlands
- Tel: +31 (0) 73-6400390
- Fax: +31 (0) 73-6416525
- Email: [email protected]
- (General Information) [email protected]
- (Technical Support) [email protected]
- (Customer Support)
- Website: www.supermicro.nl
Asia-Pacific
- Address: Super Micro Computer, Inc. 3F, No. 150, Jian 1st Rd. Zhonghe Dist., New Taipei City 235 Taiwan (R.O.C)
- Tel: +886-(2) 8226-3990
- Fax: +886-(2) 8226-3992
- Email: [email protected]
- Website: www.supermicro.com.tw

Overview

Congratulations on purchasing your add-on card from an acknowledged leader in the industry. Supermicro products are designed with the utmost attention to detail to provide you with the highest standards in quality and performance. For product support and updates, please refer to our website at http://www.supermicro.com/products/nfo/networking.cfm#adapter.

Key Features

The key features of this add-on card include the following:

2U networking ultra riser cards for 2U Ultra systems
Mellanox® ConnectX-6 LX 25GbE controller
Dual SFP28 connectors
One PCIe Gen 4 x8 (in x16) slot
One PCIe Gen 4 x16 slot
One internal PCIe Gen 4 x8 (in x16) slot
RDMA over Converged Ethernet
Network Virtualization: VXLAN and NVGRE
Thermal sensor support
NC-SI for remote management

Specifications

General
- 2U networking ultra riser for 2U Ultra systems
- Mellanox® ConnectX-6 LX 25GbE controller
- Dual SFP28 connectors
- One PCIe Gen 4 x8 (in x16) slot
- One PCIe Gen 4 x16 slot
- One internal PCIe Gen 4 x8 (in x16) slot
Storage Accelerations
- NVMe over Fabric offloads for target
- Storage protocols: iSER, NFSoRDMA,
- SMB Direct, NVMe-oF, and more
RDMA over Converged Ethernet
- RoCE v1/v2
- Zero-Touch RoCE: no ECN, no PFC
- RoCE over overlay networks
- IPsec over RoCE
- Selective repeat
- GPUDirect®
- Dynamically Connected Transport (DCT)
- Burst buffer offload
Management Features
- SMBus 2.0
- Network Controller Sideband Interface (NC-SI)
- NC-SI, MCTP over SMBus, and MCTP over PCIe – Baseboard Management
- Controller interface
- PLDM for Monitor and Control DSP0248
- PLDM for Firmware Update DSP026
Remote Boot
- Remote boot over Ethernet
- Remote boot over iSCSI
- UEFI support for x86 and Arm servers
- PXE boot
Standards
- IEEE 802.3ae 10 Gigabit Ethernet
- IEEE 802.3by 25G supporting all FEC modes
- IEEE 802.3ad, 802.1AX Link Aggregation
- IEEE 802.3az Energy Efficient Ethernet (supports only “Fast-Wake” mode)
- IEEE 802.3ap based auto-negotiation and KR startup
- IEEE 802.1Q, 802.1P VLAN tags and priority
- IEEE 802.1Qaz (ETS)
- IEEE 802.1Qbb (PFC)
- IEEE 802.1Qbg
- IEEE 1588v2
- IEEE 1149.1 and IEEE 1149.6 JTAG
- PCI Express Gen 3.0 and 4.0
Power Consumption
- Maximum power consumption: 15W (+75W for each PCIe slot if used)
Operating Conditions
- Storage condition: -40°C to 70°C (-40°F to 158°F)
- Storage humidity: 90% non-condensing relative humidity at 35°C
Supported Platforms
supermicro ultra system

Hardware Components

Add-On Card Image and Layout

SUPERMICRO AOC-2UR68G4-M2TS Ultra Riser Card-fig3

SUPERMICRO AOC-2UR68G4-M2TS Ultra Riser Card-fig4

Major Components

The following major components are installed on the AOC-2UR68G4-m2TS:

AOC-2UR68G4-m2TS Major Components

x16)

| Slot 3

Ports
There are two LAN ports (LAN1 and LAN2) located on the AOC-2UR68G4-m2TS add-on card. Connect a Direct Attach Copper Twin Axial cable or an LC Fiber-Optic cable to the ports to provide Gigabit Ethernet communication. Each connector has two ports. The SFP28 connector ports are for LAN1 and LAN2. Refer to the add-on card layout on pages 2-1 through 2-2 for the locations of the ports.

Connectors
SFP28 Port LEDs
There are two bi-colored LED indicators per port (Link and Activity). Please refer to the table below for LED color definition.

LAN Port LEDs

Jumpers

Explanation of Jumpers
To modify the operation of the add-on card, a jumper can be used to choose be- tween optional settings. A jumper creates shorts between two pins to change the function of the connector. See the add-on card layouts on pages 2-1 and 2-2 for the jumper locations.
Note: On two-pin jumpers, “Closed” means the jumper is on and “Open” means the jumper is off the pins.

Standby Power Enable
The 3.3V Standby Power Enable jumper, located at JP3, is used to turn on or turn off 3.3V standby power. To turn 3.3V standby power on, close pins 1-2 to enable NC-SI, BMC management, shared LAN1, and WoL (Wake-on-LAN) support during standby. Close pins 3-4 to turn 3.3V standby power off, which will also disable the connections to NC-SI, BMC, shared LAN1, and WoL during standby. The default setting is 3.3V Standby Off on pins 3-4. Refer to page 2-1 for JP3 location.
Warning: Please check with your local Supermicro FAE or contact Supermicro Technical Support before you change the JP3 jumper to en-able 3.3V Standby On. Staying in the standby state for a long period of time without the fan blowing air inside the chasis may cause the onboard Mellanox chipset to overheat.

Installation

Static-Sensitive Devices
Electrostatic Discharge (ESD) can damage electronic com ponents. To avoid dam- aging your add-on card, it is important to handle it very carefully. The following measures are generally sufficient to protect your equipment from ESD.

Precautions

Use a grounded wrist strap designed to prevent static discharge.
Touch a grounded metal object before removing the add-on card from the antistatic bag.
Handle the add-on card by its edges only; do not touch its components, or peripheral chips.
Put the add-on card back into the antistatic bags when not in use.
For grounding purposes, make sure that your system chassis provides excel-lent conductivity between the power supply, the case, the mounting fasteners, and the add-on card.

Unpacking
The add-on card is shipped in antistatic packaging to avoid static damage. When unpacking your component or your system, make sure that the person handling it is static protected.
Warning: To avoid damaging your components and to ensure proper installation, be sure to always connect the power cord last, and always remove it before adding, removing, or changing any hardware components.

Before Installation
To install the add-on card properly, be sure to follow the instructions below.

Power down the system.
Remove the power cord from the wall socket.
Use industry standard anti-static equipment (such as gloves or wrist strap) and follow the instructions listed on page 3-1 to avoid damage caused by ESD.
Familiarize yourself with the server, motherboard, and/or chassis documenta-tion.
Confirm that your operating system includes the latest updates and hotfixes.

Installing the Add-on Card
Follow the steps below to install the add-on card into your system.

Remove the server cover and, if necessary, set aside any screws for later use.
Remove the add-on card slot cover. If the case requires a screw, place the screw aside for later use.
Position the add-on card in the slot directly over the connector, and gently push down on both sides of the card until it slides into the PCI connector.
Secure the add-on card to the chassis. If required, use the screw that you previously removed.
Attach any necessary external cables to the add-on card.
Replace the chassis cover.
Plug the power cord into the wall socket, and power up the system.

Installing Drivers for Windows
Follow the steps below to install the drivers needed for your Windows OS support. The controller comes with a driver on the CD-ROM CDR-NIC.

Run the CDR-NIC. (If you do not have a product CD-ROM, download drivers from the Supermicro Support Website and then transfer them to your system.)
When the SUPERMICRO window appears, click on the computer icon next to the product model.
Note: If the FOUND NEW HARDWARE WIZARD screen displays on your system, click CANCEL.

SUPERMICRO AOC-2UR68G4-M2TS Ultra Riser Card-fig5

Click on INSTALL DRIVERS AND SOFTWARE.
Follow the prompts to complete the installation.

Installing Drivers (for Mellanox® ConnectX-6)
Use the procedures below to install the driver for the AOC-2UR68G4-m2TS add-on card on both Linux and Windows.

Linux Drivers

Use the following procedures to install the 25GbE driver on the Linux (Red-Hat/ CentOS) operating system.
We recommend downloading the latest Mellanox Driver directly from the Mellanox website: https://mellanox.com/products/infiniband-drivers/linux/mlnx_ofed.
Download and extract /untar the MLNX_OFED***.tgz package.
Change to the appropriate directory where your newly extracted package is located.
Install the driver by entering the following commands: ./mlnxofedinstall ./ mlnxofedinstall
This installs the Linux drivers to your system. You might be prompted to install kernel dependencies for Linux, in which case you would need to follow on-screen instructions.

Windows Drivers
Use the following procedures to install a 25GbE driver on the Windows operating system.

We recommend that you download the latest Mellanox Driver directly from the Mellanox website: https://mellanox.com/products/adapter-software/ethernet/windows/winof-2.
Once the driver is downloaded, run the .exe file to install the driver

(Disclaimer Continued)

The products sold by Supermicro are not intended for and will not be used in life support systems, medical equipment, nuclear facilities or systems, aircraft, aircraft devices, aircraft/emergency com-munication devices or other critical systems whose failure to perform be reasonably expected to result in significant injury or loss of life or catastrophic property damage. Accordingly, Supermicro disclaims any and all liability, and should buyer use or sell such products for use in such ultra-hazardous ap-plications, it does so entirely at its own risk. Furthermore, buyer agrees to fully indemnify, defend and hold Supermicro harmless for and against any and all claims, demands, actions, litigation, and proceedings of any kind arising out of or related to such ultra-hazardous use or sale.