DELL Technologies S6000-ON 40GbE ToR Switch Instruction Manual

June 12, 2024
DELL Technologies

DELL Technologies S6000-ON 40GbE ToR Switch

DELL-Technologies-S6000-ON-40GbE-ToR-Switch-PRODUCT

Product Information

Product: Dell Networking S6000-ON
Release Version: 9.14(2.16)
Release Date: August 19, 2022

Supported Hardware

Hardware Description
S6000-ON chassis Hardware chassis for the S6000-ON platform
Thirty-two QSFP+ ports (40 Gbps) Thirty-two ports with QSFP+ connectors

supporting 40 Gbps data
transfer
Two AC/DC PSUs| Two power supply units with support for both AC and DC power
sources
Three fan subsystems| Three fan subsystems for cooling the hardware

Supported Software

Software Description Minimum Release Requirement
Dell Networking OS Dell Networking operating system 9.14(2.16)
BigSwitch Cumulus: S6000-ON (S6000 with ONIE) Cumulus Linux software for the
S6000-ON platform 4.0.0 Cumulus Linux 2.1 v3.20.1.3
ONIE Open Network Install Environment for network switch
installation 9.14(2.16)

New Dell Networking OS Version 9.14(2.16) Features

No new features have been integrated into the Dell Networking OS 9.14.2 branch through this release.

Prerequisite Steps for Upgrading Dell Networking OS

  1. Uninstall the older version of the Open Automation (OA) package.
  2. Upgrade the Dell Networking OS to version 9.14.2.0 or later.
  3. Install the following OA packages from the respective upgraded version:
    • SmartScripts
    • Puppet
    • Open management infrastructure (OMI)
    • SNMP MIB

Prerequisite Steps for Downgrading Dell Networking OS

  1. Uninstall the OA package of version 9.14.2.0 or later.
  2. Downgrade the Dell Networking OS to an earlier version.
  3. Install the respective OA package from an earlier version.

For more information about installing, uninstalling, and upgrading the Dell Networking OS and OA package, refer to the respective Dell System Release Notes.
If you downgrade the Dell Networking OS version from 9.14.2.16 to 9.11.0.0 or any older versions, the system displays the following error message even though there is no functional impact:

Dell System S6000–ON 9.14(2.16) Release Notes
This document contains information on open and resolved caveats, and operational information specific to the Dell Networking OS software and the S6000-ON platform.
Current Release Version: 9.14(2.16)
Release Date: 2022-08-19
Previous Release Version: 9.14(2.14)
Topics:

  • Document Revision History
  • Supported Hardware
  • Supported Software
  • New Dell Networking OS Version 9.14(2.16) Features
  • Restrictions
  • Changes to Default Behavior and CLI Syntax
  • Upgrading the CPLD
  • S6000–ON Upgrade Procedures: Overview
  • Upgrading the CPLD
  • Uninstalling Dell Networking OS from the S6000-ON
  • Documentation Corrections
  • Deferred Issues
  • Fixed Issues
  • Known Issues
  • Support Resources
  • NOTE: This document may contain language that is not consistent with current guidelines of Dell Technologies. There are plans to update this document over subsequent releases to revise the language accordingly.
  • Incorrect behavior or unexpected caveats are listed as the Problem Report (PR) numbers within the appropriate sections.
  • For more information on hardware and software features, commands, and capabilities, refer to the Dell Networking website at: https://www.dellemc.com/networking.

Document Revision History

Table 1. Revision History

Date Description
2022–08 Initial release.

Supported Hardware

The following hardware is supported with this platform:

  • Hardware
    • S6000-ON chassis
  • Hardware
    • Thirty-two QSFP+ ports (40 Gbps)
  • Two AC/DC PSUs
    • Three fan subsystems

NOTE: If all the three fan trays are found to be empty or faulty, the system shuts down after one minute.

Supported Software

The following software is supported with this platform:

Software Minimum Release Requirement
Dell Networking OS 9.14(2.16)
BigSwitch 4.0.0
Cumulus: S6000-ON (S6000 with ONIE) Cumulus Linux 2.1
ONIE v3.20.1.3

New Dell Networking OS Version 9.14(2.16) Features

The following features are integrated into the Dell Networking 9.14.2 branch through this releaseNone

Restrictions

You can use non-Dell qualified cables, adapters, and optics in a S6000-ON switch, but Dell Networking does not guarantee their performance as the S6000-ON does not support non-Dell qualified transceivers of 25G and above. If you insert
a non-Dell qualified transceiver of 25G and above into a SFP28, QSFP+, or QSFP28 port, the switch places the
interface in an error-disabled (operationally down) state and generates a syslog message, such as: %S6000LC0640:8 %IFAGT-2-TRANSCEIVER_UNSUPPORTED_ERROR: Transceiver in slot 1 port 49 unrecognized, putting interface in operational-down state.
To verify the error-disabled status of an interface, enter any of the following show commands.DELL-Technologies-S6000-ON-40GbE-ToR-Switch-
FIG-1

  • Prerequisite steps to upgrade the Dell Networking OS from earlier version to 9.14.2.0 or later:
  1. Uninstall the older version of the Open Automation (OA) package
  2. Upgrade the Dell Networking OS to 9.14.2.0 or later version
  3. Install the following OA packages from the respective upgraded version:
    • a. SmartScripts
    • b. Puppet
    • c. Open management infrastructure (OMI)
    • d. SNMP MIB
  • Prerequisite steps to downgrade the Dell Networking OS from 9.14.2.0 or later to the earlier version:
  1. Uninstall the OA package of 9.14.2.0 or later version
  2. Downgrade the Dell Networking OS to an earlier version
  3. Install the respective OA package from an earlier version

For more information about installing, uninstalling and upgrading the Dell Networking OS and OA package, see the respective Dell System Release Notes.
If you downgrade the Dell Networking OS version from 9.14.2.16 to 9.11.0.0 or any older versions, the system displays the following error message even though there is no functional impact:DELL-Technologies-S6000-ON-40GbE-ToR-
Switch-FIG-2

Before downgrading, save the current configuration and then remove the CDB files (confd_cdb.tar.gz.version and confd_cdb.tar.gz). To remove the files, use the following steps:DELL-Technologies-S6000-ON-40GbE-ToR-Switch-
FIG-3

  • In a VXLAN scenario, hybrid port is not supported.
  • While deploying the system in the normal-reload mode in BMP configuration, use the ip ssh server enable command at the beginning of the startup configuration if the write memory command is used at the end of the configuration.
  • When FRRP is enabled in a VLT domain, no flavor of Spanning tree should concurrently be enabled on the nodes of that specific VLT domain. In essence FRRP and xSTP should not co-exist in a VLT environment.
  • The following features are not available in the Dell Networking OS from version 9.7(0.0):
  • PIM ECMP
  • Static IGMP join (ip igmp static-group)
  • IGMP querier timeout configuration (ip igmp querier-timeout)
  • IGMP group join limit (ip igmp group join-limit)
  • You can use the negotiation auto command to turn auto-negotiation on or off only on fiber interfaces operating at 1G speed.
  • When 1024 or more VNI profiles are configured, the system takes more time to load. Dell recommends to restrict the VNI profiles to be less than 1000.
  • If you use the interface range command to select multiple interfaces that are added to the management VRF, the ipv6 address command does not display the autoconfig option. You can configure the autoconfig command on individual interfaces.
  • If you use the interface range command to select multiple interfaces that are added to the management VRF, the ipv6 nd command displays the following options but they do not take effect if you use them:
  • dns-server
  • hop-limit
  • anaged-config-flag
  • ax-ra-interval
  • mtu
  • other-config-flag
  • prefix
  • ra-guard
  • ra-lifetime
  • reachable-time
  • retrans-timer
  • suppress-ra
  • You cannot use the established keyword in an ACL rule, along with the other control flags.
  • While using the established keyword in an ACL rule, all the other TCP control flags are masked, to avoid redundant TCP control flags configuration in a single rule. When you use any TCP control flag in an ACL rule, established is masked and other control flags are available.

Changes to Default Behavior and CLI Syntax

  • If you are upgrading from an earlier OS9 version to 9.14.2.x, ensure you first upgrade to version 9.13.0.0 before upgrading to the required version of 9.14.2.x to prevent any issues during the upgrade procedure.

Upgrading the CPLD

  • The S6000-ON system with Dell Networking OS Version 9.14(2.16) requires System CPLD revision 10, Master CPLD revision 12, and Slave CPLD revision 10.

Verify that a CPLD upgrade is required

  • NOTE: If your CPLD revisions are higher than the ones shown here, DO NOT make any changes. If you have questions regarding the CPLD revision, contact technical support.
  • Use the following command to identify the CPLD version:
  • Use the following command to view CPLD version that is associated with the Dell Networking OS image:DELL-Technologies-S6000-ON-40GbE-ToR-Switch-FIG-5

Installing Dell Networking OS on the S6000-ON using ONIE

  • NOTE: The Dell Networking OS installer package, ONIE-FTOS-SI-ON-9.14.2.16.bin, is required for installing Dell Networking OS on S6000-ON that has only ONIE.
  • To upgrade the ONIE package you have installed, use one of the following two processes: zero touch (dynamic) update or manual update.
  1. Zero touch (dynamic): Copy the update ONIE installer and the DIAG installer for your system to the TFTP/
    HTTP server.Configure the DHCP options using the ONIE specifications shown at the following link: http://opencomputeproject.github.io/onie/docs/design- spec/updater.html
    S6000-ON image >>>> onie-updater-x86_64-dell_s6000_s1220-r0

  2. Manual: Copy the image onto the TFTP/HTTP servers and boot ONIE. Update the ONIE using the onie-self-update command, then download and run an ONIE updater image.The supported URL types are: HTTP, FTP, TFTP, and FILE. S6000-ON image >>>> onie-updater-x86_64-dell_s6000_s1220-r0

  3. UPGRADING ONIE ON AN EXISTING S6000–ON SYSTEM.The following example uses TFTP to upgrade ONIE.DELL-Technologies-S6000-ON-40GbE-ToR-Switch-FIG-6

    • The following example uses HTTP to upgrade ONIE.DELL-Technologies-S6000-ON-40GbE-ToR-Switch-FIG-7
  4. Upgrade the DIAG installer package.DELL-Technologies-S6000-ON-40GbE-ToR-Switch-FIG-8DELL-Technologies-S6000-ON-40GbE-ToR-Switch-FIG-9

  5. Upgrade the BIOS image using the BIOS image and Flashrom utility included with the diagnostic package.DELL-Technologies-S6000-ON-40GbE-ToR-Switch-FIG-10

S6000–ON Upgrade Procedures: Overview

To upgrade the Dell Networking OS to the latest version, complete these steps:

  • NOTE: When upgrading from an earlier version of OS9 (example: 9.10.0.1) to 9.14.2.x, first upgrade to 9.13.0.0 to prevent any issues during the upgrade procedure.
  • Upgrade the S6000–ON Dell Networking OS Image and Boot Code
  • Upgrading the CPLD
  • VLT Upgrade Procedure
Upgrade the S6000-ON Dell Networking OS Image and Boot Code using Dell

Networking OS CLI

Bare Metal Provisioning

NOTE: If you are using Bare Metal Provisioning (BMP), see the Bare Metal Provisioning topic in the Dell Networking OS Configuration Guide or the Open Automation Guide.

Manual Upgrade Procedure
Follow these steps carefully to upgrade your S6000-ON systems:

  1. Dell Networking recommends that you back up your startup configuration and any important files and directories to an external media prior to upgrading the system.

  2. Upgrade the Dell Networking OS in flash partition A: or B: EXEC Privilege Mode upgrade system [flash: | ftp: | stack-unit <1-6 | all> | tftp: | scp: | usbflash:] [A: |B:]DELL-Technologies-S6000-ON-40GbE-ToR-Switch-FIG-11

  3. In case of a stack setup, upgrade the Dell Networking OS for the stacked units.

    • EXEC Privilege Mode upgrade system stack-unit [0-11 | all] [A: | B:]
    • If A: is specified in the command, the Dell Networking OS version present in Management unit’s A: partition will be pushed to the stack units. If B: is specified in the command, the Management unit’s B: will be pushed to the stack units. Upgrade of stack units can be done on individual units by specifying the unit id [1-6] or on all units by using all in the command.DELL-Technologies-S6000-ON-40GbE-ToR-Switch-FIG-12
  4. Verify that the Dell Networking OS has been upgraded correctly in the upgraded flash partition. EXEC Privilege Mode show boot system stack-unit [1-6 | all]DELL-Technologies-S6000-ON-40GbE-ToR-Switch-FIG-13

  5. Upgrade the S6000-ON Boot Flash and Boot Selector images

    • EXEC Privilege Mode
    • upgrade boot [all | bootflash-image | bootselector-image] stack-unit [1-6 | all] [booted | flash: | ftp: | scp: | tftp: | usbflash:]
    • Dell Networking OS version 9.14(2.16) requires S6000-ON Boot Flash image version 3.20.2.5 and Boot Selector image version 3.20.0.3. The Boot Flash and Boot Selector images can be upgraded together by selecting all in the command. If the user wants to upgrade Boot Flash image or Boot Selector image separately, the options bootflash-image or bootselector-image needs to be given separately in the command. The booted option is used to upgrade the Boot flash and Boot Selector images to the image versions packed with the loaded Dell Networking OS image. The Boot Flash and Boot Selector image
      versions packed with the loaded Dell Networking OS can be found using the show os-version command in EXEC PRIVILEGE mode. Dell #upgrade boot all stack-unit 1 bootedDELL-Technologies-S6000-ON-40GbE-ToR-Switch-
FIG-15DELL-Technologies-S6000
-ON-40GbE-ToR-Switch-FIG-16
  6. Change the Primary Boot Parameter of the S6000-ON to the upgraded partition A: or B: CONFIGURATION Mode boot system stack-unit [1–6 | all] primary system: [A: | B: | tftp: | ftp:]

  7. Save the configuration so that the configuration will be retained after a reload using write memory command. EXEC Privilege Mode write memoryDELL-Technologies-S6000-ON-40GbE-ToR-Switch-FIG-17

  8. Reload the unit. EXEC Privilege Mode reload

  9. Verify that the ONIE has been upgraded to the Dell Networking OS version 9.14(2.16). EXEC Privilege Mode show versionDELL-Technologies-S6000-ON-40GbE-ToR-Switch-FIG-19DELL-Technologies-S6000-ON-40GbE-ToR-Switch-FIG-20

  10. Verify that the S6000–ON has been upgraded to the latest Boot Flash and Boot Selector images. EXEC Privilege Mode show system stack-unit [1-6]DELL-Technologies-S6000-ON-40GbE-ToR-Switch-FIG-21

Upgrading the CPLD

The S6000-ON system with Dell Networking OS Version 9.14(2.16) requires System CPLD revision 10, Master CPLD revision 12, and Slave CPLD revision 10.

NOTE: For the Port LEDs to work properly with the Dell Networking OS version 9.9(0.0P5), downgrade the CPLD version to 12.

Verify that a CPLD upgrade is required

Use the following command to identify the CPLD version:

Use the following command to view CPLD version that is associated with the Dell Networking OS image:DELL-Technologies-S6000-ON-40GbE-ToR-Switch-
FIG-23

Upgrading the CPLD Image

NOTE: The upgrade fpga-image stack-unit 1 booted command is hidden when using the FPGA Upgrade feature in the CLI. However, it is a supported command and will be accepted when entered as documented.
NOTE: Ensure that the BIOS version is 3.20.0.3 or above. You can verify this version using show system stack-unit 1 command.

To upgrade the CPLD image on S6000-ON, follow these steps:

  1. Upgrade the CPLD image. EXEC Privilege Mode upgrade fpga-image stack-unit [1–6] bootedDELL-Technologies-S6000-ON-40GbE-ToR-Switch-FIG-24
  2. Power cycle the system physically. Switch off the system by unplugging the power chords from the REAR PSUs and wait until the PSU FAN–REAR STATUS LED is completely OFF.
    • NOTE: Do not switch on the system with PSU–REAR LED glowing AMBER.
  3. Switch on the system and wait for the Dell prompt. The CPLD version can be verified using the show revision command. EXEC Privilege Mode show revision
    • NOTE: Do not use power-cycle stack-unit command to power cycle the system and do not power off the system while FPGA upgrade is in progress. For any queries, contact technical support.

Uninstalling Dell Networking OS from the S6000-ON

To uninstall the Dell Networking OS version 9.14(2.16) from the S6000-ON device, perform the following steps:

  1. Reboot the system. During the reboot process, the system displays the following message prompting you to press the Esc key in order to stop the auto-boot process:DELL-Technologies-S6000-ON-40GbE-ToR-Switch-FIG-26
  2. At this prompt message, press the Esc key. The following menu appears:
  3. From the menu, choose the ONIE option.
    • NOTE: To choose an option from the menu, highlight one of the options using the up or down arrow key and press Enter.
    • The following menu appears:
  4. From this menu, choose the ONIE : Uninstall OSoption.
    • NOTE: To choose an option from the menu, highlight one of the options using the up or down arrow key and press Enter.
    • The uninstall process begins. Following is the log generated by the system while Dell Networking OS 9.14(2.16) uninstalls:DELL-Technologies-S6000-ON-40GbE-ToR-Switch-FIG-29 DELL-Technologies-S6000-ON-40GbE-ToR-Switch-FIG-30DELL-Technologies-S6000-ON-40GbE-ToR-Switch-FIG-31 DELL-Technologies-S6000-ON-40GbE-ToR-Switch-FIG-32
  5. After the installation completes, the system displays the following ONIE prompt: ONIE:/ #

Documentation Corrections

  • This section describes the errors identified in the current release of the Dell Networking OS.
  • The router bgp command allows you to configure only one L3 interface with an IPv4 address.
  • The Configuration guide does not mention this limitation and will be corrected in the next release of the guide.

Deferred Issues

  • Issues that appear in this section were reported in Dell Networking OS version 9.14(2.0) as open, but have since been deferred. Deferred caveats are those that are found to be invalid, not reproducible, or not scheduled for resolution.
  • Deferred issues are reported using the following definitions.

Category Description

  • PR# Problem Report number that identifies the issue.
  • Severity S1 — Crash: A software crash occurs in the kernel or a running process that requires a restart of AFM, the router, switch, or process.
  • S2 — Critical: An issue that renders the system or a major feature unusable, which can have a pervasiveimpact on the system or network, and for which there is no work-around acceptable to the customer.
  • S3 — Major : An issue that affects the functionality of a major feature or negatively effects the network for which there exists a work-around that is acceptable to the customer.
  • S4 — Minor : A cosmetic issue or an issue in a minor feature with little or no network impact for which there might be a work-around.
  • Synopsis Synopsis is the title or short description of the issue.
  • Release Notes Release Notes description contains more detailed information about the issue.
  • Work around Work around describes a mechanism for circumventing, avoiding, or recovering from the issue. It might not be a permanent solution.
  • Issues listed in the “Closed Caveats” section should not be present, and the work-around is unnecessary, as the version of code for which this release note is documented has resolved the caveat.

Deferred S6000-ON 9.14(2.0) Software Issues

  • Issues that appear in this section were reported in Dell Networking OS version 9.14(2.0) as open, but have since been deferred.
  • Deferred caveats are those that are found to be invalid, not reproducible, or not scheduled for resolution.
  • The following issues have been deferred in the Dell Networking OS version 9.14(2.0): None.

Fixed Issues

  • Fixed issues are reported using the following definitions.

Category Description

  • PR# Problem Report number that identifies the issue.
    • Severity S1 — Crash: A software crash occurs in the kernel or a running process that requires a restart of AFM, the router, switch, or process.
  • S2 — Critical: An issue that renders the system or a major feature unusable, which can have a pervasive impact on the system or network, and for which there is no work-around acceptable to the customer.
    • S3 — Major: An issue that affects the functionality of a major feature or negatively effects the network for which there exists a work-around that is acceptable to the customer.
  • S4 — Minor: A cosmetic issue or an issue in a minor feature with little or no network impact for which there might be a work-around.
    • Synopsis Synopsis is the title or short description of the issue.
  • Release Notes Release Notes description contains more detailed information about the issue.
    • Work around Work around describes a mechanism for circumventing, avoiding, or recovering from the issue. It might not be a permanent solution.
  • Issues listed in the “Closed Caveats” section should not be present, and the work-around is unnecessary, as the version of code for which this release note is documented has resolved the caveat.

Fixed S6000-ON 9.14(2.16) Software Issues

  • NOTE: Dell Networking OS 9.14(2.16) includes fixes for caveats addressed in the previous 9.14 releases. Refer to the respective release notes documentation for the list of caveats fixed in the earlier 9.14 releases.

The following caveats have been fixed in Dell Networking OS version 9.14(2.16):
PR# 170307

  • Severity: Sev 3
  • Synopsis: In certain scenarios, when SSH daemon crashes the switch becomes inaccessible.
  • Release Notes: In certain scenarios, when SSH daemon crashes the switch becomes inaccessible.
  • Workaround: None

Known Issues

  • Known issues are reported using the following definitions.

Category Description

  • PR# Problem Report number that identifies the issue.
  • Severity S1Crash: A software crash occurs in the kernel or a running process that requires a restart of AFM, the router, switch, or process.
  • S2CriticaBl: An issue that renders the system or a major feature unusable, which can have a pervasive impact on the system or network, and for which there is no work-around acceptable to the customer.
  • S3Major: An issue that affects the functionality of a major feature or negatively effects the network for which there exists a work-around that is acceptable to the customer.
  • S4Minor: A cosmetic issue or an issue in a minor feature with little or no network impact for which there might be a work-around.

Category Description

  • Synopsis Synopsis is the title or short description of the issue.
    • Release Notes Release Notes description contains more detailed information about the issue.
  • Work around Work around describes a mechanism for circumventing, avoiding, or recovering from the issue. It might not be a permanent solution.
    • Issues listed in the “Closed Caveats” section should not be present, and the work-around is unnecessary, as the version of code for which this release note is documented has resolved the caveat.

KnownS6000-ON 9.14(2.16) Software Issues

  • The following caveats are open in Dell Networking OS version 9.14(2.16) None

Support Resources

  • The following support resources are available for theS6000 system.

Documentation Resources

  • This document contains operational information specific to the S6000–ON system.
  • For information about using the S6000–ON, refer to the following documents at http://www.dell.com/support:
  • Installing the S6000-ON System
  • Quick Start Guide
  • Dell Networking Command Line Reference Guide for the S6000-ON System
  • Dell Networking Configuration Guide for the S6000-ON System
  • For more information about hardware features and capabilities, refer to the Dell Networking website at https://www.dellemc.com/networking.
  • For more information about the open network installation environment (ONIE)-compatible third-party operating system, refer to http://onie.org.

Issues

  • Issues are unexpected or incorrect behavior and are listed in order of Problem Report (PR) number within the appropriate sections.

Finding Documentation

  • This document contains operational information specific to the S6000–ON system.
    ● For information about using the S6000–ON, refer to the documents at http://www.dell.com/support.
    ● For more information about hardware features and capabilities, refer to the Dell Networking website at https://www.dellemc.com/networking.
    ● For more information about the open network installation environment (ONIE)-compatible third-party operating system, refer to http://onie.org.

Contacting Dell

  • NOTE: If you do not have an active Internet connection, you can find contact information on your purchase invoice, packing slip, bill, or Dell product catalog.
  • Dell provides several online and telephone-based support and service options. Availability varies by country and product, and some services may not be available in your area. To contact Dell for sales, technical support, or customer service issues:
  • Go to www.dell.com/support.

Notes, cautions, and warnings

  • NOTE: A NOTE indicates important information that helps you make better use of your product.
  • CAUTION: A CAUTION indicates either potential damage to hardware or loss of data and tells you how to avoid the problem.
  • WARNING: A WARNING indicates a potential for property damage, personal injury, or death.
  • © 2022 Dell Inc. or its subsidiaries. All rights reserved. Dell, EMC, and other trademarks are trademarks of Dell Inc. or its subsidiaries. Other trademarks may be trademarks of their respective owners.

References

Read User Manual Online (PDF format)

Read User Manual Online (PDF format)  >>

Download This Manual (PDF format)

Download this manual  >>

DELL Technologies User Manuals

Related Manuals