Dell EMC Networking Switch S4148-ON/S4128-ON User Manual
- June 6, 2024
- Dell
Table of Contents
Dell EMC Networking S4148-ON and S4128-ON
Switch Configuration Guide for Dell EMC SC Series SANs
Abstract
This document illustrates how to configure Dell EMC™ Networking S4148-ON and
S4128-ON switches for use with Dell EMC SC Series storage using Dell EMC best
practices.
October 2017
Dell EMC Configuration and Deployment Guide
Revisions
| Date | Revision |
|---|---|
| Oct-17 | Initial release |
The information in this publication is provided “as is.” Dell Inc. makes no
representations or warranties of any kind with respect to the information in
this publication and specifically disclaims implied warranties of
merchantability or fitness for a particular purpose.
Use, copying, and distribution of any software described in this publication
require an applicable software license.
© 2017 Dell Inc. or its subsidiaries. All Rights Reserved. Dell, EMC, Dell
EMC, and other trademarks are trademarks of Dell Inc. or its subsidiaries.
Other trademarks may be trademarks of their respective owners.
Dell believes the information in this document is accurate as of its
publication date. The information is subject to change without notice.
Introduction
This document illustrates how to configure Dell EMC™ Networking S4148-ON and
S4128-ON switches for use with Dell EMC SC Series storage using Dell EMC best
practices.
The host servers and storage controllers can be connected to the switches
using the QSFP+ and QSFP28 ports with appropriate breakout cables. The
switches are interconnected to each other using 40GbE cables or 100GbE cables.
Optional steps are provided in section 3 to enable Data Center Bridging (DCB).
For more information on SC Series SAN design recommendations, see the Storage
Center System Manager Administrator’s Guide and the Storage Center Deployment
Guide at the Customer Portal (login
required).
1.1 Document conventions
Table 1 lists the formatting conventions used in this document.
Table1 Document conventions
Format
| Description|
Example
---|---|---
Bold| User input| OS# show version
Bold Italic| User input (variable)| OS# my password
< Italic>
1.2 Audience
This switch configuration guide describes an optimal configuration following
Dell EMC’s best practices for a SC Series iSCSI SAN and is intended for
storage or network administrators and deployment personnel.
1.3 Switch details
Table 2 provides an overview of the switch configuration.
Table 2 Switch specifications
Dell EMC Networking S4148-0N/S4128-ON
Switch vendor| Dell EMC
Switch model| S4148U-ON, S4148F-ON, S4148FE-ON, S4148T-ON, S4128FON,
and S4128T-ON
Switch firmware| 10.3.1 or later
Note: For proper functionality, the switch must be at the switch firmware
version shown in Table 2 before proceeding with this configuration. Using
previous firmware versions may have unpredictable results.
Note: The latest firmware updates and documentation can be found at
Dell.com/support.
1.4 Cabling diagram
The cabling diagram shown in Figure 1 represents the Dell EMC recommended
method for deploying servers and SC Series arrays.
Dell EMC recommended switch configuration
The steps in this section show how to configure two Dell EMC Networking
S4148-ON/S4128-ON switches in the Dell SC series storage environment.
Note: The configuration steps in this section are only recommended when
the switch is used as a dedicated SAN for iSCSI traffic.
2.1 Hardware configuration
- Power on the two switches.
- Connect a serial cable to the serial port of the first switch.
- Using PuTTY or another terminal utility, open a serial connection session to the switch.
- Open the terminal emulator and configure it to use the serial port (COM1, COM2). Configure serial communications for 115200 N,8,1, and no flow control.
Note: This example assumes a switch at its default configuration
settings. Always back up the configuration settings prior to performing any
configuration changes.
2.1 Check the firmware version
OS10# **show version**Note: If the active version displayed here is not 10.3.1.x or later,
visit Dell.com/support and download the latest
update for the switches.
2.2 Delete the startup configuration
Note: The following commands will delete all configuration settings.
OS10# **delete startup-configuration**
Proceed to delete startup-config [confirm yes/no(default)] **yes**
OS10# **reload**
System configuration has been modified. Save? [yes/no] **no**
Proceed to reboot the system? [confirm yes/no] **yes**Note: The switch will reboot. After the startup configuration is deleted,
the factory default password is admin.
2.3 Switch profiles (only for S4148-ON and its variants)
On the S4148-ON switch and its variants, switch port profiles determine the
available front-panel Ethernet ports and supported breakout interfaces on
uplink ports. Refer to the switch user’s guide to determine which switch
profile fits your environment.
Note: Changing switch profiles will delete all configuration information
from the switch except for the management port configuration. Save and reload
the switch for the new switch profile to take effect.
OS10# **configure terminal**
OS10(config)# **switch-port-profile 1/1 profile- <number>**
Warning: Switch port profile will be applied only after a save and reload. All
management port configurations will be retained but all other configurations
will be wiped out after the reload.
OS10(config)# **exit**
OS10# **copy running-configuration startup-configuration**
OS10# **reload**
Proceed to reboot the system? [confirm yes/no] **yes**2.4 Configure unified ports on S4148U-ON
Note: This section applies to the S4148U-ON switch only. Skip this
section if using other switches.
This section configures unified ports on S4148U-ON switches to Ethernet ports.
Refer to the switch user’s guide for further details. Port-group 1/1/1-1/1/6
refers to the first 24 SFP+ ports on the switch. Use the following commands to
convert these ports to Ethernet ports.
OS10# **configure terminal**
OS10(config)# **port-group 1/1/ <port-group-number>**
OS10(conf-pg-1/1/1)# **mode Eth 10g-4x**
OS10(conf-pg-1/1/1)# **exit**
OS10(config)#Repeat the prior steps for port-group 1/1/1 to 1/1/6.
Note: QSFP+ and QSFP28 ports are by default in Ethernet mode. They can be
configured by configuring port-group 1/1/7-1/1/10 using the prior commands.
Refer to the S4148-ON switch user’s guide for more information.
2.5 Configure out of band (OOB) management port
OS10(config)# **interface mgmt 1/1/1**
OS10(conf-if-ma-1/1/1)# **no ip address dhcp**
OS10(conf-if-ma-1/1/1)# **ip address <ipaddress>/<subnet>**
OS10(conf-if-ma-1/1/1)# **exit**
OS10(config)#2.6 Configure login credentials
OS10(config)# **username admin password $0$ <password> **2.7 Configure QSPF+ and QSFP28 ports to 4 x 10GbE breakout ports
QSFP+ and QSFP28 ports on S4148-ON and S4128-ON switches can be configured as
breakouts to be used with 10GbE iSCSI storage or server network adapters. To
configure these ports as 4 x 10GbE ports, use the following commands.
OS10(config)# **interface breakout 1/1/ <port-number> map 10g-4x**
OS10(config)# **exit**
OS10#Use the following command to check the port interface status:
OS10# **show interface status**2.8 Enable switch ports
Switch ports are enabled and are configured switch port mode access by
default for S4148-ON and S4128-ON switches. If choosing to reconfigure the
ports, use the following steps.
Option 1: Enable ports individually by entering the port number.
OS10# **configure terminal**
OS10(config)# **interface ethernet 1/1/1**Note: For ports configured as 4 x 10GbE breakout ports, use the following command in which 1/1 represents the switch number, xx represents a port number, and yy represents sub port number:
OS10(conf)# **interface ethernet 1/1/xx:yy**
OS10(conf-if-eth1/1/1)# **switchport mode access**
OS10(conf-if-eth1/1/1)# **no shutdown**
OS10(conf-if-eth1/1/1)# **exit**Option 2: Enable multiple ports at once using the range parameter.
OS10# **configure terminal**
OS10(config)# **interface range ethernet 1/1/1–1/1/54**Note: For ports configured as 4 x 10GbE breakout ports, use the following command in which 1/1 represents the switch number, xx represents port number, and yy represents sub port number:
OS10(conf)# **interface range ethernet 1/1/xx:yy-1/1/xx:yy**
OS10(conf-range-eth1/1/1-1/1/54)# **switchport mode access**
OS10(conf-range-eth1/1/1-1/1/54)# **no shutdown**
OS10(conf-range-eth1/1/1-1/1/54)# **exit**2.9 iSCSI enable
The steps in this section enable iSCSI auto-detection of attached storage
arrays and switch autoconfiguration.
Dell PS Series and SC Series storage arrays are detected by the switch when
iscsi is enabled. The switch will auto-configure for Jumbo frames with MTU
9216 and flowcontrol receive on, and transmit off for all the ports. The ports
detected to be connected to the storage units are auto-configured as spanning-
tree edge ports with unicast storm control disabled.
OS10(config)# **iscsi enable**
OS10(config)# **iscsi session-monitoring enable**Note: Do not change the LLDP description on the SC Series array. Changing
this will disable iSCSI storage detection and iSCSI auto-configuration.
Note: iSCSI auto-configuration on OS10 switch ports is not supported with
QLogic® QLE4062 network adapters on SC Series arrays.
2.10 Enable Jumbo frames and flow control (optional)
Note: This step is optional because iSCSI auto-detection and auto-
configuration enabled in the previous step will enable Jumbo frames with MTU
9216 and enable receive flow control on all ports, once PS Series or SC Series
storage ports are detected on the switch.
OS10(config)# **interface range ethernet 1/1/1 – 1/1/54**
OS10(conf-range-eth1/1/1-1/1/54)# **mtu 9216**
OS10(conf-range-eth1/1/1-1/1/54)# **flowcontrol receive on**
OS10(conf-range-eth1/1/1-1/1/54)# **flowcontrol transmit off**2.11 Configure spanning tree on edge ports
OS10(conf-range-eth1/1/1-1/1/54)# **spanning-tree port type edge**
OS10(conf-range-eth1/1/1-1/1/54)# **exit**Note: Spanning tree is enabled by default. If there is a need to reconfigure it, use the following command.
OS10(config)# **no spanning-tree disable**
OS10(config)# **exit**2.12 Save configuration
OS10# **copy running-configuration startup-configuration**
OS10# **reload**
System configuration has been modified. Save? [yes/no]: **yes**
Proceed to reboot the system? [confirm yes/no]: **yes**2.13 Configure additional switch
Repeat the commands from section 2 to configure the second switch.
Note: The preceding procedure places all switch ports in the default
VLAN. If preferring to place ports in a non-default VLAN, refer to the switch
documentation.
Configure Data Center Bridging (DCB) (optional)
To enable DCB mode on the switch, use the commands in this section.
Note: Complete the switch configuration steps in section 2 before
configuring the switch for DCB mode.
Note: DCB switch configuration is applicable only for environments with
DCB-capable SC Series arrays.
3.1 Disable iSCSI
OS10# **configure terminal**
OS10(config)# **no iscsi enable**
OS10(config)# **no iscsi session-monitoring enable**3.2 Disable 802.3x flow control on all ports
OS10# **configure terminal**
OS10(config)# **interface range ethernet 1/1/1–1/1/54**
OS10(conf-range-eth1/1/1-1/1/54)# **no flowcontrol receive**
OS10(conf-range-eth1/1/1-1/1/54)# **no flowcontrol transmit**
OS10(conf-range-eth1/1/1-1/1/54)# **exit**
OS10(config)#3.3 Enable DCB
OS10(config)# **dcbx enable**3.4 Create tagged VLAN for all ports and port-channels
Note: You must supply a VLAN ID. The valid range is 2-4093.
The following commands configure a single VLAN ID. If desired, multiple VLAN
IDs can be created on the switch and assigned to ports.
OS10(config)# **interface vlan <vlan-id>**
OS10(conf-if-vl-<vlan-id>)# **mtu 9216**
OS10(conf-if-vl-<vlan-id>)# **no shutdown**
OS10(conf-if-vl-<vlan-id>)# **exit**3.5 Create QoS policy-map with dot1p values as trusted
OS10(config)# **policy-map type qos <trust-policy-map-name>**
OS10(config-pmap-qos)# **class class-trust**
OS10(config-pmap-c-qos)# **trust dot1p**
OS10(config-pmap-c-qos)# **exit**
OS10(config-pmap-qos)# **exit**
OS10(config)#3.6 Create PFC dot1p traffic class
The following commands configure a network QoS class-map and match the iSCSI
traffic class.
OS10(config)# **class-map type network-qos <iSCSI-class-map-name>**
OS10 (config-cmap-nqos)# **match qos-group 4**
OS10 (config-cmap-nqos)# **exit**
OS10(config)#3.7 Configure network QoS policy map
OS10(config)# **policy-map type network-qos <policy-map-name>**
OS10(config-pmap-network-qos)# **class <iSCSI-class-map-name>**
OS10 (config-pmap-c-nqos)# **pause**
OS10 (config-pmap-c-nqos)# **pfc-cos 4**
OS10 (config-pmap-c-nqos)# **exit**
OS10(config-pmap-network-qos)# **exit**
OS10(config)#
OS10(config)# **policy-map type application <qos-policy-map-name>**
OS10(config-pmap-application)# **class class-iscsi**
OS10 (config-pmap-c-app)# **set qos-group 4**
OS10 (config-pmap-c-app)# **set cos 4**
OS10 (config-pmap-c-app)# **exit**
OS10(config-pmap-application)# **exit**
OS10(config)#3.8 Configure ETS policies
OS10(config)# **qos-map traffic-class <queue-map-name>**
OS10(config-qos-map)# **queue 0 qos-group 0-3,5-7**
OS10(config-qos-map)# **queue 4 qos-group 4**
OS10(config-qos-map)# **exit**
OS10(config)#
OS10(config)# **class-map type queuing <LAN-traffic-map-name>**
OS10(config-cmap-queuing)# **match queue 0**
OS10(config-cmap-queuing)# **exit**
OS10(config)#
OS10(config)# **class-map type queuing <iSCSI-traffic-map-name>**
OS10(config-cmap-queuing)# **match queue 4**
OS10(config-cmap-queuing)# **exit**
OS10(config)#3.9 Create an ETS policy map for bandwidth allocations
OS10(config)# **policy-map type queuing <queuing-policy-name>**
OS10(config-pmap-queuing)# **class <LAN-traffic-map-name>**
OS10(config-pmap-c-que)# **bandwidth percent <bandwidth-percentage>**
OS10(config-pmap-c-que)# **class <iSCSI-traffic-map-name>**
OS10(config-pmap-c-que)# **bandwidth percent <bandwidth-percentage>**
OS10(config-pmap-c-que)# **exit**
OS10(config-pmap-queuing)# **exit**
OS10(config)#Note: The sum of the bandwidth percentages must equal 100. Monitor the
LAN and SAN performance in your environment to determine optimal bandwidth
settings.
3.10 QoS policy
OS10(config)# **system QoS**
OS10(config-sys-qos)# **service-policy input type qos <trust-policy-map-name>**
OS10(config-sys-qos)# **service-policy type application <qos-policy-map-name>**
OS10(config-sys-qos)# **ets mode on**
OS10(config-sys-qos)# **exit**
OS10(config)#3.11 Apply policies and VLAN ID to all switch edge ports
OS10(config)# **interface range ethernet 1/1/1-1/1/54**
OS10(conf-range-eth1/1/1-1/1/54)# **switchport mode trunk**
OS10(conf-range-eth1/1/1-1/1/54)# **switchport trunk allowed vlan <vlan-id>**
OS10(conf-range-eth1/1/1-1/1/54)# **service-policy input type network-qos <policymap-name>**
OS10(conf-range-eth1/1/1-1/1/54)# **service-policy output type queuing <queuingpolicy-name>**
OS10(conf-range-eth1/1/1-1/1/54)# **ets mode on**
OS10(conf-range-eth1/1/1-1/1/54)# **qos-map traffic-class <queue-map-name>**
OS10(conf-range-eth1/1/1-1/1/54)# **priority-flow-control mode on**
OS10(conf-range-eth1/1/1-1/1/54)# **exit**
OS10(config)#3.12 iSCSI enable
OS10(config)# **iscsi enable**
OS10(config)# **iscsi session-monitoring enable**
OS10(config)# **exit**3.13 Save configuration
OS10# **copy running-configuration startup-configuration**3.14 Show commands to verify DCBx, ETS, and PFC status on individual ports
OS10# s **how lldp dcbx interface ethernet 1/1/ <port-number>**
OS10# **show lldp dcbx interface ethernet 1/1/ <port-number> pfc detail**
OS10# **show lldp dcbx interface ethernet 1/1/ <port-number> ets detail**3.15 Configure additional switches
Repeat the commands from section 3 to configure DCB on additional switches.
Revert from DCB to non-DCB configuration (optional)
One method to revert from a DCB configured switch to a non-DCB configured
switch is to delete the current configuration (startup-config) and follow the
steps in section 2. If deleting the current configuration is not an option,
use the following procedure to unconfigure DCB and enable standard flow
control.
Note: This is a disruptive operation that requires downtime. The arrays
will temporarily lose communication with each other. Power off all arrays and
hosts connected to the SAN before proceeding with these steps.
4.1 Disable DCB
OS10# **configure terminal**
OS10(config)# **no dcbx enable**
OS10(config)#4.2 Disable iSCSI
OS10(config)# **no iscsi enable**
OS10(config)# **no iscsi session-monitoring enable**4.3 Remove DCB policies and apply standard flow control on edge ports
OS10(config)# **interface range ethernet 1/1/1-1/1/54**
OS10(conf-range-eth1/1/1-1/1/54)# **no priority-flow-control**
OS10(conf-range-eth1/1/1-1/1/54)# **no qos-map traffic-class**
OS10(conf-range-eth1/1/1-1/1/54)# **no ets**
OS10(conf-range-eth1/1/1-1/1/54)# **no service-policy output type queuing <queuing-policy-name>**
OS10(conf-range-eth1/1/1-1/1/54)# **no service-policy input type network-qos <policy-map-name>**
OS10(conf-range-eth1/1/1-1/1/54)# **no switchport trunk allowed vlan <vlan-id>**
OS10(conf-range-eth1/1/1-1/1/54)# **no switchport mode**
OS10(conf-range-eth1/1/1-1/1/54)# **switchport mode access**
OS10(conf-range-eth1/1/1-1/1/54)# **flowcontrol receive on**
OS10(conf-range-eth1/1/1-1/1/54)# **flowcontrol transmit off**
OS10(conf-range-eth1/1/1-1/1/54)# **exit**
OS10(config)#4.4 Revert to default VLAN ID on switch and arrays
Once DCB is disabled on the switch, the SC Series arrays will no longer use
the VLAN ID that was configured when DCB was enabled. The arrays will revert
to the default or native VLAN. Therefore, a valid VLAN must be configured for
all host servers, switches, and SC Series array members. A valid VLAN can use
the default or native VLAN ID (typically 0 or 1), or a specific VLAN can be
configured (for example, VLAN 100). If a non-default VLAN is configured, any
ports connected to the arrays must be configured as untagged.
The steps in section 4.3 revert the switch ports to default native VLAN 1. Use
the following command to remove VLANs other than VLAN 1 from the switch
configuration.
OS10(config)# **no interface vlan <vlan-id>**4.5 Remove ETS, PFC, and other policies from the switch configuration
OS10(config)# **no policy-map type queuing <queuing-policy-name>**
OS10(config)# **no class-map type queuing <LAN-traffic-map-name>**
OS10(config)# **no class-map type queuing <iSCSI-traffic-map-name>**
OS10(config)# **system qos**
OS10(config-sys-qos)# **no ets**
OS10(config-sys-qos)# **no service-policy input type qos <trust-policy-map-name>**
OS10(config-sys-qos)# **no service-policy type application <qos-policy-map-name>**
OS10(config-sys-qos)# **exit**
OS10(config)# **no policy-map type network-qos <policy-map-name>**
OS10(config)# **no policy-map type qos <trust-policy-map-name>**
OS10(config)# **policy-map type application <qos-policy-map-name>**
OS10(config-pmap-application)# **no class class-iscsi**
OS10(config-pmap-application)# **exit**
OS10(config)# **no qos-map traffic-class <queue-map-name>**
OS10(config)# **no class-map type network-qos <iSCSI-class-map-name>**
OS10(config)# **no class-map type application <qos-policy-map-name>**
OS10(config)#4.6 iSCSI enable
OS10(config)# **iscsi enable**
OS10(config)# **iscsi session-monitoring enable**
OS10(config)# **exit**4.7 Save configuration
OS10# **copy running-configuration startup-configuration**4.8 Reload
OS10# **reload** Proceed to reboot the system? [confirm yes/no]: **yes**Note: The switch will reboot.
4.9Verify DCB status
OS10# **show lldp dcbx interface ethernet 1/1/ <port-number>**4.10 Configure additional switch
Repeat the commands from section 4 to disable DCB on additional switches.
A. Technical support and resources
Dell.com/support is focused on meeting customer needs with proven services and
support.
Dell TechCenter is an online technical community where IT professionals
have access to numerous resources for Dell EMC software, hardware, and
services.
Storage Solutions Technical Documents on Dell TechCenter provide the expertise that helps to ensure
customer success on Dell EMC storage platforms.
A.1 Related resources
Referenced or recommended publications:
Dell EMC Storage Compatibility Matrix
For SC Series best practices white papers, reference architectures, and sizing
guidelines for enterprise applications and SANs, refer to SC Series Technical
Documents.
19 Dell EMC Networking S4148-ON and S4128-ON Switch Configuration
Guide for Dell EMC SC Series SANs
SCG3704
References
Read User Manual Online (PDF format)
Read User Manual Online (PDF format) >>