Unsolved
This post is more than 5 years old
37 Posts
0
2555
October 25th, 2018 09:00
Dell equallogic PS4110
Warning health conditions currently exist... Correct these conditions before they affect array operation....An invalid switch configuration has been detected on one or more interfaces...There are 1 outstanding health conditions. Correct these conditions before they affect array operation.
I am getting these issues after updating MXL and powerconnect firmware.
No Events found!
dwilliam62
4 Operator
•
1.5K Posts
0
October 25th, 2018 10:00
Hello,
That's actually a pretty easy one to fix. It will require a small outage though. Data Center Bridging (DCB) has been enabled on that switch but isn't configured. This disables traditional flowcontrol from working.
You need to disable DCB on the switches and then restart the switches. Then those messages should go away.
You do want to make sure that flowcontrol TX/RX are enabled on the switch ports for the EQL SAN and any server ports.
This website has guides for various switches including the MXL
https://www.dell.com/support/article/us/en/04/sln310825/switch-configuration-guides-for-sc-series-or-ps-series-sans?lang=en
Here is a link directly to the MXL guide
https://downloads.dell.com/manuals/all-products/esuprt_software/esuprt_it_ops_datcentr_mgmt/general-solution-resources_white-papers9_en-us.pdf
Regards,
Don
Parweez
37 Posts
0
October 25th, 2018 10:00
MXL-A1(conf)#
MXL-A1(conf)#exit
MXL-A1#show running-config
Current Configuration ...
! Version 9.13(0.1)
! Last configuration change at Mon Mar 26 09:04:12 2018 by admin
!
boot system stack-unit 0 primary system: A:
boot system stack-unit 0 secondary system: B:
boot system stack-unit 0 default system: B:
!
hostname MXL-A1
!
protocol lldp
dcbx version cee
!
redundancy auto-synchronize full
!
enable password 7 b125455cf679b20820f3b77d4197ce56aa10d4c8e9def1bb
!
username admin password 7 57d58c586b676ba75a75f61c613c361f privilege 15
username root password 7 d7acc8a1dcd4f698 privilege 15
!
protocol spanning-tree rstp
no disable
!
stack-unit 0 provision MXL-10/40GbE
!
stack-unit 0 port 41 portmode quad
!
stack-unit 0 port 45 portmode quad
!
stack-unit 0 port 49 portmode quad
!
stack-unit 0 port 53 portmode quad
!
interface TenGigabitEthernet 0/1
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/2
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/3
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/4
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/5
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/6
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/7
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/8
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/9
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree mstp edge-port
spanning-tree rstp edge-port
spanning-tree 0 portfast
spanning-tree pvst edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/10
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree mstp edge-port
spanning-tree rstp edge-port
spanning-tree 0 portfast
spanning-tree pvst edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/11
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree mstp edge-port
spanning-tree rstp edge-port
spanning-tree 0 portfast
spanning-tree pvst edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/12
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree mstp edge-port
spanning-tree rstp edge-port
spanning-tree 0 portfast
spanning-tree pvst edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/13
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree mstp edge-port
spanning-tree rstp edge-port
spanning-tree 0 portfast
spanning-tree pvst edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/14
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree mstp edge-port
spanning-tree rstp edge-port
spanning-tree 0 portfast
spanning-tree pvst edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/15
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/16
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/17
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/18
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/19
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/20
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/21
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/22
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/23
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/24
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/25
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/26
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/27
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/28
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/29
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/30
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/31
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/32
no ip address
mtu 12000
portmode hybrid
switchport
spanning-tree rstp edge-port
!
protocol lldp
no shutdown
!
interface fortyGigE 0/33
no ip address
mtu 12000
!
port-channel-protocol LACP
port-channel 1 mode active
!
protocol lldp
no shutdown
!
interface fortyGigE 0/37
no ip address
mtu 12000
!
port-channel-protocol LACP
port-channel 1 mode active
!
protocol lldp
no shutdown
!
interface TenGigabitEthernet 0/41
no ip address
mtu 12000
portmode hybrid
switchport
shutdown
!
interface TenGigabitEthernet 0/42
no ip address
mtu 12000
portmode hybrid
switchport
shutdown
!
interface TenGigabitEthernet 0/43
no ip address
mtu 12000
portmode hybrid
switchport
shutdown
!
interface TenGigabitEthernet 0/44
no ip address
mtu 12000
portmode hybrid
switchport
shutdown
!
interface TenGigabitEthernet 0/45
no ip address
mtu 12000
portmode hybrid
switchport
shutdown
!
interface TenGigabitEthernet 0/46
no ip address
mtu 12000
portmode hybrid
switchport
shutdown
!
interface TenGigabitEthernet 0/47
no ip address
mtu 12000
portmode hybrid
switchport
shutdown
!
interface TenGigabitEthernet 0/48
no ip address
mtu 12000
portmode hybrid
switchport
shutdown
!
interface TenGigabitEthernet 0/49
no ip address
mtu 12000
portmode hybrid
switchport
shutdown
!
interface TenGigabitEthernet 0/50
no ip address
mtu 12000
portmode hybrid
switchport
shutdown
!
interface TenGigabitEthernet 0/51
no ip address
mtu 12000
portmode hybrid
switchport
shutdown
!
interface TenGigabitEthernet 0/52
no ip address
mtu 12000
portmode hybrid
switchport
shutdown
!
interface TenGigabitEthernet 0/53
no ip address
mtu 12000
portmode hybrid
switchport
shutdown
!
interface TenGigabitEthernet 0/54
no ip address
mtu 12000
portmode hybrid
switchport
shutdown
!
interface TenGigabitEthernet 0/55
no ip address
mtu 12000
portmode hybrid
switchport
shutdown
!
interface TenGigabitEthernet 0/56
no ip address
mtu 12000
portmode hybrid
switchport
shutdown
!
interface ManagementEthernet 0/0
ip address 172.16.100.43/24
no shutdown
!
interface Port-channel 1
no ip address
mtu 12000
portmode hybrid
switchport
no shutdown
!
interface Vlan 1
no ip address
!untagged TenGigabitEthernet 0/1-32,41-56
!untagged Port-channel 1
no shutdown
!
interface Vlan 11
name iscsi
no ip address
mtu 12000
tagged TenGigabitEthernet 0/1-32
tagged Port-channel 1
shutdown
!
management route 0.0.0.0/0 172.16.100.1
!
ip domain-name dc.local
ip domain-lookup
ip name-server 172.16.100.22
!
service-class dynamic dot1p
!
snmp-server community public ro
snmp-server contact IT
snmp-server location Cooke Hall
!
no ip telnet server enable
!
support-assist
enable all
!
wred-profile mem
!
dcb-map FLEXIO_DCB_MAP_PFC_OFF
no pfc mode on
!
line console 0
line vty 0
line vty 1
line vty 2
line vty 3
line vty 4
line vty 5
line vty 6
line vty 7
line vty 8
line vty 9
!
reload-type
boot-type normal-reload
config-scr-download enable
retry-count 3
!
end
Parweez
37 Posts
0
October 25th, 2018 10:00
dwilliam62
4 Operator
•
1.5K Posts
0
October 25th, 2018 11:00
Hello,
I suspect it's the line:
dcbx version cee
That means DCB is enabled.
I believe the command is no dcb enable but the guide I included should have it.
Regards,
Don
dwilliam62
4 Operator
•
1.5K Posts
0
October 25th, 2018 11:00
Hello,
On Page 8 of the MXL guide shows how to disable DCB
Dell (conf)#no dcb enable
Dell (conf)# exit
Parweez
37 Posts
0
October 25th, 2018 14:00
Are there any benefits to DCB since dell set it up this way?
dwilliam62
4 Operator
•
1.5K Posts
0
October 25th, 2018 16:00
Hello,
Re: DCB. No. DCB requires expensive H/W iSCSI adapters in order to support it. ALL hosts would have to have them, you can't mix and match. Without those cards performance will be worse under load as the iSCSI traffic will no longer be prioritized and link layer flowcontrol is disabled.
Regards,
Don
Parweez
37 Posts
0
October 25th, 2018 19:00
We tried disabling DCB and our network and SAN connectivity went away. This is with Dell's help.
dwilliam62
4 Operator
•
1.5K Posts
0
October 25th, 2018 23:00
Hello,
Did you disable it on the switch and reboot or on the EQL array? It must be done at the switch level.
If you lost connectivity then something else is not configured correctly.
As long as DCB is enabled but not configured and Hw iSCSI adapters not used iSCSI traffic will be put in the lowest possible priority queue. Known as the "lossy" class. All other network traffic will have preference over iSCSI.
And as I mentioned before standard link level flowcontrol is not available. Which under load can result in reduced performance and dropped connections.
Did you look at the guide? It was updated July of this year.
You want to disable iSCSI optimization, disable DCB, enable flowcontrol, etc....
Jumbo frames should be set to 9216 not 12K and spanning-tree rstp edge-port
Here is the link again.
https://downloads.dell.com/manuals/all-products/esuprt_software/esuprt_it_ops_datcentr_mgmt/general-solution-resources_white-papers9_en-us.pdf
If you have a service contract I would suggest you open a new support case for this issue.
Regards,
Don
Parweez
37 Posts
0
October 26th, 2018 12:00
They disabled it on both MXL's only not on the storage array. They did not reboot the switches because he did a write mem and it committed the changes and we lost connectivity to the storage arrays.
dwilliam62
4 Operator
•
1.5K Posts
0
October 26th, 2018 13:00
Hello,
Well after disabling DCB you would have to reboot the switches so they will no longer be advertising DCB to the network. Which what the array follows, the configuration of the switch.
Regards,
Don
Parweez
37 Posts
0
October 28th, 2018 10:00
Have you done this before or are you just looking at the documentation?
dwilliam62
4 Operator
•
1.5K Posts
0
October 28th, 2018 12:00
Hello,
I've done this a number of times before. I've been working for Equallogic for 13+ years.
For the switch settings I've been referring to the switch guide.
That error you are asking about is specific to DCB being enabled on switch but not configured. That message was added once DCB started to be enabled by default on 10GbE switches. With DCB negotiated it must be configured on the array and ALL iSCSI initiators. There's no mixing of DCB and non-DCB servers.
Regards,
Don
Parweez
37 Posts
0
October 30th, 2018 10:00
This is what Dell prosupport did and they kept dcb enabled with ISCSI traffic at 50%. This cleared all warnings.
global commands on MXL A1 and A2
dcb-map ISCSI priority-group 0 bandwidth 50 pfc off
priority-group 1 bandwidth 50 pfc on
priority-pgid 0 0 0 0 1 0 0 0 //priority-group-id 4
interface commands on MXL A1 and A2
int te0/10 dcb-map ISCSI
int te0/11 dcb-map ISCSI
int te0/13 dcb-map ISCSI
dwilliam62
4 Operator
•
1.5K Posts
0
October 30th, 2018 11:00
Hello,
Well I do not believe that is the correct configuration. All they have done is configure DCB.
When "pfc" Priority Flow Control is enabled then link layer flowcontrol is disabled. Since you are not using DCB you are not taking advantage of DCB you are still stuck where you were. You don't get the benefit of DCB and you lose flowcontrol.
Regards,
Don