Start a Conversation

This post is more than 5 years old

Solved!

Go to Solution

5029

March 21st, 2008 01:00

PowerPath and qlogic HBA problems

Hi guys.
I would like to show you the following output coming from two Linux machine RH5.1 both with two qlogic HBA.

Machine n.1 where it all works fine:
# cat /proc/scsi/qla2xxx/0
QLogic PCI to Fibre Channel Host Adapter for QMH2462:
Firmware version 4.00.90 [IP] , Driver version 8.01.07.16
ISP: ISP2432
Request Queue = 0x36d80000, Response Queue = 0x36d10000
Request Queue count = 4096, Response Queue count = 512
Total number of active commands = 0
Total number of interrupts = 2528907
Device queue depth = 0x10
Number of free request entries = 1216
Number of mailbox timeouts = 0
Number of ISP aborts = 0
Number of loop resyncs = 0
Number of retries for empty slots = 0
Number of reqs in pending_q= 0, retry_q= 0, done_q= 0, scsi_retry_q= 0
Host adapter:loop state = , flags = 0x41a43
Dpc flags = 0x4000000
MBX flags = 0x0
Link down Timeout = 008
Port down retry = 064
Login retry count = 016
Commands retried with dropped frame(s) = 0
Product ID = 0000 0000 0000 0000

SCSI Device Information:
scsi-qla0-adapter-node=50014380011c51bd;
scsi-qla0-adapter-port=50014380011c51bc;
scsi-qla0-target-0=5006016141e00fa9;
scsi-qla0-target-1=5006016941e00fa9;

FC Port Information:
scsi-qla0-port-0=50060160c1e00fa9:5006016141e00fa9:010000:81;
scsi-qla0-port-1=50060160c1e00fa9:5006016941e00fa9:010400:82;

SCSI LUN Information:
(Id:Lun) * - indicates lun is not registered with the OS.
( 0: 0): Total reqs 39351, Pending reqs 0, flags 0x0, 0:0:81 00
( 0: 1): Total reqs 39345, Pending reqs 0, flags 0x0, 0:0:81 00
( 0: 2): Total reqs 39386, Pending reqs 0, flags 0x0, 0:0:81 00
( 1: 0): Total reqs 39395, Pending reqs 0, flags 0x0, 0:0:82 00
( 1: 1): Total reqs 39390, Pending reqs 0, flags 0x0, 0:0:82 00
( 1: 2): Total reqs 39354, Pending reqs 0, flags 0x0, 0:0:82 00

cat /proc/scsi/qla2xxx/1

QLogic PCI to Fibre Channel Host Adapter for QMH2462:
Firmware version 4.00.90 [IP] , Driver version 8.01.07.16
ISP: ISP2432
Request Queue = 0x36e80000, Response Queue = 0x36e50000
Request Queue count = 4096, Response Queue count = 512
Total number of active commands = 0
Total number of interrupts = 240145
Device queue depth = 0x10
Number of free request entries = 784
Number of mailbox timeouts = 0
Number of ISP aborts = 0
Number of loop resyncs = 0
Number of retries for empty slots = 0
Number of reqs in pending_q= 0, retry_q= 0, done_q= 0, scsi_retry_q= 0
Host adapter:loop state = , flags = 0x41a43
Dpc flags = 0x4000000
MBX flags = 0x0
Link down Timeout = 008
Port down retry = 064
Login retry count = 016
Commands retried with dropped frame(s) = 0
Product ID = 0000 0000 0000 0000

SCSI Device Information:
scsi-qla1-adapter-node=50014380011c51bf;
scsi-qla1-adapter-port=50014380011c51be;
scsi-qla1-target-0=5006016041e00fa9;
scsi-qla1-target-1=5006016841e00fa9;

FC Port Information:
scsi-qla1-port-0=50060160c1e00fa9:5006016041e00fa9:010000:81;
scsi-qla1-port-1=50060160c1e00fa9:5006016841e00fa9:010400:82;

SCSI LUN Information:
(Id:Lun) * - indicates lun is not registered with the OS.
( 0: 0): Total reqs 39466, Pending reqs 0, flags 0x0, 1:0:81 00
( 0: 1): Total reqs 39461, Pending reqs 0, flags 0x0, 1:0:81 00
( 0: 2): Total reqs 39508, Pending reqs 0, flags 0x0, 1:0:81 00
( 1: 0): Total reqs 39412, Pending reqs 0, flags 0x0, 1:0:82 00
( 1: 1): Total reqs 39411, Pending reqs 0, flags 0x0, 1:0:82 00
( 1: 2): Total reqs 39368, Pending reqs 0, flags 0x0, 1:0:82 00

hp_rescan -a
Sending rescan signal to /proc/scsi/qla2xxx/0...
Sending rescan signal to /proc/scsi/qla2xxx/1...
Adding legacy tape devices to /proc/scsi/device_info
Scanning /proc/scsi/qla2xxx/0, target 1, LUN 2
Scanning /proc/scsi/qla2xxx/1, target 1, LUN 2

scsi0 00 00 00 DGC RAID 0324 Direct-Access
scsi0 00 00 01 DGC RAID 0324 Direct-Access
scsi0 00 00 02 DGC RAID 0324 Direct-Access
scsi0 00 01 00 DGC RAID 0324 Direct-Access
scsi0 00 01 01 DGC RAID 0324 Direct-Access
scsi0 00 01 02 DGC RAID 0324 Direct-Access
scsi1 00 00 00 DGC RAID 0324 Direct-Access
scsi1 00 00 01 DGC RAID 0324 Direct-Access
scsi1 00 00 02 DGC RAID 0324 Direct-Access
scsi1 00 01 00 DGC RAID 0324 Direct-Access
scsi1 00 01 01 DGC RAID 0324 Direct-Access
scsi1 00 01 02 DGC RAID 0324 Direct-Access

EMC PowerPath
powermt display dev=all
Pseudo name=emcpowera
CLARiiON ID=CK200062401609 [Cluster Oracle DWH]
Logical device ID=6006016040301900AACFD76C26F1DC11 [DWH OCFS2]
state=alive; policy=BasicFailover; priority=0; queued-IOs=0
Owner: default=SP B, current=SP A Array failover mode: 1
==============================================

---------------- Host --------------- - Stor - -- I/O Path - -- Stats ---
### HW Path I/O Paths Interf. Mode State Q-IOs Errors
==============================================

0 qla2xxx sdb SP A1 unlic alive 0 0
0 qla2xxx sde SP B1 unlic alive 0 0
1 qla2xxx sdh SP A0 active alive 0 0
1 qla2xxx sdk SP B0 active alive 0 0

Pseudo name=emcpowerb
CLARiiON ID=CK200062401609 [Cluster Oracle DWH]
Logical device ID=6006016040301900E0AB4A7D22F1DC11 [DWH DG_DATA]
state=alive; policy=BasicFailover; priority=0; queued-IOs=0
Owner: default=SP B, current=SP A Array failover mode: 1
==============================================
---------------- Host --------------- - Stor - -- I/O Path - -- Stats ---
### HW Path I/O Paths Interf. Mode State Q-IOs Errors
==============================================
0 qla2xxx sda SP A1 unlic alive 0 0
0 qla2xxx sdd SP B1 unlic alive 0 0
1 qla2xxx sdg SP A0 active alive 0 0
1 qla2xxx sdj SP B0 active alive 0 0

Pseudo name=emcpowerd
CLARiiON ID=CK200062401609 [Cluster Oracle DWH]
Logical device ID=6006016040301900FC4EB80AF4F1DC11 [DWH DG_FRA]
state=alive; policy=BasicFailover; priority=0; queued-IOs=0
Owner: default=SP B, current=SP A Array failover mode: 1
==============================================
---------------- Host --------------- - Stor - -- I/O Path - -- Stats ---
### HW Path I/O Paths Interf. Mode State Q-IOs Errors
==============================================
0 qla2xxx sdc SP A1 unlic alive 0 0
0 qla2xxx sdf SP B1 unlic alive 0 0
1 qla2xxx sdi SP A0 active alive 0 0
1 qla2xxx sdl SP B0 active alive 0 0

Machine n.2 where it doesn't works:
cat /proc/scsi/qla2xxx/0

QLogic PCI to Fibre Channel Host Adapter for QMH2462:
Firmware version 4.00.90 [IP] , Driver version 8.01.07.25-fo
BIOS version 1.26
ISP: ISP2432
Request Queue = 0x37480000, Response Queue = 0x37410000
Request Queue count = 4096, Response Queue count = 512
Total number of active commands = 0
Total number of interrupts = 30489
Device queue depth = 0x10
Number of free request entries = 3137
Number of mailbox timeouts = 0
Number of ISP aborts = 0
Number of loop resyncs = 0
Number of retries for empty slots = 0
Number of reqs in pending_q= 0, retry_q= 0, done_q= 0, scsi_retry_q= 0
Number of reqs in failover_q= 0
Host adapter:loop state = , flags = 0x41a43
Dpc flags = 0x4000000
MBX flags = 0x0
Link down Timeout = 008
Port down retry = 030
Login retry count = 030
Commands retried with dropped frame(s) = 0
Product ID = 0000 0000 0000 0000

SCSI Device Information:
scsi-qla0-adapter-node=5001438000beaf21;
scsi-qla0-adapter-port=5001438000beaf20;
scsi-qla0-target-0=5006016141e00fa9;


FC Port Information:
scsi-qla0-port-0=50060160c1e00fa9:5006016141e00fa9:010000:81;
scsi-qla0-port-1=50060160c1e00fa9:5006016941e00fa9:010400:82;

SCSI LUN Information:
(Id:Lun) * - indicates lun is not registered with the OS.
( 0: 0): Total reqs 313, Pending reqs 0, flags 0x2, Dflags 0x0, 0:0:81 00
( 0: 1): Total reqs 299, Pending reqs 0, flags 0x2, Dflags 0x0, 0:0:81 00
( 0: 2): Total reqs 312, Pending reqs 0, flags 0x2, Dflags 0x0, 0:0:81 00


cat /proc/scsi/qla2xxx/1
QLogic PCI to Fibre Channel Host Adapter for QMH2462:
Firmware version 4.00.90 [IP] , Driver version 8.01.07.25-fo
BIOS version 1.26
ISP: ISP2432
Request Queue = 0x37580000, Response Queue = 0x37510000
Request Queue count = 4096, Response Queue count = 512
Total number of active commands = 0
Total number of interrupts = 3447
Device queue depth = 0x10
Number of free request entries = 4090
Number of mailbox timeouts = 0
Number of ISP aborts = 0
Number of loop resyncs = 0
Number of retries for empty slots = 0
Number of reqs in pending_q= 0, retry_q= 0, done_q= 0, scsi_retry_q= 0
Number of reqs in failover_q= 0
Host adapter:loop state = , flags = 0x41a43
Dpc flags = 0x4000000
MBX flags = 0x0
Link down Timeout = 008
Port down retry = 030
Login retry count = 030
Commands retried with dropped frame(s) = 0
Product ID = 0000 0000 0000 0000

SCSI Device Information:
scsi-qla1-adapter-node=5001438000beaf23;
scsi-qla1-adapter-port=5001438000beaf22;


FC Port Information:
scsi-qla1-port-0=50060160c1e00fa9:5006016041e00fa9:010000:81;
scsi-qla1-port-1=50060160c1e00fa9:5006016841e00fa9:010400:82;

SCSI LUN Information:
(Id:Lun) * - indicates lun is not registered with the OS.

hp_rescan -a
Sending rescan signal to /proc/scsi/qla2xxx/0...
Sending rescan signal to /proc/scsi/qla2xxx/1...
Adding legacy tape devices to /proc/scsi/device_info
Scanning /proc/scsi/qla2xxx/0, target 0, LUN 2

scsi0 00 00 00 DGC RAID 0324 Direct-Access
scsi0 00 00 01 DGC RAID 0324 Direct-Access
scsi0 00 00 02 DGC RAID 0324 Direct-Access

EMC PowerPath
powermt display dev=all
Pseudo name=emcpowerb
CLARiiON ID=CK200062401609 [Cluster Oracle DWH]
Logical device ID=6006016040301900AACFD76C26F1DC11 [DWH OCFS2]
state=alive; policy=BasicFailover; priority=0; queued-IOs=0
Owner: default=Unknown, current=SP A Array failover mode: 1
==============================================

---------------- Host --------------- - Stor - -- I/O Path - -- Stats ---
### HW Path I/O Paths Interf. Mode State Q-IOs Errors
==============================================
0 qla2xxx sdb SP A1 active alive 0 0

Pseudo name=emcpowerc
CLARiiON ID=CK200062401609 [Cluster Oracle DWH]
Logical device ID=6006016040301900E0AB4A7D22F1DC11 [DWH DG_DATA]
state=alive; policy=BasicFailover; priority=0; queued-IOs=0
Owner: default=Unknown, current=SP A Array failover mode: 1
==============================================

---------------- Host --------------- - Stor - -- I/O Path - -- Stats ---
### HW Path I/O Paths Interf. Mode State Q-IOs Errors
==============================================
0 qla2xxx sda SP A1 active alive 0 0

Pseudo name=emcpowerd
CLARiiON ID=CK200062401609 [Cluster Oracle DWH]
Logical device ID=6006016040301900FC4EB80AF4F1DC11 [DWH DG_FRA]
state=alive; policy=BasicFailover; priority=0; queued-IOs=0
Owner: default=Unknown, current=SP A Array failover mode: 1
==============================================

---------------- Host --------------- - Stor - -- I/O Path - -- Stats ---
### HW Path I/O Paths Interf. Mode State Q-IOs Errors
==============================================
0 qla2xxx sdc SP A1 active alive 0 0

How can I correct those errors?

Thanks,
Marco

2 Intern

 • 

2.8K Posts

March 21st, 2008 02:00

Hi Marco.

Machine n.1 where it all works fine:
# cat /proc/scsi/qla2xxx/0

...
SCSI Device Information:
scsi-qla0-adapter-node=50014380011c51bd;
scsi-qla0-adapter-port=50014380011c51bc;
scsi-qla0-target-0=5006016141e00fa9;
scsi-qla0-target-1=5006016941e00fa9;

...
#cat /proc/scsi/qla2xxx/1
SCSI Device Information:
scsi-qla1-adapter-node=50014380011c51bf;
scsi-qla1-adapter-port=50014380011c51be;
scsi-qla1-target-0=5006016041e00fa9;
scsi-qla1-target-1=5006016841e00fa9;


This host have 2 HBA and every HBA can see two different WWN (two different targets). The wwns belong to two ports of the same Clariion. So an HBA can see SPA0 and SPB0 while the other HBA can see SPA1 and SPB1.

Machine n.2 where it doesn't works:
cat /proc/scsi/qla2xxx/0

...
SCSI Device Information:
scsi-qla0-adapter-node=5001438000beaf21;
scsi-qla0-adapter-port=5001438000beaf20;
scsi-qla0-target-0=5006016141e00fa9;

...
cat /proc/scsi/qla2xxx/1
SCSI Device Information:
scsi-qla1-adapter-node=5001438000beaf23;
scsi-qla1-adapter-port=5001438000beaf22;


This host have again 2 HBA but while HBA0 can see only a single target (only a single SPXy) the other HBA can see ANY target.

Can you please explain what do you mean by "it doesn't works" ?? :D

How can I correct those errors?


If the "error" is that your Machine n.2 can't see all the luns, please check zoning for Machine n.2. Maybe you have also to check masking (I think it's called Access Logix in CX world). Also check that your hba logs in correctly on the Storage Processors before going on. Use Navisphere to check connectivity between your hosts and the CX.

-s-

2 Intern

 • 

5.7K Posts

March 21st, 2008 05:00

Also check if in the connectivity status all paths are the same color (black) and if there are no blue-ish icons.

341 Posts

March 24th, 2008 21:00

Might also be worth checking from Navisphere Manager that all paths to storage are enabled for this host.

Refer to EMC knowledgebase article emc111684 for instructions on how to do this, and if you have any questions about this procedure contact the EMC Customer Support center or your local EMC representative and quote this article ID.

Let us know if any of these suggestions have progressed the issue reported.

Message was edited by:
Mark Foreman (moderator)

341 Posts

March 25th, 2008 00:00

Sorry, I was using emc111684 to troubleshoot which is "customer-viewable", and publicly displays the p/w... I didn't realise it was secret!
I can't seem to edit my previous post.

Marc/Stefano, you can delete as you see fit... sorry.

2 Intern

 • 

5.7K Posts

March 25th, 2008 00:00

Please remove the engineering mode password from your post. It's supposed to be secret.

By the way: the checking of the color in connectivity status is leading towards your solving that particular problem.

2 Intern

 • 

5.7K Posts

March 25th, 2008 01:00

AFAIK mentioning passwords or serial numbers are not best practice here ;)

2 Intern

 • 

5.7K Posts

March 25th, 2008 03:00

Oh well, just thought it would be better not to mention too much of those details here ;)

9 Legend

 • 

20.4K Posts

March 25th, 2008 03:00

this password is mentioned in many solutions on PP ..what's the big deal.

2 Intern

 • 

2.8K Posts

March 25th, 2008 13:00

I missed the opportunity to trim a thread !!! :D

However I suppose the password you are talking about is the Navisphere "expert" password. Even if widely known it's still a "secret" .. ]:)

9 Legend

 • 

20.4K Posts

March 25th, 2008 16:00

I missed the opportunity to trim a thread !!! :D


i would say something but then what's the point ..enjoy your power trip my friend.

9 Legend

 • 

20.4K Posts

March 26th, 2008 05:00

oh ..so you disabled Qlogic native failover. If you typically download drivers from the OEM section on Qlogic/Emulex website and for OEM vendor select EMC, their rpm's are usually modified to set failover to 0.

10 Posts

March 26th, 2008 05:00

Hi Stefano,
the problem was solved installing qla2xxx-v8.02.08-dist.tgz, adding the following line to /etc/modprob.conf
options qla2xxx ConfigRequired=0 ql2xfailover=0
and following the guidelines provided by the README.qla2xxx file.

Now I've another problem... I'll post it asap :)


Thanks,
Marco
No Events found!

Top