Unsolved
This post is more than 5 years old
4 Posts
0
15777
September 24th, 2012 13:00
Persistent reservation , windows 2003 sp2
All,
Good day.
We had outage couple of days ago and our cluster disk went offline. When analyzing the logs with Microsoft, they said we need to diasble Persistent Reservation flag.
Microsoft comments “This mostly happens due to a persistent reservation present on the disks which does not allow the clusdisk.sys to perform I/O operation on the cluster disks and blocks it. This also prevents failover to other nodes.
Action Plan:
- Engage the Storage vendor and ask them to remove the persistent reservations on the cluster disks.”
Microsoft keep saying to engage Storage vendor and storage vendor saying is done from host.
Any thoughts would be appreciated!
Thanks,
Naveen
No Events found!
dynamox
9 Legend
•
20.4K Posts
0
September 24th, 2012 14:00
what array ?
nvnaveen
4 Posts
0
September 24th, 2012 21:00
Sorry i missed, looks from Grap its EMC SYMMETRIX .
dynamox
9 Legend
•
20.4K Posts
0
September 24th, 2012 21:00
run "symdev show" on the device and see if this string is enabled
SCSI-3 Persistent Reserve: Enabled
if it is you will need to disable it, it's needed for Win2k8 clusters, not for Win2k3
set device XXXX attribute=no scsi3_persist_reserv;
EMCDHANA
1 Message
0
September 25th, 2012 00:00
Thanks for the reply. SCSI-3 presistent reserver is enabled on the FA adapters. you mean to say that it should be disabled from the SAN end by using the command given.
nvnaveen
4 Posts
0
September 25th, 2012 03:00
dynamox,
Thanks for reply. We keep saying to SAN team and they say its enabled for all servers, if you don't need it then you need to disable from host. Is this something possible?
Also can we disabled SCSI-3 Persitent Reserver just for Lun's ?
By the way this Server has Multipath enabled, i read some where that SCSI3 - PR needs to be enabled for Multipath to work? is that so or its safe to disable as this is Windows 2003?
Thanks,
dynamox
9 Legend
•
20.4K Posts
0
September 25th, 2012 05:00
they must be thinking about this parameter which is set at the FA level, it has nothing to do with persistent reservation, that one needs to stay at whatever value it's currently set (most likely enabled)
you want to disable SCSI-3 Persitent reservation just for the LUNs presented to that specific cluster. I have windows 2003 clusters without SCSI3-PR enabled and PowerPath is working just fine, i have never seen that requirement.
nvnaveen
4 Posts
0
September 25th, 2012 06:00
thanks again.
I have a meeting with SAN team later today, hopefully i can show them this. By the way Microsoft Keep saying Persistent Reseravtion flag, and they are not sure if its is called SCSI3- PR, is there really a difference or both terms are the same.
Thanks,
dynamox
9 Legend
•
20.4K Posts
0
September 25th, 2012 06:00
Additionally for Windows 2008 Failover Cluster, the Persistent Reservation attribute SCSI3_persist_reserv must be enabled on each Symmetrix DMX device used. This should NOT be done to devices for Windows 2003 clusters. EMC recommends that the SCSI3_persist_reserv attribute be only set on devices that require it.
For detailed information on changing these settings please refer to the Solutions Enabler Symmetrix Device Masking CLI Product Guide, Solutions Enabler Symmetrix Configuration Change CLI Product Guide and Solutions Enabler Symmetrix Array Controls CLI Product Guide available on Powerlink. Some SYMCLI examples are provided below.
No specific bit is required for iSCSI environment, with the following exception: VCM bit is required to enable the iSCSI initiator access login and, optionally, the iSCSI Challenge Handshake Authentication Protocol (CHAP) security configuration.
Please note, making changes globally for each director will affect all hosts connected to that port. In most instances where there are multiple types of hosts (Linux, Windows, Solaris) it may be a better option to set it per initiator.
To see the current director flag settings, run the following Solutions Enabler command:
symcfg list -sid xxxx -v -dir all
You can also set any of the director flags per host initiator. See "Setting the HBA port flags" in the Solutions Enabler Symmetrix Array Controls CLI Product Guide or see "Setting the Heterogeneous Host Configuration" in the Solutions Enabler Symmetrix Device Masking CLI Product Guide for detailed information. If the Symmetrix is running an Enginuity version earlier than 5671.68.71, 5771.104.114, or 5772.55.51 the OS2007 flag can only be enabled via a CE or symconfigure bin file change. Refer to solution emc183161 for details.
To display what director flags have been set per host initiator, run the following Solutions Enabler command.
symmaskdb -sid XXXX list database -v (without the -v you will not see the flags)
To enable the necessary director flags for an initiator on director 4a port 0 using symmask:
symmask -sid xxxx -wwn xxxxxxxxxxxxx -dir 4a -p 0 set hba_flags on C,OS2007,SC3,SPC2 -enable
symmask refresh (this command is required after performing the above command)
To enable the necessary director flags for an initiator group using Symaccess:
symaccess -sid xxxx -type init -name myig1 set ig_flags on C,OS2007,SC3,SPC2 -enable
To display the flags from the previous command using symmaccess:
symaccess -sid xxxx -type init show myig1 -detail
To enable the SC3, SPC2 & OS2007 flags globally on the FA 1D port 0 via symconfigure, create a text file similar to below..
set port 1d:0 SCSI_3=enable, SPC2_Protocol_Version=enable, SCSI_Support1=enable;
dynamox
9 Legend
•
20.4K Posts
0
March 9th, 2015 07:00
take a look at E-Lab navigator, they will provide a table with the required flags
rakesh_pandey
17 Posts
0
March 9th, 2015 07:00
Hi Dynamox,
Needed a help. We have provisioned LUNs from DMX4-24 5773 to one of the Sun Solaris Server (10.5). But the LUNs are not visible at host end. Do we need to enable any Flag for this. If yes, please guide with commands.
Thanks in Advance
Rakesh
henkvisser
5 Posts
0
March 24th, 2016 09:00
Dynamox,
I am moving to a W2k8R2 Cluster and getting the same "persistent reservation" issue when I do a Failover Cluster validation.
i am using a CX4-120. Do I have to disable SCSI-3? And how is it done on these boxes?
Thanks,
K/R
Henk
dynamox
9 Legend
•
20.4K Posts
0
March 24th, 2016 14:00
on Clariion/VNX you can't control those parameters, they are either in the code or not. It is very possible that because the Clariion is so old it does not support SCSI-3 reservation.
DaveGrawl
1 Rookie
•
25 Posts
0
March 28th, 2016 11:00
Try Command Prompt or PS>
Clear-ClusterDiskReservation -Disk #
Https://Technet.microsoft.com/en-us/library/ee461016.aspx
or how to clear SCSI reservation on a disk/LUN
Http//:winte;guy.com/2011/20110514_scsisnd.html
Mich
86 Posts
0
March 28th, 2016 17:00
Clariion has been supporting persistent reservations out of the box for many years way before the CX4 was released.
As for persistent reservations. They should be removed by the host.
On Windows 2008 (R2)
"cluster.exe node /clearpr:X" where X is the PhysicalDrive number for the Cluster Disk in disk management.
Note: Cluster Disk X may not be the same as the PhysicalDrive number.
https://support.emc.com/kb/461344
Windows 2012
https://support.emc.com/kb/327009
dynamox
9 Legend
•
20.4K Posts
0
March 29th, 2016 17:00
what you do you mean remove ? When you run Win2k8 cluster validation report it checks if the storage supports persistent reservation.