Start a Conversation

Unsolved

This post is more than 5 years old

2065

April 14th, 2016 11:00

RHEL mapped volumes not sync'ing across nodes

Working with a set of 2 RHEL 7.2 servers.  I have 3 SIO volumes mapped to both.

Both systems show the volumes under /dev

However, if one system formats/edits the volume it does not reflect those changes on the other system.

With attached iSCSI volumes, this works, but not with SIO.


These 2 systems are going to be used for Spectrum Scale GPFS (NSD nodes) and it keeps failing because the changes are not showing across both systems.

Is there something special that has to be done to get this working properly?

306 Posts

April 21st, 2016 23:00

Hi,

Have you installed GPFS already? I think the problem might be with the OS rather than with ScaleIO - when you don't use clustering software/filesystem, you are not supposed to share any devices, as the changes done on one node might not be reflected on another.

Can you please deploy the distributed file system and let us know if that worked?

Thank you,

Pawel

12 Posts

April 22nd, 2016 00:00

GPFS is installed.

As I said if we use iSCSI devices it works fine, same if we add NetApp devices via FC.

This only fails when using SIO as the device.

We have Windows clusters that work correctly.  We assign a quorum disk and 2 data disks, create the cluster and it does what we expect it to do..  formats the devices on one node and all nodes reflect the changes.

There is nothing that was done to the Windows installs other than the drv_cfg command, which we are also using on the RHEL systems.

306 Posts

April 23rd, 2016 00:00

Hi,

Can you please show us the GPFS status? "mmgetstate -a" and "mmlsmount all -L"

Thanks,

Pawel

12 Posts

April 24th, 2016 01:00

The LS Mount status won't matter as the devices fail initialization of GPFS because the systems are not sync'ing the devices across nodes.

I currently have multiple iSCSI devices mounted and mapping correctly.

It's only ScaleIO devices that do not do so.

306 Posts

April 25th, 2016 00:00

I think we have some customers using GPFS with ScaleIO without any issues, I am not aware of any special procedure of installation - can you please provide some more details about what are you exactly doing (format etc.) and when exactly GPFS installation fails - what's the command and the error message?

12 Posts

June 21st, 2016 09:00

There is no error message, the GPFS cluster simply reports the drive is not available for use.

For now we're simply using iSCSI because we have failed to get ScaleIO to work, at all.

Even after upgrading to Version: 2.0.6035

No Events found!

Top