Unsolved

Closed

10 Posts

444

June 12th, 2023 02:00

MD3600f stuck in "Controller entering SODReboot lockdown state"

I upset my Dell MD3600f the other day by daring add some more storage to it!  The hard disks in question had been used by the unit previously but were from a time before we had upgraded the firmware on the box so when I put 6 of the old hard disks in to it, it threw a tantrum and is now stick in a lockdown state.

I have conneced via a serial cable and tried to perform a factory reset which goes through the motions and reboots several times and then ends with the following error:

06/09/23-14:08:15 (tRAID): WARN: Controller entering SODReboot lockdown state...

As it is in a lockdown state I can no longer access it through PowerVault Modular Disk Storage Manager and only via Putty using the serial cable.

I have removed the 6 HDDs that caused this latest issue and left in the existing 6 hard disks that were in the unit when we upgraded the firmware the other month and they were working OK.

How can I get it out of the lockdown state so I can use the SAN?  Then I need to know how I can add the other hard disks I have without it doing this again but one thing at a time!  Thanks.

10 Posts

June 12th, 2023 07:00

When I run that command, it reboots a few times and then comes up with the Controller entering SODReboot lockdown state error message and stays in lockdown.  I've run that a couple of times now and it does the same thing.

Moderator

 • 

9.6K Posts

June 12th, 2023 07:00

FazzaGBR,

 

When a condition is present that prevents SOD (Start Of Day) from completing 5 times, the controller enters a SOD reboot lockdown state to prevent further continuous reboots.  What you need to do is to run the following command from serial shell:

 

lemClearLockdown

 

Once that is done the error message will be cleared. If the issue persists after it is cleared then I would suggest you call in to your local support, as it is likely going to require direct support to resolve it. 

 

Let me know if this helps.

 

 

Moderator

 • 

9.6K Posts

June 12th, 2023 07:00

Thank you. 

 

We will need to get a serial boot capture of the controller, which is where you use putty or some tool like it to capture the boot process of the controller. You will need to have the serial cable that comes with the unit in order to do it.

 

Once you get the boot capture will you upload it to upload. dell. com and then private message me the svc tag used to upload it, that way I can locate it. 

 

Based on your description, it "looks" to be a database issue, but lets confirm.

 

 

Moderator

 • 

4K Posts

June 13th, 2023 02:00

Hi @FazzaGBR,

 

Shutdown the storage and let it sit for 15 minutes. Try removing one controller, run the command "lemClearLockdown" and monitor the boot. Check if it's still throwing the warning Controller entering SODReboot lockdown state. If this does not work, install the removed controller, and remove the other one. Repeat the steps. 

 

 

 

 

10 Posts

June 13th, 2023 02:00

Hi! Many thanks for your help on this.  We're a Dell/EMC house and being a School we dont have the money to buy brand new SANs (especially as this SAN should still work at acceptable speed).

The service tag sticker has worn away so I can't upload the boot capture from Putty so I have shared it from my Microsoft OneDrive:

MD3600f Boot Capture Text File 

There's no data on the disks (I've just been using it in a test lab to get it working there before going in to production) - I just need to factory reset it and somehow use the disks that we have that were used before we updated the firmware etc.

Thanks.

10 Posts

June 13th, 2023 05:00

I've shutdown the SAN, waited 20 minutes, removed one of the controllers and then powered it back on.  Then I run the lemClearLockdown command and it went through the motions as before but still reported that it was in lockdown.  I then powered it down, removed the controller and put the other controller back in it and then did the same again.  After running lemClearLockdown it went through the motions and the last things it says is:

Controller entering SODReboot lockdown state...

Moderator

 • 

9.6K Posts

June 13th, 2023 07:00


FazzaGBR,


You would need to call in and have support assist you in factory resetting the system, as we can't share the details on resetting an MD3600f on the forums.

No Events found!

Top