Start a Conversation

Solved!

Go to Solution

1 Rookie

 • 

35 Posts

1376

March 27th, 2022 12:00

CMC not responding on M1000e after power failure

Hello,

We had a bad power failure and our M1000e does not boot anymore. The lcd panel display CMC not responding a few minutes after powerup.

The top led on the CMC is amber steady and the bottom light starts blue and goes amber steady.

I have the same thing for both cmc. I tried to pull one of them to see if it would make a diffrence but I get the same result.

Does that mean that both cmc need to be replaced ?

Any help would be appeciated as this is urgent.

Thank you

Gilbert

 

Moderator

 • 

9.5K Posts

March 28th, 2022 13:00

Ok, thank you.

 

Do you happen to have a known good CMC, such as from another unit, that we can test in this system? The reason I ask is I want to try to eliminate the issue being caused by a double failure of the CMC's, albeit very rare I just wanted to confirm. If you try and the result is the same then I would bet that the issue is that the power outage you described failed the Control Panel itself. If you try and it isn't the same, then the issue is that the power outage failed both of your CMC's.

 

Let me know what you see.

 

 

Moderator

 • 

5.1K Posts

March 27th, 2022 17:00

Hi, can you make sure if network cables are plugged properly? Also you can see CMC status on the front LCDs.

Moderator

 • 

9.5K Posts

March 28th, 2022 08:00

GSoucy,

 

It sounds like the IP was either not excluded after being assigned tot he idrac, or possibly was configured as DHCP and the ip was dropped when it went offline. So you can set the idrac in the future to static, and then after asssigning the IP to it, then go and set that IP as excluded from assignment. 

 

As far as the diagnostic indicators, the issue I see is that you stated that both the top LED and then the bottom (after a delay) go amber steady. Now as you see on the page you linked, the steady amber is showing as Not Used on the CMC, but being amber I believe is an indication of an issue. 

 

Where we are now I would lean as it being an issue with the CMC itself, the M1000e board, or a power supply.

 

 

Now would you confirm if there is dual CMCs on this M1000e or just the single? If it is dual, would you confirm if you have tried failing over the CMC to see if it resolves? 

 

Can you confirm the power supply LEDs status?

 

Lastly, can you confirm the specific CMC version you're on?

 

Let me know.

 

 

1 Rookie

 • 

35 Posts

March 28th, 2022 08:00

Thank you for the reply.

I found something strange: the idrac ip of the m1000e is now taken by another server. This is strange. I thought that the m1000e was refusing to boot because its IP was not available so I completely  unplugged the ethernet cables on both cmc. No luck, same thing. 

Regarding your post, does the cmc need network access to boot ?

Also, if the LEDs on the cmc is  top :  amber steady   and bottom : blue steady, does that mean that the cmc is ok ?  My interpretation of this PDF ( https://dl.dell.com/topicspdf/dell-cmc-v5.0-m1000e_users-guide_en-us.pdf , page 250 ) is that the CMC is ok. 

You said that I can see the CMC status on the front LCD panel. I dont know how. This panel show only cmc not responding and no a single button works. 

How can I talk to the device if the idrac is not working ? I tried to attach a terminal on the back on the m1000e but it seems dead.

Any idea ?

1 Rookie

 • 

35 Posts

March 28th, 2022 12:00

Hello

The IP was static, it has been there for years without any issue.

This is a dual CMC system. I tried to force a failover ( I pulled the left card off the enclosure). I got the same result ( CMC not responding and both leds amber steady )

The power LEDs: all 6 units have their bottom led green. Only 2 of them have the top led green. The others have the top led black (not lit). In summary, from left to right (when looking at the back of the m1000e), the PSU have  2  1 1 2 1 1   leds green. 

I am sorry but I have not idea what is the version of the CMC. Can I tell easily ?

Thank you

Gilbert

 

 

1 Rookie

 • 

35 Posts

March 28th, 2022 13:00

I dont have any spare CMC but I just ordered a few. Will get them in a few days I hope. I will let you know. 

Thank you

1 Rookie

 • 

35 Posts

April 7th, 2022 04:00

Just a quick update on this case . I finally received my replacement CMC and now the m1000e boots as before and all the blade servers hosted by the m1000e also boot fine. So, it appears that the power failure failed both CMC.

So, right now I am using one CMC and I keep my other spare CMC unplugged to protect it against any power surge. This way, I am sure to recover from any power storm faster then it took in my last event.

It seems the the KVM module is also failing now. Less urgent but I will replace it and it should the end of this bad event.

Note that we do have a UPS and generator but the problem was caused by a failure on a transfer switch when going from the generator to the main public power.

Thank you all for the help on this.

No Events found!

Top