Unsolved
1 Rookie
•
4 Posts
0
1074
April 12th, 2022 17:00
vnxe SPs reboot into service mode from appinit failure
Having a strange issue following a power outage where the SPs will come online and allow ESXi's to access the NFS shares for 19 minutes and will then reboot 3 times. While the array is up and running the mgmt IP is not available until the array final boots into service mode which will then allow me to access it. Below are a few outputs.
**********************************************************************************
service@spb spb:~> svc_rescue_state -l
comp code count max action
---- ---- ----- --- ---------------
SYSTEM 0x01 0 3 0x00 (RESCUE)
SSD 0x02 0 1 0x04 (REIMAGE PROMPT)
MIRROR 0x03 0 3 0x04 (REIMAGE PROMPT)
CCSX 0x04 0 3 0x02 (RECOVER CONFIG PROMPT)
CDX 0x05 0 3 0x02 (RECOVER CONFIG PROMPT)
LOG 0x06 0 3 0x02 (RECOVER CONFIG PROMPT)
CP CS 0x07 0 3 0x02 (RECOVER CONFIG PROMPT)
CP ECOM 0x08 0 3 0x02 (RECOVER CONFIG PROMPT)
USER 0x09 0 1 0x05 (RESCUE MODE REQUESTED)
POST 0x0a 0 1 0x00 (RESCUE)
BOOTFL 0x0b 0 3 0x00 (RESCUE)
PLTFORM 0x0c 0 3 0x00 (RESCUE)
CDX2 0x0d 0 3 0x06 (IGNORE)
CDX3 0x0e 0 3 0x06 (IGNORE)
CDX4 0x0f 0 3 0x06 (IGNORE)
CDX5 0x10 0 3 0x06 (IGNORE)
ADMIN 0x11 0 3 0x02 (RECOVER CONFIG PROMPT)
APPINIT 0x12 3 3 0x00 (RESCUE)
SVCREBOOT 0x13 0 3 0x06 (IGNORE)
UPGRADE 0x14 0 1 0x00 (RESCUE)
SVCREIMAGE 0x15 0 3 0x06 (IGNORE)
SVCHALT 0x16 0 3 0x06 (IGNORE)
SVCMODE 0x17 0 3 0x06 (IGNORE)
AUTOPWROFF 0x18 0 1 0x00 (RESCUE)
MANPWROFF 0x19 0 1 0x00 (RESCUE)
FW 0x1a 0 3 0x00 (RESCUE)
SOFTWARE 0x1b 0 1 0x00 (RESCUE)
*************************************************************************
service@spb spb:~> svc_diag
======== Now executing basic state ========
* System Serial Number is: blank
* System Friendly Host Name is: (none)
* Current Software version: upc_Kittyhawk_5_HF1_upcBuilder-3.0.1.4029529-GNOSIS-RETAIL
* Unisphere IP address(es): blank blank blank
* SSH Enabled: false
* FIPS mode: Disabled
* Boot Mode: Rescue Mode
* Post Faults: 0x0000
* Backend Faults: 0x0000
* Boot Faults: 0x1200
* Rescue Reason: 0x1200
* Rescue reason for code 0x1200 - There is a problem with the system software on this Storage Processor (APPINIT). To attempt to correct this problem, first run Data Collection, and then try the following in order: Check all cables, reboot each SP, and reimage each Storage Processor (SP). If this does not resolve the issue, contact your service provider.
*** WARNING *** This Storage Processor is in Service Mode *** WARNING ***
*** Run "svc_diag" to view system info or "help" for service commands ***
*********************************************************************
I can reset the array when its in service mode using the commands below however they will return to SM after a few more reboots.
svc_rescue_state -c
svc_shutdown -r
In addition to those commands i've attempted a reimage however that has same result.
The VNXe is currently out of support but I'd like to recover a few VMs and was hoping to get some direction on logging to get a better understanding of the appinit failure.
DELL-Sam L
Moderator
•
7.6K Posts
0
April 13th, 2022 12:00
Hello pdware,
Here are some steps that you can try to resolve your issue:
1. Cleared the rescue counters "svc_rescue_state -c" since APPINIT counters were set.
2. Reboot SP (svc_shutdown -r)
pdware
1 Rookie
•
4 Posts
0
April 13th, 2022 18:00
Thank you DELL-Sam L for the feedback. As I mentioned in my original post the process you provided still results in my VNXe SP's returning to service mode. I did find out that for me to have an SP reboot 3 times before entering service mode I had to take one of the SPs offline otherwise they would reboot directly into service mode. One of my concerns is that the mgmt IP address is unavailable until the system enters service mode.
DELL-Sam L
Moderator
•
7.6K Posts
0
April 14th, 2022 08:00
Hello pdware,
At this point you are going to have to open a support case to resolve this issue.
Nancem
1 Rookie
•
4 Posts
0
March 2nd, 2025 09:57
Hello
I have the same problem on EMC VNXe 3200.It restarts in a loop and stops after a few minutesI have the following message when I connect in ssh :
DELL-Sam L
Moderator
•
7.6K Posts
0
March 3rd, 2025 14:57
Hello Nancem,
Have you done any upgrades or improvements to your VNXe3200? In most cases when you get the 0x1200 error you need to call into support so that we can resolve the issue. In most cases to resolve the issue you will need to reimage the SP. If that fails and you are still getting the same error then support will need to look at the sp to see what is going on with the reimage.
Nancem
1 Rookie
•
4 Posts
0
April 3rd, 2025 06:08
Hello @DELL-Sam L
Could you tell me how to do the reimage ?
DELL-Sam L
Moderator
•
7.6K Posts
0
April 3rd, 2025 14:53
Hello Nancem,
The steps to reimage a VNXe system is reserved to support and partners only.