Unsolved

This post is more than 5 years old

9 Posts

14187

August 17th, 2011 04:00

The operation was terminated on the NDMP server - Snapsure configuration

Hi,


My first post here on this forum

.


We have at our company the following:


1 NAS CELERRA NS 120 storage


(1 Tape storage Quantum Scalar 50)


1 BACKUP SERVER WINDOWS 2003 WITH SYMANTEC BACKUP EXEC 2010 R3


At the celerra side, we obtained the NDMP license from EMC with snapsure checkpoints and configured correclty like this;


[root@server]#  server_param server_2 -f NDMP -list

server_2 :

param_name                       facility  default     current   configured

maxProtocolVersion                  NDMP          4          4

dialect                             NDMP

snapsure                            NDMP          0          1          1

includeCkptFs                       NDMP          1          1

md5                                 NDMP          1          1          1

tapeSilveringStr                    NDMP         ts         ts

convDialect                         NDMP     8859-1     8859-1

scsiReserve                         NDMP          1          1

bufsz                               NDMP        128        128

v4OldTapeCompatible                 NDMP          1          1

forceRecursiveForNonDAR             NDMP          0          0

excludeSvtlFs                       NDMP          1          1

snapTimeout                         NDMP          5          5


Also, on the backup server side, in Backup Exec, we enabled the option for the backup job with "Backup with integrated checkpoints (SnapSure)"


When we try to run the job, we get an error (inside the Backup Exec software):

The operation was terminated on the NDMP server.

NDMP Mover Halted: Internal Error
NDMP Log Message: SnapSure file system creation fails
NDMP Data Halted: Aborted


WE TRIED TO FIND A SOLUTION WITH SYMANTEC SUPPORT BUT THEY SAID THIS ERROR IS CAUSED (triggered) BY THE NAS CELERRA INFORMING US THAT SNAPSURE IS NOT INSTALLED OR CONFIGURED. BUT WE CONFIRMED THAT SNAPSURE SETUP CORRECTLY. HOW CAN WE DOUBLE CHECK THIS? WHERE CAN WE FIND (PLEASE PROVIDE LINK) A COMPLETE MANUAL FOR SNAPSURE CONFIGURATION CLI


PLEASE HELP




9 Posts

August 17th, 2011 05:00

Hi DynaMox. Thanks for your fast reply.

I followed your advice: We set the NDMP snapsure config as following.

(Did not restart the NAS or anything else)

[root@nas]#server_param server_2 -facility NDMP -modify snapsure -value 0

RESULT:

[root@nas]# server_param server_2 -f NDMP -i snapsure -v
server_2 :
name                    = snapsure
facility_name           = NDMP
default_value           = 0
current_value           = 0
configured_value        = 0
user_action             = none
change_effective        = immediate
range                   = (0,1)
description             = Use SnapSure file system for backup

Then from Symantec Backup Exec backup server we restarted the job. After 10  minutes or so we got the same error again (The operation was terminated on the NDMP server etc..)

ALSO SEE LAST LINES FROM LOG FROM COMMAND server_log server_2: (IMPORTANTE: WHEN THE VALUE WAS ON 1, THE JOB ABORTED IMMEDIATELY, NOW IT ABORTS AFTER 10 MINUTES OR SO

2011-08-17 14:22:04: NDMP: 4: Session 060 (thread ndmp060) < Backup type: dump >
2011-08-17 14:22:04: NDMP: 4: Session 060 (thread ndmp060) Name: FILESYSTEM Value: /root_vdm_1/Tecnologia
2011-08-17 14:22:04: NDMP: 4: Session 060 (thread ndmp060) Name: LEVEL Value: 0
2011-08-17 14:22:04: NDMP: 4: Session 060 (thread ndmp060) Name: DUMP_DATE Value: -1
2011-08-17 14:22:04: NDMP: 4: Session 060 (thread ndmp060) Name: UPDATE Value: Y
2011-08-17 14:22:04: NDMP: 4: Session 060 (thread ndmp060) Name: HIST Value: Y
2011-08-17 14:22:04: NDMP: 4: Session 060 (thread ndmp060) Name: SNAPSURE Value: Y
2011-08-17 14:22:04: NDMP: 4: Session 060 (thread ndmp060) Name: TYPE Value: dump
2011-08-17 14:22:04: NDMP: 4: 1: source_fsid:31 mount_point:/root_vdm_1/automaticNDMPCkpts/automaticTempNDMPCkpt5-31-1313583724

2011-08-17 14:27:04: NDMP: 3: < LOG type: 2, msg_id: 0, entry: SnapSure file system creation fails, hasAssociatedMsg: 0, associatedMsgSeq: 0 >

2011-08-17 14:27:04: NDMP: 4: 2: fsid:-1 mount_point:/root_vdm_1/automaticNDMPCkpts/automaticTempNDMPCkpt5-31-1313583724

2011-08-17 14:27:04: NDMP: 4: Session 060 (thread ndmp060) NdmpdData::startBackup, SnapSure creation for backup failed

2011-08-17 14:32:04: NDMP: 4: 2: fsid:-1 mount_point:/root_vdm_1/automaticNDMPCkpts/automaticTempNDMPCkpt5-31-1313583724

Please help.

Thanks.

9 Legend

 • 

20.4K Posts

August 17th, 2011 05:00

i actually don't think you need to enable that parameter for Backup exec as it passes that parameter when it talks to the datamover. Some application can't pass that parameter (TSM for example) so you have to set that parameter manually.  Try setting that parameter back to 0 and give it a try again. If it still fails, please provide a log entries from the datamover itself around the time you tried to run your backup job. To view log on datamover use the following command on control station:

server_log server_2

9 Posts

August 17th, 2011 06:00

Ok,

i ran the command to check the license

[root@nasserver]# nas_license -list


key                 status    value
site_key            online    4a 66 f4 92
advancedmanager     online
cifs                online
nfs                 online
iscsi               online
snapsure            online

9 Legend

 • 

20.4K Posts

August 17th, 2011 06:00

i don't think this is the issue but let's verify snapsure is licensed:

nas_license -list

9 Legend

 • 

20.4K Posts

August 17th, 2011 06:00

Hmm..i wonder if there is not enough space in the pool where that file system resides. Let's create a snapsure checkpoint manually and see if it succeeds.

fs_ckpt -name testcheckpoint -Create

if it succeeds , delete it

nas_fs -delete testcheckpoint -o umount=yes

9 Legend

 • 

20.4K Posts

August 17th, 2011 07:00

do you have tape drives presented to datamovers ?

9 Posts

August 17th, 2011 07:00

oops. i think that i did not provide sufficient info. it is not a problem with pool space ...

We use Symantec Backup exec with ndmp to backup network resources and folders that are located ON THE NAS CELERRA  TO OUR QUANTUM SCALAR 50.

We can do a backup sucessfully directly to the QUANTUM SCALAR 50 from our backup server (with Symantec Backup exec) from files and folders that are located on the network. Quantum scalar 50 works ok. The tapes are being used correctly.

But if we want backup resources (what to backup and where) located on the NAS, it fails: see screenshots (in Spanish, sorry):

SEGCIFS = IS OUR CELERRA NAS

9 Posts

August 18th, 2011 00:00

Hi,

present tape drives to data movers-  ?

Is there is easy command to see that information?

i ran this command:

[root@csgesitur nasadmin]# nas_server -info server_2
id        = 1
name      = server_2
acl       = 0
type      = nas
slot      = 2
member_of =
standby   = server_3, policy=auto
status    :
  defined = enabled

9 Posts

August 18th, 2011 02:00

Hi again

i can confirm you that the tapes in the Quantum cabinet are correctly presented to the datamovers.

We do not know if we also must present those tapes to the datamover on the Celerra NAS side. ??

please help

9 Legend

 • 

20.4K Posts

August 18th, 2011 05:00

NDMP backups can be accomplished via IP , where your backup servers pulls data from the datamover over your ip network or you can present a couple of tape drives directly to datamovers (via AUX ports on datamover) and perform backups via fiber channel network. Which option are you trying to do ?

9 Legend

 • 

20.4K Posts

August 18th, 2011 06:00

in backup exec, can you "uncheck" snapshots so it does not try to create one.

9 Posts

August 18th, 2011 06:00

Hi,

We do backup (NDMP backups) via IP

We have the backup server  which pulls the data from the NAS

see screenshot

Then destination to Quantum

Quantum device info:

please help

9 Posts

August 18th, 2011 06:00

Hi,

If we uncheck the snapshots option, then we lose the option off having SnapSure snapshots.  We obtained a license for that

[root@csgesitur nasadmin]# server_param server_2 -facility NDMP -list
server_2 :
param_name                       facility  default     current   configured
maxProtocolVersion                  NDMP          4          4
dialect                             NDMP
snapsure                            NDMP          0          1          1
includeCkptFs                       NDMP          1          1
md5                                 NDMP          1          1          1
tapeSilveringStr                    NDMP         ts         ts
convDialect                         NDMP     8859-1     8859-1
scsiReserve                         NDMP          1          1
bufsz                               NDMP        128        128
v4OldTapeCompatible                 NDMP          1          1
forceRecursiveForNonDAR             NDMP          0          0
excludeSvtlFs                       NDMP          1          1
snapTimeout                         NDMP          5          5

Also, Symantec reported: (and they refer to EMC)

Problem


Backups will fail with the error, "0xe000130b - The operation was terminated on the NDMP server" if run on EMC NAS device


Error


NDMP Mover Halted: Internal Error
NDMP Log Message: SnapSure file system creation fails
NDMP Data Halted: Aborted
UMI: V-79-57344-4875
Final error: 0xe000130b - The operation was terminated on the NDMP server.


Solution


Cause:
The backups fail with this error if the SnapSure is not enabled on the EMC server. (Figure 1)

9 Legend

 • 

20.4K Posts

August 18th, 2011 07:00

try these commands and tell me if they complete ok

fs_ckpt -name testcheckpoint -Create

if it succeeds , delete it

nas_fs -delete testcheckpoint -o umount=yes

9 Posts

August 19th, 2011 03:00

Hi,

Yes !!! know we found out why it not work. you were right !!! no space in pool

we ran

fs_ckpt id=xx -name testcheckpoint -Create  (id obtained via nas_fs -list command)

and we got:

operation in progress (not interruptible)...Error 12013: A pool could not be found on the storage system(s) CKM00085200043 to satisfy the request.

we cleaned some space in the pool via Celerra Gui console

re-ran the fs_ckpt command and finished ok. checkpoint created. Now we re-ran the backup job  and finished ok.

Thank you !!!! 

Gracias

Top