Start a Conversation

Unsolved

A

3 Posts

1693

June 21st, 2021 08:00

Isilon Deduplication Job Always Fails

Hi, We have an Isilon cluster of 4 nodes. Each time we run a deduplication job it fails.

Is there a way to see what is causing the failure? 

Job Event Details

 

Time:

2020-12-14 17:00:36
 
Event ID:
1798980
 
Job ID:
26922
 
Job Type:
Dedupe
 
Event:
State change
 
State:
Failed
 
Phase: 1
 

 

I've tried running the dedupe job against different directories, but it always fails.

We are out of support so I can't raise a ticket with Dell. Any help much appreciated.

Moderator

 • 

7.6K Posts

June 21st, 2021 15:00

Hello AlteredApe,

Which Isilon system do you have and what is your current onefs version that you are using as well?

June 22nd, 2021 00:00

Hi,

 Thanks for the speedy response.

 It's actually a 5 node cluster. 2x X200 3x X210 modules. Running 8.1.2.0. So quite old.

 

June 22nd, 2021 03:00

Looking at the report I get this:

% isi job reports view -v --id 36049
Dedupe[36049] phase 1 (2021-06-11T12:47:08)
-------------------------------------------
Errors 1
Error list [ 21-06-11 12:45:58 Dedupe[36049] Node 6 (6) task 6-194: Device busy ]

% isi job reports view -v --id 36510
Dedupe[36510] phase 1 (2021-06-15T23:01:23)
-------------------------------------------
Errors 1
Error list [ 21-06-15 23:00:18 Dedupe[36510] Node 5 (5) task 6-142: Invalid argument ]

% isi job reports view -v --id 36706
Dedupe[36706] phase 1 (2021-06-21T14:39:17)
-------------------------------------------
Errors 1
Error list [ 21-06-21 14:38:15 Dedupe[36706] Node 5 (5) task 6-84: Invalid argument ]


% isi job reports view -v --id 36708
Dedupe[36708] phase 1 (2021-06-21T14:53:04)
-------------------------------------------
Errors 1
Error list [ 21-06-21 14:51:59 Dedupe[36708] Node 4 (4) task 6-84: Invalid argument ]

% isi job reports view -v --id 36710
Dedupe[36710] phase 1 (2021-06-21T15:14:26)
-------------------------------------------
Errors 1
Error list [ 21-06-21 15:13:25 Dedupe[36710] Node 4 (4) task 6-84: Invalid argument ]


% isi job reports view -v --id 36712
Dedupe[36712] phase 1 (2021-06-21T15:23:30)
-------------------------------------------
Errors 1
Error list [ 21-06-21 15:22:29 Dedupe[36712] Node 4 (4) task 6-84: Invalid argument ]

1 Message

June 22nd, 2021 05:00

SmartDedupe deduplicates data by scanning an Isilon cluster for identical data blocks. Each block is 8 KB. If SmartDedupe finds duplicate blocks, SmartDedupe moves a single copy of the blocks to a hidden file called a shadow store. SmartDedupe then deletes the duplicate blocks from the original files and replaces the blocks with pointers to the shadow store.

Moderator

 • 

7.6K Posts

June 22nd, 2021 11:00

Hello AlteredApe,

Looking at your error log you posted it states that there are invalid arguments.  What I would do is to try & recreate the job from scratch to see if you still get the error.  I would also check the administrator guide to make sure that the jobs are created correctly.  Here is the link to the admin guide. https://dell.to/3zOm7Q8

1 Message

June 24th, 2022 11:00

Did you ever figure out what was going on??  im having the same issues.   I tried removing all the jobs, and configured the assessment and dedupe job to just be /ifs/data  and  ran a 5 day job for just the dedupe assessment and that worked.   When i rand the dedupe job again, it failed.  So any insight would be appreciated.

Moderator

 • 

7.6K Posts

June 24th, 2022 14:00

Hello glong101,

Which Isilon system do you have and what is your current Onefs version?

December 28th, 2023 20:24

Hello!
Did you find a solution to your issue? Can you share it? 

No Events found!

Top