Unsolved
3 Posts
0
1693
June 21st, 2021 08:00
Isilon Deduplication Job Always Fails
Hi, We have an Isilon cluster of 4 nodes. Each time we run a deduplication job it fails.
Is there a way to see what is causing the failure?
Job Event Details
Time:
2020-12-14 17:00:36
Event ID:
1798980
Job ID:
26922
Job Type:
Dedupe
Event:
State change
State:
Failed
Phase: 1
I've tried running the dedupe job against different directories, but it always fails.
We are out of support so I can't raise a ticket with Dell. Any help much appreciated.
No Events found!
DELL-Sam L
Moderator
•
7.6K Posts
0
June 21st, 2021 15:00
Hello AlteredApe,
Which Isilon system do you have and what is your current onefs version that you are using as well?
AlteredApe
3 Posts
0
June 22nd, 2021 00:00
Hi,
Thanks for the speedy response.
It's actually a 5 node cluster. 2x X200 3x X210 modules. Running 8.1.2.0. So quite old.
AlteredApe
3 Posts
0
June 22nd, 2021 03:00
Looking at the report I get this:
% isi job reports view -v --id 36049
Dedupe[36049] phase 1 (2021-06-11T12:47:08)
-------------------------------------------
Errors 1
Error list [ 21-06-11 12:45:58 Dedupe[36049] Node 6 (6) task 6-194: Device busy ]
% isi job reports view -v --id 36510
Dedupe[36510] phase 1 (2021-06-15T23:01:23)
-------------------------------------------
Errors 1
Error list [ 21-06-15 23:00:18 Dedupe[36510] Node 5 (5) task 6-142: Invalid argument ]
% isi job reports view -v --id 36706
Dedupe[36706] phase 1 (2021-06-21T14:39:17)
-------------------------------------------
Errors 1
Error list [ 21-06-21 14:38:15 Dedupe[36706] Node 5 (5) task 6-84: Invalid argument ]
% isi job reports view -v --id 36708
Dedupe[36708] phase 1 (2021-06-21T14:53:04)
-------------------------------------------
Errors 1
Error list [ 21-06-21 14:51:59 Dedupe[36708] Node 4 (4) task 6-84: Invalid argument ]
% isi job reports view -v --id 36710
Dedupe[36710] phase 1 (2021-06-21T15:14:26)
-------------------------------------------
Errors 1
Error list [ 21-06-21 15:13:25 Dedupe[36710] Node 4 (4) task 6-84: Invalid argument ]
% isi job reports view -v --id 36712
Dedupe[36712] phase 1 (2021-06-21T15:23:30)
-------------------------------------------
Errors 1
Error list [ 21-06-21 15:22:29 Dedupe[36712] Node 4 (4) task 6-84: Invalid argument ]
Orlandosz
1 Message
0
June 22nd, 2021 05:00
SmartDedupe deduplicates data by scanning an Isilon cluster for identical data blocks. Each block is 8 KB. If SmartDedupe finds duplicate blocks, SmartDedupe moves a single copy of the blocks to a hidden file called a shadow store. SmartDedupe then deletes the duplicate blocks from the original files and replaces the blocks with pointers to the shadow store.
DELL-Sam L
Moderator
•
7.6K Posts
0
June 22nd, 2021 11:00
Hello AlteredApe,
Looking at your error log you posted it states that there are invalid arguments. What I would do is to try & recreate the job from scratch to see if you still get the error. I would also check the administrator guide to make sure that the jobs are created correctly. Here is the link to the admin guide. https://dell.to/3zOm7Q8
glong101
1 Message
0
June 24th, 2022 11:00
Did you ever figure out what was going on?? im having the same issues. I tried removing all the jobs, and configured the assessment and dedupe job to just be /ifs/data and ran a 5 day job for just the dedupe assessment and that worked. When i rand the dedupe job again, it failed. So any insight would be appreciated.
DELL-Sam L
Moderator
•
7.6K Posts
0
June 24th, 2022 14:00
Hello glong101,
Which Isilon system do you have and what is your current Onefs version?
NikolayPylnev
1 Message
0
December 28th, 2023 20:24
Hello!
Did you find a solution to your issue? Can you share it?