Need help understanding filesystem usage

Depends on how you actually look at usage like block view vs. file view vs. client view

Lots of possible reasons why it doesn’t add up like

- Single instanced files or compressed file

- Quota not counting root usage

- Client view not counting fs metadata

- Partially filled 8k blocks

- Quota recalc necessary

- …..

Savvol usage isn’t visible in file system stats

Without more info that’s just guessing.

You don’t say how your are viewing usage or whether you mean user quota’s or treequota’s

Hi Rainer - thanks for the reply.

The numbers I posted where from a right click of the file system in Unisphere. What's confusing me, is that I thought the usage was a representation of data, but actual data.....which I got from adding up how much space was taken up in the tree quotas, only adds up to 1983GB.

So actual data is less than 2TB, but the file system is reporting 6.8TB USED. Seems way off to me.

***"Savvol usage isn’t visible in file system stats"***

Isn't the savvol represented in file system properties, under "checkpoint storage"?

server_df agrees with nas_fs. I also posted a nas tree quota report. I do not understand why it doesn't even come close to adding up. From the tree quota report, I added up the KB's. It came out to 1.94TB

$ server_df server_4 cvscifsp04_ata

server_4 :

Filesystem          kbytes         used        avail capacity Mounted on

cvscifsp04_ata  8306041328   7227065688   1078975640   87%    /root_vdm_3/cvscifsp04_ata

$ nas_fs -size cvscifsp04_ata

total = 8111368 avail = 1053682 used = 7057687 ( 87% ) (sizes in MB) ( blockcount = 16869490688 )

volume: total = 8237056 (sizes in MB) ( blockcount = 16869490688 ) avail = 1053681 used = 7183375 ( 87% )

_____________________________________________________________________________________________

nas_quotas -report -tree -fs cvscifsp04_ata

Report for tree quotas on filesystem cvscifsp04_ata mounted on /root_vdm_3/cvscifsp04_ata

+------------+-----------------------------------------------+-----------------------------------------------+

| Tree       |                 Bytes Used  (1K)              |                    Files                      |

+------------+------------+------------+------------+--------+------------+------------+------------+--------+

|            |    Used    |    Soft    |    Hard    |Timeleft|    Used    |    Soft    |    Hard    |Timeleft|

+------------+------------+------------+------------+--------+------------+------------+------------+--------+

|#1          |   759640400|     NoLimit|   943718400|        |      532968|           0|           0|        |

|#2          |    58175720|     NoLimit|   943718400|        |     1428298|           0|           0|        |

|#3          |   543813008|     NoLimit|  1730150400|        |     1627802|           0|           0|        |

|#4          |   367927800|     NoLimit|   629145600|        |      587670|           0|           0|        |

|#5          |   148708832|     NoLimit|   838860800|        |     1076536|           0|           0|        |

|#6          |   200853360|     NoLimit|   419430400|        |      478692|           0|           0|        |

|#7          |     7676256|     NoLimit|   524288000|        |       67480|           0|           0|        |

|#8          |       97184|     NoLimit|   157286400|        |       10806|           0|           0|        |

+------------+------------+------------+------------+--------+------------+------------+------------+--------+

Please post a server_df output

Server_df is always correct about how much space is used in the file system

Make sure all directories on top of the filesystem are also tree quotas.

If you want the sum of the treequotas correspond to the used fs space, make sure, there are no files directories outside of the treequotas.

If deduplication on this fs is on, then the treequota sum will not correspond to the used fs space.

Run a nas_quota -check ..

sorry - didnt see you reply  with server_df output in the EMail watches

yes they do indeed not add up

I would suggest to first do a "nas_quotas -check"

If they still dont add up you need to look for the other potential reasons mentioned before

you could also do a quick check from a Unix/NFS client doing a "du -sh *" in the file system root

I ran the nas_quotas check on all the quotas. The FS is reporting the same thing, as are the quotas.

I also took a look to see if there were shares that didn't have tree quotas. I didn't see anything. All the folders under the file system have tree quotas.

________________________________

drwxr-xr-x 13 root root 1024 Sep  5  2013 .

drwxr-xr-x 34 root bin  3072 Dec  2  2014 ..

dr-xr-xr-x  2 root bin  1024 Aug 27 07:22 .etc

drwxr-xr-x  6 root bin  1024 Mar 11 11:34 L

drwxr-xr-x  2 root root 8192 Apr  5  2013 lost+found

drwxr-xr-x 15 root bin  1024 Aug 23 11:48 M

drwxr-xr-x  4 root bin  1024 Mar 11 11:34 N

drwxr-xr-x  7 root bin  1024 Aug  3 12:48 O

drwxr-xr-x  8 root bin  1024 Mar 11 11:34 P

drwxr-xr-x 11 root bin  1024 Jul 11 13:19 R

drwxr-xr-x  3 root bin  1024 Mar 11 11:34 T

drwxr-xr-x  4 root bin  1024 Mar 11 11:34 V

[nasadmin@Rri1vnx679cs0 cvscifsp04_ata]$ pwd

/nas/quota/slot_4/root_vdm_3/cvscifsp04_ata

___________________________________________

| Quota trees for filesystem cvscifsp04_ata mounted  on /root_vdm_3/cvscifsp04_ata:

+------+-----------------------------------------------------------------------+

|TreeId| Quota tree path (Comment)                                             |

+------+-----------------------------------------------------------------------+

|    1 | /L ()                                                                 |

|    2 | /R ()                                                                 |

|    3 | /M ()                                                                 |

|    4 | /N ()                                                                 |

|    5 | /O ()                                                                 |

|    6 | /P ()                                                                 |

|    7 | /V ()                                                                 |

|    8 | /T ()                                                                 |

+------+-----------------------------------------------------------------------+

run a du -sh for each subdir

also check your quota params whether you can files owned by root and if your quota policy is file or block

check .etc and lost+found

It takes a while to run du on the subs, I've only gotten to the 1st one, but the output was odd.

Quota L has a 900GB hard limit, and a nas quotas report says that there's 770GB used...so 86% full

I ran du -sh on this and it came back with 1.2TB....pretty confusing

Do you have file deduplication enabled on that fs ?

yes.

$ fs_dedupe -i cvscifsp04_ata

Id                                 = 166

Name                               = cvscifsp04_ata

Deduplication                      = On