ONTAP Discussions

Analysing CIFS share file type usage

shocko
658 Views

I have several hundred CIFS shares with 90 millions files therein on a C-Mode 9.x cluster. I'm looking for a tool(s) that can scan them all and create reports showing the number of files, file-type/extension and locations they are in. Does NetApp have anything for this other than FSA (file System Analytics). I have found FSA adds a lot of CPU overhead. 

Other tools I have tried:

  1. JAM Treesize professional (No DB store for historic analysis)
  2. Scripting (cumbersome and need our own DB schema to store results at this volume)
  3. JAM Space Observer (cannot handle the load at this number of files)
5 REPLIES 5

elementx
654 Views

There are nice professional tools from partners like DataDobi and others.

Building your own isn't that hard, there are advantages and disadvantages to building your own. I got good results, it scaled very well (tested with 0.5, 1, 2, and 4 million files).

https://scaleoutsean.github.io/2025/06/05/simple-filesystem-and-s3-analytics-and-mcp.html#example-smb-share

I'd say the hard part is when you start having multiple users, when you need permissions (who can see what), authentication, people want fancy Web charts and it can becomes a distraction and/or time sink... If that can happen, it's probably better to buy than build...

Sanaman
636 Views

Try the NABox (Harvest/ Grafana) based. Developed by NetApp developers.

elementx
635 Views

Seriously? Harvest doesn't access network shares, how could it know anything about the files on them?

sanmanjax
608 Views

I believe that NetApp Classification is the tool for you - you can scan for stale files, find duplicates, get reports on share, file & folder security, identify sensitive information, & more. The best part is that it is FREE under 500 TiB!   Our environment currently in Classification is 189.2M files consuming 137.85 TiB.

I have found it to be very programmer-friendly, too, if you're into that.

Best wishes,
Daniel

 

robverhoeven
593 Views

I think XCP is also able to do this.... see https://xcp.netapp.com

Public