Duplicate Files Deletion

[sprmachtmann]

Are there any way to optimizing storage by deleting duplicate files automatically? Any  recommendations will be appreciated.

CIFS environment, Classification, BlueXP onprem , Cloud Data Sense - Not Legacy version.

[chamfer]

Hi @sprmachtmann,

Can you provide more information?  Your question is generic and adding more information would assist the community with providing you with some recommendations.

I would start by:

1. Defining your definition of "optimizing storage" - Some would say "just enable de-duplication" assuming this is not enabled.
2. Providing more information about your platform - AFF/FAS/CVO/etc
3. How you are seeing duplicate files and your ideal end state.
4. Do you have any constraints around installing software or using scripts for this process?

That is a start, but more information will help those trying to help you..... and I hope that this helps!

[sprmachtmann]

Hi @chamfer ,

Environment runs on AFF system. Our ideal end state is every duplicated files will be reduced as non-duplicated.

No restriction or avoidance for any software or script. 

[Adithya_Kameswaran · Accepted solution]

Hello @sprmachtmann , 

As mentioned by @chamfer , can you validate if deduplication is enabled for the volumes in your AFF cluster. I am herewith attaching a documentation that details about enabling deduplication: 

http://docs.netapp.com/us-en/ontap/volumes/enable-deduplication-volume-task.html

You can also validate if the storage efficiency is enabled for a particular volume by running the command: 

::> volume efficiency show <vol_name> -instance