topic Re: Dedupe Running extremely slow in ONTAP Discussions

Dedupe Running extremely slow

johnhuber — Wed, 04 Jun 2025 10:21:18 GMT

Have a problem where dedupe on a aggregate is running extremely slow. Some operations have been running for 2 weeks or more on volumes it you take minutes to run. We are running Ontap 9.7 P3. The hardware is FAS2620, Shelf : DS212-12 with IOM12E modules with 7TB SATA disks. There are no errors in the logs. Everything shows normal. File access is normal. Netapp support so far has not been helpful. They had me try stopping a starting depdupe runs. Most the the time the dedupe does not says it is stopping but never does. Have be able to start and stop the process on some small volumes but dedupe still take extremely long to complete or the process hangs up for long periods. There in nothing running in the job that would affect it.

Any Ideas or experience with this problem

Thanks

Re: Dedupe Running extremely slow

SpindleNinja — Thu, 17 Jun 2021 20:51:50 GMT

It is a background process, so if you run a new a new scan with "scan old data true". it might take a while.

If you look at the jobs, are they making progress?

And How much data are we talking here?

Re: Dedupe Running extremely slow

johnhuber — Fri, 18 Jun 2021 14:50:08 GMT

You can see progress on small volumes but larger volume do not appear to be moving . Volume range from 200 GB up to 8TB

Re: Dedupe Running extremely slow

paul_stejskal — Fri, 18 Jun 2021 16:01:07 GMT

How are your disks? https://kb.netapp.com/Advice_and_Troubleshooting/Data_Storage_Software/ONTAP_OS/How_to_address_latency_from_disks_in_ONTAP https://kb.netapp.com/Advice_and_Troubleshooting/Data_Storage_Software/ONTAP_OS/How_to_Assess_Disk_Response_Times_in_ONTAP