topic Re: Any way to increase the rate of deduplication in ONTAP Discussions https://community.netapp.com/t5/ONTAP-Discussions/Any-way-to-increase-the-rate-of-deduplication/m-p/60421#M14226 <HTML><HEAD></HEAD><BODY><P>From the <A href="http://media.netapp.com/documents/tr-3505.pdf" target="_blank">NetApp Deduplication for FAS and V-Series Deployment and Implementation Guide</A>:</P><P></P><PRE __jive_macro_name="quote"><P>THE PERFORMANCE OF THE DEDUPLICATION OPERATION<BR />The performance of the deduplication operation itself varies widely depending on the factors listed above, and this determines how long it takes this background process to finish running. On a FAS6080 with no other load on the system, we have seen deduplication performances of up to 120 MBytes/sec (running a single deduplication session). If multiple deduplication streams are running, this total bandwidth gets divided evenly into the number of streams.<BR />To get an idea of how long it takes for a deduplication process to complete, let’s say that the deduplication process is running on a flexible volume at 25MB/sec. If 1TB of new data has been added to the volume since the last deduplication update, this deduplication operation takes about 10 to 12 hours to complete. <STRONG>(There are no configurable parameters that can tune the deduplication process; that is, the priority of this background process in Data ONTAP is fixed.)</STRONG></P></PRE><P></P><P>Although no system-wide control is available you would be able to prioritize dedupe activity (using 'system' as a proxy) on a given flexvol through the use of FlexShare.</P></BODY></HTML> Fri, 29 May 2009 14:43:15 GMT madden 2009-05-29T14:43:15Z Any way to increase the rate of deduplication https://community.netapp.com/t5/ONTAP-Discussions/Any-way-to-increase-the-rate-of-deduplication/m-p/60416#M14224 <HTML><HEAD></HEAD><BODY><P>Are there any tunable parameters to increase/decrease the rate at which the data deduplication process runs?</P><P></P><P>I am currently un deduping a volume and I would like to increase the rate at which that is being done</P></BODY></HTML> Thu, 05 Jun 2025 07:27:42 GMT https://community.netapp.com/t5/ONTAP-Discussions/Any-way-to-increase-the-rate-of-deduplication/m-p/60416#M14224 TerryMcCoy 2025-06-05T07:27:42Z Re: Any way to increase the rate of deduplication https://community.netapp.com/t5/ONTAP-Discussions/Any-way-to-increase-the-rate-of-deduplication/m-p/60421#M14226 <HTML><HEAD></HEAD><BODY><P>From the <A href="http://media.netapp.com/documents/tr-3505.pdf" target="_blank">NetApp Deduplication for FAS and V-Series Deployment and Implementation Guide</A>:</P><P></P><PRE __jive_macro_name="quote"><P>THE PERFORMANCE OF THE DEDUPLICATION OPERATION<BR />The performance of the deduplication operation itself varies widely depending on the factors listed above, and this determines how long it takes this background process to finish running. On a FAS6080 with no other load on the system, we have seen deduplication performances of up to 120 MBytes/sec (running a single deduplication session). If multiple deduplication streams are running, this total bandwidth gets divided evenly into the number of streams.<BR />To get an idea of how long it takes for a deduplication process to complete, let’s say that the deduplication process is running on a flexible volume at 25MB/sec. If 1TB of new data has been added to the volume since the last deduplication update, this deduplication operation takes about 10 to 12 hours to complete. <STRONG>(There are no configurable parameters that can tune the deduplication process; that is, the priority of this background process in Data ONTAP is fixed.)</STRONG></P></PRE><P></P><P>Although no system-wide control is available you would be able to prioritize dedupe activity (using 'system' as a proxy) on a given flexvol through the use of FlexShare.</P></BODY></HTML> Fri, 29 May 2009 14:43:15 GMT https://community.netapp.com/t5/ONTAP-Discussions/Any-way-to-increase-the-rate-of-deduplication/m-p/60421#M14226 madden 2009-05-29T14:43:15Z