Looking for some key numbers regarding DeDupe

raol · ‎2013-03-28

Hello everyone,

I was wondering if there was an equivalent output using PStoolkit for 'df -s'.

I looked but could not find it...

I looked at two possible candidates... Get-NaVol & Get-NaSis but did not see the saved number in either. (still using v2.1)

What I am also interested in is the 'num_blks_vol_dense_metadata' number from the stats command... I know that would be a long shot but figured I'd try my luck 🙂

Thanks in advance

Mayur

vinith · ‎2013-03-29

Hello you can use "Get-NaEfficiency" cmdlet to get the required info

PS C:\Users\vinith> Get-NaEfficiency

Volume ReturnsInfo:

- Dedupe: The savings that results from using deduplication.

- Compression: The savings that results from using compression.

- Snapshot: The savings that results from using volume snapshots. This is equal to: snapshot savings = data

used space - (snapshot used space / number of snapshots). We divide the snapshot used space by the number of

snapshots to get an accurate savings calculation from volumes with long-running snapshots that effectively consume

more space than the space consumed by the data.

- Cloning: The savings that result from using NetApp Volume FlexClones. The value is equal to the result of

the volume-clone-split-estimate API.

raol · ‎2013-03-29

Thank you Vinith,

Who would think they would hide this cmdlet in 'Toolkit' ?

so this works... but, I finally did some more digging and found something that shows exactly the output of 'df -s'... Get-NaVolSis

The other curiosity now is... why do the numbers between Get-NaEfficiency and Get-NaVolSis not match in terms of the savings ?

In my case 'df -s' & Get-NaVolSis shows 53% and Get-NaEfficiency shows 49%... the only difference is that the first case talks about Dedup Saved % and the second talks about Efficiency %... which I am assuming involve more than just Dedup...

beam · ‎2013-03-29

The Get-NaEfficiency cmdlet does involve more than just dedupe. You can see the details in the 'Returns' field returned by Get-NaEfficiency:

PS C:\> $efficiency = Get-NaEfficiency vol1

PS C:\> $efficiency

Name Capacity Used Free SnapUsage Reserve Returns EfficiencyPercentage

---- -------- ---- ---- --------- ------- ------- --------------------

vol1 100.0 GB 79.2 GB 20.8 GB 18.4 GB 0 121.0 GB 200%

PS C:\> $efficiency.Returns

Dedupe : 66873917440

Compression : 0

Snapshot : 63072938211

Cloning : 0

Total : 129946855651

The Dedupe value is bytes saved by deduplication. It is the same value returned by Get-NaVolSis:

PS C:\> Get-NaVolSis vol1

CompressSaved : 0

DedupSaved : 66873917440

LastOperationBegin : Fri Mar 29 01:00:00 EDT 2013

LastOperationEnd : Fri Mar 29 01:06:21 EDT 2013

LastOperationError :

LastOperationSize : 15331995648

PercentageSaved : 44

PercentCompressSaved : 0

PercentDedupSaved : 44

PercentTotalSaved : 44

Progress : idle for 09:28:37

Schedule : sun-sat@1

SizeSaved : 66873917440

SizeShared : 4914774016

State : enabled

Status : idle

TotalSaved : 66873917440

Type : regular

-Steven

WHITECLOUD · ‎2013-07-31

Where can we get explanations such as this and what Vinith mentioned? Is there documentation with descriptions of the properties returned by the get-* commandlets?

vinith · ‎2013-08-01

Check out "Making the Most of Data ONTAP PowerShell Toolkit" for more details on the new features. If you're new to PowerShell or the Toolkit, you might want to start with our "Getting Started" slides.

You can filter cmdlets by category then later explore for more help about those cmdlets in those categories. Here's how you can do the same.

PS C:\Users\vinith> Get-NaHelp | select category -Unique

Category

--------

aggr

cifs

toolkit

fpolicy

host

igroup

iscsi

license

lun

net

nfs

portset

quota

radius

snapvault

snmp

clone

disk

fcp

options

vfiler

nameservice

cf

copyoffload

fc

ndmp

priority

reallocate

sis

snapmirror

rsh

storage adapter

useradmin

feature

file

flash

lock

perf

qtree

ses

snaplock

snapshot

system

clock

volume

vss

secureadmin

ems

wafl

consistency group

Then later explore the set of cmdlets in each category one by one, for example you can see below that below i can see all the cmdlets which belong to the category type Aggregate

PS C:\Users\vinith> Get-NaHelp -Category aggr

Name Category Api

---- -------- ---

Add-NaAggr aggr {aggr-add}

Confirm-NaAggrSpareLow aggr {aggr-check-spare-low}

Get-NaAggr aggr {aggr-list-info}

Get-NaAggrFilerInfo aggr {aggr-get-filer-info}

Get-NaAggrMediaScrub aggr {aggr-mediascrub-list-info}

Get-NaAggrOption aggr {aggr-options-list-info}

Get-NaAggrScrub aggr {aggr-scrub-list-info}

Get-NaAggrSpace aggr {aggr-space-list-info}

Get-NaAggrVerify aggr {aggr-verify-list-info}

New-NaAggr aggr {aggr-create}

New-NaAggrMirror aggr {aggr-mirror}

Remove-NaAggr aggr {aggr-destroy}

Rename-NaAggr aggr {aggr-rename}

Resume-NaAggrScrub aggr {aggr-scrub-resume}

Resume-NaAggrVerify aggr {aggr-verify-resume}

Set-NaAggr aggr {aggr-online, aggr-offline, aggr-restrict}

Set-NaAggrOption aggr {aggr-set-option}

Set-NaAggrRaidType aggr {aggr-modify-raid-type}

Split-NaAggrMirror aggr {aggr-split}

Start-NaAggrScrub aggr {aggr-scrub-start}

Start-NaAggrVerify aggr {aggr-verify-start}

Stop-NaAggrScrub aggr {aggr-scrub-stop}

Stop-NaAggrVerify aggr {aggr-verify-stop}

Suspend-NaAggrScrub aggr {aggr-scrub-suspend}

Suspend-NaAggrVerify aggr {aggr-verify-suspend}

If you need to get more detailed help on the cmdlets you can do the following.

PS C:\Users\vinith> Get-Help Add-NaAggr -Detailed

SKHari · ‎2016-07-28

We are looking for cmdlets for getting output of Deduplication in below format. Through the command sis status -l we can get the Stale Fingerprint % but we are unable to find the Powershell Cmdlets for getting the output of Stale fingerprint. Can you please assist us on this.

			PRE-DEDUPE	POST-DEDUPE	Start time of Dedupe
Netapp Controller	Datastore	Time to complete Dedupe	Free Space	Stale Fingerprint %	Free Space	Stale Fingerprint %
xxxxxxxxx	/vol/NFS_Infra	01hrs 45mins 30sec	674GB	30%	673GB	13%	00:00 GMT
xxxxxxxxx	/vol/NFS_Desktops1	01hrs 13mins 35sec	1548GB	7%	1692GB	14%	00:00 GMT
xxxxxxxxx	/vol/NFS_Desktops3	01hrs 08mins 33sec	1548GB	13%	1692GB	20%	00:00 GMT

JGPSHNTAP · ‎2013-08-01

Beam is right...

I tend to use get-navolsis and then use a math function to get what i'm looking for

$sis = get-navolsis $name

[System.Math]::Floor($sis.sizesaved/1gb)