Looking for some key numbers regarding DeDupe

[raol]

Hello everyone,

I was wondering if there was an equivalent output using PStoolkit for 'df -s'.

I looked but could not find it...

I looked at two possible candidates... Get-NaVol & Get-NaSis but did not see the saved number in either. (still using v2.1)

What I am also interested in is the 'num_blks_vol_dense_metadata' number from the stats command... I know that would be a long shot but figured I'd try my luck 🙂

Thanks in advance

Mayur

[vinith]

Hello you can use "Get-NaEfficiency" cmdlet to get the required info

PS C:\Users\vinith> Get-NaEfficiency

Volume ReturnsInfo:

    - Dedupe:  The savings that results from using deduplication.

    - Compression:  The savings that results from using compression.

    - Snapshot:  The savings that results from using volume snapshots.  This is equal to:  snapshot savings = data

used space - (snapshot used space / number of snapshots).  We divide the snapshot used space by the number of

snapshots to get an accurate savings calculation from volumes with long-running snapshots that effectively consume

more space than the space consumed by the data.

    - Cloning:  The savings that result from using NetApp Volume FlexClones.  The value is equal to the result of

the volume-clone-split-estimate API.

[raol]

Thank you Vinith,

Who would think they would hide this cmdlet in 'Toolkit' ?

so this works... but, I finally did some more digging and found something that shows exactly the output of 'df -s'... Get-NaVolSis

The other curiosity now is... why do the numbers between Get-NaEfficiency and Get-NaVolSis not match in terms of the savings ?

In my case 'df -s' & Get-NaVolSis shows 53% and Get-NaEfficiency shows 49%... the only difference is that the first case talks about Dedup Saved % and the second talks about Efficiency %... which I am assuming involve more than just Dedup...

[beam]

The Get-NaEfficiency cmdlet does involve more than just dedupe.  You can see the details in the 'Returns' field returned by Get-NaEfficiency:

PS C:\> $efficiency = Get-NaEfficiency vol1

PS C:\> $efficiency

Name                     Capacity         Used         Free    SnapUsage      Reserve      Returns EfficiencyPercentage

----                     --------         ----         ----    ---------      -------      ------- --------------------

vol1                     100.0 GB      79.2 GB      20.8 GB      18.4 GB            0     121.0 GB                 200%

PS C:\> $efficiency.Returns

Dedupe      : 66873917440

Compression : 0

Snapshot    : 63072938211

Cloning     : 0

Total       : 129946855651

The Dedupe value is bytes saved by deduplication.  It is the same value returned by Get-NaVolSis:

PS C:\> Get-NaVolSis vol1

CompressSaved        : 0

DedupSaved           : 66873917440

LastOperationBegin   : Fri Mar 29 01:00:00 EDT 2013

LastOperationEnd     : Fri Mar 29 01:06:21 EDT 2013

LastOperationError   :

LastOperationSize    : 15331995648

PercentageSaved      : 44

PercentCompressSaved : 0

PercentDedupSaved    : 44

PercentTotalSaved    : 44

Progress             : idle for 09:28:37

Schedule             : sun-sat@1

SizeSaved            : 66873917440

SizeShared           : 4914774016

State                : enabled

Status               : idle

TotalSaved           : 66873917440

Type                 : regular

-Steven

[WHITECLOUD]

Where can we get explanations such as this and what Vinith mentioned?  Is there documentation with descriptions of the properties returned by the get-* commandlets? 

[vinith]

Check out "Making the Most of Data ONTAP PowerShell Toolkit" for more details on the new features.  If you're new to PowerShell or the Toolkit, you might want to start with our "Getting Started" slides.

You can filter cmdlets by category then later explore for more help about those cmdlets in those categories. Here's how you can do the same.

PS C:\Users\vinith> Get-NaHelp | select category -Unique
Category
--------
aggr
cifs
toolkit
fpolicy
host
igroup
iscsi
license
lun
net
nfs
portset
quota
radius
snapvault
snmp
clone
disk
fcp
options
vfiler
nameservice
cf
copyoffload
fc
ndmp
priority
reallocate
sis
snapmirror
rsh
storage adapter
useradmin
feature
file
flash
lock
perf
qtree
ses
snaplock
snapshot
system
clock
volume
vss
secureadmin
ems
wafl
consistency group

Then later explore the set of cmdlets in each category one by one, for example you can see below that below i can see all the cmdlets which belong to the category type Aggregate

PS C:\Users\vinith> Get-NaHelp -Category aggr
Name                                Category        Api
----                                --------        ---
Add-NaAggr                          aggr            {aggr-add}
Confirm-NaAggrSpareLow              aggr            {aggr-check-spare-low}
Get-NaAggr                          aggr            {aggr-list-info}
Get-NaAggrFilerInfo                 aggr            {aggr-get-filer-info}
Get-NaAggrMediaScrub                aggr            {aggr-mediascrub-list-info}
Get-NaAggrOption                    aggr            {aggr-options-list-info}
Get-NaAggrScrub                     aggr            {aggr-scrub-list-info}
Get-NaAggrSpace                     aggr            {aggr-space-list-info}
Get-NaAggrVerify                    aggr            {aggr-verify-list-info}
New-NaAggr                          aggr            {aggr-create}
New-NaAggrMirror                    aggr            {aggr-mirror}
Remove-NaAggr                       aggr            {aggr-destroy}
Rename-NaAggr                       aggr            {aggr-rename}
Resume-NaAggrScrub                  aggr            {aggr-scrub-resume}
Resume-NaAggrVerify                 aggr            {aggr-verify-resume}
Set-NaAggr                          aggr            {aggr-online, aggr-offline, aggr-restrict}
Set-NaAggrOption                    aggr            {aggr-set-option}
Set-NaAggrRaidType                  aggr            {aggr-modify-raid-type}
Split-NaAggrMirror                  aggr            {aggr-split}
Start-NaAggrScrub                   aggr            {aggr-scrub-start}
Start-NaAggrVerify                  aggr            {aggr-verify-start}
Stop-NaAggrScrub                    aggr            {aggr-scrub-stop}
Stop-NaAggrVerify                   aggr            {aggr-verify-stop}
Suspend-NaAggrScrub                 aggr            {aggr-scrub-suspend}
Suspend-NaAggrVerify                aggr            {aggr-verify-suspend}

If you need to get more detailed help on the cmdlets you can do the following.

PS C:\Users\vinith> Get-Help Add-NaAggr -Detailed

[JGPSHNTAP]

Beam is right...

I tend to use get-navolsis and then use a math function to get what i'm looking for

$sis = get-navolsis $name

[System.Math]::Floor($sis.sizesaved/1gb)

[SKHari]

We are looking for cmdlets for getting output of Deduplication in below format. Through the command sis status -l we can get the Stale Fingerprint % but we are unable to find the Powershell Cmdlets for getting the output of Stale fingerprint. Can you please assist us on this.

			PRE-DEDUPE	POST-DEDUPE	Start time of Dedupe
Netapp Controller	Datastore	Time to complete Dedupe	Free Space	Stale Fingerprint %	Free Space	Stale Fingerprint %
xxxxxxxxx	/vol/NFS_Infra	01hrs 45mins 30sec	674GB	30%	673GB	13%	00:00 GMT
xxxxxxxxx	/vol/NFS_Desktops1	01hrs 13mins 35sec	1548GB	7%	1692GB	14%	00:00 GMT
xxxxxxxxx	/vol/NFS_Desktops3	01hrs 08mins 33sec	1548GB	13%	1692GB	20%	00:00 GMT