Microsoft Virtualization Discussions

Looking for some key numbers regarding DeDupe

raol
7,078 Views

Hello everyone,

I was wondering if there was an equivalent output using PStoolkit for 'df -s'.

I looked but could not find it...

I looked at two possible candidates... Get-NaVol & Get-NaSis but did not see the saved number in either. (still using v2.1)

What I am also interested in is the 'num_blks_vol_dense_metadata' number from the stats command... I know that would be a long shot but figured I'd try my luck 🙂

Thanks in advance

Mayur

7 REPLIES 7

vinith
7,078 Views

Hello you can use "Get-NaEfficiency" cmdlet to get the required info

PS C:\Users\vinith> Get-NaEfficiency

Volume ReturnsInfo:

    - Dedupe:  The savings that results from using deduplication.

    - Compression:  The savings that results from using compression.

    - Snapshot:  The savings that results from using volume snapshots.  This is equal to:  snapshot savings = data

used space - (snapshot used space / number of snapshots).  We divide the snapshot used space by the number of

snapshots to get an accurate savings calculation from volumes with long-running snapshots that effectively consume

more space than the space consumed by the data.

    - Cloning:  The savings that result from using NetApp Volume FlexClones.  The value is equal to the result of

the volume-clone-split-estimate API.

raol
7,078 Views

Thank you Vinith,

Who would think they would hide this cmdlet in 'Toolkit' ?

so this works... but, I finally did some more digging and found something that shows exactly the output of 'df -s'... Get-NaVolSis

The other curiosity now is... why do the numbers between Get-NaEfficiency and Get-NaVolSis not match in terms of the savings ?

In my case 'df -s' & Get-NaVolSis shows 53% and Get-NaEfficiency shows 49%... the only difference is that the first case talks about Dedup Saved % and the second talks about Efficiency %... which I am assuming involve more than just Dedup...

beam
7,078 Views

The Get-NaEfficiency cmdlet does involve more than just dedupe.  You can see the details in the 'Returns' field returned by Get-NaEfficiency:

PS C:\> $efficiency = Get-NaEfficiency vol1

PS C:\> $efficiency

Name                     Capacity         Used         Free    SnapUsage      Reserve      Returns EfficiencyPercentage

----                     --------         ----         ----    ---------      -------      ------- --------------------

vol1                     100.0 GB      79.2 GB      20.8 GB      18.4 GB            0     121.0 GB                 200%

PS C:\> $efficiency.Returns

Dedupe      : 66873917440

Compression : 0

Snapshot    : 63072938211

Cloning     : 0

Total       : 129946855651

The Dedupe value is bytes saved by deduplication.  It is the same value returned by Get-NaVolSis:

PS C:\> Get-NaVolSis vol1

CompressSaved        : 0

DedupSaved           : 66873917440

LastOperationBegin   : Fri Mar 29 01:00:00 EDT 2013

LastOperationEnd     : Fri Mar 29 01:06:21 EDT 2013

LastOperationError   :

LastOperationSize    : 15331995648

PercentageSaved      : 44

PercentCompressSaved : 0

PercentDedupSaved    : 44

PercentTotalSaved    : 44

Progress             : idle for 09:28:37

Schedule             : sun-sat@1

SizeSaved            : 66873917440

SizeShared           : 4914774016

State                : enabled

Status               : idle

TotalSaved           : 66873917440

Type                 : regular

-Steven

WHITECLOUD
7,078 Views

Where can we get explanations such as this and what Vinith mentioned?  Is there documentation with descriptions of the properties returned by the get-* commandlets? 

vinith
7,078 Views

Check out "Making the Most of Data ONTAP PowerShell Toolkit" for more details on the new features.  If you're new to PowerShell or the Toolkit, you might want to start with our "Getting Started" slides.

You can filter cmdlets by category then later explore for more help about those cmdlets in those categories. Here's how you can do the same.

PS C:\Users\vinith> Get-NaHelp | select category -Unique

Category

--------

aggr

cifs

toolkit

fpolicy

host

igroup

iscsi

license

lun

net

nfs

portset

quota

radius

snapvault

snmp

clone

disk

fcp

options

vfiler

nameservice

cf

copyoffload

fc

ndmp

priority

reallocate

sis

snapmirror

rsh

storage adapter

useradmin

feature

file

flash

lock

perf

qtree

ses

snaplock

snapshot

system

clock

volume

vss

secureadmin

ems

wafl

consistency group


Then later explore the set of cmdlets in each category one by one, for example you can see below that below i can see all the cmdlets which belong to the category type Aggregate

PS C:\Users\vinith> Get-NaHelp -Category aggr

Name                                Category        Api

----                                --------        ---

Add-NaAggr                          aggr            {aggr-add}

Confirm-NaAggrSpareLow              aggr            {aggr-check-spare-low}

Get-NaAggr                          aggr            {aggr-list-info}

Get-NaAggrFilerInfo                 aggr            {aggr-get-filer-info}

Get-NaAggrMediaScrub                aggr            {aggr-mediascrub-list-info}

Get-NaAggrOption                    aggr            {aggr-options-list-info}

Get-NaAggrScrub                     aggr            {aggr-scrub-list-info}

Get-NaAggrSpace                     aggr            {aggr-space-list-info}

Get-NaAggrVerify                    aggr            {aggr-verify-list-info}

New-NaAggr                          aggr            {aggr-create}

New-NaAggrMirror                    aggr            {aggr-mirror}

Remove-NaAggr                       aggr            {aggr-destroy}

Rename-NaAggr                       aggr            {aggr-rename}

Resume-NaAggrScrub                  aggr            {aggr-scrub-resume}

Resume-NaAggrVerify                 aggr            {aggr-verify-resume}

Set-NaAggr                          aggr            {aggr-online, aggr-offline, aggr-restrict}

Set-NaAggrOption                    aggr            {aggr-set-option}

Set-NaAggrRaidType                  aggr            {aggr-modify-raid-type}

Split-NaAggrMirror                  aggr            {aggr-split}

Start-NaAggrScrub                   aggr            {aggr-scrub-start}

Start-NaAggrVerify                  aggr            {aggr-verify-start}

Stop-NaAggrScrub                    aggr            {aggr-scrub-stop}

Stop-NaAggrVerify                   aggr            {aggr-verify-stop}

Suspend-NaAggrScrub                 aggr            {aggr-scrub-suspend}

Suspend-NaAggrVerify                aggr            {aggr-verify-suspend}

If you need to get more detailed help on the cmdlets you can do the following.

PS C:\Users\vinith> Get-Help Add-NaAggr -Detailed


SKHari
5,825 Views

We are looking for cmdlets for getting output of Deduplication in below format. Through the command sis status -l we can get the Stale Fingerprint % but we are unable to find the Powershell Cmdlets for getting the output of Stale fingerprint. Can you please assist us on this.

 

   PRE-DEDUPEPOST-DEDUPEStart time of Dedupe
Netapp ControllerDatastoreTime to complete DedupeFree SpaceStale Fingerprint %Free SpaceStale Fingerprint % 
xxxxxxxxx/vol/NFS_Infra01hrs 45mins 30sec674GB30%673GB13%00:00 GMT
xxxxxxxxx/vol/NFS_Desktops101hrs 13mins 35sec1548GB7%1692GB14%00:00 GMT
xxxxxxxxx/vol/NFS_Desktops301hrs 08mins 33sec1548GB13%1692GB20%00:00 GMT

JGPSHNTAP
7,078 Views

Beam is right...

I tend to use get-navolsis and then use a math function to get what i'm looking for

$sis = get-navolsis $name

[System.Math]::Floor($sis.sizesaved/1gb)

Public