Deleted FlexVol, aggregate won't release the space

[#1]

I have an aggregate on a FAS2050 running OnTap 7.3.2 with several 1TB FlexVols on it, and on Friday I deleted one of them to re-create it during some troubleshooting but didn't see the space available. I figured it must have had to process and release (our array is SATA) so I let it go over the weekend and still no additional space freed. Running "aggr show_space" makes me believe that the space is sitting still in WAFL reserve:

Aggregate                       Allocated            Used           Avail

Total space                  9024035984KB    2521786544KB     348701216KB

Snap reserve                          0KB             0KB             0KB

WAFL reserve                 1041451312KB      99056988KB     942394324KB

That's almost 900GB available in reserve! I searched and found suggestions of it being tied up in snapshots or snapshot reserve, but this aggregate has none. I've also been watching "df -Ak" for a while and the numbers to appear to be fluctuating but not by much. Is it really possible that deleting an empty volume can take 3+ days for the space to be returned or is there something else going on?

[#2]

does priv set advanced ; wafl scan status show space reclamation running?  Are aggr snapshots running?  Even when rolling off they keep getting recreated so might help to disable aggr snaps and delete existing aggr snaps and see if that makes a difference.  Space should come back when the aggr snaps clear.

[#3]

Do you have aggregate snapshots?

[#4]

Scott, the wafl scan status shows space reclamation on the other aggregate and individual volumes, but not the aggr in question. I also don't have any aggregate snapshots configured or taken but I disabled the schedule anyway.

Apparently I had a disk fail last night though, so i'm going to say the rebuild is going to take precedence now. Thankfully I already have a replacement on the way.

[#5]

After the rebuild is done and you have time... does the total of every volume in aggr show_space not match the total used in the aggregate?  Depending on if volume guarantee is on or not it might vary but you can compute based on the used or total size depending on guarantee... then see how much extra space isn't freed up in the aggr.

[#6]

Do these commands;

FAS3070*> snap reserve -A

FAS3070*> snap list -A

FAS3070*> snap delta -A

I bet the data is being held in an aggregate snap shot.  Since this is exactly what they do.  Also it can be a slow process getting all the blocks back in large volumes.

[#7]

It seems that should be the issue but he said he doesn't have aggr snaps... please post the output of the commands just to make sure.

[#8]

sorry guys, that single disk failure turned into a multi-disk failure and a rebuild of a different aggregate... all it back to normal (finally) except this problem. Anyway, here is the output from those commands:

snap reserve -A:

Aggregate aggr2: current snapshot reserve is 0% or 0 k-bytes.

snap list -A

Aggregate aggr2

working...

No snapshots exist.

snap delta -A

Aggregate aggr2

working...

snap delta: No snapshots exist in Aggregate aggr2

Also aggr show_space:

Aggregate 'aggr2'

      Total space    WAFL reserve    Snap reserve    Usable space       BSR NVLOG           A-SIS

  10414513152KB    1041451312KB             0KB    9373061840KB             0KB             0KB

Space allocated to volumes in the aggregate

Volume                          Allocated            Used       Guarantee

SQL_DB_14                    1349633820KB      83706340KB          volume

SQL_DB_12                    1349633820KB     651752992KB          volume

SQL_DB_16                    1349633820KB     504296272KB          volume

SQL_DB_21                    1199674504KB     718353544KB          volume

SQL_DB_22                    1199674504KB     443348312KB          volume

SQL_DB_24                    1679544308KB     508884544KB          volume

SQL_DB_25                     896241208KB     541405156KB          volume

Aggregate                       Allocated            Used           Avail

Total space                  9024035984KB    3451747160KB     348701220KB

Snap reserve                          0KB             0KB             0KB

WAFL reserve                 1041451312KB      95460992KB     945990320KB

The WAFL reserve allocated/available is what is puzzling me. Should it really be almost 1TB in size?

[#9]

Peter,

Were you able to find out why the space wasn't showing up?  I'm having a similar issue with all the same indicators.

[#10]

Having same issue. Any ideas?