Hi Bill, Yes, it does make sense. I guess, I would have to accept this size of the snapshot. I hvae two more quick question: a) I would have to remove the snapshot, and let the backup going, then reinitialize the snapmirror, since I don't have any space left in aggr. right? b) If I add FC drives into this SATA aggr, would that be alright, any performance issues? Thank you! ... View more

Hi aborzenkov, >Backup applications can delete large amount of expired data in short time. Does that mean it could cause such large size of snapshot (1911GB) in an hour due to the deletion of the large amount of expired data? I thought if the data is gone, we don't need to track these data, and then should not have such amount of the snapshot. I am still trying to logically explain why we have such large size of  snapshot in an hour(thanks for pointing this out). Please let me know. Thank you! ... View more

No, it is not 5 days. I explained that already. Though I post the message on 10/14, the snapmairror had already broken off by me on 10/9 because the volume was full on10/9. so, all outputs were refrection of situation before 10/9. ... View more

Hi Bill, There is one issue left in my mind. >So your 1911G snapshot essentially contains the _changes_ to the volume between when the snapshot was taken and now -_not_ the changes since initialization. We have the schedule of updating the volume in every minute on the destination(I know now it is too extrem),  as I understand, this update would meanwhile also trigger the snapshot. So, this 1911GB was the result of snapshot being taken in a minute! This size of data changes in a minute seems impossible. >2TB change in 8TB in 5 days _seems_ a bit high I don't know where you got "5days" from? At this point, I should tell you what is the volume for.  This volume is  presented to Window server as a share, and is used for Acronis backup. 2 weeks retention, full backup in 2 Sunday, and incrementals in any other days.  Does this tell you something? Thank you! ... View more

Okay. One thing I am not so sure of. Would it be possible the snapshot takes so much space, 1911GB? How to explain the snapshot is so big? It seems not likely that there are so much data being changed between two snapshots. ... View more

Got your point. I could not grow the source, since the aggr where the  volume is located is completely full, I could not grow the source. Could I remove the 1911G first? it seems to me that this snapshot maybe already corrupted. If I could, then do I have to reinitialize or I could resync? ... View more

Hi Bill, Thank you so much for such detailed explanations which cleared out quite confusions in my mind. As you indicated, there should be something wrong with the snapmirror, and now I feel the size of the snapshot should not be so big (1911GB). The total of the volume size is about 8TB. I am sorry, but I have not accurately stated my situation: -     a)                 the snapmirror for this volume is scheduled as following, not every half hour as I said earlier: netapp2:vol1 drfiler1:vol1 - 0-59/59 * * * How to explain this schedule? Does the update start every hour based on this schedule? Maybe this schedule caused the problem of that every month or so the volume gets full? -     b)    The output of snap list you see here  was up to 10/09 when the volume got full, and  I therefore broke  the snapmirror off on that day. The following are outputs you ask for, and again it was up to 10/09: drfiler1> snap list vol1 Volume vol1 working...   %/used       %/total  date          name ----------  ----------  ------------  --------   0% ( 0%)    0% ( 0%)  Oct 09 06:00  drfiler1(0151735037)_vol1.806   0% ( 0%)    0% ( 0%)  Oct 09 05:59  drfiler1(0151735037)_vol1.805 drfiler1> df -rg vol1 Filesystem               total       used      avail   reserved  Mounted on /vol/vol1/       8193GB     8135GB       57GB        0GB  /vol/vol1/ /vol/vol1/.snapshot        0GB        0GB        0GB        0GB  /vol/vol1/.snapshot drfiler1> snapmirror status vol1 Snapmirror is on. Source                 Destination              State          Lag        Status netapp2:vol1  drfiler1: vol1  Broken-off     126:33:39  Idle Thanks again for your patience. ... View more

Okay. Understood. Thanks for clearifications.  I am ursorry, but still could not fully understand my questions in mind. This snapmirror has been scheduled once every half hour on the destiantion, and it seems working by using"snapmirror status". So, the following line by "snap list" contains every single snapshot (understood it is frozen image copy) since first initialization? and that's why it is so big, with the size of 1911GB? if all snapshots have already transferred to the destination ( I guess this is how the destination keeps the original copy and all changes being made on the source), why do we need to keep all these snapshots on the source? Thank for your patience. filer2> snap list vol1 Volume vol1 working...    %/used       %/total  date          name ----------  ----------  ------------  -------- 23% (23%)   23% (23%)  Oct 09 06:00  drfiler(0151735037)_vol1.806 (snapmirror) ... View more

Okay. Where could you see "two snapshots" on source? I  only see one. The snapmirror was established a month ago. I can olny see one line as the  result of  "snap list".  So, does this snap with 1911GB include all changes/owverwritten since first initialization? ... View more

thanks for your idea. I would correct settings as following now: /etc/snapmirror.conf on D1: s1rep:vol1 d1:vol1 - 0,15,30,45 * * * /etc/snapmirror.conf on D2: s2rep:vol2 d2:vol2 - 0,15,30,45 * * * in /etc/snapmirror.allow d1rep options snapmirror.access legacy I also need to make sure there is a route from s1rep to d1 via d1rep. traceroute -s s1rep d1rep can show you the route. right? ... View more

I contacted Supprt, but they could not give me a clear answer other than just sending a few links, and wanted me to figure it out myself. I could not. I have 2 SAS ports on each filer (2XFAS3250), and two dedicated SAS stacks. Can I use FC ports for SATA stack, or are there any other ports I can use for SATA stack? ... View more

Yes. I have flashcache on this 3250. Would that have any impact on adding the SATA shelf. Do I have ports for the shelf and then have its own Stack? Thanks for your message! ... View more

Sathish, I am asking for a DFM command and about historic data on a particular time window. Thanks for your reply. ... View more

Hi resqme914 , sorry to bother you again on this topic. now, I have total of 78 data sas drives left. You mentioned that I can add all these drives into existing aggr0 then I don't need to move vol0. My question is, since there is already a raid0 in aggr0 with size of 3 drives, how many raid-dp groups I need to create in aggr0, and how to size them? Here is the step I can think of, please correct me. 1.  expand raid0 first by adding 18 more drives. So, raid0 will include root vol0. Then how do I determine what those of 18 drives out of 78 should be added in? 2. create the rest of 3 more raid-dp groups with the size of 20 each. Also, with the size of 20 / 21 of raid-dp, would that satisfy the best practice? Thank you, as always. ... View more

hi Adai, Could you please show me a full command as an example? ... View more

I am sorry, but I could not quite follow you. currently, we are using 2-ports LACP group on each 2-node HA filer, A vlan is created on these two ports on each filer, so, two vlan's from two filers respectively are pointing to two different switches. If one switch went down, and then we will lost one filer, since as I understand it, in case like this, the failover would not happen. Could you please elabrate your idea more, or recommend any document to prevent the single point failire on the switch? Thanks a lot! ... View more

aborzenkov, You sounds pretty familiar with tht sese options. you are right, we should talk to networking guys, but we heard different things from them, so, that's why I wanted to get some ideas myself. It sounds a lot of efforts or costly on networking side. Then what we can do on NetApp side? If we don't go with vPC approach on network side, what can we do to resolve the single point failure on the switch? when tthe switch went down, it will cause the entire LACP (2 ports) going down as well. ... View more

Thanks for your message. Is vPC usually enabled or disabled in normal circumstance? what impact on the switch if I wanted to enable it? The reason I am asking these is because our networking guys told me that two ports in LACP could not be connected to two different NX switches. So, I am wondering what difficulties are to stop them to do so. Thanks for your further advices! ... View more

Hello ipsita, Thanks for checking. I just did it, quiesce and break the snapmirror, and destroy the lun, then resync the snapmirror. the lun has been snapmirrored to DR. Looks all good. the conclusion is that I have to break the mirror before I can destroy the lun. online volume won't do it. volume has already been online but read-only. Thanks to all for your help ... View more