Community

Subscribe
Highlighted
Accepted Solution

how can I physically move filers that are mirrored ?

Hello I have a question on how to move filers that are mirrored.

I have filer 1 and filer 2 which are scheduled(1-3 months) to be moved to a different data center.

The aggregates on the filers are mirrored in a PLEX.  I see that some aggregates are mirrored and some are not from doing a aggr status -r

netapp-a> aggr status -r

Aggregate aggr0 (online, raid4, mirrored) (block checksums)

  Plex /aggr0/plex0 (online, normal, active, pool0)

    RAID group /aggr0/plex0/rg0 (normal)

      RAID Disk Device  HA  SHELF BAY CHAN Pool Type  RPM  Used (MB/blks)    Phys (MB/blks)

      --------- ------  ------------- ---- ---- ---- ----- --------------    --------------

      parity    5a.16   5a    1   0   FC:A   0  FCAL 10000 272000/557056000  280104/573653840

      data      5a.32   5a    2   0   FC:A   0  FCAL 10000 272000/557056000  280104/573653840

  Plex /aggr0/plex2 (online, normal, active, pool1)

    RAID group /aggr0/plex2/rg0 (normal)

      RAID Disk Device  HA  SHELF BAY CHAN Pool Type  RPM  Used (MB/blks)    Phys (MB/blks)

      --------- ------  ------------- ---- ---- ---- ----- --------------    --------------

      parity    6a.32   6a    2   0   FC:A   1  FCAL 10000 272000/557056000  274845/562884296

      data      6a.16   6a    1   0   FC:A   1  FCAL 10000 272000/557056000  280104/573653840

Aggregate aggr2_SATA (online, raid_dp, mirrored) (block checksums)

  Plex /aggr2_SATA/plex0 (online, normal, active, pool0)

    RAID group /aggr2_SATA/plex0/rg0 (normal)

      RAID Disk Device  HA  SHELF BAY CHAN Pool Type  RPM  Used (MB/blks)    Phys (MB/blks)

      --------- ------  ------------- ---- ---- ---- ----- --------------    --------------

      dparity   5b.19   5b    1   3   FC:A   0  ATA   7200 847555/1735794176 847827/1736350304

      parity    5b.32   5b    2   0   FC:A   0  ATA   7200 847555/1735794176 847827/1736350304

      data      5b.48   5b    3   0   FC:A   0  ATA   7200 847555/1735794176 847827/1736350304

      data      5b.20   5b    1   4   FC:A   0  ATA   7200 847555/1735794176 847827/1736350304

      data      5b.33   5b    2   1   FC:A   0  ATA   7200 847555/1735794176 847827/1736350304

      data      5b.49   5b    3   1   FC:A   0  ATA   7200 847555/1735794176 847827/1736350304

      data      5b.21   5b    1   5   FC:A   0  ATA   7200 847555/1735794176 847827/1736350304

      data      5b.34   5b    2   2   FC:A   0  ATA   7200 847555/1735794176 847827/1736350304

      data      5b.50   5b    3   2   FC:A   0  ATA   7200 847555/1735794176 847827/1736350304

      data      5b.22   5b    1   6   FC:A   0  ATA   7200 847555/1735794176 847827/1736350304

      data      5b.35   5b    2   3   FC:A   0  ATA   7200 847555/1735794176 847827/1736350304

      data      5b.51   5b    3   3   FC:A   0  ATA   7200 847555/1735794176 847827/1736350304

      data      5b.23   5b    1   7   FC:A   0  ATA   7200 847555/1735794176 847827/1736350304

      data      5b.36   5b    2   4   FC:A   0  ATA   7200 847555/1735794176 847827/1736350304

  Plex /aggr2_SATA/plex1 (online, normal, active, pool1)

    RAID group /aggr2_SATA/plex1/rg0 (normal)

      RAID Disk Device  HA  SHELF BAY CHAN Pool Type  RPM  Used (MB/blks)    Phys (MB/blks)

      --------- ------  ------------- ---- ---- ---- ----- --------------    --------------

      dparity   6b.16   6b    1   0   FC:A   1  ATA   7200 847555/1735794176 847827/1736350304

      parity    6b.32   6b    2   0   FC:A   1  ATA   7200 847555/1735794176 847827/1736350304

      data      6b.48   6b    3   0   FC:A   1  ATA   7200 847555/1735794176 847827/1736350304

      data      6b.17   6b    1   1   FC:A   1  ATA   7200 847555/1735794176 847827/1736350304

      data      6b.33   6b    2   1   FC:A   1  ATA   7200 847555/1735794176 847827/1736350304

      data      6b.49   6b    3   1   FC:A   1  ATA   7200 847555/1735794176 847827/1736350304

      data      6b.18   6b    1   2   FC:A   1  ATA   7200 847555/1735794176 847827/1736350304

      data      6b.34   6b    2   2   FC:A   1  ATA   7200 847555/1735794176 847827/1736350304

      data      6b.50   6b    3   2   FC:A   1  ATA   7200 847555/1735794176 847827/1736350304

      data      6b.19   6b    1   3   FC:A   1  ATA   7200 847555/1735794176 847827/1736350304

      data      6b.35   6b    2   3   FC:A   1  ATA   7200 847555/1735794176 847827/1736350304

      data      6b.51   6b    3   3   FC:A   1  ATA   7200 847555/1735794176 847827/1736350304

      data      6b.20   6b    1   4   FC:A   1  ATA   7200 847555/1735794176 847827/1736350304

      data      6b.36   6b    2   4   FC:A   1  ATA   7200 847555/1735794176 847827/1736350304

What would be the process of moving them to the new data center ? Would I break the Aggregate mirror and first move one filer with its disks, followed by another after some time ? Can I break syncmirror or its not possible ?

What are my options ? thank you.

Re: how can I physically move filers that are mirrored ?

Anton:

What exactly are you trying to do?  Are you trying to move without downtime?  Are these two systems in a cluster relationship?

The aggr status output you posted shows two mirrored aggregates in ONE system.  Are you proposing breaking the mirror (aggr split), and assigning the split disks to the other head in the new datacenter?

Bill

Re: how can I physically move filers that are mirrored ?

Bill, the filers are both in a cluster relationship, I am trying to minimize downtime as much as I can so that management can agree with this plan.  The mirroring of aggrs are on both heads, can I break the mirror by splitting to the other head (head b) and move head a to new data center?

Re: how can I physically move filers that are mirrored ?

Of course you can move head to another datacenter, but this head will probably not useful without disks. If you want to move head and disks, say so.

Re: how can I physically move filers that are mirrored ?

sorry with disks of course

Re: how can I physically move filers that are mirrored ?

Well … the first problem is, NetApp does not officially support hot shelf unplug.

Second problem is, even if you manage to move one head and half of the shelves while second head stays in takeover mode, you have no way to perform giveback now. So you will face downtime while you be moving second head from one datacenter to another. This is exactly the same downtime as for moving both heads. So you do not save any downtime.

Based on information you provided so far, I do not see any sense in doing even if it were possible.

Re: how can I physically move filers that are mirrored ?

IF you can get one plex of each mirror on the same set of shelves - so shelves a-m would contain all the "1st" plexes, and shelves n-z would contain all the "2nd" plexes, you could, theoretically:

-split the mirrors

-assign all the 2nd plex drives (now an aggr) to one head, and all the 1st plexes to the other - aggr downtime, but it is the copy, so no real downtime

-do a "quick" shutdown to recable from a clustered system to two non-clustered systems - one head with shelves a-m, the other with shelves n-z

-bring up the system that is not moving - downtime is over

-move the other system (with shelves n-z) to the new data center

-bring up the remote system

-repoint servers and applications

-shut down the local system, move it to the new datacenter

-take another "quick" downtime to recable to a clustered system

-rebuild the mirrors

One of the many problems with this is that your data at the remote site will be inconsistent.

If you have snapmirror licenses (or can get a temp), you could do as above - split the mirrors, isolate disk shelves, recable, move one head and shelves - then snapmirror the data over, repoint systems, move the other head, recable.

There is some more detail in there but you get the point.

If you can get a weekend maint window I would suggest taking the downtime and moving everything.  Better yet use the move as a reason to do a hardware refresh....

Hope that helps

Bill

Re: how can I physically move filers that are mirrored ?

Forgot you mentioned you were active/active.  So in addition to juggling the shelves, you'd need to juggle the aggregates to get the primary on the 1st shelf....  May not even be doable, depending on your environment.

Re: how can I physically move filers that are mirrored ?

so I just want to clarify... if I do a takeover on one node, shut down the second node and move it with its disks to the new data center, I will not be able to perform a giveback once they get moved over?

Then what are my options, shut down both nodes and then bring them back up after the move is complete?

Break the aggregate mirrors and then recreate them once the second node the is moved?

Re: how can I physically move filers that are mirrored ?

Cluster relationships don't work across datacenters like that, so no, you wouldn't be able to perform a giveback after moving one head - plus, as aborzenkov points out, you cannot "hot-unplug" the shelves, so you would incur downtime to isolate disk shelves.

If you can split the aggr mirrors to discrete shelves, you could move one half over, swap the services, then move the other half over, as I described below (still incurs downtime, plus data consistency issues).

Best bet, if you can get the downtime, is to move everything at once.

Bill