Network and Storage Protocols

cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Network and Storage Protocols

Ask a Question

How to REIP a Netapp's primary interface without any downtime?

JLundfelt
‎2013-10-31 11:02 AM
7,579 Views

Hello.,

As part of an organization change we need to change the IP address of everything in our environment, to a new corporate network range. I was wondering if our plan to REIP the primary routable interface on each of our NetApp’s was solid. Here is the typical controller-

TypeControllerInterfaceNetwork AddressNetwork MaskTypeStatusIn/SecOut/SecProtocols
Active/Active Controllerirv-gdc-san1a.corp.myco.comvif1-9610.1.96.100255.255.255.0VIFUp6947801745400CIFS
Active/Active Controllerirv-gdc-san1a.corp.myco.comlosk127.0.20.1255.0.0.0UnknownUp01LOOPBACK
Active/Active Controllerirv-gdc-san1a.corp.myco.comvif2-23010.1.230.50255.255.255.0VIFUp5209970023208100iSCSI
Active/Active Controllerirv-gdc-san1a.corp.myco.comvif2-23110.1.231.50255.255.255.0VIFUp20998801475370NFS
Active/Active Controllerirv-gdc-san1a.corp.myco.comvif2-23210.1.232.50255.255.255.0VIFUp756796013NFS

Routing tables

 

Internet:

Destination      Gateway            Flags     Refs     Use  Interface

default          10.1.96.1          UGS        33 3318967135  vif1-96

10.1.96/24       link#14            UC          0        0  vif1-96

10.1.96.1        c4:7d:4f:b1:35:40  UHL         1        0  vif1-96

irv-gdc-san1a-vi 2:a0:98:12:e8:ac   UHL         0      443  lo

10.1.96.255      ff:ff:ff:ff:ff:ff  UHL         0   317283  vif1-96


The A record points to 10.1.96.100, and the tentative plan was to -

  • Add new VLAN to existing VIF1 interface. [vlan create vif1 26]
  • Add new IP Address (10.228.26.100) to new VLAN [Ifconfig Vif1-26 10.228.26.100 netmask 255.255.255.0]
  • Verify connectivity by testing CIFS / RPC to new IP address
  • Change A record(s)
  • Confirm network traffic [netstat -I vif1-96 -w 1 –x]
  • Change default route
  • Confirm network traffic [netstat -I vif1-26 -w 1 –x]
  • Remove existing vif1-96 VLAN

Attached are our hosts, and RC file

rc.zip
hosts.zip
0 Kudos
View By:
1 ACCEPTED SOLUTION

billshaffer
‎2013-10-31 03:33 PM
In response to JLundfelt
7,579 Views

For the test, at least, you don't have to worry much about the multiple routes - a host route will take precedent over a default route.  The man page for na_route says "metric" has to be 0 if the destination is on a directly attached network; not sure if it would let you put a non-zero metric for a destination on the same network.

For the actual cutover, I do see your dilemma - if the client addresses aren't changing, how do you satisfy incoming traffic from both vlans?  Like I said though, CIFS is going to be a problem anyways because it is connection oriented.  I don't see any way around refreshing the CIFS share on the clients to get them to recognize the new IP.  And in addition to having to wait for DNS to propagate, you  need to worry about the DNS cache on the windows boxes.  I've seen plenty of occasions when I had to flush the cache in order to get windows to see a new IP.

Bill

View solution in original post

0 Kudos
8 REPLIES 8

billshaffer
‎2013-10-31 12:20 PM
7,579 Views

This looks like it will work - as far as changing the controller IP.  But I think you're still going to run into CIFS/NFS disconnects.  I'm pretty sure that NFS filehandles won't move to the new IP, and you'd have to do a remount on the clients.  CIFS will certainly complain when the existing interface is taken offline.

You will also need to consider your NFS exports - if the network changes are happening on the client side as well, then the entire /etc/exports file becomes deprecated as soon as you make the switch.

I'm not completely clear on how CIFS registers with AD, or whether the same machine on a different IP will confuse AD or not, but that is another thing to consider.

You could test this - create your new vlan, and create another A record to point to the existing one.  Mount a couple shares on a test box pointing to that new A record, change the A record, as see what happens....  You'd have to do something with the routing on the new vlan - a static host route to your test box, maybe?

Bill

JLundfelt
‎2013-10-31 03:09 PM
In response to billshaffer
7,579 Views

Yeah. I am scheduled to test tomorrow. The good news is only CIFS, and MGMT (DFM / SSH / SNMP / ETC) run over the primary interface. iSCSI and NFS have their own interfaces as I was illustrating above-

ControllerInterfaceNetwork AddressNetwork MaskProtocols
irv-gdc-san1a.corp.myco.comvif1-9610.1.96.100255.255.255.0CIFS
irv-gdc-san1a.corp.myco.comlosk127.0.20.1255.0.0.0LOOPBACK
irv-gdc-san1a.corp.myco.comvif2-23010.1.230.50255.255.255.0iSCSI
irv-gdc-san1a.corp.myco.comvif2-23110.1.231.50255.255.255.0NFS
irv-gdc-san1a.corp.myco.comvif2-23210.1.232.50255.255.255.0NFS

The first interface is the primary, and the one we will be changing. I am not worried how thie will impact AD / Kerberos so much, as I am how I can have two routes simultaneously while I wait for the DNS record to update, and workstations and servers to start using the new interface. Wouldn't I need to change my plan to-

  • Add new VLAN to existing VIF1 interface. [vlan create vif1 26]
  • Add new IP Address (10.228.26.100) to new VLAN [Ifconfig Vif1-26 10.228.26.100 netmask 255.255.255.0]
  • Verify connectivity by testing CIFS / RPC to new IP address
  • Change A record(s)
  • Confirm network traffic [netstat -I vif1-96 -w 1 –x]
  • Change default route  add new route with lower metric [route add host 10.228.26.100 10.228.26.1 10]
  • Confirm network traffic [netstat -I vif1-26 -w 1 –x]
  • Remove existing vif1-96 VLAN
0 Kudos

billshaffer
‎2013-10-31 03:33 PM
In response to JLundfelt
7,580 Views

For the test, at least, you don't have to worry much about the multiple routes - a host route will take precedent over a default route.  The man page for na_route says "metric" has to be 0 if the destination is on a directly attached network; not sure if it would let you put a non-zero metric for a destination on the same network.

For the actual cutover, I do see your dilemma - if the client addresses aren't changing, how do you satisfy incoming traffic from both vlans?  Like I said though, CIFS is going to be a problem anyways because it is connection oriented.  I don't see any way around refreshing the CIFS share on the clients to get them to recognize the new IP.  And in addition to having to wait for DNS to propagate, you  need to worry about the DNS cache on the windows boxes.  I've seen plenty of occasions when I had to flush the cache in order to get windows to see a new IP.

Bill

0 Kudos

JLundfelt
‎2013-11-05 11:14 AM
In response to billshaffer
7,579 Views

So we ended up having some downtime. It was a good thing we were connected through the RLM, We are going to either try and source the RC file next time, or paste the following commands to expedite-

•Change default route
oarp -a
oroute -f
oroute delete default
oroute add default 10.228.26.1 1
oroute add net 10.228.26/24 10.228.26.1 1

Will let everyone know what the next outage window duration is.

Thanks,

Jon

0 Kudos

billshaffer
‎2013-11-05 01:07 PM
In response to JLundfelt
7,579 Views

What's the purpose of the net route?  If an interface exists on that network, it should by default route that subnet through the interface?

Bill

0 Kudos

aborzenkov
‎2013-11-05 07:53 PM
In response to billshaffer
7,579 Views

I am not that sure. Routes are tied to interfaces, so it may happen that when you down interface with current default route, you are left without any default route at all. Need to test.

0 Kudos

JLundfelt
‎2013-11-05 11:37 PM
In response to aborzenkov
7,579 Views

I just confirmed it's 'optional', I needed it when i had problems recreating a LIF

0 Kudos

JLundfelt
‎2013-11-06 07:21 AM
In response to JLundfelt
7,579 Views

So for anyone else that needs to REIP the primary interface on a NetApp, here was our final full list of commands-

vlan create vif1 426

ifconfig vif1-426 10.228.26.101 netmask 255.255.255.0 -wins partner vif1-96

-CHANGE DNS RECORD- Wait for replication (flush client DNS cache Get-nacifssession  |%{psexec \\$($_.hostname) ipconfig /flushdns}

arp -a

route -f

route delete default

route add default 10.228.26.1 1

ifconfig vif1-96 down

vlan delete vif1 96

options cf.hw_assist.partner.address 10.228.26.100

dfm host set irv-gdc-san1b.prod.myco.com hostPrimaryAddress=10.228.26.101

0 Kudos
All Community Forums
Public