Options
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Mute
- Printer Friendly Page
Migrate from dual chassis HA to single chassis HA - Interconnect down
2017-09-27
05:44 AM
6,123 Views
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Deal all,
we just moved our storage services from FAS3240 dual Chassis HA (7-Mode) to FAS8200 dual Chassis HA (cDot). Now we want to migrate the "old" FAS3240 7-Mode back to a single chassis HA. In the past the dual chassis FAS3240 used "external" onboard 10GB SFPs for cluster interconnect (Port c0a and c0b). Now we moved the second controller into the chassis of the first controller and disconnect the "external" cluster interconnect cables, because the cluster pair should use the internal Infiniband interconnect on the backplane.
Unfortunaltely the cluster still wants to use the ports c0a and c0b for cluster interconnect. Due to the reasons that we unplug the "external" cables, Ontap told us:
Link 0: down
IC RDMA connection : down
If we enable cf the messages appaers:
Filer-B is up, takeover disabled because of reason (interconnect error)
Filer-A has disabled takeover by Filer-B (interconnect error)
RDMA Interconnect is down (Link 0 down).
How to tell Ontap to use internal Infiniband IC's insetad of "externel" cluster ports c0a and c0b?
7-Mode version 8.1.3
Many thanks for your help!!!
Solved! See The Solution
View By:
- View By:
-
FAS
1 ACCEPTED SOLUTION
timmwestedt has accepted the solution
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello,
thanks for your help. The psm-cc-config setting were already set, because it was an HA pair before as well (just a dual chassis cluster pair).
It's fixed now by rebooting the first node again... finally after the second reboot the controller started up the RDMA Link 0 interconnect and cf is running well. No more interconnect errors. Failover is working as well.
Thanks all again!
6 REPLIES 6
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Tim -
In a single chasis install we use the backplane for the HA interconnect, but not for the cluster network.
You still need to use the 10G ports for the cluster networking.
I hope this response has been helpful to you.
At your service,
Eugene E. Kashpureff, Sr.
Independent NetApp Consultant http://www.linkedin.com/in/eugenekashpureff
Senior NetApp Instructor, Fast Lane US http://www.fastlaneus.com/
(P.S. I appreciate 'kudos' on any helpful posts.)
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello Eugene,
thanks for your reply.
Are you sure this is required even in 7-Mode. I though it's only required in cDot-Mode.
Does the 7-Mode cluster communicate by cf hw_assist via e0m and internal IC only?
Best Regards
Timm
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi Timm, I think the variable you are looking for is the psm-cc-config? Since this needed to be unset when converting from a single chassis HA to a dual chassis HA, you'll need to set it back to true.
At the LOADER prompt check the status, enter printenv psm-cc-config?
If the value is empty, enter set psm-cc-config? true
Also, just check that in Maintenance Mode the ha-config show output has both:
Chassis HA configuration: ha
Controller HA configuration: ha
Hope this helps.
Cheers,
Grant.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
+1 on the bootarg.
This bootarg is documented in the "Adding a second chassis to an existing HA pair" doc. You would just be configuring things in reverse/opposite, if going the other way.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
@timmwestedt wrote:How to tell Ontap to use internal Infiniband IC's insetad of "externel" cluster ports c0a and c0b?
You need to set psm-cc-config? LOADER variable (setenv psm-cc-config? true). Question mark is part of variable name.
timmwestedt has accepted the solution
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello,
thanks for your help. The psm-cc-config setting were already set, because it was an HA pair before as well (just a dual chassis cluster pair).
It's fixed now by rebooting the first node again... finally after the second reboot the controller started up the RDMA Link 0 interconnect and cf is running well. No more interconnect errors. Failover is working as well.
Thanks all again!