Direct cross-connect between separate 6080's using 10G?

bedelen — Thu, 05 Jun 2025 06:55:25 GMT

We don't have a 10G network yet, but I'd like to use the 10G cards we have in our 6080's to speed up snapmirror traffic between the arrays.

I have two 6080 clusters in close enough proximity to direct connect them.

Is this possible? Do I need to flip the fiber on one end (for cross-over)?

other than assigning private IP addresses at each end, is there anything else?

Re: Direct cross-connect between separate 6080's using 10G?

bedelen — Thu, 05 May 2011 18:27:15 GMT

got an answer...

I’ve done this before – I didn’t have to flip the connections on the fiber, but you’ll want to double-check the cable to make sure the send side won’t be going into the send port on the other card.

I’d recommend giving a private IP to each port:

Filer1a: 10.10.10.10

Filer1b: 10.10.11.10

Filer2: 10.10.10.11

Filer2b: 10.10.11.11

If you have more than one port on each system, then you can do a multipath snapmirror:

Snapmirror.conf:

Connection1=multi(filer1a,filer2a)(filer1b,filer2b)

Also, boost the snapmirror window to the maximum size and enable jumbo frames on both sides:

Snapmirror.conf
connection1=multi(10.10.12.11,10.10.12.10)(10.10.14.11,10.10.14.10)
connection1:vol filer2:vol wsize=14680064 * * * * (max for 10GB link)

connection1:vol filer2:vol wsize=7340032 * * * * (max for 1GB link)

ifconfig e0d mtusize 9000 (for snapmirror interface - on command line to change immediately, modify /etc/rc to make permanent)

We saw dramatic CPU cycle savings when enabling jumbo frames.

topic Direct cross-connect between separate 6080's using 10G? in ONTAP Discussions

Direct cross-connect between separate 6080's using 10G?

Re: Direct cross-connect between separate 6080's using 10G?