Mixing FC Target Ports Onboard and Expansion

[erick_moore]

We have a 3170 with a single quad port FC expansion card (actually we have 2, one per controller).  We have no plans for adding any more than the 2 FC loops already installed (we are going with SAS for all our new shelves), and we don't plan on using more than 2 of the onboard ports per controller as initiators.  Our installer configured 2 of the onboard ports as targets along with 2 of the ports in the quad port HBA so we would have loop redundancy in the event we lost a PCI slot.  I was just taking the NetApp NCIE-SAN practice exam, and it stated that target ports should never be mixed between the expansion cards and the onboard cards.  Any thoughts on this matter?

[radek_kubka]

Hi Eric,

Have you read this thread?

http://communities.netapp.com/message/7600#7600

Regards,

Radek

[erick_moore]

I can't get to that link for some reason.  It is giving me an access is denied error.

[ekashpureff]

Eric -

It's my understanding that add on cards are configured at the factory to be initiator or target ports, and can not be re-configured.

Motherboard ports can be reconfigured. This requires a re-boot.

I haven't seen any best practice documents that say you shouldn't use motherboard target ports as well as add on card target ports.

I hope this response has been helpful to you.

At your service,

Eugene E. Kashpureff
ekashp@kashpureff.org
Fastlane NetApp Instructor and Independent Consultant
http://www.fastlaneus.com/ http://www.linkedin.com/in/eugenekashpureff

(P.S. I appreciate points for helpful or correct answers.)

[radek_kubka]

It's within Partner & Field Community, that's probably why.

This is the bottom line from Skip Shapiro from NetApp:

If any on-board ports are used as  targets, you cannot use any expansion target HBAs.  All target ports  used either either onboard or on expansion cards; you can't use both  types together.

However, you can mix onboard ports configured as initiators and initiator expansion HBAs.

[scottgelb]

There are some rules that are often broken with Initiator/Target and also with Disk/Tape Initiator ports.

NetApp/Partner SEs have an updated fc rules powerpoint in the net2 download and I submitted some edits a while ago...a great document and summary below

1) It is ok to have initiators mixed onboard and expansion slots

2) Expansion cards are hard set as initiator or target, but onboard can be swapped (already mentioned)

3) It is not ok to mix Targets onboard and expansion slots.  Either all onboard or all expansion slots for targets

4) It is ok to mix port speeds on the same card or asic

5) You cannot put ports on the same expansion hba ASIC (1a/1b for example) to both disk and tape (1a to disk and 1b to tape for example), but you can put disk on 1a/1b and tape on 1c/1d.  However, if onboard ports it is OK (0a disk, 0b tape)... This rule is often broken since it works but is not supported on expansion hbas.  (kb22038)

[aborzenkov]

Re. 3 – it is not what the latest ppt (edition 4) says:

Can I have target expansion cards installed in the system and still use some of my onboard ports for fibre channel SAN Host connectivity (targets)?

It Depends

7.3.2 or greater – Yes

7.3.1.1 or less - No

[scottgelb]

I think that needs a fix in the new one.. I don't know of support added in 7.3.2 for on/offboard targets concurrent.. Need to have Bryan fix this one..or clarify if a change was made, but not correct I don't think.

Typos Sent on Blackberry Wireless

[aborzenkov]

Well, I am afraid it is a bit more complicated ...

7.3.1.1 BSAG:

Considerations

If you install target expansion adapters on the system, you must configure the onboard adapters as

initiators.

7.3.3 BSAG:

The whole paragrah "Consderations" is no more there. The only limitation that is mentioned is total number of target HBAs and the rule that all target adapters must be of the same speed: you cannot mix 2-Gb and 4-Gb adapters on the same system

The presentation mentions this rule only for target expansion cards:

Can I mix expansion target cards in the same system of different speeds (X1130 4G & X1131 8G)? NO

But if the rule of speed mix is for all target HBAs, it means - you can use onboard, as long as speed matches. Given that current HBAs are 8Gb/s, we have no way to mix them

I'd love if someone from NetApp gave final word.

[scottgelb]

And 8.0.1 rc2 bsag it says you have to unconfigure onboard on an ha pair when adding target adapters... It has always been either all onboard or all expansion target ports without a mix, but the documentation doesn't all match up... I will forward this link to Steve Botkin and he will be able to confirm here.

You are upgrading from a 2-Gb onboard adapter to a 4-Gb target expansion adapter or 4-Gb
onboard adapter to a 8-Gb target expansion adapter. Because you cannot mix 2-Gb and 4-Gb
adapters or 4-Gb and 8-Gb adapters on the same system, or on two systems in an HA pair, you
must set the onboard adapters to unconfigured before installing the target expansion adapter.