FCoE issue with FAS2240-2

[aleale111]

hi experts,

trying to connect in Centos a lun in the above mentioned storage but getting this :

Sat Nov 10 13:25:42 CET [NetApp-A:scsitarget.ispfct.portLogin:notice]: FCP login on Fibre Channel adapter '1a' from '10:00:a0:b3:cc:e3:0e:e7',
address 0x10301

and in dmesg:

[    8.655464] scsi host6: Emulex OneConnect OCe10100, FCoE Initiator  on PCI bus 04 device 03 irq 71
[    8.656860] lpfc 0000:04:00.3: irq 72 for MSI/MSI-X
[    8.656875] lpfc 0000:04:00.3: irq 73 for MSI/MSI-X
[    8.656889] lpfc 0000:04:00.3: irq 74 for MSI/MSI-X
[    8.656902] lpfc 0000:04:00.3: irq 75 for MSI/MSI-X
[    8.686151] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9b (x1/x3d) Status x0 Data: x1 x0 x0 x0 x0 x1013d x0 x10 x10 x0 x0 x0 x0 CQ: x0 x0 x0 x98000000
[    8.695349] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x11 (x0/x0) Status x0 Data: x20340000 x2 x1 x0 x0 xa012020 x0 x7011130 x2e392e34 x2e363134 x3531 x0 x7011130 CQ: x0 x0 x0 x98000000
[    8.716123] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x17 (x0/x0) Status x0 Data: x2 x17 x400 x33429400 x2 x400 x0 x0 x0 x0 x0 x0 x0 CQ: x0 x0 x0 x98000000
[    8.716137] lpfc 0000:04:00.3: 10):2571 Mailbox cmd x17 Status x0 Data: x2 x17 x400 x33429400 x2 x400 x0 x0 x0 x0 x0 x0 x0 x0 x0 x0 x0 x0 CQ: x0 x0 x0 x98000000
[    8.728108] lpfc 0000:04:00.3: 10):0356 Mailbox cmd xb (x0/x0) Status x0 Data: x0 x101 x0 x7d0 x0 xa x0 x0 x100 x0 x0 x4000400 x4000400 CQ: x0 x0 x0 x98000000
[    8.740096] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9b (x1/x4d) Status x0 Data: x1 x14 x0 x0 x0 x1014d x0 x4 x4 x3231 x0 x0 x0 CQ: x0 x0 x0 x98000000
[    8.740105] lpfc 0000:04:00.3: 1:3080 Successful retrieving SLI4 device physical port name: 2.
[    8.740115] lpfc 0000:04:00.3: 10):0380 READ_REV Status x0 fw_rev:4.9.416.15 fcphHi:20 fcphLo:20 flHi:a flLo:1
[    8.808025] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9d (x0/x0) Status x0 Data: x0 x812 x12 x0 x0 x0 x0 x0 x0 x0 x0 x0 x0 CQ: x0 x0 x0 x98000000
[    8.855998] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x8d (x0/x0) Status x0 Data: x0 x0 x70 x33429400 x2 x100 x80000 x80000 x80000 x80000 x0 x0 x0 CQ: x0 x0 x0 x98000000
[    8.864972] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9b (xc/x3) Status x0 Data: x8 x654 x0 x0 x0 xbb04f000 x0 x654 x0 x0 x0 x0 x0 CQ: x0 x0 x0 x98000000
[    8.876970] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9b (xc/xb) Status x0 Data: x1 x1c x0 x0 x0 x10c0b x0 xc xc x10400 x34104000 x2 x0 CQ: x0 x0 x0 x98000000
[    8.882955] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9b (x1/x3a) Status x0 Data: x1 xac x0 x0 x0 x1013a x0 x9c x9c x7 x2 x1 xc0 CQ: x0 x0 x0 x98000000
[    8.909929] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9b (x1/xd) Status x0 Data: x1 x64 x0 x0 x0 x1010d x0 x4 x4 x18 x20000000 x8000000 x30 CQ: x0 x0 x0 x98000000
[    8.915921] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9b (x1/xd) Status x0 Data: x1 x64 x0 x0 x0 x1010d x0 x4 x4 x19 x20000000 x8000000 x30 CQ: x0 x0 x0 x98000000
[    8.921925] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9b (x1/xd) Status x0 Data: x1 x64 x0 x0 x0 x1010d x0 x4 x4 x1a x20000000 x8000000 x30 CQ: x0 x0 x0 x98000000
[    8.927920] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9b (x1/xd) Status x0 Data: x1 x64 x0 x0 x0 x1010d x0 x4 x4 x1b x20000000 x8000000 x30 CQ: x0 x0 x0 x98000000
[    8.933906] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9b (x1/xc) Status x0 Data: x1 x44 x0 x0 x0 x1010c x0 x4 x4 x7 xb0000000 x6000000 x30 CQ: x0 x0 x0 x98000000
[    8.939909] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9b (x1/xc) Status x0 Data: x1 x44 x0 x0 x0 x1010c x0 x4 x4 x8 xb0000000 x6400000 x30 CQ: x0 x0 x0 x98000000
[    8.945904] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9b (x1/xc) Status x0 Data: x1 x44 x0 x0 x0 x1010c x0 x4 x4 x1b xb0000000 x6800000 x30 CQ: x0 x0 x0 x98000000
[    8.951886] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9b (x1/xc) Status x0 Data: x1 x44 x0 x0 x0 x1010c x0 x4 x4 x1c xb0000000 x6c00000 x30 CQ: x0 x0 x0 x98000000
[    8.958074] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9b (xc/x1) Status x0 Data: x1 x54 x0 x0 x0 x10c01 x0 x4 x4 x70001 xbb04a000 x0 xbb049000 CQ: x0 x0 x0 x98000000
[    8.964058] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9b (xc/x1) Status x0 Data: x1 x54 x0 x0 x0 x10c01 x0 x4 x4 x80003 xbb9c1000 x0 xbb9c2000 CQ: x0 x0 x0 x98000000
[    8.970075] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9b (xc/x1) Status x0 Data: x1 x54 x0 x0 x0 x10c01 x0 x4 x4 x1b0005 xbb9b9000 x0 xbb9b8000 CQ: x0 x0 x0 x98000000
[    8.975876] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9b (xc/x1) Status x0 Data: x1 x54 x0 x0 x0 x10c01 x0 x4 x4 x1c0007 xbb8f4000 x0 xbb8f3000 CQ: x0 x0 x0 x98000000
[    8.981888] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9b (x1/xc) Status x0 Data: x1 x44 x0 x0 x0 x1010c x0 x4 x4 x1d xb0000000 x6000000 x30 CQ: x0 x0 x0 x98000000
[    8.987855] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9b (x1/xc) Status x0 Data: x1 x44 x0 x0 x0 x1010c x0 x4 x4 x1e xb0000000 x6000000 x30 CQ: x0 x0 x0 x98000000
[    8.993857] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9b (x1/x5a) Status x0 Data: x1 x68 x0 x0 x0 x1015a x0 x4 x4 x3 x30026 x7450000 x8000c000 CQ: x0 x0 x0 x98000000
[    8.999852] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9b (xc/x1) Status x0 Data: x1 x54 x0 x0 x0 x10c01 x0 x4 x4 x1e0009 xbba00000 x0 xbda18000 CQ: x0 x0 x0 x98000000
[    9.014825] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9b (xc/x5) Status x0 Data: x1 x64 x0 x0 x0 x10c05 x0 x4 x4 x80 x92000 x8000c000 x1e0080 CQ: x0 x0 x0 x98000000
[    9.041797] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9b (xc/x5) Status x0 Data: x1 x64 x0 x0 x0 x10c05 x0 x4 x4 x81 x92000 x8000c000 x1e0800 CQ: x0 x0 x0 x98000000
[    9.047791] lpfc 0000:04:00.3: 10):0356 Mailbox cmd x9b (x1/x29) Status x0 Data: x1 x74 x0 x0 x0 x10129 x0 x64 x64 x4 x18 x0 x33 CQ: x0 x0 x0 x98000000
[    9.048836] lpfc 0000:04:00.3: 116777215):0354 Mbox cmd issue - Enqueue Data: x5 (x0/x0) x0 x200 x2
[    9.048865] lpfc 0000:04:00.3: 10):0354 Mbox cmd issue - Enqueue Data: x17 (x0/x0) x0 x300 x2
[    9.048871] lpfc 0000:04:00.3: 10):0355 Mailbox cmd x5 (x0/x0) issue Data: x0 x300
[    9.056375] lpfc 0000:04:00.3: 10):0355 Mailbox cmd x17 (x0/x0) issue Data: x0 x300
[    9.056398] lpfc 0000:04:00.3: 10):0307 Mailbox cmd x5 (x0/x0) Cmpl xffffffffa0533750 Data: x500 x0 x4404 x0 x0 x0 x0 x0 x0 x0 x0 x0
[    9.079185] lpfc 0000:04:00.3: 1:1303 Link Up Event x1 received Data: x1 x0 x40 x0 x0 x0 0
[    9.079198] lpfc 0000:04:00.3: 10):0354 Mbox cmd issue - Enqueue Data: x8d (x0/x0) x0 x300 x2
[    9.079208] lpfc 0000:04:00.3: 10):0354 Mbox cmd issue - Enqueue Data: x9b (xc/x8) x0 x300 x2
[    9.094877] lpfc 0000:04:00.3: 10):0355 Mailbox cmd x8d (x0/x0) issue Data: x0 x300
[    9.094886] lpfc 0000:04:00.3: 10):0307 Mailbox cmd x17 (x0/x0) Cmpl xffffffffa052f5b0 Data: xfffd1700 x2 x16 x210 xbb050800 x0 x0 x0 x0 x0 x0 x0
[    9.101388] lpfc 0000:04:00.3: 10):0355 Mailbox cmd x9b (xc/x8) issue Data: x0 x300
[    9.101397] lpfc 0000:04:00.3: 10):0307 Mailbox cmd x8d (x0/x0) Cmpl xffffffffa055d980 Data: x8d00 x0 x0 x70 x342f7400 x2 x100 x80000 x80000 x80000 x80000 x0
[    9.113440] lpfc 0000:04:00.3: 10):0307 Mailbox cmd x9b (xc/x8) Cmpl xffffffffa0561a20 Data: x9b00 x8 x244 x0 x0 x0 x342f8000 x2 x244 x0 x0 x0
[    9.113468] lpfc 0000:04:00.3: 10):0354 Mbox cmd issue - Enqueue Data: xa0 (x0/x0) x0 x200 x2
[    9.113480] lpfc 0000:04:00.3: 10):0355 Mailbox cmd xa0 (x0/x0) issue Data: x0 x300
[    9.127877] lpfc 0000:04:00.3: 10):0307 Mailbox cmd xa0 (x0/x0) Cmpl xffffffffa05612b0 Data: xa000 x200000 x80ffff xffffffff x0 x0 x0 x0 x76f4 x0 x0 x0
[    9.127899] lpfc 0000:04:00.3: 10):0354 Mbox cmd issue - Enqueue Data: xa3 (x0/x0) x0 x200 x2
[    9.127909] lpfc 0000:04:00.3: 10):0355 Mailbox cmd xa3 (x0/x0) issue Data: x0 x300
[    9.128461] XFS (sda1): Ending clean mount
[    9.128484] SELinux: initialized (dev sda1, type xfs), uses xattr
[    9.134592] lpfc 0000:04:00.3: 10):0307 Mailbox cmd xa3 (x0/x0) Cmpl xffffffffa0558f60 Data: x12a300 xd0000100 x1000020 x0 x0 x0 x0 x0 x0 x0 x0 x0
[   10.128790] lpfc 0000:04:00.3: 10):3134 Register VFI, mydid:x10301, fcfi:32,  vfi:256, vpi:256, fc_pname:b3a00010e70ee3cc fc_flag:x90114 port_state:x9 topology chg:0
[   10.128801] lpfc 0000:04:00.3: 10):0354 Mbox cmd issue - Enqueue Data: x9f (x0/x0) x9 x200 x2
[   10.128819] lpfc 0000:04:00.3: 10):0355 Mailbox cmd x9f (x0/x0) issue Data: x9 x300
[   10.165667] lpfc 0000:04:00.3: 10):0307 Mailbox cmd x9f (x0/x0) Cmpl xffffffffa055fa20 Data: x9f00 x10000100 x1000020 xb3a00010 xe70ee3cc x70 xbb050800 x0 x7d0 xa x10301 x0
[   10.166419] lpfc 0000:04:00.3: 10):0354 Mbox cmd issue - Enqueue Data: x93 (x0/x0) x9 x200 x2
[   10.166432] lpfc 0000:04:00.3: 10):0355 Mailbox cmd x93 (x0/x0) issue Data: x9 x300
[   10.177331] lpfc 0000:04:00.3: 10):0307 Mailbox cmd x93 (x0/x0) Cmpl xffffffffa05608e0 Data: x9300 x401 xfffffc x70 xbb050800 x0 x100 x0 x0 x0 x0 x0
[   10.184073] lpfc 0000:04:00.3: 10):0354 Mbox cmd issue - Enqueue Data: x93 (x0/x0) x20 x200 x2
[   10.184086] lpfc 0000:04:00.3: 10):0355 Mailbox cmd x93 (x0/x0) issue Data: x20 x300
[   10.186450] XFS (dm-2): Mounting V4 Filesystem
[   10.195146] lpfc 0000:04:00.3: 10):0307 Mailbox cmd x93 (x0/x0) Cmpl xffffffffa055e1c0 Data: x9300 x402 x10100 x70 x321d6400 x2 x100 x0 x0 x0 x0 x0
[   10.195848] lpfc 0000:04:00.3: 10):9068 ALLOC 32 scsi_bufs: 2048 (1856 + 32 + 160)
[   10.196005] lpfc 0000:04:00.3: 116777215):0354 Mbox cmd issue - Enqueue Data: x9b (xc/x3) x20 x200 x2
[   10.196029] lpfc 0000:04:00.3: 10):0355 Mailbox cmd x9b (xc/x3) issue Data: x20 x300
[   10.198319] lpfc 0000:04:00.3: 10):0307 Mailbox cmd x9b (xc/x3) Cmpl xffffffffa052f5b0 Data: x9b00 x8 x214 x0 x0 x0 x34082000 x2 x214 x0 x0 x0
[   10.198811] scsi 6:0:0:0: Direct-Access     NETAPP   LUN              811a PQ: 0 ANSI: 5
[   10.200011] lpfc 0000:04:00.3: 10):9030 FCP cmd x0 failed <0/0> status: x1 result: x0 sid: x10301 did: x10100 oxid: x469 Data: x402 x806
[   10.200020] lpfc 0000:04:00.3: 10):9024 FCP command x0 failed: x2 SNS x70000600 x29000000 Data: x2 x0 x16 x0 x0
[   10.200027] lpfc 0000:04:00.3: 10):0710 Iodone <0/0> cmd ffff880233986bc0, error x2 SNS x60070 x29 Data: x0 x0
[   10.200224] sd 6:0:0:0: [sdb] 5951717376 512-byte logical blocks: (3.04 TB/2.77 TiB)
[   10.200233] sd 6:0:0:0: [sdb] 4096-byte physical blocks
[   10.200259] sd 6:0:0:0: Attached scsi generic sg2 type 0
[   10.200983] sd 6:0:0:0: [sdb] Write Protect is off
[   10.200992] sd 6:0:0:0: [sdb] Mode Sense: bd 00 00 08
[   10.201156] sd 6:0:0:0: [sdb] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
[   10.205871]  sdb: sdb1
[   10.208257] sd 6:0:0:0: [sdb] Attached SCSI disk
[   10.219911] lpfc 0000:04:00.3: 10):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x47c Data: x402 x819
[   10.219921] lpfc 0000:04:00.3: 10):0710 Iodone <0/0> cmd ffff880433e64c40, error x70000 SNS x0 x0 Data: x0 x0
[   10.227277] lpfc 0000:04:00.3: 10):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x47d Data: x402 x81a
[   10.227289] lpfc 0000:04:00.3: 10):0710 Iodone <0/0> cmd ffff880433e64c40, error x70000 SNS x0 x0 Data: x1 x0
[   10.234098] lpfc 0000:04:00.3: 10):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x47e Data: x402 x81b
[   10.234110] lpfc 0000:04:00.3: 10):0710 Iodone <0/0> cmd ffff880433e64c40, error x70000 SNS x0 x0 Data: x2 x0
[   10.240187] lpfc 0000:04:00.3: 10):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x47f Data: x402 x81c
[   10.240198] lpfc 0000:04:00.3: 10):0710 Iodone <0/0> cmd ffff880433e64c40, error x70000 SNS x0 x0 Data: x3 x0
[   10.246961] lpfc 0000:04:00.3: 10):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x480 Data: x402 x81d
[   10.246972] lpfc 0000:04:00.3: 10):0710 Iodone <0/0> cmd ffff880433e64c40, error x70000 SNS x0 x0 Data: x4 x0
[   10.253757] lpfc 0000:04:00.3: 10):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x481 Data: x402 x81e
[   10.253768] lpfc 0000:04:00.3: 10):0710 Iodone <0/0> cmd ffff880433e64c40, error x70000 SNS x0 x0 Data: x5 x0
[   10.253965] sd 6:0:0:0: [sdb] tag#0 FAILED Result: hostbyte=DID_ERROR driverbyte=DRIVER_OK
[   10.253980] sd 6:0:0:0: [sdb] tag#0 CDB: Read(16) 88 00 00 00 00 00 00 00 02 00 00 00 02 00 00 00
[   10.253989] blk_update_request: I/O error, dev sdb, sector 512
[   10.268734] XFS (dm-2): Ending clean mount
[   10.268758] SELinux: initialized (dev dm-2, type xfs), uses xattr
[   10.272091] lpfc 0000:04:00.3: 10):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x473 Data: x402 x810
[   10.272101] lpfc 0000:04:00.3: 10):0710 Iodone <0/0> cmd ffff880433e64a80, error x70000 SNS x0 x0 Data: x0 x0
[   10.281813] lpfc 0000:04:00.3: 10):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x476 Data: x402 x813
[   10.281847] lpfc 0000:04:00.3: 10):0710 Iodone <0/0> cmd ffff880433e64fc0, error x70000 SNS x0 x0 Data: x0 x0
[   10.282146] lpfc 0000:04:00.3: 10):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x472 Data: x402 x80f
[   10.282154] lpfc 0000:04:00.3: 10):0710 Iodone <0/0> cmd ffff880433e64a80, error x70000 SNS x0 x0 Data: x0 x0

I am using HP blade with Emulex CNA

topology

hp blade ---(hp interconnect switch) ------- qfx3500 FCoE GW ------- brocade FC switch ------------ netapp

have tried CNA firmware upgrade but the error is the same

Centos 7 with 3.10.0-327.el7.x86_64 kernel

NetApp Release 8.1.3 7-Mode: Sat Jun  8 08:11:51 PDT 2013

btw the same lun is mounted via iscsi without issues

what could be the issue? is there a way to troubleshoot on netapp side besides show commnds like fcp show ?

thanks,

Alex

[andris]

Have you confirmed  your software configuration is compatible in the Interoperability Matrix Tool (IMT)?

This KB article "directory of KB's" might be helpful...

Top LUN mapping issues and solutions

8.1.3 is past EoVS.  Consider upgrading to 8.2.5P1 - at some point.

[Damien_Queen]

2240 systems not capable of FCoE.

You can use FC or Ethernet (with iSCSI for example) instead.

[aleale111 · Accepted solution]

Hi all, 

thanks for your responses, I managed to connect it by manipulating lpfc driver  T10 DIF options 

actually there are sometimes messages like still 

[   10.200020] lpfc 0000:04:00.3: 1Smiley Sad0):9024 FCP command x0 failed: x2 SNS x70000600 x29000000 Data: x2 x0 x16 x0 x0
[   10.200027] lpfc 0000:04:00.3: 1Smiley Sad0):0710 Iodone <0/0> cmd ffff880233986bc0, error x2 SNS x60070 x29 Data: x0 x0

but LUN is mounted now