FCoE issue with FAS2240-2

aleale111 — Wed, 04 Jun 2025 13:07:24 GMT

hi experts,

trying to connect in Centos a lun in the above mentioned storage but getting this :

Sat Nov 10 13:25:42 CET [NetApp-A:scsitarget.ispfct.portLogin:notice]: FCP login on Fibre Channel adapter '1a' from '10:00:a0:b3:cc:e3:0e:e7',
address 0x10301

and in dmesg:

[    8.655464] scsi host6: Emulex OneConnect OCe10100, FCoE Initiator on PCI bus 04 device 03 irq 71
[    8.656860] lpfc 0000:04:00.3: irq 72 for MSI/MSI-X
[    8.656875] lpfc 0000:04:00.3: irq 73 for MSI/MSI-X
[    8.656889] lpfc 0000:04:00.3: irq 74 for MSI/MSI-X
[    8.656902] lpfc 0000:04:00.3: irq 75 for MSI/MSI-X
[    8.686151] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/x3d) Status x0 Data: x1 x0 x0 x0 x0 x1013d x0 x10 x10 x0 x0 x0 x0 CQ: x0 x0 x0 x98000000
[    8.695349] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x11 (x0/x0) Status x0 Data: x20340000 x2 x1 x0 x0 xa012020 x0 x7011130 x2e392e34 x2e363134 x3531 x0 x7011130 CQ: x0 x0 x0 x98000000
[    8.716123] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x17 (x0/x0) Status x0 Data: x2 x17 x400 x33429400 x2 x400 x0 x0 x0 x0 x0 x0 x0 CQ: x0 x0 x0 x98000000
[    8.716137] lpfc 0000:04:00.3: 1:(0):2571 Mailbox cmd x17 Status x0 Data: x2 x17 x400 x33429400 x2 x400 x0 x0 x0 x0 x0 x0 x0 x0 x0 x0 x0 x0 CQ: x0 x0 x0 x98000000
[    8.728108] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd xb (x0/x0) Status x0 Data: x0 x101 x0 x7d0 x0 xa x0 x0 x100 x0 x0 x4000400 x4000400 CQ: x0 x0 x0 x98000000
[    8.740096] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/x4d) Status x0 Data: x1 x14 x0 x0 x0 x1014d x0 x4 x4 x3231 x0 x0 x0 CQ: x0 x0 x0 x98000000
[    8.740105] lpfc 0000:04:00.3: 1:3080 Successful retrieving SLI4 device physical port name: 2.
[    8.740115] lpfc 0000:04:00.3: 1:(0):0380 READ_REV Status x0 fw_rev:4.9.416.15 fcphHi:20 fcphLo:20 flHi:a flLo:1
[    8.808025] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9d (x0/x0) Status x0 Data: x0 x812 x12 x0 x0 x0 x0 x0 x0 x0 x0 x0 x0 CQ: x0 x0 x0 x98000000
[    8.855998] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x8d (x0/x0) Status x0 Data: x0 x0 x70 x33429400 x2 x100 x80000 x80000 x80000 x80000 x0 x0 x0 CQ: x0 x0 x0 x98000000
[    8.864972] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (xc/x3) Status x0 Data: x8 x654 x0 x0 x0 xbb04f000 x0 x654 x0 x0 x0 x0 x0 CQ: x0 x0 x0 x98000000
[    8.876970] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (xc/xb) Status x0 Data: x1 x1c x0 x0 x0 x10c0b x0 xc xc x10400 x34104000 x2 x0 CQ: x0 x0 x0 x98000000
[    8.882955] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/x3a) Status x0 Data: x1 xac x0 x0 x0 x1013a x0 x9c x9c x7 x2 x1 xc0 CQ: x0 x0 x0 x98000000
[    8.909929] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/xd) Status x0 Data: x1 x64 x0 x0 x0 x1010d x0 x4 x4 x18 x20000000 x8000000 x30 CQ: x0 x0 x0 x98000000
[    8.915921] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/xd) Status x0 Data: x1 x64 x0 x0 x0 x1010d x0 x4 x4 x19 x20000000 x8000000 x30 CQ: x0 x0 x0 x98000000
[    8.921925] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/xd) Status x0 Data: x1 x64 x0 x0 x0 x1010d x0 x4 x4 x1a x20000000 x8000000 x30 CQ: x0 x0 x0 x98000000
[    8.927920] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/xd) Status x0 Data: x1 x64 x0 x0 x0 x1010d x0 x4 x4 x1b x20000000 x8000000 x30 CQ: x0 x0 x0 x98000000
[    8.933906] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/xc) Status x0 Data: x1 x44 x0 x0 x0 x1010c x0 x4 x4 x7 xb0000000 x6000000 x30 CQ: x0 x0 x0 x98000000
[    8.939909] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/xc) Status x0 Data: x1 x44 x0 x0 x0 x1010c x0 x4 x4 x8 xb0000000 x6400000 x30 CQ: x0 x0 x0 x98000000
[    8.945904] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/xc) Status x0 Data: x1 x44 x0 x0 x0 x1010c x0 x4 x4 x1b xb0000000 x6800000 x30 CQ: x0 x0 x0 x98000000
[    8.951886] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/xc) Status x0 Data: x1 x44 x0 x0 x0 x1010c x0 x4 x4 x1c xb0000000 x6c00000 x30 CQ: x0 x0 x0 x98000000
[    8.958074] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (xc/x1) Status x0 Data: x1 x54 x0 x0 x0 x10c01 x0 x4 x4 x70001 xbb04a000 x0 xbb049000 CQ: x0 x0 x0 x98000000
[    8.964058] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (xc/x1) Status x0 Data: x1 x54 x0 x0 x0 x10c01 x0 x4 x4 x80003 xbb9c1000 x0 xbb9c2000 CQ: x0 x0 x0 x98000000
[    8.970075] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (xc/x1) Status x0 Data: x1 x54 x0 x0 x0 x10c01 x0 x4 x4 x1b0005 xbb9b9000 x0 xbb9b8000 CQ: x0 x0 x0 x98000000
[    8.975876] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (xc/x1) Status x0 Data: x1 x54 x0 x0 x0 x10c01 x0 x4 x4 x1c0007 xbb8f4000 x0 xbb8f3000 CQ: x0 x0 x0 x98000000
[    8.981888] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/xc) Status x0 Data: x1 x44 x0 x0 x0 x1010c x0 x4 x4 x1d xb0000000 x6000000 x30 CQ: x0 x0 x0 x98000000
[    8.987855] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/xc) Status x0 Data: x1 x44 x0 x0 x0 x1010c x0 x4 x4 x1e xb0000000 x6000000 x30 CQ: x0 x0 x0 x98000000
[    8.993857] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/x5a) Status x0 Data: x1 x68 x0 x0 x0 x1015a x0 x4 x4 x3 x30026 x7450000 x8000c000 CQ: x0 x0 x0 x98000000
[    8.999852] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (xc/x1) Status x0 Data: x1 x54 x0 x0 x0 x10c01 x0 x4 x4 x1e0009 xbba00000 x0 xbda18000 CQ: x0 x0 x0 x98000000
[    9.014825] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (xc/x5) Status x0 Data: x1 x64 x0 x0 x0 x10c05 x0 x4 x4 x80 x92000 x8000c000 x1e0080 CQ: x0 x0 x0 x98000000
[    9.041797] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (xc/x5) Status x0 Data: x1 x64 x0 x0 x0 x10c05 x0 x4 x4 x81 x92000 x8000c000 x1e0800 CQ: x0 x0 x0 x98000000
[    9.047791] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/x29) Status x0 Data: x1 x74 x0 x0 x0 x10129 x0 x64 x64 x4 x18 x0 x33 CQ: x0 x0 x0 x98000000
[    9.048836] lpfc 0000:04:00.3: 1:(16777215):0354 Mbox cmd issue - Enqueue Data: x5 (x0/x0) x0 x200 x2
[    9.048865] lpfc 0000:04:00.3: 1:(0):0354 Mbox cmd issue - Enqueue Data: x17 (x0/x0) x0 x300 x2
[    9.048871] lpfc 0000:04:00.3: 1:(0):0355 Mailbox cmd x5 (x0/x0) issue Data: x0 x300
[    9.056375] lpfc 0000:04:00.3: 1:(0):0355 Mailbox cmd x17 (x0/x0) issue Data: x0 x300
[    9.056398] lpfc 0000:04:00.3: 1:(0):0307 Mailbox cmd x5 (x0/x0) Cmpl xffffffffa0533750 Data: x500 x0 x4404 x0 x0 x0 x0 x0 x0 x0 x0 x0
[    9.079185] lpfc 0000:04:00.3: 1:1303 Link Up Event x1 received Data: x1 x0 x40 x0 x0 x0 0
[    9.079198] lpfc 0000:04:00.3: 1:(0):0354 Mbox cmd issue - Enqueue Data: x8d (x0/x0) x0 x300 x2
[    9.079208] lpfc 0000:04:00.3: 1:(0):0354 Mbox cmd issue - Enqueue Data: x9b (xc/x8) x0 x300 x2
[    9.094877] lpfc 0000:04:00.3: 1:(0):0355 Mailbox cmd x8d (x0/x0) issue Data: x0 x300
[    9.094886] lpfc 0000:04:00.3: 1:(0):0307 Mailbox cmd x17 (x0/x0) Cmpl xffffffffa052f5b0 Data: xfffd1700 x2 x16 x210 xbb050800 x0 x0 x0 x0 x0 x0 x0
[    9.101388] lpfc 0000:04:00.3: 1:(0):0355 Mailbox cmd x9b (xc/x8) issue Data: x0 x300
[    9.101397] lpfc 0000:04:00.3: 1:(0):0307 Mailbox cmd x8d (x0/x0) Cmpl xffffffffa055d980 Data: x8d00 x0 x0 x70 x342f7400 x2 x100 x80000 x80000 x80000 x80000 x0
[    9.113440] lpfc 0000:04:00.3: 1:(0):0307 Mailbox cmd x9b (xc/x8) Cmpl xffffffffa0561a20 Data: x9b00 x8 x244 x0 x0 x0 x342f8000 x2 x244 x0 x0 x0
[    9.113468] lpfc 0000:04:00.3: 1:(0):0354 Mbox cmd issue - Enqueue Data: xa0 (x0/x0) x0 x200 x2
[    9.113480] lpfc 0000:04:00.3: 1:(0):0355 Mailbox cmd xa0 (x0/x0) issue Data: x0 x300
[    9.127877] lpfc 0000:04:00.3: 1:(0):0307 Mailbox cmd xa0 (x0/x0) Cmpl xffffffffa05612b0 Data: xa000 x200000 x80ffff xffffffff x0 x0 x0 x0 x76f4 x0 x0 x0
[    9.127899] lpfc 0000:04:00.3: 1:(0):0354 Mbox cmd issue - Enqueue Data: xa3 (x0/x0) x0 x200 x2
[    9.127909] lpfc 0000:04:00.3: 1:(0):0355 Mailbox cmd xa3 (x0/x0) issue Data: x0 x300
[    9.128461] XFS (sda1): Ending clean mount
[    9.128484] SELinux: initialized (dev sda1, type xfs), uses xattr
[    9.134592] lpfc 0000:04:00.3: 1:(0):0307 Mailbox cmd xa3 (x0/x0) Cmpl xffffffffa0558f60 Data: x12a300 xd0000100 x1000020 x0 x0 x0 x0 x0 x0 x0 x0 x0
[   10.128790] lpfc 0000:04:00.3: 1:(0):3134 Register VFI, mydid:x10301, fcfi:32, vfi:256, vpi:256, fc_pname:b3a00010e70ee3cc fc_flag:x90114 port_state:x9 topology chg:0
[   10.128801] lpfc 0000:04:00.3: 1:(0):0354 Mbox cmd issue - Enqueue Data: x9f (x0/x0) x9 x200 x2
[   10.128819] lpfc 0000:04:00.3: 1:(0):0355 Mailbox cmd x9f (x0/x0) issue Data: x9 x300
[   10.165667] lpfc 0000:04:00.3: 1:(0):0307 Mailbox cmd x9f (x0/x0) Cmpl xffffffffa055fa20 Data: x9f00 x10000100 x1000020 xb3a00010 xe70ee3cc x70 xbb050800 x0 x7d0 xa x10301 x0
[   10.166419] lpfc 0000:04:00.3: 1:(0):0354 Mbox cmd issue - Enqueue Data: x93 (x0/x0) x9 x200 x2
[   10.166432] lpfc 0000:04:00.3: 1:(0):0355 Mailbox cmd x93 (x0/x0) issue Data: x9 x300
[   10.177331] lpfc 0000:04:00.3: 1:(0):0307 Mailbox cmd x93 (x0/x0) Cmpl xffffffffa05608e0 Data: x9300 x401 xfffffc x70 xbb050800 x0 x100 x0 x0 x0 x0 x0
[   10.184073] lpfc 0000:04:00.3: 1:(0):0354 Mbox cmd issue - Enqueue Data: x93 (x0/x0) x20 x200 x2
[   10.184086] lpfc 0000:04:00.3: 1:(0):0355 Mailbox cmd x93 (x0/x0) issue Data: x20 x300
[   10.186450] XFS (dm-2): Mounting V4 Filesystem
[   10.195146] lpfc 0000:04:00.3: 1:(0):0307 Mailbox cmd x93 (x0/x0) Cmpl xffffffffa055e1c0 Data: x9300 x402 x10100 x70 x321d6400 x2 x100 x0 x0 x0 x0 x0
[   10.195848] lpfc 0000:04:00.3: 1:(0):9068 ALLOC 32 scsi_bufs: 2048 (1856 + 32 + 160)
[   10.196005] lpfc 0000:04:00.3: 1:(16777215):0354 Mbox cmd issue - Enqueue Data: x9b (xc/x3) x20 x200 x2
[   10.196029] lpfc 0000:04:00.3: 1:(0):0355 Mailbox cmd x9b (xc/x3) issue Data: x20 x300
[   10.198319] lpfc 0000:04:00.3: 1:(0):0307 Mailbox cmd x9b (xc/x3) Cmpl xffffffffa052f5b0 Data: x9b00 x8 x214 x0 x0 x0 x34082000 x2 x214 x0 x0 x0
[   10.198811] scsi 6:0:0:0: Direct-Access     NETAPP   LUN              811a PQ: 0 ANSI: 5
[   10.200011] lpfc 0000:04:00.3: 1:(0):9030 FCP cmd x0 failed <0/0> status: x1 result: x0 sid: x10301 did: x10100 oxid: x469 Data: x402 x806
[   10.200020] lpfc 0000:04:00.3: 1:(0):9024 FCP command x0 failed: x2 SNS x70000600 x29000000 Data: x2 x0 x16 x0 x0
[   10.200027] lpfc 0000:04:00.3: 1:(0):0710 Iodone <0/0> cmd ffff880233986bc0, error x2 SNS x60070 x29 Data: x0 x0
[   10.200224] sd 6:0:0:0: [sdb] 5951717376 512-byte logical blocks: (3.04 TB/2.77 TiB)
[   10.200233] sd 6:0:0:0: [sdb] 4096-byte physical blocks
[   10.200259] sd 6:0:0:0: Attached scsi generic sg2 type 0
[   10.200983] sd 6:0:0:0: [sdb] Write Protect is off
[   10.200992] sd 6:0:0:0: [sdb] Mode Sense: bd 00 00 08
[   10.201156] sd 6:0:0:0: [sdb] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
[   10.205871] sdb: sdb1
[   10.208257] sd 6:0:0:0: [sdb] Attached SCSI disk
[   10.219911] lpfc 0000:04:00.3: 1:(0):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x47c Data: x402 x819
[   10.219921] lpfc 0000:04:00.3: 1:(0):0710 Iodone <0/0> cmd ffff880433e64c40, error x70000 SNS x0 x0 Data: x0 x0
[   10.227277] lpfc 0000:04:00.3: 1:(0):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x47d Data: x402 x81a
[   10.227289] lpfc 0000:04:00.3: 1:(0):0710 Iodone <0/0> cmd ffff880433e64c40, error x70000 SNS x0 x0 Data: x1 x0
[   10.234098] lpfc 0000:04:00.3: 1:(0):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x47e Data: x402 x81b
[   10.234110] lpfc 0000:04:00.3: 1:(0):0710 Iodone <0/0> cmd ffff880433e64c40, error x70000 SNS x0 x0 Data: x2 x0
[   10.240187] lpfc 0000:04:00.3: 1:(0):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x47f Data: x402 x81c
[   10.240198] lpfc 0000:04:00.3: 1:(0):0710 Iodone <0/0> cmd ffff880433e64c40, error x70000 SNS x0 x0 Data: x3 x0
[   10.246961] lpfc 0000:04:00.3: 1:(0):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x480 Data: x402 x81d
[   10.246972] lpfc 0000:04:00.3: 1:(0):0710 Iodone <0/0> cmd ffff880433e64c40, error x70000 SNS x0 x0 Data: x4 x0
[   10.253757] lpfc 0000:04:00.3: 1:(0):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x481 Data: x402 x81e
[   10.253768] lpfc 0000:04:00.3: 1:(0):0710 Iodone <0/0> cmd ffff880433e64c40, error x70000 SNS x0 x0 Data: x5 x0
[   10.253965] sd 6:0:0:0: [sdb] tag#0 FAILED Result: hostbyte=DID_ERROR driverbyte=DRIVER_OK
[   10.253980] sd 6:0:0:0: [sdb] tag#0 CDB: Read(16) 88 00 00 00 00 00 00 00 02 00 00 00 02 00 00 00
[   10.253989] blk_update_request: I/O error, dev sdb, sector 512
[   10.268734] XFS (dm-2): Ending clean mount
[   10.268758] SELinux: initialized (dev dm-2, type xfs), uses xattr
[   10.272091] lpfc 0000:04:00.3: 1:(0):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x473 Data: x402 x810
[   10.272101] lpfc 0000:04:00.3: 1:(0):0710 Iodone <0/0> cmd ffff880433e64a80, error x70000 SNS x0 x0 Data: x0 x0
[   10.281813] lpfc 0000:04:00.3: 1:(0):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x476 Data: x402 x813
[   10.281847] lpfc 0000:04:00.3: 1:(0):0710 Iodone <0/0> cmd ffff880433e64fc0, error x70000 SNS x0 x0 Data: x0 x0
[   10.282146] lpfc 0000:04:00.3: 1:(0):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x472 Data: x402 x80f
[   10.282154] lpfc 0000:04:00.3: 1:(0):0710 Iodone <0/0> cmd ffff880433e64a80, error x70000 SNS x0 x0 Data: x0 x0

I am using HP blade with Emulex CNA

topology

hp blade ---(hp interconnect switch) ------- qfx3500 FCoE GW ------- brocade FC switch ------------ netapp

have tried CNA firmware upgrade but the error is the same

Centos 7 with 3.10.0-327.el7.x86_64 kernel

NetApp Release 8.1.3 7-Mode: Sat Jun 8 08:11:51 PDT 2013

btw the same lun is mounted via iscsi without issues

what could be the issue? is there a way to troubleshoot on netapp side besides show commnds like fcp show ?

thanks,

Alex

Re: FCoE issue with FAS2240-2

andris — Sun, 11 Nov 2018 22:47:47 GMT

Have you confirmed your software configuration is compatible in the Interoperability Matrix Tool (IMT)?

This KB article "directory of KB's" might be helpful...

Re: FCoE issue with FAS2240-2

Damien_Queen — Tue, 20 Nov 2018 18:44:12 GMT

2240 systems not capable of FCoE.

You can use FC or Ethernet (with iSCSI for example) instead.

Re: FCoE issue with FAS2240-2

aleale111 — Tue, 20 Nov 2018 21:44:27 GMT

Hi all,

thanks for your responses, I managed to connect it by manipulating lpfc driver T10 DIF options

actually there are sometimes messages like still

[   10.200020] lpfc 0000:04:00.3: 1Smiley Sad0):9024 FCP command x0 failed: x2 SNS x70000600 x29000000 Data: x2 x0 x16 x0 x0
[   10.200027] lpfc 0000:04:00.3: 1Smiley Sad0):0710 Iodone <0/0> cmd ffff880233986bc0, error x2 SNS x60070 x29 Data: x0 x0

but LUN is mounted now

topic Re: FCoE issue with FAS2240-2 in ONTAP Hardware

FCoE issue with FAS2240-2

Re: FCoE issue with FAS2240-2

Re: FCoE issue with FAS2240-2

Re: FCoE issue with FAS2240-2