hi experts,
trying to connect in Centos a lun in the above mentioned storage but getting this :
Sat Nov 10 13:25:42 CET [NetApp-A:scsitarget.ispfct.portLogin:notice]: FCP login on Fibre Channel adapter '1a' from '10:00:a0:b3:cc:e3:0e:e7',
address 0x10301
and in dmesg:
[ 8.655464] scsi host6: Emulex OneConnect OCe10100, FCoE Initiator on PCI bus 04 device 03 irq 71
[ 8.656860] lpfc 0000:04:00.3: irq 72 for MSI/MSI-X
[ 8.656875] lpfc 0000:04:00.3: irq 73 for MSI/MSI-X
[ 8.656889] lpfc 0000:04:00.3: irq 74 for MSI/MSI-X
[ 8.656902] lpfc 0000:04:00.3: irq 75 for MSI/MSI-X
[ 8.686151] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/x3d) Status x0 Data: x1 x0 x0 x0 x0 x1013d x0 x10 x10 x0 x0 x0 x0 CQ: x0 x0 x0 x98000000
[ 8.695349] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x11 (x0/x0) Status x0 Data: x20340000 x2 x1 x0 x0 xa012020 x0 x7011130 x2e392e34 x2e363134 x3531 x0 x7011130 CQ: x0 x0 x0 x98000000
[ 8.716123] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x17 (x0/x0) Status x0 Data: x2 x17 x400 x33429400 x2 x400 x0 x0 x0 x0 x0 x0 x0 CQ: x0 x0 x0 x98000000
[ 8.716137] lpfc 0000:04:00.3: 1:(0):2571 Mailbox cmd x17 Status x0 Data: x2 x17 x400 x33429400 x2 x400 x0 x0 x0 x0 x0 x0 x0 x0 x0 x0 x0 x0 CQ: x0 x0 x0 x98000000
[ 8.728108] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd xb (x0/x0) Status x0 Data: x0 x101 x0 x7d0 x0 xa x0 x0 x100 x0 x0 x4000400 x4000400 CQ: x0 x0 x0 x98000000
[ 8.740096] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/x4d) Status x0 Data: x1 x14 x0 x0 x0 x1014d x0 x4 x4 x3231 x0 x0 x0 CQ: x0 x0 x0 x98000000
[ 8.740105] lpfc 0000:04:00.3: 1:3080 Successful retrieving SLI4 device physical port name: 2.
[ 8.740115] lpfc 0000:04:00.3: 1:(0):0380 READ_REV Status x0 fw_rev:4.9.416.15 fcphHi:20 fcphLo:20 flHi:a flLo:1
[ 8.808025] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9d (x0/x0) Status x0 Data: x0 x812 x12 x0 x0 x0 x0 x0 x0 x0 x0 x0 x0 CQ: x0 x0 x0 x98000000
[ 8.855998] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x8d (x0/x0) Status x0 Data: x0 x0 x70 x33429400 x2 x100 x80000 x80000 x80000 x80000 x0 x0 x0 CQ: x0 x0 x0 x98000000
[ 8.864972] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (xc/x3) Status x0 Data: x8 x654 x0 x0 x0 xbb04f000 x0 x654 x0 x0 x0 x0 x0 CQ: x0 x0 x0 x98000000
[ 8.876970] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (xc/xb) Status x0 Data: x1 x1c x0 x0 x0 x10c0b x0 xc xc x10400 x34104000 x2 x0 CQ: x0 x0 x0 x98000000
[ 8.882955] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/x3a) Status x0 Data: x1 xac x0 x0 x0 x1013a x0 x9c x9c x7 x2 x1 xc0 CQ: x0 x0 x0 x98000000
[ 8.909929] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/xd) Status x0 Data: x1 x64 x0 x0 x0 x1010d x0 x4 x4 x18 x20000000 x8000000 x30 CQ: x0 x0 x0 x98000000
[ 8.915921] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/xd) Status x0 Data: x1 x64 x0 x0 x0 x1010d x0 x4 x4 x19 x20000000 x8000000 x30 CQ: x0 x0 x0 x98000000
[ 8.921925] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/xd) Status x0 Data: x1 x64 x0 x0 x0 x1010d x0 x4 x4 x1a x20000000 x8000000 x30 CQ: x0 x0 x0 x98000000
[ 8.927920] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/xd) Status x0 Data: x1 x64 x0 x0 x0 x1010d x0 x4 x4 x1b x20000000 x8000000 x30 CQ: x0 x0 x0 x98000000
[ 8.933906] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/xc) Status x0 Data: x1 x44 x0 x0 x0 x1010c x0 x4 x4 x7 xb0000000 x6000000 x30 CQ: x0 x0 x0 x98000000
[ 8.939909] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/xc) Status x0 Data: x1 x44 x0 x0 x0 x1010c x0 x4 x4 x8 xb0000000 x6400000 x30 CQ: x0 x0 x0 x98000000
[ 8.945904] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/xc) Status x0 Data: x1 x44 x0 x0 x0 x1010c x0 x4 x4 x1b xb0000000 x6800000 x30 CQ: x0 x0 x0 x98000000
[ 8.951886] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/xc) Status x0 Data: x1 x44 x0 x0 x0 x1010c x0 x4 x4 x1c xb0000000 x6c00000 x30 CQ: x0 x0 x0 x98000000
[ 8.958074] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (xc/x1) Status x0 Data: x1 x54 x0 x0 x0 x10c01 x0 x4 x4 x70001 xbb04a000 x0 xbb049000 CQ: x0 x0 x0 x98000000
[ 8.964058] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (xc/x1) Status x0 Data: x1 x54 x0 x0 x0 x10c01 x0 x4 x4 x80003 xbb9c1000 x0 xbb9c2000 CQ: x0 x0 x0 x98000000
[ 8.970075] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (xc/x1) Status x0 Data: x1 x54 x0 x0 x0 x10c01 x0 x4 x4 x1b0005 xbb9b9000 x0 xbb9b8000 CQ: x0 x0 x0 x98000000
[ 8.975876] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (xc/x1) Status x0 Data: x1 x54 x0 x0 x0 x10c01 x0 x4 x4 x1c0007 xbb8f4000 x0 xbb8f3000 CQ: x0 x0 x0 x98000000
[ 8.981888] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/xc) Status x0 Data: x1 x44 x0 x0 x0 x1010c x0 x4 x4 x1d xb0000000 x6000000 x30 CQ: x0 x0 x0 x98000000
[ 8.987855] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/xc) Status x0 Data: x1 x44 x0 x0 x0 x1010c x0 x4 x4 x1e xb0000000 x6000000 x30 CQ: x0 x0 x0 x98000000
[ 8.993857] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/x5a) Status x0 Data: x1 x68 x0 x0 x0 x1015a x0 x4 x4 x3 x30026 x7450000 x8000c000 CQ: x0 x0 x0 x98000000
[ 8.999852] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (xc/x1) Status x0 Data: x1 x54 x0 x0 x0 x10c01 x0 x4 x4 x1e0009 xbba00000 x0 xbda18000 CQ: x0 x0 x0 x98000000
[ 9.014825] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (xc/x5) Status x0 Data: x1 x64 x0 x0 x0 x10c05 x0 x4 x4 x80 x92000 x8000c000 x1e0080 CQ: x0 x0 x0 x98000000
[ 9.041797] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (xc/x5) Status x0 Data: x1 x64 x0 x0 x0 x10c05 x0 x4 x4 x81 x92000 x8000c000 x1e0800 CQ: x0 x0 x0 x98000000
[ 9.047791] lpfc 0000:04:00.3: 1:(0):0356 Mailbox cmd x9b (x1/x29) Status x0 Data: x1 x74 x0 x0 x0 x10129 x0 x64 x64 x4 x18 x0 x33 CQ: x0 x0 x0 x98000000
[ 9.048836] lpfc 0000:04:00.3: 1:(16777215):0354 Mbox cmd issue - Enqueue Data: x5 (x0/x0) x0 x200 x2
[ 9.048865] lpfc 0000:04:00.3: 1:(0):0354 Mbox cmd issue - Enqueue Data: x17 (x0/x0) x0 x300 x2
[ 9.048871] lpfc 0000:04:00.3: 1:(0):0355 Mailbox cmd x5 (x0/x0) issue Data: x0 x300
[ 9.056375] lpfc 0000:04:00.3: 1:(0):0355 Mailbox cmd x17 (x0/x0) issue Data: x0 x300
[ 9.056398] lpfc 0000:04:00.3: 1:(0):0307 Mailbox cmd x5 (x0/x0) Cmpl xffffffffa0533750 Data: x500 x0 x4404 x0 x0 x0 x0 x0 x0 x0 x0 x0
[ 9.079185] lpfc 0000:04:00.3: 1:1303 Link Up Event x1 received Data: x1 x0 x40 x0 x0 x0 0
[ 9.079198] lpfc 0000:04:00.3: 1:(0):0354 Mbox cmd issue - Enqueue Data: x8d (x0/x0) x0 x300 x2
[ 9.079208] lpfc 0000:04:00.3: 1:(0):0354 Mbox cmd issue - Enqueue Data: x9b (xc/x8) x0 x300 x2
[ 9.094877] lpfc 0000:04:00.3: 1:(0):0355 Mailbox cmd x8d (x0/x0) issue Data: x0 x300
[ 9.094886] lpfc 0000:04:00.3: 1:(0):0307 Mailbox cmd x17 (x0/x0) Cmpl xffffffffa052f5b0 Data: xfffd1700 x2 x16 x210 xbb050800 x0 x0 x0 x0 x0 x0 x0
[ 9.101388] lpfc 0000:04:00.3: 1:(0):0355 Mailbox cmd x9b (xc/x8) issue Data: x0 x300
[ 9.101397] lpfc 0000:04:00.3: 1:(0):0307 Mailbox cmd x8d (x0/x0) Cmpl xffffffffa055d980 Data: x8d00 x0 x0 x70 x342f7400 x2 x100 x80000 x80000 x80000 x80000 x0
[ 9.113440] lpfc 0000:04:00.3: 1:(0):0307 Mailbox cmd x9b (xc/x8) Cmpl xffffffffa0561a20 Data: x9b00 x8 x244 x0 x0 x0 x342f8000 x2 x244 x0 x0 x0
[ 9.113468] lpfc 0000:04:00.3: 1:(0):0354 Mbox cmd issue - Enqueue Data: xa0 (x0/x0) x0 x200 x2
[ 9.113480] lpfc 0000:04:00.3: 1:(0):0355 Mailbox cmd xa0 (x0/x0) issue Data: x0 x300
[ 9.127877] lpfc 0000:04:00.3: 1:(0):0307 Mailbox cmd xa0 (x0/x0) Cmpl xffffffffa05612b0 Data: xa000 x200000 x80ffff xffffffff x0 x0 x0 x0 x76f4 x0 x0 x0
[ 9.127899] lpfc 0000:04:00.3: 1:(0):0354 Mbox cmd issue - Enqueue Data: xa3 (x0/x0) x0 x200 x2
[ 9.127909] lpfc 0000:04:00.3: 1:(0):0355 Mailbox cmd xa3 (x0/x0) issue Data: x0 x300
[ 9.128461] XFS (sda1): Ending clean mount
[ 9.128484] SELinux: initialized (dev sda1, type xfs), uses xattr
[ 9.134592] lpfc 0000:04:00.3: 1:(0):0307 Mailbox cmd xa3 (x0/x0) Cmpl xffffffffa0558f60 Data: x12a300 xd0000100 x1000020 x0 x0 x0 x0 x0 x0 x0 x0 x0
[ 10.128790] lpfc 0000:04:00.3: 1:(0):3134 Register VFI, mydid:x10301, fcfi:32, vfi:256, vpi:256, fc_pname:b3a00010e70ee3cc fc_flag:x90114 port_state:x9 topology chg:0
[ 10.128801] lpfc 0000:04:00.3: 1:(0):0354 Mbox cmd issue - Enqueue Data: x9f (x0/x0) x9 x200 x2
[ 10.128819] lpfc 0000:04:00.3: 1:(0):0355 Mailbox cmd x9f (x0/x0) issue Data: x9 x300
[ 10.165667] lpfc 0000:04:00.3: 1:(0):0307 Mailbox cmd x9f (x0/x0) Cmpl xffffffffa055fa20 Data: x9f00 x10000100 x1000020 xb3a00010 xe70ee3cc x70 xbb050800 x0 x7d0 xa x10301 x0
[ 10.166419] lpfc 0000:04:00.3: 1:(0):0354 Mbox cmd issue - Enqueue Data: x93 (x0/x0) x9 x200 x2
[ 10.166432] lpfc 0000:04:00.3: 1:(0):0355 Mailbox cmd x93 (x0/x0) issue Data: x9 x300
[ 10.177331] lpfc 0000:04:00.3: 1:(0):0307 Mailbox cmd x93 (x0/x0) Cmpl xffffffffa05608e0 Data: x9300 x401 xfffffc x70 xbb050800 x0 x100 x0 x0 x0 x0 x0
[ 10.184073] lpfc 0000:04:00.3: 1:(0):0354 Mbox cmd issue - Enqueue Data: x93 (x0/x0) x20 x200 x2
[ 10.184086] lpfc 0000:04:00.3: 1:(0):0355 Mailbox cmd x93 (x0/x0) issue Data: x20 x300
[ 10.186450] XFS (dm-2): Mounting V4 Filesystem
[ 10.195146] lpfc 0000:04:00.3: 1:(0):0307 Mailbox cmd x93 (x0/x0) Cmpl xffffffffa055e1c0 Data: x9300 x402 x10100 x70 x321d6400 x2 x100 x0 x0 x0 x0 x0
[ 10.195848] lpfc 0000:04:00.3: 1:(0):9068 ALLOC 32 scsi_bufs: 2048 (1856 + 32 + 160)
[ 10.196005] lpfc 0000:04:00.3: 1:(16777215):0354 Mbox cmd issue - Enqueue Data: x9b (xc/x3) x20 x200 x2
[ 10.196029] lpfc 0000:04:00.3: 1:(0):0355 Mailbox cmd x9b (xc/x3) issue Data: x20 x300
[ 10.198319] lpfc 0000:04:00.3: 1:(0):0307 Mailbox cmd x9b (xc/x3) Cmpl xffffffffa052f5b0 Data: x9b00 x8 x214 x0 x0 x0 x34082000 x2 x214 x0 x0 x0
[ 10.198811] scsi 6:0:0:0: Direct-Access NETAPP LUN 811a PQ: 0 ANSI: 5
[ 10.200011] lpfc 0000:04:00.3: 1:(0):9030 FCP cmd x0 failed <0/0> status: x1 result: x0 sid: x10301 did: x10100 oxid: x469 Data: x402 x806
[ 10.200020] lpfc 0000:04:00.3: 1:(0):9024 FCP command x0 failed: x2 SNS x70000600 x29000000 Data: x2 x0 x16 x0 x0
[ 10.200027] lpfc 0000:04:00.3: 1:(0):0710 Iodone <0/0> cmd ffff880233986bc0, error x2 SNS x60070 x29 Data: x0 x0
[ 10.200224] sd 6:0:0:0: [sdb] 5951717376 512-byte logical blocks: (3.04 TB/2.77 TiB)
[ 10.200233] sd 6:0:0:0: [sdb] 4096-byte physical blocks
[ 10.200259] sd 6:0:0:0: Attached scsi generic sg2 type 0
[ 10.200983] sd 6:0:0:0: [sdb] Write Protect is off
[ 10.200992] sd 6:0:0:0: [sdb] Mode Sense: bd 00 00 08
[ 10.201156] sd 6:0:0:0: [sdb] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
[ 10.205871] sdb: sdb1
[ 10.208257] sd 6:0:0:0: [sdb] Attached SCSI disk
[ 10.219911] lpfc 0000:04:00.3: 1:(0):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x47c Data: x402 x819
[ 10.219921] lpfc 0000:04:00.3: 1:(0):0710 Iodone <0/0> cmd ffff880433e64c40, error x70000 SNS x0 x0 Data: x0 x0
[ 10.227277] lpfc 0000:04:00.3: 1:(0):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x47d Data: x402 x81a
[ 10.227289] lpfc 0000:04:00.3: 1:(0):0710 Iodone <0/0> cmd ffff880433e64c40, error x70000 SNS x0 x0 Data: x1 x0
[ 10.234098] lpfc 0000:04:00.3: 1:(0):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x47e Data: x402 x81b
[ 10.234110] lpfc 0000:04:00.3: 1:(0):0710 Iodone <0/0> cmd ffff880433e64c40, error x70000 SNS x0 x0 Data: x2 x0
[ 10.240187] lpfc 0000:04:00.3: 1:(0):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x47f Data: x402 x81c
[ 10.240198] lpfc 0000:04:00.3: 1:(0):0710 Iodone <0/0> cmd ffff880433e64c40, error x70000 SNS x0 x0 Data: x3 x0
[ 10.246961] lpfc 0000:04:00.3: 1:(0):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x480 Data: x402 x81d
[ 10.246972] lpfc 0000:04:00.3: 1:(0):0710 Iodone <0/0> cmd ffff880433e64c40, error x70000 SNS x0 x0 Data: x4 x0
[ 10.253757] lpfc 0000:04:00.3: 1:(0):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x481 Data: x402 x81e
[ 10.253768] lpfc 0000:04:00.3: 1:(0):0710 Iodone <0/0> cmd ffff880433e64c40, error x70000 SNS x0 x0 Data: x5 x0
[ 10.253965] sd 6:0:0:0: [sdb] tag#0 FAILED Result: hostbyte=DID_ERROR driverbyte=DRIVER_OK
[ 10.253980] sd 6:0:0:0: [sdb] tag#0 CDB: Read(16) 88 00 00 00 00 00 00 00 02 00 00 00 02 00 00 00
[ 10.253989] blk_update_request: I/O error, dev sdb, sector 512
[ 10.268734] XFS (dm-2): Ending clean mount
[ 10.268758] SELinux: initialized (dev dm-2, type xfs), uses xattr
[ 10.272091] lpfc 0000:04:00.3: 1:(0):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x473 Data: x402 x810
[ 10.272101] lpfc 0000:04:00.3: 1:(0):0710 Iodone <0/0> cmd ffff880433e64a80, error x70000 SNS x0 x0 Data: x0 x0
[ 10.281813] lpfc 0000:04:00.3: 1:(0):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x476 Data: x402 x813
[ 10.281847] lpfc 0000:04:00.3: 1:(0):0710 Iodone <0/0> cmd ffff880433e64fc0, error x70000 SNS x0 x0 Data: x0 x0
[ 10.282146] lpfc 0000:04:00.3: 1:(0):9030 FCP cmd x88 failed <0/0> status: x3 result: x40 sid: x10301 did: x10100 oxid: x472 Data: x402 x80f
[ 10.282154] lpfc 0000:04:00.3: 1:(0):0710 Iodone <0/0> cmd ffff880433e64a80, error x70000 SNS x0 x0 Data: x0 x0
I am using HP blade with Emulex CNA
topology
hp blade ---(hp interconnect switch) ------- qfx3500 FCoE GW ------- brocade FC switch ------------ netapp
have tried CNA firmware upgrade but the error is the same
Centos 7 with 3.10.0-327.el7.x86_64 kernel
NetApp Release 8.1.3 7-Mode: Sat Jun 8 08:11:51 PDT 2013
btw the same lun is mounted via iscsi without issues
what could be the issue? is there a way to troubleshoot on netapp side besides show commnds like fcp show ?
thanks,
Alex
