topic Re: Active (I/O) paths misconfigured on VMware with ALUA in VMware Solutions Discussions

Active (I/O) paths misconfigured on VMware with ALUA

pedro_rocha — Thu, 05 Jun 2025 06:05:44 GMT

Hello all,

I am seeing a strange behavior in as customer´s virtual environment. We have this vSphere 5.0 cluster which is accessing its Datastores via FCP. VSC 4.1 is installed and recommended settings are applied to the cluster. Igroups on the NetApp side have ALUA enabled.

On the vSphere side, path selection policy is round-robin and SATP is ALUA aware also (VMW_SATP_ALUA). There are 8 paths from each ESXi server to the NetApp HA pair (4 to each controller, running DOT 8.0.2P3 7-mode).

With this configuration we are seeing all paths as "Active (I/O)". Which for me indicates that all paths are active and I/O is passing through them all. I understand that with this configuration we would have 4 paths as "Active (I/O)" (optimized paths) and 4 paths as "Active" (non-optimized paths).

Does anyone know what could be possibly happening here? What's my mistake?

Kind regards,

Pedro Rocha.

Re: Active (I/O) paths misconfigured on VMware with ALUA

maske — Sun, 14 Apr 2013 10:58:46 GMT

Please follow the KB on this issue:

https://kb.netapp.com/support/index?page=content&id=1011577&actp=search&viewlocale=en_US&searchid=null

Re: Active (I/O) paths misconfigured on VMware with ALUA

pedro_rocha — Tue, 16 Apr 2013 21:11:08 GMT

Hi Doug,

Have done that before, no success. Case opened, let's see what is happening. Will post here...

Regards,

Pedro Rocha

Re: Active (I/O) paths misconfigured on VMware with ALUA

Sergio_Santos — Fri, 03 May 2013 16:35:09 GMT

Hi Pedro,

I'm having the exact same problem and also have a ticket open but it's been a few weeks and so far no luck. Were you able to get a resolution? My setup is almost identical except my DOT is 8.0.2P4 and ESXi servers are 5.1 (though I had this problem with vSphere 5.0 as well). What kind of SAN switches are you using if I may ask? Thanks!

Sergio

Re: Active (I/O) paths misconfigured on VMware with ALUA

pedro_rocha — Fri, 03 May 2013 17:11:13 GMT

Hi Sergio,

I have not got any answer yet. Case is still opened. We are using Brocade 5100 switches for the SAN environment.

I'll post here if I get any luck.

Regards,

Pedro Rocha.

Re: Active (I/O) paths misconfigured on VMware with ALUA

werner_komar — Wed, 15 May 2013 11:37:40 GMT

Hello Pedro,

we have the same Configuratiuon / Problem. We use a FAS3240 Ontap 8.1.2 7 Mode with FC and Brocade 200E 4GB. The Servers come from HP CX7000 Blade

On the vSphere side, path selection policy is round-robin and SATP is ALUA.

All 4 Path are (Active IO). When we do a "CF Takeover", we lost the communication HOST <-> Datastore. If we "cf giveback" all 4 Path will come back online.

We open a Case since 29.4.2013. ....we are waiting...

Regards

Werner Komar

Re: Active (I/O) paths misconfigured on VMware with ALUA

pedro_rocha — Wed, 15 May 2013 12:40:46 GMT

Werner,

We are now dealing with VMware. NetApp told us to contact them since the issue does not appear to be related to NetApp.

I'll tell you when we have something.

Regards,

Pedro

Pedro Rocha

+55 61 8203-5800

Enviado pelo meu BlackBerry®

Re: Active (I/O) paths misconfigured on VMware with ALUA

PSSUPPORT — Fri, 17 May 2013 10:52:50 GMT

We had a similar issue with two FAS 3240 in a streched Metro Cluster using FC.

The solution for our environment was to disable ALUA on IGroup within the Netapp.

Then the ESX-Servers use default-ALU (VMW_SATP_DEFAULT_AA). Path Policy is set to Round robin (VMWARE).

Maybe this helps.

Regards,

ps-support

Re: Active (I/O) paths misconfigured on VMware with ALUA

PSSUPPORT — Fri, 17 May 2013 11:42:29 GMT

Additional info:

you have to reboot the esx servers after disabling ALUA on the netapp, then the esx servers should use VMW_SATP_DEFAULT_AA instead of VMW_SATP_ALUA.

Regards,

ps-support

Re: Active (I/O) paths misconfigured on VMware with ALUA

gatorman1369 — Thu, 23 May 2013 15:17:38 GMT

Has this been sorted out, I am running into this issue with 5.1 hosts and ALUA enabled iGroups. I can give more details if needed but I am basically just reaching out before we submit a ticket on this.

Message was edited by: Allan Howard Here's a nmp list -d for one of my datastores ~ # esxcli storage nmp device list -d naa.60a98000572d43504f5a636d57537144 naa.60a98000572d43504f5a636d57537144 Device Display Name: NETAPP Fibre Channel Disk (naa.60a98000572d43504f5a636d57537144) Storage Array Type: VMW_SATP_ALUA Storage Array Type Device Config: {implicit_support=on;explicit_support=off; explicit_allow=on;alua_followover=on;{TPG_id=2,TPG_state=AO}{TPG_id=2,TPG_state=AO}{TPG_id=2,TPG_state=AO}} Path Selection Policy: VMW_PSP_RR Path Selection Policy Device Config: {policy=rr,iops=1000,bytes=10485760,useANO=0;lastPathIndex=3: NumIOsPending=0,numBytesPending=0} Path Selection Policy Device Custom Config: Working Paths: vmhba2:C0:T1:L61, vmhba2:C0:T0:L61, vmhba3:C0:T0:L61, vmhba3:C0:T1:L61 Is Local SAS Device: false Is Boot USB Device: false

Re: Active (I/O) paths misconfigured on VMware with ALUA

pedro_rocha — Thu, 23 May 2013 15:33:04 GMT

Hi,

Disabling ALUA does not seem to be a solution. AFAIK it is recommended to use ALUA with roud robin policy for this environment. Or not?

We have opened a case with VMware since this appears to be a VMware issue. I'll post here what we find out.

Regards,

Pedro Rocha.

Re: Active (I/O) paths misconfigured on VMware with ALUA

pedro_rocha — Thu, 23 May 2013 15:34:02 GMT

Hello,

Nothing yet. I would recommend to check this with VMware also. From NetApp that is what I got (a direction to check with VMware).

Regards,

Pedro.

Re: Active (I/O) paths misconfigured on VMware with ALUA

Sergio_Santos — Thu, 23 May 2013 18:05:42 GMT

No luck on my end either. On my 5th NetApp tech and they referred me to VMware support to resolve the issue. I'm waiting to hear back from them, but they've been awfully quiet.

I'm about to change the PSP to using FIXED with a preferred path as I've been working on this for months and I need to move on with this project. Maybe someone with more time can follow up on this and get this resolved once and for all since it doesn't sound like just me with this problem. I'm gonna dump my setup below and some of the steps I've taken:

SETUP:

Brocade VA-40FC 8Gbp FC switches (independent dual-fabric)

DELL R910/R900 servers with two single port Qlogic QLE2460 HBAs (each HBA to one fabric)

NetApp V3240 controllers with DataONTAP 8.0.2P4, single_image cf mode (1st FC port to fabric 1, 2nd to fabric 2); no V features used (back-end storage array connections)

Single initiator, single target zoning (Each ESXi hba port to one NetApp FC port per controller)

TROUBLESHOOTING (none of the steps below had any affect on pathing):

* Was happening with ESXi 5.0 with same DELL servers and NetApp controllers, and McData DS4700M FC SAN switches

* Built new ESXi 5.1 server on DELL R720

* Tried old firmware HBA QLE 2460 4.00.012 later upgraded to latest 5.09.0000

* Tried old firmware dual-port HBA QLE 2462 4.00.030 later upgraded to latest 5.09.0000

* Change FC fill-word option on Brocade switch ports from 1 to 3 for esxi ports and netapp ports

* Injected latest Qlogic drivers into ESXi OS (originally using v911.k1.1-26vmw but now 934.5.20.0-1vmw)

* Disable port features (NPIV, trunking, QoS) on Brocade for ESXi port

* Upgraded to ESXi 5.1 U1

Re: Active (I/O) paths misconfigured on VMware with ALUA

gatorman1369 — Wed, 29 May 2013 19:57:14 GMT

I've submitted a ticket to VMware.

I hate to be the guy who throws a wrench into this, but I've got a similar site as the one that isn't working, my HQ actually, with HP DL 380 G7's, and ESXi builds that were upgraded from build 9xxxxx to 1065491. ONTAP is 8.1.2 7-mode on 3250's. ALUA works just fine here.

Last week I went to my DR site to do a revamp, get more hosts and it's own vCenter, as my hosts there were managed by my vCenter at HQ. ALUA not working.

Here are a few of my details on the site that isn't working.

CISCO MDS 9124 (Using MDS 9148 at HQ)

NetApp 3140 HA pair ONTAP 8.1.2 P1 7-mode (yep, difference is the P1 compared to HQ)

HP DL380 G5

ESXi 5.1u1 Build 1065491 (Fresh install, not upgraded like HQ)

Emulex LPe12002 HBA Firmware: 2.00A4 Drivers:8.2.3.1-127vmw (Same as HQ)

I've configured iGroups for each of my hosts with ALUA enabled, yes I've rebooted them.

I've even run the NetApp VSC "Set recommended Values" for of the timeouts and such . Also did not help. Mind you, that I haven't run this back at HQ, and it doesn't seem to be an issue.

I've done similar TS steps as I am sure a lot of you have already done.. like blowing away the iGroups and creating them over again via System Manager GUI instead of using the command line originally. I've tried creating the iGroups without enabling ALUA first, saving the configuration, and then enabling ALUA both in SM and command line. Or creating a new LUN and seeing what the host decides the multipathing will be. I can not enable ALUA on the iGroup, and not have all paths active i/o... Going back to fixed path may be the thing I have to go with too.

I'll hopefully speak to VMware tomorrow.

Re: Active (I/O) paths misconfigured on VMware with ALUA

pedro_rocha — Wed, 29 May 2013 23:50:59 GMT

Hi all,

We are now speaking with VMware support, who directed us back to NetApp

support.

I am going to try to make them speak to each other since this is really

annoying and several people is getting same results.

Regards,

Pedro.

On Wed, May 29, 2013 at 4:58 PM, gatorman1369 <

Re: Active (I/O) paths misconfigured on VMware with ALUA

sinergy_storage — Thu, 30 May 2013 10:20:18 GMT

Hi everybody. Same issue to us. Customer with Metrocluster 3240 / two fabric (host ESXi 5.1 no update 1) with 2 HBA QLOGIC - 8 path all in Active I/O.

In the same cluster vmware also we are zoned with IBM SVC. SVC uses all active I/O path enabled.

We expect from Netapp the traditional ALUA, so Active I/O to half of the path and the Others only in "Active".

is there any response from VMWARE/NetApp

what about changing Advanced paramters

Disk.UseDeviceReset from 1 to 0 or

Disk.UseLunReset ????

Re: Active (I/O) paths misconfigured on VMware with ALUA

sinergy_storage — Thu, 30 May 2013 10:55:27 GMT

what about the information regarding optimizations path written on this recent vmware kb?

http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=1008113

It seems something tied to the single device

wainting further response

Re: Active (I/O) paths misconfigured on VMware with ALUA

gatorman1369 — Thu, 30 May 2013 14:22:10 GMT

I've run the "esxcli storage core device list" command in a ALUA working environment as well as my non-working environment. Results from both are the same.

Particularly from this KB you mention....

Queue Full Sample Size: 0

Queue Full Threshold: 0

Example:

ALUA working

naa.60a98000572d43504b5a66444d755758

Display Name: NETAPP Fibre Channel Disk (naa.60a98000572d43504b5a66444d755758)

Has Settable Display Name: true

Size: 512078

Device Type: Direct-Access

Multipath Plugin: NMP

Devfs Path: /vmfs/devices/disks/naa.60a98000572d43504b5a66444d755758

Vendor: NETAPP

Model: LUN

Revision: 811a

SCSI Level: 4

Is Pseudo: false

Status: on

Is RDM Capable: true

Is Local: false

Is Removable: false

Is SSD: false

Is Offline: false

Is Perennially Reserved: false

Queue Full Sample Size: 0

Queue Full Threshold: 0

Thin Provisioning Status: yes

Attached Filters: VAAI_FILTER

VAAI Status: supported

Other UIDs: vml.020026000060a98000572d43504b5a66444d7557584c554e202020

Is Local SAS Device: false

Is Boot USB Device: false

ALUA not working

naa.60a98000572d43504f5a6b337a643563

Display Name: NETAPP Fibre Channel Disk (naa.60a98000572d43504f5a6b337a643563)

Has Settable Display Name: true

Size: 266254

Device Type: Direct-Access

Multipath Plugin: NMP

Devfs Path: /vmfs/devices/disks/naa.60a98000572d43504f5a6b337a643563

Vendor: NETAPP

Model: LUN

Revision: 811a

SCSI Level: 4

Is Pseudo: false

Status: on

Is RDM Capable: true

Is Local: false

Is Removable: false

Is SSD: false

Is Offline: false

Is Perennially Reserved: false

Queue Full Sample Size: 0

Queue Full Threshold: 0

Thin Provisioning Status: yes

Attached Filters: VAAI_FILTER

VAAI Status: supported

Other UIDs: vml.020064000060a98000572d43504f5a6b337a6435634c554e202020

Is Local SAS Device: false

Is Boot USB Device: false

Appreciate the time and\ the KB link.

Re: Active (I/O) paths misconfigured on VMware with ALUA

sinergy_storage — Thu, 30 May 2013 16:03:34 GMT

now we are wainting for a time Windows on the customer's production infrastructure to trying a selective zoning.

In other words, the problem seems to be tied to the number o path to the devices that is major of 4.

In another cluster with only 4 path to datastores the ALUA works perfectly.

We'try to remove some path from fabric so that a max of 4 path will be available. Then see the results.

If somebedy could test this situztion in time before us, please write a feedback.

Bye

Sinergy

Re: Active (I/O) paths misconfigured on VMware with ALUA

Sergio_Santos — Thu, 30 May 2013 17:13:30 GMT

Hi Sinergy,

We've got 4 paths total here and it's not working (they all have Active (I/O)). The four paths breakdown like this:

Fabric 1

Path 1: ESX vmhba1 to V3240 Controller 1 Port 0d

Path 2: ESX vmhba1 to V3240 Controller 2 Port 0d

Fabric 2

Path 3: ESX vmhba2 to V3240 Controller 1 Port 4a

Path 4: ESX vmhba2 to V3240 Controller 2 Port 4a

I would try to change your pathing scheme anyway because there does not seem to be a clear pattern when this happens and when it doesn't. No word from the VMware tech on my end. I don't know if I mentioned it, but all my ESX setups have been fresh--no upgrades from 4.0 to 5.0 to 5.1. I installed both a new vCenter sever and reinstalled ESXi each time.

Also, I was trying to pick the brain of the Netapp tech to find out if there's a way to debug the ALUA negotiation between the ESX and the controller. Either a log or in real time. Alas, it doesn't sound like there is any way to do that.