ONTAP Discussions

Database is not on NFS mounted storage. Hence, no views available.

MARTIN_LAUSCH
8,920 Views

Hi,

 

yesterday I installed the NetApp Storage Plugin in our Test Cloud Control environment.

Everything works fine so far but under the (for us - the dba team) interesting link "Consolidated Database Storage Performance" we face the Info: "Database is not on NFS mounted storage. Hence, no views available."

 

All(most) of our databases run on NFS storage(more exact directNFS is enabled).

 

Database Version: Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production

Database Server OS: Oracle Linux Server release 6.2

Clound Control Version: Oracle Enterprise Manager Cloud Control 12c Release 3 - 12.1.0.3.0 (db-plugin version 12.1.0.5.)

Cloud Control Server OS: Oracle Linux Server release 6.2

NetApp Plugin Version: NetApp Storage System Plug-in - netapp.storage.sys - 12.1.0.2.0

 

Any ideas how to get it work?

 

Thanks & regards,

Martin

26 REPLIES 26

sachin1
8,149 Views

Hi Martin,

Thanks you for sharing feedback.

Please make sure that following things have been configured:

1) Monitoring database has already been registered with Oracle Enterprise Manager (OEM)  and it is visible from there.

2) Storage controller on which database resides has also been registered with OEM.

***3) Please make sure that on database host, fstab entry holds the IP address of storage controller for mount point definition. We are using database host fstab entry to generate mapping based upon IP address (only IP address). Also, database should be mounted on NFS volume (no qtrees)

4) If you are making any changes to fstab entry now, it takes approx. 24 hours to reflect this value in OEM repository or may need to do some force operation to reflect the change.

5) Please also check if your database volumes are listed by "Volume Details" metric for the registered storage controller.

If above steps are in place, database views should work for you.

Please let us know your feedback.

*** Please note that we are working upon next release and where we have resolved that IP address constraint and you can provide short name / FQDN of storage controller in FSTAB mount point definition.

Regards,

Sachin Maheshwari

MARTIN_LAUSCH
8,149 Views

Hi Sashin,

thanks for your fast answer. I will check these points.

  • What I can already say is that we have several qtrees at the moment.
  • Additionally we use nested mounts for the oracle binaries (some weeks ago we learned that there are some problems with nested qtree mounts and that we should change some mountpoint-options for these mounts) but I don't know if we have to care about the binaries here.
  • In the fstab we use the name of the storage and not the IP

We know that we use a lot of mountpoints and volumes and we already going to change this because we start using the Snapmanager for Oracle and therefor we have to create a new structure. But for now this is the standard.

Regards,

Martin

sachin1
8,149 Views

Hi Martin,

Thank you for sharing details. Currently, we don't support views if database resides on qtrees.

From above data, I can see that databases are residing on qtrees. We are already working upon this requirement and it will be available in next patch release for database support on qtrees,

I also request, if you can share the output of following SQL. This will help us to know your environment better. If you feel data is private, please send an email: sachin1@netapp.com

You must have permissions to login to EM12c repository SQL prompt and execute below SQL on EM repository. 

SELECT V2.TARGET_NAME "DatabaseName", V1.FILESYSTEM "FileSystem", V2.FILE_NAME "FileName"

FROM MGMT$STORAGE_REPORT_NFS V1, MGMT$DB_DATAFILES V2

WHERE V1.MOUNTPOINT = V2.OS_STORAGE_ENTITY and V2.TARGET_NAME ='<DB_NAME>'   -- Specify database name here

Regards,

Sachin Maheshwari

MARTIN_LAUSCH
8,149 Views

Hi Sachin,

I will send you a mail with the output of the SQL next week.

Because of qtrees. As already said due to SMO storage redesign we try to move out most of the qtrees. I can test it with a SMO test database and see if it works with a db without qtrees.

But for now it seems not usable for us for the existing systems until we reconstructed the mountpoints or we have to wait for the next release of the plugin.

Thanks so far and regards,

Martin

sachin1
8,149 Views

Hi Martin,

Thank you for update.

Version 2.0 of plug-in has lots of new features. Please review the documentation to know more and share your feedback about other features.

I also suggest when you are creating test database, please provide IP address instead of storage name in fstab for mount point definition to make this work.

Probably, we will make patch release during Jan-Feb time frame to resolve naming and qtrees dependency.

Regards,

Sachin Maheshwari

NAVEENGARG
8,149 Views

Hello Sachin,

We are on EM12c Release 3 (12.1.0.3.0) and installed the NetApp plug-in (12.1.0.2.1). Our FSTAB looks like this

rdnetapp01adata&colon;/vol/ndatmsod_data01     16777216  8187840   8589376  49% /ndatmsod/oradata01

rdnetapp01adata&colon;/vol/ndatmsos_data01     16777216  8184320   8592896  49% /ndatmsos/oradata01

1. We are using DNS name in the FSTAB

2. We are mounting the volume (not qtrees)

3. When I click on "Consolidated Database Storage Performance", I see a list of databases (How does it build the list of DBs ?)

We also edited the StorageIPAddressMapping.xml file and added the shortname "rdnetapp01adata", but still get the same error "Database is not on NFS mounted storage. Hence, no views available."

nkarthik
8,151 Views

Hello Naveen,

1. Can you please send us the StorageIPAddressMapping.xml?

2. Can you send us the "nslookup  rdnetapp01adata"?

3. If you update the fstab now, please wait for 24 hours to check the change.

Regards,

Karthikeyan.N

NAVEENGARG
7,750 Views

1. Can you please send us the StorageIPAddressMapping.xml?

Couldn't file any option to attach a file. Here are the contents of the StorageIPAddressMapping.xml file

oracle@rdlvd29{ndatmsos}[/u01/app/oracle/product/agent/plugins/netapp.storage.sys.agent.plugin_12.1.0.2.1/scripts/data/7mode/10.230.1.43]$ cat StorageIPAddressMapping.xml

<?xml version="1.0" encoding="UTF-8" standalone="yes"?>

<storageIPAddressMapping xmlns="http://www.netapp.com/oemplugin">

    <InterfaceMappingInfo shortname="rdnetapp01a" fqdnName="rdnetapp01a.ctdi.com" ipAddress="192.168.112.122" interfaceName="e0a"/>

    <InterfaceMappingInfo shortname="rdnetapp01adata" fqdnName="rdnetapp01a.ctdi.com" ipAddress="10.230.1.43" interfaceName="e0M"/>

    <InterfaceMappingInfo shortname="Not Assigned" fqdnName="Not Assigned" ipAddress="192.168.112.123" interfaceName="e0b"/>

    <InterfaceMappingInfo shortname="Not Assigned" fqdnName="Not Assigned" ipAddress="Not Assigned" interfaceName="e1a"/>

    <InterfaceMappingInfo shortname="Not Assigned" fqdnName="Not Assigned" ipAddress="Not Assigned" interfaceName="e1b"/>

    <InterfaceMappingInfo shortname="Not Assigned" fqdnName="Not Assigned" ipAddress="192.168.1.106" interfaceName="c0a"/>

    <InterfaceMappingInfo shortname="Not Assigned" fqdnName="Not Assigned" ipAddress="192.168.2.56" interfaceName="c0b"/>

    <InterfaceMappingInfo shortname="Not Assigned" fqdnName="Not Assigned" ipAddress="192.168.2.187" interfaceName="e0P"/>

    <InterfaceMappingInfo shortname="Not Assigned" fqdnName="Not Assigned" ipAddress="10.230.1.132" interfaceName="nfsdata01a"/>

    <ManualMapping>true</ManualMapping>

</storageIPAddressMapping>

2. Can you send us the "nslookup  rdnetapp01adata"?

oracle@rdlvd29{ndatmsos}[/u01/app/oracle/product/agent/plugins/netapp.storage.sys.agent.plugin_12.1.0.2.1/scripts/data/7mode/10.230.1.43]$ nslookup rdnetapp01adata

Server:         192.168.112.72

Address:        192.168.112.72#53

Address: 10.230.1.132

3. If you update the fstab now, please wait for 24 hours to check the change.

What do you want me to update the FSTAB to ?

nkarthik
7,414 Views

Hello Naveen,

In the StorageIPAddressMapping.xml, The IP address is pointed to "10.230.1.43" and in the Nslookup the Address is "10.230.1.132" for "rdnetapp01adata" and make sure the interface name is e0M for "rdnetapp01adata" " pointing IP address.

when did you update the /etc/fstab file with the following entries?, if they are updated recently wait for 24 hours to view the changes.

rdnetapp01adata&colon;/vol/ndatmsod_data01     16777216  8187840   8589376  49% /ndatmsod/oradata01

rdnetapp01adata&colon;/vol/ndatmsos_data01     16777216  8184320   8592896  49% /ndatmsos/oradata01

Regards,

Karthikeyan.N

NAVEENGARG
7,414 Views

I forgot to reply the question you asked in this post.

The FSTAB entries haven't changed in weeks.

Also, I have two lines in the StorageIPAddressMapping.xml file for this shortname with different interfacename. Is that OK ?

<InterfaceMappingInfo shortname="rdnetapp01adata" fqdnName="rdnetapp01adata.ctdi.com" ipAddress="10.230.1.132" interfaceName="e0M"/>

<InterfaceMappingInfo shortname="rdnetapp01adata" fqdnName="rdnetapp01adata.ctdi.com" ipAddress="10.230.1.132" interfaceName="nfsdata01a"/>

nkarthik
6,660 Views

Try with one entry.

NAVEENGARG
8,151 Views

Made some changes to the file

oracle@rdlvd27{sbchtwcd}[/u01/app/oracle/product/agent/plugins/netapp.storage.sys.agent.plugin_12.1.0.2.1/scripts/data/7mode/10.230.1.43]$ cat StorageIPAddressMapping.xml

<?xml version="1.0" encoding="UTF-8" standalone="yes"?>

<storageIPAddressMapping xmlns="http://www.netapp.com/oemplugin">

    <InterfaceMappingInfo shortname="rdnetapp01a" fqdnName="rdnetapp01a.ctdi.com" ipAddress="192.168.112.122" interfaceName="e0a"/>

    <InterfaceMappingInfo shortname="rdnetapp01adata" fqdnName="rdnetapp01adata.ctdi.com" ipAddress="10.230.1.132" interfaceName="e0M"/>

    <InterfaceMappingInfo shortname="rdnetapp01adata" fqdnName="rdnetapp01adata.ctdi.com" ipAddress="10.230.1.132" interfaceName="nfsdata01a"/>

    <InterfaceMappingInfo shortname="Not Assigned" fqdnName="Not Assigned" ipAddress="192.168.112.123" interfaceName="e0b"/>

    <InterfaceMappingInfo shortname="Not Assigned" fqdnName="Not Assigned" ipAddress="Not Assigned" interfaceName="e1a"/>

    <InterfaceMappingInfo shortname="Not Assigned" fqdnName="Not Assigned" ipAddress="Not Assigned" interfaceName="e1b"/>

    <InterfaceMappingInfo shortname="Not Assigned" fqdnName="Not Assigned" ipAddress="192.168.1.106" interfaceName="c0a"/>

    <InterfaceMappingInfo shortname="Not Assigned" fqdnName="Not Assigned" ipAddress="192.168.2.56" interfaceName="c0b"/>

    <InterfaceMappingInfo shortname="Not Assigned" fqdnName="Not Assigned" ipAddress="192.168.2.187" interfaceName="e0P"/>

    <ManualMapping>true</ManualMapping>

</storageIPAddressMapping>

nkarthik
7,815 Views

Please let me know how it goes now with the latest changes?

Regards,

Karthikeyan.N

NAVEENGARG
7,815 Views

Karthik,

Do I need to restart the agent ? Still getting the error.

NAVEENGARG
7,816 Views

In the /u01/app/oracle/product/agent/plugins/netapp.storage.sys.agent.plugin_12.1.0.2.1/scripts/data/7mode directory, I don't see a directory for 10.230.1.132. I was expecting that !

nkarthik
7,816 Views

Naveen,

Try restart the agent and check /u01/app/oracle/product/agent/plugins/netapp.storage.sys.agent.plugin_12.1.0.2.1/scripts/log/NetAppPlugin.log and send it to nkarthik@netapp.com and sachin1@netapp.com

Regards,

Karthikeyan.N

NAVEENGARG
6,660 Views

Karthik,

Something doesn't seem right.

In the /u01/app/oracle/product/agent/plugins/netapp.storage.sys.agent.plugin_12.1.0.2.1/scripts/data/7mode directory, I don't see a directory for 10.230.1.132. I only see "10.230.1.43" "10.230.1.45". These IPs are the other interfaces for the same NetApp

NAVEENGARG
7,062 Views

How do I attach a file here ?? The file NetAppPlugin.log doesn't have much info, the last entry is from 9.18 this morning when we had a wrong password in the monitoring configuration.

[2014-04-29 09:16:15,964] [main] [ERROR] Failed to initialize Zapi runner. :com.netapp.autozapi.client.ApiAuthenticationException: Authentication to Storage System 10.230.1.45 as user 443 failed.  Response code: 401

[2014-04-29 09:16:16,055] [main] [ERROR] Failed to initialize Zapi runner. :com.netapp.autozapi.client.ApiAuthenticationException: Authentication to Storage System 10.230.1.45 as user 443 failed.  Response code: 401

[2014-04-29 09:16:16,062] [main] [ERROR] Failed to initialize Zapi runner. :com.netapp.autozapi.client.ApiAuthenticationException: Authentication to Storage System 10.230.1.43 as user 443 failed.  Response code: 401

[2014-04-29 09:16:17,100] [main] [ERROR] Failed to initialize Zapi runner. :com.netapp.autozapi.client.ApiAuthenticationException: Authentication to Storage System 10.230.1.45 as user 443 failed.  Response code: 401

[2014-04-29 09:18:28,956] [main] [ERROR] Failed to initialize Zapi runner. :com.netapp.autozapi.client.ApiAuthenticationException: Authentication to Storage System 10.230.1.45 as user 443 failed.  Response code: 401

[2014-04-29 09:18:30,125] [main] [ERROR] Failed to initialize Zapi runner. :com.netapp.autozapi.client.ApiAuthenticationException: Authentication to Storage System 10.230.1.45 as user 443 failed.  Response code: 401

[2014-04-29 09:18:31,257] [main] [ERROR] Failed to initialize Zapi runner. :com.netapp.autozapi.client.ApiAuthenticationException: Authentication to Storage System 10.230.1.45 as user 443 failed.  Response code: 401

nkarthik
7,060 Views

Naveen,

 

I hope you are using 7 mode storage controller. if not correct me.

 

The StorageIPAddressMapping.xml is in /u01/app/oracle/product/agent/plugins/netapp.storage.sys.agent.plugin_12.1.0.2.1/scripts/data/7mode/10.230.1.43 it should be in /u01/app/oracle/product/agent/plugins/netapp.storage.sys.agent.plugin_12.1.0.2.1/scripts/data/7mode/10.230.1.132.

   

can you re-register your storage with the correct ip address(10.230.1.132) and choose the right target type (7mode) and you will see /u01/app/oracle/product/agent/plugins/netapp.storage.sys.agent.plugin_12.1.0.2.1/scripts/data/7mode/10.230.1.132 then change StorageIPAddressMapping.xml with one entry.

 

change the collection internal to 5 min (Targets -> all targets -> NetApp storage system operating in 7 mode -> select the newly registered storage target -> NetApp storage system operating in 7 mode -> monitoring -> all metrics -> Network Interface list  -> (Interface FQDN and Interface shortName ) are proper.

then you try to check

Regards,

Karthikeyan.N

NAVEENGARG
6,573 Views

Karthik

Yes, we are using 7 mode storage controller.

I did re-register the storage with the correct ip address(10.230.1.132 with 7mode) and I do see /u01/app/oracle/product/agent/plugins/netapp.storage.sys.agent.plugin_12.1.0.2.1/scripts/data/7mode/10.230.1.132. The file "/u01/app/oracle/product/agent/plugins/netapp.storage.sys.agent.plugin_12.1.0.2.1/scripts/data/7mode/10.230.1.132/StorageIPAddressMapping.xml" has the following entries. I did not change anything (wasn't sure what to change).

I mounted the host filesystem on IP 10.230.1.132, so I wasn't sure if I need to change anything in this file.

oracle@rdlvd27{sbchtwcd}[/u01/app/oracle/product/agent/plugins/netapp.storage.sys.agent.plugin_12.1.0.2.1/scripts/data/7mode/10.230.1.132]$ cat StorageIPAddressMapping.xml

<?xml version="1.0" encoding="UTF-8" standalone="yes"?>

<storageIPAddressMapping xmlns="http://www.netapp.com/oemplugin">

    <InterfaceMappingInfo shortname="rdnetapp01a" fqdnName="rdnetapp01a.ctdi.com" ipAddress="192.168.112.122" interfaceName="e0a"/>

    <InterfaceMappingInfo shortname="Not Assigned" fqdnName="Not Assigned" ipAddress="192.168.112.123" interfaceName="e0b"/>

    <InterfaceMappingInfo shortname="Not Assigned" fqdnName="Not Assigned" ipAddress="Not Assigned" interfaceName="e1a"/>

    <InterfaceMappingInfo shortname="Not Assigned" fqdnName="Not Assigned" ipAddress="Not Assigned" interfaceName="e1b"/>

    <InterfaceMappingInfo shortname="Not Assigned" fqdnName="Not Assigned" ipAddress="192.168.1.106" interfaceName="c0a"/>

    <InterfaceMappingInfo shortname="Not Assigned" fqdnName="Not Assigned" ipAddress="192.168.2.56" interfaceName="c0b"/>

    <InterfaceMappingInfo shortname="Not Assigned" fqdnName="Not Assigned" ipAddress="10.230.1.43" interfaceName="e0M"/>

    <InterfaceMappingInfo shortname="Not Assigned" fqdnName="Not Assigned" ipAddress="192.168.2.187" interfaceName="e0P"/>

    <InterfaceMappingInfo shortname="Not Assigned" fqdnName="Not Assigned" ipAddress="10.230.1.132" interfaceName="nfsdata01a"/>

    <ManualMapping>false</ManualMapping>

</storageIPAddressMapping>


Still the same error ! Not sure what your role is (are you a user or developer of this product). I'm getting totally confused at this point.

Public