Solved: Re: Cinder driver netapp problem - KILO Release

Rodrigo · ‎2016-01-29

I configured the cinder driver for netapp with success, I can create volumes, instances using the nfs backend.
But when I create a new instance using the horizon, the value from internal storage for the hypervisor is marked as in use at the local disk, even not in use.
The volume for instance is created in nfs shared but the LOCAL STORAGE in hypervisor is updated as used.

# nova hypervisor-stats
+----------------------+-------+
| Property             | Value |
+----------------------+-------+
| count                | 2     |
| current_workload     | 0     |
| disk_available_least | 470   |
| free_disk_gb         | 10    |
| free_ram_mb          | 48428 |
| local_gb             | 470   |
| local_gb_used        | 460   |
| memory_mb            | 96556 |
| memory_mb_used       | 48128 |
| running_vms          | 23    |
| vcpus                | 32    |
| vcpus_used           | 23    |
+----------------------+-------+

When all space from the local hypervisor is marked as in use a received the error:

No valid host was found. There are not enough hosts available.

But I have space in NFS share and all volumes was created in the NFS, I don't have any volumes created in the compute local storages.

- cinder.conf

[DEFAULT]
rootwrap_config = /etc/cinder/rootwrap.conf
api_paste_confg = /etc/cinder/api-paste.ini
iscsi_helper = tgtadm
volume_name_template = volume-%s
volume_group = cinder
verbose = True
auth_strategy = keystone
state_path = /var/lib/cinder
lock_path = /var/lock/cinder
volumes_dir = /var/lib/cinder/volumes
enable_v2_api=True
iscsi_protocol=iscsi
use_syslog=True
api_paste_config=/etc/cinder/api-paste.ini
glance_num_retries=0
volume_driver=cinder.volume.drivers.lvm.LVMVolumeDriver
use_stderr=False
debug=False
storage_availability_zone=nova
glance_api_ssl_compression=False
glance_api_insecure=False
syslog_log_facility=LOG_LOCAL3
log_dir=/var/log/cinder
iscsi_ip_address=10.250.3.131
glance_api_servers=10.1.3.130:9292
volume_backend_name=DEFAULT
default_availability_zone=nova
use_syslog_rfc_format=True
control_exchange=cinder
enable_v1_api=True
glance_api_version=2
amqp_durable_queues=False
rpc_backend=cinder.openstack.common.rpc.impl_kombu
kombu_reconnect_delay=5.0
enabled_backends=cinder_isci,cinder_netapp
default_volume_type=cinder_netapp

[oslo_messaging_rabbit]
rabbit_ha_queues=True
rabbit_use_ssl=False
rabbit_hosts=10.1.3.131:5673, 10.1.3.132:5673, 10.1.3.134:5673
rabbit_virtual_host=/
rabbit_password=password
rabbit_userid=nova

[keystone_authtoken]
signing_dir=/tmp/keystone-signing-cinder
admin_password=password
admin_tenant_name=services
auth_uri=http://10.1.3.130:5000/
identity_uri=http://10.1.3.130:5000/
admin_user=cinder
signing_dirname=/tmp/keystone-signing-cinder

[database]
idle_timeout=3600
max_pool_size=30
max_retries=-1
retry_interval=10
max_overflow=60
min_pool_size=1
connection=mysql://cinder:password@10.1.3.130/cinder?charset=utf8&read_timeout=60

[keymgr]
fixed_key=8756254f7e8ee8c57f3858af6c47c420b074c2608e3932ca6720538112ee99d5

[cinder_isci]
iscsi_helper=tgtadm
volume_backend_name=cinder_isci
volume_group=cinder

[cinder_netapp]
netapp_login=root
netapp_eseries_host_type=linux_dm_mp
netapp_controller_ips=
netapp_size_multiplier=1.2
netapp_vserver=
netapp_server_port=80
nfs_shares_config=/etc/cinder/shares.conf
netapp_sa_password=
thres_avl_size_perc_start=20
netapp_storage_pools=
volume_driver=cinder.volume.drivers.netapp.common.NetAppDriver
netapp_storage_protocol=nfs
netapp_storage_family=ontap_7mode
volume_backend_name=cinder_netapp
thres_avl_size_perc_stop=60
netapp_vfiler=
netapp_volume_list=
netapp_server_hostname=10.1.0.25
expiry_thres_minutes=2160
netapp_transport_type=http
netapp_password=password
netapp_webservice_path=/devmgr/v2
netapp_copyoffload_tool_path=

- shared.conf

10.250.3.253:/vol/openstack

# df -h

Filesystem                   Size  Used Avail Use% Mounted on
udev                          16G   12K   16G   1% /dev
tmpfs                        3.2G  5.4M  3.2G   1% /run
/dev/dm-1                     27G  2.1G   24G   9% /
none                         4.0K     0  4.0K   0% /sys/fs/cgroup
none                         5.0M     0  5.0M   0% /run/lock
none                          16G     0   16G   0% /run/shm
none                         100M     0  100M   0% /run/user
/dev/sda3                    196M   44M  143M  24% /boot
/dev/mapper/vm-nova           91G   33M   91G   1% /var/lib/nova
10.250.3.253:/vol/openstack  500G  452M  500G   1% /var/lib/nova/mnt/36f09148d1243e64fbe04aa72c497a2e

# ls -la /var/lib/nova/mnt/36f09148d1243e64fbe04aa72c497a2e
total 438608
drwxr-xr-x 2 cinder       cinder              8192 Jan 29 19:23 .
drwxr-xr-x 3 nova         nova                  45 Jan 29 19:22 ..
-rw-r----- 1 cinder       cinder                76 Jan 29 19:08 .cinderSecureEnvIndicator
-rw-rw---- 1 cinder       cinder       21474836480 Jan 29 19:22 img-cache-984a5cfe-d136-488b-b393-85fd7ba9cfce
-rw-rw---- 1 libvirt-qemu libvirt-qemu 21474836480 Jan 29 19:24 volume-0367ff27-93f7-49d3-bee5-20748938a6e8
-rw-rw---- 1 libvirt-qemu libvirt-qemu 21474836480 Jan 29 19:23 volume-05d3d597-bf48-4a51-a4e1-0de0b7c406e9
-rw-rw---- 1 libvirt-qemu libvirt-qemu 21474836480 Jan 29 19:23 volume-13a00b96-5d39-46fc-8ba8-b88b2c651e3f
-rw-rw---- 1 libvirt-qemu libvirt-qemu 21474836480 Jan 29 19:24 volume-151d5d98-e32b-4a0b-84e0-3c5c795da993
-rw-rw---- 1 libvirt-qemu libvirt-qemu 21474836480 Jan 29 19:23 volume-1d1e7286-6fbb-4fca-9d12-41f082f829e8
-rw-rw---- 1 libvirt-qemu libvirt-qemu 21474836480 Jan 29 19:23 volume-245b6b85-bd7b-42ea-ab9f-e8b4f547c56a
-rw-rw---- 1 libvirt-qemu libvirt-qemu 21474836480 Jan 29 19:23 volume-24f4ef8b-bb4e-4735-b5b7-47e82d82ac55
-rw-rw---- 1 libvirt-qemu libvirt-qemu 21474836480 Jan 29 19:24 volume-327ee624-c8a4-4c31-aa3b-1bb499976a18
-rw-rw---- 1 libvirt-qemu libvirt-qemu 21474836480 Jan 29 19:24 volume-3360c4db-41af-4420-854d-e7d2402e16f7
-rw-rw---- 1 libvirt-qemu libvirt-qemu 21474836480 Jan 29 19:23 volume-41e14189-31d7-4e88-a77a-9e14a190f5c2
-rw-rw---- 1 libvirt-qemu libvirt-qemu 21474836480 Jan 29 19:24 volume-49bf9683-7730-495c-93d2-f8cd8646cfc6
-rw-rw---- 1 libvirt-qemu libvirt-qemu 21474836480 Jan 29 19:23 volume-4dd997fb-3411-46a5-8c56-454d56679311
-rw-rw---- 1 libvirt-qemu libvirt-qemu 21474836480 Jan 29 19:23 volume-7629e1b2-57e3-43b2-a6f2-5d4acc57c4ee
-rw-rw---- 1 libvirt-qemu libvirt-qemu 21474836480 Jan 29 19:23 volume-7bf604fe-1797-41bb-b394-e1bc5e2c1493
-rw-rw---- 1 libvirt-qemu libvirt-qemu 21474836480 Jan 29 19:23 volume-8d91491b-7dfa-4787-b915-06280a945f17
-rw-rw---- 1 libvirt-qemu libvirt-qemu 21474836480 Jan 29 19:23 volume-9dd79169-b285-42f9-bd83-133e7d46fd9e
-rw-rw---- 1 libvirt-qemu libvirt-qemu 21474836480 Jan 29 19:23 volume-b532112e-bc88-40d3-bd05-42b152af4d3a
-rw-rw---- 1 libvirt-qemu libvirt-qemu 21474836480 Jan 29 19:24 volume-c96118c1-6d4a-4355-b904-498af26e8cdc
-rw-rw---- 1 libvirt-qemu libvirt-qemu 21474836480 Jan 29 19:23 volume-ce17b3fd-7df0-46c6-9edb-7470563281d5
-rw-rw---- 1 libvirt-qemu libvirt-qemu 21474836480 Jan 29 19:24 volume-d1359aa0-78e8-4f99-913c-b73f5de20df8
-rw-rw---- 1 libvirt-qemu libvirt-qemu 21474836480 Jan 29 19:23 volume-d1d04ab4-948d-4d5e-9ddf-fe342508b650
-rw-rw---- 1 libvirt-qemu libvirt-qemu 21474836480 Jan 29 19:23 volume-dbbc6249-3d19-4e09-9083-8ae3d919664a
-rw-rw---- 1 libvirt-qemu libvirt-qemu 21474836480 Jan 29 19:24 volume-eb9fc6d5-c302-4527-885e-6cf698627066

# ls -la /var/lib/cinder/volumes/
total 8
drwxr-x--- 2 cinder cinder 4096 Oct 20 13:44 .
drwxr-xr-x 5 cinder cinder 4096 Jan 29 19:22 ..

# Instance error log instnace

Message
    No valid host was found. There are not enough hosts available.
Code
    500
Details
  File "/usr/lib/python2.7/dist-packages/nova/conductor/manager.py", line 671, in build_instances request_spec, filter_properties) File "/usr/lib/python2.7/dist-packages/nova/scheduler/utils.py", 
  line 337, in wrapped return func(*args, **kwargs) File "/usr/lib/python2.7/dist-packages/nova/scheduler/client/__init__.py", line 52, in select_destinations context, request_spec, filter_properties) 
  File "/usr/lib/python2.7/dist-packages/nova/scheduler/client/__init__.py", line 37, in __run_method return getattr(self.instance, __name)(*args, **kwargs) 
  File "/usr/lib/python2.7/dist-packages/nova/scheduler/client/query.py", line 34, in select_destinations context, request_spec, filter_properties) 
  File "/usr/lib/python2.7/dist-packages/nova/scheduler/rpcapi.py", line 120, in select_destinations request_spec=request_spec, filter_properties=filter_properties) 
  File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 156, in call retry=self.retry) 
  File "/usr/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 90, in _send timeout=timeout, retry=retry) 
  File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 350, in send retry=retry) 
  File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 341, in _send raise result

Thank you !

dcain · ‎2016-02-01

Hi Rodrigo,

First off, you get a gold star for the helpful level of detail provided in your post. Configuration details, log files, error messages, etc are all helpful in diagnosing any technical issues, especially so with all the moving pieces and parts of OpenStack!

With that being said, I think I've run into this problem in the Liberty release. Only difference in my case was the fact that instances created via the CLI were impacted too. You're sure that you can create instances with the CLI, but not with Horizon?

For me in Liberty to fix this, If one omits the DiskFilter in /etc/nova/nova.conf:

scheduler_default_filters=RetryFilter,AvailabilityZoneFilter,RamFilter,ComputeFilter,ComputeCapabilitiesFilter,ImagePropertiesFilter,ServerGroupAntiAffinityFilter,ServerGroupAffinityFilter

Instances can then be built on shared storage without consulting (in error) the free space allocated in "free_disk_gb" as shown by the hypervisor-stats command. I believe this is what is causing the scheduler to give up with the ever so helpful error message of "No valid host found," as it consults the free_disk_gb beore placement of an instance. Negative values don't appear to cause any problems, at least in my initial investigation. See here for what I'm talking about:

[admin@liberty-controller-0 ~]$ nova hypervisor-stats
+----------------------+--------+
| Property             | Value  |
+----------------------+--------+
| count                | 1      |
| current_workload     | 1      |
| disk_available_least | 36     |
| free_disk_gb         | -31    |
| free_ram_mb          | 255158 |
| local_gb             | 39     |
| local_gb_used        | 70     |
| memory_mb            | 257718 |
| memory_mb_used       | 2560   |
| running_vms          | 4      |
| vcpus                | 40     |
| vcpus_used           | 4      |
+----------------------+--------+

View solution in original post

dcain · ‎2016-02-01

Hi Rodrigo,

First off, you get a gold star for the helpful level of detail provided in your post. Configuration details, log files, error messages, etc are all helpful in diagnosing any technical issues, especially so with all the moving pieces and parts of OpenStack!

With that being said, I think I've run into this problem in the Liberty release. Only difference in my case was the fact that instances created via the CLI were impacted too. You're sure that you can create instances with the CLI, but not with Horizon?

For me in Liberty to fix this, If one omits the DiskFilter in /etc/nova/nova.conf:

scheduler_default_filters=RetryFilter,AvailabilityZoneFilter,RamFilter,ComputeFilter,ComputeCapabilitiesFilter,ImagePropertiesFilter,ServerGroupAntiAffinityFilter,ServerGroupAffinityFilter

Instances can then be built on shared storage without consulting (in error) the free space allocated in "free_disk_gb" as shown by the hypervisor-stats command. I believe this is what is causing the scheduler to give up with the ever so helpful error message of "No valid host found," as it consults the free_disk_gb beore placement of an instance. Negative values don't appear to cause any problems, at least in my initial investigation. See here for what I'm talking about:

[admin@liberty-controller-0 ~]$ nova hypervisor-stats
+----------------------+--------+
| Property             | Value  |
+----------------------+--------+
| count                | 1      |
| current_workload     | 1      |
| disk_available_least | 36     |
| free_disk_gb         | -31    |
| free_ram_mb          | 255158 |
| local_gb             | 39     |
| local_gb_used        | 70     |
| memory_mb            | 257718 |
| memory_mb_used       | 2560   |
| running_vms          | 4      |
| vcpus                | 40     |
| vcpus_used           | 4      |
+----------------------+--------+

Rodrigo · ‎2016-02-01

Thank you ! Now is working !

dcain · ‎2016-02-01

Glad to hear.

nsrushi46 · ‎2016-05-16

Hi

I get the following error.

Unable to update stats, NetAppCmodeNfsDriver -1.0.0 (config name netapp-driver) driver is uninitialized.

My cinder service-list ok . i get all services up and NFS mount was ok and i can write files but when i try to create volume i get the above error.

Any idea.

BR

Rushi.

dcain · ‎2016-05-18

Please post up more (all) of your cinder-volume.log - something is stopping your driver being initialized, but you haven't provided enough logs to tell what the issue is.

nsrushi46 · ‎2016-05-18

Hi

Here you go complete cinder.log (my logs only have one file )

------

2016-05-19 03:56:32.346 60931 INFO cinder.volume.manager [req-8fe6d923-7457-4841-b518-76c662cdeb5e - - - - -] Updating volume status
2016-05-19 03:56:32.347 60931 WARNING cinder.volume.manager [req-8fe6d923-7457-4841-b518-76c662cdeb5e - - - - -] Unable to update stats, NetAppCmodeNfsDriver -1.0.0 (config name net
app-driver) driver is uninitialized.
2016-05-19 03:56:42.538 60861 INFO cinder.openstack.common.service [-] Caught SIGTERM, stopping children
2016-05-19 03:56:42.553 60861 INFO cinder.openstack.common.service [-] Waiting on 8 children to exit
2016-05-19 03:56:42.554 60861 INFO cinder.openstack.common.service [-] Child 60904 killed by signal 15
2016-05-19 03:56:42.555 60861 INFO cinder.openstack.common.service [-] Child 60905 killed by signal 15
2016-05-19 03:56:42.556 60861 INFO cinder.openstack.common.service [-] Child 60906 killed by signal 15
2016-05-19 03:56:42.556 60861 INFO cinder.openstack.common.service [-] Child 60907 killed by signal 15
2016-05-19 03:56:42.557 60861 INFO cinder.openstack.common.service [-] Child 60908 killed by signal 15
2016-05-19 03:56:42.557 60861 INFO cinder.openstack.common.service [-] Child 60909 killed by signal 15
2016-05-19 03:56:42.558 60861 INFO cinder.openstack.common.service [-] Child 60910 killed by signal 15
2016-05-19 03:56:42.558 60861 INFO cinder.openstack.common.service [-] Child 60911 killed by signal 15
2016-05-19 03:56:42.861 60875 INFO cinder.openstack.common.service [req-4eef44ca-9650-4565-8b31-e9371ede13fe - - - - -] Caught SIGTERM, exiting
2016-05-19 03:56:43.190 60891 INFO cinder.openstack.common.service [req-7656ccb5-6c60-46f9-bb48-c341cddecaf5 - - - - -] Caught SIGTERM, stopping children
2016-05-19 03:56:43.196 60891 INFO cinder.openstack.common.service [req-7656ccb5-6c60-46f9-bb48-c341cddecaf5 - - - - -] Waiting on 2 children to exit
2016-05-19 03:56:43.198 60891 INFO cinder.openstack.common.service [req-7656ccb5-6c60-46f9-bb48-c341cddecaf5 - - - - -] Child 60921 killed by signal 15
2016-05-19 03:56:43.200 60891 INFO cinder.openstack.common.service [req-7656ccb5-6c60-46f9-bb48-c341cddecaf5 - - - - -] Child 60931 killed by signal 15
2016-05-19 03:56:51.086 14987 WARNING cinder.api [-] The v1 api is deprecated and will be removed in the Liberty release. You should set enable_v1_api=false and enable_v2_api=true i
n your cinder.conf file.
2016-05-19 03:56:51.233 14987 INFO cinder.api.extensions [-] Initializing extension manager.
2016-05-19 03:56:51.235 14987 INFO cinder.api.extensions [-] Loaded extension: os-volume-encryption-metadata
2016-05-19 03:56:51.236 14987 INFO cinder.api.extensions [-] Loaded extension: os-vol-tenant-attr
2016-05-19 03:56:51.236 14987 INFO cinder.api.extensions [-] Loaded extension: scheduler-stats
2016-05-19 03:56:51.238 14987 INFO cinder.api.extensions [-] Loaded extension: os-volume-replication
2016-05-19 03:56:51.239 14987 INFO cinder.api.extensions [-] Loaded extension: os-hosts
2016-05-19 03:56:51.241 14987 INFO cinder.api.extensions [-] Loaded extension: backups
2016-05-19 03:56:51.242 14987 INFO cinder.api.extensions [-] Loaded extension: os-volume-transfer
2016-05-19 03:56:51.243 14987 INFO cinder.api.extensions [-] Loaded extension: encryption
2016-05-19 03:56:51.245 14987 INFO cinder.api.extensions [-] Loaded extension: consistencygroups
2016-05-19 03:56:51.246 14987 INFO cinder.api.extensions [-] Loaded extension: os-volume-manage
2016-05-19 03:56:51.247 14987 INFO cinder.api.extensions [-] Loaded extension: cgsnapshots
2016-05-19 03:56:51.248 14987 INFO cinder.api.extensions [-] Loaded extension: os-admin-actions
2016-05-19 03:56:51.249 14987 INFO cinder.api.extensions [-] Loaded extension: os-types-manage
2016-05-19 03:56:51.250 14987 INFO cinder.api.extensions [-] Loaded extension: os-vol-mig-status-attr
2016-05-19 03:56:51.250 14987 INFO cinder.api.extensions [-] Loaded extension: os-volume-type-access
2016-05-19 03:56:51.251 14987 INFO cinder.api.extensions [-] Loaded extension: os-extended-services
2016-05-19 03:56:51.252 14987 INFO cinder.api.extensions [-] Loaded extension: os-volume-actions
2016-05-19 03:56:51.253 14987 INFO cinder.api.extensions [-] Loaded extension: os-used-limits
2016-05-19 03:56:51.254 14987 INFO cinder.api.extensions [-] Loaded extension: os-image-create
2016-05-19 03:56:51.255 14987 INFO cinder.api.extensions [-] Loaded extension: qos-specs
2016-05-19 03:56:51.256 14987 INFO cinder.api.extensions [-] Loaded extension: os-extended-snapshot-attributes
2016-05-19 03:56:51.257 14987 INFO cinder.api.extensions [-] Loaded extension: os-volume-unmanage
2016-05-19 03:56:51.257 14987 INFO cinder.api.extensions [-] Loaded extension: os-vol-image-meta
2016-05-19 03:56:51.258 14987 INFO cinder.api.extensions [-] Loaded extension: os-quota-class-sets
2016-05-19 03:56:51.259 14987 INFO cinder.api.extensions [-] Loaded extension: os-availability-zone
2016-05-19 03:56:51.260 14987 INFO cinder.api.extensions [-] Loaded extension: os-types-extra-specs
2016-05-19 03:56:51.261 14987 INFO cinder.api.extensions [-] Loaded extension: os-snapshot-actions
2016-05-19 03:56:51.544 14987 INFO cinder.api.extensions [-] Loaded extension: os-quota-sets
2016-05-19 03:56:51.545 14987 INFO cinder.api.extensions [-] Loaded extension: OS-SCH-HNT
2016-05-19 03:56:51.546 14987 INFO cinder.api.extensions [-] Loaded extension: os-services
2016-05-19 03:56:51.547 14987 INFO cinder.api.extensions [-] Loaded extension: os-vol-host-attr
2016-05-19 03:56:51.627 14987 INFO keystoneclient.middleware.auth_token [-] Starting keystone auth_token middleware
2016-05-19 03:56:51.628 14987 WARNING keystoneclient.middleware.auth_token [-] This middleware module is deprecated as of v0.10.0 in favor of keystonemiddleware.auth_token - please
update your WSGI pipeline to reference the new middleware package.
2016-05-19 03:56:51.628 14987 INFO keystoneclient.middleware.auth_token [-] Using /var/cache/cinder/keystone-signing as cache directory for signing certificate
2016-05-19 03:56:51.629 14987 WARNING keystoneclient.middleware.auth_token [-] signing_dir is not owned by 0
2016-05-19 03:56:51.630 14987 WARNING cinder.openstack.common.versionutils [-] Deprecated: RequestBodySizeLimiter() is deprecated as of Kilo in favor of oslo_middleware.RequestBodyS
izeLimiter and may be removed in M.
2016-05-19 03:56:51.631 14987 WARNING cinder.openstack.common.versionutils [-] Deprecated: RequestIdMiddleware() is deprecated as of Kilo in favor of oslo_middleware.RequestId and m
ay be removed in M.
2016-05-19 03:56:51.637 14987 INFO cinder.api.extensions [-] Initializing extension manager.
2016-05-19 03:56:51.638 14987 INFO cinder.api.extensions [-] Loaded extension: os-volume-encryption-metadata
2016-05-19 03:56:51.638 14987 INFO cinder.api.extensions [-] Loaded extension: os-vol-tenant-attr
2016-05-19 03:56:51.639 14987 INFO cinder.api.extensions [-] Loaded extension: scheduler-stats
2016-05-19 03:56:51.640 14987 INFO cinder.api.extensions [-] Loaded extension: os-volume-replication
2016-05-19 03:56:51.640 14987 INFO cinder.api.extensions [-] Loaded extension: os-hosts
2016-05-19 03:56:51.641 14987 INFO cinder.api.extensions [-] Loaded extension: backups
2016-05-19 03:56:51.641 14987 INFO cinder.api.extensions [-] Loaded extension: os-volume-transfer
2016-05-19 03:56:51.642 14987 INFO cinder.api.extensions [-] Loaded extension: encryption
2016-05-19 03:56:51.642 14987 INFO cinder.api.extensions [-] Loaded extension: consistencygroups
2016-05-19 03:56:51.643 14987 INFO cinder.api.extensions [-] Loaded extension: os-volume-manage
2016-05-19 03:56:51.643 14987 INFO cinder.api.extensions [-] Loaded extension: cgsnapshots
2016-05-19 03:56:51.644 14987 INFO cinder.api.extensions [-] Loaded extension: os-admin-actions
2016-05-19 03:56:51.645 14987 INFO cinder.api.extensions [-] Loaded extension: os-types-manage
2016-05-19 03:56:51.645 14987 INFO cinder.api.extensions [-] Loaded extension: os-vol-mig-status-attr
2016-05-19 03:56:51.646 14987 INFO cinder.api.extensions [-] Loaded extension: os-volume-type-access
2016-05-19 03:56:51.646 14987 INFO cinder.api.extensions [-] Loaded extension: os-extended-services
2016-05-19 03:56:51.647 14987 INFO cinder.api.extensions [-] Loaded extension: os-volume-actions
2016-05-19 03:56:51.647 14987 INFO cinder.api.extensions [-] Loaded extension: os-used-limits
2016-05-19 03:56:51.648 14987 INFO cinder.api.extensions [-] Loaded extension: os-image-create
2016-05-19 03:56:51.648 14987 INFO cinder.api.extensions [-] Loaded extension: qos-specs
2016-05-19 03:56:51.649 14987 INFO cinder.api.extensions [-] Loaded extension: os-extended-snapshot-attributes
2016-05-19 03:56:51.650 14987 INFO cinder.api.extensions [-] Loaded extension: os-volume-unmanage
2016-05-19 03:56:51.650 14987 INFO cinder.api.extensions [-] Loaded extension: os-vol-image-meta
2016-05-19 03:56:51.651 14987 INFO cinder.api.extensions [-] Loaded extension: os-quota-class-sets
2016-05-19 03:56:51.651 14987 INFO cinder.api.extensions [-] Loaded extension: os-availability-zone
2016-05-19 03:56:51.652 14987 INFO cinder.api.extensions [-] Loaded extension: os-types-extra-specs
2016-05-19 03:56:51.652 14987 INFO cinder.api.extensions [-] Loaded extension: os-snapshot-actions
2016-05-19 03:56:51.653 14987 INFO cinder.api.extensions [-] Loaded extension: os-quota-sets
2016-05-19 03:56:51.653 14987 INFO cinder.api.extensions [-] Loaded extension: OS-SCH-HNT
2016-05-19 03:56:51.654 14987 INFO cinder.api.extensions [-] Loaded extension: os-services

aging_rabbit".
2016-05-19 03:56:52.237 15006 WARNING oslo_config.cfg [req-20a160eb-7297-470e-8b5a-e814dda56d6d - - - - -] Option "rabbit_password" from group "DEFAULT" is deprecated. Use option "rabbit_password" from group "o
slo_messaging_rabbit".
2016-05-19 03:56:52.238 15006 WARNING oslo_config.cfg [req-20a160eb-7297-470e-8b5a-e814dda56d6d - - - - -] Option "rabbit_userid" from group "DEFAULT" is deprecated. Use option "rabbit_userid" from group "oslo_
messaging_rabbit".
2016-05-19 03:56:52.239 15006 WARNING oslo_config.cfg [req-20a160eb-7297-470e-8b5a-e814dda56d6d - - - - -] Option "lock_path" from group "DEFAULT" is deprecated. Use option "lock_path" from group "oslo_concurre
ncy".
2016-05-19 03:56:52.240 15006 INFO cinder.service [-] Starting cinder-scheduler node (version 2015.1.3)
2016-05-19 03:56:52.257 15006 INFO oslo_messaging._drivers.impl_rabbit [req-0be24f5a-8e8e-4c69-8657-f5e1bf150a4e - - - - -] Connecting to AMQP server on 10.76.8.95:5672
2016-05-19 03:56:52.275 15006 INFO oslo_messaging._drivers.impl_rabbit [req-0be24f5a-8e8e-4c69-8657-f5e1bf150a4e - - - - -] Connected to AMQP server on 10.76.8.95:5672
2016-05-19 03:56:52.287 15006 INFO oslo_messaging._drivers.impl_rabbit [req-9cf4153c-ffc9-4cac-aa1e-b21d8cb301fb - - - - -] Connecting to AMQP server on 10.76.8.95:5672
2016-05-19 03:56:52.302 15006 INFO oslo_messaging._drivers.impl_rabbit [req-9cf4153c-ffc9-4cac-aa1e-b21d8cb301fb - - - - -] Connected to AMQP server on 10.76.8.95:5672
2016-05-19 03:56:52.812 15022 INFO cinder.volume.manager [req-e68e4e4e-6df4-40fe-8487-d5344b9ae51c - - - - -] Determined volume DB was not empty at startup.
2016-05-19 03:56:52.821 15022 WARNING cinder.volume.drivers.lvm [req-e68e4e4e-6df4-40fe-8487-d5344b9ae51c - - - - -] LVMISCSIDriver is deprecated, you should now just use LVMVolumeDriver and specify target_help
er for the target driver you wish to use.
2016-05-19 03:56:52.823 15022 INFO cinder.openstack.common.service [req-e68e4e4e-6df4-40fe-8487-d5344b9ae51c - - - - -] Starting 1 workers
2016-05-19 03:56:52.827 15022 INFO cinder.openstack.common.service [req-e68e4e4e-6df4-40fe-8487-d5344b9ae51c - - - - -] Started child 15051
2016-05-19 03:56:52.833 15051 INFO cinder.service [-] Starting cinder-volume node (version 2015.1.3)
2016-05-19 03:56:52.836 15051 INFO cinder.volume.manager [req-ea4cc97c-846c-4fa1-a90c-05de9947b09f - - - - -] Starting volume driver LVMISCSIDriver (3.0.0)
2016-05-19 03:56:52.890 15022 INFO cinder.volume.manager [req-5e440383-fee5-402a-8362-3bd5311307f2 - - - - -] Determined volume DB was not empty at startup.
2016-05-19 03:56:52.913 15022 INFO cinder.volume.drivers.netapp.common [req-5e440383-fee5-402a-8362-3bd5311307f2 - - - - -] OpenStack OS Version Info: '2015.1.3~a0~dev16|9.1|obs.wdf.sap.corp'|Linux-3.12.55-52.4
2-default-x86_64-with-SuSE-12-x86_64
2016-05-19 03:56:52.914 15022 INFO cinder.volume.drivers.netapp.common [req-5e440383-fee5-402a-8362-3bd5311307f2 - - - - -] Requested unified config: ontap_cluster and nfs.
2016-05-19 03:56:52.936 15022 INFO cinder.volume.drivers.netapp.common [req-5e440383-fee5-402a-8362-3bd5311307f2 - - - - -] NetApp driver of family ontap_cluster and protocol nfs loaded.
2016-05-19 03:56:52.938 15022 INFO cinder.openstack.common.service [req-5e440383-fee5-402a-8362-3bd5311307f2 - - - - -] Starting 1 workers
2016-05-19 03:56:52.942 15022 INFO cinder.openstack.common.service [req-5e440383-fee5-402a-8362-3bd5311307f2 - - - - -] Started child 15061
2016-05-19 03:56:52.947 15061 INFO cinder.service [-] Starting cinder-volume node (version 2015.1.3)
2016-05-19 03:56:52.951 15061 INFO cinder.volume.manager [req-5b751b89-5625-474e-9d1b-9c1ae99f8bc1 - - - - -] Starting volume driver NetAppCmodeNfsDriver (1.0.0)
2016-05-19 03:56:52.953 15022 WARNING oslo_config.cfg [req-5e440383-fee5-402a-8362-3bd5311307f2 - - - - -] Option "rabbit_host" from group "DEFAULT" is deprecated. Use option "rabbit_host" from group "oslo_mess
aging_rabbit".
2016-05-19 03:56:52.953 15022 WARNING oslo_config.cfg [req-5e440383-fee5-402a-8362-3bd5311307f2 - - - - -] Option "rabbit_port" from group "DEFAULT" is deprecated. Use option "rabbit_port" from group "oslo_mess
aging_rabbit".
2016-05-19 03:56:52.954 15022 WARNING oslo_config.cfg [req-5e440383-fee5-402a-8362-3bd5311307f2 - - - - -] Option "rabbit_password" from group "DEFAULT" is deprecated. Use option "rabbit_password" from group "o
slo_messaging_rabbit".
2016-05-19 03:56:52.954 15022 WARNING oslo_config.cfg [req-5e440383-fee5-402a-8362-3bd5311307f2 - - - - -] Option "rabbit_userid" from group "DEFAULT" is deprecated. Use option "rabbit_userid" from group "oslo_
messaging_rabbit".
2016-05-19 03:56:52.961 15022 WARNING oslo_config.cfg [req-5e440383-fee5-402a-8362-3bd5311307f2 - - - - -] Option "lock_path" from group "DEFAULT" is deprecated. Use option "lock_path" from group "oslo_concurre
ncy".
2016-05-19 03:56:52.977 15061 INFO cinder.brick.remotefs.remotefs [req-5b751b89-5625-474e-9d1b-9c1ae99f8bc1 - - - - -] Already mounted: /var/lib/cinder/mnt/751a2c4603d493faacc8fcb997c22abd
2016-05-19 03:56:52.979 15061 WARNING cinder.volume.drivers.nfs [req-5b751b89-5625-474e-9d1b-9c1ae99f8bc1 - - - - -] The NAS file permissions mode will be 666 (allowing other/world read & write access). This is
considered an insecure NAS environment. Please see http://docs.openstack.org/admin-guide-cloud/content/nfs_backend.html for information on a secure NFS configuration.
2016-05-19 03:56:52.981 15061 WARNING cinder.volume.drivers.nfs [req-5b751b89-5625-474e-9d1b-9c1ae99f8bc1 - - - - -] The NAS file operations will be run as root: allowing root level access at the storage backen
d. This is considered an insecure NAS environment. Please see http://docs.openstack.org/admin-guide-cloud/content/nfs_backend.html for information on a secure NAS configuration.
2016-05-19 03:56:53.108 15051 INFO cinder.volume.manager [req-ea4cc97c-846c-4fa1-a90c-05de9947b09f - - - - -] Updating volume status
2016-05-19 03:56:53.235 15051 WARNING oslo_config.cfg [req-ea4cc97c-846c-4fa1-a90c-05de9947b09f - - - - -] Option "rabbit_host" from group "DEFAULT" is deprecated. Use option "rabbit_host" from group "oslo_mess
aging_rabbit".
2016-05-19 03:56:53.236 15051 WARNING oslo_config.cfg [req-ea4cc97c-846c-4fa1-a90c-05de9947b09f - - - - -] Option "rabbit_port" from group "DEFAULT" is deprecated. Use option "rabbit_port" from group "oslo_mess
aging_rabbit".
2016-05-19 03:56:53.237 15051 WARNING oslo_config.cfg [req-ea4cc97c-846c-4fa1-a90c-05de9947b09f - - - - -] Option "rabbit_userid" from group "DEFAULT" is deprecated. Use option "rabbit_userid" from group "oslo_
messaging_rabbit".
2016-05-19 03:56:53.238 15051 WARNING oslo_config.cfg [req-ea4cc97c-846c-4fa1-a90c-05de9947b09f - - - - -] Option "rabbit_password" from group "DEFAULT" is deprecated. Use option "rabbit_password" from group "o
slo_messaging_rabbit".
2016-05-19 03:56:53.245 15051 INFO oslo_messaging._drivers.impl_rabbit [req-ea4cc97c-846c-4fa1-a90c-05de9947b09f - - - - -] Connecting to AMQP server on 10.76.8.95:5672
2016-05-19 03:56:53.264 15051 INFO oslo_messaging._drivers.impl_rabbit [req-ea4cc97c-846c-4fa1-a90c-05de9947b09f - - - - -] Connected to AMQP server on 10.76.8.95:5672
2016-05-19 03:56:53.404 15051 INFO oslo_messaging._drivers.impl_rabbit [req-37f64b76-c09d-4bc8-8dab-acf2f45c8e7c - - - - -] Connecting to AMQP server on 10.76.8.95:5672
2016-05-19 03:56:53.420 15051 INFO oslo_messaging._drivers.impl_rabbit [req-37f64b76-c09d-4bc8-8dab-acf2f45c8e7c - - - - -] Connected to AMQP server on 10.76.8.95:5672
2016-05-19 03:56:59.252 15034 INFO eventlet.wsgi.server [-] (15034) accepted ('10.76.8.95', 33710)
2016-05-19 03:56:59.288 15034 INFO keystoneclient.middleware.auth_token [-] Auth Token confirmed use of v2.0 apis
2016-05-19 03:56:59.714 15034 INFO cinder.api.openstack.wsgi [req-1fd895e1-2927-4c20-a869-93e007a5b03a f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v1/499b
c5c54b244601babbc7fb29787834/os-services
2016-05-19 03:56:59.955 15034 INFO cinder.api.openstack.wsgi [req-1fd895e1-2927-4c20-a869-93e007a5b03a f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v1/499bc5c5
4b244601babbc7fb29787834/os-services returned with HTTP 200
2016-05-19 03:56:59.956 15034 INFO eventlet.wsgi.server [req-1fd895e1-2927-4c20-a869-93e007a5b03a f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:56:59] "
GET /v1/499bc5c54b244601babbc7fb29787834/os-services HTTP/1.1" 200 809 0.703131
2016-05-19 03:57:33.745 15037 INFO eventlet.wsgi.server [-] (15037) accepted ('10.76.8.95', 33729)
2016-05-19 03:57:33.786 15037 INFO keystoneclient.middleware.auth_token [-] Auth Token confirmed use of v2.0 apis
2016-05-19 03:57:34.213 15037 INFO cinder.api.openstack.wsgi [req-72f8940d-9f25-483c-be1b-425504867808 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/limits
2016-05-19 03:57:34.464 15037 WARNING cinder.quota [req-a6893318-1f8f-4195-a246-a9f10dd451ac - - - - -] Deprecated: Default quota for resource: snapshots_NetApp is set by the default quota flag: quota_snapshots
_NetApp, it is now deprecated. Please use the default quota class for default quota.
2016-05-19 03:57:34.466 15037 WARNING cinder.quota [req-a6893318-1f8f-4195-a246-a9f10dd451ac - - - - -] Deprecated: Default quota for resource: backup_gigabytes is set by the default quota flag: quota_backup_gi
gabytes, it is now deprecated. Please use the default quota class for default quota.
2016-05-19 03:57:34.467 15037 WARNING cinder.quota [req-a6893318-1f8f-4195-a246-a9f10dd451ac - - - - -] Deprecated: Default quota for resource: volumes_NetApp is set by the default quota flag: quota_volumes_Net
App, it is now deprecated. Please use the default quota class for default quota.
2016-05-19 03:57:34.468 15037 WARNING cinder.quota [req-a6893318-1f8f-4195-a246-a9f10dd451ac - - - - -] Deprecated: Default quota for resource: backups is set by the default quota flag: quota_backups, it is now
deprecated. Please use the default quota class for default quota.
2016-05-19 03:57:34.469 15037 WARNING cinder.quota [req-a6893318-1f8f-4195-a246-a9f10dd451ac - - - - -] Deprecated: Default quota for resource: gigabytes_NetApp is set by the default quota flag: quota_gigabytes
_NetApp, it is now deprecated. Please use the default quota class for default quota.
2016-05-19 03:57:34.490 15037 INFO cinder.api.openstack.wsgi [req-204e5dc6-f1cf-43f6-aebd-951984aeed49 - - - - -] http://10.76.8.95:8776/v2/499bc5c54b244601babbc7fb29787834/limits returned with HTTP 200
2016-05-19 03:57:34.491 15037 INFO eventlet.wsgi.server [req-204e5dc6-f1cf-43f6-aebd-951984aeed49 - - - - -] 10.76.8.95 - - [19/May/2016 03:57:34] "GET /v2/499bc5c54b244601babbc7fb29787834/limits HTTP/1.1" 200
568 0.743255
2016-05-19 03:57:39.060 15032 INFO eventlet.wsgi.server [-] (15032) accepted ('10.76.8.95', 33738)
2016-05-19 03:57:39.098 15032 INFO keystoneclient.middleware.auth_token [-] Auth Token confirmed use of v2.0 apis
2016-05-19 03:57:39.511 15032 INFO cinder.api.openstack.wsgi [req-96fda48a-89b0-4473-9ba8-29a1d5a3b8cb f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/os-volume-transfer/detail
2016-05-19 03:57:39.760 15032 INFO cinder.api.openstack.wsgi [req-96fda48a-89b0-4473-9ba8-29a1d5a3b8cb f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c

4b244601babbc7fb29787834/os-volume-transfer/detail returned with HTTP 200
2016-05-19 03:57:39.761 15032 INFO eventlet.wsgi.server [req-96fda48a-89b0-4473-9ba8-29a1d5a3b8cb f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:57:39] "
GET /v2/499bc5c54b244601babbc7fb29787834/os-volume-transfer/detail HTTP/1.1" 200 279 0.699348
2016-05-19 03:57:39.767 15032 INFO eventlet.wsgi.server [-] (15032) accepted ('10.76.8.95', 33742)
2016-05-19 03:57:39.770 15032 INFO cinder.api.openstack.wsgi [req-a7afbc5a-641d-4341-8dda-1ea2f754a56b f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/volumes/detail?all_tenants=True
2016-05-19 03:57:39.816 15032 INFO cinder.api.openstack.wsgi [req-a7afbc5a-641d-4341-8dda-1ea2f754a56b f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/volumes/detail?all_tenants=True returned with HTTP 200
2016-05-19 03:57:39.817 15032 INFO eventlet.wsgi.server [req-a7afbc5a-641d-4341-8dda-1ea2f754a56b f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:57:39] "
GET /v2/499bc5c54b244601babbc7fb29787834/volumes/detail?all_tenants=True HTTP/1.1" 200 4379 0.048678
2016-05-19 03:57:40.042 15033 INFO eventlet.wsgi.server [-] (15033) accepted ('10.76.8.95', 33745)
2016-05-19 03:57:40.082 15033 INFO keystoneclient.middleware.auth_token [-] Auth Token confirmed use of v2.0 apis
2016-05-19 03:57:40.525 15033 INFO cinder.api.openstack.wsgi [req-289266b7-8d55-4a90-aa34-17ac3dbfc2d7 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/snapshots/detail?all_tenants=True
2016-05-19 03:57:40.761 15033 INFO cinder.api.openstack.wsgi [req-289266b7-8d55-4a90-aa34-17ac3dbfc2d7 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/snapshots/detail?all_tenants=True returned with HTTP 200
2016-05-19 03:57:40.763 15033 INFO eventlet.wsgi.server [req-289266b7-8d55-4a90-aa34-17ac3dbfc2d7 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:57:40] "
GET /v2/499bc5c54b244601babbc7fb29787834/snapshots/detail?all_tenants=True HTTP/1.1" 200 279 0.718860
2016-05-19 03:57:45.794 15034 INFO eventlet.wsgi.server [-] (15034) accepted ('10.76.8.95', 33750)
2016-05-19 03:57:45.815 15034 INFO keystoneclient.middleware.auth_token [-] Auth Token confirmed use of v2.0 apis
2016-05-19 03:57:46.223 15034 INFO cinder.api.openstack.wsgi [req-0210d778-6e77-41a8-ae21-267799ee04ef f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/types
2016-05-19 03:57:46.236 15034 INFO cinder.api.openstack.wsgi [req-0210d778-6e77-41a8-ae21-267799ee04ef f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/types returned with HTTP 200
2016-05-19 03:57:46.237 15034 INFO eventlet.wsgi.server [req-0210d778-6e77-41a8-ae21-267799ee04ef f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:57:46] "
GET /v2/499bc5c54b244601babbc7fb29787834/types HTTP/1.1" 200 466 0.441240
2016-05-19 03:57:46.243 15034 INFO eventlet.wsgi.server [-] (15034) accepted ('10.76.8.95', 33754)
2016-05-19 03:57:46.247 15034 INFO cinder.api.openstack.wsgi [req-76de2d91-8e00-4462-8095-462bf7da81a9 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/qos-specs
2016-05-19 03:57:46.254 15034 INFO cinder.api.openstack.wsgi [req-76de2d91-8e00-4462-8095-462bf7da81a9 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/qos-specs returned with HTTP 200
2016-05-19 03:57:46.255 15034 INFO eventlet.wsgi.server [req-76de2d91-8e00-4462-8095-462bf7da81a9 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:57:46] "
GET /v2/499bc5c54b244601babbc7fb29787834/qos-specs HTTP/1.1" 200 279 0.011060
2016-05-19 03:57:46.257 15034 INFO eventlet.wsgi.server [-] (15034) accepted ('10.76.8.95', 33755)
2016-05-19 03:57:46.260 15034 INFO cinder.api.openstack.wsgi [req-15aa988e-d8c0-4d32-a67c-1be9abd57972 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/types
2016-05-19 03:57:46.269 15034 INFO cinder.api.openstack.wsgi [req-15aa988e-d8c0-4d32-a67c-1be9abd57972 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/types returned with HTTP 200
2016-05-19 03:57:46.269 15034 INFO eventlet.wsgi.server [req-15aa988e-d8c0-4d32-a67c-1be9abd57972 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:57:46] "
GET /v2/499bc5c54b244601babbc7fb29787834/types HTTP/1.1" 200 466 0.011362
2016-05-19 03:57:46.274 15034 INFO eventlet.wsgi.server [-] (15034) accepted ('10.76.8.95', 33756)
2016-05-19 03:57:46.277 15034 INFO cinder.api.openstack.wsgi [req-2ab1f025-a14a-40f0-9865-1e53037a7e17 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/types/42721fc2-7208-4b5c-83ec-4b443c7a1d76/encryption
2016-05-19 03:57:46.292 15034 INFO cinder.api.openstack.wsgi [req-2ab1f025-a14a-40f0-9865-1e53037a7e17 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/types/42721fc2-7208-4b5c-83ec-4b443c7a1d76/encryption returned with HTTP 200
2016-05-19 03:57:46.292 15034 INFO eventlet.wsgi.server [req-2ab1f025-a14a-40f0-9865-1e53037a7e17 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:57:46] "
GET /v2/499bc5c54b244601babbc7fb29787834/types/42721fc2-7208-4b5c-83ec-4b443c7a1d76/encryption HTTP/1.1" 200 263 0.018071
2016-05-19 03:57:46.296 15034 INFO eventlet.wsgi.server [-] (15034) accepted ('10.76.8.95', 33757)
2016-05-19 03:57:46.300 15034 INFO cinder.api.openstack.wsgi [req-be49dcc4-86dc-4dc8-91d3-16c1f3dee18d f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/qos-specs
2016-05-19 03:57:46.306 15034 INFO cinder.api.openstack.wsgi [req-be49dcc4-86dc-4dc8-91d3-16c1f3dee18d f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/qos-specs returned with HTTP 200
2016-05-19 03:57:46.307 15034 INFO eventlet.wsgi.server [req-be49dcc4-86dc-4dc8-91d3-16c1f3dee18d f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:57:46] "
GET /v2/499bc5c54b244601babbc7fb29787834/qos-specs HTTP/1.1" 200 279 0.009792
2016-05-19 03:57:46.465 15036 INFO eventlet.wsgi.server [-] (15036) accepted ('10.76.8.95', 33760)
2016-05-19 03:57:46.506 15036 INFO keystoneclient.middleware.auth_token [-] Auth Token confirmed use of v2.0 apis
2016-05-19 03:57:47.015 15036 INFO cinder.api.openstack.wsgi [req-eb814961-7876-4728-8bf5-a9045e0e8e8a f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/extensions

4b244601babbc7fb29787834/extensions returned with HTTP 200
2016-05-19 03:57:47.019 15036 INFO eventlet.wsgi.server [req-eb814961-7876-4728-8bf5-a9045e0e8e8a f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:57:47] "
GET /v2/499bc5c54b244601babbc7fb29787834/extensions HTTP/1.1" 200 7809 0.551761
2016-05-19 03:57:52.277 15036 INFO eventlet.wsgi.server [-] (15036) accepted ('10.76.8.95', 33764)
2016-05-19 03:57:52.281 15036 INFO cinder.api.openstack.wsgi [req-94c3ccbb-ff6c-4acf-9376-73845c235b9f f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/types/42721fc2-7208-4b5c-83ec-4b443c7a1d76
2016-05-19 03:57:52.524 15036 INFO cinder.api.openstack.wsgi [req-94c3ccbb-ff6c-4acf-9376-73845c235b9f f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/types/42721fc2-7208-4b5c-83ec-4b443c7a1d76 returned with HTTP 200
2016-05-19 03:57:52.525 15036 INFO eventlet.wsgi.server [req-94c3ccbb-ff6c-4acf-9376-73845c235b9f f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:57:52] "
GET /v2/499bc5c54b244601babbc7fb29787834/types/42721fc2-7208-4b5c-83ec-4b443c7a1d76 HTTP/1.1" 200 463 0.247614
2016-05-19 03:57:52.531 15032 INFO eventlet.wsgi.server [-] (15032) accepted ('10.76.8.95', 33765)
2016-05-19 03:57:52.539 15032 INFO cinder.api.openstack.wsgi [req-debb2cb2-dd75-44ee-8b73-a11c26357236 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/types/42721fc2-7208-4b5c-83ec-4b443c7a1d76/extra_specs
2016-05-19 03:57:52.558 15032 INFO cinder.api.openstack.wsgi [req-debb2cb2-dd75-44ee-8b73-a11c26357236 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/types/42721fc2-7208-4b5c-83ec-4b443c7a1d76/extra_specs returned with HTTP 200
2016-05-19 03:57:52.559 15032 INFO eventlet.wsgi.server [req-debb2cb2-dd75-44ee-8b73-a11c26357236 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:57:52] "
GET /v2/499bc5c54b244601babbc7fb29787834/types/42721fc2-7208-4b5c-83ec-4b443c7a1d76/extra_specs HTTP/1.1" 200 319 0.026389
2016-05-19 03:57:52.563 15032 INFO eventlet.wsgi.server [-] (15032) accepted ('10.76.8.95', 33766)
2016-05-19 03:57:52.566 15032 INFO cinder.api.openstack.wsgi [req-1eebcf7b-45bc-4b1f-8902-a4ea704d7bc5 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/types/42721fc2-7208-4b5c-83ec-4b443c7a1d76
2016-05-19 03:57:52.578 15032 INFO cinder.api.openstack.wsgi [req-1eebcf7b-45bc-4b1f-8902-a4ea704d7bc5 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/types/42721fc2-7208-4b5c-83ec-4b443c7a1d76 returned with HTTP 200
2016-05-19 03:57:52.579 15032 INFO eventlet.wsgi.server [req-1eebcf7b-45bc-4b1f-8902-a4ea704d7bc5 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:57:52] "
GET /v2/499bc5c54b244601babbc7fb29787834/types/42721fc2-7208-4b5c-83ec-4b443c7a1d76 HTTP/1.1" 200 463 0.015193
2016-05-19 03:58:02.048 15033 INFO eventlet.wsgi.server [-] (15033) accepted ('10.76.8.95', 33767)
2016-05-19 03:58:02.058 15033 INFO cinder.api.openstack.wsgi [req-888f04df-6222-4c83-962f-19ba0e4a81e1 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/os-volume-transfer/detail
2016-05-19 03:58:02.065 15033 INFO cinder.api.openstack.wsgi [req-888f04df-6222-4c83-962f-19ba0e4a81e1 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/os-volume-transfer/detail returned with HTTP 200
2016-05-19 03:58:02.066 15033 INFO eventlet.wsgi.server [req-888f04df-6222-4c83-962f-19ba0e4a81e1 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:58:02] "
GET /v2/499bc5c54b244601babbc7fb29787834/os-volume-transfer/detail HTTP/1.1" 200 279 0.016636
2016-05-19 03:58:02.072 15032 INFO eventlet.wsgi.server [-] (15032) accepted ('10.76.8.95', 33768)
2016-05-19 03:58:02.078 15032 INFO cinder.api.openstack.wsgi [req-e5103f79-f4a2-4a48-a436-adabc145dcea f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/volumes/detail
2016-05-19 03:58:02.119 15032 INFO cinder.api.openstack.wsgi [req-e5103f79-f4a2-4a48-a436-adabc145dcea f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/volumes/detail returned with HTTP 200
2016-05-19 03:58:02.119 15032 INFO eventlet.wsgi.server [req-e5103f79-f4a2-4a48-a436-adabc145dcea f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:58:02] "
GET /v2/499bc5c54b244601babbc7fb29787834/volumes/detail HTTP/1.1" 200 4379 0.046269
2016-05-19 03:58:02.370 15037 INFO eventlet.wsgi.server [-] (15037) accepted ('10.76.8.95', 33771)
2016-05-19 03:58:02.378 15037 INFO cinder.api.openstack.wsgi [req-f6204687-feb9-4d8f-b653-96d148c67f58 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/snapshots/detail
2016-05-19 03:58:02.392 15037 INFO cinder.api.openstack.wsgi [req-f6204687-feb9-4d8f-b653-96d148c67f58 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/snapshots/detail returned with HTTP 200
2016-05-19 03:58:02.393 15037 INFO eventlet.wsgi.server [req-f6204687-feb9-4d8f-b653-96d148c67f58 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:58:02] "
GET /v2/499bc5c54b244601babbc7fb29787834/snapshots/detail HTTP/1.1" 200 279 0.020814
2016-05-19 03:58:02.460 15036 INFO eventlet.wsgi.server [-] (15036) accepted ('10.76.8.95', 33772)
2016-05-19 03:58:02.464 15036 INFO cinder.api.openstack.wsgi [req-e1c84e97-2968-4bb7-bf26-d779ce6a8699 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/limits
2016-05-19 03:58:02.481 15036 WARNING cinder.quota [req-327d7326-95c6-4d72-9884-161bf9dae61d - - - - -] Deprecated: Default quota for resource: snapshots_NetApp is set by the default quota flag: quota_snapshots
_NetApp, it is now deprecated. Please use the default quota class for default quota.
2016-05-19 03:58:02.482 15036 WARNING cinder.quota [req-327d7326-95c6-4d72-9884-161bf9dae61d - - - - -] Deprecated: Default quota for resource: backup_gigabytes is set by the default quota flag: quota_backup_gi
gabytes, it is now deprecated. Please use the default quota class for default quota.
2016-05-19 03:58:02.483 15036 WARNING cinder.quota [req-327d7326-95c6-4d72-9884-161bf9dae61d - - - - -] Deprecated: Default quota for resource: volumes_NetApp is set by the default quota flag: quota_volumes_Net
App, it is now deprecated. Please use the default quota class for default quota.
2016-05-19 03:58:02.484 15036 WARNING cinder.quota [req-327d7326-95c6-4d72-9884-161bf9dae61d - - - - -] Deprecated: Default quota for resource: backups is set by the default quota flag: quota_backups, it is now
deprecated. Please use the default quota class for default quota.
2016-05-19 03:58:02.485 15036 WARNING cinder.quota [req-327d7326-95c6-4d72-9884-161bf9dae61d - - - - -] Deprecated: Default quota for resource: gigabytes_NetApp is set by the default quota flag: quota_gigabytes
_NetApp, it is now deprecated. Please use the default quota class for default quota.
2016-05-19 03:58:02.505 15036 INFO cinder.api.openstack.wsgi [req-6ed2c759-e8be-4128-ac99-4d7bdf41c401 - - - - -] http://10.76.8.95:8776/v2/499bc5c54b244601babbc7fb29787834/limits returned with HTTP 200

2016-05-19 03:58:02.506 15036 INFO eventlet.wsgi.server [req-6ed2c759-e8be-4128-ac99-4d7bdf41c401 - - - - -] 10.76.8.95 - - [19/May/2016 03:58:02] "GET /v2/499bc5c54b244601babbc7fb29787834/limits HTTP/1.1" 200
568 0.044595
2016-05-19 03:58:07.292 15034 INFO eventlet.wsgi.server [-] (15034) accepted ('10.76.8.95', 33774)
2016-05-19 03:58:07.298 15034 INFO cinder.api.openstack.wsgi [req-0445f787-ca5c-4568-bc4d-75e0932d9bcb f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/types
2016-05-19 03:58:07.314 15034 INFO cinder.api.openstack.wsgi [req-0445f787-ca5c-4568-bc4d-75e0932d9bcb f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/types returned with HTTP 200
2016-05-19 03:58:07.314 15034 INFO eventlet.wsgi.server [req-0445f787-ca5c-4568-bc4d-75e0932d9bcb f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:58:07] "
GET /v2/499bc5c54b244601babbc7fb29787834/types HTTP/1.1" 200 466 0.021068
2016-05-19 03:58:07.320 15032 INFO eventlet.wsgi.server [-] (15032) accepted ('10.76.8.95', 33775)
2016-05-19 03:58:07.327 15032 INFO cinder.api.openstack.wsgi [req-4582c8c4-8dc0-4200-b7ad-238bba237839 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/extensions
2016-05-19 03:58:07.330 15032 INFO cinder.api.openstack.wsgi [req-4582c8c4-8dc0-4200-b7ad-238bba237839 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/extensions returned with HTTP 200
2016-05-19 03:58:07.331 15032 INFO eventlet.wsgi.server [req-4582c8c4-8dc0-4200-b7ad-238bba237839 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:58:07] "
GET /v2/499bc5c54b244601babbc7fb29787834/extensions HTTP/1.1" 200 7809 0.009138
2016-05-19 03:58:07.527 15036 INFO eventlet.wsgi.server [-] (15036) accepted ('10.76.8.95', 33776)
2016-05-19 03:58:07.536 15036 INFO cinder.api.openstack.wsgi [req-b7f23654-eafd-41f0-81f3-03d8f86aa35f f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/os-availability-zone
2016-05-19 03:58:07.548 15036 INFO cinder.api.openstack.wsgi [req-1ab65e52-36de-40f8-b5b2-4c87a4ba839d - - - - -] http://10.76.8.95:8776/v2/499bc5c54b244601babbc7fb29787834/os-availability-zone returned with HT
TP 200
2016-05-19 03:58:07.549 15036 INFO eventlet.wsgi.server [req-1ab65e52-36de-40f8-b5b2-4c87a4ba839d - - - - -] 10.76.8.95 - - [19/May/2016 03:58:07] "GET /v2/499bc5c54b244601babbc7fb29787834/os-availability-zone
HTTP/1.1" 200 344 0.019795
2016-05-19 03:58:07.554 15033 INFO eventlet.wsgi.server [-] (15033) accepted ('10.76.8.95', 33777)
2016-05-19 03:58:07.558 15033 INFO cinder.api.openstack.wsgi [req-92051fcc-45a6-48f1-835e-47be8e272e1c f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/snapshots/detail?status=available
2016-05-19 03:58:07.568 15033 INFO cinder.api.openstack.wsgi [req-92051fcc-45a6-48f1-835e-47be8e272e1c f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/snapshots/detail?status=available returned with HTTP 200
2016-05-19 03:58:07.569 15033 INFO eventlet.wsgi.server [req-92051fcc-45a6-48f1-835e-47be8e272e1c f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:58:07] "
GET /v2/499bc5c54b244601babbc7fb29787834/snapshots/detail?status=available HTTP/1.1" 200 279 0.014042
2016-05-19 03:58:07.871 15033 INFO eventlet.wsgi.server [-] (15033) accepted ('10.76.8.95', 33782)
2016-05-19 03:58:07.880 15033 INFO cinder.api.openstack.wsgi [req-6087dddb-05e1-479c-b53b-b59ae9f7b87c f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/os-volume-transfer/detail
2016-05-19 03:58:07.888 15033 INFO cinder.api.openstack.wsgi [req-6087dddb-05e1-479c-b53b-b59ae9f7b87c f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/os-volume-transfer/detail returned with HTTP 200
2016-05-19 03:58:07.889 15033 INFO eventlet.wsgi.server [req-6087dddb-05e1-479c-b53b-b59ae9f7b87c f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:58:07] "
GET /v2/499bc5c54b244601babbc7fb29787834/os-volume-transfer/detail HTTP/1.1" 200 279 0.017021
2016-05-19 03:58:07.895 15037 INFO eventlet.wsgi.server [-] (15037) accepted ('10.76.8.95', 33783)
2016-05-19 03:58:07.902 15037 INFO cinder.api.openstack.wsgi [req-c383acc7-c11d-4ca3-8815-90dc8b99aac9 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/volumes/detail?status=available
2016-05-19 03:58:07.950 15037 INFO cinder.api.openstack.wsgi [req-c383acc7-c11d-4ca3-8815-90dc8b99aac9 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/volumes/detail?status=available returned with HTTP 200
2016-05-19 03:58:07.951 15037 INFO eventlet.wsgi.server [req-c383acc7-c11d-4ca3-8815-90dc8b99aac9 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:58:07] "
GET /v2/499bc5c54b244601babbc7fb29787834/volumes/detail?status=available HTTP/1.1" 200 2349 0.054587
2016-05-19 03:58:08.171 15037 INFO eventlet.wsgi.server [-] (15037) accepted ('10.76.8.95', 33786)
2016-05-19 03:58:08.179 15037 INFO cinder.api.openstack.wsgi [req-7d952b20-2054-400a-9917-3d85f5537923 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/limits
2016-05-19 03:58:08.219 15037 INFO cinder.api.openstack.wsgi [req-400bc5d7-f6ad-40db-8817-13dd71668dd0 - - - - -] http://10.76.8.95:8776/v2/499bc5c54b244601babbc7fb29787834/limits returned with HTTP 200
2016-05-19 03:58:08.220 15037 INFO eventlet.wsgi.server [req-400bc5d7-f6ad-40db-8817-13dd71668dd0 - - - - -] 10.76.8.95 - - [19/May/2016 03:58:08] "GET /v2/499bc5c54b244601babbc7fb29787834/limits HTTP/1.1" 200
568 0.046906
2016-05-19 03:58:08.225 15037 INFO eventlet.wsgi.server [-] (15037) accepted ('10.76.8.95', 33787)
2016-05-19 03:58:08.229 15037 INFO cinder.api.openstack.wsgi [req-1572b599-667c-40da-af09-b1feaa5a9fce f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/os-volume-transfer/detail
2016-05-19 03:58:08.234 15037 INFO cinder.api.openstack.wsgi [req-1572b599-667c-40da-af09-b1feaa5a9fce f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/os-volume-transfer/detail returned with HTTP 200
2016-05-19 03:58:08.234 15037 INFO eventlet.wsgi.server [req-1572b599-667c-40da-af09-b1feaa5a9fce f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:58:08] "
GET /v2/499bc5c54b244601babbc7fb29787834/os-volume-transfer/detail HTTP/1.1" 200 279 0.009122
2016-05-19 03:58:08.239 15037 INFO eventlet.wsgi.server [-] (15037) accepted ('10.76.8.95', 33788)
2016-05-19 03:58:08.241 15037 INFO cinder.api.openstack.wsgi [req-b8cec33f-e34b-4072-b83f-1c4953ee76e1 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b

2016-05-19 03:58:33.762 15033 WARNING cinder.quota [req-20327777-dba7-4807-ab86-f6fe488cfaea - - - - -] Deprecated: Default quota for resource: backup_gigabytes is set by the default quota flag: quota_backup_gi
gabytes, it is now deprecated. Please use the default quota class for default quota.
2016-05-19 03:58:33.763 15033 WARNING cinder.quota [req-20327777-dba7-4807-ab86-f6fe488cfaea - - - - -] Deprecated: Default quota for resource: volumes_NetApp is set by the default quota flag: quota_volumes_Net
App, it is now deprecated. Please use the default quota class for default quota.
2016-05-19 03:58:33.765 15033 WARNING cinder.quota [req-20327777-dba7-4807-ab86-f6fe488cfaea - - - - -] Deprecated: Default quota for resource: backups is set by the default quota flag: quota_backups, it is now
deprecated. Please use the default quota class for default quota.
2016-05-19 03:58:33.766 15033 WARNING cinder.quota [req-20327777-dba7-4807-ab86-f6fe488cfaea - - - - -] Deprecated: Default quota for resource: gigabytes_NetApp is set by the default quota flag: quota_gigabytes
_NetApp, it is now deprecated. Please use the default quota class for default quota.
2016-05-19 03:58:33.785 15033 INFO cinder.api.openstack.wsgi [req-c58274ab-1f36-4fa3-8232-90d8b77fbbd7 - - - - -] http://10.76.8.95:8776/v2/499bc5c54b244601babbc7fb29787834/limits returned with HTTP 200
2016-05-19 03:58:33.786 15033 INFO eventlet.wsgi.server [req-c58274ab-1f36-4fa3-8232-90d8b77fbbd7 - - - - -] 10.76.8.95 - - [19/May/2016 03:58:33] "GET /v2/499bc5c54b244601babbc7fb29787834/limits HTTP/1.1" 200
568 0.046877
2016-05-19 03:58:33.789 15033 INFO eventlet.wsgi.server [-] (15033) accepted ('10.76.8.95', 33805)
2016-05-19 03:58:33.793 15033 INFO cinder.api.openstack.wsgi [req-2849e5ae-d0a6-4cfa-9c4c-687c3db2a05b f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/os-volume-transfer/detail
2016-05-19 03:58:33.797 15033 INFO cinder.api.openstack.wsgi [req-2849e5ae-d0a6-4cfa-9c4c-687c3db2a05b f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/os-volume-transfer/detail returned with HTTP 200
2016-05-19 03:58:33.797 15033 INFO eventlet.wsgi.server [req-2849e5ae-d0a6-4cfa-9c4c-687c3db2a05b f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:58:33] "
GET /v2/499bc5c54b244601babbc7fb29787834/os-volume-transfer/detail HTTP/1.1" 200 279 0.007735
2016-05-19 03:58:33.800 15033 INFO eventlet.wsgi.server [-] (15033) accepted ('10.76.8.95', 33806)
2016-05-19 03:58:33.803 15033 INFO cinder.api.openstack.wsgi [req-335de376-4ef6-4591-a8b4-55cdb1e989c6 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/volumes/detail
2016-05-19 03:58:33.836 15033 INFO cinder.api.openstack.wsgi [req-335de376-4ef6-4591-a8b4-55cdb1e989c6 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/volumes/detail returned with HTTP 200
2016-05-19 03:58:33.836 15033 INFO eventlet.wsgi.server [req-335de376-4ef6-4591-a8b4-55cdb1e989c6 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:58:33] "
GET /v2/499bc5c54b244601babbc7fb29787834/volumes/detail HTTP/1.1" 200 4379 0.035607
2016-05-19 03:58:33.840 15033 INFO eventlet.wsgi.server [-] (15033) accepted ('10.76.8.95', 33807)
2016-05-19 03:58:33.842 15033 INFO cinder.api.openstack.wsgi [req-3ba192b9-881a-499a-a293-200f6e73c77b f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/snapshots/detail
2016-05-19 03:58:33.849 15033 INFO cinder.api.openstack.wsgi [req-3ba192b9-881a-499a-a293-200f6e73c77b f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/snapshots/detail returned with HTTP 200
2016-05-19 03:58:33.850 15033 INFO eventlet.wsgi.server [req-3ba192b9-881a-499a-a293-200f6e73c77b f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:58:33] "
GET /v2/499bc5c54b244601babbc7fb29787834/snapshots/detail HTTP/1.1" 200 279 0.009599
2016-05-19 03:58:33.853 15033 INFO eventlet.wsgi.server [-] (15033) accepted ('10.76.8.95', 33808)
2016-05-19 03:58:33.856 15033 INFO cinder.api.openstack.wsgi [req-70981af5-0ec6-4c29-beed-5b13be058fb3 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] POST http://10.76.8.95:8776/v2/499
bc5c54b244601babbc7fb29787834/volumes
2016-05-19 03:58:33.866 15033 INFO cinder.api.v2.volumes [req-70981af5-0ec6-4c29-beed-5b13be058fb3 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] Create volume of 10 GB
2016-05-19 03:58:34.139 15033 WARNING oslo_config.cfg [req-dcc2b361-7ec8-40fc-a723-63291fd5513f - - - - -] Option "rabbit_host" from group "DEFAULT" is deprecated. Use option "rabbit_host" from group "oslo_mess
aging_rabbit".
2016-05-19 03:58:34.140 15033 WARNING oslo_config.cfg [req-dcc2b361-7ec8-40fc-a723-63291fd5513f - - - - -] Option "rabbit_port" from group "DEFAULT" is deprecated. Use option "rabbit_port" from group "oslo_mess
aging_rabbit".
2016-05-19 03:58:34.140 15033 WARNING oslo_config.cfg [req-dcc2b361-7ec8-40fc-a723-63291fd5513f - - - - -] Option "rabbit_userid" from group "DEFAULT" is deprecated. Use option "rabbit_userid" from group "oslo_
messaging_rabbit".
2016-05-19 03:58:34.141 15033 WARNING oslo_config.cfg [req-dcc2b361-7ec8-40fc-a723-63291fd5513f - - - - -] Option "rabbit_password" from group "DEFAULT" is deprecated. Use option "rabbit_password" from group "o
slo_messaging_rabbit".
2016-05-19 03:58:34.143 15033 INFO oslo_messaging._drivers.impl_rabbit [req-dcc2b361-7ec8-40fc-a723-63291fd5513f - - - - -] Connecting to AMQP server on 10.76.8.95:5672
2016-05-19 03:58:34.175 15033 INFO oslo_messaging._drivers.impl_rabbit [req-dcc2b361-7ec8-40fc-a723-63291fd5513f - - - - -] Connected to AMQP server on 10.76.8.95:5672
2016-05-19 03:58:34.193 15033 INFO cinder.api.openstack.wsgi [req-dcc2b361-7ec8-40fc-a723-63291fd5513f - - - - -] http://10.76.8.95:8776/v2/499bc5c54b244601babbc7fb29787834/volumes returned with HTTP 202
2016-05-19 03:58:34.196 15033 INFO eventlet.wsgi.server [req-dcc2b361-7ec8-40fc-a723-63291fd5513f - - - - -] 10.76.8.95 - - [19/May/2016 03:58:34] "POST /v2/499bc5c54b244601babbc7fb29787834/volumes HTTP/1.1" 20
2 1026 0.341858
2016-05-19 03:58:34.327 15006 WARNING cinder.scheduler.host_manager [req-70981af5-0ec6-4c29-beed-5b13be058fb3 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] volume service is down. (ho
st: ld7035@netapp-driver)
2016-05-19 03:58:34.329 15006 WARNING cinder.scheduler.filter_scheduler [req-70981af5-0ec6-4c29-beed-5b13be058fb3 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] No weighed hosts found
for volume with properties: {u'name': u'NetApp', u'qos_specs_id': None, u'deleted': False, u'created_at': u'2016-05-09T20:48:25.000000', u'updated_at': None, u'extra_specs': {u'volume_backend_name': u'netapp-dr
iver'}, u'is_public': True, u'deleted_at': None, u'id': u'42721fc2-7208-4b5c-83ec-4b443c7a1d76', u'description': None}
2016-05-19 03:58:34.331 15006 ERROR cinder.scheduler.flows.create_volume [req-70981af5-0ec6-4c29-beed-5b13be058fb3 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] Failed to run task cin
der.scheduler.flows.create_volume.ScheduleCreateVolumeTask;volume:create: No valid host was found. No weighed hosts available
2016-05-19 03:58:34.575 15037 INFO eventlet.wsgi.server [-] (15037) accepted ('10.76.8.95', 33810)
2016-05-19 03:58:34.584 15037 INFO cinder.api.openstack.wsgi [req-f51c8e80-95d8-44e3-8fe3-6fdfc2fac438 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/os-volume-transfer/detail

2016-05-19 03:58:34.593 15037 INFO cinder.api.openstack.wsgi [req-f51c8e80-95d8-44e3-8fe3-6fdfc2fac438 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/os-volume-transfer/detail returned with HTTP 200
2016-05-19 03:58:34.595 15037 INFO eventlet.wsgi.server [req-f51c8e80-95d8-44e3-8fe3-6fdfc2fac438 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:58:34] "
GET /v2/499bc5c54b244601babbc7fb29787834/os-volume-transfer/detail HTTP/1.1" 200 279 0.018028
2016-05-19 03:58:34.600 15033 INFO eventlet.wsgi.server [-] (15033) accepted ('10.76.8.95', 33811)
2016-05-19 03:58:34.611 15033 INFO cinder.api.openstack.wsgi [req-742854c3-f948-452f-9591-254a1e84c51a f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/volumes/detail
2016-05-19 03:58:34.669 15033 INFO cinder.api.openstack.wsgi [req-742854c3-f948-452f-9591-254a1e84c51a f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/volumes/detail returned with HTTP 200
2016-05-19 03:58:34.670 15033 INFO eventlet.wsgi.server [req-742854c3-f948-452f-9591-254a1e84c51a f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:58:34] "
GET /v2/499bc5c54b244601babbc7fb29787834/volumes/detail HTTP/1.1" 200 5392 0.067298
2016-05-19 03:58:34.935 15035 INFO eventlet.wsgi.server [-] (15035) accepted ('10.76.8.95', 33813)
2016-05-19 03:58:34.981 15035 INFO keystoneclient.middleware.auth_token [-] Auth Token confirmed use of v2.0 apis
2016-05-19 03:58:35.377 15035 INFO cinder.api.openstack.wsgi [req-60105086-b323-4f35-97c1-2708ff8a8ba3 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/snapshots/detail
2016-05-19 03:58:35.619 15035 INFO cinder.api.openstack.wsgi [req-60105086-b323-4f35-97c1-2708ff8a8ba3 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] http://10.76.8.95:8776/v2/499bc5c5
4b244601babbc7fb29787834/snapshots/detail returned with HTTP 200
2016-05-19 03:58:35.620 15035 INFO eventlet.wsgi.server [req-60105086-b323-4f35-97c1-2708ff8a8ba3 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] 10.76.8.95 - - [19/May/2016 03:58:35] "
GET /v2/499bc5c54b244601babbc7fb29787834/snapshots/detail HTTP/1.1" 200 279 0.684249
2016-05-19 03:58:35.692 15035 INFO eventlet.wsgi.server [-] (15035) accepted ('10.76.8.95', 33817)
2016-05-19 03:58:35.695 15035 INFO cinder.api.openstack.wsgi [req-92e75a8f-ac0e-4cf5-8093-a9840ee4bba4 f69506d6e4d54716be497723836ba682 499bc5c54b244601babbc7fb29787834 - - -] GET http://10.76.8.95:8776/v2/499b
c5c54b244601babbc7fb29787834/limits
2016-05-19 03:58:35.712 15035 WARNING cinder.quota [req-a3dd810d-6fca-407a-8362-373830e9fd88 - - - - -] Deprecated: Default quota for resource: snapshots_NetApp is set by the default quota flag: quota_snapshots
_NetApp, it is now deprecated. Please use the default quota class for default quota.
2016-05-19 03:58:35.713 15035 WARNING cinder.quota [req-a3dd810d-6fca-407a-8362-373830e9fd88 - - - - -] Deprecated: Default quota for resource: backup_gigabytes is set by the default quota flag: quota_backup_gi
gabytes, it is now deprecated. Please use the default quota class for default quota.
2016-05-19 03:58:35.714 15035 WARNING cinder.quota [req-a3dd810d-6fca-407a-8362-373830e9fd88 - - - - -] Deprecated: Default quota for resource: volumes_NetApp is set by the default quota flag: quota_volumes_Net
App, it is now deprecated. Please use the default quota class for default quota.
2016-05-19 03:58:35.715 15035 WARNING cinder.quota [req-a3dd810d-6fca-407a-8362-373830e9fd88 - - - - -] Deprecated: Default quota for resource: backups is set by the default quota flag: quota_backups, it is now
deprecated. Please use the default quota class for default quota.
2016-05-19 03:58:35.716 15035 WARNING cinder.quota [req-a3dd810d-6fca-407a-8362-373830e9fd88 - - - - -] Deprecated: Default quota for resource: gigabytes_NetApp is set by the default quota flag: quota_gigabytes
_NetApp, it is now deprecated. Please use the default quota class for default quota.
2016-05-19 03:58:35.735 15035 INFO cinder.api.openstack.wsgi [req-a4bf5e3e-3c59-488e-8a61-5416bd418f38 - - - - -] http://10.76.8.95:8776/v2/499bc5c54b244601babbc7fb29787834/limits returned with HTTP 200
2016-05-19 03:58:35.736 15035 INFO eventlet.wsgi.server [req-a4bf5e3e-3c59-488e-8a61-5416bd418f38 - - - - -] 10.76.8.95 - - [19/May/2016 03:58:35] "GET /v2/499bc5c54b244601babbc7fb29787834/limits HTTP/1.1" 200
568 0.043879
2016-05-19 03:58:39.440 15051 INFO cinder.volume.manager [req-2b997c65-d679-4efb-98ee-265df97ae202 - - - - -] Updating volume status
2016-05-19 03:59:00.221 15061 ERROR cinder.volume.manager [req-5b751b89-5625-474e-9d1b-9c1ae99f8bc1 - - - - -] Error encountered during initialization of driver: NetAppCmodeNfsDriver
2016-05-19 03:59:00.222 15061 ERROR cinder.volume.manager [req-5b751b89-5625-474e-9d1b-9c1ae99f8bc1 - - - - -] NetApp API failed. Reason - Unexpected error:<urlopen error [Errno 110] ETIMEDOUT>
2016-05-19 03:59:00.222 15061 TRACE cinder.volume.manager Traceback (most recent call last):
2016-05-19 03:59:00.222 15061 TRACE cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/manager.py", line 301, in init_host
2016-05-19 03:59:00.222 15061 TRACE cinder.volume.manager self.driver.do_setup(ctxt)
2016-05-19 03:59:00.222 15061 TRACE cinder.volume.manager File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 105, in wrapper
2016-05-19 03:59:00.222 15061 TRACE cinder.volume.manager return f(*args, **kwargs)
2016-05-19 03:59:00.222 15061 TRACE cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/netapp/dataontap/nfs_cmode.py", line 68, in do_setup
2016-05-19 03:59:00.222 15061 TRACE cinder.volume.manager vserver=self.vserver)
2016-05-19 03:59:00.222 15061 TRACE cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/netapp/dataontap/client/client_cmode.py", line 42, in __init__
2016-05-19 03:59:00.222 15061 TRACE cinder.volume.manager (major, minor) = self.get_ontapi_version(cached=False)
2016-05-19 03:59:00.222 15061 TRACE cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/netapp/dataontap/client/client_base.py", line 54, in get_ontapi_version
2016-05-19 03:59:00.222 15061 TRACE cinder.volume.manager res = self.connection.invoke_successfully(ontapi_version, False)
2016-05-19 03:59:00.222 15061 TRACE cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/netapp/dataontap/client/api.py", line 224, in invoke_successfully
2016-05-19 03:59:00.222 15061 TRACE cinder.volume.manager result = self.invoke_elem(na_element, enable_tunneling)
2016-05-19 03:59:00.222 15061 TRACE cinder.volume.manager File "/usr/lib/python2.7/site-packages/cinder/volume/drivers/netapp/dataontap/client/api.py", line 212, in invoke_elem
2016-05-19 03:59:00.222 15061 TRACE cinder.volume.manager raise NaApiError('Unexpected error', e)
2016-05-19 03:59:00.222 15061 TRACE cinder.volume.manager NaApiError: NetApp API failed. Reason - Unexpected error:<urlopen error [Errno 110] ETIMEDOUT>
2016-05-19 03:59:00.222 15061 TRACE cinder.volume.manager
2016-05-19 03:59:00.248 15061 WARNING oslo_config.cfg [req-7ffd462c-dea7-4946-b659-785b172f94bc - - - - -] Option "rabbit_host" from group "DEFAULT" is deprecated. Use option "rabbit_host" from group "oslo_mess
aging_rabbit".
2016-05-19 03:59:00.249 15061 WARNING oslo_config.cfg [req-7ffd462c-dea7-4946-b659-785b172f94bc - - - - -] Option "rabbit_port" from group "DEFAULT" is deprecated. Use option "rabbit_port" from group "oslo_mess
aging_rabbit".2016-05-19 03:59:00.250 15061 WARNING oslo_config.cfg [req-7ffd462c-dea7-4946-b659-785b172f94bc - - - - -] Option "rabbit_password" from group "DEFAULT" is deprecated. Use option "rabbit_password" from group "o
slo_messaging_rabbit".
2016-05-19 03:59:00.255 15061 INFO oslo_messaging._drivers.impl_rabbit [req-7ffd462c-dea7-4946-b659-785b172f94bc - - - - -] Connecting to AMQP server on 10.76.8.95:5672
2016-05-19 03:59:00.284 15061 INFO oslo_messaging._drivers.impl_rabbit [req-7ffd462c-dea7-4946-b659-785b172f94bc - - - - -] Connected to AMQP server on 10.76.8.95:5672
2016-05-19 03:59:39.441 15051 INFO cinder.volume.manager [req-010238af-2c36-4642-a7df-5653c3e2e82b - - - - -] Updating volume status
2016-05-19 03:59:41.302 15061 INFO cinder.volume.manager [req-02ea3981-09c0-46a6-9953-d23a0fd961bc - - - - -] Updating volume status
2016-05-19 03:59:41.304 15061 WARNING cinder.volume.manager [req-02ea3981-09c0-46a6-9953-d23a0fd961bc - - - - -] Unable to update stats, NetAppCmodeNfsDriver -1.0.0 (config name netapp-driver) driver is uniniti
alized.
2016-05-19 04:00:39.440 15051 INFO cinder.volume.manager [req-a262742c-2002-490c-a90d-4aa60d1da76c - - - - -] Updating volume status
2016-05-19 04:00:41.302 15061 INFO cinder.volume.manager [req-334794ae-af02-49fe-954b-16369318ae25 - - - - -] Updating volume status
2016-05-19 04:00:41.303 15061 WARNING cinder.volume.manager [req-334794ae-af02-49fe-954b-16369318ae25 - - - - -] Unable to update stats, NetAppCmodeNfsDriver -1.0.0 (config name netapp-driver) driver is uniniti
alized.
2016-05-19 04:01:39.443 15051 INFO cinder.volume.manager [req-12802b0b-e16f-4ce2-b6c9-58b365ced088 - - - - -] Updating volume status
2016-05-19 04:01:41.302 15061 INFO cinder.volume.manager [req-247f7ef8-2fb0-4d4a-b800-1ec43574d57e - - - - -] Updating volume status
2016-05-19 04:01:41.303 15061 WARNING cinder.volume.manager [req-247f7ef8-2fb0-4d4a-b800-1ec43574d57e - - - - -] Unable to update stats, NetAppCmodeNfsDriver -1.0.0 (config name netapp-driver) driver is uniniti
alized.

--------------

please check and let me know.

Cinder driver netapp problem - KILO Release

Get ready to power on