OpenStack Compute (nova)

unable to boot instance (Error: novalid host )

Asked by Anil Benny

Unable to boot an instance. I get novalid host error. I have attached the n-api log and cinder.conf file which i am using in pastebin

http://pastebin.com/wca3B5zW

nova boot --image c64c1f4a-edae-4f46-835f-929de2b1c84e --flavor m1.tiny test2
+-----------------------------+---------------------------------------------------------------------------------+
| Property | Value |
+-----------------------------+---------------------------------------------------------------------------------+
| status | ERROR |
| updated | 2013-03-01T04:19:52Z |
| OS-EXT-STS:task_state | None |
| key_name | None |
| image | cirros-0.3.0-x86_64-uec |
| hostId | |
| OS-EXT-STS:vm_state | error |
| flavor | m1.tiny |
| id | c14f1124-4d4a-4c71-bf7f-20c750b8fd42 |
| security_groups | [{u'name': u'default'}] |
| user_id | fde67b8f9c854843bcc1aa11f2ac79d4 |
| name | test2 |
| adminPass | vg7rHPzGyp6G |
| fault | {u'message': u'NoValidHost', u'code': 500, u'created': u'2013-03-01T04:19:52Z'} |
| created | 2013-03-01T04:19:52Z |
| OS-DCF:diskConfig | MANUAL |
| metadata | {} |
| accessIPv4 | |
| accessIPv6 | |
| tenant_id | 166c24ffa3934175b8f14cc7f9a09f4c |
| OS-EXT-STS:power_state | 0 |
| OS-EXT-AZ:availability_zone | None |
| config_drive | |
+-----------------------------+---------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------

####################
# n-api log
####################

2013-02-28 23:19:51.329 INFO nova.osapi_compute.wsgi.server [req-1dc1222c-39da-4031-8ad9-90f9209dfe4b demo demo] 10.63.165.30 "GET /v2/166c24ffa3934175b8f14cc7f9a09f4c/flavors/detail HTTP/1.1" status: 200 len: 2263 time: 0.0906730

2013-02-28 23:19:51.405 INFO nova.api.openstack.wsgi [req-9919eef0-e97e-44e2-bdb5-76d0db28244f demo demo] POST http://10.63.165.30:8774/v2/166c24ffa3934175b8f14cc7f9a09f4c/servers
2013-02-28 23:19:51.406 INFO nova.api.openstack.wsgi [req-9919eef0-e97e-44e2-bdb5-76d0db28244f demo demo] Action: 'create', body: {"server": {"min_count": 1, "flavorRef": "1", "name": "test2", "imageRef": "c64c1f4a-edae-4f46-835f-929de2b1c84e", "max_count": 1}}
2013-02-28 23:19:51.406 DEBUG nova.api.openstack.wsgi [req-9919eef0-e97e-44e2-bdb5-76d0db28244f demo demo] Calling method <bound method Controller.create of <nova.api.openstack.compute.servers.Controller object at 0x41aa750>> from (pid=29599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:927
2013-02-28 23:19:51.468 DEBUG nova.quota [req-9919eef0-e97e-44e2-bdb5-76d0db28244f demo demo] Created reservations ['34aea247-0480-4bb1-8d76-64acf4cc8665', 'f5b462e8-5e49-45e5-88b8-509d71fbc6a3', 'a1649614-11b9-498c-b5cb-731c938a91da'] from (pid=29599) reserve /opt/stack/nova/nova/quota.py:944
2013-02-28 23:19:51.478 DEBUG nova.image.glance [req-9919eef0-e97e-44e2-bdb5-76d0db28244f demo demo] fetching image c64c1f4a-edae-4f46-835f-929de2b1c84e from glance from (pid=29599) get_remote_image_service /opt/stack/nova/nova/image/glance.py:492
2013-02-28 23:19:51.830 DEBUG nova.image.glance [req-9919eef0-e97e-44e2-bdb5-76d0db28244f demo demo] fetching image 55d910b0-aaaa-446f-a9c2-9c2f514cae8f from glance from (pid=29599) get_remote_image_service /opt/stack/nova/nova/image/glance.py:492
2013-02-28 23:19:52.152 DEBUG nova.image.glance [req-9919eef0-e97e-44e2-bdb5-76d0db28244f demo demo] fetching image c7bef711-9931-4ceb-bdff-e8057af16543 from glance from (pid=29599) get_remote_image_service /opt/stack/nova/nova/image/glance.py:492
2013-02-28 23:19:52.475 DEBUG nova.compute.api [req-9919eef0-e97e-44e2-bdb5-76d0db28244f demo demo] Going to run 1 instances... from (pid=29599) _validate_and_provision_instance /opt/stack/nova/nova/compute/api.py:589
2013-02-28 23:19:52.607 DEBUG nova.quota [req-9919eef0-e97e-44e2-bdb5-76d0db28244f demo demo] Committed reservations ['34aea247-0480-4bb1-8d76-64acf4cc8665', 'f5b462e8-5e49-45e5-88b8-509d71fbc6a3', 'a1649614-11b9-498c-b5cb-731c938a91da'] from (pid=29599) commit /opt/stack/nova/nova/quota.py:968
2013-02-28 23:19:52.631 DEBUG nova.openstack.common.rpc.amqp [req-9919eef0-e97e-44e2-bdb5-76d0db28244f demo demo] Making asynchronous cast on scheduler... from (pid=29599) cast /opt/stack/nova/nova/openstack/common/rpc/amqp.py:577
2013-02-28 23:19:52.675 INFO nova.api.openstack.wsgi [req-9919eef0-e97e-44e2-bdb5-76d0db28244f demo demo] http://10.63.165.30:8774/v2/166c24ffa3934175b8f14cc7f9a09f4c/servers returned with HTTP 202
2013-02-28 23:19:52.676 INFO nova.osapi_compute.wsgi.server [req-9919eef0-e97e-44e2-bdb5-76d0db28244f demo demo] 10.63.165.30 "POST /v2/166c24ffa3934175b8f14cc7f9a09f4c/servers HTTP/1.1" status: 202 len: 736 time: 1.3419569

2013-02-28 23:19:52.769 INFO nova.api.openstack.wsgi [req-5d407646-2da9-4b75-8402-64460bb0c2e7 demo demo] GET http://10.63.165.30:8774/v2/166c24ffa3934175b8f14cc7f9a09f4c/servers/c14f1124-4d4a-4c71-bf7f-20c750b8fd42
2013-02-28 23:19:52.770 DEBUG nova.api.openstack.wsgi [req-5d407646-2da9-4b75-8402-64460bb0c2e7 demo demo] No Content-Type provided in request from (pid=29599) get_body /opt/stack/nova/nova/api/openstack/wsgi.py:795
2013-02-28 23:19:52.770 DEBUG nova.api.openstack.wsgi [req-5d407646-2da9-4b75-8402-64460bb0c2e7 demo demo] Calling method <bound method Controller.show of <nova.api.openstack.compute.servers.Controller object at 0x41aa750>> from (pid=29599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:927
2013-02-28 23:19:52.841 INFO nova.api.openstack.wsgi [req-5d407646-2da9-4b75-8402-64460bb0c2e7 demo demo] http://10.63.165.30:8774/v2/166c24ffa3934175b8f14cc7f9a09f4c/servers/c14f1124-4d4a-4c71-bf7f-20c750b8fd42 returned with HTTP 200
2013-02-28 23:19:52.842 INFO nova.osapi_compute.wsgi.server [req-5d407646-2da9-4b75-8402-64460bb0c2e7 demo demo] 10.63.165.30 "GET /v2/166c24ffa3934175b8f14cc7f9a09f4c/servers/c14f1124-4d4a-4c71-bf7f-20c750b8fd42 HTTP/1.1" status: 200 len: 1458 time: 0.1605740

2013-02-28 23:19:52.918 INFO nova.api.openstack.wsgi [req-030a27ec-d203-42af-8671-f30506a677e5 demo demo] GET http://10.63.165.30:8774/v2/166c24ffa3934175b8f14cc7f9a09f4c/flavors/1
2013-02-28 23:19:52.919 DEBUG nova.api.openstack.wsgi [req-030a27ec-d203-42af-8671-f30506a677e5 demo demo] No Content-Type provided in request from (pid=29599) get_body /opt/stack/nova/nova/api/openstack/wsgi.py:795
2013-02-28 23:19:52.919 DEBUG nova.api.openstack.wsgi [req-030a27ec-d203-42af-8671-f30506a677e5 demo demo] Calling method <bound method Controller.show of <nova.api.openstack.compute.flavors.Controller object at 0x41c5d10>> from (pid=29599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:927
2013-02-28 23:19:52.935 INFO nova.api.openstack.wsgi [req-030a27ec-d203-42af-8671-f30506a677e5 demo demo] http://10.63.165.30:8774/v2/166c24ffa3934175b8f14cc7f9a09f4c/flavors/1 returned with HTTP 200
2013-02-28 23:19:52.936 INFO nova.osapi_compute.wsgi.server [req-030a27ec-d203-42af-8671-f30506a677e5 demo demo] 10.63.165.30 "GET /v2/166c24ffa3934175b8f14cc7f9a09f4c/flavors/1 HTTP/1.1" status: 200 len: 595 time: 0.0901568

2013-02-28 23:19:53.010 INFO nova.api.openstack.wsgi [req-28e28e86-54a0-4ed2-8aaf-fc1288129751 demo demo] GET http://10.63.165.30:8774/v2/166c24ffa3934175b8f14cc7f9a09f4c/images/c64c1f4a-edae-4f46-835f-929de2b1c84e
2013-02-28 23:19:53.011 DEBUG nova.api.openstack.wsgi [req-28e28e86-54a0-4ed2-8aaf-fc1288129751 demo demo] No Content-Type provided in request from (pid=29599) get_body /opt/stack/nova/nova/api/openstack/wsgi.py:795
2013-02-28 23:19:53.011 DEBUG nova.api.openstack.wsgi [req-28e28e86-54a0-4ed2-8aaf-fc1288129751 demo demo] Calling method <bound method Controller.show of <nova.api.openstack.compute.images.Controller object at 0x41b5f90>> from (pid=29599) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:927
2013-02-28 23:19:53.340 INFO nova.api.openstack.wsgi [req-28e28e86-54a0-4ed2-8aaf-fc1288129751 demo demo] http://10.63.165.30:8774/v2/166c24ffa3934175b8f14cc7f9a09f4c/images/c64c1f4a-edae-4f46-835f-929de2b1c84e returned with HTTP 200
2013-02-28 23:19:53.341 INFO nova.osapi_compute.wsgi.server [req-28e28e86-54a0-4ed2-8aaf-fc1288129751 demo demo] 10.63.165.30 "GET /v2/166c24ffa3934175b8f14cc7f9a09f4c/images/c64c1f4a-edae-4f46-835f-929de2b1c84e HTTP/1.1" status: 200 len: 1010 time: 0.4017301

Question information

Language:
English Edit question
Status:
Answered
For:
OpenStack Compute (nova) Edit question
Assignee:
No assignee Edit question
Last query:
Last reply:

This question was originally filed as bug #1137003.

Revision history for this message
Russell Bryant (russellb) said : 		#1

I'm convering this bug into a question. Hopefully someone can continue to help you debug your setup there. Thanks!

Revision history for this message
varada (varadaa) said : 		#2

1 )how is your nova-scheduler.log looking, when 'nova boot ' was issued ?

2 )See..if the compute node is registered in the sqlDB at all
   mysql> select hypervisor_hostname from compute_nodes;

3) Could be authentication issue from compute node itself. You might want to check the connect strings/user/pass and such.

Revision history for this message
Anil Benny (anil-benny) said : 		#3

ok i see the root cause itself being the devstack installation. I am seeing these errors being thrown after i install the devstack.

req-1ac4ac16-4d59-4205-98c2-7a00e12cb2a9 None None] Timed out waiting for nova-conductor. Is it running? Or did this service start before nova-conductor?
2013-03-07 05:01:11.515 DEBUG nova.openstack.common.rpc.amqp [req-1ac4ac16-4d59-4205-98c2-7a00e12cb2a9 None None] Making synchronous call on conductor ... from (pid=4666) multicall /opt/stack/nova/nova/openstack/common/rpc/amqp.py:541
2013-03-07 05:01:11.516 DEBUG nova.openstack.common.rpc.amqp [req-1ac4ac16-4d59-4205-98c2-7a00e12cb2a9 None None] MSG_ID is 77d1c4ce71384b509740caa688c97821 from (pid=4666) multicall /opt/stack/nova/nova/openstack/common/rpc/amqp.py:544
2013-03-07 05:02:11.622 ERROR nova.openstack.common.rpc.common [req-1ac4ac16-4d59-4205-98c2-7a00e12cb2a9 None None] Timed out waiting for RPC response: timed out
2013-03-07 05:02:11.622 TRACE nova.openstack.common.rpc.common Traceback (most recent call last):
2013-03-07 05:02:11.622 TRACE nova.openstack.common.rpc.common File "/opt/stack/nova/nova/openstack/common/rpc/impl_kombu.py", line 563, in ensure
2013-03-07 05:02:11.622 TRACE nova.openstack.common.rpc.common return method(*args, **kwargs)
2013-03-07 05:02:11.622 TRACE nova.openstack.common.rpc.common File "/opt/stack/nova/nova/openstack/common/rpc/impl_kombu.py", line 643, in _consume
2013-03-07 05:02:11.622 TRACE nova.openstack.common.rpc.common return self.connection.drain_events(timeout=timeout)
2013-03-07 05:02:11.622 TRACE nova.openstack.common.rpc.common File "/usr/local/lib/python2.7/dist-packages/kombu/connection.py", line 110, in drain_events
2013-03-07 05:02:11.622 TRACE nova.openstack.common.rpc.common return self.transport.drain_events(self.connection, **kwargs)
2013-03-07 05:02:11.622 TRACE nova.openstack.common.rpc.common File "/usr/local/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 200, in drain_events
2013-03-07 05:02:11.622 TRACE nova.openstack.common.rpc.common return connection.drain_events(**kwargs)
2013-03-07 05:02:11.622 TRACE nova.openstack.common.rpc.common File "/usr/local/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 50, in drain_events
2013-03-07 05:02:11.622 TRACE nova.openstack.common.rpc.common return self.wait_multi(self.channels.values(), timeout=timeout)
2013-03-07 05:02:11.622 TRACE nova.openstack.common.rpc.common File "/usr/local/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 56, in wait_multi
2013-03-07 05:02:11.622 TRACE nova.openstack.common.rpc.common chanmap.keys(), allowed_methods, timeout=timeout)
2013-03-07 05:02:11.622 TRACE nova.openstack.common.rpc.common File "/usr/local/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 104, in _wait_multiple
2013-03-07 05:02:11.622 TRACE nova.openstack.common.rpc.common channel, method_sig, args, content = self.read_timeout(timeout)
2013-03-07 05:02:11.622 TRACE nova.openstack.common.rpc.common File "/usr/local/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 86, in read_timeout
2013-03-07 05:02:11.622 TRACE nova.openstack.common.rpc.common return self.method_reader.read_method()
2013-03-07 05:02:11.622 TRACE nova.openstack.common.rpc.common File "/usr/local/lib/python2.7/dist-packages/amqplib/client_0_8/method_framing.py", line 215, in read_method
2013-03-07 05:02:11.622 TRACE nova.openstack.common.rpc.common raise m
2013-03-07 05:02:11.622 TRACE nova.openstack.common.rpc.common timeout: timed out
2013-03-07 05:02:11.622 TRACE nova.openstack.common.rpc.common
2013-03-07 05:02:11.627 WARNING nova.conductor.api [req-1ac4ac16-4d59-4205-98c2-7a00e12cb2a9 None None] Timed out waiting for nova-conductor. Is it running? Or did this service start before nova-conductor?
2013-03-07 05:02:11.627 DEBUG nova.openstack.common.rpc.amqp [req-1ac4ac16-4d59-4205-98c2-7a00e12cb2a9 None None] Making synchronous call on conductor ... from (pid=4666) multicall /opt/stack/nova/nova/openstack/common/rpc/amqp.py:541
2013-03-07 05:02:11.628 DEBUG nova.openstack.common.rpc.amqp [req-1ac4ac16-4d59-4205-98c2-7a00e12cb2a9 None None] MSG_ID is c3951780d39340df8a144ab1857091ac from (pid=4666) multicall /opt/stack/nova/nova/openstack/common/rpc/amqp.py:544
2013-03-07 05:03:11.734 ERROR nova.openstack.common.rpc.common [req-1ac4ac16-4d59-4205-98c2-7a00e12cb2a9 None None] Timed out waiting for RPC response: timed out
2013-03-07 05:03:11.734 TRACE nova.openstack.common.rpc.common Traceback (most recent call last):
2013-03-07 05:03:11.734 TRACE nova.openstack.common.rpc.common File "/opt/stack/nova/nova/openstack/common/rpc/impl_kombu.py", line 563, in ensure
2013-03-07 05:03:11.734 TRACE nova.openstack.common.rpc.common return method(*args, **kwargs)
2013-03-07 05:03:11.734 TRACE nova.openstack.common.rpc.common File "/opt/stack/nova/nova/openstack/common/rpc/impl_kombu.py", line 643, in _consume
2013-03-07 05:03:11.734 TRACE nova.openstack.common.rpc.common return self.connection.drain_events(timeout=timeout)
2013-03-07 05:03:11.734 TRACE nova.openstack.common.rpc.common File "/usr/local/lib/python2.7/dist-packages/kombu/connection.py", line 110, in drain_events
2013-03-07 05:03:11.734 TRACE nova.openstack.common.rpc.common return self.transport.drain_events(self.connection, **kwargs)
2013-03-07 05:03:11.734 TRACE nova.openstack.common.rpc.common File "/usr/local/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 200, in drain_events
2013-03-07 05:03:11.734 TRACE nova.openstack.common.rpc.common return connection.drain_events(**kwargs)
2013-03-07 05:03:11.734 TRACE nova.openstack.common.rpc.common File "/usr/local/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 50, in drain_events
2013-03-07 05:03:11.734 TRACE nova.openstack.common.rpc.common return self.wait_multi(self.channels.values(), timeout=timeout)
2013-03-07 05:03:11.734 TRACE nova.openstack.common.rpc.common File "/usr/local/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 56, in wait_multi
2013-03-07 05:03:11.734 TRACE nova.openstack.common.rpc.common chanmap.keys(), allowed_methods, timeout=timeout)
2013-03-07 05:03:11.734 TRACE nova.openstack.common.rpc.common File "/usr/local/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 104, in _wait_multiple
2013-03-07 05:03:11.734 TRACE nova.openstack.common.rpc.common channel, method_sig, args, content = self.read_timeout(timeout)
2013-03-07 05:03:11.734 TRACE nova.openstack.common.rpc.common File "/usr/local/lib/python2.7/dist-packages/kombu/transport/pyamqplib.py", line 86, in read_timeout
2013-03-07 05:03:11.734 TRACE nova.openstack.common.rpc.common return self.method_reader.read_method()
2013-03-07 05:03:11.734 TRACE nova.openstack.common.rpc.common File "/usr/local/lib/python2.7/dist-packages/amqplib/client_0_8/method_framing.py", line 215, in read_method
2013-03-07 05:03:11.734 TRACE nova.openstack.common.rpc.common raise m
2013-03-07 05:03:11.734 TRACE nova.openstack.common.rpc.common timeout: timed out
2013-03-07 05:03:11.734 TRACE nova.openstack.common.rpc.common
2013-03-07 05:03:11.739 WARNING nova.conductor.api [req-1ac4ac16-4d59-4205-98c2-7a00e12cb2a9 None None] Timed out waiting for nova-conductor. Is it running

Revision history for this message
Jason (zzs) said : 		#4

it looks like the nova-conductor is still initializing, can you check if it is gone after a while.
Please check all the nova services work or not by:
nova-manage service list.

Can you help with this problem?

Provide an answer of your own, or ask Anil Benny for more information if necessary.

To post a message you must log in.