Friday, February 28, 2014

USB Redirection hack on "Two Node Controller&Compute Neutron GRE+OVS" Fedora 20 Cluster

   I clearly understand that only incomplete  Havana RDO setup allows me to activate spice USB redirection communicating with cloud instances.
There is no dashboard ( Administrative Web Console ) on Cluster. All information
regarding nova instances status, neutron subnets,routers,ports is supposed to be obtained via CLI as well as managing instances, subnets,routers,ports and rules is also supposed to be done via CLI, having  carefully watch sourcing "keystonerc_user"  file to manage in environment of particular user of particular tenant.
   Also I have to mention that  to create new instance I must have in `nova list` no more then four entries. Then I will be able create new one instance for sure.  It has been tested on two  "Two Node Neutron GRE+OVS Systems" It is related with `nova quota-show`  for tenant (10 instances is default ). Having 3 vms on Compute I brought up openstack-nova-compute on Controller and was able to create 2 vms more on Compute and 5 vms on Controller. View https://ask.openstack.org/en/question/11746/openstack-nova-scheduler-service-cannot-any-longer-connect-to-amqp-server-performing-nova-boot-on-fedora-20/



Manual Setup  ( view [2]  http://bderzhavets.blogspot.com/2014/01/setting-up-two-physical-node-openstack.html )
- Controller node: Nova, Keystone, Cinder, Glance, Neutron (using Open vSwitch plugin and GRE tunneling )
 - Compute node: Nova (nova-compute), Neutron (openvswitch-agent)
 
dwf02.localdomain   -  Controller (192.168.1.127)
dwf01.localdomain   -  Compute   (192.168.1.137)
Controller status :-

[root@dfw02 ~(keystone_admin)]$ openstack-status
== Nova services ==
openstack-nova-api:                     active
openstack-nova-cert:                    inactive  (disabled on boot)
openstack-nova-compute:                 inactive  (disabled on boot)
openstack-nova-network:                 inactive  (disabled on boot)
openstack-nova-scheduler:               active
openstack-nova-volume:                  inactive  (disabled on boot)
openstack-nova-conductor:               active
== Glance services ==
openstack-glance-api:                   active
openstack-glance-registry:              active
== Keystone service ==
openstack-keystone:                     active
== neutron services ==
neutron-server:                         active
neutron-dhcp-agent:                     active
neutron-l3-agent:                       active
neutron-metadata-agent:                 active
neutron-lbaas-agent:                    inactive  (disabled on boot)
neutron-openvswitch-agent:              active
neutron-linuxbridge-agent:              inactive  (disabled on boot)
neutron-ryu-agent:                      inactive  (disabled on boot)
neutron-nec-agent:                      inactive  (disabled on boot)
neutron-mlnx-agent:                     inactive  (disabled on boot)
== Cinder services ==
openstack-cinder-api:                   active
openstack-cinder-scheduler:             active
openstack-cinder-volume:                active
== Ceilometer services ==
openstack-ceilometer-api:               inactive  (disabled on boot)
openstack-ceilometer-central:           inactive  (disabled on boot)
openstack-ceilometer-compute:           active
openstack-ceilometer-collector:         inactive  (disabled on boot)
openstack-ceilometer-alarm-notifier:    inactive  (disabled on boot)
openstack-ceilometer-alarm-evaluator:   inactive  (disabled on boot)
== Support services ==
mysqld:                                 inactive  (disabled on boot)
libvirtd:                               active
openvswitch:                            active
dbus:                                   active
tgtd:                                   active
qpidd:                                  active
== Keystone users ==
+----------------------------------+---------+---------+-------+
|                id                |   name  | enabled | email |
+----------------------------------+---------+---------+-------+
| 970ed56ef7bc41d59c54f5ed8a1690dc |  admin  |   True  |       |
| 162021e787c54cac906ab3296a386006 |  boris  |   True  |       |
| 1beeaa4b20454048bf23f7d63a065137 |  cinder |   True  |       |
| 006c2728df9146bd82fab04232444abf |  glance |   True  |       |
| 5922aa93016344d5a5d49c0a2dab458c | neutron |   True  |       |
| af2f251586564b46a4f60cdf5ff6cf4f |   nova  |   True  |       |
+----------------------------------+---------+---------+-------+
== Glance images ==
+--------------------------------------+---------------------------------+-------------+------------------+-------------+--------+
| ID                                   | Name                            | Disk Format | Container Format | Size        | Status |
+--------------------------------------+---------------------------------+-------------+------------------+-------------+--------+
| a6e8ef59-e492-46e2-8147-fd8b1a65ed73 | CentOS 6.5 image                | qcow2       | bare             | 344457216   | active |
| dc992799-7831-4933-b6ee-7b81868f808b | CirrOS31                        | qcow2       | bare             | 13147648    | active |
| 03c9ad20-b0a3-4b71-aa08-2728ecb66210 | Fedora 19 x86_64                | qcow2       | bare             | 237371392   | active |
| de93ee44-4085-4111-b022-a7437da8feac | Fedora 20 image                 | qcow2       | bare             | 214106112   | active |
| e70591fc-6905-4e57-84b7-4ffa7c001864 | Ubuntu Server 13.10             | qcow2       | bare             | 244514816   | active |
| b7d54434-1cc6-4770-82f3-c8619952575c | Ubuntu Trusty Tar 02/23/14      | qcow2       | bare             | 261029888   | active |
| 07071d00-fb85-4b32-a9b4-d515088700d0 | Windows Server 2012 R2 Std Eval | vhd         | bare             | 17182752768 | active |
+--------------------------------------+---------------------------------+-------------+------------------+-------------+--------+
== Nova managed services ==
+----------------+-------------------+----------+---------+-------+----------------------------+-----------------+
| Binary         | Host              | Zone     | Status  | State | Updated_at                 | Disabled Reason |
+----------------+-------------------+----------+---------+-------+----------------------------+-----------------+
| nova-scheduler | dfw02.localdomain | internal | enabled | up    | 2014-02-28T06:32:03.000000 | None            |
| nova-conductor | dfw02.localdomain | internal | enabled | up    | 2014-02-28T06:32:03.000000 | None            |
| nova-compute   | dfw01.localdomain | nova     | enabled | up    | 2014-02-28T06:31:59.000000 | None            |
+----------------+-------------------+----------+---------+-------+----------------------------+-----------------+
== Nova networks ==
+--------------------------------------+-------+------+
| ID                                   | Label | Cidr |
+--------------------------------------+-------+------+
| 1eea88bb-4952-4aa4-9148-18b61c22d5b7 | int   | None |
| 426bb226-0ab9-440d-ba14-05634a17fb2b | int1  | None |
| 780ce2f3-2e6e-4881-bbac-857813f9a8e0   | ext   | None |
+--------------------------------------+-------+------+
== Nova instance flavors ==
+----+-----------+-----------+------+-----------+------+-------+-------------+-----------+
| ID | Name      | Memory_MB | Disk | Ephemeral | Swap | VCPUs | RXTX_Factor | Is_Public |
+----+-----------+-----------+------+-----------+------+-------+-------------+-----------+
| 1  | m1.tiny   | 512       | 1    | 0         |      | 1     | 1.0         | True      |
| 2  | m1.small  | 2048      | 20   | 0         |      | 1     | 1.0         | True      |
| 3  | m1.medium | 4096      | 40   | 0         |      | 2     | 1.0         | True      |
| 4  | m1.large  | 8192      | 80   | 0         |      | 4     | 1.0         | True      |
| 5  | m1.xlarge | 16384     | 160  | 0         |      | 8     | 1.0         | True      |
+----+-----------+-----------+------+-----------+------+-------+-------------+-----------+
== Nova instances ==
+----+------+--------+------------+-------------+----------+
| ID | Name | Status | Task State | Power State | Networks |
+----+------+--------+------------+-------------+----------+
+----+------+--------+------------+-------------+----------+

[root@dfw02 ~(keystone_boris)]$ nova list
+--------------------------------------+-----------+-----------+------------+-------------+------------------------------+
| ID                                   | Name      | Status    | Task State | Power State | Networks                     |
+--------------------------------------+-----------+-----------+------------+-------------+------------------------------+
| 5fcd83c3-1d4e-4b11-bfe5-061a03b73174 | UbuntuRSX | SUSPENDED | None       | Shutdown    | int1=40.0.0.5, 192.168.1.120 |
| 7953950c-112c-4c59-b183-5cbd06eabcf6 | VF19WXL   | SUSPENDED | None       | Shutdown    | int1=40.0.0.6, 192.168.1.121 |
| 784e8afc-d41a-4c2e-902a-8e109a40f7db | VF20GLS   | SUSPENDED | None       | Shutdown    | int1=40.0.0.4, 192.168.1.102 |
| 9b156b85-a6a1-4f15-bffa-6fdb124f8cff | VF20WXL   | SUSPENDED | None       | Shutdown    | int1=40.0.0.2, 192.168.1.101 |
+--------------------------------------+-----------+-----------+------------+-------------+------------------------------+

 [root@dfw02 ~(keystone_admin)]$ nova-manage service list
Binary           Host                                 Zone             Status     State Updated_At
nova-scheduler   dfw02.localdomain                    internal         enabled    :-)   2014-02-28 11:47:25
nova-conductor   dfw02.localdomain                    internal         enabled    :-)   2014-02-28 11:47:25
nova-compute     dfw01.localdomain                    nova             enabled    :-)   2014-02-28 11:47:19


[root@dfw02 ~(keystone_admin)]$ neutron agent-list
+--------------------------------------+--------------------+-------------------+-------+----------------+
| id                                   | agent_type         | host              | alive | admin_state_up |
+--------------------------------------+--------------------+-------------------+-------+----------------+
| 037b985d-7a7d-455b-8536-76eed40b0722 | L3 agent           | dfw02.localdomain | :-)   | True           |
| 22438ee9-b4ea-4316-9492-eb295288f61a | Open vSwitch agent | dfw02.localdomain | :-)   | True           |
| 76ed02e2-978f-40d0-879e-1a2c6d1f7915 | DHCP agent         | dfw02.localdomain | :-)   | True           |
| 951632a3-9744-4ff4-a835-c9f53957c617 | Open vSwitch agent | dfw01.localdomain | :-)   | True           |
+--------------------------------------+--------------------+-------------------+-------+----------------+



Create F20 instance per http://bderzhavets.blogspot.com/2014/01/setting-up-two-physical-node-openstack.html 
and run on newly built instance :-

# yum -y update
# yum -y install spice-vdagent
# reboot

Connect via virt-manager and switch to Properties tab :-


   1. Switch to Spice Server
   2. Switch to Video QXL
   3. Add Hardware "Spice agent(spicevmc)"
   4. Add Hardware "USB Redirection"
       Spice channel

 


  

Then :-
[root@dfw02 ~(keystone_boris)]$  nova reboot VF20GLS 


 
Plug in USB pen on Controller

 

[ 6443.772131] usb 1-2.1: USB disconnect, device number 5
[ 6523.996983] usb 1-2.1: new full-speed USB device number 6 using uhci_hcd
[ 6524.278848] usb 1-2.1: New USB device found, idVendor=0951, idProduct=160e
[ 6524.281206] usb 1-2.1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 6524.282055] usb 1-2.1: Product: DataTraveler 2.0
[ 6524.284851] usb 1-2.1: Manufacturer: Kingston
[ 6524.290527] usb 1-2.1: SerialNumber: 000AEB920161SK861E1301F6
[ 6524.369667] usb-storage 1-2.1:1.0: USB Mass Storage device detected
[ 6524.379638] scsi4 : usb-storage 1-2.1:1.0
[ 6525.420794] scsi 4:0:0:0: Direct-Access     Kingston DataTraveler 2.0 1.00 PQ: 0 ANSI: 2
[ 6525.459504] sd 4:0:0:0: Attached scsi generic sg0 type 0
[ 6525.526419] sd 4:0:0:0: [sdb] 7856128 512-byte logical blocks: (4.02 GB/3.74 GiB)
[ 6525.554959] sd 4:0:0:0: [sdb] Write Protect is off
[ 6525.555010] sd 4:0:0:0: [sdb] Mode Sense: 23 00 00 00
[ 6525.571552] sd 4:0:0:0: [sdb] No Caching mode page found
[ 6525.573029] sd 4:0:0:0: [sdb] Assuming drive cache: write through
[ 6525.667624] sd 4:0:0:0: [sdb] No Caching mode page found
[ 6525.669322] sd 4:0:0:0: [sdb] Assuming drive cache: write through
[ 6525.816841]  sdb: sdb1
[ 6525.887493] sd 4:0:0:0: [sdb] No Caching mode page found
[ 6525.889142] sd 4:0:0:0: [sdb] Assuming drive cache: write through
[ 6525.890478] sd 4:0:0:0: [sdb] Attached SCSI removable disk

$ sudo mount /dev/sdb1 /mnt/usbpen

[ 5685.621007] FAT-fs (sdb1): Volume was not properly unmounted. Some data may be corrupt. Please run fsck.
[ 5685.631218] SELinux: initialized (dev sdb1, type vfat), uses genfs_contexts


   Setup Light X Windows System & Fluxbox on F20 instance ( [1] ) and make sure it's completely functional and can read and write to USB pen.
However, to copy to USB pen `sudo cp whatever.file  /mnt/usbpen` is required

 

  

   Nova status verification
    
  
   Neutron status verification



On the dfw02 (Controller) , run the following command:

  ssh-keygen (Hit Enter to accept all of the defaults)
  ssh-copy-id -i ~/.ssh/id_rsa.pub root@dwf01 (Compute)

Add to /etc/rc.d/rc.local lines :-

ssh -L 5900:127.0.0.1:5900 -N -f -l root 192.168.1.137
ssh -L 5901:127.0.0.1:5901 -N -f -l root 192.168.1.137
ssh -L 5902:127.0.0.1:5902 -N -f -l root 192.168.1.137

to be comfortable with spicy connection to instances running on Compute node.

 Build fresh spice-gtk packages :-

$ rpm -iv spice-gtk-0.23-1.fc21.src.rpm
$ cd ~/rpmbuild/SPEC

$ sudo yum install intltool gtk2-devel usbredir-devel libusb1-devel libgudev1-devel pixman-devel openssl-devel  libjpeg-turbo-devel celt051-devel pulseaudio-libs-devel pygtk2-devel python-devel zlib-devel cyrus-sasl-devel libcacard-devel gobject-introspection-devel  dbus-glib-devel libacl-devel polkit-devel gtk-doc vala-tools gtk3-devel spice-protocol opus-devel

$ rpmbuild -bb ./spice-gtk.spec
$ cd ../RPMS/x86_64

Install rpms been built , because spicy is not on the system

[boris@dfw02 x86_64]$  sudo yum install spice-glib-0.23-1.fc20.x86_64.rpm \
spice-glib-devel-0.23-1.fc20.x86_64.rpm \
spice-gtk-0.23-1.fc20.x86_64.rpm \
spice-gtk3-0.23-1.fc20.x86_64.rpm \
spice-gtk3-devel-0.23-1.fc20.x86_64.rpm \
spice-gtk3-vala-0.23-1.fc20.x86_64.rpm \
spice-gtk-debuginfo-0.23-1.fc20.x86_64.rpm \
spice-gtk-devel-0.23-1.fc20.x86_64.rpm  \
spice-gtk-python-0.23-1.fc20.x86_64.rpm \
spice-gtk-tools-0.23-1.fc20.x86_64.rpm

Verify new spice-gtk install on F20 :-

[boris@dfw02 x86_64]$ rpm -qa | grep spice-
spice-gtk-tools-0.23-1.fc20.x86_64
spice-server-0.12.4-3.fc20.x86_64
spice-glib-devel-0.23-1.fc20.x86_64
spice-gtk3-vala-0.23-1.fc20.x86_64
spice-gtk3-devel-0.23-1.fc20.x86_64
spice-gtk-python-0.23-1.fc20.x86_64
spice-vdagent-0.15.0-1.fc20.x86_64
spice-gtk-devel-0.23-1.fc20.x86_64
spice-gtk-0.23-1.fc20.x86_64
spice-gtk-debuginfo-0.23-1.fc20.x86_64
spice-glib-0.23-1.fc20.x86_64
spice-gtk3-0.23-1.fc20.x86_64
spice-protocol-0.12.6-2.fc20.noarch

Connection via spice will give  a warning :-


    just ignore this message.

    Test on Ubuntu 14.04 Beta 1 cloud instance
    


[  183.704082] init: plymouth-stop pre-start process (1075) terminated with status 1
[  304.422935] usb 1-2.1: new full-speed USB device number 4 using uhci_hcd
[  304.724345] usb 1-2.1: New USB device found, idVendor=0951, idProduct=160e
[  304.724426] usb 1-2.1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[  304.724516] usb 1-2.1: Product: DataTraveler 2.0
[  304.724578] usb 1-2.1: Manufacturer: Kingston
[  304.724640] usb 1-2.1: SerialNumber: 000AEB920161SK861E1301F6
[  305.038629] usb-storage 1-2.1:1.0: USB Mass Storage device detected
[  305.053503] scsi2 : usb-storage 1-2.1:1.0
[  305.068785] usbcore: registered new interface driver usb-storage
[  306.088727] scsi 2:0:0:0: Direct-Access     Kingston DataTraveler 2.0 1.00 PQ: 0 ANSI: 2
[  306.121297] sd 2:0:0:0: Attached scsi generic sg0 type 0
[  306.143700] sd 2:0:0:0: [sda] 7856128 512-byte logical blocks: (4.02 GB/3.74 GiB)
[  306.172714] sd 2:0:0:0: [sda] Write Protect is off
[  306.172805] sd 2:0:0:0: [sda] Mode Sense: 23 00 00 00
[  306.180711] sd 2:0:0:0: [sda] No Caching mode page found
[  306.182786] sd 2:0:0:0: [sda] Assuming drive cache: write through
[  306.254420] sd 2:0:0:0: [sda] No Caching mode page found
[  306.254851] sd 2:0:0:0: [sda] Assuming drive cache: write through
[  306.382421]  sda: sda1
[  306.458938] sd 2:0:0:0: [sda] No Caching mode page found
[  306.459490] sd 2:0:0:0: [sda] Assuming drive cache: write through
[  306.459956] sd 2:0:0:0: [sda] Attached SCSI removable disk
[  387.146403] FAT-fs (sda1): Volume was not properly unmounted. Some data may be corrupt. Please run fsck.


    The original text of Setup&Configs docs were posted on fedorapeople.org by Kashyap in November 2013.
   Attached ones [3],[4] tuned for new IP's and should not have any more  typos of original version.They also contain MySQL preventive updates currently required for openstack-nova-compute & neutron-openvswitch-agent remote connection to Controller Node to succeed . MySQL stuff is mine. All attached *.conf & *.ini files have been update for my network as well.
   In meantime I am quite sure  that using Libvirt's default and non-default networks  for creating Controller and Compute nodes  as F20 VMs is not important. Configs allow metadata to be sent from Controller to Compute on real
physical boxes. Just one Ethernet Controller per box should be required in case of  using GRE tunnelling in case of RDO Havana on Fedora 20 manual setup. 

References


1. http://bderzhavets.blogspot.com/2014/02/setup-light-weight-x-windows_2.html
2. http://bderzhavets.blogspot.com/2014/01/setting-up-two-physical-node-openstack.html
3. http://textuploader.com/1hin
4. http://textuploader.com/1hey

Saturday, February 15, 2014

Ongoing testing "Two Real Controller&Compute Nodes Neutron GRE + OVS" on Fedora 20 been setup via native Havana Repos


   Per my experience (4 different clusters set-ups  from scratch) critical number of instances which may be created on my systems is 5.So, I can smoothly create any 5 cloud instances after fresh install of "Two node Controller+Compute Neutron GRE+OVS cluster ". Another important notice, that  MySQL credentials for root&nova have to be setup manually in meatime, please view http://bderzhavets.blogspot.com/2014/02/mysql-credentials-for-root-nova-in-two.html  and https://ask.openstack.org/en/question/11672/ongoing-problem-with-starting-neutron-server-on-fedora-20-rdo-havana/.  

    To create new instance I must have in `nova list` no more then four entries. Then I will be able create new one instance for sure.  It has been tested on two  "Two Node Neutron GRE+OVS Systems"  ( watching in other window `tail -f /var/log/nova/scheduler.log` for ERRORS to connect AMQP Server) .  It looks like AMQP Server eventually breaks connection to Nova & Neutron services, what may require service QPIDD restart and service openstack-nova-scheduler restart.
    It is related with `nova quota-show`  for tenant (10 instances is default ). Having 3 vms on Compute I brought up openstack-nova-compute on Controller and was able to create 2 vms more on Compute and 5 vms on Controller.

Syntax like :

[root@dallas1 ~(keystone_admin)]$  nova quota-defaults
+-----------------------------+-------+
| Quota                       | Limit |
+-----------------------------+-------+
| instances                   | 10    |
| cores                       | 20    |
| ram                         | 51200 |
| floating_ips                | 10    |
| fixed_ips                   | -1    |
| metadata_items              | 128   |
| injected_files              | 5     |
| injected_file_content_bytes | 10240 |
| injected_file_path_bytes    | 255   |
| key_pairs                   | 100   |
| security_groups             | 10    |
| security_group_rules        | 20    |
+-----------------------------+-------+
[root@dallas1 ~(keystone_admin)]$  nova quota-class-update --instances 20 default


[root@dallas1 ~(keystone_admin)]$  nova quota-defaults
+-----------------------------+-------+
| Quota                       | Limit |
+-----------------------------+-------+
| instances                   | 20    |
| cores                       | 20    |
| ram                         | 51200 |
| floating_ips                | 10    |
| fixed_ips                   | -1    |
| metadata_items              | 128   |
| injected_files              | 5     |
| injected_file_content_bytes | 10240 |
| injected_file_path_bytes    | 255   |
| key_pairs                   | 100   |
| security_groups             | 10    |
| security_group_rules        | 20    |
+-----------------------------+-------+
 

doesn't work for me


Instance number on this snapshot is Instance-0000004a (HEX). This number is all the time increasing . This is instance created 74 th starting with 00000001



Detailed information about instances above:

[root@dfw02 ~(keystone_admin)]$ nova list
+--------------------------------------+------------+-----------+------------+-------------+-----------------------------+
| ID                                   | Name       | Status    | Task State | Power State | Networks                    |
+--------------------------------------+------------+-----------+------------+-------------+-----------------------------+
| e52f8f4d-5d01-4237-a1ed-79ee53ecc88a | UbuntuSX5  | SUSPENDED | None       | Shutdown    | int=10.0.0.2, 192.168.1.114 |
| 6c094d16-fda7-43fa-8f24-22e02e7a2fc6 | UbuntuVLG1 | ACTIVE    | None       | Running     | int=10.0.0.6, 192.168.1.118 |
| 526b803d-ded5-48d8-857a-f622f6082c18 | VF20GLF    | ACTIVE    | None       | Running     | int=10.0.0.5, 192.168.1.119 |
| c3a4c6d4-8618-4c4f-becb-0c53c2b3ad91 | VF20GLX    | ACTIVE    | None       | Running     | int=10.0.0.7, 192.168.1.117 |
| 4b619f27-30ba-4bd0-bd03-019b3c5d4bf7 | VF20SX4    | SUSPENDED | None       | Shutdown    | int=10.0.0.4, 192.168.1.110 |
+--------------------------------------+------------+-----------+------------+-------------+-----------------------------+

[root@dfw02 ~(keystone_admin)]$ nova show 526b803d-ded5-48d8-857a-f622f6082c18
+--------------------------------------+----------------------------------------------------------+
| Property                             | Value                                                               |
+--------------------------------------+----------------------------------------------------------+
| status                               | ACTIVE                                                            |
| updated                              | 2014-02-17T13:10:14Z                               |
| OS-EXT-STS:task_state                | None                                                  |
| OS-EXT-SRV-ATTR:host                 | dfw01.localdomain                         |
| key_name                             | None                                                             |
| image                Attempt to boot from volume - no image supplied      |
| int network                          | 10.0.0.5, 192.168.1.119                           |
| hostId                               | b67c11ccfa8ac8c9ed019934fa650d307f91e7fe7bbf8cd6874f3e01 |
| OS-EXT-STS:vm_state                  | active                                                 |
| OS-EXT-SRV-ATTR:instance_name        | instance-0000004a                                                                                                      |
| OS-SRV-USG:launched_at                                                                         | 2014-02-17T11:08:13.000000                                                                   |
| OS-EXT-SRV-ATTR:hypervisor_hostname  | dfw01.localdomain                                                                                       |
| flavor                               | m1.small (2)                                                     |
| id                                   | 526b803d-ded5-48d8-857a-f622f6082c18     |
| security_groups                      | [{u'name': u'default'}]                          |
| OS-SRV-USG:terminated_at             | None                                              |
| user_id                              | 970ed56ef7bc41d59c54f5ed8a1690dc      |
| name                                 | VF20GLF                                                         |
| created                              | 2014-02-17T11:08:07Z                                |
| tenant_id                            | d0a0acfdb62b4cc8a2bfa8d6a08bb62f    |
| OS-DCF:diskConfig                    | MANUAL                                              |
| metadata                             | {}                                                                 |
| os-extended-volumes:volumes_attached | [{u'id': u'296d02ff-6e2a-424a-bd79-e75ed52875fc'}]       |
| accessIPv4                           |                                                                     |
| accessIPv6                           |                                                                     |
| progress                             | 0                                                                    |
| OS-EXT-STS:power_state               | 1                                                     |
| OS-EXT-AZ:availability_zone          | nova                                              |
| config_drive                         |                                                                     |
+--------------------------------------+----------------------------------------------------------+


[root@dfw02 ~(keystone_admin)]$ nova-manage service list
Binary           Host                                 Zone             Status     State Updated_At
nova-scheduler   dfw02.localdomain                    internal         enabled    :-)   2014-02-17 15:20:11
nova-conductor   dfw02.localdomain                    internal         enabled    :-)   2014-02-17 15:20:11
nova-compute     dfw01.localdomain                    nova             enabled    :-)   2014-02-17 15:20:12

   Top at Compute :-

  

      Top at Controller :-

      

Now about another "Two Node Neutron GRE + OVS" 

   Watch also carefully "ovs-vsctl outputs on Controller & Compute , presence of block :-

On controller :

Port "gre-2"
            Interface "gre-2"
                type: gre
                options: {in_key=flow, local_ip="192.168.1.130", out_key=flow, remote_ip="192.168.1.140"}

and this one on compute:

Port "gre-1"
            Interface "gre-1"
                type: gre
                options: {in_key=flow, local_ip="192.168.1.140", out_key=flow, remote_ip="192.168.1.130"}


is important for success . It might be gone from "ovs-vsctl show" report.

Initial point start testing . Continue per http://bderzhavets.blogspot.com/2014/01/setting-up-two-physical-node-openstack.html

System is functional.

Controller - dallas1.localdomain 192.168.1.130
Compute  -  dallas2.localdomain 192.168.1.140


[root@dallas1 ~(keystone_admin)]$ date
Sat Feb 15 11:05:12 MSK 2014

[root@dallas1 ~(keystone_admin)]$ openstack-status

== Nova services ==
openstack-nova-api:                     active
openstack-nova-cert:                    inactive  (disabled on boot)
openstack-nova-compute:                 inactive  (disabled on boot)
openstack-nova-network:                 inactive  (disabled on boot)
openstack-nova-scheduler:               active
openstack-nova-volume:                  inactive  (disabled on boot)
openstack-nova-conductor:               active

== Glance services ==
openstack-glance-api:                   active
openstack-glance-registry:              active

== Keystone service ==
openstack-keystone:                     active

== neutron services ==
neutron-server:                         active
neutron-dhcp-agent:                     active
neutron-l3-agent:                       active
neutron-metadata-agent:                 active
neutron-lbaas-agent:                    inactive  (disabled on boot)
neutron-openvswitch-agent:              active
neutron-linuxbridge-agent:              inactive  (disabled on boot)
neutron-ryu-agent:                      inactive  (disabled on boot)
neutron-nec-agent:                      inactive  (disabled on boot)
neutron-mlnx-agent:                     inactive  (disabled on boot)

== Cinder services ==
openstack-cinder-api:                   active
openstack-cinder-scheduler:             active
openstack-cinder-volume:                active

== Support services ==
mysqld:                                 inactive  (disabled on boot)
libvirtd:                               active
openvswitch:                            active
dbus:                                   active
tgtd:                                   active
qpidd:                                  active

== Keystone users ==
+----------------------------------+---------+---------+-------+
|                id                |   name  | enabled | email |
+----------------------------------+---------+---------+-------+
| 974006673310455e8893e692f1d9350b |  admin  |   True  |       |
| fbba3a8646dc44e28e5200381d77493b |  cinder |   True  |       |
| 0214c6ae6ebc4d6ebeb3e68d825a1188 |  glance |   True  |       |
| abb1fa95b0ec448ea8da3cc99d61d301 | kashyap |   True  |       |
| 329b3ca03a894b319420b3a166d461b5 | neutron |   True  |       |
| 89b3f7d54dd04648b0519f8860bd0f2a |   nova  |   True  |       |
+----------------------------------+---------+---------+-------+

== Glance images ==
+--------------------------------------+---------------------+-------------+------------------+-----------+--------+
| ID                                   | Name                | Disk Format | Container Format | Size      | Status |
+--------------------------------------+---------------------+-------------+------------------+-----------+--------+
| 2cada436-30a7-425b-9e75-ce56764cdd13 | Cirros31            | qcow2       | bare             | 13147648  | active |
| c0b90f9e-fd47-46da-b98b-1144a41a6c08 | Fedora 20 x86_64    | qcow2       | bare             | 214106112 | active |
| 2dcc95ad-ebef-43f1-ae14-8d28e6f8194b | Ubuntu 13.10 Server | qcow2       | bare             | 244711424 | active |
+--------------------------------------+---------------------+-------------+------------------+-----------+--------+

== Nova managed services ==
+----------------+---------------------+----------+---------+-------+----------------------------+-----------------+
| Binary         | Host                | Zone     | Status  | State | Updated_at                 | Disabled Reason |
+----------------+---------------------+----------+---------+-------+----------------------------+-----------------+
| nova-scheduler | dallas1.localdomain | internal | enabled | up    | 2014-02-15T08:14:54.000000 | None            |
| nova-conductor | dallas1.localdomain | internal | enabled | up    | 2014-02-15T08:14:54.000000 | None            |
| nova-compute   | dallas2.localdomain | nova     | enabled | up    | 2014-02-15T08:14:59.000000 | None            |
+----------------+---------------------+----------+---------+-------+----------------------------+-----------------+

== Nova networks ==
+--------------------------------------+-------+------+
| ID                                   | Label | Cidr |
+--------------------------------------+-------+------+
| 082249a5-08f4-478f-b176-effad0ef6843 | ext   | None |
| cea0463e-1ef2-46ac-a449-d1c265f5ed7c | int   | None |
+--------------------------------------+-------+------+

== Nova instance flavors ==
+----+-----------+-----------+------+-----------+------+-------+-------------+-----------+
| ID | Name      | Memory_MB | Disk | Ephemeral | Swap | VCPUs | RXTX_Factor | Is_Public |
+----+-----------+-----------+------+-----------+------+-------+-------------+-----------+
| 1  | m1.tiny   | 512       | 1    | 0         |      | 1     | 1.0         | True      |
| 2  | m1.small  | 2048      | 20   | 0         |      | 1     | 1.0         | True      |
| 3  | m1.medium | 4096      | 40   | 0         |      | 2     | 1.0         | True      |
| 4  | m1.large  | 8192      | 80   | 0         |      | 4     | 1.0         | True      |
| 5  | m1.xlarge | 16384     | 160  | 0         |      | 8     | 1.0         | True      |
+----+-----------+-----------+------+-----------+------+-------+-------------+-----------+

== Nova instances ==
+--------------------------------------+-----------+--------+------------+-------------+-----------------------------+
| ID                                   | Name      | Status | Task State | Power State | Networks                    |
+--------------------------------------+-----------+--------+------------+-------------+-----------------------------+
| 56794a06-3c2b-45d1-a024-aeb94be598dc | Cirrus311 | ACTIVE | None       | Running     | int=10.0.0.2, 192.168.1.101 |
| 6adf0838-bfcf-4980-a0a4-6a541facf9c9 | UbuntuSRV | ACTIVE | None       | Running     | int=10.0.0.5, 192.168.1.103 |
| c0e2bea9-aba8-48b2-adce-ceeee47a607b | VF20WXL   | ACTIVE | None       | Running     | int=10.0.0.4, 192.168.1.102 |
+--------------------------------------+-----------+--------+------------+-------------+------------------------------

Looks good on both Controller and Compute

[root@dallas1 nova]# ovs-vsctl show
2790327e-fde5-4f35-9c99-b1180353b29e
    Bridge br-int
        Port br-int
            Interface br-int
                type: internal
        Port "qr-f38eb3d5-20"
            tag: 1
            Interface "qr-f38eb3d5-20"
                type: internal
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
        Port "tap5d1add26-f3"
            tag: 1
            Interface "tap5d1add26-f3"
                type: internal
    Bridge br-ex
        Port "p37p1"
            Interface "p37p1"
        Port br-ex
            Interface br-ex
                type: internal
        Port "qg-0dea8587-32"
            Interface "qg-0dea8587-32"
                type: internal
    Bridge br-tun
        Port "gre-2"
            Interface "gre-2"
                type: gre
                options: {in_key=flow, local_ip="192.168.1.130", out_key=flow, remote_ip="192.168.1.140"}
        Port br-tun
            Interface br-tun
                type: internal
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
    ovs_version: "2.0.0"

[root@dallas2 ~]# ovs-vsctl show
b2e33386-ca7e-46e2-b97e-6bbf511727ac
    Bridge br-int
        Port br-int
            Interface br-int
                type: internal
        Port "qvo30c356f8-c0"
            tag: 1
            Interface "qvo30c356f8-c0"
        Port "qvoa5c6c346-78"
            tag: 1
            Interface "qvoa5c6c346-78"
        Port "qvo56bfcccb-86"
            tag: 1
            Interface "qvo56bfcccb-86"
        Port "qvo051565c4-dd"
            tag: 1
            Interface "qvo051565c4-dd"
        Port patch-tun
            Interface patch-tun
                type: patch
                options: {peer=patch-int}
    Bridge br-tun
        Port patch-int
            Interface patch-int
                type: patch
                options: {peer=patch-tun}
        Port "gre-1"
            Interface "gre-1"
                type: gre
                options: {in_key=flow, local_ip="192.168.1.140", out_key=flow, remote_ip="192.168.1.130"}
        Port br-tun
            Interface br-tun
                type: internal
    ovs_version: "2.0.0"


[root@dallas1 ~(keystone_admin)]$ nova boot --flavor 2 --user-data=./myfile.txt --image 2dcc95ad-ebef-43f1-ae14-8d28e6f8194b UbuntuSRV

+--------------------------------------+--------------------------------------+
| Property                             | Value                                |
+--------------------------------------+--------------------------------------+
| OS-EXT-STS:task_state                | scheduling                           |
| image                                | Ubuntu 13.10 Server                  |
| OS-EXT-STS:vm_state                  | building                             |
| OS-EXT-SRV-ATTR:instance_name        | instance-00000003                    |
| OS-SRV-USG:launched_at               | None                                 |
| flavor                               | m1.small                             |
| id                                   | 6adf0838-bfcf-4980-a0a4-6a541facf9c9 |
| security_groups                      | [{u'name': u'default'}]              |
| user_id                              | 974006673310455e8893e692f1d9350b     |
| OS-DCF:diskConfig                    | MANUAL                               |
| accessIPv4                           |                                      |
| accessIPv6                           |                                      |
| progress                             | 0                                    |
| OS-EXT-STS:power_state               | 0                                    |
| OS-EXT-AZ:availability_zone          | nova                                 |
| config_drive                         |                                      |
| status                               | BUILD                                |
| updated                              | 2014-02-15T07:24:54Z                 |
| hostId                               |                                      |
| OS-EXT-SRV-ATTR:host                 | None                                 |
| OS-SRV-USG:terminated_at             | None                                 |
| key_name                             | None                                 |
| OS-EXT-SRV-ATTR:hypervisor_hostname  | None                                 |
| name                                 | UbuntuSRV                            |
| adminPass                            | T2ArvfucEGqr                         |
| tenant_id                            | b5c0d0d4d31e4f3785362f2716df0b0f     |
| created                              | 2014-02-15T07:24:54Z                 |
| os-extended-volumes:volumes_attached | []                                   |
| metadata                             | {}                                   |
+--------------------------------------+--------------------------------------+

[root@dallas1 ~(keystone_admin)]$ nova list

+--------------------------------------+-----------+--------+------------+-------------+-----------------------------+
| ID                                   | Name      | Status | Task State | Power State | Networks                    |
+--------------------------------------+-----------+--------+------------+-------------+-----------------------------+
| 56794a06-3c2b-45d1-a024-aeb94be598dc | Cirrus311 | ACTIVE | None       | Running     | int=10.0.0.2, 192.168.1.101 |
| 6adf0838-bfcf-4980-a0a4-6a541facf9c9 | UbuntuSRV | BUILD  | spawning   | NOSTATE     | int=10.0.0.5                |
| c0e2bea9-aba8-48b2-adce-ceeee47a607b | VF20WXL   | ACTIVE | None       | Running     | int=10.0.0.4, 192.168.1.102 |
+--------------------------------------+-----------+--------+------------+-------------+-----------------------------+

[root@dallas1 ~(keystone_admin)]$ date
Sat Feb 15 11:25:36 MSK 2014

[root@dallas1 ~(keystone_admin)]$ nova list
+--------------------------------------+-----------+--------+------------+-------------+-----------------------------+
| ID                                   | Name      | Status | Task State | Power State | Networks                    |
+--------------------------------------+-----------+--------+------------+-------------+-----------------------------+
| 56794a06-3c2b-45d1-a024-aeb94be598dc | Cirrus311 | ACTIVE | None       | Running     | int=10.0.0.2, 192.168.1.101 |
| 6adf0838-bfcf-4980-a0a4-6a541facf9c9 | UbuntuSRV | ACTIVE | None       | Running     | int=10.0.0.5                |
| c0e2bea9-aba8-48b2-adce-ceeee47a607b | VF20WXL   | ACTIVE | None       | Running     | int=10.0.0.4, 192.168.1.102 |
+--------------------------------------+-----------+--------+------------+-------------+------------------

/var/log/nova/schedure.log ( last message about 1 hour before successfull `nova boot  .. ` F20, Ubuntu 13.10, Cirrus loaded OK.

I believe the number of `nova boot .. ` successful commands I still have is equal (5- number_of_nova_boot_done). After then I will have delete existing instance to create new one.



The last record in /var/log/nova/scheduler.log :-

2014-02-15 09:37:03.713 1111 ERROR nova.openstack.common.rpc.impl_qpid [req-4363af36-3f90-49b9-abaa-835797891946 None None] Unable to connect to AMQP server: [Errno 111] ECONNREFUSED. Sleeping 60 seconds


Nothing else, still working fine.


  


[root@dallas1 ~(keystone_admin)]$ date
Sat Feb 15 12:44:33 MSK 2014


[root@dallas1 Downloads(keystone_admin)]$ nova image-list
+--------------------------------------+---------------------+--------+--------+
| ID                                   | Name                | Status | Server |
+--------------------------------------+---------------------+--------+--------+
| 2cada436-30a7-425b-9e75-ce56764cdd13 | Cirros31            | ACTIVE |        |
| fd1cd492-d7d8-4fc3-961a-0b43f9aa148d | Fedora 20 Image     | ACTIVE |        |
| c0b90f9e-fd47-46da-b98b-1144a41a6c08 | Fedora 20 x86_64    | ACTIVE |        |
| 2dcc95ad-ebef-43f1-ae14-8d28e6f8194b | Ubuntu 13.10 Server | ACTIVE |        |
+--------------------------------------+---------------------+--------+--------+

[root@dallas1 Downloads(keystone_admin)]$ cd

[root@dallas1 ~(keystone_admin)]$ nova boot --flavor 2 --user-data=./myfile.txt --image fd1cd492-d7d8-4fc3-961a-0b43f9aa148d VF20GLS

+--------------------------------------+--------------------------------------+
| Property                             | Value                                |
+--------------------------------------+--------------------------------------+
| OS-EXT-STS:task_state                | scheduling                           |
| image                                | Fedora 20 Image                      |
| OS-EXT-STS:vm_state                  | building                             |
| OS-EXT-SRV-ATTR:instance_name        | instance-00000004                    |
| OS-SRV-USG:launched_at               | None                                 |
| flavor                               | m1.small                             |
| id                                   | e948e74c-86e5-46e3-9df1-5b7ab890cb8a |
| security_groups                      | [{u'name': u'default'}]              |
| user_id                              | 974006673310455e8893e692f1d9350b     |
| OS-DCF:diskConfig                    | MANUAL                               |
| accessIPv4                           |                                      |
| accessIPv6                           |                                      |
| progress                             | 0                                    |
| OS-EXT-STS:power_state               | 0                                    |
| OS-EXT-AZ:availability_zone          | nova                                 |
| config_drive                         |                                      |
| status                               | BUILD                                |
| updated                              | 2014-02-15T09:04:22Z                 |
| hostId                               |                                      |
| OS-EXT-SRV-ATTR:host                 | None                                 |
| OS-SRV-USG:terminated_at             | None                                 |
| key_name                             | None                                 |
| OS-EXT-SRV-ATTR:hypervisor_hostname  | None                                 |
| name                                 | VF20GLS                              |
| adminPass                            | i5Lb79SybSpV                         |
| tenant_id                            | b5c0d0d4d31e4f3785362f2716df0b0f     |
| created                              | 2014-02-15T09:04:22Z                 |
| os-extended-volumes:volumes_attached | []                                   |
| metadata                             | {}                                   |
+--------------------------------------+--------------------------------------+

[root@dallas1 ~(keystone_admin)]$ nova list
+--------------------------------------+-----------+-----------+------------+-------------+-----------------------------+
| ID                                   | Name      | Status    | Task State | Power State | Networks                    |
+--------------------------------------+-----------+-----------+------------+-------------+-----------------------------+
| 56794a06-3c2b-45d1-a024-aeb94be598dc | Cirrus311 | ACTIVE    | None       | Running     | int=10.0.0.2, 192.168.1.101 |
| 6adf0838-bfcf-4980-a0a4-6a541facf9c9 | UbuntuSRV | ACTIVE    | None       | Running     | int=10.0.0.5, 192.168.1.103 |
| e948e74c-86e5-46e3-9df1-5b7ab890cb8a | VF20GLS   | BUILD     | spawning   | NOSTATE     | int=10.0.0.6                |
| c0e2bea9-aba8-48b2-adce-ceeee47a607b | VF20WXL   | SUSPENDED | None       | Shutdown    | int=10.0.0.4, 192.168.1.102 |
+--------------------------------------+-----------+-----------+------------+-------------+-----------------------------+

[root@dallas1 ~(keystone_admin)]$ nova list
+--------------------------------------+-----------+-----------+------------+-------------+-----------------------------+
| ID                                   | Name      | Status    | Task State | Power State | Networks                    |
+--------------------------------------+-----------+-----------+------------+-------------+-----------------------------+
| 56794a06-3c2b-45d1-a024-aeb94be598dc | Cirrus311 | ACTIVE    | None       | Running     | int=10.0.0.2, 192.168.1.101 |
| 6adf0838-bfcf-4980-a0a4-6a541facf9c9 | UbuntuSRV | ACTIVE    | None       | Running     | int=10.0.0.5, 192.168.1.103 |
| e948e74c-86e5-46e3-9df1-5b7ab890cb8a | VF20GLS   | ACTIVE    | None       | Running     | int=10.0.0.6                |
| c0e2bea9-aba8-48b2-adce-ceeee47a607b | VF20WXL   | SUSPENDED | None       | Shutdown    | int=10.0.0.4, 192.168.1.102 |
+--------------------------------------+-----------+-----------+------------+-------------+-----------------------------+

[root@dallas1 ~(keystone_admin)]$ neutron floatingip-create ext
Created a new floatingip:
+---------------------+--------------------------------------+
| Field               | Value                                |
+---------------------+--------------------------------------+
| fixed_ip_address    |                                      |
| floating_ip_address | 192.168.1.104                        |
| floating_network_id | 082249a5-08f4-478f-b176-effad0ef6843 |
| id                  | b582d8f9-8e44-4282-a71c-20f36f2e3d89 |
| port_id             |                                      |
| router_id           |                                      |
| tenant_id           | b5c0d0d4d31e4f3785362f2716df0b0f     |
+---------------------+--------------------------------------+

[root@dallas1 ~(keystone_admin)]$ neutron port-list --device-id e948e74c-86e5-46e3-9df1-5b7ab890cb8a
+--------------------------------------+------+-------------------+---------------------------------------------------------------------------------+
| id                                   | name | mac_address       | fixed_ips                                                                       |
+--------------------------------------+------+-------------------+---------------------------------------------------------------------------------+
| 30c356f8-c0e9-439b-b68e-6c1e950b39ef |      | fa:16:3e:7f:4a:57 | {"subnet_id": "3d75d529-9a18-46d3-ac08-7cb4c733636c", "ip_address": "10.0.0.6"} |
+--------------------------------------+------+-------------------+---------------------------------------------------------------------------------+


[root@dallas1 ~(keystone_admin)]$ neutron floatingip-associate b582d8f9-8e44-4282-a71c-20f36f2e3d89 30c356f8-c0e9-439b-b68e-6c1e950b39ef
Associated floatingip b582d8f9-8e44-2014-02-15


[root@dallas1 ~(keystone_admin)]$ ping 192.168.1.104
PING 192.168.1.104 (192.168.1.104) 56(84) bytes of data.
64 bytes from 192.168.1.104: icmp_seq=1 ttl=63 time=3.67 ms
64 bytes from 192.168.1.104: icmp_seq=2 ttl=63 time=0.758 ms
64 bytes from 192.168.1.104: icmp_seq=3 ttl=63 time=0.687 ms
64 bytes from 192.168.1.104: icmp_seq=4 ttl=63 time=0.731 ms
64 bytes from 192.168.1.104: icmp_seq=5 ttl=63 time=0.767 ms
64 bytes from 192.168.1.104: icmp_seq=6 ttl=63 time=0.713 ms
64 bytes from 192.168.1.104: icmp_seq=7 ttl=63 time=0.817 ms
64 bytes from 192.168.1.104: icmp_seq=8 ttl=63 time=0.741 ms
64 bytes from 192.168.1.104: icmp_seq=9 ttl=63 time=0.703 ms
^C
--- 192.168.1.104 ping statistics ---
9 packets transmitted, 9 received, 0% packet loss, time 8002ms
rtt min/avg/max/mdev = 0.687/1.065/3.674/0.923 ms


[root@dallas1 ~(keystone_admin)]$ date
Sat Feb 15 13:15:13 MSK 2014


Check same log :-


2014-02-15 09:36:03.663 1111 ERROR nova.openstack.common.rpc.impl_qpid [req-4363af36-3f90-49b9-abaa-835797891946 None None] Unable to connect to AMQP server: [Errno 111] ECONNREFUSED. Sleeping 60 seconds





  Top at Compute Node :-

 


[root@dallas2 ~]# virsh list --all

 Id    Name                           State
----------------------------------------------------
 4     instance-00000001              running
 5     instance-00000003              running
 9     instance-00000005              running
 10    instance-00000002              running
 11    instance-00000004              running

Finally, I get ERROR&NOSTATE at 16:28

[root@dallas1 ~(keystone_admin)]$ nova list
+--------------------------------------+-----------+-----------+------------+-------------+-----------------------------+
| ID                                   | Name      | Status    | Task State | Power State | Networks                    |
+--------------------------------------+-----------+-----------+------------+-------------+-----------------------------+
| 56794a06-3c2b-45d1-a024-aeb94be598dc | Cirrus311 | SUSPENDED | None       | Shutdown    | int=10.0.0.2, 192.168.1.101 |
| ee3ff870-91b7-4d14-bb06-e9a6603f0a83 | UbuntuSLM | ERROR     | None       | NOSTATE     |                             |
| 6adf0838-bfcf-4980-a0a4-6a541facf9c9 | UbuntuSRV | SUSPENDED | None       | Shutdown    | int=10.0.0.5, 192.168.1.103 |
| 5e43c64d-41cf-413f-b317-0046b070a7a4 | VF20GLS   | SUSPENDED | None       | Shutdown    | int=10.0.0.7, 192.168.1.105 |
| e948e74c-86e5-46e3-9df1-5b7ab890cb8a | VF20GLS   | SUSPENDED | None       | Shutdown    | int=10.0.0.6, 192.168.1.104 |
| c0e2bea9-aba8-48b2-adce-ceeee47a607b | VF20WXL   | SUSPENDED | None       | Shutdown    | int=10.0.0.4, 192.168.1.102 |
+--------------------------------------+-----------+-----------+------------+-------------+-----------------------------+

[root@dallas1 ~(keystone_admin)]$ date
Sat Feb 15 16:28:35 MSK 2014


I was allowed to create 5 instance . Six one goes to ERROR&NOSTATE

If I need another instance to be setup on my Compute node I do have remove
one of old ones and have `nova list` containing 4 rows

[root@dallas1 ~(keystone_admin)]$ nova boot --flavor 2 --user-data=./myfile.txt --image 14cf6e7b-9aed-40c6-8185-366eb0c4c397 UbuntuSL3 

+--------------------------------------+--------------------------------------+
| Property                             | Value                                |
+--------------------------------------+--------------------------------------+
| OS-EXT-STS:task_state                | scheduling                           |
| image                                | Ubuntu Salamander Server             |
| OS-EXT-STS:vm_state                  | building                             |
| OS-EXT-SRV-ATTR:instance_name        | instance-00000009                    |
| OS-SRV-USG:launched_at               | None                                 |
| flavor                               | m1.small                             |
| id                                   | 2712446b-3442-4af2-a330-c9365736ee73 |
| security_groups                      | [{u'name': u'default'}]              |
| user_id                              | 974006673310455e8893e692f1d9350b     |
| OS-DCF:diskConfig                    | MANUAL                               |
| accessIPv4                           |                                      |
| accessIPv6                           |                                      |
| progress                             | 0                                    |
| OS-EXT-STS:power_state               | 0                                    |
| OS-EXT-AZ:availability_zone          | nova                                 |
| config_drive                         |                                      |
| status                               | BUILD                                |
| updated                              | 2014-02-15T12:44:36Z                 |
| hostId                               |                                      |
| OS-EXT-SRV-ATTR:host                 | None                                 |
| OS-SRV-USG:terminated_at             | None                                 |
| key_name                             | None                                 |
| OS-EXT-SRV-ATTR:hypervisor_hostname  | None                                 |
| name                                 | UbuntuSL3                            |
| adminPass                            | zq3n5FCktcYB                         |
| tenant_id                            | b5c0d0d4d31e4f3785362f2716df0b0f     |
| created                              | 2014-02-15T12:44:36Z                 |
| os-extended-volumes:volumes_attached | []                                   |
| metadata                             | {}                                   |
+--------------------------------------+--------------------------------------+
 

[root@dallas1 ~(keystone_admin)]$ nova list
+--------------------------------------+-----------+-----------+------------+-------------+-----------------------------+
| ID                                   | Name      | Status    | Task State | Power State | Networks                    |
+--------------------------------------+-----------+-----------+------------+-------------+-----------------------------+
| 56794a06-3c2b-45d1-a024-aeb94be598dc | Cirrus311 | SUSPENDED | None       | Shutdown    | int=10.0.0.2, 192.168.1.101 |
| 2712446b-3442-4af2-a330-c9365736ee73 | UbuntuSL3 | BUILD     | spawning   | NOSTATE     | int=10.0.0.6                |
| 6adf0838-bfcf-4980-a0a4-6a541facf9c9 | UbuntuSRV | SUSPENDED | None       | Shutdown    | int=10.0.0.5, 192.168.1.103 |
| 5e43c64d-41cf-413f-b317-0046b070a7a4 | VF20GLS   | ACTIVE    | None       | Running     | int=10.0.0.7, 192.168.1.105 |
| c0e2bea9-aba8-48b2-adce-ceeee47a607b | VF20WXL   | SUSPENDED | None       | Shutdown    | int=10.0.0.4, 192.168.1.102 |
+--------------------------------------+-----------+-----------+------------+-------------+-----------------------------+
 



[root@dallas1 ~(keystone_admin)]$ nova list
+--------------------------------------+-----------+-----------+------------+-------------+-----------------------------+
| ID                                   | Name      | Status    | Task State | Power State | Networks                    |
+--------------------------------------+-----------+-----------+------------+-------------+-----------------------------+
| 56794a06-3c2b-45d1-a024-aeb94be598dc | Cirrus311 | SUSPENDED | None       | Shutdown    | int=10.0.0.2, 192.168.1.101 |
| 2712446b-3442-4af2-a330-c9365736ee73 | UbuntuSL3 | ACTIVE    | None       | Running     | int=10.0.0.6                |
| 6adf0838-bfcf-4980-a0a4-6a541facf9c9 | UbuntuSRV | SUSPENDED | None       | Shutdown    | int=10.0.0.5, 192.168.1.103 |
| 5e43c64d-41cf-413f-b317-0046b070a7a4 | VF20GLS   | ACTIVE    | None       | Running     | int=10.0.0.7, 192.168.1.105 |
| c0e2bea9-aba8-48b2-adce-ceeee47a607b | VF20WXL   | SUSPENDED | None       | Shutdown    | int=10.0.0.4, 192.168.1.102 |
+--------------------------------------+-----------+-----------+------------+-------------+-----------------------------+
 

Here goes sample on another Cluster :-

First make number of instances on system <= 4 and run

[root@dfw02 ~(keystone_admin)]$ nova boot --flavor 2  --user-data=./myfile.txt --block_device_mapping vda=4cb4c501-c7b1-4c42-ba26-0141fcde038b:::0 VF20SX4

+--------------------------------------+----------------------------------------------------+
| Property                             | Value                                              |
+--------------------------------------+----------------------------------------------------+
| OS-EXT-STS:task_state                | scheduling                                         |
| image                                | Attempt to boot from volume - no image supplied    |
| OS-EXT-STS:vm_state                  | building                                           |
| OS-EXT-SRV-ATTR:instance_name        | instance-0000003c                                  |
| OS-SRV-USG:launched_at               | None                                               |
| flavor                               | m1.small                                           |
| id                                   | 4b619f27-30ba-4bd0-bd03-019b3c5d4bf7               |
| security_groups                      | [{u'name': u'default'}]                            |
| user_id                              | 970ed56ef7bc41d59c54f5ed8a1690dc                   |
| OS-DCF:diskConfig                    | MANUAL                                             |
| accessIPv4                           |                                                    |
| accessIPv6                           |                                                    |
| progress                             | 0                                                  |
| OS-EXT-STS:power_state               | 0                                                  |
| OS-EXT-AZ:availability_zone          | nova                                               |
| config_drive                         |                                                    |
| status                               | BUILD                                              |
| updated                              | 2014-02-16T06:15:34Z                               |
| hostId                               |                                                    |
| OS-EXT-SRV-ATTR:host                 | None                                               |
| OS-SRV-USG:terminated_at             | None                                               |
| key_name                             | None                                               |
| OS-EXT-SRV-ATTR:hypervisor_hostname  | None                                               |
| name                                 | VF20SX4                                            |
| adminPass                            | C8r6vtF3kHJi                                       |
| tenant_id                            | d0a0acfdb62b4cc8a2bfa8d6a08bb62f                   |
| created                              | 2014-02-16T06:15:33Z                               |
| os-extended-volumes:volumes_attached | [{u'id': u'4cb4c501-c7b1-4c42-ba26-0141fcde038b'}] |
| metadata                             | {}                                                 |
+--------------------------------------+----------------------------------------------------+

[root@dfw02 ~(keystone_admin)]$ nova list
+--------------------------------------+------------------+-----------+------------+-------------+-----------------------------+
| ID                                   | Name             | Status    | Task State | Power State | Networks                    |
+--------------------------------------+------------------+-----------+------------+-------------+-----------------------------+
| 964fd0b0-b331-4b0c-a1d5-118bf8a40abf | CentOS6.5        | SUSPENDED | None       | Shutdown    | int=10.0.0.5, 192.168.1.105 |
| 3f2db906-567c-48b0-967e-799b2bffe277 | Cirros312        | SUSPENDED | None       | Shutdown    | int=10.0.0.2, 192.168.1.101 |
| 95a36074-5145-4959-b3b3-2651f2ac1a9c | UbuntuSalamander | SUSPENDED | None       | Shutdown    | int=10.0.0.8, 192.168.1.104 |
| 4b619f27-30ba-4bd0-bd03-019b3c5d4bf7 | VF20SX4          | ACTIVE    | None       | Running     | int=10.0.0.4                |
| 55f6e0bc-281e-480d-b88f-193207ea4d4a | VF20XWL          | SUSPENDED | None       | Shutdown    | int=10.0.0.7, 192.168.1.108 |
+--------------------------------------+------------------+-----------+------------+-------------+-----------------------------+


[root@dfw02 ~(keystone_admin)]$ nova show 4b619f27-30ba-4bd0-bd03-019b3c5d4bf7
+--------------------------------------+----------------------------------------------------------+
| Property                             | Value                                                    |
+--------------------------------------+----------------------------------------------------------+
| status                               | ACTIVE                                                   |
| updated                              | 2014-02-16T06:15:39Z                                     |
| OS-EXT-STS:task_state                | None                                                     |
| OS-EXT-SRV-ATTR:host                 | dfw01.localdomain                                        |
| key_name                             | None                                                     |
| image                                | Attempt to boot from volume - no image supplied          |
| int network                          | 10.0.0.4, 192.168.1.110                                  |
| hostId                               | b67c11ccfa8ac8c9ed019934fa650d307f91e7fe7bbf8cd6874f3e01 |
| OS-EXT-STS:vm_state                  | active                                                   |
| OS-EXT-SRV-ATTR:instance_name        | instance-0000003c                                        |
| OS-SRV-USG:launched_at               | 2014-02-16T06:15:39.000000                               |
| OS-EXT-SRV-ATTR:hypervisor_hostname  | dfw01.localdomain                                        |
| flavor                               | m1.small (2)                                             |
| id                                   | 4b619f27-30ba-4bd0-bd03-019b3c5d4bf7                     |
| security_groups                      | [{u'name': u'default'}]                                  |
| OS-SRV-USG:terminated_at             | None                                                     |
| user_id                              | 970ed56ef7bc41d59c54f5ed8a1690dc                         |
| name                                 | VF20SX4                                                  |
| created                              | 2014-02-16T06:15:33Z                                     |
| tenant_id                            | d0a0acfdb62b4cc8a2bfa8d6a08bb62f                         |
| OS-DCF:diskConfig                    | MANUAL                                                   |
| metadata                             | {}                                                       |
| os-extended-volumes:volumes_attached | [{u'id': u'4cb4c501-c7b1-4c42-ba26-0141fcde038b'}]       |
| accessIPv4                           |                                                          |
| accessIPv6                           |                                                          |
| progress                             | 0                                                        |
| OS-EXT-STS:power_state               | 1                                                        |
| OS-EXT-AZ:availability_zone          | nova                                                     |
| config_drive                         |                                                          |
+--------------------------------------+----------------------------------------------------------+


Testing tenants network,router,instance creating ability

  
[root@dfw02 ~]#  cat  keystonerc_boris
export OS_USERNAME=boris
export OS_TENANT_NAME=ostenant
export OS_PASSWORD=fedora
export OS_AUTH_URL=http://192.168.1.127:35357/v2.0/
export PS1='[\u@\h \W(keystone_boris)]$ '


[root@dfw02 ~]# . keystonerc_boris

[root@dfw02 ~(keystone_boris)]$ neutron net-list
+--------------------------------------+------+---------------------------------------+
| id                                   | name | subnets                               |
+--------------------------------------+------+---------------------------------------+
| 780ce2f3-2e6e-4881-bbac-857813f9a8e0 | ext  | f30e5a16-a055-4388-a6ea-91ee142efc3d  |
+--------------------------------------+------+---------------------------------------+

[root@dfw02 ~(keystone_boris)]$ neutron router-create router2 Created a new router:
+-----------------------+--------------------------------------+
| Field                 | Value                                |
+-----------------------+--------------------------------------+
| admin_state_up        | True                                 |
| external_gateway_info |                                      |
| id                    | 86b3008c-297f-4301-9bdc-766b839785f1 |
| name                  | router2                              |
| status                | ACTIVE                               |
| tenant_id             | 4dacfff9e72c4245a48d648ee23468d5     |
+-----------------------+--------------------------------------+

[root@dfw02 ~(keystone_boris)]$ neutron router-gateway-set router2 ext
Set gateway for router router2

[root@dfw02 ~(keystone_boris)]$  neutron net-create int1
Created a new network:
+----------------+--------------------------------------+
| Field          | Value                                |
+----------------+--------------------------------------+
| admin_state_up | True                                 |
| id             | 426bb226-0ab9-440d-ba14-05634a17fb2b |
| name           | int1                                 |
| shared         | False                                |
| status         | ACTIVE                               |
| subnets        |                                      |
| tenant_id      | 4dacfff9e72c4245a48d648ee23468d5     |
+----------------+--------------------------------------+

[root@dfw02 ~(keystone_boris)]$ neutron subnet-create int1 40.0.0.0/24 --dns_nameservers list=true 83.221.202.254
Created a new subnet:
+------------------+--------------------------------------------+
| Field            | Value                                      |
+------------------+--------------------------------------------+
| allocation_pools | {"start": "40.0.0.2", "end": "40.0.0.254"} |
| cidr             | 40.0.0.0/24                                |
| dns_nameservers  | 83.221.202.254                             |
| enable_dhcp      | True                                       |
| gateway_ip       | 40.0.0.1                                   |
| host_routes      |                                            |
| id               | 9e0d457b-c4c4-45cf-84e2-4ac7550f3b06       |
| ip_version       | 4                                          |
| name             |                                            |
| network_id       | 426bb226-0ab9-440d-ba14-05634a17fb2b       |
| tenant_id        | 4dacfff9e72c4245a48d648ee23468d5           |
+------------------+--------------------------------------------+

[root@dfw02 ~(keystone_boris)]$  neutron router-interface-add router2 9e0d457b-c4c4-45cf-84e2-4ac7550f3b06
Added interface e031db6b-d0cc-4c57-877b-53b1c6946870 to router router2.

[root@dfw02 ~(keystone_boris)]$ neutron subnet-list
+--------------------------------------+------+-------------+--------------------------------------------+
| id                                   | name | cidr        | allocation_pools                           |
+--------------------------------------+------+-------------+--------------------------------------------+
| 9e0d457b-c4c4-45cf-84e2-4ac7550f3b06 |      | 40.0.0.0/24 | {"start": "40.0.0.2", "end": "40.0.0.254"} |
+--------------------------------------+------+-------------+--------------------------------------------+

[root@dfw02 ~(keystone_boris)]$ neutron security-group-rule-create --protocol icmp \
>   --direction ingress --remote-ip-prefix 0.0.0.0/0 default

Created a new security_group_rule:
+-------------------+--------------------------------------+
| Field             | Value                                |
+-------------------+--------------------------------------+
| direction         | ingress                              |
| ethertype         | IPv4                                 |
| id                | 4a6deddf-9350-4f98-97d7-a54cf6ebaa9a |
| port_range_max    |                                      |
| port_range_min    |                                      |
| protocol          | icmp                                 |
| remote_group_id   |                                      |
| remote_ip_prefix  | 0.0.0.0/0                            |
| security_group_id | 4b72bcaf-b456-4222-afcc-8885326b96b2 |
| tenant_id         | 4dacfff9e72c4245a48d648ee23468d5     |
+-------------------+--------------------------------------+

[root@dfw02 ~(keystone_boris)]$ neutron security-group-rule-create --protocol tcp \
>   --port-range-min 22 --port-range-max 22 \
>   --direction ingress --remote-ip-prefix 0.0.0.0/0 default

Created a new security_group_rule:
+-------------------+--------------------------------------+
| Field             | Value                                |
+-------------------+--------------------------------------+
| direction         | ingress                              |
| ethertype         | IPv4                                 |
| id                | 7a461936-ffbc-4968-975b-3d27ec975e04 |
| port_range_max    | 22                                   |
| port_range_min    | 22                                   |
| protocol          | tcp                                  |
| remote_group_id   |                                      |
| remote_ip_prefix  | 0.0.0.0/0                            |
| security_group_id | 4b72bcaf-b456-4222-afcc-8885326b96b2 |
| tenant_id         | 4dacfff9e72c4245a48d648ee23468d5     |
+-------------------+--------------------------------------+

[root@dfw02 ~(keystone_boris)]$ glance image-list
+--------------------------------------+---------------------+-------------+------------------+-----------+--------+
| ID                                   | Name                | Disk Format | Container Format | Size      | Status |
+--------------------------------------+---------------------+-------------+------------------+-----------+--------+
| b9782f24-2f37-4f8d-9467-f622507788bf | CentOS6.5 image     | qcow2       | bare             | 344457216 | active |
| dc992799-7831-4933-b6ee-7b81868f808b | CirrOS31            | qcow2       | bare             | 13147648  | active |
| 03c9ad20-b0a3-4b71-aa08-2728ecb66210 | Fedora 19 x86_64    | qcow2       | bare             | 237371392 | active |
| de93ee44-4085-4111-b022-a7437da8feac | Fedora 20 image     | qcow2       | bare             | 214106112 | active |
| e70591fc-6905-4e57-84b7-4ffa7c001864 | Ubuntu Server 13.10 | qcow2       | bare             | 244514816 | active |
| dd8c11d2-f9b0-4b77-9b5e-534c7ac0fd58 | Ubuntu Trusty image | qcow2       | bare             | 246022144 | active |
+--------------------------------------+---------------------+-------------+------------------+-----------+--------+

[root@dfw02 ~(keystone_boris)]$ cinder create --image-id de93ee44-4085-4111-b022-a7437da8feac --display_name VF20VLG02 7 +---------------------+--------------------------------------+
|       Property      |                Value                 |
+---------------------+--------------------------------------+
|     attachments     |                  []                  |
|  availability_zone  |                 nova                 |
|       bootable      |                false                 |
|      created_at     |      2014-02-21T06:36:21.753407      |
| display_description |                 None                 |
|     display_name    |              VF20VLG02               |
|          id         | c3b09e44-1868-43c6-baaa-1ffcb4b80fb1 |
|       image_id      | de93ee44-4085-4111-b022-a7437da8feac |
|       metadata      |                  {}                  |
|         size        |                  7                   |
|     snapshot_id     |                 None                 |
|     source_volid    |                 None                 |
|        status       |               creating               |
|     volume_type     |                 None                 |
+---------------------+--------------------------------------+

[root@dfw02 ~(keystone_boris)]$ cinder list
+--------------------------------------+-------------+--------------+------+-------------+----------+-------------+
|                  ID                  |    Status   | Display Name | Size | Volume Type | Bootable | Attached to |
+--------------------------------------+-------------+--------------+------+-------------+----------+-------------+
| c3b09e44-1868-43c6-baaa-1ffcb4b80fb1 | downloading |  VF20VLG02   |  7   |     None    |  false   |             |
+--------------------------------------+-------------+--------------+------+-------------+----------+-------------+

[root@dfw02 ~(keystone_boris)]$ cinder list
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
|                  ID                  |   Status  | Display Name | Size | Volume Type | Bootable | Attached to |
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+
| c3b09e44-1868-43c6-baaa-1ffcb4b80fb1 | available |  VF20VLG02   |  7   |     None    |   true   |             |
+--------------------------------------+-----------+--------------+------+-------------+----------+-------------+

[root@dfw02 ~(keystone_boris)]$ nova boot --flavor 2  --user-data=./myfile.txt --block_device_mapping vda=c3b09e44-1868-43c6-baaa-1ffcb4b80fb1:::0 VF20XWS
+--------------------------------------+----------------------------------------------------+
| Property                             | Value                                              |
+--------------------------------------+----------------------------------------------------+
| status                               | BUILD                                              |
| updated                              | 2014-02-21T06:49:42Z                               |
| OS-EXT-STS:task_state                | scheduling                                         |
| key_name                             | None                                               |
| image                                | Attempt to boot from volume - no image supplied    |
| hostId                               |                                                    |
| OS-EXT-STS:vm_state                  | building                                           |
| OS-SRV-USG:launched_at               | None                                               |
| flavor                               | m1.small                                           |
| id                                   | c4573327-dd99-4e57-941e-3d35aacb637c               |
| security_groups                      | [{u'name': u'default'}]                            |
| OS-SRV-USG:terminated_at             | None                                               |
| user_id                              | 162021e787c54cac906ab3296a386006                   |
| name                                 | VF20XWS                                            |
| adminPass                            | YkPYdW58gz7K                                       |
| tenant_id                            | 4dacfff9e72c4245a48d648ee23468d5                   |
| created                              | 2014-02-21T06:49:42Z                               |
| OS-DCF:diskConfig                    | MANUAL                                             |
| metadata                             | {}                                                 |
| os-extended-volumes:volumes_attached | [{u'id': u'c3b09e44-1868-43c6-baaa-1ffcb4b80fb1'}] |
| accessIPv4                           |                                                    |
| accessIPv6                           |                                                    |
| progress                             | 0                                                  |
| OS-EXT-STS:power_state               | 0                                                  |
| OS-EXT-AZ:availability_zone          | nova                                               |
| config_drive                         |                                                    |
+--------------------------------------+----------------------------------------------------+

[root@dfw02 ~(keystone_boris)]$ nova list
+--------------------------------------+---------+--------+------------+-------------+---------------+
| ID                                   | Name    | Status | Task State | Power State | Networks      |
+--------------------------------------+---------+--------+------------+-------------+---------------+
| c4573327-dd99-4e57-941e-3d35aacb637c | VF20XWS | ACTIVE | None       | Running     | int1=40.0.0.2 |
+--------------------------------------+---------+--------+------------+-------------+---------------+

[root@dfw02 ~(keystone_boris)]$ neutron floatingip-create ext
Created a new floatingip:
+---------------------+--------------------------------------+
| Field               | Value                                |
+---------------------+--------------------------------------+
| fixed_ip_address    |                                      |
| floating_ip_address | 192.168.1.115                        |
| floating_network_id | 780ce2f3-2e6e-4881-bbac-857813f9a8e0 |
| id                  | 64dd749f-6127-4d0f-ba51-8a9978b8c211 |
| port_id             |                                      |
| router_id           |                                      |
| tenant_id           | 4dacfff9e72c4245a48d648ee23468d5     |
+---------------------+--------------------------------------+

[root@dfw02 ~(keystone_boris)]$ neutron port-list --device-id c4573327-dd99-4e57-941e-3d35aacb637c
+--------------------------------------+------+-------------------+---------------------------------------------------------------------------------+
| id                                   | name | mac_address       | fixed_ips                                                                       |
+--------------------------------------+------+-------------------+---------------------------------------------------------------------------------+
| 2d6c6569-44c3-44b2-8bed-cdc8dde12336 |      | fa:16:3e:10:a0:e3 | {"subnet_id": "9e0d457b-c4c4-45cf-84e2-4ac7550f3b06", "ip_address": "40.0.0.2"} |
+--------------------------------------+------+-------------------+---------------------------------------------------------------------------------+

[root@dfw02 ~(keystone_boris)]$ neutron floatingip-associate 64dd749f-6127-4d0f-ba51-8a9978b8c211 2d6c6569-44c3-44b2-8bed-cdc8dde12336
Associated floatingip 64dd749f-6127-4d0f-ba51-8a9978b8c211

[root@dfw02 ~(keystone_boris)]$ neutron floatingip-show 64dd749f-6127-4d0f-ba51-8a9978b8c211
+---------------------+--------------------------------------+
| Field               | Value                                |
+---------------------+--------------------------------------+
| fixed_ip_address    | 40.0.0.2                             |
| floating_ip_address | 192.168.1.115                        |
| floating_network_id | 780ce2f3-2e6e-4881-bbac-857813f9a8e0 |
| id                  | 64dd749f-6127-4d0f-ba51-8a9978b8c211 |
| port_id             | 2d6c6569-44c3-44b2-8bed-cdc8dde12336 |
| router_id           | 86b3008c-297f-4301-9bdc-766b839785f1 |
| tenant_id           | 4dacfff9e72c4245a48d648ee23468d5     |
+---------------------+--------------------------------------+

[root@dfw02 ~(keystone_boris)]$ ping 192.168.1.115

PING 192.168.1.115 (192.168.1.115) 56(84) bytes of data.
64 bytes from 192.168.1.115: icmp_seq=1 ttl=63 time=3.80 ms
64 bytes from 192.168.1.115: icmp_seq=2 ttl=63 time=1.13 ms
64 bytes from 192.168.1.115: icmp_seq=3 ttl=63 time=0.954 ms
64 bytes from 192.168.1.115: icmp_seq=4 ttl=63 time=1.01 ms
64 bytes from 192.168.1.115: icmp_seq=5 ttl=63 time=0.999 ms
64 bytes from 192.168.1.115: icmp_seq=6 ttl=63 time=0.809 ms
64 bytes from 192.168.1.115: icmp_seq=7 ttl=63 time=1.02 ms
^C


  

  


   The original text of documents was posted on fedoraproject.org by Kashyap in November 2013. Atached ones tuned for new IP's and should not have any more  typos of original version Setup procedure.They also contain MySQL preventive updates currently required for openstack-nova-compute & neutron-openvswitch-agent remote connection to Controller Node to succeed . MySQL stuff is mine. All attached *.conf & *.ini files have been updated  for my network as well.
   In meantime I am quite sure  that using Libvirt's default and non-default networks  for creating Controller and Compute nodes  as F20 VMs is not important. Configs allow metadata to be sent from Controller to Compute on real physical boxes. Just one Ethernet Controller per box should be required in case of  using GRE tunnelling in case of RDO Havana on Fedora 20 manual setup.    

  References

   1. http://textuploader.com/1hin
   2. http://textuploader.com/1hey
   3. http://kashyapc.fedorapeople.org/virt/openstack/neutron-configs-GRE-OVS-two-node.txt
   4. http://bderzhavets.blogspot.com/2014/01/setting-up-two-physical-node-openstack.html