Tuesday, May 31, 2016
Sunday, May 29, 2016
Set up VM to connect Tripleo QuickStart Overcloud via Virt-manager GUI
Set up Gnome Desktop && VirtTools on Virtualization Server ( VIRTHOST ) and make remote connection to Virt-manager running on VIRTHOST (192.168.1.75). Then create VM via virt-manager as follows using standard CentOS 7.2 ISO image , I am aware of post Connecting another vm to your tripleo-quickstart deployment at oddbits.com and manage this way deliberately. Just wondering is it possible to get results similar to obtained
by LarsKS ( via in depth knowledge virsh CLI and Libvirt features) with Virt-manager GUI intuitively much more affordable. I realize that speed and
flexibility of approach suggested bellow are losing the aforementioned
Proceed with VM set up via Virt-manager remote GUI. Attaching "external" and
"overcloud" networks to VM and assign static IPs to eth0 and eth1 which belong
to corresponding networks.
[root@ServerCentOS72 ~]# virsh net-list
Name State Autostart Persistent
----------------------------------------------------------
default active yes yes
external active yes yes
overcloud active yes yes
Looks good , start install
Installation completed. Following step verfication availabilty connect to
overcloud on VIRTHOST. Check static IPs on Remote Console and connect
to dashboard of Controller
Now connect to VMs running in overcloud
Switching eth1 to DHCP mode on RemoteConsole (following post at oddbits.com)
[root@ServerCentOS72 ~]# virsh dumpxml RemoteConsole | xmllint --xpath '//interface[source/@bridge="brovc"]' -
<interface type="network">
<mac address="52:54:00:dd:c6:9d"/>
<source network="overcloud" bridge="brovc"/>
<target dev="vnet1"/>
<model type="virtio"/>
<alias name="net1"/>
<address type="pci" domain="0x0000" bus="0x00" slot="0x04" function="0x0"/>
Creating port on ctlplane ( undercloud VM )
On RemoteConsole switch eth1 to DHCP mode via NetworkManager GUI
We are all set. Connection to TripleO Quickstart overcloud environment
from host which didn't initiate original deployment , i.e. didn't issue
$ ssh-copy-id root@$VIRTHOST and is unable to issue without prompt
$ ssh root@$VIRTHOST uname -a
Proceed with VM set up via Virt-manager remote GUI. Attaching "external" and
"overcloud" networks to VM and assign static IPs to eth0 and eth1 which belong
to corresponding networks.
[root@ServerCentOS72 ~]# virsh net-list
Name State Autostart Persistent
----------------------------------------------------------
default active yes yes
external active yes yes
overcloud active yes yes
Looks good , start install
Installation completed. Following step verfication availabilty connect to
overcloud on VIRTHOST. Check static IPs on Remote Console and connect
to dashboard of Controller
Now connect to VMs running in overcloud
Switching eth1 to DHCP mode on RemoteConsole (following post at oddbits.com)
<interface type="network">
<mac address="52:54:00:dd:c6:9d"/>
<source network="overcloud" bridge="brovc"/>
<target dev="vnet1"/>
<model type="virtio"/>
<alias name="net1"/>
<address type="pci" domain="0x0000" bus="0x00" slot="0x04" function="0x0"/>
On RemoteConsole switch eth1 to DHCP mode via NetworkManager GUI
We are all set. Connection to TripleO Quickstart overcloud environment
from host which didn't initiate original deployment , i.e. didn't issue
$ ssh-copy-id root@$VIRTHOST and is unable to issue without prompt
$ ssh root@$VIRTHOST uname -a
Thursday, May 26, 2016
RDO Triple0 QuickStart && First impressions
I believe the post bellow will bring some more light on TripleO QuickStart
procedure suggested on RDO QuickStart page ( size of memory 32 GB
is a must. During minimal configuration runtime 23 GB of RAM are
required ). Following tips from Deploying OpenStack on just one hosted server
Overcloud deployed .
************************************************************************
First of all taking look at routing tables on undercloud VM
************************************************************************
[root@undercloud ~]# ifconfig
br-ctlplane: flags=4163 mtu 1500
inet 192.0.2.1 netmask 255.255.255.0 broadcast 192.0.2.255
inet6 fe80::285:8cff:feee:4c12 prefixlen 64 scopeid 0x20
ether 00:85:8c:ee:4c:12 txqueuelen 0 (Ethernet)
RX packets 5458173 bytes 430801023 (410.8 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 8562456 bytes 31493865046 (29.3 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
eth0: flags=4163 mtu 1500
inet 192.168.23.28 netmask 255.255.255.0 broadcast 192.168.23.255
inet6 fe80::285:8cff:feee:4c10 prefixlen 64 scopeid 0x20
ether 00:85:8c:ee:4c:10 txqueuelen 1000 (Ethernet)
RX packets 4550861 bytes 7090076105 (6.6 GiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 1597556 bytes 760511620 (725.2 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
eth1: flags=4163 mtu 1500
inet6 fe80::285:8cff:feee:4c12 prefixlen 64 scopeid 0x20
ether 00:85:8c:ee:4c:12 txqueuelen 1000 (Ethernet)
RX packets 5459780 bytes 430920997 (410.9 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 8564443 bytes 31494029129 (29.3 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
lo: flags=73 mtu 65536
inet 127.0.0.1 netmask 255.0.0.0
inet6 ::1 prefixlen 128 scopeid 0x10
loop txqueuelen 0 (Local Loopback)
RX packets 4361647 bytes 24858373851 (23.1 GiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 4361647 bytes 24858373851 (23.1 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
virbr0: flags=4099 mtu 1500
inet 192.168.122.1 netmask 255.255.255.0 broadcast 192.168.122.255
ether 52:54:00:39:0a:ae txqueuelen 0 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
vlan10: flags=4163 mtu 1500
inet 10.0.0.1 netmask 255.255.255.0 broadcast 10.0.0.255
inet6 fe80::804e:69ff:fe19:844b prefixlen 64 scopeid 0x20
ether 82:4e:69:19:84:4b txqueuelen 0 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 12 bytes 816 (816.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
[root@undercloud ~]# ip route
default via 192.168.23.1 dev eth0
10.0.0.0/24 dev vlan10 proto kernel scope link src 10.0.0.1
192.0.2.0/24 dev br-ctlplane proto kernel scope link src 192.0.2.1
192.168.23.0/24 dev eth0 proto kernel scope link src 192.168.23.28
192.168.122.0/24 dev virbr0 proto kernel scope link src 192.168.122.1
[root@undercloud ~]# ovs-vsctl show
83b044ee-44ac-4575-88b3-4951a6e9847f
Bridge br-int
fail_mode: secure
Port "tapb3ad6627-29"
tag: 1
Interface "tapb3ad6627-29"
type: internal
Port int-br-ctlplane
Interface int-br-ctlplane
type: patch
options: {peer=phy-br-ctlplane}
Port br-int
Interface br-int
type: internal
Bridge br-ctlplane
Port "vlan10"
tag: 10
Interface "vlan10"
type: internal
Port phy-br-ctlplane
Interface phy-br-ctlplane
type: patch
options: {peer=int-br-ctlplane}
Port "eth1"
Interface "eth1"
Port br-ctlplane
Interface br-ctlplane
type: internal
ovs_version: "2.5.0"
*********************************************************
Here admin credentials on overcloud controller
*********************************************************
[stack@undercloud ~]$ cat overcloudrc
export OS_NO_CACHE=True
export OS_CLOUDNAME=overcloud
export OS_AUTH_URL=http://192.0.2.10:5000/v2.0
export NOVA_VERSION=1.1
export COMPUTE_API_VERSION=1.1
export OS_USERNAME=admin
export no_proxy=,192.0.2.10,192.0.2.10
export OS_PASSWORD=pWyQpHsaXAWskcmYEq2ja4WaU
export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available"
export OS_TENANT_NAME=admin
*******************************
At the same on VIRTHOST
*******************************
[root@ServerCentOS72 ~]# virsh net-list
Name State Autostart Persistent
----------------------------------------------------------
default active yes yes
external active yes yes
overcloud active yes yes
[root@ServerCentOS72 ~]# virsh net-dumpxml external
<network>
<name>external</name>
<uuid>d585615b-c1c5-4e30-bf2d-ea247591c2b0</uuid>
<forward mode='nat'>
<nat>
<port start='1024' end='65535'/>
</nat>
</forward>
<bridge name='brext' stp='off' delay='0'/>
<mac address='52:54:00:9d:b4:1d'/>
<ip address='192.168.23.1' netmask='255.255.255.0'>
<dhcp>
<range start='192.168.23.10' end='192.168.23.50'/>
</dhcp>
</ip>
</network>
[root@ServerCentOS72 ~]# su - stack
Last login: Thu May 26 18:01:31 MSK 2016 on :0
[stack@ServerCentOS72 ~]$ virsh list
Id Name State
----------------------------------------------------
2 undercloud running
11 compute_0 running
12 control_0 running
*************************************************************************
Source stackrc and run openstack-status on undercloud
Overcloud deployment is already done on undercloud VM
*************************************************************************
[root@undercloud ~]# . stackrc
[root@undercloud ~]# openstack-status
== Nova services ==
openstack-nova-api: active
openstack-nova-compute: active
openstack-nova-network: inactive (disabled on boot)
openstack-nova-scheduler: active
openstack-nova-cert: active
openstack-nova-conductor: active
openstack-nova-console: inactive (disabled on boot)
openstack-nova-consoleauth: inactive (disabled on boot)
openstack-nova-xvpvncproxy: inactive (disabled on boot)
== Glance services ==
openstack-glance-api: active
openstack-glance-registry: active
== Keystone service ==
openstack-keystone: inactive (disabled on boot)
== Horizon service ==
openstack-dashboard: 404
== neutron services ==
neutron-server: active
neutron-dhcp-agent: active
neutron-l3-agent: inactive (disabled on boot)
neutron-metadata-agent: inactive (disabled on boot)
neutron-lbaas-agent: inactive (disabled on boot)
neutron-openvswitch-agent: active
neutron-metering-agent: inactive (disabled on boot)
== Swift services ==
openstack-swift-proxy: active
openstack-swift-account: active
openstack-swift-container: active
openstack-swift-object: active
== Cinder services ==
openstack-cinder-api: inactive (disabled on boot)
openstack-cinder-scheduler: inactive (disabled on boot)
openstack-cinder-volume: inactive (disabled on boot)
openstack-cinder-backup: inactive (disabled on boot)
== Ceilometer services ==
openstack-ceilometer-api: active
openstack-ceilometer-central: active
openstack-ceilometer-compute: inactive (disabled on boot)
openstack-ceilometer-collector: active
openstack-ceilometer-notification: active
== Heat services ==
openstack-heat-api: active
openstack-heat-api-cfn: active
openstack-heat-api-cloudwatch: inactive (disabled on boot)
openstack-heat-engine: active
== Sahara services ==
openstack-sahara-all: inactive (disabled on boot)
== Ironic services ==
openstack-ironic-api: active
openstack-ironic-conductor: active
== Support services ==
mysqld: inactive (disabled on boot)
libvirtd: active
openvswitch: active
dbus: active
rabbitmq-server: active
memcached: active
====Keystone users ======
+----------------------------------+------------------+---------+-----------------------------------+
| id | name | enabled | email |
+----------------------------------+------------------+---------+-----------------------------------+
| c1668084d057422ab21c9180424b3e4a | admin | True | root@localhost |
| db938fe459c94cd09fe227a118f8be0f | aodh | True | aodh@localhost |
| 001a56a0872048a592db95dc9885292d | ceilometer | True | ceilometer@localhost |
| e038f5b685b84e6aa601b37312d84a56 | glance | True | glance@localhost |
| d7ddbfd73b814c13926c1ecd5ebe1bb2 | heat | True | heat@localhost |
| dc784308498d40568b649fbf12eaeb51 | ironic | True | ironic@localhost |
| 0c1f829c533240cdbec944236048ee1a | ironic-inspector | True | baremetal-introspection@localhost |
| ddbcb1dd885845c698f8d65f6f9ff44f | neutron | True | neutron@localhost |
| 987bd356963e4a5cbf2bd50c50919f9b | nova | True | nova@localhost |
| a5c862796ef24615afc2881e1a59f9d5 | swift | True | swift@localhost |
+----------------------------------+------------------+---------+-----------------------------------+
== Glance images ==
+--------------------------------------+------------------------+-------------+------------------+------------+--------+
| ID | Name | Disk Format | Container Format | Size | Status |
+--------------------------------------+------------------------+-------------+------------------+------------+--------+
| c734ff64-7723-43ee-a5d2-d662e1e206eb | bm-deploy-kernel | aki | aki | 5157360 | active |
| f80e32c4-cfce-4dcc-993a-939800440fbf | bm-deploy-ramdisk | ari | ari | 380554146 | active |
| 8616adc8-7136-4536-8562-5ed9cf129ed2 | overcloud-full | qcow2 | bare | 1175351296 | active |
| 73f5bfc7-99c2-46dc-8507-e5978ec61b84 | overcloud-full-initrd | ari | ari | 36444678 | active |
| 0d30aa5d-869c-4716-bdd4-87685e4790ca | overcloud-full-vmlinuz | aki | aki | 5157360 | active |
+--------------------------------------+------------------------+-------------+------------------+------------+--------+
== Nova managed services ==
+----+----------------+------------+----------+---------+-------+----------------------------+-----------------+
| Id | Binary | Host | Zone | Status | State | Updated_at | Disabled Reason |
+----+----------------+------------+----------+---------+-------+----------------------------+-----------------+
| 1 | nova-cert | undercloud | internal | enabled | up | 2016-05-26T18:41:57.000000 | - |
| 7 | nova-scheduler | undercloud | internal | enabled | up | 2016-05-26T18:41:55.000000 | - |
| 8 | nova-conductor | undercloud | internal | enabled | up | 2016-05-26T18:41:56.000000 | - |
| 10 | nova-compute | undercloud | nova | enabled | up | 2016-05-26T18:41:54.000000 | - |
+----+----------------+------------+----------+---------+-------+----------------------------+-----------------+
== Nova networks ==
+--------------------------------------+----------+------+
| ID | Label | Cidr |
+--------------------------------------+----------+------+
| c27b8d62-f838-4c7e-8828-64ae1503f4c4 | ctlplane | - |
+--------------------------------------+----------+------+
== Nova instance flavors ==
+--------------------------------------+---------------+-----------+------+-----------+------+-------+-------------+-----------+
| ID | Name | Memory_MB | Disk | Ephemeral | Swap | VCPUs | RXTX_Factor | Is_Public |
+--------------------------------------+---------------+-----------+------+-----------+------+-------+-------------+-----------+
| 1320d766-7051-4639-9554-a42e7c7fd958 | control | 4096 | 40 | 0 | | 1 | 1.0 | True |
| 1b0ad845-6273-437f-8573-e4922a256ec7 | block-storage | 4096 | 40 | 0 | | 1 | 1.0 | True |
| 27a0e9ee-c909-4d7d-8e86-1eb2e61fb1cb | oooq_control | 8192 | 49 | 0 | | 1 | 1.0 | True |
| 40057aa6-5e8b-4d4b-85d4-f21418d01b5d | baremetal | 4096 | 40 | 0 | | 1 | 1.0 | True |
| 5750def3-dc08-43dd-b194-02d4ea73b8d7 | compute | 4096 | 40 | 0 | | 1 | 1.0 | True |
| 769969da-f429-4f5f-84c9-6456f39539f8 | ceph-storage | 4096 | 40 | 0 | | 1 | 1.0 | True |
| 9c1622bc-ee0f-4dfa-a988-1e89cad47015 | oooq_compute | 8192 | 49 | 0 | | 1 | 1.0 | True |
| a2e5a055-3334-4080-86f9-4887931aee22 | swift-storage | 4096 | 40 | 0 | | 1 | 1.0 | True |
| b05b3c15-7928-4f59-9f8d-7d3947e19bee | oooq_ceph | 8192 | 49 | 0 | | 1 | 1.0 | True |
+--------------------------------------+---------------+-----------+------+-----------+------+-------+-------------+-----------+
== Nova instances ==
+--------------------------------------+-------------------------+----------------------------------+--------+------------+-------------+---------------------+
| ID | Name | Tenant ID | Status | Task State | Power State | Networks |
+--------------------------------------+-------------------------+----------------------------------+--------+------------+-------------+---------------------+
| 88f841ac-1ca0-4339-ba8a-c2895c0dc57c | overcloud-controller-0 | ccf0e5fdbebb4335ad7875ec821af91d | ACTIVE | - | Running | ctlplane=192.0.2.13 |
| f12a1086-7e23-4acb-80a7-8b2efe1e4ef2 | overcloud-novacompute-0 | ccf0e5fdbebb4335ad7875ec821af91d | ACTIVE | - | Running | ctlplane=192.0.2.12 |
+--------------------------------------+-------------------------+----------------------------------+--------+------------+-------------+---------------------+
******************************************************
Neutron reports on undercloud VM
******************************************************
[root@undercloud ~]# neutron net-list
+--------------------------------------+----------+------------------------------------------+
| id | name | subnets |
+--------------------------------------+----------+------------------------------------------+
| c27b8d62-f838-4c7e-8828-64ae1503f4c4 | ctlplane | 631022c3-cfc5-4353-b038-1592cceea57e |
| | | 192.0.2.0/24 |
+--------------------------------------+----------+------------------------------------------+
[root@undercloud ~]# neutron net-show ctlplane
+---------------------------+--------------------------------------+
| Field | Value |
+---------------------------+--------------------------------------+
| admin_state_up | True |
| availability_zone_hints | |
| availability_zones | nova |
| created_at | 2016-05-26T11:32:18 |
| description | |
| id | c27b8d62-f838-4c7e-8828-64ae1503f4c4 |
| ipv4_address_scope | |
| ipv6_address_scope | |
| mtu | 1500 |
| name | ctlplane |
| provider:network_type | flat |
| provider:physical_network | ctlplane |
| provider:segmentation_id | |
| router:external | False |
| shared | False |
| status | ACTIVE |
| subnets | 631022c3-cfc5-4353-b038-1592cceea57e |
| tags | |
| tenant_id | ccf0e5fdbebb4335ad7875ec821af91d |
| updated_at | 2016-05-26T11:32:18 |
+---------------------------+--------------------------------------+
[root@undercloud ~]# neutron subnet-list
+------------------------------------+------+--------------+------------------------------------+
| id | name | cidr | allocation_pools |
+------------------------------------+------+--------------+------------------------------------+
| 631022c3-cfc5-4353-b038-1592cceea5 | | 192.0.2.0/24 | {"start": "192.0.2.5", "end": |
| 7e | | | "192.0.2.30"} |
+------------------------------------+------+--------------+------------------------------------+
[root@undercloud ~]# neutron subnet-show 631022c3-cfc5-4353-b038-1592cceea57e
+-------------------+---------------------------------------------------------------+
| Field | Value |
+-------------------+---------------------------------------------------------------+
| allocation_pools | {"start": "192.0.2.5", "end": "192.0.2.30"} |
| cidr | 192.0.2.0/24 |
| created_at | 2016-05-26T11:32:18 |
| description | |
| dns_nameservers | |
| enable_dhcp | True |
| gateway_ip | 192.0.2.1 |
| host_routes | {"destination": "169.254.169.254/32", "nexthop": "192.0.2.1"} |
| id | 631022c3-cfc5-4353-b038-1592cceea57e |
| ip_version | 4 |
| ipv6_address_mode | |
| ipv6_ra_mode | |
| name | |
| network_id | c27b8d62-f838-4c7e-8828-64ae1503f4c4 |
| subnetpool_id | |
| tenant_id | ccf0e5fdbebb4335ad7875ec821af91d |
| updated_at | 2016-05-26T11:32:18 |
+-------------------+---------------------------------------------------------------+
**********************************************
When overcloud deployment is done
**********************************************
[stack@undercloud ~]$ heat stack-list
+--------------------------------------+------------+-----------------+---------------------+--------------+
| id | stack_name | stack_status | creation_time | updated_time |
+--------------------------------------+------------+-----------------+---------------------+--------------+
| 7002392b-cd2d-439f-b3cd-024979f153a5 | overcloud | CREATE_COMPLETE | 2016-05-26T13:35:17 | None |
+--------------------------------------+------------+-----------------+---------------------+--------------+
[stack@undercloud ~]$ nova list
+--------------------------------------+-------------------------+--------+------------+-------------+---------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+-------------------------+--------+------------+-------------+---------------------+
| 88f841ac-1ca0-4339-ba8a-c2895c0dc57c | overcloud-controller-0 | ACTIVE | - | Running | ctlplane=192.0.2.13 |
| f12a1086-7e23-4acb-80a7-8b2efe1e4ef2 | overcloud-novacompute-0 | ACTIVE | - | Running | ctlplane=192.0.2.12 |
+--------------------------------------+-------------------------+--------+------------+-------------+---------------------+
*******************************************
Log into overcloud controller
*******************************************
[stack@undercloud ~]$ ssh heat-admin@192.0.2.13
Last login: Thu May 26 16:52:28 2016 from gateway
[heat-admin@overcloud-controller-0 ~]$ sudo su -
Last login: Thu May 26 15:42:23 UTC 2016 on pts/0
[root@overcloud-controller-0 ~]# ls
keystonerc_admin oskey01.pem
[root@overcloud-controller-0 ~]# . keystonerc_admin
[root@overcloud-controller-0 ~]# ifconfig
br-ex: flags=4163 mtu 1500
inet 192.0.2.13 netmask 255.255.255.0 broadcast 192.0.2.255
inet6 fe80::2f7:7fff:fe1a:ca59 prefixlen 64 scopeid 0x20
ether 00:f7:7f:1a:ca:59 txqueuelen 0 (Ethernet)
RX packets 689651 bytes 1362839189 (1.2 GiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 2346450 bytes 3243444405 (3.0 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
eth0: flags=4163 mtu 1500
inet6 fe80::2f7:7fff:fe1a:ca59 prefixlen 64 scopeid 0x20
ether 00:f7:7f:1a:ca:59 txqueuelen 1000 (Ethernet)
RX packets 2783352 bytes 4201989574 (3.9 GiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 2876264 bytes 3280863833 (3.0 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
lo: flags=73 mtu 65536
inet 127.0.0.1 netmask 255.0.0.0
inet6 ::1 prefixlen 128 scopeid 0x10
loop txqueuelen 0 (Local Loopback)
RX packets 2962545 bytes 8418607495 (7.8 GiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 2962545 bytes 8418607495 (7.8 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
[root@overcloud-controller-0 ~]# ovs-vsctl show
cc8be4fb-f96f-4679-b85d-d0afc7dd7f72
Bridge br-int
fail_mode: secure
Port "tapb86d48f2-45"
tag: 2
Interface "tapb86d48f2-45"
type: internal
Port "tapa4fa2a9d-a4"
tag: 3
Interface "tapa4fa2a9d-a4"
type: internal
Port "qr-eb92ffa9-da"
tag: 2
Interface "qr-eb92ffa9-da"
type: internal
Port "qr-e8146f9f-51"
tag: 3
Interface "qr-e8146f9f-51"
type: internal
Port br-int
Interface br-int
type: internal
Port patch-tun
Interface patch-tun
type: patch
options: {peer=patch-int}
Port int-br-ex
Interface int-br-ex
type: patch
options: {peer=phy-br-ex}
Bridge br-tun
fail_mode: secure
Port "vxlan-c000020c"
Interface "vxlan-c000020c"
type: vxlan
options: {df_default="true", in_key=flow, local_ip="192.0.2.13", out_key=flow, remote_ip="192.0.2.12"}
Port patch-int
Interface patch-int
type: patch
options: {peer=patch-tun}
Port br-tun
Interface br-tun
type: internal
Bridge br-ex
Port phy-br-ex
Interface phy-br-ex
type: patch
options: {peer=int-br-ex}
Port "qg-df23145d-8f"
Interface "qg-df23145d-8f"
type: internal
Port "qg-53315134-1d"
Interface "qg-53315134-1d"
type: internal
Port br-ex
Interface br-ex
type: internal
Port "eth0"
Interface "eth0"
ovs_version: "2.5.0"
**************************************
Routing table on overcloud controller
*************************************
[root@overcloud-controller-0 ~]# ip route
default via 192.0.2.1 dev br-ex proto static
169.254.169.254 via 192.0.2.1 dev br-ex proto static
192.0.2.0/24 dev br-ex proto kernel scope link src 192.0.2.13
Network topology
[root@overcloud-controller-0 ~]# neutron net-list
+--------------------------------------+--------------+----------------------------------------+
| id | name | subnets |
+--------------------------------------+--------------+----------------------------------------+
| 1dad601c-c865-41d8-94cb-efc634c1fc83 | public | 12787d8b-1b72-402d-9b93-2821f0a18b7b |
| | | 192.0.2.0/24 |
| 0086836e-2dc3-4d40-a2e2-21f222b159f4 | demo_network | dcc40bfc-9293-47bb-8788-d4b5f090d076 |
| | | 90.0.0.0/24 |
| 59168b6e-adca-4ec6-982a-f94a0eb770c8 | private | ede9bbc2-5099-4d9f-91af-2fd4387d52be |
| | | 50.0.0.0/24 |
+--------------------------------------+--------------+----------------------------------------+
[root@overcloud-controller-0 ~]# nova service-list
+----+------------------+-------------------------------------+----------+---------+-------+----------------------------+-----------------+
| Id | Binary | Host | Zone | Status | State | Updated_at | Disabled Reason |
+----+------------------+-------------------------------------+----------+---------+-------+----------------------------+-----------------+
| 1 | nova-cert | overcloud-controller-0 | internal | enabled | up | 2016-05-26T17:09:20.000000 | - |
| 2 | nova-consoleauth | overcloud-controller-0 | internal | enabled | up | 2016-05-26T17:09:20.000000 | - |
| 5 | nova-scheduler | overcloud-controller-0 | internal | enabled | up | 2016-05-26T17:09:22.000000 | - |
| 6 | nova-conductor | overcloud-controller-0 | internal | enabled | up | 2016-05-26T17:09:24.000000 | - |
| 7 | nova-compute | overcloud-novacompute-0.localdomain | nova | enabled | up | 2016-05-26T17:09:19.000000 | - |
+----+------------------+-------------------------------------+----------+---------+-------+----------------------------+-----------------+
Running VMs
*************************************************************************
Verfication outbound connectivity. Connecting via floating IPs belong
192.0.2.0/24 to VMs running in overcloud from undercloud VM
*************************************************************************
*********************************************************
`ip netns` on overcloud controller
**********************************************************
It won't work on 16 GB even minimal configuration.
Server memory allocation for minimal virtual environment
procedure suggested on RDO QuickStart page ( size of memory 32 GB
is a must. During minimal configuration runtime 23 GB of RAM are
required ). Following tips from Deploying OpenStack on just one hosted server
Overcloud deployed .
************************************************************************
First of all taking look at routing tables on undercloud VM
************************************************************************
[root@undercloud ~]# ifconfig
br-ctlplane: flags=4163
inet 192.0.2.1 netmask 255.255.255.0 broadcast 192.0.2.255
inet6 fe80::285:8cff:feee:4c12 prefixlen 64 scopeid 0x20
ether 00:85:8c:ee:4c:12 txqueuelen 0 (Ethernet)
RX packets 5458173 bytes 430801023 (410.8 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 8562456 bytes 31493865046 (29.3 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
eth0: flags=4163
inet 192.168.23.28 netmask 255.255.255.0 broadcast 192.168.23.255
inet6 fe80::285:8cff:feee:4c10 prefixlen 64 scopeid 0x20
ether 00:85:8c:ee:4c:10 txqueuelen 1000 (Ethernet)
RX packets 4550861 bytes 7090076105 (6.6 GiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 1597556 bytes 760511620 (725.2 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
eth1: flags=4163
inet6 fe80::285:8cff:feee:4c12 prefixlen 64 scopeid 0x20
ether 00:85:8c:ee:4c:12 txqueuelen 1000 (Ethernet)
RX packets 5459780 bytes 430920997 (410.9 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 8564443 bytes 31494029129 (29.3 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
lo: flags=73
inet 127.0.0.1 netmask 255.0.0.0
inet6 ::1 prefixlen 128 scopeid 0x10
loop txqueuelen 0 (Local Loopback)
RX packets 4361647 bytes 24858373851 (23.1 GiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 4361647 bytes 24858373851 (23.1 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
virbr0: flags=4099
inet 192.168.122.1 netmask 255.255.255.0 broadcast 192.168.122.255
ether 52:54:00:39:0a:ae txqueuelen 0 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
vlan10: flags=4163
inet 10.0.0.1 netmask 255.255.255.0 broadcast 10.0.0.255
inet6 fe80::804e:69ff:fe19:844b prefixlen 64 scopeid 0x20
ether 82:4e:69:19:84:4b txqueuelen 0 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 12 bytes 816 (816.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
[root@undercloud ~]# ip route
default via 192.168.23.1 dev eth0
10.0.0.0/24 dev vlan10 proto kernel scope link src 10.0.0.1
192.0.2.0/24 dev br-ctlplane proto kernel scope link src 192.0.2.1
192.168.23.0/24 dev eth0 proto kernel scope link src 192.168.23.28
192.168.122.0/24 dev virbr0 proto kernel scope link src 192.168.122.1
83b044ee-44ac-4575-88b3-4951a6e9847f
Bridge br-int
fail_mode: secure
Port "tapb3ad6627-29"
tag: 1
Interface "tapb3ad6627-29"
type: internal
Port int-br-ctlplane
Interface int-br-ctlplane
type: patch
options: {peer=phy-br-ctlplane}
Port br-int
Interface br-int
type: internal
Bridge br-ctlplane
Port "vlan10"
tag: 10
Interface "vlan10"
type: internal
Port phy-br-ctlplane
Interface phy-br-ctlplane
type: patch
options: {peer=int-br-ctlplane}
Port "eth1"
Interface "eth1"
Port br-ctlplane
Interface br-ctlplane
type: internal
ovs_version: "2.5.0"
*********************************************************
export OS_NO_CACHE=True
export OS_CLOUDNAME=overcloud
export OS_AUTH_URL=http://192.0.2.10:5000/v2.0
export NOVA_VERSION=1.1
export COMPUTE_API_VERSION=1.1
export OS_USERNAME=admin
export no_proxy=,192.0.2.10,192.0.2.10
export OS_PASSWORD=pWyQpHsaXAWskcmYEq2ja4WaU
export PYTHONWARNINGS="ignore:Certificate has no, ignore:A true SSLContext object is not available"
export OS_TENANT_NAME=admin
At the same on VIRTHOST
*******************************
[root@ServerCentOS72 ~]# virsh net-list
Name State Autostart Persistent
----------------------------------------------------------
default active yes yes
external active yes yes
overcloud active yes yes
[root@ServerCentOS72 ~]# virsh net-dumpxml external
<network>
<name>external</name>
<uuid>d585615b-c1c5-4e30-bf2d-ea247591c2b0</uuid>
<forward mode='nat'>
<nat>
<port start='1024' end='65535'/>
</nat>
</forward>
<bridge name='brext' stp='off' delay='0'/>
<mac address='52:54:00:9d:b4:1d'/>
<ip address='192.168.23.1' netmask='255.255.255.0'>
<dhcp>
<range start='192.168.23.10' end='192.168.23.50'/>
</dhcp>
</ip>
</network>
[root@ServerCentOS72 ~]# su - stack
Last login: Thu May 26 18:01:31 MSK 2016 on :0
[stack@ServerCentOS72 ~]$ virsh list
Id Name State
----------------------------------------------------
2 undercloud running
11 compute_0 running
12 control_0 running
*************************************************************************
Source stackrc and run openstack-status on undercloud
Overcloud deployment is already done on undercloud VM
*************************************************************************
[root@undercloud ~]# . stackrc
[root@undercloud ~]# openstack-status
== Nova services ==
openstack-nova-api: active
openstack-nova-compute: active
openstack-nova-network: inactive (disabled on boot)
openstack-nova-scheduler: active
openstack-nova-cert: active
openstack-nova-conductor: active
openstack-nova-console: inactive (disabled on boot)
openstack-nova-consoleauth: inactive (disabled on boot)
openstack-nova-xvpvncproxy: inactive (disabled on boot)
== Glance services ==
openstack-glance-api: active
openstack-glance-registry: active
== Keystone service ==
openstack-keystone: inactive (disabled on boot)
== Horizon service ==
openstack-dashboard: 404
== neutron services ==
neutron-server: active
neutron-dhcp-agent: active
neutron-l3-agent: inactive (disabled on boot)
neutron-metadata-agent: inactive (disabled on boot)
neutron-lbaas-agent: inactive (disabled on boot)
neutron-openvswitch-agent: active
neutron-metering-agent: inactive (disabled on boot)
== Swift services ==
openstack-swift-proxy: active
openstack-swift-account: active
openstack-swift-container: active
openstack-swift-object: active
== Cinder services ==
openstack-cinder-api: inactive (disabled on boot)
openstack-cinder-scheduler: inactive (disabled on boot)
openstack-cinder-volume: inactive (disabled on boot)
openstack-cinder-backup: inactive (disabled on boot)
== Ceilometer services ==
openstack-ceilometer-api: active
openstack-ceilometer-central: active
openstack-ceilometer-compute: inactive (disabled on boot)
openstack-ceilometer-collector: active
openstack-ceilometer-notification: active
== Heat services ==
openstack-heat-api: active
openstack-heat-api-cfn: active
openstack-heat-api-cloudwatch: inactive (disabled on boot)
openstack-heat-engine: active
== Sahara services ==
openstack-sahara-all: inactive (disabled on boot)
== Ironic services ==
openstack-ironic-api: active
openstack-ironic-conductor: active
== Support services ==
mysqld: inactive (disabled on boot)
libvirtd: active
openvswitch: active
dbus: active
rabbitmq-server: active
memcached: active
====Keystone users ======
+----------------------------------+------------------+---------+-----------------------------------+
| id | name | enabled | email |
+----------------------------------+------------------+---------+-----------------------------------+
| c1668084d057422ab21c9180424b3e4a | admin | True | root@localhost |
| db938fe459c94cd09fe227a118f8be0f | aodh | True | aodh@localhost |
| 001a56a0872048a592db95dc9885292d | ceilometer | True | ceilometer@localhost |
| e038f5b685b84e6aa601b37312d84a56 | glance | True | glance@localhost |
| d7ddbfd73b814c13926c1ecd5ebe1bb2 | heat | True | heat@localhost |
| dc784308498d40568b649fbf12eaeb51 | ironic | True | ironic@localhost |
| 0c1f829c533240cdbec944236048ee1a | ironic-inspector | True | baremetal-introspection@localhost |
| ddbcb1dd885845c698f8d65f6f9ff44f | neutron | True | neutron@localhost |
| 987bd356963e4a5cbf2bd50c50919f9b | nova | True | nova@localhost |
| a5c862796ef24615afc2881e1a59f9d5 | swift | True | swift@localhost |
+----------------------------------+------------------+---------+-----------------------------------+
== Glance images ==
+--------------------------------------+------------------------+-------------+------------------+------------+--------+
| ID | Name | Disk Format | Container Format | Size | Status |
+--------------------------------------+------------------------+-------------+------------------+------------+--------+
| c734ff64-7723-43ee-a5d2-d662e1e206eb | bm-deploy-kernel | aki | aki | 5157360 | active |
| f80e32c4-cfce-4dcc-993a-939800440fbf | bm-deploy-ramdisk | ari | ari | 380554146 | active |
| 8616adc8-7136-4536-8562-5ed9cf129ed2 | overcloud-full | qcow2 | bare | 1175351296 | active |
| 73f5bfc7-99c2-46dc-8507-e5978ec61b84 | overcloud-full-initrd | ari | ari | 36444678 | active |
| 0d30aa5d-869c-4716-bdd4-87685e4790ca | overcloud-full-vmlinuz | aki | aki | 5157360 | active |
+--------------------------------------+------------------------+-------------+------------------+------------+--------+
== Nova managed services ==
+----+----------------+------------+----------+---------+-------+----------------------------+-----------------+
| Id | Binary | Host | Zone | Status | State | Updated_at | Disabled Reason |
+----+----------------+------------+----------+---------+-------+----------------------------+-----------------+
| 1 | nova-cert | undercloud | internal | enabled | up | 2016-05-26T18:41:57.000000 | - |
| 7 | nova-scheduler | undercloud | internal | enabled | up | 2016-05-26T18:41:55.000000 | - |
| 8 | nova-conductor | undercloud | internal | enabled | up | 2016-05-26T18:41:56.000000 | - |
| 10 | nova-compute | undercloud | nova | enabled | up | 2016-05-26T18:41:54.000000 | - |
+----+----------------+------------+----------+---------+-------+----------------------------+-----------------+
== Nova networks ==
+--------------------------------------+----------+------+
| ID | Label | Cidr |
+--------------------------------------+----------+------+
| c27b8d62-f838-4c7e-8828-64ae1503f4c4 | ctlplane | - |
+--------------------------------------+----------+------+
== Nova instance flavors ==
+--------------------------------------+---------------+-----------+------+-----------+------+-------+-------------+-----------+
| ID | Name | Memory_MB | Disk | Ephemeral | Swap | VCPUs | RXTX_Factor | Is_Public |
+--------------------------------------+---------------+-----------+------+-----------+------+-------+-------------+-----------+
| 1320d766-7051-4639-9554-a42e7c7fd958 | control | 4096 | 40 | 0 | | 1 | 1.0 | True |
| 1b0ad845-6273-437f-8573-e4922a256ec7 | block-storage | 4096 | 40 | 0 | | 1 | 1.0 | True |
| 27a0e9ee-c909-4d7d-8e86-1eb2e61fb1cb | oooq_control | 8192 | 49 | 0 | | 1 | 1.0 | True |
| 40057aa6-5e8b-4d4b-85d4-f21418d01b5d | baremetal | 4096 | 40 | 0 | | 1 | 1.0 | True |
| 5750def3-dc08-43dd-b194-02d4ea73b8d7 | compute | 4096 | 40 | 0 | | 1 | 1.0 | True |
| 769969da-f429-4f5f-84c9-6456f39539f8 | ceph-storage | 4096 | 40 | 0 | | 1 | 1.0 | True |
| 9c1622bc-ee0f-4dfa-a988-1e89cad47015 | oooq_compute | 8192 | 49 | 0 | | 1 | 1.0 | True |
| a2e5a055-3334-4080-86f9-4887931aee22 | swift-storage | 4096 | 40 | 0 | | 1 | 1.0 | True |
| b05b3c15-7928-4f59-9f8d-7d3947e19bee | oooq_ceph | 8192 | 49 | 0 | | 1 | 1.0 | True |
+--------------------------------------+---------------+-----------+------+-----------+------+-------+-------------+-----------+
== Nova instances ==
+--------------------------------------+-------------------------+----------------------------------+--------+------------+-------------+---------------------+
| ID | Name | Tenant ID | Status | Task State | Power State | Networks |
+--------------------------------------+-------------------------+----------------------------------+--------+------------+-------------+---------------------+
| 88f841ac-1ca0-4339-ba8a-c2895c0dc57c | overcloud-controller-0 | ccf0e5fdbebb4335ad7875ec821af91d | ACTIVE | - | Running | ctlplane=192.0.2.13 |
| f12a1086-7e23-4acb-80a7-8b2efe1e4ef2 | overcloud-novacompute-0 | ccf0e5fdbebb4335ad7875ec821af91d | ACTIVE | - | Running | ctlplane=192.0.2.12 |
+--------------------------------------+-------------------------+----------------------------------+--------+------------+-------------+---------------------+
******************************************************
Neutron reports on undercloud VM
******************************************************
[root@undercloud ~]# neutron net-list
+--------------------------------------+----------+------------------------------------------+
| id | name | subnets |
+--------------------------------------+----------+------------------------------------------+
| c27b8d62-f838-4c7e-8828-64ae1503f4c4 | ctlplane | 631022c3-cfc5-4353-b038-1592cceea57e |
| | | 192.0.2.0/24 |
+--------------------------------------+----------+------------------------------------------+
[root@undercloud ~]# neutron net-show ctlplane
+---------------------------+--------------------------------------+
| Field | Value |
+---------------------------+--------------------------------------+
| admin_state_up | True |
| availability_zone_hints | |
| availability_zones | nova |
| created_at | 2016-05-26T11:32:18 |
| description | |
| id | c27b8d62-f838-4c7e-8828-64ae1503f4c4 |
| ipv4_address_scope | |
| ipv6_address_scope | |
| mtu | 1500 |
| name | ctlplane |
| provider:network_type | flat |
| provider:physical_network | ctlplane |
| provider:segmentation_id | |
| router:external | False |
| shared | False |
| status | ACTIVE |
| subnets | 631022c3-cfc5-4353-b038-1592cceea57e |
| tags | |
| tenant_id | ccf0e5fdbebb4335ad7875ec821af91d |
| updated_at | 2016-05-26T11:32:18 |
+---------------------------+--------------------------------------+
[root@undercloud ~]# neutron subnet-list
+------------------------------------+------+--------------+------------------------------------+
| id | name | cidr | allocation_pools |
+------------------------------------+------+--------------+------------------------------------+
| 631022c3-cfc5-4353-b038-1592cceea5 | | 192.0.2.0/24 | {"start": "192.0.2.5", "end": |
| 7e | | | "192.0.2.30"} |
+------------------------------------+------+--------------+------------------------------------+
[root@undercloud ~]# neutron subnet-show 631022c3-cfc5-4353-b038-1592cceea57e
+-------------------+---------------------------------------------------------------+
| Field | Value |
+-------------------+---------------------------------------------------------------+
| allocation_pools | {"start": "192.0.2.5", "end": "192.0.2.30"} |
| cidr | 192.0.2.0/24 |
| created_at | 2016-05-26T11:32:18 |
| description | |
| dns_nameservers | |
| enable_dhcp | True |
| gateway_ip | 192.0.2.1 |
| host_routes | {"destination": "169.254.169.254/32", "nexthop": "192.0.2.1"} |
| id | 631022c3-cfc5-4353-b038-1592cceea57e |
| ip_version | 4 |
| ipv6_address_mode | |
| ipv6_ra_mode | |
| name | |
| network_id | c27b8d62-f838-4c7e-8828-64ae1503f4c4 |
| subnetpool_id | |
| tenant_id | ccf0e5fdbebb4335ad7875ec821af91d |
| updated_at | 2016-05-26T11:32:18 |
+-------------------+---------------------------------------------------------------+
**********************************************
When overcloud deployment is done
**********************************************
[stack@undercloud ~]$ heat stack-list
+--------------------------------------+------------+-----------------+---------------------+--------------+
| id | stack_name | stack_status | creation_time | updated_time |
+--------------------------------------+------------+-----------------+---------------------+--------------+
| 7002392b-cd2d-439f-b3cd-024979f153a5 | overcloud | CREATE_COMPLETE | 2016-05-26T13:35:17 | None |
+--------------------------------------+------------+-----------------+---------------------+--------------+
[stack@undercloud ~]$ nova list
+--------------------------------------+-------------------------+--------+------------+-------------+---------------------+
| ID | Name | Status | Task State | Power State | Networks |
+--------------------------------------+-------------------------+--------+------------+-------------+---------------------+
| 88f841ac-1ca0-4339-ba8a-c2895c0dc57c | overcloud-controller-0 | ACTIVE | - | Running | ctlplane=192.0.2.13 |
| f12a1086-7e23-4acb-80a7-8b2efe1e4ef2 | overcloud-novacompute-0 | ACTIVE | - | Running | ctlplane=192.0.2.12 |
+--------------------------------------+-------------------------+--------+------------+-------------+---------------------+
*******************************************
Log into overcloud controller
*******************************************
[stack@undercloud ~]$ ssh heat-admin@192.0.2.13
Last login: Thu May 26 16:52:28 2016 from gateway
[heat-admin@overcloud-controller-0 ~]$ sudo su -
Last login: Thu May 26 15:42:23 UTC 2016 on pts/0
[root@overcloud-controller-0 ~]# ls
keystonerc_admin oskey01.pem
[root@overcloud-controller-0 ~]# . keystonerc_admin
[root@overcloud-controller-0 ~]# ifconfig
br-ex: flags=4163
inet 192.0.2.13 netmask 255.255.255.0 broadcast 192.0.2.255
inet6 fe80::2f7:7fff:fe1a:ca59 prefixlen 64 scopeid 0x20
ether 00:f7:7f:1a:ca:59 txqueuelen 0 (Ethernet)
RX packets 689651 bytes 1362839189 (1.2 GiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 2346450 bytes 3243444405 (3.0 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
eth0: flags=4163
inet6 fe80::2f7:7fff:fe1a:ca59 prefixlen 64 scopeid 0x20
ether 00:f7:7f:1a:ca:59 txqueuelen 1000 (Ethernet)
RX packets 2783352 bytes 4201989574 (3.9 GiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 2876264 bytes 3280863833 (3.0 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
lo: flags=73
inet 127.0.0.1 netmask 255.0.0.0
inet6 ::1 prefixlen 128 scopeid 0x10
loop txqueuelen 0 (Local Loopback)
RX packets 2962545 bytes 8418607495 (7.8 GiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 2962545 bytes 8418607495 (7.8 GiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
[root@overcloud-controller-0 ~]# ovs-vsctl show
cc8be4fb-f96f-4679-b85d-d0afc7dd7f72
Bridge br-int
fail_mode: secure
Port "tapb86d48f2-45"
tag: 2
Interface "tapb86d48f2-45"
type: internal
Port "tapa4fa2a9d-a4"
tag: 3
Interface "tapa4fa2a9d-a4"
type: internal
Port "qr-eb92ffa9-da"
tag: 2
Interface "qr-eb92ffa9-da"
type: internal
Port "qr-e8146f9f-51"
tag: 3
Interface "qr-e8146f9f-51"
type: internal
Port br-int
Interface br-int
type: internal
Port patch-tun
Interface patch-tun
type: patch
options: {peer=patch-int}
Port int-br-ex
Interface int-br-ex
type: patch
options: {peer=phy-br-ex}
Bridge br-tun
fail_mode: secure
Port "vxlan-c000020c"
Interface "vxlan-c000020c"
type: vxlan
options: {df_default="true", in_key=flow, local_ip="192.0.2.13", out_key=flow, remote_ip="192.0.2.12"}
Port patch-int
Interface patch-int
type: patch
options: {peer=patch-tun}
Port br-tun
Interface br-tun
type: internal
Bridge br-ex
Port phy-br-ex
Interface phy-br-ex
type: patch
options: {peer=int-br-ex}
Port "qg-df23145d-8f"
Interface "qg-df23145d-8f"
type: internal
Port "qg-53315134-1d"
Interface "qg-53315134-1d"
type: internal
Port br-ex
Interface br-ex
type: internal
Port "eth0"
Interface "eth0"
ovs_version: "2.5.0"
**************************************
Routing table on overcloud controller
*************************************
[root@overcloud-controller-0 ~]# ip route
default via 192.0.2.1 dev br-ex proto static
169.254.169.254 via 192.0.2.1 dev br-ex proto static
192.0.2.0/24 dev br-ex proto kernel scope link src 192.0.2.13
Network topology
[root@overcloud-controller-0 ~]# neutron net-list
+--------------------------------------+--------------+----------------------------------------+
| id | name | subnets |
+--------------------------------------+--------------+----------------------------------------+
| 1dad601c-c865-41d8-94cb-efc634c1fc83 | public | 12787d8b-1b72-402d-9b93-2821f0a18b7b |
| | | 192.0.2.0/24 |
| 0086836e-2dc3-4d40-a2e2-21f222b159f4 | demo_network | dcc40bfc-9293-47bb-8788-d4b5f090d076 |
| | | 90.0.0.0/24 |
| 59168b6e-adca-4ec6-982a-f94a0eb770c8 | private | ede9bbc2-5099-4d9f-91af-2fd4387d52be |
| | | 50.0.0.0/24 |
+--------------------------------------+--------------+----------------------------------------+
[root@overcloud-controller-0 ~]# nova service-list
+----+------------------+-------------------------------------+----------+---------+-------+----------------------------+-----------------+
| Id | Binary | Host | Zone | Status | State | Updated_at | Disabled Reason |
+----+------------------+-------------------------------------+----------+---------+-------+----------------------------+-----------------+
| 1 | nova-cert | overcloud-controller-0 | internal | enabled | up | 2016-05-26T17:09:20.000000 | - |
| 2 | nova-consoleauth | overcloud-controller-0 | internal | enabled | up | 2016-05-26T17:09:20.000000 | - |
| 5 | nova-scheduler | overcloud-controller-0 | internal | enabled | up | 2016-05-26T17:09:22.000000 | - |
| 6 | nova-conductor | overcloud-controller-0 | internal | enabled | up | 2016-05-26T17:09:24.000000 | - |
| 7 | nova-compute | overcloud-novacompute-0.localdomain | nova | enabled | up | 2016-05-26T17:09:19.000000 | - |
+----+------------------+-------------------------------------+----------+---------+-------+----------------------------+-----------------+
Running VMs
*************************************************************************
Verfication outbound connectivity. Connecting via floating IPs belong
192.0.2.0/24 to VMs running in overcloud from undercloud VM
*************************************************************************
*********************************************************
`ip netns` on overcloud controller
**********************************************************
It won't work on 16 GB even minimal configuration.
Server memory allocation for minimal virtual environment
Monday, May 23, 2016
Backport upstream commits to stable RDO Mitaka release && Deployments with Keystone API V3
Posting bellow is written with intend to avoid waiting until "koji" build will appear in updates repo of stable RDO Mitaka release, what might take a couple of months or so. Actually, it doesn't require knowledge how to write properly source RH's rpm file. It just needs picking up raw content of git commits from upstream git repo converting them into patches and rebuild required src.rpm(s) with patch(es) needed. There is also not commonly known command `rpm -qf` which is very useful when you need to detect which rpm has installed particular file. Just to know which src.rpm should be downloaded for git commit referencing
say "cinder.rb"
[root@ServerCentOS72 /]# find . -name cinder.rb -print
find: ‘./run/user/1000/gvfs’: Permission denied
./usr/share/openstack-puppet/modules/cinder/lib/puppet/provider/cinder.rb
[root@ServerCentOS72 /]# rpm -qf /usr/share/openstack-puppet/modules/cinder/lib/puppet/provider/cinder.rb
openstack-puppet-modules-8.0.4-2.el7.centos.noarch
*******************************
Thus download from
*******************************
1. https://cbs.centos.org/koji/buildinfo?buildID=10895
openstack-packstack-8.0.0-1.el7.src.rpm
2. https://cbs.centos.org/koji/buildinfo?buildID=10859
openstack-puppet-modules-8.0.4-1.el7.src.rpm
[boris@ServerCentOS72 Downloads]$ ls -l
total 3116
-rw-rw-r--. 1 boris boris 170107 May 21 21:26 openstack-packstack-8.0.0-1.el7.src.rpm
-rw-rw-r--. 1 boris boris 3015046 May 21 18:33 openstack-puppet-modules-8.0.4-1.el7.src.rpm
****************
Then run :-
****************
$ rpm -iv openstack-packstack-8.0.0-1.el7.src.rpm
$ rpm -iv openstack-puppet-modules-8.0.4-1.el7.src.rpm
$ cd ../rpmbuild
In folder ~boris/rpmbuild/SOURCES
create to patch files :-
0001-Use-versionless-auth_url-for-cinder.patch
0001-Enable-keystone-v3-support-for-cinder_type.patch
********************************************************************
In second patch file insert "cinder" in path to *.rb files
********************************************************************
diff --git a/cinder/lib/puppet/provider/cinder_type/openstack.rb b/cinder/lib/puppet/provider/cinder_type/openstack.rb
index feaea49..9aa31c5 100644
--- a/cinder/lib/puppet/provider/cinder_type/openstack.rb
+++ b/cinder/lib/puppet/provider/cinder_type/openstack.rb
@@ -32,6 +32,10 @@ class Puppet::Provider::Cinder < Puppet::Provider::Openstack
. . . . .
diff --git a/cinder/lib/puppet/provider/cinder_type/openstack.rb b/cinder/lib/puppet/provider/cinder_type/openstack.rb
index feaea49..9aa31c5 100644
--- a/cinder/lib/puppet/provider/cinder_type/openstack.rb
+++ b/cinder/lib/puppet/provider/cinder_type/openstack.rb
@@ -7,7 +7,7 @@ Puppet::Type.type(:cinder_type).provide(
. . . . . .
diff --git a/cinder/spec/unit/provider/cinder_spec.rb b/cinder/spec/unit/provider/cinder_spec.rb
index cfc8850..246ae58 100644
--- a/cinder/spec/unit/provider/cinder_spec.rb
+++ b/cinder/spec/unit/provider/cinder_spec.rb
@@ -24,10 +24,12 @@ describe Puppet::Provider::Cinder do
Finally SOURES folder would look like :-
**********************
Next step is :-
**********************
$ cd ../SPECS
and update *.spec files , so that they would understand that patches placed
into SOURCES folder have to be applied to corresponding *.tar.gz archives
before building phase itself.
*****************************************
First openstack-packstack.spec :-
*****************************************
Name: openstack-packstack
Version: 8.0.0
Release: 2%{?milestone}%{?dist} <== increase 1 to 2
Summary: Openstack Install Utility
Group: Applications/System
License: ASL 2.0 and GPLv2
URL: https://github.com/openstack/packstack
Source0: http://tarballs.openstack.org/packstack/packstack-%{upstream_version}.tar.gz
Patch0: 0001-Use-versionless-auth_url-for-cinder.patch <=== Add line
. . . . . .
%prep
%setup -n packstack-%{upstream_version}
%patch0 -p1 <== Add line
:wq
*****************************************
Second openstack-puppet-modules.spec
*****************************************
Name: openstack-puppet-modules
Epoch: 1
Version: 8.0.4
Release: 2%{?milestone}%{?dist} <=== increase 1 to 2
Summary: Puppet modules used to deploy OpenStack
License: ASL 2.0 and GPLv2 and GPLv3
URL: https://github.com/redhat-openstack
Source0: https://github.com/redhat-openstack/%{name}/archive/%{upstream_version}.tar.gz
Patch0: 0001-Enable-keystone-v3-support-for-cinder_type.patch <== Add line
. . . . .
%prep
%setup -q -n %{name}-%{?upstream_version}
%patch0 -p1 <== Add line
:wq
******************************************
Attempt rpmbuild for each spec file
******************************************
$ rpmbuild -bb openstack-packstack.spec
$ rpmbuild -bb openstack-puppet-modules.spec
If particular build is missing some packages it will report their's names to screen
This packages could be usually installed via yum, otherwise you have a problem
with local build.
If each build output finishes with message like
Everything is going fine. In particular case results will be written
to ../RPMS/noarch
Then
$ cd ../RPMS/noarch
and create installation script
[boris@ServerCentOS72 SPECS]$ cd ../RPMS/noarch
[boris@ServerCentOS72 noarch]$ ls -l
total 3428
-rwxrwxr-x. 1 boris boris 239 May 21 21:40 install
-rw-rw-r--. 1 boris boris 247312 May 21 21:34 openstack-packstack-8.0.0-2.el7.centos.noarch.rpm
-rw-rw-r--. 1 boris boris 17376 May 21 21:34 openstack-packstack-doc-8.0.0-2.el7.centos.noarch.rpm
-rw-rw-r--. 1 boris boris 16792 May 21 21:34 openstack-packstack-puppet-8.0.0-2.el7.centos.noarch.rpm
-rw-rw-r--. 1 boris boris 3212844 May 21 21:38 openstack-puppet-modules-8.0.4-2.el7.centos.noarch.rpm
[boris@ServerCentOS72 noarch]$ cat install
sudo yum install openstack-packstack-8.0.0-2.el7.centos.noarch.rpm \
openstack-packstack-doc-8.0.0-2.el7.centos.noarch.rpm \
openstack-packstack-puppet-8.0.0-2.el7.centos.noarch.rpm \
openstack-puppet-modules-8.0.4-2.el7.centos.noarch.rpm
****************************
Run install :-
****************************
[boris@ServerCentOS72 noarch]$ ./install
Due to increased release (1=>2) old rpms should be replaced by just been built
[root@ServerCentOS72 ~]# rpm -qa \*openstack-packstack\*
openstack-packstack-doc-8.0.0-2.el7.centos.noarch
openstack-packstack-puppet-8.0.0-2.el7.centos.noarch
openstack-packstack-8.0.0-2.el7.centos.noarch
[root@ServerCentOS72 ~]# rpm -qa \*openstack-puppet-modules\*
openstack-puppet-modules-8.0.4-2.el7.centos.noarch
****************************************************************
Since that point following entry in your answer-file :-
****************************************************************
# Identity service API version string. ['v2.0', 'v3']
CONFIG_KEYSTONE_API_VERSION=v3
won't cause cinder puppet to crash packstack run, no matter of kind of your deployment
References
1. https://bugzilla.redhat.com/show_bug.cgi?id=1330289
say "cinder.rb"
[root@ServerCentOS72 /]# find . -name cinder.rb -print
find: ‘./run/user/1000/gvfs’: Permission denied
./usr/share/openstack-puppet/modules/cinder/lib/puppet/provider/cinder.rb
[root@ServerCentOS72 /]# rpm -qf /usr/share/openstack-puppet/modules/cinder/lib/puppet/provider/cinder.rb
openstack-puppet-modules-8.0.4-2.el7.centos.noarch
*******************************
Thus download from
*******************************
1. https://cbs.centos.org/koji/buildinfo?buildID=10895
openstack-packstack-8.0.0-1.el7.src.rpm
2. https://cbs.centos.org/koji/buildinfo?buildID=10859
openstack-puppet-modules-8.0.4-1.el7.src.rpm
[boris@ServerCentOS72 Downloads]$ ls -l
total 3116
-rw-rw-r--. 1 boris boris 170107 May 21 21:26 openstack-packstack-8.0.0-1.el7.src.rpm
-rw-rw-r--. 1 boris boris 3015046 May 21 18:33 openstack-puppet-modules-8.0.4-1.el7.src.rpm
****************
Then run :-
****************
$ rpm -iv openstack-packstack-8.0.0-1.el7.src.rpm
$ rpm -iv openstack-puppet-modules-8.0.4-1.el7.src.rpm
$ cd ../rpmbuild
In folder ~boris/rpmbuild/SOURCES
create to patch files :-
0001-Use-versionless-auth_url-for-cinder.patch
0001-Enable-keystone-v3-support-for-cinder_type.patch
********************************************************************
In second patch file insert "cinder" in path to *.rb files
********************************************************************
diff --git a/cinder/lib/puppet/provider/cinder_type/openstack.rb b/cinder/lib/puppet/provider/cinder_type/openstack.rb
index feaea49..9aa31c5 100644
--- a/cinder/lib/puppet/provider/cinder_type/openstack.rb
+++ b/cinder/lib/puppet/provider/cinder_type/openstack.rb
@@ -32,6 +32,10 @@ class Puppet::Provider::Cinder < Puppet::Provider::Openstack
. . . . .
diff --git a/cinder/lib/puppet/provider/cinder_type/openstack.rb b/cinder/lib/puppet/provider/cinder_type/openstack.rb
index feaea49..9aa31c5 100644
--- a/cinder/lib/puppet/provider/cinder_type/openstack.rb
+++ b/cinder/lib/puppet/provider/cinder_type/openstack.rb
@@ -7,7 +7,7 @@ Puppet::Type.type(:cinder_type).provide(
. . . . . .
diff --git a/cinder/spec/unit/provider/cinder_spec.rb b/cinder/spec/unit/provider/cinder_spec.rb
index cfc8850..246ae58 100644
--- a/cinder/spec/unit/provider/cinder_spec.rb
+++ b/cinder/spec/unit/provider/cinder_spec.rb
@@ -24,10 +24,12 @@ describe Puppet::Provider::Cinder do
Finally SOURES folder would look like :-
**********************
Next step is :-
**********************
$ cd ../SPECS
and update *.spec files , so that they would understand that patches placed
into SOURCES folder have to be applied to corresponding *.tar.gz archives
before building phase itself.
*****************************************
First openstack-packstack.spec :-
*****************************************
Name: openstack-packstack
Version: 8.0.0
Release: 2%{?milestone}%{?dist} <== increase 1 to 2
Summary: Openstack Install Utility
Group: Applications/System
License: ASL 2.0 and GPLv2
URL: https://github.com/openstack/packstack
Source0: http://tarballs.openstack.org/packstack/packstack-%{upstream_version}.tar.gz
Patch0: 0001-Use-versionless-auth_url-for-cinder.patch <=== Add line
. . . . . .
%prep
%setup -n packstack-%{upstream_version}
%patch0 -p1 <== Add line
:wq
*****************************************
Second openstack-puppet-modules.spec
*****************************************
Name: openstack-puppet-modules
Epoch: 1
Version: 8.0.4
Release: 2%{?milestone}%{?dist} <=== increase 1 to 2
Summary: Puppet modules used to deploy OpenStack
License: ASL 2.0 and GPLv2 and GPLv3
URL: https://github.com/redhat-openstack
Source0: https://github.com/redhat-openstack/%{name}/archive/%{upstream_version}.tar.gz
Patch0: 0001-Enable-keystone-v3-support-for-cinder_type.patch <== Add line
. . . . .
%prep
%setup -q -n %{name}-%{?upstream_version}
%patch0 -p1 <== Add line
:wq
******************************************
Attempt rpmbuild for each spec file
******************************************
$ rpmbuild -bb openstack-packstack.spec
$ rpmbuild -bb openstack-puppet-modules.spec
If particular build is missing some packages it will report their's names to screen
This packages could be usually installed via yum, otherwise you have a problem
with local build.
If each build output finishes with message like
Wrote: /home/boris/rpmbuild/RPMS/noarch/openstack-puppet-modules-8.0.4-2.el7.centos.noarch.rpm Executing(%clean): /bin/sh -e /var/tmp/rpm-tmp.wX6p3q + umask 022 + cd /home/boris/rpmbuild/BUILD + cd openstack-puppet-modules-8.0.4 + /usr/bin/rm -rf /home/boris/rpmbuild/BUILDROOT/openstack-puppet-modules-8.0.4-2.el7.centos.x86_64 + exit 0
Everything is going fine. In particular case results will be written
to ../RPMS/noarch
Then
$ cd ../RPMS/noarch
and create installation script
[boris@ServerCentOS72 SPECS]$ cd ../RPMS/noarch
[boris@ServerCentOS72 noarch]$ ls -l
total 3428
-rwxrwxr-x. 1 boris boris 239 May 21 21:40 install
-rw-rw-r--. 1 boris boris 247312 May 21 21:34 openstack-packstack-8.0.0-2.el7.centos.noarch.rpm
-rw-rw-r--. 1 boris boris 17376 May 21 21:34 openstack-packstack-doc-8.0.0-2.el7.centos.noarch.rpm
-rw-rw-r--. 1 boris boris 16792 May 21 21:34 openstack-packstack-puppet-8.0.0-2.el7.centos.noarch.rpm
-rw-rw-r--. 1 boris boris 3212844 May 21 21:38 openstack-puppet-modules-8.0.4-2.el7.centos.noarch.rpm
[boris@ServerCentOS72 noarch]$ cat install
sudo yum install openstack-packstack-8.0.0-2.el7.centos.noarch.rpm \
openstack-packstack-doc-8.0.0-2.el7.centos.noarch.rpm \
openstack-packstack-puppet-8.0.0-2.el7.centos.noarch.rpm \
openstack-puppet-modules-8.0.4-2.el7.centos.noarch.rpm
****************************
Run install :-
****************************
[boris@ServerCentOS72 noarch]$ ./install
Due to increased release (1=>2) old rpms should be replaced by just been built
[root@ServerCentOS72 ~]# rpm -qa \*openstack-packstack\*
openstack-packstack-doc-8.0.0-2.el7.centos.noarch
openstack-packstack-puppet-8.0.0-2.el7.centos.noarch
openstack-packstack-8.0.0-2.el7.centos.noarch
[root@ServerCentOS72 ~]# rpm -qa \*openstack-puppet-modules\*
openstack-puppet-modules-8.0.4-2.el7.centos.noarch
****************************************************************
Since that point following entry in your answer-file :-
****************************************************************
# Identity service API version string. ['v2.0', 'v3']
CONFIG_KEYSTONE_API_VERSION=v3
won't cause cinder puppet to crash packstack run, no matter of kind of your deployment
References
1. https://bugzilla.redhat.com/show_bug.cgi?id=1330289
Friday, May 20, 2016
Java EE Servers as Nova-Docker Containers && RDO Mitaka External vlan networks
Details here Setup Docker Hypervisor on Multi Node DVR Cluster RDO Mitaka
Thus Controller/Network RDO Mitaka Node has to have external networks of VLAN type with predefined vlan tags. Straight forward packstack deployment doesn't allow to achieve desired network configuration. External network provider of vlan type appears to be required.
Also I have to notice that Docker Hypervisor running on Compute Node
requires all deployment nodes set SELINUX to PERMISSIVE MODE.
In particular case, office networks 10.10.10.0/24 is vlan tagged (157), 10.10.50.0/24 is vlan tagged (172) already exists when RDO install is running.
192.169.142.127 Controller/Network
192.169.142.147 Storage Node
192.169.142.137 Compute Node
192.169.142.45 WKS ( 3VNICs eth0 - 192.169.142.45 , eth1.157 - 10.10.10.45, eth2.172 - 10.10.50.45 ), running web browser to connect to Java Servers
First
***********************************************************
Update /etc/neutron/plugins/ml2/ml2_conf.ini
***********************************************************
[root@ip-192-169-142-127 ml2(keystone_demo)]# cat ml2_conf.ini
[ml2]
type_drivers = flat,vlan,vxlan
tenant_network_types = vlan,vxlan
mechanism_drivers =openvswitch
path_mtu = 0
[ml2_type_flat]
[ml2_type_vlan]
network_vlan_ranges =physnet1:100:200,vlan157:157:157,vlan172:172:172,physnet4
[ml2_type_gre]
[ml2_type_vxlan]
vni_ranges =10:100
vxlan_group =224.0.0.1
[ml2_type_geneve]
[securitygroup]
enable_security_group = True
**************
Then
**************
# openstack-service restart neutron
***************************************************
Invoke external network provider
***************************************************
[root@ip-192-169-142-127 ~(keystone_admin]#neutron net-create vlan157 --shared --provider:network_type vlan --provider:segmentation_id 157 --provider:physical_network vlan157 --router:external
[root@ip-192-169-142-127 ~(keystone_admin]# neutron subnet-create --name sub-vlan157 --gateway 10.10.10.1 --allocation-pool start=10.10.10.100,end=10.10.10.200 vlan157 10.10.10.0/24
***********************************************
Create second external vlan network
***********************************************
[root@ip-192-169-142-127 ~(keystone_admin]# neutron net-create vlan172 --shared --provider:network_type vlan --provider:segmentation_id 172 --provider:physical_network vlan172 --router:external
[root@ip-192-169-142-127 ~(keystone_admin]# neutron subnet-create --name sub-vlan172 --gateway 10.10.50.1 --allocation-pool start=10.10.50.100,end=10.10.50.200 vlan172 10.10.50.0/24
*************************************
Creating third flat network
*************************************
# neutron net-create external4 -- --router:external \
--provider:network_type=flat \
--provider:physical_network=physnet4
# neutron subnet-create --disable-dhcp external4 192.179.143.0/24
[root@ip-192-169-142-127 ~(keystone_admin)]# neutron net-show vlan157
+---------------------------+--------------------------------------+
| Field | Value |
+---------------------------+--------------------------------------+
| admin_state_up | True |
| availability_zone_hints | |
| availability_zones | nova |
| created_at | 2016-05-05T11:04:57 |
| description | |
| id | 98116982-6553-4b7e-920c-0284a7200916 |
| ipv4_address_scope | |
| ipv6_address_scope | |
| is_default | False |
| mtu | 1500 |
| name | vlan157 |
| provider:network_type | vlan |
| provider:physical_network | vlan157 |
| provider:segmentation_id | 157 |
| router:external | True |
| shared | True |
| status | ACTIVE |
| subnets | d50fddd2-46e7-4c67-8ab5-97e952bc11c9 |
| tags | |
| tenant_id | 5d0e67d2fe7a403180fe77232b0cdcd5 |
| updated_at | 2016-05-05T11:04:57 |
+---------------------------+--------------------------------------+
[root@ip-192-169-142-127 ~(keystone_admin)]# neutron subnet-show sub-vlan157
+-------------------+--------------------------------------------------+
| Field | Value |
+-------------------+--------------------------------------------------+
| allocation_pools | {"start": "10.10.10.100", "end": "10.10.10.200"} |
| cidr | 10.10.10.0/24 |
| created_at | 2016-05-05T11:05:27 |
| description | |
| dns_nameservers | |
| enable_dhcp | True |
| gateway_ip | 10.10.10.1 |
| host_routes | |
| id | d50fddd2-46e7-4c67-8ab5-97e952bc11c9 |
| ip_version | 4 |
| ipv6_address_mode | |
| ipv6_ra_mode | |
| name | sub-vlan157 |
| network_id | 98116982-6553-4b7e-920c-0284a7200916 |
| subnetpool_id | |
| tenant_id | 5d0e67d2fe7a403180fe77232b0cdcd5 |
| updated_at | 2016-05-05T11:05:27 |
+-------------------+--------------------------------------------------+
[root@ip-192-169-142-127 ~(keystone_admin)]# neutron net-show vlan172
+---------------------------+--------------------------------------+
| Field | Value |
+---------------------------+--------------------------------------+
| admin_state_up | True |
| availability_zone_hints | |
| availability_zones | nova |
| created_at | 2016-05-05T11:05:46 |
| description | |
| id | 6fc89f42-cb85-4cdb-be5f-4d1768b05e14 |
| ipv4_address_scope | |
| ipv6_address_scope | |
| is_default | False |
| mtu | 1500 |
| name | vlan172 |
| provider:network_type | vlan |
| provider:physical_network | vlan172 |
| provider:segmentation_id | 172 |
| router:external | True |
| shared | True |
| status | ACTIVE |
| subnets | 2d4f907b-1f80-451a-a663-b87bbd683d58 |
| tags | |
| tenant_id | 5d0e67d2fe7a403180fe77232b0cdcd5 |
| updated_at | 2016-05-05T11:05:46 |
+---------------------------+--------------------------------------+
[root@ip-192-169-142-127 ~(keystone_admin)]# neutron subnet-show sub-vlan172
+-------------------+--------------------------------------------------+
| Field | Value |
+-------------------+--------------------------------------------------+
| allocation_pools | {"start": "10.10.50.100", "end": "10.10.50.200"} |
| cidr | 10.10.50.0/24 |
| created_at | 2016-05-05T11:10:18 |
| description | |
| dns_nameservers | |
| enable_dhcp | True |
| gateway_ip | 10.10.50.1 |
| host_routes | |
| id | 2d4f907b-1f80-451a-a663-b87bbd683d58 |
| ip_version | 4 |
| ipv6_address_mode | |
| ipv6_ra_mode | |
| name | sub-vlan172 |
| network_id | 6fc89f42-cb85-4cdb-be5f-4d1768b05e14 |
| subnetpool_id | |
| tenant_id | 5d0e67d2fe7a403180fe77232b0cdcd5 |
| updated_at | 2016-05-05T11:10:18 |
+-------------------+--------------------------------------------------+
Enable EPEL 7 to install vconfig ( or use ip CLI )
***************************************************
Next Step - external bridges setup on Controller
***************************************************
# modprobe 8021q
# ovs-vsctl add-br br-vlan
# ovs-vsctl add-port br-vlan eth2
# vconfig add br-vlan 157
# ovs-vsctl add-br br-vlan2
# ovs-vsctl add-port br-vlan2 eth3
# vconfig add br-vlan2 172
**********************************
External flat network
**********************************
# ovs-vsctl add-br br-eth4
# ovs-vsctl add-port br-eth4 eth4
****************************************************
Update Neutron OVS configuration files
****************************************************
Start with the following comment in
l3_agent.ini
:# When external_network_bridge is set, each L3 agent can be associated
# with no more than one external network. This value should be set to the UUID
# of that external network. To allow L3 agent support multiple external
# networks, both the external_network_bridge and gateway_external_network_id
# must be left empty.
******************************Update l3_agent.ini file
******************************
external_network_bridge =
gateway_external_network_id =
******************************************************
/etc/neutron/plugins/ml2/openvswitch_agent.ini
******************************************************
bridge_mappings = physnet1:br-eth1,vlan157:br-vlan,vlan172:br-vlan2,physnet4:br-eth4
*************************************
Update Neutron Configuration
*************************************
# openstack-service restart neutron
************************************************
Set up config persistent between reboots
************************************************
[root@ip-192-169-142-127 network-scripts(keystone_admin)]# cat ifcfg-eth2
DEVICE="eth2"
ONBOOT=yes
OVS_BRIDGE=br-vlan
TYPE=OVSPort
DEVICETYPE="ovs"
[root@ip-192-169-142-127 network-scripts(keystone_admin)]# cat ifcfg-eth3
DEVICE="eth3"
ONBOOT=yes
OVS_BRIDGE=br-vlan2
TYPE=OVSPort
DEVICETYPE="ovs"
[root@ip-192-169-142-127 network-scripts(keystone_admin)]# cat ifcfg-br-vlan
DEVICE=br-vlan
BOOTPROTO=none
ONBOOT=yes
TYPE=OVSBridge
DEVICETYPE="ovs"
[root@ip-192-169-142-127 network-scripts(keystone_admin)]# cat ifcfg-br-vlan2
DEVICE=br-vlan2
BOOTPROTO=none
ONBOOT=yes
TYPE=OVSBridge
DEVICETYPE="ovs"
[root@ip-192-169-142-127 network-scripts(keystone_admin)]# cat ifcfg-br-vlan.157
BOOTPROTO="none"
DEVICE="br-vlan.157"
ONBOOT="yes"
IPADDR="10.10.10.150"
PREFIX="24"
GATEWAY="10.10.10.1"
DNS1="83.221.202.254"
VLAN=yes
NOZEROCONF=yes
USERCTL=no
[root@ip-192-169-142-127 network-scripts(keystone_admin)]# cat ifcfg-br-vlan2.172
BOOTPROTO="none"
DEVICE="br-vlan2.172"
ONBOOT="yes"
IPADDR="10.10.50.150"
PREFIX="24"
GATEWAY="10.10.50.1"
DNS1="83.221.202.254"
VLAN=yes
NOZEROCONF=yes
***************************
Then run script
***************************
#!/bin/bash -x
chkconfig network on
systemctl stop NetworkManager
systemctl disable NetworkManager
service network restart
# openstack-service restart neutron
[root@ip-192-169-142-127 ~(keystone_admin)]# ip -details link show dev br-vlan.157
34: br-vlan.157@br-vlan: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT
link/ether ba:bb:33:85:aa:49 brd ff:ff:ff:ff:ff:ff promiscuity 0
vlan protocol 802.1Q id 157 <REORDER_HDR> addrgenmode eui64
[root@ip-192-169-142-127 ~(keystone_admin)]# ip -details link show dev br-vlan2.172
33: br-vlan2.172@br-vlan2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP mode DEFAULT
link/ether 0e:e7:2d:26:c3:4a brd ff:ff:ff:ff:ff:ff promiscuity 0
vlan protocol 802.1Q id 172 <REORDER_HDR> addrgenmode eui64
[root@ip-192-169-142-127 ~(keystone_admin)]# ip route
default via 10.10.10.1 dev br-vlan.157
10.10.10.0/24 dev br-vlan.157 proto kernel scope link src 10.10.10.150
10.10.50.0/24 dev br-vlan2.172 proto kernel scope link src 10.10.50.150
169.254.0.0/16 dev eth0 scope link metric 1002
169.254.0.0/16 dev eth1 scope link metric 1003
169.254.0.0/16 dev eth2 scope link metric 1004
169.254.0.0/16 dev eth3 scope link metric 1005
169.254.0.0/16 dev eth4 scope link metric 1006
169.254.0.0/16 dev br-vlan scope link metric 1009
169.254.0.0/16 dev br-ex scope link metric 1010
169.254.0.0/16 dev br-vlan2 scope link metric 1012
192.168.122.0/24 dev virbr0 proto kernel scope link src 192.168.122.1
192.169.142.0/24 dev br-ex proto kernel scope link src 192.169.142.127
***************************
Controller/Network***************************
[root@ip-192-169-142-127 ~(keystone_admin)]# ovs-vsctl show
d12e6a7a-f589-42cd-91b3-96156ad9ed59
Bridge br-int
fail_mode: secure
Port "tap114497da-9f"
tag: 1
Interface "tap114497da-9f"
type: internal
Port "tap390b9bc5-b9"
tag: 5
Interface "tap390b9bc5-b9"
type: internal
Port "int-br-vlan2"
Interface "int-br-vlan2"
type: patch
options: {peer="phy-br-vlan2"}
Port "tap4b0c52b8-90"
tag: 3
Interface "tap4b0c52b8-90"
type: internal
Port "qr-795380c4-1d"
tag: 2
Interface "qr-795380c4-1d"
type: internal
Port "qg-b856b873-d0"
tag: 3
Interface "qg-b856b873-d0"
type: internal
Port "tap119f2a5f-2e"
tag: 4
Interface "tap119f2a5f-2e"
type: internal
Port int-br-vlan
Interface int-br-vlan
type: patch
options: {peer=phy-br-vlan}
Port "qr-2e2d2e81-14"
tag: 1
Interface "qr-2e2d2e81-14"
type: internal
Port "qg-234c2d9c-0a"
tag: 4
Interface "qg-234c2d9c-0a"
type: internal
Port "qr-41a1a0fa-ec"
tag: 5
Interface "qr-41a1a0fa-ec"
type: internal
Port br-int
Interface br-int
type: internal
Port "qg-5c7b2d0a-1b"
tag: 6
Interface "qg-5c7b2d0a-1b"
type: internal
Port "int-br-eth4"
Interface "int-br-eth4"
type: patch
options: {peer="phy-br-eth4"}
Port "int-br-eth1"
Interface "int-br-eth1"
type: patch
options: {peer="phy-br-eth1"}
Port "tap936bd80d-26"
tag: 2
Interface "tap936bd80d-26"
type: internal
Bridge "br-vlan2" <===external vlan172 network
Port "eth3"
Interface "eth3"
Port "phy-br-vlan2"
Interface "phy-br-vlan2"
type: patch
options: {peer="int-br-vlan2"}
Port "br-vlan2"
Interface "br-vlan2"
type: internal
Bridge "br-eth4" <===external flat network
Port "eth4"
Interface "eth4"
Port "phy-br-eth4"
Interface "phy-br-eth4"
type: patch
options: {peer="int-br-eth4"}
Port "br-eth4"
Interface "br-eth4"
type: internal
Bridge br-ex
Port br-ex
Interface br-ex
type: internal
Port "eth0"
Interface "eth0"
Bridge "br-eth1" <=== internal vlan enabled vm/data network
Port "phy-br-eth1"
Interface "phy-br-eth1"
type: patch
options: {peer="int-br-eth1"}
Port "eth1"
Interface "eth1"
Port "br-eth1"
Interface "br-eth1"
type: internal
Bridge br-vlan <===external vlan157 network
Port br-vlan
Interface br-vlan
type: internal
Port "eth2"
Interface "eth2"
Port phy-br-vlan
Interface phy-br-vlan
type: patch
options: {peer=int-br-vlan}
ovs_version: "2.4.0"
[root@ip-192-169-142-127 ~(keystone_admin)]# ifconfig
br-ex: flags=4163
inet 192.169.142.127 netmask 255.255.255.0 broadcast 192.169.142.255
inet6 fe80::3058:e2ff:fe5c:f64c prefixlen 64 scopeid 0x20
ether 32:58:e2:5c:f6:4c txqueuelen 0 (Ethernet)
RX packets 54754 bytes 12112793 (11.5 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 48647 bytes 15788730 (15.0 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
br-vlan: flags=4163
inet6 fe80::2054:9fff:feb5:b645 prefixlen 64 scopeid 0x20
ether 22:54:9f:b5:b6:45 txqueuelen 0 (Ethernet)
RX packets 51 bytes 6647 (6.4 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 298 bytes 16763 (16.3 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
br-vlan2: flags=4163
inet6 fe80::149a:c9ff:fe29:2240 prefixlen 64 scopeid 0x20
ether 16:9a:c9:29:22:40 txqueuelen 0 (Ethernet)
RX packets 497 bytes 24405 (23.8 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 31 bytes 4481 (4.3 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
br-vlan.157: flags=4163
inet 10.10.10.150 netmask 255.255.255.0 broadcast 10.10.10.255
inet6 fe80::2054:9fff:feb5:b645 prefixlen 64 scopeid 0x20
ether 22:54:9f:b5:b6:45 txqueuelen 0 (Ethernet)
RX packets 34 bytes 4667 (4.5 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 290 bytes 14955 (14.6 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
br-vlan2.172: flags=4163
inet 10.10.50.150 netmask 255.255.255.0 broadcast 10.10.50.255
inet6 fe80::149a:c9ff:fe29:2240 prefixlen 64 scopeid 0x20
ether 16:9a:c9:29:22:40 txqueuelen 0 (Ethernet)
RX packets 480 bytes 16181 (15.8 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 23 bytes 3741 (3.6 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
eth0: flags=4163
inet6 fe80::5054:ff:fe82:e40e prefixlen 64 scopeid 0x20
ether 52:54:00:82:e4:0e txqueuelen 1000 (Ethernet)
RX packets 56233 bytes 12189701 (11.6 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 48639 bytes 15786905 (15.0 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
eth1: flags=4163
inet6 fe80::5054:ff:feb2:82c prefixlen 64 scopeid 0x20
ether 52:54:00:b2:08:2c txqueuelen 1000 (Ethernet)
RX packets 4327 bytes 2918115 (2.7 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 1882 bytes 6415333 (6.1 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
eth2: flags=4163
inet6 fe80::5054:ff:fec9:cdcf prefixlen 64 scopeid 0x20
ether 52:54:00:c9:cd:cf txqueuelen 1000 (Ethernet)
RX packets 3334 bytes 6491253 (6.1 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 3064 bytes 2816873 (2.6 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
eth3: flags=4163
inet6 fe80::5054:ff:fe48:266f prefixlen 64 scopeid 0x20
ether 52:54:00:48:26:6f txqueuelen 1000 (Ethernet)
RX packets 2027 bytes 108290 (105.7 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 88 bytes 43478 (42.4 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
eth4: flags=4163
inet6 fe80::5054:ff:fe92:f712 prefixlen 64 scopeid 0x20
ether 52:54:00:92:f7:12 txqueuelen 1000 (Ethernet)
RX packets 1489 bytes 77816 (75.9 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 9 bytes 718 (718.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
lo: flags=73
inet 127.0.0.1 netmask 255.0.0.0
inet6 ::1 prefixlen 128 scopeid 0x10
loop txqueuelen 0 (Local Loopback)
RX packets 422071 bytes 134700542 (128.4 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 422071 bytes 134700542 (128.4 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
virbr0: flags=4099
inet 192.168.122.1 netmask 255.255.255.0 broadcast 192.168.122.255
ether 52:54:00:e9:36:be txqueuelen 0 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
Verification VLAN connectivity from WKS (VM) having eth1.157 && eth2.172 to mentioned bellow Java Servers running on Compute Node 192.169.142.137 as Nova-Docker Containers (instances) with floating ips on vlan157 and vlan172 correspondently
******************************************************************************************
Network configuration on WKS
[root@VlanConnect ~]# ifconfig
eth0: flags=4163
inet 192.169.142.45 netmask 255.255.255.0 broadcast 192.169.142.255
inet6 fe80::5054:ff:fef5:a7eb prefixlen 64 scopeid 0x20
ether 52:54:00:f5:a7:eb txqueuelen 1000 (Ethernet)
RX packets 3358 bytes 178671 (174.4 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 22 bytes 3676 (3.5 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
eth1: flags=4163
inet6 fe80::5054:ff:fe2e:716c prefixlen 64 scopeid 0x20
ether 52:54:00:2e:71:6c txqueuelen 1000 (Ethernet)
RX packets 5154 bytes 1994070 (1.9 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 1157 bytes 153055 (149.4 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
eth2: flags=4163
inet6 fe80::5054:ff:fe62:5abb prefixlen 64 scopeid 0x20
ether 52:54:00:62:5a:bb txqueuelen 1000 (Ethernet)
RX packets 3384 bytes 213816 (208.8 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 654 bytes 36212 (35.3 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
eth1.157: flags=4163
inet 10.10.10.45 netmask 255.255.255.0 broadcast 10.10.10.255
inet6 fe80::5054:ff:fe2e:716c prefixlen 64 scopeid 0x20
ether 52:54:00:2e:71:6c txqueuelen 0 (Ethernet)
RX packets 1823 bytes 1786566 (1.7 MiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 1151 bytes 147974 (144.5 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
eth2.172: flags=4163
inet 10.10.50.45 netmask 255.255.255.0 broadcast 10.10.50.255
inet6 fe80::5054:ff:fe62:5abb prefixlen 64 scopeid 0x20
ether 52:54:00:62:5a:bb txqueuelen 0 (Ethernet)
RX packets 52 bytes 38138 (37.2 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 647 bytes 33022 (32.2 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
lo: flags=73
inet 127.0.0.1 netmask 255.0.0.0
inet6 ::1 prefixlen 128 scopeid 0x10
loop txqueuelen 0 (Local Loopback)
RX packets 590 bytes 62280 (60.8 KiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 590 bytes 62280 (60.8 KiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
virbr0: flags=4099
inet 192.168.122.1 netmask 255.255.255.0 broadcast 192.168.122.255
ether 52:54:00:13:11:69 txqueuelen 0 (Ethernet)
RX packets 0 bytes 0 (0.0 B)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 0 bytes 0 (0.0 B)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
5: eth1.157@eth1:
link/ether 52:54:00:2e:71:6c brd ff:ff:ff:ff:ff:ff promiscuity 0
vlan protocol 802.1Q id 157
[root@VlanConnect ~]# ip -details link show dev eth2.172
6: eth2.172@eth2:
link/ether 52:54:00:62:5a:bb brd ff:ff:ff:ff:ff:ff promiscuity 0
vlan protocol 802.1Q id 172
********************************************************************************
Attempt to launch browser to GlassFish 4.X and Tomcat 7.0 consoles
********************************************************************************
Nova-Docker instance derbyGlassfish01 on vlan157 (10.10.10.105:4848)
Nova-Docker instance Tomcat on vlan172 (10.10.50.105:8080)
Subscribe to:
Posts (Atom)