Two KVMs have been created , each one having 2 virtual NICs (eth0,eth1) for
Controller && Compute Nodes setup. Before running `packstack --answer-file=twoNode-answer.txt` SELINUX set to permissive on both nodes.
Both eth1's assigned IPs from GRE Libvirts subnet before installation and set
to promiscuous mode (192.168.122.127, 192.168.122.137 ). Packstack bind to
public IP - eth0 192.169.142.127 , Compute Node 192.169.142.137
GRE Tunnel Support subnet: 192.168.122.0/24
After packstack 2 Node (Controller+Compute) IceHouse OVS&GRE setup :-
Controller && Compute Nodes setup. Before running `packstack --answer-file=twoNode-answer.txt` SELINUX set to permissive on both nodes.
Both eth1's assigned IPs from GRE Libvirts subnet before installation and set
to promiscuous mode (192.168.122.127, 192.168.122.137 ). Packstack bind to
public IP - eth0 192.169.142.127 , Compute Node 192.169.142.137
ANSWER FILE Two Node IceHouse Neutron OVS&GRE && Updated *.ini , *.conf files after packstack setup http://textuploader.com/0ts8
Two Libvirt's subnet created on F20 KVM Sever to support installation
Public subnet : 192.169.142.0/24
GRE Tunnel Support subnet: 192.168.122.0/24
1. Create a new libvirt network (other than your default 198.162.x.x) file: $ cat openstackvms.xml
<network>
<name>openstackvms</name>
<uuid>d0e9964a-f91a-40c0-b769-a609aee41bf2</uuid>
<forward mode='nat'>
<nat>
<port start='1024' end='65535'/>
</nat>
</forward>
<bridge name='virbr1' stp='on' delay='0' />
<mac address='52:54:00:60:f8:6e'/>
<ip address='192.169.142.1' netmask='255.255.255.0'>
<dhcp>
<range start='192.169.142.2' end='192.169.142.254' />
</dhcp>
</ip>
</network>
2. Define the above network: $ virsh net-define openstackvms.xml 3. Start the network and enable it for "autostart"
$ virsh net-start openstackvms $ virsh net-autostart openstackvms 4. List your libvirt networks to see if it reflects: $ virsh net-list Name State Autostart Persistent ---------------------------------------------------------- default active yes yes openstackvms active yes yes 5. Optionally, list your bridge devices: $ brctl show bridge name bridge id STP enabled interfaces virbr0 8000.5254003339b3 yes virbr0-nic virbr1 8000.52540060f86e yes virbr1-nic
After packstack 2 Node (Controller+Compute) IceHouse OVS&GRE setup :-
[root@ip-192-169-142-127 ~]# mysql -u root -p
Enter password:
Welcome to the MariaDB monitor. Commands end with ; or \g.
Your MariaDB connection id is 143
Server version: 5.5.36-MariaDB-wsrep MariaDB Server, wsrep_25.9.r3961
Copyright (c) 2000, 2014, Oracle, Monty Program Ab and others.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
MariaDB [(none)]> show databases ;
+--------------------+
| Database |
+--------------------+
| information_schema |
| cinder |
| glance |
| keystone |
| mysql |
| nova |
| ovs_neutron |
| performance_schema |
| test |
+--------------------+
9 rows in set (0.02 sec)
MariaDB [(none)]> use ovs_neutron ;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A
Database changed
MariaDB [ovs_neutron]> show tables ;
+---------------------------+
| Tables_in_ovs_neutron |
+---------------------------+
| agents |
| alembic_version |
| allowedaddresspairs |
| dnsnameservers |
| externalnetworks |
| extradhcpopts |
| floatingips |
| ipallocationpools |
| ipallocations |
| ipavailabilityranges |
| networkdhcpagentbindings |
| networks |
| ovs_network_bindings |
| ovs_tunnel_allocations |
| ovs_tunnel_endpoints |
| ovs_vlan_allocations |
| portbindingports |
| ports |
| quotas |
| routerl3agentbindings |
| routerroutes |
| routers |
| securitygroupportbindings |
| securitygrouprules |
| securitygroups |
| servicedefinitions |
| servicetypes |
| subnetroutes |
| subnets |
+---------------------------+
29 rows in set (0.00 sec)
MariaDB [ovs_neutron]> select * from networks ;
+----------------------------------+--------------------------------------+---------+--------+----------------+--------+
| tenant_id | id | name | status | admin_state_up | shared |
+----------------------------------+--------------------------------------+---------+--------+----------------+--------+
| 179e44f8f53641da89c3eb5d07405523 | 3854bc88-ae14-47b0-9787-233e54ffe7e5 | private | ACTIVE | 1 | 0 |
| 179e44f8f53641da89c3eb5d07405523 | 6e8dc33d-55d4-47b5-925f-e1fa96128c02 | public | ACTIVE | 1 | 1 |
+----------------------------------+--------------------------------------+---------+--------+----------------+--------+
2 rows in set (0.00 sec)
MariaDB [ovs_neutron]> select * from routers ;
+----------------------------------+--------------------------------------+---------+--------+----------------+--------------------------------------+-------------+
| tenant_id | id | name | status | admin_state_up | gw_port_id | enable_snat |
+----------------------------------+--------------------------------------+---------+--------+----------------+--------------------------------------+-------------+
| 179e44f8f53641da89c3eb5d07405523 | 94829282-e6b2-4364-b640-8c0980218a4f | ROUTER3 | ACTIVE | 1 | df9711e4-d1a2-4255-9321-69105fbd8665 | 1 |
+----------------------------------+--------------------------------------+---------+--------+----------------+--------------------------------------+-------------+
1 row in set (0.00 sec)
MariaDB [ovs_neutron]>
*********************
On Controller :-
********************
[root@ip-192-169-142-127 network-scripts]# cat ifcfg-br-ex
DEVICE="br-ex"
BOOTPROTO="static"
IPADDR="192.169.142.127"
NETMASK="255.255.255.0"
DNS1="83.221.202.254"
BROADCAST="192.169.142.255"
GATEWAY="192.169.142.1"
NM_CONTROLLED="no"
DEFROUTE="yes"
IPV4_FAILURE_FATAL="yes"
IPV6INIT=no
ONBOOT="yes"
TYPE="OVSBridge"
DEVICETYPE="ovs"
[root@ip-192-169-142-127 network-scripts]# cat ifcfg-eth0
DEVICE=eth0
ONBOOT="yes"
TYPE="OVSPort"
DEVICETYPE="ovs"
OVS_BRIDGE=br-ex
NM_CONTROLLED=no
IPV6INIT=no
[root@ip-192-169-142-127 network-scripts]# cat ifcfg-eth1
TYPE=Ethernet
BOOTPROTO=none
DEFROUTE=yes
IPV4_FAILURE_FATAL=no
IPV6INIT=yes
IPV6_AUTOCONF=yes
IPV6_DEFROUTE=yes
IPV6_FAILURE_FATAL=no
DEVICE=eth1
ONBOOT=yes
IPADDR=192.168.122.127
PREFIX=24
GATEWAY=192.168.122.1
DNS1=83.221.202.254
NM_CONTROLLED=no
IPV6_PEERDNS=yes
IPV6_PEERROUTES=yes
*************************************
ovs-vsctl show output on controller
*************************************
[root@ip-192-169-142-127 ~(keystone_admin)]# ovs-vsctl show
dc2c76d6-40e3-496e-bdec-470452758c32
Bridge br-tun
Port patch-int
Interface patch-int
type: patch
options: {peer=patch-tun}
Port "gre-1"
Interface "gre-1"
type: gre
options: {in_key=flow, local_ip="192.168.122.127", out_key=flow, remote_ip="192.168.122.137"}
Port br-tun
Interface br-tun
type: internal
Bridge br-int
Port br-int
Interface br-int
type: internal
Port patch-tun
Interface patch-tun
type: patch
options: {peer=patch-int}
Port "tap7acb7666-aa"
tag: 1
Interface "tap7acb7666-aa"
type: internal
Port "qr-a26fe722-07"
tag: 1
Interface "qr-a26fe722-07"
type: internal
Bridge br-ex
Port "qg-df9711e4-d1"
Interface "qg-df9711e4-d1"
type: internal
Port "eth0"
Interface "eth0"
Port br-ex
Interface br-ex
type: internal
ovs_version: "2.1.2"
********************
On Compute:-
********************
[root@ip-192-169-142-137 network-scripts]# cat ifcfg-eth0
TYPE=Ethernet
BOOTPROTO=static
DEFROUTE=yes
IPV4_FAILURE_FATAL=no
IPV6INIT=yes
IPV6_AUTOCONF=yes
IPV6_DEFROUTE=yes
IPV6_FAILURE_FATAL=no
DEVICE=eth0
UUID=f96e561d-d14c-4fb1-9657-0c935f7f5721
ONBOOT=yes
IPADDR=192.169.142.137
PREFIX=24
GATEWAY=192.169.142.1
DNS1=83.221.202.254
HWADDR=52:54:00:67:AC:04
NM_CONTROLLED=no
IPV6_PEERDNS=yes
IPV6_PEERROUTES=yes
[root@ip-192-169-142-137 network-scripts]# cat ifcfg-eth1
TYPE=Ethernet
BOOTPROTO=none
DEFROUTE=yes
IPV4_FAILURE_FATAL=no
IPV6INIT=yes
IPV6_AUTOCONF=yes
IPV6_DEFROUTE=yes
IPV6_FAILURE_FATAL=no
DEVICE=eth1
ONBOOT=yes
IPADDR=192.168.122.137
PREFIX=24
GATEWAY=192.168.122.1
DNS1=83.221.202.254
NM_CONTROLLED=no
IPV6_PEERDNS=yes
IPV6_PEERROUTES=yes
************************************
ovs-vsctl show output on compute
************************************
[root@ip-192-169-142-137 ~]# ovs-vsctl show
1c6671de-fcdf-4a29-9eee-96c949848fff
Bridge br-tun
Port "gre-2"
Interface "gre-2"
type: gre
options: {in_key=flow, local_ip="192.168.122.137", out_key=flow, remote_ip="192.168.122.127"}
Port patch-int
Interface patch-int
type: patch
options: {peer=patch-tun}
Port br-tun
Interface br-tun
type: internal
Bridge br-int
Port "qvo87038189-3f"
tag: 1
Interface "qvo87038189-3f"
Port patch-tun
Interface patch-tun
type: patch
options: {peer=patch-int}
Port br-int
Interface br-int
type: internal
ovs_version: "2.1.2"
[root@ip-192-169-142-137 ~]# brctl show
bridge name bridge id STP enabled interfaces
qbr87038189-3f 8000.2abf9e69f97c no qvb87038189-3f
tap87038189-3f
*************************
Metadata verification
*************************
[root@ip-192-169-142-127 ~(keystone_admin)]# ip netns exec qrouter-94829282-e6b2-4364-b640-8c0980218a4f iptables -S -t nat | grep 169.254
-A neutron-l3-agent-PREROUTING -d 169.254.169.254/32 -p tcp -m tcp --dport 80 -j REDIRECT --to-ports 9697
[root@ip-192-169-142-127 ~(keystone_admin)]# ip netns exec qrouter-94829282-e6b2-4364-b640-8c0980218a4f netstat -anpt
Active Internet connections (servers and established)
Proto Recv-Q Send-Q Local Address Foreign Address State PID/Program name
tcp 0 0 0.0.0.0:9697 0.0.0.0:* LISTEN 3771/python
[root@ip-192-169-142-127 ~(keystone_admin)]# ps -ef | 3771
bash: 3771: command not found...
[root@ip-192-169-142-127 ~(keystone_admin)]# ps -ef | grep 3771
root 3771 1 0 13:58 ? 00:00:00 /usr/bin/python /bin/neutron-ns-metadata-proxy --pid_file=/var/lib/neutron/external/pids/94829282-e6b2-4364-b640-8c0980218a4f.pid --metadata_proxy_socket=/var/lib/neutron/metadata_proxy --router_id=94829282-e6b2-4364-b640-8c0980218a4f --state_path=/var/lib/neutron --metadata_port=9697 --verbose --log-file=neutron-ns-metadata-proxy-94829282-e6b2-4364-b640-8c0980218a4f.log --log-dir=/var/log/neutron
[root@ip-192-169-142-127 ~(keystone_admin)]# netstat -anpt | grep 9697
tcp 0 0 0.0.0.0:9697 0.0.0.0:* LISTEN 1024/python
[root@ip-192-169-142-127 ~(keystone_admin)]# ps -ef | grep 1024
nova 1024 1 1 13:58 ? 00:00:05 /usr/bin/python /usr/bin/nova-api
nova 3369 1024 0 13:58 ? 00:00:00 /usr/bin/python /usr/bin/nova-api
nova 3370 1024 0 13:58 ? 00:00:00 /usr/bin/python /usr/bin/nova-api
nova 3397 1024 0 13:58 ? 00:00:02 /usr/bin/python /usr/bin/nova-api
nova 3398 1024 0 13:58 ? 00:00:02 /usr/bin/python /usr/bin/nova-api
nova 3423 1024 0 13:58 ? 00:00:00 /usr/bin/python /usr/bin/nova-api
nova 3424 1024 0 13:58 ? 00:00:00 /usr/bin/python /usr/bin/nova-api
root 4947 4301 0 14:06 pts/0 00:00:00 grep --color=auto 1024
