Xen Virtualization on Linux and Solaris: RDO Setup Two Real Node (Controller+Compute) IceHouse Neutron ML2&OVS&VLAN Cluster on Fedora 20

Successful implementation of Neutron ML2&&OVS&&VLAN multi node setup requires correct version of plugin.ini -> /etc/neutron/plugins/ml2/ml2_conf.ini which appears to be generated with errors by packstack. Several days playing with plugin.ini allowed me to build properly working system

Two boxes have been setup , each one having 2 NICs (p37p1,p4p1) for
Controller && Compute Nodes setup. Before running
`packstack --answer-file= TwoRealNode Neutron ML2&OVS&VLAN.txt` SELINUX set to permissive on both nodes.Both p4p1's assigned IPs and set to promiscuous mode (192.168.0.127, 192.168.0.137 ). Services firewalld and NetworkManager disabled, IPv4 firewall with iptables and service network are enabled and running. Packstack is bind to public IP of interface p37p1 192.169.1.127, Compute Node is 192.169.1.137 ( view answer-file ).

Setup configuration

- Controller node: Nova, Keystone, Cinder, Glance, Neutron (using Open vSwitch plugin && VLAN )
- Compute node: Nova (nova-compute), Neutron (openvswitch-agent)

icehouse1.localdomain - Controller (192.168.1.127)
icehouse2.localdomain - Compute (192.168.1.137)

Status after packstack install and updating /etc/neutron/plugin.ini as shown bellow

[root@icehouse1 neutron]# cat plugin.ini
[ml2]
type_drivers = vlan
tenant_network_types = vlan
mechanism_drivers = openvswitch
[ml2_type_vlan]
network_vlan_ranges = physnet1:100:200
[ovs]
network_vlan_ranges = physnet1:100:200
tenant_network_type = vlan
enable_tunneling = False
integration_bridge = br-int
bridge_mappings = physnet1:br-p4p1
local_ip = 192.168.1.127
[AGENT]
polling_interval = 2
[SECURITYGROUP]
firewall_driver = neutron.agent.linux.iptables_firewall.OVSHybridIptablesFirewallDriver

Recreating link plugin.ini :-

    [root@ip-192-169-142-127 neutron]# ls -l
     total 84
    -rw-r--r--. 1 root root      197 Jun 20 11:18 api-paste.ini
    -rw-r-----. 1 root neutron  3855 Jun 21 08:17 dhcp_agent.ini
    -rw-r--r--. 1 root root      333 Jun 21 13:35 dhcp_agent.out
    -rw-r-----. 1 root neutron   109 Apr 17 15:50 fwaas_driver.ini
    -rw-r-----. 1 root neutron  3431 Jun 20 14:42 l3_agent.ini
    -rw-r-----. 1 root neutron  1400 Apr 17 15:50 lbaas_agent.ini
    -rw-r-----. 1 root neutron   328 Jun 20 14:58 metadata_agent.ini
    -rw-r-----. 1 root neutron 19057 Jun 21 13:47 neutron.conf
    lrwxrwxrwx. 1 root root       37 Jun 21 15:30 plugin.ini -> /etc/neutron/plugins/ml2/ml2_conf.ini
    drwxr-xr-x. 4 root root     4096 Jun 20 11:18 plugins
    -rw-r-----. 1 root neutron  6148 Apr 17 15:50 policy.json
    -rw-r--r--. 1 root root       80 May 19 19:53 release
    -rw-r--r--. 1 root root     1216 Apr 17 15:50 rootwrap.conf

Restarting Compute and Controller nodes

[root@icehouse1 ~(keystone_admin)]# openstack-status
== Nova services ==
openstack-nova-api:                     active
openstack-nova-cert:                    active
openstack-nova-compute:                 inactive (disabled on boot)
openstack-nova-network:                 inactive (disabled on boot)
openstack-nova-scheduler:               active
openstack-nova-volume:                  inactive (disabled on boot)
openstack-nova-conductor:               active
== Glance services ==
openstack-glance-api:                   active
openstack-glance-registry:              active
== Keystone service ==
openstack-keystone:                     active
== Horizon service ==
openstack-dashboard:                    active
== neutron services ==
neutron-server:                         active
neutron-dhcp-agent:                     active
neutron-l3-agent:                       active
neutron-metadata-agent:                 active
neutron-lbaas-agent:                    inactive (disabled on boot)
neutron-openvswitch-agent:              active
neutron-linuxbridge-agent:              inactive (disabled on boot)
neutron-ryu-agent:                      inactive (disabled on boot)
neutron-nec-agent:                      inactive (disabled on boot)
neutron-mlnx-agent:                     inactive (disabled on boot)
== Cinder services ==
openstack-cinder-api:                   active
openstack-cinder-scheduler:             active
openstack-cinder-volume:                active
openstack-cinder-backup:                inactive (disabled on boot)
== Ceilometer services ==
openstack-ceilometer-api:               failed
openstack-ceilometer-central:           active
openstack-ceilometer-compute:           inactive (disabled on boot)
openstack-ceilometer-collector:         active
openstack-ceilometer-alarm-notifier:    active
openstack-ceilometer-alarm-evaluator:   active
== Support services ==
openvswitch:                            active
dbus:                                   active
tgtd:                                   active
rabbitmq-server:                        active
memcached:                              active

== Nova networks ==
+--------------------------------------+---------+------+
| ID                                   | Label   | Cidr |
+--------------------------------------+---------+------+
| f4e7f0f5-bdb4-43fe-bfc4-6e16428638ef | private | -    |
| f23bd22c-a755-4119-9911-97980a0bd9ba | public | -    |
+--------------------------------------+---------+------+

== Nova instance flavors ==
+----+-----------+-----------+------+-----------+------+-------+-------------+-----------+
| ID | Name      | Memory_MB | Disk | Ephemeral | Swap | VCPUs | RXTX_Factor | Is_Public |
+----+-----------+-----------+------+-----------+------+-------+-------------+-----------+
| 1 | m1.tiny   | 512       | 1    | 0         |      | 1     | 1.0         | True      |
| 2 | m1.small | 2048      | 20   | 0         |      | 1     | 1.0         | True      |
| 3 | m1.medium | 4096      | 40   | 0         |      | 2     | 1.0         | True      |
| 4 | m1.large | 8192      | 80   | 0         |      | 4     | 1.0         | True      |
| 5 | m1.xlarge | 16384     | 160 | 0         |      | 8     | 1.0         | True      |
+----+-----------+-----------+------+-----------+------+-------+-------------+-----------+

[root@icehouse1 ~(keystone_admin)]# nova-manage service list
Binary           Host                                 Zone             Status     State Updated_At
nova-consoleauth icehouse1.localdomain                internal         enabled    :-)   2014-06-23 11:14:46
nova-scheduler   icehouse1.localdomain                internal         enabled    :-)   2014-06-23 11:14:46
nova-conductor   icehouse1.localdomain                internal         enabled    :-)   2014-06-23 11:14:44
nova-cert        icehouse1.localdomain                internal         enabled    :-)   2014-06-23 11:14:46
nova-compute     icehouse2.localdomain                nova             enabled    :-)   2014-06-23 11:14:49

[root@icehouse1 ~(keystone_admin)]# neutron agent-list
+--------------------------------------+--------------------+-----------------------+-------+----------------+
| id                                   | agent_type         | host                  | alive | admin_state_up |
+--------------------------------------+--------------------+-----------------------+-------+----------------+
| 4c79ae4c-374a-43a8-a4cd-a839788af56e | L3 agent           | icehouse1.localdomain | :-)   | True           |
| 5c4d05a2-e9e4-47b7-b9ee-ed815e205925 | Open vSwitch agent | icehouse2.localdomain | :-)   | True           |
| 6fa0f569-ea7f-4925-b788-b0d70442c9e0 | DHCP agent         | icehouse1.localdomain | :-)   | True           |
| c6fca55b-e9ad-433a-b146-5223b1b4b851 | Metadata agent     | icehouse1.localdomain | :-)   | True           |
| e62f13a6-7d5c-44ac-8a99-6211e62a0c3c | Open vSwitch agent | icehouse1.localdomain | :-)   | True           |
+--------------------------------------+--------------------+-----------------------+-------+----------------+

[root@icehouse1 ~(keystone_admin)]# mysql -u root -p
Enter password:
Welcome to the MariaDB monitor. Commands end with ; or \g.
Your MariaDB connection id is 389
Server version: 5.5.36-MariaDB-wsrep MariaDB Server, wsrep_25.9.r3961

Copyright (c) 2000, 2014, Oracle, Monty Program Ab and others.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

MariaDB [(none)]> show databases ;
+--------------------+
| Database           |
+--------------------+
| information_schema |
| cinder             |
| glance             |
| keystone           |
| mysql              |
| neutron            |
| nova               |
| performance_schema |
| test               |
+--------------------+
9 rows in set (0.03 sec)

MariaDB [(none)]> use neutron ;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A

Database changed

MariaDB [(none)]> SELECT TABLE_NAME, ENGINE FROM information_schema.TABLES where TABLE_SCHEMA = 'neutron';
+------------------------------+--------+
| TABLE_NAME                   | ENGINE |
+------------------------------+--------+
| agents                       | InnoDB |
| alembic_version              | InnoDB |
| allowedaddresspairs          | InnoDB |
| arista_provisioned_nets      | InnoDB |
| arista_provisioned_tenants   | InnoDB |
| arista_provisioned_vms       | InnoDB |
| cisco_ml2_credentials        | InnoDB |
| cisco_ml2_nexusport_bindings | InnoDB |
| consistencyhashes            | InnoDB |
| dnsnameservers               | InnoDB |
| externalnetworks             | InnoDB |
| extradhcpopts                | InnoDB |
| floatingips                  | InnoDB |
| ipallocationpools            | InnoDB |
| ipallocations                | InnoDB |
| ipavailabilityranges         | InnoDB |
| ml2_brocadenetworks          | InnoDB |
| ml2_brocadeports             | InnoDB |
| ml2_flat_allocations         | InnoDB |
| ml2_gre_allocations          | InnoDB |
| ml2_gre_endpoints            | InnoDB |
| ml2_network_segments         | InnoDB |
| ml2_port_bindings            | InnoDB |
| ml2_vlan_allocations         | InnoDB |
| ml2_vxlan_allocations        | InnoDB |
| ml2_vxlan_endpoints          | InnoDB |
| networkdhcpagentbindings     | InnoDB |
| networks                     | InnoDB |
| ports                        | InnoDB |
| quotas                       | InnoDB |
| routerl3agentbindings        | InnoDB |
| routerroutes                 | InnoDB |
| routers                      | InnoDB |
| securitygroupportbindings    | InnoDB |
| securitygrouprules           | InnoDB |
| securitygroups               | InnoDB |
| servicedefinitions           | InnoDB |
| servicetypes                 | InnoDB |
| subnetroutes                 | InnoDB |
| subnets                      | InnoDB |
+------------------------------+--------+
40 rows in set (0.01 sec)

MariaDB [neutron]> select * from ml2_port_bindings ;
+--------------------------------------+-----------------------+----------+-------------+--------------------------------------+-----------+------------------------------------------------+---------+
| port_id                              | host                  | vif_type | driver      | segment                              | vnic_type | vif_details                                    | profile |
+--------------------------------------+-----------------------+----------+-------------+--------------------------------------+-----------+------------------------------------------------+---------+
| 2c664775-624d-4e92-9510-3b95b851f0cc | icehouse2.localdomain | ovs      | openvswitch | 78561388-cad6-43b0-8909-7f34426faf41 | normal    | {"port_filter": true, "ovs_hybrid_plug": true} |         |
| 3073e90e-d8c1-4bc9-9478-aacc5e36672d | icehouse1.localdomain | ovs      | openvswitch | 78561388-cad6-43b0-8909-7f34426faf41 | normal    | {"port_filter": true, "ovs_hybrid_plug": true} | {}      |
| 32b3bc11-b9d0-4f8c-8489-288c627784be |                       | unbound | NULL        | NULL                                 | normal    |                                                | {}      |
| 425eedda-772a-411d-8db8-8fae20f22e10 |                       | unbound | NULL        | NULL                                 | normal    |                                                | {}      |
| 495ba455-4034-4388-ba20-1d36b2c53fc7 | icehouse2.localdomain | ovs      | openvswitch | 78561388-cad6-43b0-8909-7f34426faf41 | normal    | {"port_filter": true, "ovs_hybrid_plug": true} |         |
| 6aa4d544-e29e-436b-801a-72edfe3ab386 |                       | unbound | NULL        | NULL                                 | normal    |                                                | {}      |
| 8be46650-b3b5-4494-8661-4aba15be0bb6 | icehouse2.localdomain | ovs      | openvswitch | 78561388-cad6-43b0-8909-7f34426faf41 | normal    | {"port_filter": true, "ovs_hybrid_plug": true} |         |
| a55e262f-c878-4b27-8176-8c8ce946fbd5 | icehouse1.localdomain | ovs      | openvswitch | 78561388-cad6-43b0-8909-7f34426faf41 | normal    | {"port_filter": true, "ovs_hybrid_plug": true} | {}      |
| ce46806f-9693-4baf-9bb0-5f33ac72f9c3 | icehouse1.localdomain | ovs      | openvswitch | 8ce25f91-9f4c-431b-ab3a-2766359cf8e4 | normal    | {"port_filter": true, "ovs_hybrid_plug": true} | {}      |
+--------------------------------------+-----------------------+----------+-------------+--------------------------------------+-----------+------------------------------------------------+---------+
9 rows in set (0.00 sec)

MariaDB [neutron]> select * from ml2_network_segments ;
+--------------------------------------+--------------------------------------+--------------+------------------+-----------------+
| id                                   | network_id                           | network_type | physical_network | segmentation_id |
+--------------------------------------+--------------------------------------+--------------+------------------+-----------------+
| 78561388-cad6-43b0-8909-7f34426faf41 | f4e7f0f5-bdb4-43fe-bfc4-6e16428638ef | vlan         | physnet1         |             101 |
| 8ce25f91-9f4c-431b-ab3a-2766359cf8e4 | f23bd22c-a755-4119-9911-97980a0bd9ba | vlan         | physnet1         |             100 |
+--------------------------------------+--------------------------------------+--------------+------------------+-----------------+
2 rows in set (0.00 sec)

MATE Setup on Fedora 20 VM

# yum -y groups install "MATE Desktop"
$ echo "exec /usr/bin/mate-session" >> ~/.xinitrc
$ startx
# ln -sf /lib/systemd/system/graphical.target /etc/systemd/system/default.target

VM reboot