Saturday, May 17, 2014

Two Node (Controller+Compute) IceHouse Neutron OVS&VLAN Cluster on CentOS 6.5

 Two KVMs have been created , each one having 2 virtual NICs (eth0,eth1) for
Controller && Compute Nodes setup. Before running `packstack --answer-file=twoNode-answer.txt` SELINUX set to permissive on both nodes. Service NetworkManager disabled, service network enabled. Interfaces eth1 on both nodes set to promiscuous mode (e.g. HWADDRESS was commented out). Testing VMs network performance on Compute Node , I had to disable checksum offloading on eth1 on Compute :-

# /sbin/ethtool --offload eth1 tx off

In case of further problems with network,  switch to setup on non-default Libvirt's subnet ( for instance 192.169.142.0/24).

View How to create non-default Libvirt subnet
http://kashyapc.fedorapeople.org/virt/create-a-new-libvirt-bridge.txt

Link for download is here Answer-file

After  `packstack --answer-file=twoNode-answer.txt` successful run :-

[root@icehouse1 neutron(keystone_admin)]# openstack-status

== Nova services ==
openstack-nova-api:                     active
openstack-nova-cert:                    active
openstack-nova-compute:                 active
openstack-nova-network:                 dead      (disabled on boot)
openstack-nova-scheduler:               active
openstack-nova-conductor:               active
== Glance services ==
openstack-glance-api:                   active
openstack-glance-registry:              active
== Keystone service ==
openstack-keystone:                     active
== Horizon service ==
openstack-dashboard:                    active
== neutron services ==
neutron-server:                         active
neutron-dhcp-agent:                     active
neutron-l3-agent:                       active
neutron-metadata-agent:                 active
neutron-lbaas-agent:                    active
neutron-openvswitch-agent:              active
== Swift services ==
openstack-swift-proxy:                  active
openstack-swift-account:                active
openstack-swift-container:              active
openstack-swift-object:                 active
== Cinder services ==
openstack-cinder-api:                   active
openstack-cinder-scheduler:             active
openstack-cinder-volume:                active
openstack-cinder-backup:                active
== Ceilometer services ==
openstack-ceilometer-api:               active
openstack-ceilometer-central:           active
openstack-ceilometer-compute:           active
openstack-ceilometer-collector:         active
openstack-ceilometer-alarm-notifier:    active
openstack-ceilometer-alarm-evaluator:   active
== Support services ==
libvirtd:                               active
openvswitch:                            active
messagebus:                             active
tgtd:                                   active
rabbitmq-server:                        active
memcached:                              active
== Keystone users ==
+----------------------------------+------------+---------+----------------------+
|                id                |    name    | enabled |        email         |
+----------------------------------+------------+---------+----------------------+
| 4f12ef0e71c14001a083467641658abf |   admin    |   True  |    test@test.com     |
| 162bc283029a4a3fbe48608c3eb0ed09 | ceilometer |   True  | ceilometer@localhost |
| 16188cb1bff44e73841fe34960c996fb |   cinder   |   True  |   cinder@localhost   |
| c04ccaf920b447b9913120de4621694d |   glance   |   True  |   glance@localhost   |
| 5a56b1e0d4fc450ca2a167aa089e4f60 |  neutron   |   True  |  neutron@localhost   |
| 404c881482c34577bdb07847c1514f35 |    nova    |   True  |    nova@localhost    |
| 9145a9d4414a48cf9b2bd652d2e5415e |   swift    |   True  |   swift@localhost    |
+----------------------------------+------------+---------+----------------------+
== Glance images ==
+--------------------------------------+---------------+-------------+------------------+----------+--------+
| ID                                   | Name          | Disk Format | Container Format | Size     | Status |
+--------------------------------------+---------------+-------------+------------------+----------+--------+
| 1cbfb4d8-ba0b-4553-b8f6-460cba1531c2 | Cirros31Image | qcow2       | bare             | 13147648 | active |
+--------------------------------------+---------------+-------------+------------------+----------+--------+
== Nova managed services ==
+------------------+-----------------------+----------+---------+-------+----------------------------+-----------------+
| Binary           | Host                  | Zone     | Status  | State | Updated_at                 | Disabled Reason |
+------------------+-----------------------+----------+---------+-------+----------------------------+-----------------+
| nova-consoleauth | icehouse1.localdomain | internal | enabled | up    | 2014-05-17T23:14:48.000000 | -               |
| nova-scheduler   | icehouse1.localdomain | internal | enabled | up    | 2014-05-17T23:14:48.000000 | -               |
| nova-conductor   | icehouse1.localdomain | internal | enabled | up    | 2014-05-17T23:14:45.000000 | -               |
| nova-compute     | icehouse1.localdomain | nova     | enabled | up    | 2014-05-17T23:14:49.000000 | -               |
| nova-cert        | icehouse1.localdomain | internal | enabled | up    | 2014-05-17T23:14:51.000000 | -               |
| nova-compute     | icehouse2.localdomain | nova     | enabled | up    | 2014-05-17T23:14:46.000000 | -               |
+------------------+-----------------------+----------+---------+-------+----------------------------+-----------------+
== Nova networks ==
+--------------------------------------+--------+------+
| ID                                   | Label  | Cidr |
+--------------------------------------+--------+------+
| 6af03a26-3577-4dbc-b1cf-2bd571de04d8 | public | -    |
| c358b6ac-ecd8-4ac7-8c54-4a97a1946969 | int    | -    |
| ec5c4d42-207a-4b38-b8b8-6426e4765756 | int1   | -    |
+--------------------------------------+--------+------+
== Nova instance flavors ==
+----+-----------+-----------+------+-----------+------+-------+-------------+-----------+
| ID | Name      | Memory_MB | Disk | Ephemeral | Swap | VCPUs | RXTX_Factor | Is_Public |
+----+-----------+-----------+------+-----------+------+-------+-------------+-----------+
| 1  | m1.tiny   | 512       | 1    | 0         |      | 1     | 1.0         | True      |
| 2  | m1.small  | 2048      | 20   | 0         |      | 1     | 1.0         | True      |
| 3  | m1.medium | 4096      | 40   | 0         |      | 2     | 1.0         | True      |
| 4  | m1.large  | 8192      | 80   | 0         |      | 4     | 1.0         | True      |
| 5  | m1.xlarge | 16384     | 160  | 0         |      | 8     | 1.0         | True      |
+----+-----------+-----------+------+-----------+------+-------+-------------+-----------+
== Nova instances ==
+--------------------------------------+----------+-----------+------------+-------------+--------------------------------+
| ID                                   | Name     | Status    | Task State | Power State | Networks                       |
+--------------------------------------+----------+-----------+------------+-------------+--------------------------------+
| c7546511-b4ae-45ef-b5c1-5b5beaee3ec9 | Cirros31 | SUSPENDED | -          | Shutdown    | int1=40.0.0.2, 192.168.122.153 |
+--------------------------------------+----------+-----------+------------+-------------+--------------------------------+

[root@icehouse1 neutron(keystone_admin)]# nova-manage service list
Binary           Host                                 Zone             Status     State Updated_At

nova-consoleauth icehouse1.localdomain                internal         enabled    :-)   2014-05-17 23:14:58
nova-scheduler   icehouse1.localdomain                 internal         enabled    :-)   2014-05-17 23:14:58
nova-conductor   icehouse1.localdomain                internal         enabled    :-)   2014-05-17 23:14:55
nova-compute     icehouse1.localdomain                 nova             enabled    :-)   2014-05-17 23:14:59
nova-cert        icehouse1.localdomain                     internal         enabled    :-)   2014-05-17 23:15:01
nova-compute     icehouse2.localdomain                 nova             enabled    :-)   2014-05-17 23:14:56


[root@icehouse1 neutron(keystone_admin)]# neutron agent-list
+--------------------------------------+--------------------+-----------------------+-------+----------------+
| id                                   | agent_type         | host                  | alive | admin_state_up |
+--------------------------------------+--------------------+-----------------------+-------+----------------+
| 23f809cf-839d-45ae-9050-48e73e4ba7cc | Open vSwitch agent | icehouse2.localdomain | :-)   | True           |
| 56eed6cc-3218-42e0-87dd-0daec7d41e2d | Metadata agent     | icehouse1.localdomain | :-)   | True           |
| 6787db4d-0124-428f-bfaf-91ab4c1c7a01 | Open vSwitch agent | icehouse1.localdomain | :-)   | True           |
| b3ac0969-023e-4d15-b40f-d1d056ff9132 | DHCP agent         | icehouse1.localdomain | :-)   | True           |
| da5b54e8-b8c5-4429-8938-907ce51dc0b7 | L3 agent           | icehouse1.localdomain | :-)   | True           |
+--------------------------------------+--------------------+-----------------------+-------+----------------+


SSH into Cirros instance && verification metadata

[root@icehouse1 ~]# ssh -l cirros -i oskey25.priv 192.168.122.155
The authenticity of host '192.168.122.155 (192.168.122.155)' can't be established.
RSA key fingerprint is f2:bd:fc:82:31:9b:6e:03:47:4c:0f:32:79:9d:10:06.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added '192.168.122.155' (RSA) to the list of known hosts.

$ ifconfig
eth0      Link encap:Ethernet  HWaddr FA:16:3E:26:93:2E 
          inet addr:40.0.0.5  Bcast:40.0.0.255  Mask:255.255.255.0
          inet6 addr: fe80::f816:3eff:fe26:932e/64 Scope:Link
          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1
          RX packets:297 errors:0 dropped:0 overruns:0 frame:0
          TX packets:330 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:1000
          RX bytes:33724 (32.9 KiB)  TX bytes:33981 (33.1 KiB)

lo        Link encap:Local Loopback 
          inet addr:127.0.0.1  Mask:255.0.0.0
          inet6 addr: ::1/128 Scope:Host
          UP LOOPBACK RUNNING  MTU:16436  Metric:1
          RX packets:0 errors:0 dropped:0 overruns:0 frame:0
          TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
          collisions:0 txqueuelen:0
          RX bytes:0 (0.0 B)  TX bytes:0 (0.0 B)

$ ping 83.221.202.254
PING 83.221.202.254 (83.221.202.254): 56 data bytes
64 bytes from 83.221.202.254: seq=0 ttl=58 time=2.501 ms
64 bytes from 83.221.202.254: seq=1 ttl=58 time=3.053 ms
64 bytes from 83.221.202.254: seq=2 ttl=58 time=2.626 ms
64 bytes from 83.221.202.254: seq=3 ttl=58 time=2.642 ms
64 bytes from 83.221.202.254: seq=4 ttl=58 time=4.335 ms
64 bytes from 83.221.202.254: seq=5 ttl=58 time=2.636 ms
64 bytes from 83.221.202.254: seq=6 ttl=58 time=2.963 ms
64 bytes from 83.221.202.254: seq=7 ttl=58 time=2.623 ms
64 bytes from 83.221.202.254: seq=8 ttl=58 time=2.712 ms
64 bytes from 83.221.202.254: seq=9 ttl=58 time=3.081 ms
64 bytes from 83.221.202.254: seq=10 ttl=58 time=2.889 ms
64 bytes from 83.221.202.254: seq=11 ttl=58 time=2.613 ms
64 bytes from 83.221.202.254: seq=12 ttl=58 time=2.512 ms
64 bytes from 83.221.202.254: seq=13 ttl=58 time=2.901 ms
64 bytes from 83.221.202.254: seq=14 ttl=58 time=2.491 ms
64 bytes from 83.221.202.254: seq=15 ttl=58 time=2.381 ms
64 bytes from 83.221.202.254: seq=16 ttl=58 time=2.876 ms
64 bytes from 83.221.202.254: seq=17 ttl=58 time=2.867 ms

$ uname -a
Linux cirros 3.2.0-37-virtual #58-Ubuntu SMP Thu Jan 24 15:48:03 UTC 2013 x86_64 GNU/Linux

$ curl http://169.254.169.254/openstack/latest/meta_data.json
{"random_seed": "A5Z/jEl2+Xc8UkIW1RjkHjMHqShSOeIGGfqtT9NGxpvEVONBai9T67yyn72S3n5sW75Drn8VxfJQpIZxYZ6Y0RQSzr/51UoREBN0t6GsL1IPqF3+/OM1YzYc7TXPx67KgEfb0FcVcXeS+0Cwb/RcH6nMRpafGO713aMWAxaiRvIxFoPJy2ZMb3bUZ1GSWW3hN7CKvECQPyYQmkTaIVzjjBIulvw1kYFVXeEQUs8Z0SZjGxWLwpSGp0HGvLdkl3ZJljMyT4lHaxJHVBRjEcnTv4krCdXRsjct2L8qzzoBukStRIW+RR8843r/AkdIfAv7LtRc4Tb99xjsKGCzrg1tll1fRdf1FxnGxti14V+P9EiMUekPBiEjYYGMf44edMVfX3cTPY9PMOMa4rw6jAJuEsmH43t8ggR+xUOEOQihCoA6Cv46lsM3I/oYyb21FLW84sWyiZtLgn6i2x1CJ2OlytBqha/k4MgtEEkDdXrcSx3JfIGLjpOi/9s39jBGK6pMTsx0cnTsyFe/hiWnAjflt11c6zWIMUDOk8QuMyWiBZOSpobohFsiW85SJ4xoP+RqmjFVRAs0ubns3Xd2pHodQR2H0Y4KqZIlH00Uli1vOOGiN0P2CtTguZOhZAru+UlF1AWTRAmCV3ZNwLj6xegeEh4nCy8H8hv7ibGfgMgc95c=", "uuid": "675f2943-ba79-47ae-b78b-cbfcd67d0a99", "availability_zone": "nova", "hostname": "cirros35.novalocal", "launch_index": 0, "public_keys": {"oskey25": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAszAmP1OUpiPBMzjIoo0mL2nx16QrBDcjEOnOPBdlHKTQi0wUXNt008WbF0VSVy2QKZVqgzWp+YqsWx2NV9i+PdajSlP0JRcJKGyK1KYnp9Dp8t3LLXBP/HunTK3hv5NbAE5v/CFZnU9Z7rn6H0fnce4yLztnh+2W2oDLXJ+9eI3fEm+Dm0xB7/R7Rrz6gX2jz55IF5ZQCtp/TIn+e2eSJijpaZQ4uROx8ir1E6pcfWLul131UF7FbV/Q6UXPTZa0zS92lo4OnTywdH61i5G8q/qQOPZ0w4lEBY5+qwnQSGdTg8alcEs4STlIFniU7Wu8OjtPFGWhFluyLaZhU4Zr1Q== Generated by Nova$ curl http://169.254.169.254/latest/meta-data/hostname
$ curl http://169.254.169.254/latest/meta-data/local-ipv4
40.0.0.5$
$ curl http://169.254.169.254/latest/meta-data/public-ipv4
192.168.122.155$
$