Saturday, January 03, 2009


Setup Xen 3.3.0 Ubuntu Intrepid Server Dom0 via build xen-kernel based on http://xenbits.xensource.com/ext/linux-2.6.27-xen.hg


This posting, in general, follows up Clayton Shepard's "Howto Ubuntu Intrepid Ibex 8.10 Xen Dom0"([1]). However, several things went different. First, i had to disable XFS Support when building Novell's kernel, otherwise build just went out with error. Second,regardless i enabled Network Bridging Support as suggested in [2]. I still had to comment out "xen" bridging initiated via /etc/xen/xend-config.sxp and manually add the bridge to /etc/network/interfaces configuration file. I didn't take care of "xvc0" and used virtual frame buffer when tested CentOS 5.2 PV DomU and Ubuntu Intrepid Server HVM and PV DomUs at Xen 3.3.0 Intrepid Server Dom0 based on Novell's kernel

apt-get install ubuntu-xen-server build-essential libncurses5-dev gawk mercurial
mkdir -p /home/boris/build/linux-2.6.27-xen
cd /usr/src/
hg clone http://xenbits.xensource.com/ext/linux-2.6.27-xen.hg
cd linux-2.6.27-xen.hg
make O=/home/boris/build/linux-2.6.27-xen/ menuconfig

Eanbling XEN (Dom0)














Disabling SLUB Unqueued Allocator and 10000 Mbsec Ethernet ([1])









make O=/home/boris/build/linux-2.6.27-xen/ -j12 #put number of cores X1.5 here#
sudo make O=/home/boris/build/linux-2.6.27-xen/ modules_install install
sudo depmod 2.6.27.5
sudo mkinitramfs -o /boot/initrd-2.6.27.5.img 2.6.27.5

Commented out all xen-bridge declarations in /etc/xen/xend-config.sxp
Manually edited /etc/network/interfaces as follows :-

root@IntrepidSRV:~# cat /etc/network/interfaces
# This file describes the network interfaces available on your system
# and how to activate them. For more information, see interfaces(5).

# The loopback network interface
auto lo
iface lo inet loopback

# The primary network interface
auto eth1
iface eth1 inet dhcp

auto br0
iface br0 inet static
address 192.168.1.45
network 192.168.0.0
netmask 255.255.255.0
broadcast 192.168.1.255
gateway 192.168.1.1
bridge_ports eth1
bridge_fd 9
bridge_hello 2
bridge_maxage 12
bridge_stp off

Rebooted the system with grub's entry:-

title Xen 3.3 / Ubuntu 8.10, kernel 2.6.27-xen
uuid 9d96f605-1feb-4bfd-80b7-a32fa205479c
kernel /boot/xen-3.3.gz
module /boot/vmlinuz-2.6.27.5 root=/dev/sdb1 ro console=tty0
module /boot/initrd-2.6.27.5.img

and issued :-
root@IntrepidSRV:~# xm dmesg

__ __ _____ _____ ___
\ \/ /___ _ __ |___ / |___ / / _ \
\ // _ \ '_ \ |_ \ |_ \| | | |
/ \ __/ | | | ___) | ___) | |_| |
/_/\_\___|_| |_| |____(_)____(_)___/

(XEN) Xen version 3.3.0 (buildd@buildd) (gcc version 4.3.2 (Ubuntu 4.3.2-1ubuntu9) ) Mon Oct 6 18:11:58 UTC 2008
(XEN) Latest ChangeSet: unavailable
(XEN) Command line:
(XEN) Video information:
(XEN) VGA is text mode 80x25, font 8x16
(XEN) VBE/DDC methods: none; EDID transfer time: 0 seconds
(XEN) EDID info not retrieved because no DDC retrieval method detected
(XEN) Disc information:
(XEN) Found 0 MBR signatures
(XEN) Found 2 EDD information structures
(XEN) Xen-e820 RAM map:
(XEN) 0000000000000000 - 000000000009ec00 (usable)
(XEN) 000000000009ec00 - 00000000000a0000 (reserved)
(XEN) 00000000000e4000 - 0000000000100000 (reserved)
(XEN) 0000000000100000 - 00000000cff80000 (usable)
(XEN) 00000000cff80000 - 00000000cff8e000 (ACPI data)
(XEN) 00000000cff8e000 - 00000000cffe0000 (ACPI NVS)
(XEN) 00000000cffe0000 - 00000000d0000000 (reserved)
(XEN) 00000000fee00000 - 00000000fee01000 (reserved)
(XEN) 00000000ffe00000 - 0000000100000000 (reserved)
(XEN) 0000000100000000 - 0000000230000000 (usable)
(XEN) System RAM: 8191MB (8387704kB)
(XEN) ACPI: RSDP 000FBB80, 0014 (r0 ACPIAM)
(XEN) ACPI: RSDT CFF80000, 003C (r1 A_M_I_ OEMRSDT 10000730 MSFT 97)
(XEN) ACPI: FACP CFF80200, 0084 (r2 A_M_I_ OEMFACP 10000730 MSFT 97)
(XEN) ACPI: DSDT CFF805C0, 8E13 (r1 A0840 A0840001 1 INTL 20060113)
(XEN) ACPI: FACS CFF8E000, 0040
(XEN) ACPI: APIC CFF80390, 006C (r1 A_M_I_ OEMAPIC 10000730 MSFT 97)
(XEN) ACPI: MCFG CFF80400, 003C (r1 A_M_I_ OEMMCFG 10000730 MSFT 97)
(XEN) ACPI: OEMB CFF8E040, 0081 (r1 A_M_I_ AMI_OEM 10000730 MSFT 97)
(XEN) ACPI: HPET CFF893E0, 0038 (r1 A_M_I_ OEMHPET 10000730 MSFT 97)
(XEN) ACPI: OSFR CFF89420, 00B0 (r1 A_M_I_ OEMOSFR 10000730 MSFT 97)
(XEN) Xen heap: 14MB (14468kB)
(XEN) Domain heap initialised
(XEN) Processor #0 7:7 APIC version 20
(XEN) Processor #1 7:7 APIC version 20
(XEN) IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-23
(XEN) Enabling APIC mode: Flat. Using 1 I/O APICs
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Detected 3005.628 MHz processor.
(XEN) HVM: VMX enabled
(XEN) CPU0: Intel(R) Core(TM)2 Duo CPU E8400 @ 3.00GHz stepping 06
(XEN) Booting processor 1/1 eip 8c000
(XEN) CPU1: Intel(R) Core(TM)2 Duo CPU E8400 @ 3.00GHz stepping 06
(XEN) Total of 2 processors activated.
(XEN) ENABLING IO-APIC IRQs
(XEN) -> Using new ACK method
(XEN) checking TSC synchronization across 2 CPUs: passed.
(XEN) Platform timer is 14.318MHz HPET
(XEN) Brought up 2 CPUs
(XEN) I/O virtualisation disabled
(XEN) *** LOADING DOMAIN 0 ***
(XEN) Xen kernel: 64-bit, lsb, compat32
(XEN) Dom0 kernel: 64-bit, lsb, paddr 0xffffffff80200000 -> 0xffffffff807d5cbc
(XEN) PHYSICAL MEMORY ARRANGEMENT:
(XEN) Dom0 alloc.: 0000000210000000->0000000220000000 (1964779 pages to be allocated)
(XEN) VIRTUAL MEMORY ARRANGEMENT:
(XEN) Loaded kernel: ffffffff80200000->ffffffff807d5cbc
(XEN) Init. ramdisk: ffffffff807d6000->ffffffff89ebae00
(XEN) Phys-Mach map: ffffffff89ebb000->ffffffff8ae38758
(XEN) Start info: ffffffff8ae39000->ffffffff8ae394a4
(XEN) Page tables: ffffffff8ae3a000->ffffffff8ae95000
(XEN) Boot stack: ffffffff8ae95000->ffffffff8ae96000
(XEN) TOTAL: ffffffff80000000->ffffffff8b000000
(XEN) ENTRY ADDRESS: ffffffff80200000
(XEN) Dom0 has maximum 2 VCPUs
(XEN) Scrubbing Free RAM: .done.
(XEN) Xen trace buffers: disabled
(XEN) Std. Loglevel: Errors and warnings
(XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings)
(XEN) Xen is relinquishing VGA console.
(XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen)
(XEN) Freed 112kB init memory.
(XEN) mtrr: base(0xd0000000) is not aligned on a size(0xff00000) boundary

root@IntrepidSRV:~# xm info

host : IntrepidSRV
release : 2.6.27.5
version : #1 SMP Sat Jan 3 03:48:09 EST 2009
machine : x86_64
nr_cpus : 2
nr_nodes : 1
cores_per_socket : 2
threads_per_core : 1
cpu_mhz : 3005
hw_caps : bfebfbff:20100800:00000000:00000140:0008e3fd:00000000:00000001:00000000
virt_caps : hvm
total_memory : 8191
free_memory : 4112
node_to_cpu : node0:0-1
node_to_memory : node0:4112
xen_major : 3
xen_minor : 3
xen_extra : .0
xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64
xen_scheduler : credit
xen_pagesize : 4096
platform_params : virt_start=0xffff800000000000
xen_changeset : unavailable
cc_compiler : gcc version 4.3.2 (Ubuntu 4.3.2-1ubuntu9)
cc_compile_by : buildd
cc_compile_domain : buildd
cc_compile_date : Mon Oct 6 18:11:58 UTC 2008
xend_config_format : 4

root@IntrepidSRV:~# brctl show

bridge name bridge id STP enabled interfaces
br0 8000.001e8c25cca5 no eth1
pan0 8000.000000000000 no

root@IntrepidSRV:~# ifconfig

br0 Link encap:Ethernet HWaddr 00:1e:8c:25:cc:a5
inet addr:192.168.1.45 Bcast:192.168.1.255 Mask:255.255.255.0
inet6 addr: fe80::21e:8cff:fe25:cca5/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:472519 errors:0 dropped:0 overruns:0 frame:0
TX packets:1175245 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:32876475 (32.8 MB) TX bytes:1685377508 (1.6 GB)

eth0 Link encap:Ethernet HWaddr 00:1e:8c:25:d9:23
UP BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)
Interrupt:17

eth1 Link encap:Ethernet HWaddr 00:1e:8c:25:cc:a5
inet6 addr: fe80::21e:8cff:fe25:cca5/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:27254 errors:0 dropped:0 overruns:0 frame:0
TX packets:26491 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:33954188 (33.9 MB) TX bytes:6661587 (6.6 MB)
Interrupt:16 Base address:0x2c00

lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:76512 errors:0 dropped:0 overruns:0 frame:0
TX packets:76512 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:458352117 (458.3 MB) TX bytes:458352117 (458.3 MB)

wlan0 Link encap:Ethernet HWaddr 00:15:af:51:c2:c0
UP BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

wmaster0 Link encap:UNSPEC HWaddr 00-15-AF-51-C2-C0-00-00-00-00-00-00-00-00-00-00
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:0 (0.0 B) TX bytes:0 (0.0 B)

I've also ran :-

ln -s /usr/lib/xen-tools/edgy.d /usr/lib/xen-tools/hardy.d
ln -s /usr/lib/xen-tools/edgy.d /usr/lib/xen-tools/intrepid.d

Testing Dom0, i didn't follow [1] with xen-create-image along with debootstrap.
and reproduced samples from [3] and [4].
Intrepid Server PV DomU runtime snapshots:-








CentOS 5.2 PV DomU runtime snapshots:-









References
1.http://cwshep.blogspot.com/2008/12/howto-ubuntu-intrepid-ibex-810-xen-dom0.html
2.http://www.gentoo.org/doc/en/xen-guide.xml#doc_chap2
3.http://lxer.com/module/newswire/view/110642/index.html
4.http://lxer.com/module/newswire/view/114310/index.html