Lab46 Wiki

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
<html>
<center>
</html>
\\ 
\\ 
<WRAP muchbigger>Xen domU manual creation and configuration tutorial</WRAP>
\\ 
<html>
</center>
</html>


=====Objective=====
This document will detail the steps needed to successfully create Xen VMs manually using the Debian (6.0) Squeeze distribution, which, at the time of writing, is neither supported by xen-tools nor officially released.

The procedure for installing other distributions will likely be quite similar.

=====Procedure=====
====Step 0: Obtain working Xen environment====
Running a bleeding edge distribution in a VM is often far more likely than also running said bleeding edge distribution as the dom0. In the case of Debian, nothing past Lenny at the time of this writing has stable Xen dom0 support, so the dom0 is likely something older and more stable.

This will not stop us from running what we want in a VM, however.

In the LAIR, our Xen data directory structure is as follows:

<code>
/xen
    /boot
    /conf
    /domains
    /images
    /save
</code>

We configure xen-tools to create new VM images in /xen/domains, and place config files in /xen/conf, then typically migrate the VM images to /xen/images, and make the appropriate corrections in the config file.

Here, will just go make everything correctly from the start.
====Step 1: Create disk images====
There are typically 2 images needed for a standard virtual machine- the main disk and the swap.

===Main Disk===
Here we will make a 4GB disk image:

<cli prompt="# ">
vmserver:/xen/images# dd if=/dev/zero of=newvm.disk bs=1M count=4096
4096+0 records in
4096+0 records out
4294967296 bytes (4.3 GB) copied, 91.3332 s, 47.0 MB/s
vmserver:/xen/images# 
</cli>

===Swap Disk===
We'll also want to make swap (here we'll make a 256MB swap disk):

<cli prompt="# ">
vmserver:/xen/images# dd if=/dev/zero of=newvm.swap bs=1M count=256
256+0 records in
256+0 records out
268435456 bytes (268 MB) copied, 7.20193 s, 37.3 MB/s
vmserver:/xen/images# 
</cli>
====Step 2: Format images====
Before we can install, we need to put a filesystem or some structure on our disks.

===Main Disk===
ere we will format our main disk image:

<cli prompt="# ">
vmserver:/xen/images# mkfs.ext3 -j -O dir_index -v ./newvm.disk
mke2fs 1.41.3 (12-Oct-2008)
./newvm.disk is not a block special device.
Proceed anyway? (y,n) y
fs_types for mke2fs.conf resolution: 'ext3', 'default'
Filesystem label=
OS type: Linux
Block size=4096 (log=2)
Fragment size=4096 (log=2)
262144 inodes, 1048576 blocks
52428 blocks (5.00%) reserved for the super user
First data block=0
Maximum filesystem blocks=1073741824
32 block groups
32768 blocks per group, 32768 fragments per group
8192 inodes per group
Superblock backups stored on blocks: 
        32768, 98304, 163840, 229376, 294912, 819200, 884736

Writing inode tables: done                            
Creating journal (32768 blocks): done
Writing superblocks and filesystem accounting information: done

This filesystem will be automatically checked every 27 mounts or
180 days, whichever comes first.  Use tune2fs -c or -i to override.
vmserver:/xen/images# 
</cli>

===Swap Disk===
And be sure to bless the swap disk:

<cli prompt="# ">
vmserver:/xen/images# mkswap newvm.swap 
Setting up swapspace version 1, size = 268431 kB
no label, UUID=a22e7d04-d2ea-4a6b-99db-4941c291648f
vmserver:/xen/images# 
</cli>

====Step 3: Mount and Install====
Once created, we can local loopback mount the disk image, and install our distro of choice (since we're going to use squeeze, we'll **debootstrap** it).

===Mount the image===
Using a loopback mount, we mount the disk image so we can dump files onto it (ie install).

<cli prompt="# ">
vmserver:/xen/images# mount -o loop /xen/images/newvm.disk /mnt
vmserver:/xen/images# 
</cli>

===Install===
Once mounted, proceed with the installation:

<cli prompt="# ">
vmserver:/xen/images# debootstrap squeeze /mnt http://mirror/debian
I: Retrieving Release
I: Retrieving Packages
I: Retrieving Packages
I: Validating Packages
I: Resolving dependencies of required packages...
I: Resolving dependencies of base packages...
I: Found additional required dependencies: insserv libbz2-1.0 libdb4.8 libslang2 
I: Found additional base dependencies: libnfnetlink0 libsqlite3-0 libudev0 
I: Checking component main on http://mirror/debian...
I: Retrieving libacl1
I: Validating libacl1
I: Retrieving adduser
I: Validating adduser
I: Retrieving apt-utils
I: Validating apt-utils
I: Retrieving apt
I: Validating apt
...
I: Configuring tasksel-data...
I: Configuring tasksel...
I: Base system installed successfully.
vmserver:/xen/images# 
</cli>

====Step 4: Configure the installation====
Once we're done with the install, we should tend to some configuration matters.

===Set up networking===
Debian systems use **/etc/network/interfaces** for network configuration... if we're gunning for a standard VM, we'll want something like this (could likely just copy it from the VM server):

<file>
# This file describes the network interfaces available on your system
# and how to activate them. For more information, see interfaces(5).

# The loopback network interface
auto lo
iface lo inet loopback

auto eth0
iface eth0 inet dhcp
</file>

===Set up sources.list===
Debian's package management system builds its database from repositories configured in **/etc/apt/sources.list**; we should be mindful to set the VM's sources.list to use any local services (such as our in-lab repository).

<file>
#####################################################################
#
#  /etc/apt/sources.list
#
deb     http://mirror/debian    squeeze           main contrib non-free
deb-src http://mirror/debian    squeeze           main contrib non-free
#deb     http://mirror/security squeeze/updates   main contrib non-free
#deb-src http://mirror/security squeeze/updates   main contrib non-free
deb     http://mirror/lair      squeeze           main
</file>

In many cases this could also be straight copied from the VM server (but remember to change the distro to "squeeze".. the VM server is likely running "lenny").

===chroot===
Now we'll need to do some editing on the VM itself, so we're going to trick it into thinking it is running. We do this by using **chroot** to make the VM's filesystem the root of our shell session's filesystem:

<cli prompt="# ">
vmserver:~# chroot /mnt
root@vmserver:/# 
</cli>

At this point, an "ls /" will show the base of the VM's filesystem, and not the VM server. The prompt still says "vmserver", but this is a lie. We will actually be changing some files to alter that.

===Mount proc===
The **/proc** filesystem will need to be mounted in order to allow some facilities to work properly:

<cli prompt="# ">
root@vmserver:/# mount -t proc proc /proc
root@vmserver:/# 
</cli>

===Set hostname===
Now we are to change the hostname that the VM reports:

<cli prompt="# ">
root@vmserver:/# echo "vmname" > /etc/hostname
root@vmserver:/# 
</cli>

===Set root password===
And set the root password:

<cli prompt="# ">
root@vmserver:/# passwd
Enter new UNIX password: 
Retype new UNIX password: 
passwd: password updated successfully
root@vmserver:/# 
</cli>

===Configure Package Database===
Read from **/etc/apt/sources.list** and establish our package database (ends up being in **/var/lib/dpkg**):

<cli prompt="# ">
root@vmserver:/# aptitude update
Get:1 http://mirror squeeze Release.gpg [835 B]
...
Current status: 584 new [+584].
root@vmserver:/# 
</cli>

===Apply Updates===
There should not be any updates to apply, since we just recently installed, but it never hurts to check:

<cli prompt="# ">
root@vmserver:/# aptitude upgrade
No packages will be installed, upgraded, or removed.
0 packages upgraded, 0 newly installed, 0 to remove and 0 not upgraded.
Need to get 0 B of archives. After unpacking 0 B will be used.
...
root@vmserver:/# 
</cli>

===Install some initial packages===
If we're running a fairly standard VM (ie nothing experimental that needs some special kernel), here are the default packages we'd likely want to install:

<cli prompt="# ">
root@vmserver:/# aptitude install ssh linux-image-2.6.32-5-xen-amd64 locales console-data
The following NEW packages will be installed:
  busybox{a} console-common{a} console-data firmware-linux-free{a} initramfs-tools{a} 
  kbd{a} klibc-utils{a} libbsd0{a} libedit2{a} libgssapi-krb5-2{a} libk5crypto3{a} 
  libkeyutils1{a} libklibc{a} libkrb5-3{a} libkrb5support0{a} libuuid-perl{a} 
  libwrap0{a} libx11-6{a} libx11-data{a} libxau6{a} libxcb1{a} libxdmcp6{a} 
  libxext6{a} libxmuu1{a} linux-base{a} linux-image-2.6.32-5-xen-amd64 locales 
  openssh-blacklist{a} openssh-blacklist-extra{a} openssh-client{a} openssh-server{a} 
  ssh tcpd{a} xauth{a} 
0 packages upgraded, 34 newly installed, 0 to remove and 0 not upgraded.
Need to get 43.7 MB of archives. After unpacking 143 MB will be used.
Do you want to continue? [Y/n/?] y
Get:1 http://mirror/debian/ squeeze/main console-data all 2:1.10-5 [1180 kB]
Get:2 http://mirror/debian/ squeeze/main kbd amd64 1.15.2-1 [404 kB]
Get:3 http://mirror/debian/ squeeze/main console-common all 0.7.85 [128 kB]
...
</cli>

===Configure locale===
You've probably been seeing these messages appear:

<cli>
locale: Cannot set LC_CTYPE to default locale: No such file or directory
locale: Cannot set LC_MESSAGES to default locale: No such file or directory
locale: Cannot set LC_ALL to default locale: No such file or directory
</cli>

What is happening is that the locale environment variables are not properly set... time to get that taken care of:

<cli prompt="# ">
root@vmserver:/# dpkg-reconfigure locales console-data
</cli>

And be sure to check:

<cli>
[*] en_US.UTF-8 UTF-8
</cli>

And make the "**Default locale for the system environment**": en_US

Usually there's no need to touch the keymap, so when it asks: "**Don't touch keymap**"

===Set up timezone===
Also important is the timezone, which can be configured as follows:

<cli prompt="# ">
root@vmserver:/# ln -sf /usr/share/zoneinfo/US/Eastern /etc/localtime
root@vmserver:/# 
</cli>

===working console===
Before we wrap up, we should ensure we will be able to access the VM's console; instead of **/dev/tty1**, Xen has us using **/dev/hvc0**, so be sure to change that in **/etc/inittab**. Specifically, we want to look for this block:

<code>
1:2345:respawn:/sbin/getty 38400 tty1
2:23:respawn:/sbin/getty 38400 tty2
3:23:respawn:/sbin/getty 38400 tty3
4:23:respawn:/sbin/getty 38400 tty4
5:23:respawn:/sbin/getty 38400 tty5
6:23:respawn:/sbin/getty 38400 tty6
</code>

And change it to this:

<code>
1:2345:respawn:/sbin/getty 38400 hvc0
#2:23:respawn:/sbin/getty 38400 tty2
#3:23:respawn:/sbin/getty 38400 tty3
#4:23:respawn:/sbin/getty 38400 tty4
#5:23:respawn:/sbin/getty 38400 tty5
#6:23:respawn:/sbin/getty 38400 tty6
</code>

====Step 5: Wrap up VM changes====
Hey now, it looks like we're on set on VM configuration, so let's umount and exit from our chroot environment:

<cli prompt="# ">
root@vmserver:/# umount /proc
root@vmserver:/# exit
exit
vmserver:/xen/images# umount /mnt
vmserver:/xen/images# 
</cli>

====Step 6: Xen VM config====
Now it is time to create our Xen VM configuration file in /xen/conf... each config has unique characteristics in it, here is a sample file that can be altered:

<file>
##########################################################################
# LAIR Xen VM configuration file
##########################################################################

#################################################
#  Kernel + memory size
#
kernel  = '/xen/boot/vmlinuz-2.6.32-5-xen-amd64'
ramdisk = '/xen/boot/initrd.img-2.6.32-5-xen-amd64'
memory  = '192'
vcpus   = '1'
#extra  = 'clocksource=jiffies'

#################################################
#  Disk device(s).
#
root    = '/dev/xvda1 ro'
disk    = [ 'file:/xen/images/newvm.disk,xvda1,w',
            'file:/xen/images/newvm.swap,xvda2,w'  ]

#################################################
#  Hostname
#
name    = 'newvm'

#################################################
#  Networking
#
dhcp    = 'dhcp'
vif     = [ 'mac=00:16:3E:AA:BB:CC' ]

#################################################
#  Behaviour
#
on_poweroff = 'destroy'
on_reboot   = 'restart'
on_crash    = 'restart'
</file>

Look through the file and make the pertinent changes (memory, disk names/location, VM name, MAC address).

<WRAP round info box>__**NOTE:**__ with the MAC address and desired system name, appropriate updates should be made on the subnet's router in **/etc/dhcpd.conf** and the DNS zone files for the domain. Instructions for that are beyond the scope of this document.</WRAP>
=====Conclusion=====
====Document the VM====
If this is to be a regular service provided (or even if it is just an experiment), efforts should be documented so others know the purpose of the VM, and the originator has a record to recall when they've forgotten some of the specifics of their activities.

If desired, you can:

  * go to the [[system/sample.offbyone.lan|sample documentation page]]
  * view the wiki page source
  * copy it (to your clipboard)
  * create a new page under the **system** namespace (named for the fully qualified hostname)
  * edit its wiki source, and paste
  * fill out that page as appropriate

====Launch the VM====
If all our ducks are in a row, let's fire up our VM:

<cli>
vmserver:~# xm create -c /xen/conf/newvm.cfg
Using config file "/xen/conf/newvm.cfg".
...
</cli>
Lab46 Wiki

User Tools

Site Tools

Page Tools
