Categories
Linux / Gentoo Linux

Networking for KVM with CentOS 5.5

I’ve found numerous tutorials to set up KVM with CentOS 5.5. Some refer to the Red Hat guides, which are useless in my opinion if you are not using KVM in a large server park, others come up with scripts to set up networking.

I kept searching and trying configurations until I finally found one that works. Note that among problems you might encounter is the one that plagued me for months: CentOS is attempting to bring up the virtual device for LAN access on the host before bringing up the physical interface, this fails and prevents all networking and dependencies from starting properly.

To set up the bridge devices for KVM and the host (something which is done only once to ‘wire’ your virtual network instide the bridge) look here. Most of the guide is still relevant even if they refer to the Red Hat documentation (which is about Red Hats cloud virtualisation platform and not a single server running KVM).

Use a configuration like this for proper KVM networking under CentOS, Red Hat and probably even Fedora.

1. Edit /etc/sysconfig/network-scripts/ifcfg-eth0 to contain something like this:

1
2
3
4
5
6
7
# /etc/sysconfig/network-scripts/ifcfg-eth0 - the physical NIC which will not be used directly
DEVICE=eth0
TYPE=Ethernet
HWADDR=00:23:B3:16:3F:00
ONBOOT=yes
BRIDGE=br0
NM_CONTROLLED=no

The “NM_CONTROLLED” bit seems to originate from Fedora 12/13, CentOS might ignore it altogether so you could leave it out.

2. Edit /etc/sysconfig/network-scripts/ifcfg-br0 to restore network access for your host machine:

1
2
3
4
5
6
# /etc/sysconfig/network-scripts/ifcfg-br0 - Bridged network access for host
DEVICE=br0
TYPE=Bridge
BOOTPROTO=dhcp
ONBOOT=yes
NM_CONTROLLED=no

The crucial parts in this configuration is that eth0 is started on boot and is assigned a bridge device: ‘br0’. The ‘br0’ device is marked as a bridge device which completes the dependencies between them. So make sure if you deviate from the examples you leave the types and ‘bridge=br0’ in tact.

Categories
Linux / Gentoo Linux

Determining the UUID of a partition

From Wikipedia:

A Universally Unique Identifier (UUID) is an identifier standard used in software construction, standardized by the Open Software Foundation (OSF) as part of the Distributed Computing Environment (DCE).

The intent of UUIDs is to enable distributed systems to uniquely identify information without significant central coordination. Thus, anyone can create a UUID and use it to identify something with reasonable confidence that the identifier will never be unintentionally used by anyone for anything else. Information labeled with UUIDs can therefore be later combined into a single database without needing to resolve name conflicts.

Since CentOS (and Ubuntu and others) use the UUID of partitions to mount or perform other operations on them, I needed to find the UUID of my storage partition. The downside to using UUIDs is obvious: I know the device name (/dev/sdb1) but I have no clue what the UUID of the partition is.

The upside is that if I move the drives around, so my /dev/sdb1 becomes /dev/sda1 for example, everything will still work because the identifiers remained unchanged.

Enough talking, I found 3 ways of finding the UUID of a drive on Linux. Note that this is not all of them though, just enough for me.

Option 1: Use /dev

Since the UUID to device mapping needs to be done somewhere for the kernel and system tools, why not use that ourselves?
ls -l /dev/disk/by-uuid

Option 2: Use udev

The vol_id program pulls the information from udev and presents it all in a fairly readable form. For some reason, my Ubuntu 10.10 does not have it anymore but possibly others still do.
vol_id /dev/sdb1

Option 3: Use blkid

The option I tend to use it to use the program called blkid. Which as sole purpose (as its name suggests) is to show the block device ID of a block device *gasp*.
blkid /dev/sdb1

Categories
General blog entries

Converting sequential algorithms to parallel algorithms

Like I mentioned before, I started my thesis for my Computer Science degree. And without getting into too much detail at this point, one of the problems we are trying to tackle is the conversion from sequential programs to parallel programs.

The target architecture is not really of importance although we are stuffing it in a multi-core chip which is programmed into a Virtex 6 FPGA.

The thing that strikes me as odd is that an insane amount of work is being put into creating new applications for multi-core environments using tool-kits and various paradigms like tasks, task graphs, Khan Networks – whatever.

After years of development, the mainstream development tools come with tools to help the programmer to design multi-core programs without having to specify each and every thread and communication channels – a drawback which prevents most programmers to easily write parallel programs.

But most software these days is based on monolithic code meant to be running on a single core. Slowly parts are rewritten to exploit the surplus cores modern computers have but even then, most software scales poorly to more cores.

Since most ‘fixes’ involve a complete rewrite, this shift to actually write multi-threaded programs instead of having a hand full of manually designed partitions within a program to appear to be multi-core is finally beginning.

In a way, my research area is barely explored as I attempt to rewrite a decoder application to be converted from a single core program to something which can run on at least 8 cores… Hows that for multi-threading…

Categories
How-To's

New phonon-vlc backend for KDE 4

According to the devs of Amarok, the new VLC based backend for Phonon delivers better sound quality than the Xine backend. Something like this just begs to be explored of course and the instructions below are based on the generic ones but specifically for Gentoo. Please note that the backend is alpha: it is incomplete and changes daily.

Install VLC 1.1 pre by installing the live version (note that VLC 1.1 is about to be released any time now so this might be available by the time you read this). Note that I had to disable the Gentoo patches in the vlc-9999 ebuild as they prevent VLC from compiling.

ACCEPT_KEYWORDS=** emerge =vlc-9999

Note to self: add the keywords to the /etc/portage/package.keywords file. 😉

Next, fetch the Phonon-VLC backend from GIT. Note that is should become ‘stable’ soonish (it said somewhere it should be moving to kdereview in the near future) so it should be safe to assume it sort of works.

cyberwizzard@cyberxps ~ $ mkdir kde
cyberwizzard@cyberxps ~ $ cd kde
cyberwizzard@cyberxps ~/kde $ mkdir src
cyberwizzard@cyberxps ~/kde $ cd src
cyberwizzard@cyberxps ~/kde/src $ git clone git://gitorious.org/phonon/phonon-vlc.git

Initialized empty Git repository in /home/cyberwizzard/kde/src/phonon-vlc/.git/
remote: Counting objects: 483, done.
remote: Compressing objects: 100% (400/400), done.
remote: Total 483 (delta 330), reused 116 (delta 66)
Receiving objects: 100% (483/483), 102.22 KiB, done.
Resolving deltas: 100% (330/330), done.

cyberwizzard@cyberxps ~/kde/src $ cd phonon-vlc/
cyberwizzard@cyberxps ~/kde/src/phonon-vlc $ cmake -DCMAKE_BUILD_TYPE=debugfull -DCMAKE_INSTALL_PREFIX=/usr $HOME/kde/src/phonon-vlc/

...configure here...

cyberwizzard@cyberxps ~/kde/src/phonon-vlc $ make

...wait a bit more...

cyberwizzard@cyberxps ~/kde/src/phonon-vlc $ su -c "make install"
Password:

[100%] Built target phonon_vlc
Install the project...
-- Install configuration: "debugfull"
-- Installing: /usr/lib/kde4/plugins/phonon_backend/phonon_vlc.so
-- Set runtime path of "/usr/lib/kde4/plugins/phonon_backend/phonon_vlc.so" to "/usr/lib:/usr/lib64/qt4"
-- Installing: /usr/share/kde4/services/phononbackends/vlc.desktop

cyberwizzard@cyberxps ~/kde/src/phonon-vlc $ su -c "kbuildsycoca4 --noincremental"
...password and lot of output here...

And thats it! Just fire up Amarok -> Settings -> Configure Amarok -> Playback -> Configure Phonon (or go through System Settings in KDE) and select the VLC backend (currently shows up as version 0.2).

Categories
How-To's

Multi-monitor with KDE 4 and XRandR

One of the annoyances I’ve had with *nix so far was the apparent lack of multi-monitor control from the GUI. I’ve have experience with TwinView using xorg.conf, which worked fine but was quite a hassle to set up.

A side effect of this is the fact that once set up, I never touched the configuration again. For a computer with 2 screens hooked up permanently, this is fine. For a laptop which is dragged along and connected to beamers, TVs and monitors – not so much.

The good news is that I run a modern linux distro which led me to believe that the multi-monitor stuff should be enabled by default. However, I am not using Kubuntu (which would probably auto-enable all new toys for me) but rather I am using Gentoo. So it took some digging to figure out what is going on these days and how to use it. On a side note: you could use nvidia-settings instead after plugging something in but I’d rather use the automatic method.

First a word of warning: the binary NVidia drivers do not support RandR 1.2. I have the 195.xx drivers installed and NVidia expressed back in 2007 that RandR 1.2 support was a ‘priority’ feature. One that apparently needed more than 3 years to be released. This means that using the binary ‘nvidia’ driver will give you RandR 1.1 which does not support the on-the-fly hotplug for displays. Instead you are forced to use TwinView, define meta-modes for every possible configuration and switch to those using ‘xrandr’ (or use the nvidia-settings tool each time).

Since this sort of defies having RandR 1.2 support altogether in Xorg, I decided to ditch the binary nvidia driver in favor of ‘nouveau’: the open-source replacement for ‘nv’ with decent 2D acceleration support (although I couldn’t resist and enabled the highly experimental Gallium3D support as well).

To start off: trim down your Xorg configuration to a minimum, note that a recent Xorg is needed (I have 7.4 at the time of writing). This is needed to enable the auto-detection of many things or rather: manually specifying properties will override auto-detected settings and cripple Xorg’s ability to handle everything on its own. As an example, I have included my own xorg.conf below.

Section "ServerLayout"
  Identifier "Default Layout"
  Screen 0 "Screen0"
EndSection

Section "ServerFlags"
  Option "AutoAddDevices" "true"
  Option "AutoEnableDevices" "true"
EndSection

Section "Device"
  Identifier "nVidia_8600M_GS_nouveau"
  Driver "nouveau"
  Boardname "GeForce 8600M GS"
EndSection

Section "Screen"
  Identifier "Screen 0"
  Device "nVidia_8600M_GS_nouveau"
  Monitor "Monitor 0"
  SubSection "Display"
    Modes "1680x1050"
  EndSubSection
EndSection

Section "Monitor"
  Identifier "Monitor 0"
  VendorName "Primary Monitor"
  Option "DPMS"
EndSection

Section "Extensions"
  Option "Composite" "Enable"
EndSection

The ‘ServerFlags’ section is pretty simple: use every auto-detection known in Xorg to hotplug devices. This means both monitors and input devices like mouses and keyboards.

Next up are the 2 sections for my NVidia display card. Since I am using ‘nouveau’ instead of ‘nvidia’, make sure you are not loading ‘glx’ somewhere (if you were using ‘nvidia’ in the past like me, you most likely have that somewhere).

The last 2 sections are fairly simple as well but note that I do specify the native resolution of my LCD screen as the preferred resolution.

Thats it! Restart your X server and run xrandr so see the result. I plugged a VGA monitor in my notebook and this is the result:

cyberwizzard@cyberxps ~ $ xrandr
Screen 0: minimum 320 x 200, current 2960 x 1050, maximum 8192 x 8192
LVDS-1 connected 1680x1050+0+0 (normal left inverted right x axis y axis) 331mm x 207mm
1680x1050      60.0*+   60.0
1400x1050      60.0
1280x1024      59.9
1280x960       59.9
1152x864       60.0
1024x768       59.9
800x600        59.9
640x480        59.4
720x400        59.6
640x400        60.0
640x350        59.8
HDMI-1 disconnected (normal left inverted right x axis y axis)
VGA-1 connected 1280x1024+1680+0 (normal left inverted right x axis y axis) 312mm x 234mm
1680x1050      74.9 +   60.0
1280x1024      85.0*+   75.0     60.0
1792x1344      60.0
1920x1200      59.9
1600x1200      75.0     70.0     65.0     60.0
1400x1050      85.0     74.9     60.0
1440x900       84.8     75.0     59.9
1280x960       85.0     60.0
1360x768       60.0
1280x800       84.9     74.9     59.8
1152x864       75.0
1280x768       84.8     74.9     59.9
1024x768      100.0     85.0     75.1     75.0     70.1     60.0     43.5     43.5
832x624        74.6
800x600        85.1     72.2     75.0     60.3     56.2
848x480        60.0
640x480        85.0     75.0     72.8     72.8     66.7     60.0     59.9
720x400        85.0     87.8     70.1
640x400        85.1
640x350        85.1
Categories
Linux / Gentoo Linux

Change SVN repository location

For some reason, repositories can be moved around. If you are using a working copy to develop a program or web-application or whatever, the move usually only implies a ‘check-out’ and you are set.

However, sometimes the repository is part of a production environment. To be precise, the production version is prepped in a special branch and then deployed using Subversion. Upgrading a website to a newer version only requires a ‘svn up’ and if you automate the database upgrades as well, web management becomes a breeze.

You might imagine that moving the repository in such an environment is less than desirable: each site or application which is part of that repository becomes un-upgradable and checking out everything by hand and setting it all up (plus the verification that every part is still functional) becomes a time consuming task.

However, the SVN information is all stored in plain text files. The following snippet switches the repository from http://svn.mydomain.com/svn to svn://svn.someotherdomain.com. This means you can quickly switch protocol, host names or even the location within a certain host. Simply copy-paste the code below into a file in the directory holding one or more projects for that repository, change the URLs (do not forget to escape by replacing ‘/’ with ‘\/’) and run the script.

#!/bin/bash
DIRS=`find . -name ".svn"`
for dir in ${DIRS}
do
  echo "Processing $dir"
  FILES=`find $dir`
  for file in ${FILES}
  do
    if [ -f ${file} ]; then
      echo "Fixing '${file}'..."
      sed 's/http:\/\/svn.mydomain.com/svn:\/\/svn.someotherdomain.com/g' "${file}" > "${file}.tmp"
      mv "${file}.tmp" "${file}"
    fi
  done
done
Categories
General blog entries

Radio silence

Visitors dwindling to my site, I decided it was time to write something again after 3 months. Its not that I stopped working with computers but rather that my attention moved from working with computers to studying Computer Science. Something that is hard to combine if you are making a dash to the finish line.

In other words: I am finishing my last courses in the coming days and will begin on my thesis. I haven’t decided yet if I will post things from my thesis yet (as extra content). Not so much because of the extra time but also because not everything is interesting and some information is classified – making other things inexplicable or incomplete if I were to post it online.

On to more important things: KDE 4.4 is about to hit the virtual shelves! Besides more polishing and some other features, it finally comes with a full blogging client (as part of the base system).

“What”, you say, “they fixed KBlogger?” Heck no, KBlogger is still dead as a door nail and as buggy as it has been forever. It seems that someone got the bright idea to actually replace KBlogger altogether with Bilbo – the tool I talked about before. One of the major issues Bilbo had, was that fact that nobody knew it. Personally, I think this comes from the name: Bilbo – as it is also the name from one of Tolkiens books. If you now think “Lord of the Rings”, you should be ashamed: Bilbo is part of the story *before* LOTR, he just happens to be alive in the epic story afterwards…

But I digress.

The fact remains that finding the program (even if you know that it exists) becomes hard because all search engines will refer you to hits about the wrong topic. Also, as you might imagine, some folks (*cough*copyright holders*cough*) might have issues with the naming. So it was renamed from Bilbo to Blogilo a while back and as such can now be part of the whole KDE experience. Hurray!

Next time I will probably explain about a project (formal model checker, based on the Promela language) I have been working on and the surprisingly bad hash functions I found on the internet…

Categories
Linux / Gentoo Linux

Fixing Vmware mouse flicker

After upgrading a VM from Ubuntu 9.04 to Xubuntu 9.10 I noticed that the mouse cursor works fine in a certain region (say 640×480) but outside that region, it flickers between the actual mouse position and the edge of the region.

After reinstalling X a few times and upgrading the VMware tools I found the solution: it is a bug in the newer GTK versions. Since I amd running Gentoo (unstable aka bleeding edge) I am one of the lucky owners of this new bug.

The solution seems to be to instruct VMWare Player or Workstation (I use 6.5.x) to use its bundled GTK instead of the system one:

echo "VMWARE_USE_SHIPPED_GTK=yes" >> /etc/vmware/bootstrap
Categories
General blog entries

VoIP providers

In my quest for VoIP support in the Netherlands I found a lot of providers. Most of them seem to be catering the consumer needs rather than the prosumer or even business needs. Most providers fall under one of 3 categories: consumer (“free” landline calls but usually not unlimited call time resulting in paid minutes after a certain time), prosumer (better defined call rates, subscriptions, professional level support) and corporate (meant for large businesses, lots of trunks, hosted PBX and so on).

Note that I omit the service providers that only provide services for their own customers. For example, Tele2 has a business oriented VoIP division but also provides VoIP telephony to their DSL customers.

Known ISPs with a VoIP service for their customers: KPN, Tele2, XS4all, @Home (Ziggo).

Note: the listing above is incomplete and based upon results I found in my search online.

Consumer

VoIP Goedkoop

This is a handy site containing links to multiple “free” VoIP providers. These are fine for consumer usage, normally are not suited for business usage (free equals no quality guarantee, no subscriptions) and usually do not come with DID services.

http://voipgoedkoop.nl/

VoIPBuster

As one of the more wide known service providers, VoIPBuster advertises with free calls. The “free” here is relative as not all destinations are actually free and for example land line calling in the Netherlands is “free” for a minute (they call that a “Superdeal”, a choice of words which is not reflected by their meaning), after which an unspecified fee is charged. Also, every 120 days, a user needs to reactivate their account by paying 10 Euros, which is converted into 10 Euros credit. Also, mobile numbers cost 25 cpm, which is twice as much as every other VoIP provider I found, not a bargain at all…

www.voipbuster.com

Prosumer

VoipQ

VoipQ supports subscriptions, clear call rates and supports DID services as well.

www.voipq.nl

SpeakUp

SpeakUp also provides subscriptions, DIDs and clear calling rates. The also offer hosted PBX or just trunk services.

www.speakup.nl

Voys Telecom

Supports VoIP subscriptions from one to multiple lines and everything that comes with it. Does not seem to be the cheapest provider but they seem to have a good reputation.

www.voys.nl

Corporate

KPN

KPN is the leading Dutch telecom company for decades. Slowly they start to move from POTS solutions to VoIP, for example for their DSL and fibre customers. For the corporate markt they only aim for the big players, as only the start fee is 2000 Euros at the time of writing and subscriptions are expressed in 3 digit monthly fees for the smallest packages. Great for huge corporations and call centers, but useless for everyone else.

http://zakelijk.kpn.com/business/voip.htm

Categories
General blog entries

Asterisk PBX ramblings

As I am playing with AsteriskNow in a virtual machine to see how I can extend our current PBX (old, analogue, missing lots of options and has zero flexibility) to use the power of a virtual PBX and all its options.

First off I want to explain some terms, you will find these plastered over guides and they confused me as first. This is what I distilled from all that.

VoIP – Voice over IP, internet telephony. Everyone is talking about it and while the name is accurate (you send voice or phone data over a switched IP network, the internet or LAN), it does not describe how this is done. Most people assume VoIP is a technology on its own, it is not.
SIP – SIP stands for Session Initiation Protocol. This is an actual implementation of VoIP. Although SIP has a lot of advanced features (deterring new users to dive in and understanding how it works, like it did me), most people will only use a very, very small subset. See below for more information.
FXO – Foreign eXchange Office, in a nutshell this is an adapter to hook up to a phone line or PTSN (it acts as a client on a line).
FXS – Foreign eXchange Station, this is an (internal) line used to run to a phone or fax machine. The FXS port powers the line, enabling phones to function as well as provide the dial tone and ringing features.
PTSN – Public Switched Telephone Network, this means a phone line. Either a line to a PBX or to the outside world. Also called a trunk.
POTS – Plain Old Telephone System, the old analogue phone system as we know it. The counterpart of this is of course VoIP.
Trunk – A trunk is a phone line, usually only used to denote lines to the outside world. These days a SIP account allowing you to call to the outside world is called a trunk (as it has the same usage as the old physical lines that were connected to a PBX).
DID – Direct Inward Dialling usually denotes the service that connects the POTS telephony system to the digital world of the internet. In other words, it allows you to have a normal phone number which is converted into a VoIP number, which in turn can be hooked up to a VoIP phone or PBX. Usually this is nothing more than a SIP account at a service provider, making usage pretty simple.
Presence – SIP Presence is a technique where a phone tells the PBX it would like to monitor a certain extension or trunk. Normally this is used to light up LEDs on the phone if an extension or trunk is busy. Asterisk has full support for this but most entry-level phones do not sport this feature (more expensive phones targeted for corporate usage have this).

The biggest downside to the VOIP hype is the confusion that it creates in its wake. Like I said, everyone has heard of the phrase internet telephony and most know the term VoIP. Most people there for buy products with big labels on them, marking them as “VoIP phones” and such. The problem is that not always all products work together.

The upside is that most systems fully support SIP which in turn is pretty much a global standard. SIP works by connecting a client to a server, where the client is usually the phone and the server usually is a PBX. The phones are full computer systems on their own, working on the LAN most offices already use. After a phone registered itself with the server using its name and password (a SIP account), the server can reach the phone and vice versa when needed.

When the user picks up the horn and starts dialing, the phone generates a fake dial tone (there is no dial tone as this is a digital system) and waits for the user to start pressing buttons. Every status change (pick up, press number etc) is passed to the server/PBX and is processed to determine who the user is attempting to call. The PBX will then forward the call to another extension or to a trunk and the sound data is transmitted between caller and callee as soon as the connection is complete.

The reverse also holds. After the extension is registered at the server, the PBX can let it ring and after the user picks up the horn, the audio connection is made in order to complete the calling sequence.

So far, this is a simple client-server setup and the only choices one has to make is to determine which audio compression is chosen. The rule of thumb here is that better audio quality comes at a higher bandwidth cost. Most PBX-es like Asterisk convert audio codecs on the fly if for example the remote SIP trunk not supports a certain encoding.

Finally there is the option to call directly to a SIP server or PBX. For example, you hook up your server to the DNS name sip.myoffice.com. This has to be a valid domain and accessible from the outside world. You then open port 5060 for protocol UDP (very important, this is NOT the same as TCP!) on your outside firewall or server and connect that to the virtual PBX. This allows telephones to register themselves from remote locations such as home or a 2nd office but also allows you to call straight into the office.

The details of this I still have to work out (I’ll update this article as I go) but it comes down to this: the caller calls 1234@sip.myoffice.com. His PBX will know that it has to connect to sip.myoffice.com on port 5060 and ask the PBX at that address to ring up number 1234. The office PBX recognises that the incoming call request is not from a registered internal extension and determines how the call should be handled. If all goes well, the right trunk will be activated which in turn will ring the extensions you have linked to that line. This way, the POTS system is not used at all, and as another benefit, the call is absolutely free as only the internet is used.

I hope this helps others out there to determine which hardware they should buy and how most things fit together. Most devices marketed as “VoIP adapters” are not quite accurate labelled as they normally have a small SIP server (making it in fact a mini-PBX) and one or more FXS and FXO ports. The type of ports restrict you to their usage and it is very important to decide what you need. If you want to hook up a number of old telephones you need FXS ports, if you want to connect your physical telephone line to your virtual PBX, you need an FXO port.

In another article I will continue my findings as I just ordered some VoIP hardware to start experimenting with it.