Академический Документы
Профессиональный Документы
Культура Документы
Krishna Kumar
April 9, 2009
1 OBJECTIVE
In today's world there is a obvious need of information sharing in every department and network
storage can help us to achieve this most growing challenge. Here in this article we are focusing our
concentration to make a San which has following features:
• Low cost and easily affordable
• Ensured Scalability
• High Reliability
• Easily Manageable
• High Performance
• Ensured Security
• High availability
7.1 KVBLADE
About Kvblade
Kvblade is a kernel module implementing the target side of the AoE protocol. Users can command the
module through sysfs to export block devices on speci- fied network interfaces. The loopback device
should be used as an intermediary for exporting regular files with kvblade.
Compilation and Installation
Download kvblade alpha3 :
[root@node1 ]# wget http://downloads.sourceforge.net/aoetools/kvblade-alpha- 3.tgz
Untar this package:
[root@node1 ]# tar -xzvf kvblade-alpha-3.tgz
[root@node1 ]# cd kvblade-alpha-3
Compilation of this kernel module was done on FC7 (fedora 7):
[root@node1 kvblade-alpha-3]# uname -r
2.6.21-7.fc7xen
Do the following manipulation in kvblade.c file at line no. 3 and at line no. 66 : at line no. 3 : change
linux/config.h |> linux/autoconf.h at line no. 66: change ATA SERNO LEN |> ATA ID SERNO LEN
Since, linux kernel always keep changes their file name, api and data structures. So, we have done
above manipulation for successful compilation of this kernel module.
[root@node1 ]# make
[root@node1 kvblade-alpha-3]# make install
[root@node1 kvblade-alpha-3]# insmod kvblade.ko
Now your kvblade has cleanly compiled and installed on your system. Just run the following command
to verify it:
[root@node1 kvblade-alpha-3]# lsmod | grep kvblade
kvblade 17992 0
7.2 AOESERVER
About Aoeserver
Aoeserver is an in-kernel Ata Over Ethernet Storage target driver used to emu- late a Coraid
EtherDriver Blade. It is partly based on vblade and the aoe-client from the Linux 2.6-kernel.
7.3 VBLADE-KERNEL
About Vblade-kernel
Vblade-kernel is an AoE target emulator implemented as a kernel module for Linux 2.6.* kernels.
7.4 VBLADE
About Vblade
Vblade is the virtual EtherDrive (R) blade, a program that makes a seekable file available over an
ethernet local area network (LAN) via the ATA over Ethernet (AoE) protocol. Seekable file is typically
a block device like /dev/md0 but even regular files will work. Sparse files can be especially convenient.
When vblade exports the block storage over AoE it becomes a storage target. Another host on the same
LAN can access the storage if it has a compatible aoe kernel driver.
7.5 GGAOED
Ggaoed is an AoE (ATA over Ethernet) target implementation for Linux. It utilizes Linux kernel AIO,
memory mapped sockets and other Linux features to provide the best performance. GGAOED comes in
two avour: Ggaoed base version and Updated Ggaoed.
About it
This is the base version of ggaoed-0.9.tar.gz (release-0.9) released in July 2008. This can be
downloaded from following site: http://code.google.com/p/ggaoed/downloads/list
Compilation and Installation
Running ggaoed requires Linux kernel 2.6.22 or later. So, Its better that to run ggaoed on your box you
can have FC10 installed on your system.The following software is needed in order to build ggaoed:
• glibc 2.7 (built on Linux kernel 2.6.22 or later)
• libaio 0.3.107
• libatomic ops 1.2
• glib 2.12
• xsltproc and DocBook XML 4.5 stylesheets for building the documentation
Run following commands to compile GGAOED:
[root@node1 ggaoed-0.9]# ./configure
[root@node1 ggaoed-0.9]# make
[root@node1 ggaoed-0.9]# make install
Sample Configuration File(ggaoed.conf)
The format of sample configuration file is as follows:
example file: ggaoed.conf
[sdc]
path = /dev/sda2
shelf = 0
slot = 0
broadcast = true
read-only = true
queue-length=64
direct-io=true
About It
The new GGAOED has released with updtaed features of AOE protocol like mac-filtering and acl-
listing.
7.6 QAOED
Qaoed is a multithreaded ATA over Ethernet daemon that's easy to use, yet highly
configurable.QAOED also comes in two avours: qaoed and sqaoed.
After setting the appropriate parameter in this file, just run the following com- mand against all the
available aoe targets to collect the required data for fol- lowing graph:
[root@aoeclient ]# fio surface-scan
The performance graph of AoE targets with fio in case of write operation is as follows:
Here X-axis denotes block-size in kilo-bytes and Y-axis denotes throughput in KB/sec (kilo-byte per
second).
The performance graph of AoE targets with fio in case of read operation is as follows:
9.4 Performance Graph with Bonnie-64
We can setup bonnie-64 by following commands:
[root@sigma13 bonnie-64-read-only]# mount /dev/etherd/e0.0 /mnt
[root@sigma13 bonnie-64-read-only]#./Bonnie -d /mnt/ -s 128
The performance graph of AoE targets with bonnie in case of write operation is as follows:
Here X-axis denotes file-size in mega-bytes and Y-axis denotes throughput in M/sec.
12.3 SETUP
The first step of XEN-AoE setup is to export two block devices of 4GB from node1 to node2:
Acess of these two block devices on node2 and creating an Raid array
[root@node2 Desktop]# modprobe aoe
[root@node2 Desktop]# aoe-stat
[root@node2 Desktop]# mdadm - -create /dev/md0 - -level=1 - -raid-devices=2
/dev/etherd/e0.0 /dev/etherd/e0.1
[root@node2 Desktop]# cat /proc/mdstat
[root@node2 Desktop]# mdadm - -detail /dev/md0
[root@node2 Desktop]# mkfs.ext3 /dev/md0
Now Everything has done to create a new guest os with debian Linux.
Live-Migration
Now it's time to migrate this virtual machine on node3. So, run the following command:
[root@node2 ]#xm migrate - -live debian node3
13 Conclusion
Fiber Channel and iSCSI customers are often looking for more than just storage. AoE is a simple
network protocol and its description is only eleven pages long, but it provides enough of a structure to
build exible, simple, and scalable storage solutions from inexpensive hardware like disks and gigabyte
switch. So, if you want a small San with no extra features in a low budget, then AOE is a better choice
rather than iSCSI and fiber channel. As there always has been a huge demand for low cost and exible
storage solutions, it is not feasible to increase the number of drives easily in either Fiber or iSCSI based
Sans. The ATA over Ethernet (AoE) protocol solves this issue to a large extent. However Fiber channel
solutions are the fastest of the three while iSCSI solutions are still most reliable.