Building opensource SAN

Title is very catchy...isnt it. It has to be :), reason imagine SMEs investing in SAN infrastructure. Its huge investment. Lets look into a cost effective way of building a SAN infrastructure using tools like freeNAS,openfiler etc.

What we need here are two server grade boxes with suse server OS.Some SAN setups work with Fibre Channel. Because this involves an expensive fiber optics-based infrastructure, this option is not the best imaginable for an affordable open source SAN. Instead of using Fibre Channel, we'll use iSCSI. An iSCSI target will be used to provide access to the storage device.One of the challenges of building such a flexible SAN setup is to make it as versatile as possible. That means that a failing component has to switch over automatically. So if the SAN box that currently hosts DRBD as well as iSCSI access goes down, the other box in the SAN needs to take over automatically. To do this, we'll use Heartbeat -- a portable, high-availability cluster management program -- to monitor and ensure availability of all critical resources in the SAN.

Required Software
To build such SAN appliances, you need the appropriate software. Typically, any Linux distribution will do, but in this article we'll use SUSE Linux Enterprise Server 10 SP2, which is available as a free download. One of the advantages of using SUSE is its position as the distribution used by the Heartbeat Software developers; Heartbeat plays a critical role in this setup. You'll therefore always be ensured from optimal integration between the operating system and the cluster software when working with SUSE. You could use the open source version of SUSE Linux as well, but to build a stable and reliable setup, I would always recommend working with the enterprise version.

When making your choice of softwares to install, keep it to a minimum. After all, you are building SAN appliances here and typically on a SAN you wouldn't run any services. From the list of installable software patterns, select the following:

  • Server Base System
  • High Availability
  • Documentation
  • GNOME Desktop Environment for Server
  • X Window System

Apart from that, select the iSCSI target components as well. Then you don't need anything else. In fact, you can even do it with less and choose not to select the GNOME environment and X Window System, but since SUSE heavily relies on YaST to configure the box, I'd recommend - at least for as long you are still working on the installation - that you keep the graphical environment at hand. Once finished with the installation, you can still disable it. Of course, you're also free to start all graphical components from a desktop in case you would prefer that.

In addition to the software requirement, you should also think about the hard disk layout you want to use when building SAN appliances like this. No matter if you are setting up server hardware or two laptops to create a test environment, you should take into consideration that a storage device is needed as the SAN storage. In figure 1, I have used /dev/sdb as an example storage device, but this assumes that you have two (or even more) hard drives available. In case you do not have that, it may be a good option to create an LVM setup, and to make a large dedicated volume available for the SAN storage.

The LVM setup also allows you to work with a snapshot appliance - more about that later in this tip. On my test setup, where I use two laptops with a 160 GB hard disk , I've used the following disk layout:

  • /dev/sda1: a 100 MB Ext2 formatted partition that is mounted on /boot.
  • /dev/sda2: the rest of all available disk space, marked as type 8e for use in an LVM environment.
  • /dev/system: the LVM volume group that uses the disk space available from /dev/sda2.
  • /dev/system/root: a 10 GB Ext3 formatted logical volume for use as the root of the server file system.
  • /dev/system/swap: a 2 GB logical volume used as swap space.
  • /dev/system/DRBD: a 100 GB logical volume which is just allocated and not formatted.

To create such a disk layout, use the YaST integrated module while performing the installation.

The last consideration to take when setting up your server is networking. I recommend putting your SAN on a network that is separated from normal user traffic. You don't want synchronization between the storage devices in the DRBD setup to be interrupted by a large file transfer initiated by an end-user, so if possible, create a dedicated storage network.

Normally, you would also want to configure a separated network for Heartbeat traffic, in order that a node won't get cast off the network when traffic is temporarily elevated. In this situation, however, I prefer not to do that. If Heartbeat packets don't come through over the normal network connection, it is likely that your DRBD device has also ceased communicating . You wouldn't want Heartbeat to ignore a failure in the communications link while your SAN is in a disconnected stage because a redundant link is still replying, would you?

You now have the basis of your SAN solution available: the two servers that are going to offer the iSCSI storage services

Disclaimer :Parts of this article are inspired from search enterprise linux.com posted by Sander van Vugt.

Also look at this article below which gives more information on building opensource SAN

http://www.sandervanvugt.nl/files/u18/Creating_an_Open_Source_SAN_Solution.pdf


14 comments:

Anonymous said...

Could you please update the link on the PDF document at the bottom of your blog.. IT returns a 404.

Anonymous said...

Yes please update the link. This is a great read thank!

Anonymous said...

A person necessarily lend a hand to make critically articles I
would state. This is the first time I frequented your web page and so far?
I amazed with the analysis you made to create this particular put up extraordinary.

Wonderful activity!

Here is my weblog: Rvtl Anti Aging

Anonymous said...

If some one needs expert view on the topic of running a blog after that i recommend
him/her to visit this web site, Keep up the fastidious job.


Feel free to visit my weblog :: Internet Money Path Reviews

Anonymous said...

Hi! I know this is somewhat off topic but I was wondering if you knew where
I could locate a captcha plugin for my comment form?
I'm using the same blog platform as yours and I'm having difficulty finding one?
Thanks a lot!

Also visit my web blog ... Chronic profits list

Anonymous said...

Wow that was odd. I just wrote an incredibly long comment but after I clicked submit my comment didn't appear. Grrrr... well I'm not writing all that over again.
Anyhow, just wanted to say wonderful blog!

Here is my homepage - Best Supplement For Muscle

Anonymous said...

For most recent news you have to pay a visit world wide web and on world-wide-web I
found this website as a most excellent web site for newest updates.


Here is my web blog: Best Anti Aging Product

Anonymous said...

We're a gaggle of volunteers and opening a new scheme in our community. Your site provided us with useful info to work on. You have performed an impressive task and our entire neighborhood shall be grateful to you.

my page: Pure White Kidney Bean

Anonymous said...

Thanks for one's marvelous posting! I definitely enjoyed reading it, you're a great author.
I will make certain to bookmark your blog and will often come back
at some point. I want to encourage you to definitely continue your great
work, have a nice afternoon!

my homepage :: Ripped Muscle Xtreme Reviews

Anonymous said...

With havin so much content and articles do you ever
run into any issues of plagorism or copyright violation? My site has a lot of exclusive content
I've either created myself or outsourced but it appears a lot of it is popping it up all over the internet without my authorization. Do you know any ways to help reduce content from being stolen? I'd genuinely appreciate it.



my web page - Buy green coffee

Anonymous said...

Hi would you mind letting me know which webhost you're utilizing? I've loaded your blog in
3 completely different browsers and I must say this blog loads a lot quicker then most.
Can you suggest a good web hosting provider at a fair price?
Thanks a lot, I appreciate it!

Take a look at my site - choicegreencoffeeblog.org

Anonymous said...

I was recommended this blog by my cousin. I'm not sure whether this post is written by him as no one else know such detailed about my problem. You're wonderful!
Thanks!

my web blog uberbrides.com

Anonymous said...

Hey there, I think your blog might be having browser compatibility issues.
When I look at your blog site in Ie, it looks fine
but when opening in Internet Explorer, it has some overlapping.
I just wanted to give you a quick heads up!
Other then that, amazing blog!

Here is my web-site :: bowtrol

Anonymous said...

Hello to all, how is all, I think every one is getting more from this web page, and your views are nice
in favor of new visitors.

My page paint sprayer reviews