Cloud Computing practice: Rocks + Eucalyptus installation

Hi there, this is mostly an installation log with some considerations.My needs are trying to implement Cloud Computing myself with some free software.After searching around the web some days I decided to try the Rocks+Eucalyptus solution.This document try to cover and log all the aspect that in the beginning where “not so obvious” or “not so clear” to me, saving time for documentation for me in the future and for you guys out there in the community ;)Rocks is a “Clustering Suite” available at http://www.rocksclusters.org, today it is at version V, and we all know that when dealing with non commercial software being at version “5” means a big and long effort with a lot of history and experience, in fact, if I’m not wrong, Rocks development started in the may 2000. Their goal was delivering the computational power of clusters to a wide range of scientific users, and they made many “Rolls” to do that, Rocks is the base and Rolls are the application running on it, for our purposes what we need is the Xen Roll.Eucalyptus is a free Cloud Computing implementation available at http://eucalyptus.cs.ucsb.edu/This test of the Eucalyptus Cloud Computing implementation on top of a Rocks V cluster has the following topology: 1 frontend and 2 computing nodes configured as VM container, the idea is that Rocks Clustering suite has a Xen roll and I wanted to try it out to understand its features and limits.On Rocks you can have two types of nodes, Frontend and Compute, as simply understandable, frontend is the “director”, the “center of operations” and the machine that will delivery services, while compute nodes are the ones that will do the work, in our case hosting the Xen VMs.The frontend has two NICs and has been installed with Rocks V frontend software, to do that, I downloaded the Rocks installation CD, full jumbo DVD distribution from here and simply started the boot process entering “frontend” at the boot prompt, the installation went really smooth, I “simply and dumbly” selected all the rolls in the DVD as this was a test drive and I didn’t want to loose time with dependency problem later, btw: on the frontend you need at least 2 GB RAM.On the frontend node, the NICs are configured to be on two nets, the external production net, being on my LAN with 192.168.1.0/24 address and the internal network with 10.10.10.0/24 address.For installing the computing or vm-container nodes simply follow the very well Rocks installation howto.After launching the insert-ethers command, choose vm-container as node type, and repeat the installation for every physical node.As soon as you reboot nodes you should be able to see them inside the director’s Ganglia tool, reachable connecting from localhost on the director Apache server with a local browser or <a href="http://www.rocksclusters.org/roll-documentation/base/5.0/enable-www.html” target=”_blank”>enabling the network firewall rules for access to that from network.Now that the Rocks cluster is on, it’s time to install the Eucalyptus software as described in the Eucalyptus Administrator Guide, I used Eucalyptus version 1.2.First I made some test with Eucalyptus Public Cloud, than I installed my own Cloud on the Rocks cluster :)If you use some old hardware on your nodes, remember to lower the minimum required RAM needed in your instances to work inside the nodes /etc/xen/xend-config.sxp, otherwise when you will query your cloud for availability you will get a 000/000 usable resources.It works pretty well for me and Amazon’s ec2 tools are fine, unfortunately it just lacks native HA implementation.Feel free to enrich this post with your personal experience and considerations.Have a nice day ;)Fabio

5 comments

  1. Hey Fabio,I tried what you have given in the blog. I am trying to install the Rock in VMWARE, but the problem is, when i am trying to insall it using Frontend command, it is hanging in the final scripts, It is not completing the installsation, can u plesae help me out. One thing more, is it necessary to give 2 GB ram to this machine…

    Like

  2. Hi Deependu,I deployed my setup with real computers and not within VMWare, so maybe there’s something bad in the Rock’s View of resources inside the virtual environment, mind that the default Rocks implementation is based on a Linux CentOS distribution.I suggest you to try it first on real hardware and yes you need at least 2GB RAM.Hope this helpsPlease do not hesitate to post updates on your researchGood luck :)Fabio

    Like

  3. Hey Fabio,I was able sort out the problem. it was some problem with Rocks 5.0 i guess. I downloaded the Rocks 5.1 it worked fine for me. Please look how I installed, and here I am stuck in the end.The setup of the machines is as follows:Server :
    HD Size:- 60 GB
    Ram Size:- 1500 MBClients:
    HD Size :- 30 GB
    Ram Size:- 512 MBWith the DVD I am able to install Frontend on Server by firing the command:-

    <b>build appliance=vm-server</b>Front node is working fine, with all the rolls properly installed.Now, to install the vmcontainer I fire the command
    <b>insert-ethers" and selected vm-container</b>The client machine are able to network boot and get the image from the server.All the client machine is installed using the PXE network boot and started successfully.Up till now:-I have one server which has got the front end installed on it.2 Client machines installed using PXE boot.Server Ip:-
    Cluster.local (name)
    10.1.1.1/16
    192.168.0.40/16Client ip:
    Client 1:-

    hosted-vm-0-0

    10.1.255.254/16
    Client 2:-

    hosted-vm-0-1

    10.1.255.253/16Now, these physical machine has to be included in the frontend.I fire this command:-<b>rocks add cluster fqdn = "cluster.local" ip="10.1.1.1" num-computes = "2"</b>I got the output
    created frontend VM named:frontend-0-0-0

    created compute VM named:hosted-vm-0-0-0

    created compute VM named:hosted-vm-0-1-0After this successfull creation of the frontend-0-0-0 I fire this command:-
    <b>rocks start host vm cluster.local</b>It is fired without any error message.than finally I fire :-
    <b>virt-manager</b>The virtual console comes, I connect to the localhost:-
    HERE COMES THE PROBLEM :-

    I can only see Domain-0, there is no frontend-0-0-0 virtual machine foamed under Domain-0,( as shown in manual)I have been trying to resolve how to get this frontend-0-0-0, but not able to figure out.Please let me know where I am getting wrong.In case if I am wrong somewhere please guide me.I have read on some of discussion thread that there were able to install Rocks cluster on VMWARE, but none of them give any thing regarding this problem.Let me know if any other information is required.With regardsDeependu

    Like

  4. Hi Fabio,I have a problem in configuring eucalyptus cloud on the existing rocks cluser configured with 4 server.From the Frond-end server im able to run virsh list :[root@rocks ~]# virsh list Id Name State———————————- 0 Domain-0 runningBut when i run on the compute nodes i get the following error:[root@compute-0-0 ~]# virsh listerror: failed to connect to the hypervisorBut thru virt-manager im able to connect to the front-end..Eucalyptus needs virsh list to show the null domain on the compute nodes to start eucalytus on compute nodes.Can you please help me in resolving this..Regards,Arvindh.L

    Like

  5. Respected Mr. FabioWith respect to your blog entry dated 26th of August, 2008, we would highly appreciate if you agree to discuss the setting up of a rocks cluster with us.Please do get in touch at the given e-mail IDAny help would be deeply appreciated.Thank you.

    Like

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s