The Next Wave of Hosting: Grid vs. The Cloud vs. What Works

There has been an enormous amount of discussion over the past two years about new technologies that are going to set a new standard in the application hosting space. But what is fact and what is fiction, and more importantly, should you care?

The first time I heard about Grid Computing I was still up at school in the late 90s which, not surprisingly, was around the same time I was engrossed in my parallel computing course. All the talk of IPC and modulo arithmetic joined in an unholy matrimony with massive amounts of Mountain Dew and 3am whiteboarding in the labs, the offspring of which was a simple understanding of why and when to use parallel computing.

Fast forward to today and Silicon Valley’s VCs have eliminated all but the most trendy of ideas to back, the recent darlings being so-called Cloud computing. So what is Cloud Computing? Supposedly The Cloud is an ultra-scalable architecture that has implicit redundancy so no one ever has to go through the painful process of upgrading hardware; is this not the panacea of Datacenter logistics – completely automated vertical scalability?

The Promise
Current providers of Cloud provisioning software, such as 3Tera, promise less cost, ease of maintenance, and simple scalability. Need a new server? Just click a few buttons and you have a new virtual server, possibly pre-configured with software and even your specific settings.

The Failure
While having a large and dynamic infrastructure is appealing, there are inherent problems with the current approaches, the most obvious of which is the lack of failure abstraction. While products like VMWare have the ability to provide fail-over automatically, the fact that offerings like Applogic and EC2 do not provide such capabilities out-of-the-box is very telling about the underlying architecture. While many can argue that Xen-based hypervisors can be instrumented to failover, the fact that the technology does not, as a matter of its DNA, provide failover is The Failure. In order to provide the promises marketing for the various grid services has suggested, not only do we need to scale easily, but we need reliability; you cannot provide one and not the other.

Commentary
We all know that technology changes rapidly, but vendors and pundits fail when they speak as if change is good just for the sake of itself. Recently we’ve seen many old architectures rehashed: mainframe dumb-terminals have become remote desktops and terminal services, talk of Ethernet’s limitations being replaced with a protocol that involves a “Token” and the new SMP craze disguised as multi-core processing. It’s time for some real progress. It may be in the same way virtualization has brought us the Cloud that the Cloud itself may be an intermediate step to something better. At the very least let’s hope that the next step on the ladder is up, not down.

139 Responses to “The Next Wave of Hosting: Grid vs. The Cloud vs. What Works”

  1. Bert Armijo says:

    AppLogic absolutely DOES provide failure detection and correction, and has since release 1.0. Data redundancy is included as well, and our disaster recovery suite is making it easy for users to get active-active redundancy with data replication between sites.

    Your post revolves around providing servers on-demand via virtualization, but that only scratches the surface.

    AppLogic is unique in that it provides a new abstraction layer, the application, allowing users to package existing application code, data and infrastructure into portable, scalable, instantiable entities. Want 20 copies of a 10 server app for QA – it’s one command. Want to backup that 30 server ERP system – it’s one command. Need that 100 server web service moved accross the country to a new data center – it’s still one command. No human intervention. No code modification. No rebuilds. No risk.

    With all the hype around lately, it’s sometimes tough to cut through the marketing blitz, but there is real technology in the cloud and it is effecting substantial change for users.

    Bert Armijo
    3tera

  2. I will have to take issue with your article. (I can’t quite read Bert’s reply – it seems to have been mangled by FireFox.) We are a managed cloud hosting provider that have been using AppLogic to serve our customers for 18 months. AppLogic does indeed have an abstracted failover model: any applications running on servers that fail are automatically restarted on standby application servers. This is the identical model to VMWare’s failover model. The time to accomplish this depends on various system parameters as well as the memory image size of the application.

    Where you can run into problems is if you use software which cannot tolerate unexpected downtime (such as I saw today with MySQL on a MyISAM table.) Even AppLogic’s data redundancy wasn’t able to solve the fact that the restarted MySQL failed to come up due to data corruption. However, this would be true under VMWare as well. What is missing is carefully designed applications that take advantage of the failover capabilities of tools like AppLogic. When we deploy our customers’ code to an AppLogic Grid, we work with them to produce restartable deployments, which turn out to survive failures very successfully.

  3. karl says:

    @Bert -

    Thanks for the insight. My conversations with Vlad specifically talking about Layered Tech’s initial implementation(TGL) revolved around customer feedback on major issues with the lack of failover. This very well may have changed; in the article I tried to focus on how important it is to not have failover as a bolt-on application. VMWare is guilty of this to a varying degrees, as is every Cloud platform I am aware of at this time. SMP APIs for the past few decades have addressed this problem, though it seems Cloud infrastructures have not heeded the lessons. I’m only a single voice, but I would like to see a Cloud platform that at its core is not meant to scale vertically, but horizontally.

    @Eric -

    Thanks for taking the time to post. I agree there are a number of problems with getting non-grid/cloud applications to utilize the underlying services, but I think that is a litmus test of the grid/cloud platform. Most any client/server application should be able to work on a Cloud without modification and reap all the benefits the infrastructure provides, including distributed filesystems, which apparently is still an issue.

  4. ElizaSnider says:

    Some time ago, I did need to buy a good house for my business but I didn’t have enough cash and could not purchase something. Thank God my comrade proposed to take the credit loans at banks. Thus, I did so and used to be happy with my financial loan.

  5. marry poppins says:

    Ladies and gentlemen, are the radical homosexual extremists REALLY that interested in gay marriage and other activities I won’t mention at this time? Or are they just trying to be in everyone’s face in every institution, as a sort of a psychic reproduction when they can’t reproduce physically?

    Here we had the first sensible thing the state of California attempted to do in decades, and it gets trampled by a “gay” judge who didn’t have the decency or civility to recuse himself from the case. Well, the normal people’s rights have been trampled on, and please don’t ask me who I am to determine who is normal. Normal is normal, and perversion as abnormal. I say this in 2012 when Freedom of Speech is still exists, or at least it’s supposed to be in effect.

    Roe vs.Wade gave rights to selfish people everywhere, while removing the chance at life for those who stood to enter into the world. Now, we have perversion and unholy co-called “matrimony” being glorified and celebrated throughout the land.

    Combining this with the thought that we have the worst so-called “President” in history who might be reelected by selfish people, perverts and low-lifes everywhere, I don’t feel very motivated to go on rallying behind America any longer, although I suppose I still will not give up hope. While bearing in mind I may have to hide in a cave somewhere, or possibly in the Alaska wilderness or in the Florida Everglades. Being around the serpents would probably be better, in a sense.

    How do you other sensible people feel? And since this is a free forum, I suppose the degenerates can answer as well. Thanks! :)

    P.S. Please try to show some respect, by understanding the problem is not with me for identifying all of the great wrong that is taking place. The problem is with you for seeing evil and rottenness as good, and vice versa. Thanks again! :)
    ANSWER TO YOUR RIDICULOUS RESPONSES: 1. They ALREADY HAVE the same equal rights as others, including the ability to marry and the same denial as everyone. Marrying another man based on what you call yourself is a SPECIAL right, not an equal one. But you liberals are simply too stupid to understand that.

    2. Ron Paul is insane, along with his stupid, bizarre reasoning you have mentioned. HEAVEN FORBID if this mad lunatic becomes President. He’s almost as bad as Obama and he actually may be as bad or worse!
    Pooh Bear: You are correct – it’s a waste of time. My mind is completely closed, JUST AS YOURS IS. We are now a nation divided and I’d rather go through ordeals of fire and water, or have someone twist my arms off than EVER come over to your way of thinking, or Obama’s, either.
    I do want to thank people, however, for maintaining basic respect. This has been about as reasonable as a discussion as could be expected, so far.

Trackbacks/Pingbacks

  1. obrazy nowoczesne…

    I would like to uslysht just a little additional on this topic…

  2. … [Trackback] ……

    [...] more information attainable at this place [...]…

  3. ogrodzenia plastikowe…

    I like what I see so i am just adhering to you. Appear ahead to discovering your internet page however again….

  4. absite…

    Can I simply say what a reduction to find somebody who truly knows what theyre speaking about on the internet. You undoubtedly know find out how to bring an issue to gentle and make it important. More people need to learn this and understand this facet…

  5. makemoneywithleo…

    Buy toys, car seats, monitors and clothes for the little from new born to young adult. We only carry Amazon name brand baby products. I used to be more than happy to search out this net-site.I needed to thanks for your time for this wonderful learn!! I…

  6. flash flood says:

    survive…

    Can I simply say what a reduction to seek out someone who actually knows what theyre speaking about on the internet. You positively know find out how to convey a problem to mild and make it important. Extra individuals must learn this and perceive this…

  7. Related……

    [...]just beneath, are numerous totally not related sites to ours, however, they are surely worth going over[...]……

  8. I Hate amateur…

    Can I just say what a aid to search out someone who truly knows what theyre speaking about on the internet. You undoubtedly know learn how to bring an issue to gentle and make it important. More folks need to learn this and perceive this side of the st…

  9. GentleRainMarketing…

    Buy toys, car seats, monitors and clothes for the little from new born to young adult. We only carry Amazon name brand baby products. Can I just say what a aid to seek out somebody who truly knows what theyre speaking about on the internet. You undoubt…

  10. hair…

    I was very happy to search out this internet-site.I wished to thanks on your time for this excellent read!! I definitely having fun with each little little bit of it and I’ve you bookmarked to check out new stuff you blog post….

  11. discuss says:

    discuss…

    Buy toys, car seats, monitors and clothes for the little from new born to young adult. We only carry Amazon name brand baby products. very good put up, i actually love this website, keep on it…

  12. Wika Water Heater…

    I saw this really great post today….

  13. Wika Water Heater…

    Think is good…

  14. camescope hd says:

    Good read…

    I have been absent for a while, but now I remember why I used to love this blog. Thanks, I will try and check back more often. How frequently you update your website?…

  15. lire says:

    Your post…

    Very interesting points you have noted , regards for posting . “Great is the art of beginning, but greater is the art of ending.” by Henry Wadsworth Longfellow….

  16. Bing results…

    While browsing a lot Bing and AOL I very much happily discovered this interesting page in the search results and I did think it would match…

  17. Dreary Day…

    It was a dreary day here today, so I just took to messing around online and found…

  18. …[Trackback]…

    Similar post here…

  19. Looking around…

    I love to browse in various places on the online world, often I will just go to Stumble Upon and follow thru…

  20. Bonsai…

    I’ve read not one write-up in your blog. You are a big lad…

  21. Recent Blogroll Additions……

    [...]usually posts some very interesting stuff like this. If you’re new to this site[...]……

  22. Awesome…

    I’m planning to create my own blog, and a question comes up to my mind…..

  23. promotions says:

    credit cards…

    I used to be very happy to find this web-site.I needed to thanks for your time for this glorious learn!! I positively enjoying every little bit of it and I’ve you bookmarked to check out new stuff you blog post….

  24. make money online…

    Buy toys, car seats, monitors and clothes for the little from new born to young adult. We only carry Amazon name brand baby products. Can I just say what a relief to find somebody who truly is aware of what theyre speaking about on the internet. You po…

  25. Just Looking…

    When I was surfing today I noticed a great article concerning…

  26. archiwizacja online…

    Understand to publish himself, the post from one more supply…

  27. andy62358…

    Can I simply say what a reduction to seek out somebody who actually knows what theyre talking about on the internet. You undoubtedly know the way to convey an issue to light and make it important. Extra people must read this and understand this aspect …

  28. skincare…

    I used to be more than happy to search out this internet-site.I wished to thanks for your time for this excellent learn!! I undoubtedly enjoying each little bit of it and I have you bookmarked to check out new stuff you blog post….

  29. Digg…

    While checking out DIGG today I found this…

  30. link says:

    Blogs ou should be reading…

    [...]Here is a Great Blog You Might Find Interesting that we Encourage You[...]……

  31. Visitor recommendations…

    [...]one of our visitors recently recommended the following website[...]……

  32. Nice post…

    Very nice design and great subject material , hardly anything else we need : D….

  33. Transvaginal says:

    Trackback Priority…

    Fantastic site. Lots of useful info here. I am sending it to a few buddies ans additionally sharing in delicious. And naturally, thank you on your sweat!…


Leave a Reply