John Sequeira

Amped::Technology

Friday, January 26, 2007
You want to run what?, on what? on what? (Amazon style)

I found instructions for running Windows images in QEMU on Xen on (presumably) Linux. Phew.

This reminded me that I've been meaning to post about Amazon's new grid offerings s3 and ec2.

I get Amazon's s3 storage-on-demand -- I think it's great and I'm actually using it to store older database backup files for a production server. IIRC, Amazon is charging a tenth what our hosting provider charges for local SCSI/RAID disk space.

The s3 tools are way cruder than I'd like (even jungledisk's webdav->disk mapping is a bit hacky), but I see the potential.

I'm having trouble wrapping my head around EC2, though. I'm spoiled by desktop virtualization, and my clients are starting to offer quick virtual hosting of servers on their intranets. So, when/why would having a server that runs for a fraction of a day/month/whatever make sense?

I know it's exciting because it's new and all, but I just don't get it and I'm not sure who the target audience is. I suspect I'll have to wait until folks start building apps on top of EC2 before it gets on my radar.

Update: Ten minutes after I posted this, it did occur to me when/why you'd want to choose EC2. Amazon is in the process of rolling out something similar to VMWare's Virtual Appliance directory with the difference of offering a rapid deployment/hosting option.

These appliances are somewhat interesting to imagine running on a per/minute basis, but considering how easy it is to download to your desktop it's not too great. It begins to become really compelling once you move beyond individual machines and into the concept of what's now termed "Lab Management" - when you have a testing environment that consists of many machines acting in tandem, and you need to build up the cluster, test it, and tear it down and restart it , many times and in many different configurations. Covering your test matrix for distributed applications/SOA is hard, and Lab Management is ridiculously easier than the alternative.

Lab Management will remain inside the enterprise, but the value and direction of EC2 is in applying the testing-focused Lab Management concept to production user-facing applications: what I like to call the Downloadable Data Center.

Why is this cool? Well, consider the difference between your typical startup and a mature web enterprise: to really run a web hosted application according to best practices, you should have

  • staging setup
  • production setup,
  • hot standby, DR plan
  • version control repository/bug tracker
  • integrated authentication
  • distributed file system
  • load balancer
  • firewall/intrusion detection
  • etc.

And no one does initially because it takes a lot of time, money and expertise to put all these pieces in place. But what if you could have it all initially and it didn't cost an arm and a leg? The idea of a vendor (like, say Novell or RH) pre-provisioning all the machines required to pull the above off, and offering them via the Amazon EC2 Control Panel is quite compelling. Imagine the options:

  • Statefull Firewall with mod_security? Check.
  • Dedicated Image Server pre-configured with optional Akamai CDN support? Check.
  • Web analytics reporting server? Check
  • Offline bi/olap database with real-time replication? You get the idea.

Each check on that control panel is the equivalent of days or weeks of work on your hand-rolled data center. Accordindly, enabling composable application clusters like this would be worth much more than $60-70/mo/machine. EC2 ISV's like Novell would clearly be due some royalty or rent on top of the EC2 grid-dial-tone costs, in addition to their traditional subscription/support revenue.

In the near term, it's hard to imagine shifting from a hand-rolled mini data center to a commodity one because of all the weird hacks that evolve. You could call this "The ActiveGrid Challenge" since that product, which sniffs around the same space, has essentially identical adoption barriers.

Over time, as developers become aware of the prefab/click-to-deploy options and start coding to them, however, it's hard to imagine it not taking a good chunk of the hosting marketplace.

To give credit where credit is due, Marc Andreeson had this idea with his LoudCloud startup. For the small fee of $100K/month, they would professionally provision and maintain your data center. I liked the idea, but thought that although it sounded like a nifty escape valve for harried CTO's, they'd probably run of of customers pretty quickly at that price, and they did. I'm betting the same fate does not await EC2 much more mass-market effort.
5:15:18 PM      comment []  trackback []

Qumranet ?

For some reason, I went looking for Moshe Bar's weblog. I've been a Moshe fan since the Byte days, and it just occurred to me to find out what he's doing now. I found this on Wikipedia

Moshe Bar is the founder, main developer and project manager of openMosix. Moshe is founder of the company behind the Xen software, XenSource, Inc. Moshe also co-founded Qlusters Inc, an open source systems management software company with headquarters in Palo Alta, California and offices in New York City and Tel Aviv, Israel (also see openQRM).[1] Moshe is also founder and CTO of the company Qumranet which is behind the development of the KVM virtualization technology in the Linux kernel.

Moshe did a stint at XenSource as CTO ... From what I had heard about KVM, I assumed it was just a lone hacker project like QEMU. I didn't realize that the project looks to be a Xen competitor with it's corporate sponsorship and XenSource-like venture backing.

I wonder what they're up to (beyond a compelling-sounding, legacy-free VT-based hypervisor)?
3:03:36 PM      comment []  trackback []


© Copyright 2007 John Sequeira.
 
January 2007
Sun Mon Tue Wed Thu Fri Sat
  1 2 3 4 5 6
7 8 9 10 11 12 13
14 15 16 17 18 19 20
21 22 23 24 25 26 27
28 29 30 31      
Dec   Feb

Click here to visit the Radio UserLand website.

Click to see the XML version of this web page.

Click here to send an email to the editor of this weblog.
Yahoo: johnseq2
MSN: [email protected]
AIM: amped02139
Skype: johnjulian