Upcoming: Stonebreaker on 'Which of my databases you should buy'
Michael Stonebreaker's actual talk tomorrow (7-9pm) at MIT is entitled:
"One Size Fits All in DataBase Management: An Idea Whose Time Has Come and Gone"
And I hope to be there. I'm anxious to learn more about Streambase and Vertica, his event-oriented and column-oriented db progenies.
If you google for Twitter and scalability, you'll find a lot of articles on how Twitter's Rails setup has buckled under their obscene growth curve. People have pointed fingers at Rails, and Ruby, and various other things to explain these scalability issues. But I think that fundamentally they're using the wrong technology for what they're trying to accomplish.
I think their implementation of a messaging architecture on top of an RDBMS was not a great choice for their current volume, and I strongly suspect that some event processing platform like Streambase would be a better choice. I'm a complete event processing novice and I know less about twitter so they might already do this ( and their scalability issues are completely about rendering event streams to the web). But regardless I'm hoping this talk will give me a better idea of when to use messaging-oriented technology as opposed to the tried-and-true rdbms approach.