… what is so hard about scaling the Twitter service?

Hueniverse: Scaling a Microblogging Service – Part I

The social web is creating demand for new scaling tools and
technologies. Current databases and caching solutions are simply unable
to handle a complex network of multiple relationship between objects.
While databases are still a good solution for persistent storage of
social data, each retrieval requires heavy calculation.