Twitter's Real-Time URL Fetcher Using Cassandra and MemcachedTwitter’s real-time URL fetcher, code named SpiderDuck, is an excellent example of how NoSQL databases fit in the architecture of today’s systems: Metadata Store: This is a Cassandra-based distributed hash table that stores page metadata and resolution information keyed by URL, as well as fetch status for every URL recently encountered by the system. This store serves clients across Twitter that n
{{#tags}}- {{label}}
{{/tags}}