Tumblr: Hashing Your Way to Handling 23,000 Blog Requests per Second - High Scalability -
This is a guest post by Michael Schenck, SRE Staff Engineer at Tumblr. At Tumblr, blogs (or Tumblelog) are one of our most highly trafficked faces on the internet. Â One of the most convenient aspects of tumblelogs is their highly cacheable nature, which is fantastic because of the high views/post ratio the Tumblr network offers our users. Â That said, it's not entirely trivial to scale out the peri
マイクãƒã‚µãƒ¼ãƒ“スã®ãŸã‚ã® Tumblr 製フレームワーク "Colossus" - Okapies' Archive
ã“ã®è¨˜äº‹ã¯ Scala Advent Calendar 2014 ã® 15 日目ã§ã™ã€‚昨日㯠id:qtamaki ã•ã‚“ã®â€ã€Œé–¢æ•°ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚° ç 玉ã®ã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ デザインã€ã‚’Scalaã§å®Ÿè£…ã—ã¦ã¿ã‚‹â€ã§ã—ãŸã€‚ 今日ã¯ã€å…ˆæ—¥ã« Tumblr ㌠OSS 化を発表ã—㟠Scala 製ã®ãƒŽãƒ³ãƒ–ãƒãƒƒã‚ング I/O (NIO) フレームワーク "Colossus" を紹介ã—ãŸã„。â€é«˜æ€§èƒ½ãªãƒžã‚¤ã‚¯ãƒã‚µãƒ¼ãƒ“スを構築ã™ã‚‹ãŸã‚ã®ãƒ•ãƒ¬ãƒ¼ãƒ ワークâ€ã‚’謳ã£ã¦ãŠã‚Šã€ã¾ã OSS 化ã•ã‚Œã¦æ—¥ãŒæµ…ã„ã‚‚ã®ã® Tumblr ã§ã¯ã™ã§ã« production ã§ä½¿ã‚ã‚Œã¦ã„ã‚‹ã¨ã•ã‚Œã‚‹ã€‚ã¾ãŸã€Colossus 自体ãŒã‚¢ã‚¯ã‚¿ãƒ¼ãƒ•ãƒ¬ãƒ¼ãƒ ワーク Akka ã®ã‚¢ã‚¯ã‚¿ãƒ¼ã¨ã—ã¦å®Ÿè£…ã•ã‚Œã¦ãŠã‚Šã€ãれを使ã£ãŸç‹¬è‡ªã®ã‚¹ãƒ¬ãƒƒãƒ‰ãƒ¢ãƒ‡ãƒ«ã‚’æä¾›ã—ã¦ã„る点も興味深ã„。 Colossus Colossus: A New Service Framework
Tumblr's Finagle Redis Implementation
Tumblr uses redis as a cache/store for a number of our internal applications. Some of the things that depend on redis include: dashboard notifications (via staircar)Tiny URL's (via gob)gearman persistent storage (via george)note counts (also via staircar, coming soon)dashboard data (coming soon via ira) Over the past six months we've started shifting internal services from being C/libevent based t
Tumblr Architecture - 15 Billion Page Views a Month and Harder to Scale than Twitter - High Scalability -
With over 15 billion page views a month Tumblr has become an insanely popular blogging platform. Users may like Tumblr for its simplicity, its beauty, its strong focus on user experience, or its friendly and engaged community, but like it they do. Growing at over 30% a month has not been without challenges. Some reliability problems among them. It helps to realize that Tumblr operates at surprisin
Tumblr ã«ãŠã‘ã‚‹ Scala - Kato Kazuyoshi
最近ã®ã‚¦ã‚§ãƒ–系スタートアップãŒæŽ¡ç”¨ã—ã¦ã„るプãƒã‚°ãƒ©ãƒŸãƒ³ã‚°è¨€èªžã‚„フレームワークã¾ã¨ã‚ ã¨ã¡ã‚‡ã†ã©åŒã˜ãらã„ã®æ™‚期㫠High Scalability ã« Tumblr Architecture - 15 Billion Page Views A Month And Harder To Scale Than Twitter ã¨ã„ã†è¨˜äº‹ãŒã§ã¦ã„ãŸã€‚ ã¾ã¨ã‚ã 㨠Tumblr 㯠PHP を使ã£ã¦ã„ã‚‹ã“ã¨ã«ãªã£ã¦ã„ã‚‹ã‘ã©ã€ã„ã¾ç¾åœ¨ã® Tumblr 㯠PHP ã§ã™ã¹ã¦ã‚’書ãã®ã‚’æ¢ã‚ã¦ã€Scala も使ã£ã¦ã„るらã—ã„。 Scala 㨠Finagle Tumblr ã¯ã‚‚ã¨ã‚‚㨠LAMP (Linux + Apache + MySQL + PHP) ã§å‡ºæ¥ã¦ã„ãŸã€‚スケールã•ã›ã‚‹ãŸã‚ã« memcached ã‚„ HAProxy ã§ã‚ャッシュã—ã¦ã¿ãŸã‚Šã€MySQL ã‚’ sharding ã—ã¦ã¿ãŸã‚Šã€ãƒãƒƒã‚¯ã‚¨
highscalability.com ã® Tumblr ã®ã‚¢ãƒ¼ã‚テクãƒãƒ£ã«ã¤ã„ã¦ã®è¨˜äº‹ã‚’èªã‚“ã - @kyanny's blog
High Scalability - High Scalability - Tumblr Architecture - 15 Billion Page Views a Month and Harder to Scale than Twitter ã‚’èªã‚“ã 。ã™ã”ãé¢ç™½ã‹ã£ãŸã€‚ Kindle ã§å¼•ç”¨ã—ãŸã¨ã“ã‚ã‚’ä¸å¿ƒã«ãƒ¡ãƒ¢ã€‚ Tumblr ã®ã‚½ãƒ¼ã‚·ãƒ£ãƒ«ã‚°ãƒ©ãƒ•ã®ç‰¹å¾´ The graph for Tumblr users has hundreds of followers. This is different than any other social network and is what makes Tumblr so challenging to scale. Tumblr ã 㨠follower ãŒæ•°ç™¾äººã„るユーザーã¯ã‚¶ãƒ©ã«ã„る。 follower ã®å¤šã„ユーザー㮠post ã¯å¤šãã®ãƒ¦ãƒ¼ã‚¶
GitHub - tumblr/jetpants: MySQL toolkit for managing billions of rows and hundreds of database machines
Jetpants is an automation toolkit for handling monstrously large MySQL database topologies. It is geared towards common operational tasks like cloning slaves, rebalancing shards, and performing master promotions. It features a command suite for easy use by operations staff, though it’s also a full Ruby library for use in developing custom migration scripts and database automation. Jetpants support
Google グループ
Google グループã§ã¯ã€ã‚ªãƒ³ãƒ©ã‚¤ãƒ³ フォーラムやメール ベースã®ã‚°ãƒ«ãƒ¼ãƒ—を作æˆã—ãŸã‚Šã€ã“ã†ã—ãŸãƒ•ã‚©ãƒ¼ãƒ©ãƒ やグループã«å‚åŠ ã—ãŸã‚Šã™ã‚‹ã“ã¨ã§ã€å¤§å‹¢ã®ãƒ¦ãƒ¼ã‚¶ãƒ¼ã¨æƒ…å ±ã®å…±æœ‰ã‚„ディスカッションを行ã†ã“ã¨ãŒã§ãã¾ã™ã€‚
Collins - Infrastructure Management for Engineers
About Collins exists to drive infrastructure automation. Someone recently asked me to describe collins in a sentence. At Tumblr, it's the infrastructure source of truth and knowledge. Everything about Tumblr production environments is stored and encoded in Collins, and that data is used to drive all of our automation. Sometimes people refer to systems like this as a CMDB, or Configuration Manageme
ã¯ã¦ãªã‹ã‚‰Tumblrã«ç§»ã‚‹ãŸã‚ã®æ‰‹å¼•ã
è¦ç´„：Tumblrã¯æ—¥è¨˜å¸³ã¨ã—ã¦ã‚‚ソーシャルãªãƒ–クマã¨ã—ã¦ã‚‚使ãˆã‚‹ã®ã§ã€ãƒ€ã‚¤ã‚¢ãƒªãƒ¼ã¨ãƒ–ックマークをæ¢ã‚ã¦Tumblr一本ã«ã™ã‚‹ã¨æ—ã‚Šã¾ã™ã€‚ Tumblrã¯ã¯ã¦ãªãƒ€ã‚¤ã‚¢ãƒªãƒ¼ã®ä»£ç”¨ã«ãªã‚‹ã‹ï¼Ÿãªã‚Šã¾ã™ã€‚ ã¯ã¦ãªãƒ€ã‚¤ã‚¢ãƒªãƒ¼ã§å€‹äººçš„ã«ä¾¿åˆ©ã ã¨æ€ã£ã¦ã„ãŸã®ã¯æ¬¡ã®4点ã§ã™ã€‚ テã‚ストベースã§æ›¸ã‘る。コードã®ã‚·ãƒ³ã‚¿ãƒƒã‚¯ã‚¹ãƒã‚¤ãƒ©ã‚¤ãƒˆãŒå……実ã—ã¦ã„る。ã¯ã¦ãƒ–ã•ã‚Œã‚„ã™ãã¦ã€ä»–ã®äººã«è¦‹ã¦ã‚‚らã„ã‚„ã™ã„。 ã©ã†ã›ã¯ã¦ãƒ–を使ã†ã®ã§ã€è¤‡æ•°ã®ã‚µãƒ¼ãƒ“スを行ãæ¥ã—ãŸã‚Šãƒã‚°ã‚¤ãƒ³ã—ãªãŠã™é¢å€’ãã•ã•ãŒãªã„。ã“ã®ã‚ãŸã‚Šã¯ Tumblr ã«ã—ã¦ã‚‚ã ã„ãŸã„大丈夫ã¨ã„ã†ã‹ã€ã‚€ã—ã‚よããªã‚Šã¾ã™ã€‚ Markdown記法ã§æ›¸ã‘る。シンタックスãƒã‚¤ãƒ©ã‚¤ãƒˆã¯JavaScriptを使ãˆã°ã„ãらã§ã‚‚ã§ãる（例）。リブãƒã‚°ã•ã‚Œã‚„ã™ãã¦ã€ä»–ã®äººã«è¦‹ã¦ã‚‚らã„ã‚„ã™ã„。Tumblr ãŒãƒ–クマã®å½¹å‰²ã‚‚æžœãŸã—ã¦ãれるã®ã§ã€2ã¤ã®ã‚µã‚¤ãƒˆã‚’è¡Œãæ¥ã™ã‚‹é¢å€’ãã•ã•ãŒãªã„。Jav
1
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
Collins - Infrastructure Management for Engineers - Blake Matheny
Collins - Infrastructure Management for Engineers
{{#tags}}- {{label}}
{{/tags}}