Post by @instagram-engineering
As we mentioned in our previous blog, we’re big fans of tools and techniques for introspecting our live traffic to see what exactly is going on. One tool we use frequently is PGFouine, a query traffic analyzer for PostgreSQL. We recently found that we also needed a similar tool for Redis, our swiss-army-knife list/set/etc storage. We call it redis-faina and we're making it open source so you can u
redis導入後ã«ãƒˆãƒ©ãƒ–ル発生ã€ãã®ãƒ¬ãƒãƒ¼ãƒˆ
ã“ã‚“ã«ã¡ã‚ã€ãƒŸãƒ„ãƒãƒãƒ¯ãƒ¼ã‚¯ã‚¹ stoneã§ã™ã€‚ 今回ã¯ã€redisシリーズ第３弾ã€å®Ÿéš›ã«redisをサービスã®æŠ•å…¥ã—ã¦ã¿ã¦ã€ã†ã¾ãè¡Œã‹ãªã‹ã£ãŸäº‹ä¾‹ã«ã¤ã„ã¦ã”紹介ã—ã¾ã™ã€‚ redisã®ä½¿ç”¨ç”¨é€” 今回ã€ã„ãã¤ã‹ã‚るセッションデータã®ã†ã¡ï¼’ã¤ã‚’MySQLã‹ã‚‰redisã¸ç§»è¡Œã•ã›ã¾ã—ãŸã€‚ ã“れらã®ã‚»ãƒƒã‚·ãƒ§ãƒ³ãƒ‡ãƒ¼ã‚¿ã€MySQL上ã§ã¯ã€ã‚»ãƒƒã‚·ãƒ§ãƒ³IDã®ä»–ã«è¤‡æ•°ã®ã‚«ãƒ©ãƒ ã‹ã‚‰æ§‹æˆã•ã‚Œã¦ã„ã‚‹ã®ã§ã™ãŒã€redis上ã§ã¯ã€ã“ã®è¤‡æ•°ã®ã‚«ãƒ©ãƒ ã‚’serialize()ã—ã¦ã€ key(string) => value(string) ã¨ã„ã†å½¢ã§æ ¼ç´ã™ã‚‹ã‚ˆã†ã«ã—ã¾ã—ãŸã€‚ ã¡ã‚ƒã‚“ã¨ã‚½ãƒ¼ã‚¹ã‚³ãƒ¼ãƒ‰ã§ç¢ºèªã¯ã—ã¦ã„ãªã„ã®ã§ã™ãŒã€memcachedã§ã‚‚ã€TTLãŒè¨å®šã§ãã¾ã™ãŒã€TTLã‚’éŽãŽãŸãƒ‡ãƒ¼ã‚¿ã‚’監視ã—ã¦ã‚¯ãƒªã‚¢ã—ã¦ã„ãªã„ã§ã™ã‚ˆã。 ã¾ãŸã€memcached内部ã®slabã®æ§‹æˆæ¬¡ç¬¬ã§ã¯ã€TTLã¾ã§ãƒ‡ãƒ¼ã‚¿ãŒä¿æŒã•ã‚Œãšã«ã€ãƒ‡ãƒ¼ã‚¿ãŒã‚¯ãƒªã‚¢
redisã®ã‚µãƒ¼ãƒ“スã¸ã®æŠ•å…¥
ã“ã‚“ã«ã¡ã‚ã€ãƒŸãƒ„ãƒãƒãƒ¯ãƒ¼ã‚¯ã‚¹ stoneã§ã™ã€‚ 今回ã¯ã€å‰å›žã€ãƒ™ãƒ³ãƒãƒžãƒ¼ã‚¯ã‚’ã¨ã£ãŸredisをサービスã«æŠ•å…¥ã—ãŸã€ãã®æ–¹æ³•ã«ã¤ã„ã¦ã€ã”紹介ã—ã¾ã™ã€‚ 1 redisã®ã‚»ãƒƒãƒˆã‚¢ãƒƒãƒ— 1.1 redisをインストールredisã¯ã€2.0.2を使用ã—ã¾ã—ãŸã€‚ redisã®ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã¯ã€ # tar zxvf redis-2.0.2.tar.gz # cd redis-2.0.2 # make install ã§ã™ã‚“ãªã‚Šå‡ºæ¥ã¾ã—ãŸã€‚ コンパイルã•ã‚ŒãŸãƒã‚¤ãƒŠãƒªã¯ã€/usr/local/bin/以下ã«ã‚³ãƒ”ーã•ã‚Œã¦ã„ã¾ã™ã€‚ 1.2 コンフィグDECOLOGã§ã¯ã€Apacheã¨MySQLを除ã„ã¦ã€daemontoolsを利用ã—ã¦é‹ç”¨ã—ã¦ã„ã¾ã™ã€‚ ãã®ãŸã‚ã€redisã®ã‚³ãƒ³ãƒ•ã‚£ã‚°ã¯ã€ãƒ‡ãƒ•ã‚©ãƒ«ãƒˆã®redis.confã‹ã‚‰ã€ä»¥ä¸‹ã®é …目を修æ£ã—ã¦ã‚ã‚Šã¾ã™ã€‚ (デフォルトã®redis.confã¯ã€redis-2.0
Redis起動時ã®vm.overcommit_memoryè¦å‘Šå¯¾å¿œ
# WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect. 放置ã—ã¦ã„ãŸã®ã§ã™ãŒã€ã‚„ã¯ã‚Šæ°—æŒã¡ã®ã„ã„æ„Ÿã˜ã¯ã—ãªã„ã®ã§ã€å¯¾å¿œã—ã¦ã¿ã¾ã—ãŸã€‚ è¦å‘Šã®åŽŸå› エラーã®å†…容ã‹ã‚‰ 「/etc/sysctl.confã«vm.overcommit_memory = 1ã£ã¦ã„ã†è¨å®šã‚’è¿½åŠ ã—ã¦ã〠ã¨ã„ã†ã“ã¨ã¯ã‚ã‹ã‚‹ã®ã§ã™ãŒã€ã“ã®ãƒ‘ラメーターãŒä½•ã‚’æ„味ã™ã‚‹ã®ã‹èª¿ã¹ã¦ã¿
[NoSQL] Ohm (redis用ã®ORM) ã®ä½¿ã„æ–¹ - ヽ( ・∀・)ノãã¾ãã¾ãƒ¼ - s21g
redis ã¨ã¯ Cã§æ›¸ã‹ã‚ŒãŸè¶…高速ãªKVS オンメモリãªã®ã§è¶…高速 (ç´„10万件æ“作/秒 @Xeon 2.5Ghz) 定期的ã«è‡ªå‹•ä¿å˜ã™ã‚‹æ°¸ç¶šåŒ–機能 (memcached ã«å¯¾ã™ã‚‹åˆ©ç‚¹) æ–‡å—列以外ã«ã‚‚集åˆåž‹ã‚’扱ãˆã‚‹ (TokyoCabinet ã«å¯¾ã™ã‚‹åˆ©ç‚¹) å…¬å¼ http://code.google.com/p/redis/ ベンムhttp://code.google.com/p/redis/wiki/Benchmarks インストール 1 % gem install ohm セットアップ 1 require 'ohm' 2 Ohm.connect(:port=>6379) モデル 1 class Video < Ohm::Model 2 attribute :url 3 attribute :created_at 4 set :tags 5 6 index :ur
redisドã‚ュメント日本語訳 — redis 2.0.3 documentation
翻訳ã«ã¤ã„ã¦Â¶ ã“ã®ãƒ‰ã‚ュメントã¯ã€Redisã®Wiki(http://code.google.com/p/redis/wiki/)ã®å†…容をå‚考ã«ã—ãªãŒã‚‰ã€æ§‹æˆãªã©ã¯Sphinxã«åˆã‚ã›ã¤ã¤ç¿»è¨³ã—ã¦ã„ã¾ã™ã€‚ã¾ãŸã€å¿…è¦ã«å¿œã˜ã¦ã€é…布物ã®ä¸ã®ãƒ•ã‚¡ã‚¤ãƒ«ãªã©ã‚‚引用ã—ãªãŒã‚‰è¨³ã—ã¦ã„ã¾ã™ã€‚
Railsã®initializerã§Redisã«æŽ¥ç¶šã™ã‚‹æ™‚ã¯å¿…ãšæœ€åˆã«$redis.pingã™ã‚‹
Railsã§redis-rbを使ã£ã¦Redisã«æŽ¥ç¶šã™ã‚‹ã‚¢ãƒ—ãƒªã‚’ä½œã‚‹å ´åˆã€Railsアプリã®åˆæœŸåŒ–時ã«Redisã«æŽ¥ç¶šã‚’è¡Œã†ã“ã¨ãŒå¤šã„ã¨æ€ã„ã¾ã™ã€‚/app/config/initializers/redis.rbã®ã‚ˆã†ãªãƒ•ã‚¡ã‚¤ãƒ«ã®ä¸ã§$redis = Redis.newã«ã‚ˆã‚ŠæŽ¥ç¶šã‚’準備ã—ã¾ã™ãŒã€Redis.newã¯Redisクラスã®ã‚ªãƒ–ジェクトを作æˆã™ã‚‹ã ã‘ãªã®ã§ã€ä»®ã«æŽ¥ç¶šã®ãŸã‚ã®è¨å®šã«èª¤ã‚ŠãŒã‚ã£ãŸã‚ŠRedisã®ã‚µãƒ¼ãƒãƒ¼è‡ªä½“ãŒèµ·å‹•ã—ã¦ã„ãªãã¦ã‚‚例外ã«ãªã‚Šã¾ã›ã‚“。ã™ã‚‹ã¨ã€Railsã®ã‚¢ãƒ—リ本体ã®ã‚³ãƒ¼ãƒ‰ã®ã©ã“ã‹ã§å¾Œã«$redisを使ã£ã¦DBã¸ã®æŽ¥ç¶šã‚„pub/subãªã©ã‚’è¡Œã£ãŸæ™‚点ã§çªç„¶ä¾‹å¤–ãŒç™ºç”Ÿã™ã‚‹ã“ã¨ã«ãªã‚Šã¾ã™ã€‚ã“ã®ã‚ˆã†ãªäº‹æ…‹ã‚’é¿ã‘ã‚‹ãŸã‚ã«ã¯ã€/app/config/initializers/redis.rbã®ä¸ã§$redis = Redis.newã‚’è¡Œã£ãŸç›´å¾Œã«$redis.pingを実行
NAMAKESUGI | [Rails][éžåŒæœŸå‡¦ç†]Resqueã‚’ã¯ã˜ã‚ã‚‹ ãã®1 (Redisã®ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«)
Flexã‚„Ruby on Railsãªã©ã§ä½¿ã„æ–¹ã¨ã‹ã‚’自分ãŒå¾Œã§ã‚ã‹ã‚‹ã‚ˆã†ã«ãƒ¡ãƒ¢ã—ã¦ãŠãブãƒã‚°ã€‚最近ã¯Flexç³»ã«é£½ãã¦ã¾ã™ã€‚ Railsã®éžåŒæœŸå‡¦ç† Resque 導入編(Redisã®æ‰‹å‹•ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«) Resqueã¨DelayedJobã®é•ã„ DelayedJob㯠MySQLç‰ã®RDBã«éžåŒæœŸå‡¦ç†ã™ã‚‹ãŸã‚ã®ãƒ‡ãƒ¼ã‚¿ã‚’永続化ã—ã¾ã™ Resque㯠Redisã¨ã„ã†NoSQLã«ãƒ‡ãƒ¼ã‚¿ã‚’永続化ã—ã¾ã™ Redisã¯memcachedã®ã‚ˆã†ãªã‚¤ãƒ³ãƒ¡ãƒ¢ãƒªDBã§ã™ãŒã€ãƒ‡ãƒ¼ã‚¿ã®æ°¸ç¶šåŒ–機能(メモリã«ä¹—り切らãªã„データをディスクã«ä¿å˜ã™ã‚‹(SSD推奨)ã€å®šæœŸçš„ã«ãƒ¡ãƒ¢ãƒªä¸Šã®ãƒ‡ãƒ¼ã‚¿ã‚’ディスクã«ä¿å˜ã™ã‚‹ãªã©)ã‚’ã‚‚ã£ã¦ã„ã¾ã™ 基本的ã«è¶…高速ã«å‡¦ç†ã—ãŸã„å ´åˆã«åˆ©ç”¨ã™ã‚‹æ„Ÿã˜ ãªãŠã€ãƒ‡ãƒ¼ã‚¿ã®å®‰å…¨æ€§(ã‚る程度ã¯ãƒ‡ã‚£ã‚¹ã‚¯ã‚ャッシュã™ã‚‹ã‘ã©(ã—ãªã„よã†ã«ã‚‚ã§ãã‚‹ã‘ã©))ã¯ã‚¯ãƒ©ã‚¹ã‚¿çµ„ã¾ãªã„ã¨ç„¡ç†ãªã®ã§æ³¨æ„(ãã®ç‚¹Delayed
1
メンテナンス
ランã‚ング
ランã‚ング
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
nuggets/redisutils.py at master · mozilla/nuggets
http://rediscookbook.org/index.html
ãƒã‚°è§£æžã‚’支ãˆã‚‹NoSQLã®æŠ€è¡“
http://jimneath.org/2011/03/24/using-redis-with-ruby-on-rails.html
{{#tags}}- {{label}}
{{/tags}}