Burrow: Kafka Consumer Monitoring Reinvented
One of the responsibilities of the Data Infrastructure SRE team is to monitor the Apache Kafka infrastructure, the core pipeline for much of LinkedIn's data, in the most effective way to ensure 100% availability. We have recently developed a new method for monitoring Kafka consumers that we are pleased to release as an open source project - Burrow. Named after Franz Kafka's unfinished short story,
How to Monitor Kafka - Server Density Blog
By David Mytton, CEO & Founder of Server Density. Published on the 19th January, 2016. Distributed systems and microservices are all the rage these days, and Apache Kafka seems to be getting most of that attention. Here at Server Density we use it as part of our payloads processing (see: Tech chat: processing billions of events a day with Kafka, Zookeeper and Storm). For the uninitiated, Kafka is
Redisã®ç›£è¦–/分æžç³»ãƒ„ールã¾ã¨ã‚ « Rest Term
Redis関連ã®ç›£è¦–/データ分æžç³»ãƒ„ールã«ã¤ã„ã¦ãƒ¡ãƒ¢ã—ã¦ãŠãã¾ã™ã€‚ éšæ™‚追記予定。実務ã§æœ‰ç”¨ãªãƒ„ールãŒä»–ã«ã‚ã‚Šã¾ã—ãŸã‚‰æ•™ãˆã¦ã„ãŸã ã‘ã‚‹ã¨å¬‰ã—ã„ã§ã™ã€‚ 環境 CentOS 5.9, Ubuntu 12.04 (x86_64) Redis 2.6.10 (※ CentOSã®6.xç³»ã¸ã®ç§»è¡Œã¯è¶³è¸ã¿çŠ¶æ…‹ã€‚相当大変ã§ã™ã‚ˆã。。) 以下ã®é †ã«ç´¹ä»‹ã—ã¦ã„ãã¾ã™ã€‚ Redisコマンド Redis Sentinel Redis Live Redis Faina Redis Sampler redis-top Nagiosプラグイン Zabbixテンプレート Muninプラグイン Cactiプラグイン 最後ã®Cactiプラグイン以外ã¯å®Ÿéš›ã«å°Žå…¥ã—ã¦è©¦ã—ã¦ã¿ã¾ã—ãŸã€‚以é™ã€è¦‹å‡ºã—ã«å„プãƒãƒ€ã‚¯ãƒˆã¸ã®ãƒªãƒ³ã‚¯ã‚’è²¼ã£ã¦ãŠãã¾ã™ã€‚ Redisコマンド ツール紹介ã®å‰ã«ã¾ãšã¯åŸºæœ¬ã‹ã‚‰ã€‚Redisã«ã¯ç›£è¦–やデータ解æžç”¨é€”ã§ä½¿
クックパッドã«ãŠã‘るサーãƒç›£è¦–ã¨é‹ç”¨ã®å·¥å¤« - クックパッド開発者ブãƒã‚°
ã“ã‚“ã«ã¡ã¯ã€‚インフラストラクãƒãƒ£ãƒ¼éƒ¨ã®åŠ è—¤(@EugeneK)ã§ã™ã€‚ 今回ã¯Webサービスをé‹ç”¨ã™ã‚‹ä¸Šã§æ¬ ã‹ã›ãªã„ã€ãƒ¢ãƒ‹ã‚¿ãƒªãƒ³ã‚°ã‚’クックパッドã§ã©ã†ã—ã¦ã„ã‚‹ã‹ã¨ã„ã†è©±ã‚’ã—ã¾ã™ã€‚ æ»æ´»ç›£è¦–ã¨æ€§èƒ½ç›£è¦– Webサービスをé‹ç”¨ã—ã¦ã„る以上ã€ãã®ã‚µãƒ¼ãƒ“スを稼åƒã—ã¦ã„るサーãƒãŒã‚ã‚Šã€ã‚µãƒ¼ãƒã«ã¯æ•…障やトラブルãŒç™ºç”Ÿã—ã¾ã™ã€‚ ã¾ãŸã€ã©ã‚Œãらã„ã®ãƒ‘フォーマンスãŒå‡ºã¦ã„ã‚‹ã‹ã€ãƒªã‚½ãƒ¼ã‚¹ã‚’ã©ã®ãらã„消費ã—ã¦ã„ã‚‹ã‹ãªã©ã®ãƒˆãƒ¬ãƒ³ãƒ‰ã‚’把æ¡ã™ã‚‹ã“ã¨ã¯ã€æˆé•·ã™ã‚‹ã‚µãƒ¼ãƒ“スを支ãˆã¦ã„ã上ã§æ¬ ã‹ã›ã¾ã›ã‚“。 故障やトラブルã«ã„ã¡æ—©ãæ°—ã¥ããŸã‚ã®ä»•çµ„ã¿ã‚’æ»æ´»ç›£è¦–ã¨è¨€ã„ã¾ã™ã€‚ ã¾ãŸã€ã‚µãƒ¼ãƒãƒªã‚½ãƒ¼ã‚¹ã®æ™‚系列ã§ã®æŽ¨ç§»ã‚’知るãŸã‚ã«ã€ã‚°ãƒ©ãƒ•ã¨ã—ã¦ãƒˆãƒ¬ãƒ³ãƒ‰ã‚’å¯è¦–化ã™ã‚‹ä»•çµ„ã¿ã‚’性能監視ã¨è¨€ã„ã¾ã™ã€‚ ãƒãƒ¼ãƒªãƒ³ã‚°ç›£è¦–ã®é™ç•Œã¨Zabbixã®ã‚¢ã‚¯ãƒ†ã‚£ãƒ–監視 クックパッドã§ã¯æ»æ´»ç›£è¦–ã«Nagiosã€æ€§èƒ½ç›£è¦–ã«Muninを使用ã—ã¦ãã¾ã—ãŸãŒã€ã‚µãƒ¼ãƒå°æ•°ã®å¢—åŠ
1
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
{{#tags}}- {{label}}
{{/tags}}