monitoring
追è¨ï¼2015/08/14ï¼ Docker 1.8 ã®ãªãªã¼ã¹ã«å«ã¾ãã¦ãã追å ä»æ§ ã«ãã dd-agent ãããã¹ãå´ cgroup ã®ãã¦ã³ããã¤ã³ããè¦ããªãç¶æ ãçºçãã¦ããããã ã [docker] Add support for Docker 1.8 · DataDog/[email protected] æ¢ã«ä¸è¨ã«ã¦â¦
ã¯ããã« Datadog ã«ã¯ã¢ãã¿ãªã³ã°ãã¦ããã¡ããªã¯ã¹ã«å¯¾ãã¦ãè¨å®ãããããå¤ã§éç¥ãé£ã°ã Monitor ã¨ããæ©è½ãåãã£ã¦ããã Datadog Docs - Monitoræ©è½ã®è¨å®ã¬ã¤ã ãã® Monitor ã®è¨å®ã¯ WebUI åã¯æä¾ããã API çµç±ã§è¨å®ãè¡ããã¨ãåºæ¥â¦
ã¯ããã« ååã®è¨äºãæ¸ãã¦ããå¹¾ã¤ããã¼ã¸ã§ã³ã¢ãããã¦ã¿ãï½ ä¿ºã®ããã·ã¥ãã¼ã 俺ã®ããã·ã¥ãã¼ã å¤æ´ç¹ æ¦è¦ ãã¶ã¤ã³ãå¤ãã¦ã¿ã ã¡ããªã¯ã¹ã°ã©ãã modal 表示ã«ãã¦ã¿ã ç»é¢ï¼overviewï¼ ç»é¢ï¼ã¡ããªã¯ã¹ï¼ 以ä¸ã®ãã㪠HTML ã§å®ç¾ãã¦â¦
ã¯ãã㫠以åã«ä½ã£ãããã§ãã£ããæ¾ç½®ç¶æ ã ã£ãããæ¾ç½®ããã«ããã¾ãã«ãæ¥ããããç¶æ ã ã£ãã®ã§åºæ¥ãç¯å²ã§ä¿®æ£ã¨æ©è½è¿½å ããã¦ã¿ãã 俺ã®ããã·ã¥ãã¼ã 俺ã®ããã·ã¥ãã¼ã 俺ã®ãã¬ã³ãã¨ã俺ã®ã¤ã¿ãªã¢ã³ã¨ãã«ã¤ã³ã¹ãã¤ã¤ããã訳ã§ã¯ãâ¦
ã©ããããã£ã±ã§ãã è¿½è¨ Grafana ãæåã§ããããããã£ããããã ã£ãã®ã§ Scripted-dashboard ã試ãã¦ã¿ãã ã¯ãã㫠以åã« td-agent ã® monitor_agent ãå©ç¨ãã¦ãããªãã¨ããã£ã¦ãããã¨ãè¨äºããã¤ã¼ããã¦é ããããã§ãã¦... ãã£ãã / ââ¦
æ±äº¬ãããã¯ãããããã¾ãããã£ã±ã§ãã ã¯ããã« Graphite ã¯è¦æã ã£ãã®ã§ã¡ãã£ã¨å æãããã¦æ¸ãã ã»ããµã ã«æ¸ããã ã¡ãã£ã¨ã ã解ã£ãæ°ã«ãªã Graphite 㨠Grafana
竹å¯å³¶ããããã°ããããã£ã±ã§ãã ã¯ããã« Graphite 㨠Grafana ã 1 æéä½ä½¿ã£ã¦ã¿ã ã©ã¡ãã¨ãã»ããã¢ããã¯ç°¡åï¼ä½ããDockerfile ä½ãã®ã¯è¦å´ããï¼ åè dstat + fluentd + Graphite + Grafana ã§ãµã¼ãã¢ãã¿ãªã³ã°ãã ç°å¢ Graphite ã¯ãã¡â¦
丸ä¸æ¥ä»¥ä¸ããã£ã¦ Graphite ãåã Dockerfile ãä½ã£ã¦æ°ä»ãããã¨ã¨ãã¡ã¢
ã¯ãã㫠軽ãæ°æã¡ã§ã¯ããããã®ã®ä¸¸ä¸æ¥ä»¥ä¸ã©ãããã㦠Graphite ãåã Dockerfile ãä½ã£ã¦æ°ä»ãããã¨ã¨ãã¡ã¢ã åè django-admin.py 㨠manage.py Django ã§ã®ã¦ã¼ã¶èªè¨¼ ã¡ã¢ã¨åºæ¥ããã® ã¡ã¢ 丸ä¸æ¥ä»¥ä¸ããã£ã¦ Graphite ãåã Dockerfileâ¦
cloudwatch-agent ã¨ãããã¼ã«ãä½ã£ãã®ã§ cloudwatch-agent-chef ã¨ããã®ãä½ã£ã
ã¯ããã« cloudwatch-agent ã¨ãããã¼ã«ãååä½ã£ãã®ã§ãå¢ã㧠cloudwatch-agent-chef ã¨ããã®ãä½ã£ã¦ã¿ãã åè AWSã®CloudWatchã§ã«ã¹ã¿ã ã¡ããªãã¯ã¹ã使ç¨ãã Chefãããåªçæ§ããLWRPã®ä½ãæ¹ãã¾ã¨ãã¾ãã å®è·µLWRPãHTTPèªè¨¼ç¨ãã¡ã¤ã«(htâ¦
è¿½è¨ ãªãã¸ããªã®ååã以ä¸ã®éãã«å¤ããã®ã¨ååã®ã¿ Alarm è¨å®ãåºæ¥ãããã«ãã¦ã¿ãã cloudwatch-agent ä¸è¨ãã¤ã³ã¹ã¿ã³ã¹ä¸ã«ãã Chef ã® Cookbook ãå¾ããã¢ããããäºå®ã ä½çªç ãï¼ ã解ããªããããã ãå¿ è¦ã«è¿«ããã¦ã¤ã³ã¹ã¿ã³ã¹ãªã½ã¼â¦
Focuslight ã試ã + eye ã§ããã»ã¹ç£è¦ãã¦ã¿ã memo eye ã§ããã»ã¹ç£è¦ããã¨ããã¯æå¾ éãã«åä½ããããã¨ãåºæ¥ãªãã£ããã©ã¨ããããã¡ã¢ã Focuslight ã試ã + eye ã§ããã»ã¹ç£è¦ãã¦ã¿ã unicorn ã®ããã»ã¹ã¯ç£è¦ãããã¨ãã§ãããã ãã©ãªâ¦
ã¯ããã« ãã¯ãä½çªç ãã解ããªããã©ãã£ã¦ããããã£ãã®ã§ ãã ãã¾æ¤è¨¼ãä½æ¥ä¸ åè sensu/sensu-chef Sensuå°å ¥ã¨åæè¨å®ã«ã¤ã㦠Sensu Serverãã¤ã³ã¹ãã¼ã«ããæé ã¡ã¢ CentOS6ã«Sensuãã¤ã³ã¹ãã¼ã«ãã Sensu-chef ã§ç£è¦ã·ã¹ãã Sensu ã管â¦
ã¡ã¢ mackerel 㧠sensu ã®ãã©ã°ã¤ã³ã§ã«ã¹ã¿ã ã¡ããªã¯ã¹ãé£ã°ãã¦ã¿ã ã»ããµãã«ãå¾ã§æ¸ã ç°å¢ Docker ã³ã³ãã CentOS 6.5 Debian Wheezy Ruby Ruby 2.1.2 ã½ã¼ã¹ã³ã¼ãããã³ã³ãã¤ã«ãã Sensu ãã©ã°ã¤ã³ vmstat-metrics.rb è¨å® ç°¡åã sensu-plâ¦
æè¿ã®ãã¥ã¦ã£ã¼ã Sensu ã«ã¤ã㦠ç£è¦ã·ã¹ãã ãSensuã«å·æ°ãã https://t.co/iOcE31V9PMâ Yohei Kawaharaï¼ãã£ã±ï¼ (@inokara) 2014, 5æ 8 mon ã¨ããç£è¦ãã¼ã«ã Sensu ã«ç½®ãæããæ¹ã®ããã°ã詳ããã bash ã®ãã¹ããã¬ã¼ã ã¯ã¼ã¯ Shell Scriptâ¦
ç¶ã åå㯠sensu server ã®ãã°ã fluentd â norikra ã§çºãã¦ã¿ã ä»å㯠sensu ã®ç£è¦ã¤ãã³ãã fluentd ãã³ãã©ãã©ã°ã¤ã³ãã norikra ã¨ããæµããä½ã£ã¦ã¿ã åååæ§ã« sensu ã®ãããã°ããªã¢ã«ã¿ã¤ã ãªã¤ãã³ãç£è¦çã«å¿ç¨åºæ¥ããã㪠æºå sâ¦
è¿½è¨ è¿½è¨ï¼1ï¼Failed: Incorrect syntax near 'output' (a reserved keyword) ã®ã¨ã©ã¼ ãã¡ããåèã«ãªã£ã esper ã®äºç´èªã®ããã§ã㪠ã¯ããã« ã¿ã¤ãã«éã sensu server ãæ¤è¨¼ããããããã°ããã©ãã©è¦ãããå¬ãããã ããããã£ãããã°ã¾ã§ãâ¦
ã©ãããç¡æ²æ±°ãã¦ã¾ãèªç§° sensu è¸äººã®ãã£ã±ã§ãã ã¯ããã« sensu ã® Mutators ã試ãã¦ããªãã£ãã®ã§ã¾ãã¯ããã¥ã¡ã³ããè¦ããè¦çä¼¼ã§è©¦ã Mutators ã¨ã¯ï¼ ãã£ããè¨ãã¨... ç£è¦ã¤ãã³ãããã³ãã©ã«æ¸¡ãåã«ã¤ãã³ããã¼ã¿ã«æãå ããå¦ç ã¤â¦
ã¯ããã« im.kayac 㧠iPhone ã® push éç¥ãå§ããã¾ã§ã®ç°¡åãªæé ã¤ãã§ã« sensu ã®éç¥ãã©ã°ã¤ã³ãä½ã£ã¦ã¿ã æé ãã¡ãã§ã¢ã«ã¦ã³ãä½æ Apple Store ã§ã¢ããªããã¦ã³ãã¼ã ã¢ããªã§ãã°ã¤ã³è¨å® ã³ãã³ãã©ã¤ã³ãã im.kayac.com ã«å¯¾ãã¦curl â¦
ã¯ããã« Sensu ã® RabbitMQ ã¨ã Sensu API ã ELB çµç±ã§å©ç¨ããã«ããã£ã¦ãããããã£ã±ãã°è¦ãããããã£ã¦ãã¨ã§ ELB ã®ãã°ã fluent-plugin-elb-log ãä»ã㦠Elasticsearch + kibana ã®ã´ã¼ã«ãã³ã³ã³ãï¼å½ç¤¾æ¯ï¼ã§è¦ã¦ã¿ããã¨ã«ããã åè shâ¦
ãããã ElasticCache for Redis ã¨ããå¼ã³æ¹ãåã£ã¦ããã®ã解ããªãããã¯ãã§ããã©ããã ã¯ããã« sensu ã AWS ã§éç¨ãããã¨ããå ´åã« sensu ãå©ç¨ããå種ãã¼ã«ã AWS ã®åãµã¼ãã¹ã§ç½®ãæããããªããã¨æã£ãã®ã§è©¦ã ã¾ãã¯ï¼ã¨ããããâ¦
ã¯ããã« ååãæ°ã«ãªã£ããã¤ã³ãã®æ¤è¨¼ã¨æ´ç æ°ã«ãªã£ããã¤ã³ã sensu-server ã®è¨å®ã§ RabbitMQ ã®æ¥ç¶å ã ELB ã«æå®ããå ´åã£ã¦ã©ããªãã®ï¼ Redis ãã¯ã©ã¹ã¿åããå¿ è¦ãããï¼ ãªã«ã¯ã¨ããããã£ã¦ã¿ãã sensu-server ã®è¨å®ã§ RabbitMQ ã®æ¥â¦
èªç§° sensu è¸äººè¦ç¿ãã®ãã£ã±ã§ãããã¯ãããããã¾ãã ã¯ããã« ãã¡ãã§é ãã質åãæ©é試ãã ã¾ãã¯è©¦ããã ã æ§æ 以ä¸ã®ãããªã¤ã¡ã¼ã¸å³ Cacoo ãµã¤ã³ã¼ã è¨å®ã¢ã¬ã³ã¬ sensu ã®ã¤ã³ã¹ãã¼ã« å²æ å°ã以ä¸ã¯æ¢ã« sensu 㨠sensu ã稼åããçºâ¦
ã¯ããã« ãã¡å ã§ç³ãè¾¼ãã§ãããè£æ¬ ããç¹°ãä¸ãã£ã¦ãã¦å°èºãããªããåå ãã ä¼å ´ãæä¾ãã¦é ãã DeNA ããï¼ç´ æµãªå¤æ¯ã§ããï¼ãããã¨ããããã¾ããï¼ ç»å£ãããçããããããã¨ããããã¾ããï¼ ä»¥ä¸ãç®æ¡æ¸ã åèãªã³ã¯ 2014/03/25 Immuâ¦
ã¯ããã« ä¸é£ã® sensu é¢é£ã®è¨äºããã£ããã¾ã¨ããã æ§æ æ§æå³ ç¾å¨ã®æ§æããã£ããæ¸ãã¨ä»¥ä¸ã®ãããªæ§æã 使ã£ã¦ããæè¡ sensuï¼Redis ã RabbitMQ ãå«ãï¼ AWS ã® SNSï¼éç¥ï¼ Elasticsearch 㨠kibanaï¼ã¤ãã³ãæ å ±ã®åéãã¡ããªã¯ã¹ã®åéâ¦
ã¯ããã« ååã®ã¤ãã§ã§ã¡ããªã¯ã¹ã Elasticsearch ã«çªã£è¾¼ã handler ãä½ã£ã¦ã¿ã 決ã㦠Graphite ã諦ããããã§ã¯ããã¾ããã... 試ããç°å¢ã¯ Amazon Linux ã§ã [追è¨]ãã¡ããªã¯ã¹ãã¼ã¿ãã¨ããè¨èã«éåæãã£ãã®ã§ãã¡ããªã¯ã¹ãã«ç´ãã*1â¦
ã¯ããã« handler ã®åå¼·ãå ¼ãã¦ã¤ãã³ããã¼ã¿ã Elasticserch ã«æ¾ãè¾¼ããã³ãã©ã¹ã¯ãªãããæ¸ãã¦ã¿ã åè sensu-community-plugins / handlers / notification / fluentd.rb ã³ã¼ã github ã«ã¢ãããã ãã¡ã åè @repeatedlyãããä½ããããã¡â¦
ãã¯ãããããã¾ããèªç§° sensu è¸äººã®å·åã§ãã ã¯ããã« å¼ãç¶ããsensu ã«ã¤ãã¦æ å ±åéã¨æ å ±ã®æ´çãè¡ã£ã¦ããã®ã§ã¡ã¢ãåååæ§ããã¥ã¡ã³ããã¡ããã¨èªãã°å¤§æ¦ã®äºã¯è§£ãã¾ãã Metrics 㨠Notification ã«ããã checks 㨠handlers ã®æ´ç â¦
ãã¯ãããããã¾ããèªç§° sensu è¸äººã®å·åã§ãã ã¯ããã« sensu ãã¡ãã£ã¨ãã¤å¼ãå§ãã¦è²ã ã¨æ°ã¥ãããã£ããããã©ãã£ããããã®ã§ã¡ã¢ã£ã¦ãããä½ããä¸èº«èªèº«ã¯ã¡ããã¨ããã¥ã¡ã³ããèªãã°å¤§ãããã¨ã¯ç¡ããã®ã°ããã ã¨æãã åè http://sâ¦
ãã¯ãããããã¾ãã ã¯ããã« sensu 㨠Graphite ã®é£æºã«ã¤ãã¦ã¯å¼ãç¶ãã§è¿½ãã¨ãã¦...sensu ã«ã¦ç°å¸¸ãæ¤ç¥ããå ´åã« handler ãã©ã°ã¤ã³ã§ AWS ã® SNS ãå©ç¨ãããã©ã°ã¤ã³ãããã®ã§ãã¡ããå©ç¨ããã¦é ãã¦éç¥ãé£ã°ãã¦ã¿ãããªã¨æã£ã¦è©¦ãâ¦
ã¯ããã« èªåã§ãæ´çãåºæ¥ã¦ããªããã¨ããããã®ã¡ã¢ æ¤è¨¼ã®ç°å¢ã¯ Amazon Linux åè ã¢ãã«ã¸äº¬é½ã«åå ãã¦ãSensuã¨Graphiteã®è©±ããã¾ãã #monitoringcasual graphiteã®ã¤ã³ã¹ãã¼ã« Graphite ãã¨ããããã¯ããã Graphite ã£ã¦ï¼ ãã¡ããåèâ¦