CTO Night & Day 2016 winterã§ã®ã¢ã¼ãã³ã°ã»ãã·ã§ã³ã®è³æã§ãï¼Read less
Deleted articles cannot be recovered. Draft of this article would be also deleted. Are you sure you want to delete this article? è¿å¹´ãèªåã®ä¸ã§éè¨ï¼å¯è¦å㯠Fluentd(datacounter)+Growthforecast ã§å®çªåãã¦ãã¾ããã ããããããã¯ãã§æ°ãã«éè¨ï¼å¯è¦åã®è¦ä»¶ãåºã¦ãããã¨ã¨ã æè¿å¯è¦åãã¼ã«å¨ã㧠ãKibanaã£ã¦ãªãããï¼ããGraphiteã£ã¦ãªãããï¼ããInfluxDBã£ã¦ãªãããï¼ã ãªã©ããã®ãã¼ã«éã¯ä¸ä½ä½ãªãã ããâ¦ï¼ã¨ããã®ãåã ããæ°ã«ãªã£ã¦ãã¾ããã ä»åè¯ãæ©ä¼ãªã®ã§ â¯â¯ã¯ä½ããããã®ãªã®ãï¼ ã¨ããã®ãä¸ã¤ä¸ã¤èª¿ã¹ã¦ã¿ã¾ããã ããããã触ã£ã¦ã¿ãç³»ãã®è¨äºãªã®ã§ ã ãã¶æµ ãæãã§ãã 大å
ã¯ããã« AWSã®ElasticSearchã¯ä¾¿å©ã§ããããµã¼ãã管çããã«kibanaã¾ã§ä½¿ãã¡ããã¨ããå人ã¦ã¼ã¹ãªãç¡åå©ç¨æ ã§å®ç§ã§ããï¼ ã§ããåºæ¬çã«IPã¢ãã¬ã¹ãã¼ã¹ã®å¶å¾¡ããããããããªãã®ã§ãã©ããããã®ããªã¼ã¨æã£ã¦ããã®ã§ãnginxã§ãªããããç«ã¦ã¦ããã§Basicèªè¨¼ããããããªãããæ¤è¨ããã«è³ãã¾ããã ãã®è¨é²ã§ãã ãããããã¨/ãã£ãã㨠ä¸çªã¯IAMã¨ãã§kibanaã®GUIç»é¢ãã°ã¤ã³åã«AWSã®ãã°ã¤ã³ç»é¢ãåºã¦ããã°å®ç§ãªãã§ãããããã¯ã§ãããã«ãªãã®ã§ãä»æ¹ãªããªããããç«ã¦ã¦ããã§Basicèªè¨¼ãããããã¨ãèãã¾ããã ã¾ãã¯ããããªã³ã³ãã£ã°ãæ¸ãã¾ããã /etc/nginx/conf.d/reverse.conf server { server_name XXXXXX.ap-northeast-1.compute.amazonaws
Deleted articles cannot be recovered. Draft of this article would be also deleted. Are you sure you want to delete this article? ã¯ããã« Kibana4ã§ã¯Kibana3ããå ¨é¢çã«ã°ã©ãã®ä½ãæ¹ãå¤ãã£ã¦ããã®ã§ãã©ããªã°ã©ããä½ããã®ã ããï¼ã¨æã£ã¦è²ã ãã£ã¦ã¿ã. Kibana4èªä½ã®ã»ããã¢ãããå ¨ä½çãªä½¿ãæ¹ã¯ãã¡ãã®è¨äºã«ã¾ã¨ã¾ã£ã¦ãã. 以ä¸ã§ä½æããã°ã©ãã®ãã¼ã¿ã«ã¤ãã¦ãããã®è¨äºã®ä¸ã§å©ç¨ããã¦ãããã¹ããã¼ã¿harukasan/kibana-testdataã使ããã¦é ãã. Kibanaã¯ç¾æç¹ã§ã®ææ°çã§ããKibana4beta3ã使ç¨ãã. Kibana4ã«ãããVisualizeã®åºæ¬ 以ä¸ã®é çªã§Visualizeãè¡ã 対象ã¨
ã¯ããã« è¤æ¬ã§ãã æ¬æ¥ï¼ç¾å°æéã¯æ¨æ¥ï¼ãElasticã§å¤ãã®Productã®æ°ãã¼ã¸ã§ã³ããªãªã¼ã¹ããã¾ããã Elasticsearch 2.2.0, 2.1.2, and 1.7.5 released Kibana 4.4.0 is eye meltingly colorful Beats 1.1.0 & Winlogbeat released Logstash 2.2.0 and 2.1.2 released Elasticsearch for Apache Hadoop 2.2.0 and 2.1.3 released Elasticsearchã®Query Profile APIãKibanaã®Shield UI Plugin対å¿ãwinlogbeatã¨ããæ°ããBeatsããå 容çã沢山ã§ãï¼ ãã®ä¸ã§ä»åã¯Kibanaã®Shield UI Plugin対å¿ãæ©é試ãã¦
ååãåã åã¨OS 7ã«Fluentd (td-agent 2.3.0) + Elasticsearch 2.1.1 + Kibana 4.3.1 ãæ§ç¯ãã¦ãZaimã®å®¶è¨ç°¿ãã¼ã¿ãFluentdçµç±ã§Elasticsearchã«ç»é²ããã¨ããã¾ã§ãè¦ãã ä»åã¯ç¶ãã¨ãã¦ãElasticsearchã«ç»é²ãã家è¨ç°¿ãã¼ã¿ãKibana 4ã§å¯è¦åããã¨ãããããã Kibanaå¯è¦åã®æµã Kibanaãèµ·åãã¦ããç¶æ ã§ã以ä¸ã«ã¢ã¯ã»ã¹ããã http://vmdev:5601/ â»vmdevã¯Kibanaãèµ·åãã¦ãããµã¼ãã®ãã¹ã Kibanaã®ãã¼ã¸ãéãã¨ããã®ãããªç»é¢ãåºããã¡ãã¥ã¼ãã¼ã«ããé ç®ã®éããå¯è¦åã®æµãã¯ä»¥ä¸ã«ãªãã Settings : ã¤ã³ããã¯ã¹ãã¿ã¼ã³ãç»é²ãã Discover : ãã¼ã¿ãæ¤ç´¢ãã Visualize: æ¤ç´¢ãããã¼ã¿ãã°ã©ãåã
Ubuntu14.04ã«Elasticsearch 2.1ãã¤ã³ã¹ãã¼ã«ããæ¹æ³ã®åå¿é²ã§ãã Elasticsearchã¯Luceneãã¼ã¹ã®å ¨ææ¤ç´¢ã¨ã³ã¸ã³ã§ãã Elasticsearch | Elastic Elasticsearchã®åå¼·ãããããã«ã¤ã³ã¹ãã¼ã«ãã¦ã¿ã¾ããUbuntu14.04ã¯é©å½ãªVagrant boxãæ¢ãã¦ãã¦ç¨æãã¾ããã æ§æ Elasticsearch 2.1.1ã¯OracleãOpenJDKã®Java 8 update 20ã¾ãã¯Java 7 update 55ããæ°ãããã¼ã¸ã§ã³ã®JVMãå¿ è¦ã§ãã ä»åã¯OpenJDKã使ãã¾ãã Ubuntu 14.04 OpenJDK 1.8.0_72 Elasticsearch 2.1.1 OpenJDKãã¤ã³ã¹ãã¼ã« openjdk-8-jdkããã±ã¼ã¸ã®ã¤ã³ã¹ãã¼ã« OpenJDKã®ãªãã¸ããªã追å
ä»åã¯ãagent(1å°)ãelasticsearch + kinbana åå± (1å°)ã®2å°ã§æ§æãã¾ãã ã¯ã©ã¹ã¿ã¯ä»åã¯ä½¿ãã¾ããï¼(ãã¨ã§ãããã®ã§1å°æ§æã¯æ³¨æ) Logstashã¯ä»å使ããªãã£ãã®ã§ããã 訳ããã£ãã®ã§ãè¨ãã¦ããã¾ãã ãã°ãåå¨ãããµã¼ãã¼ã«Java8(JRE)ãå ¥ããå¿ è¦ããã£ã (å ¥ããããªãã£ããç°å¢ãã§ããã ãããããããªãã£ã) beatsããªããªã軽éã§ãJavaãå¿ è¦ç¡ãè¦ä»¶ãæºãããã æ¤è¨¼ãµã¼ãã¼ã®ã¤ã³ã¹ã¿ã³ã¹ãµã¤ãºãt2.microãã ã¨logstashå ¥ãã¦åããããããã³ã°ã¢ããããã»ã»ã»ã åéå ã§filterè¦ç´ 㧠logstash 使ãããã ã£ãããä»åã¯ããã¾ã§ã®è¦ä»¶ããªãã£ãã åæ§ã«filterè¦ä»¶ã§ã td-agent ãå ¥ãã¦ã¿ãããã¾ãelasticsearch5.0ã«ãã¼ã¿ãå ¥ããããªãã£ãã 注æç¹ kiba
æ¦è¦ macã«fluentd(td-agent)ãã¤ã³ã¹ãã¼ã«ããæé ã§ãã ç°å¢ OS X Yosemite(ãã¼ã¸ã§ã³10.10.5) fluentd-0.12.19(td-agent-2.3.0-0) ã¤ã³ã¹ãã¼ã«æé å ¬å¼ãµã¤ãããtd-agentã®dmgããã¦ã³ãã¼ã ææ°çã¯td-agent-2.3.0-0.dmgã§ããï¼2016/05/14æç¹ï¼ dmgããã«ã¯ãªãã¯ã§td-agent-2.3.0-0.pkgãã§ããã®ã§ã¤ã³ã¹ãã¼ã« å ¨ã¦ããã©ã«ãè¨å®ã§ã¤ã³ã¹ãã¼ã« td-agentã®èµ·åã»åæ¢ã³ãã³ã # èµ·å sudo launchctl load /Library/LaunchDaemons/td-agent.plist # åæ¢ sudo launchctl unload /Library/LaunchDaemons/td-agent.plist
ç¾å¨ããã°ãåéãåæããã·ã¹ãã ãæ§ç¯ãããã¨ããå ´åã«ããªã¼ãã³ã½ã¼ã¹ã®çµã¿åããã§ããã«å§ããããæ§æã¨ãã¦ã¯ããã«æãã¤ãã®ã¯ Fluentd + ElasticSearch + Kibana ã®æ§æã§ãã Webä¸ã®è¨äºãæ¸ç±ãå å®ãã¦ãã¾ãããæ¥æ¬ã«ãã¦ã¼ã¶ã¼ãå¤ãããªã®ã§å²ã¨å®å¿ãã¦å©ç¨ã§ããç°å¢ã§ãããã¨æããã¾ãã ãã®è¨äºã§ã¯ãFluendã«ãããã°åéãElasticSearchã«ä¿åãããããKibana 4ã§åæããç°å¢ã®æ§ç¯æé ã«ã¤ãã¦èª¿ã¹ãå 容ãã¾ã¨ãã¦ã¿ã¾ããã ä»å試ããã®ã¯ä»¥ä¸ã®ããã«ãApacheã®ã¢ã¯ã»ã¹ãã°ãtailãã¦ãFluentdã§åéãElasticSearchã«ä¿åãKibanaã§ãã°ã®æ¤ç´¢ãåæãè¡ãã·ã³ãã«ãªã·ã¹ãã æ§æã§ã Apacheã®ãã°ãåéãããµã¼ãã¼ããã³ElasticSearchãKibanaãã¤ã³ã¹ãã¼ã«ãããµã¼ãã¼ã¨
è¨å®ä¾ï¼Apacheã®ã¢ã¯ã»ã¹ãã°ãè¨é²ãã fluentdã®åºæ¬çãªè¨å®ä¾ã¨ãã¦ãã¾ãã¯Apacheã®ã¢ã¯ã»ã¹ãã°ãå¦çããä¾ãç´¹ä»ããããä»åã¯å ¥åãã©ã°ã¤ã³ã¨ãã¦ãin_tailãã使ç¨ããApacheãããã©ã«ãã§åºåãããã°ã¯ãã®ã¾ã¾æ®ããããã§fluentdã§ãã°ãè¨é²ãããã¨ã«ããã in_tailãã©ã°ã¤ã³ã¯ãæå®ããããã¹ããã¡ã¤ã«ãç£è¦ãããã¡ã¤ã«ã«æ°ããªè¡ã追å ãããããã®å 容ããã°ã¨ãã¦è¨é²ããã¨ããåä½ãããããªããããã¹ãå½¢å¼ã§ãã°ãè¨é²ããå ´åãlogrotateã¨ãããã¼ã«ã§ä¸å®æéãã¨ã«ãã°ãå¥ãã¡ã¤ã«ã«åãæ¿ãããããã°ãã¡ã¤ã«ãå§ç¸®ãããã¨ãã£ãä½æ¥ãè¡ããã¨ãå¤ãããin_tailãã©ã°ã¤ã³ã§ã¯logrotateãèæ ®ãããã¡ã¤ã«ç£è¦ãè¡ãããã«ãªã£ã¦ãããããlogrotateãå©ç¨ãã¦ããå ´åã§ãç¹ã«è¿½å ã®è¨å®ãªã©ãè¡ãå¿ è¦ã¯ãªãã ä»åã¯ã以ä¸
AWSãªã¼ãã¹ã±ã¼ã«ã®ã¹ã±ã¼ã«ã¤ã³æã«ãµã¼ãã¼å ã®ãã°ã®ååãåé¡ã«ãªã£ãããã¾ãã ãããªæã«ãfluentdãå°å ¥ãã¦ããã¨ä¾¿å©ã§ãããã æ°ã«ããããªã¼ãã¹ã±ã¼ã«ã§ã¹ã±ã¼ã«ã¤ã³ãå¯è½ã«ãªãã¾ãã ãã ããµã¼ãã¼ãä¹±åããã®ã§fluentdã§åéãããã°ãåããããããããã ãããªç®çã§ãfluentdè¨å®ãã¡ã¤ã«å ã§ç°å¢å¤æ°ãå©ç¨ã§ããªããã¨èª¿ã¹ã¾ããã fluentdè¨å®ã§å®ç¾ãããã㨠ã¨ã¼ã¸ã§ã³ãå´ã®fluentdã®è¨å®ãã¡ã¤ã«å ã§ãã¿ã°ã«ç°å¢å¤æ°ã使ç¨ãã³ã³ãã¥ã¼ã¿åãä»ãããã â» ãªã¼ãã¹ã±ã¼ã«ã§ãµã¼ãã¼æ¯ã«ã³ã³ãã¥ã¼ã¿åãå¤æ´ãããããªè¨å®ãããï¼Windowsã®å ´åã¯ãEC2configã®è¨å®ãå¿ è¦ï¼ ç°å¢ã»åææ¡ä»¶ AWSä¸ã®EC2ã§ããªã¼ãã¹ã±ã¼ã«ãå©ç¨ãfluentdã¨ã¼ã¸ã§ã³ãã¨ãªãä»åã®ãµã¼ãã¼ã¯ Windows Server 2012 R2 fluent
ç±³Linux Foundationã¯2016å¹´11æ8æ¥ï¼ç±³å½æéï¼ããã¼ã¿åéã®ãªã¼ãã³ã½ã¼ã¹ã½ããã¦ã¨ã¢ï¼OSSï¼ãFluentdãããCloud Native Computing Foundationï¼CNCFï¼ãã®ç®¡çããããã¸ã§ã¯ãã«ãªã£ãã¨çºè¡¨ãããFluentdã¯å¤æ©è²ä¹æ°ï¼åçï¼ãéçºãå§ããOSSã§ãç¾å¨ã¯ç±³Googleãç±³Microsoftã®ã¯ã©ã¦ãã®ä¸ã§ã使ããã¦ããã Linux Foundationåä¸ã®CNCFã¯ããDockerãã³ã³ãããéä¸ç®¡çããOSSãKubernetesãã®éçºã主å°ããå£ä½ãKubernetesã¯GoogleãéçºããOSSã ããGoogleã¯2015å¹´7æã«Kubernetesã®éçºãCNCFã«ç§»è¡ããã¨çºè¡¨ãã¦ãããCNCFã¯ç¾å¨ãKubernetesç¨ã®éç¨ç®¡çãã¼ã«ã§ãããOpenTracingãããPrometheusãã®é
ãªãªã¼ã¹ãé害æ å ±ãªã©ã®ãµã¼ãã¹ã®ãç¥ãã
ææ°ã®äººæ°ã¨ã³ããªã¼ã®é ä¿¡
å¦çãå®è¡ä¸ã§ã
j次ã®ããã¯ãã¼ã¯
kåã®ããã¯ãã¼ã¯
lãã¨ã§èªã
eã³ã¡ã³ãä¸è¦§ãéã
oãã¼ã¸ãéã
{{#tags}}- {{label}}
{{/tags}}