[B! fluentd] oonishinã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

oonishin id:oonishin

fluentdã«é–¢ã™ã‚‹oonishinã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (6)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Amazon Elasticsearch Serviceã‚’ä½¿ã£ãŸãƒã‚°åŽé›†åŸºç›¤ã®æ§‹æˆã‚’è€ƒãˆã¦ã¿ãŸ
ã‚¢ã‚¸ãƒ£ã‚¤ãƒ«é–‹ç™ºã«å–ã‚Šçµ„ã‚€ãƒãƒ¼ãƒ å‘ã‘ã®ã‚³ãƒ¼ãƒãƒ³ã‚°ã‚„ã€æŠ€è¡“é¡§å•ã€èªå®šã‚¹ã‚¯ãƒ©ãƒ ãƒžã‚¹ã‚¿ãƒ¼ç ”ä¿®ãªã©ã®å„ç¨®ãƒˆãƒ¬ãƒ¼ãƒ‹ãƒ³ã‚°ã‚’æä¾›ã—ã¦ã„ã¾ã™ã€‚ãœã²ãŠæ°—è»½ã«ã”ç›¸è«‡ãã ã•ã„ï¼ˆåˆå›žç›¸è«‡ç„¡æ–™ï¼‰ ã¿ãªã•ã‚“ã“ã‚“ã«ã¡ã¯ã€‚@ryuzeeã§ã™ã€‚ 6æœˆ10æ—¥ã«Amazon Web Servicesä¼æ¥å°Žå…¥ã‚¬ã‚¤ãƒ‰ãƒ–ãƒƒã‚¯ãŒç™ºå£²ã«ãªã£ã¦ã„ã¾ã™ã®ã§ã‚ˆã‚ã—ããŠé¡˜ã„ã—ã¾ã™ã€‚ ã•ã¦ä»Šå›žã¯AWSä¸Šã§ãƒã‚°åŽé›†ã¨åˆ†æžã‚’ã™ã‚‹éš›ã«ã€Amazon Elasticsearch Serviceã‚’ä½¿ã†å‰æã¨ã—ãŸå ´åˆã ã¨ã©ã®ã‚ˆã†ãªæ§‹æˆæ¡ˆãŒã‚ã‚Šãã†ã‹ã„ãã¤ã‹è€ƒãˆã¦ã¿ãŸã®ã§ã”ç´¹ä»‹ã—ã¾ã™ã€‚ ãªãŠã€æ¤œè¨Žã®ææ–™ã«ã—ã¦ã„ã‚‹å…¨ä½“ã®æ§‹æˆã¨ã—ã¦ã¯ã€è¤‡æ•°ã®VPC(ã¾ãŸã¯AWSã‚¢ã‚«ã‚¦ãƒ³ãƒˆ)ãŒã‚ã£ã¦ã€ã•ã‚‰ã«ã‚ªãƒ³ãƒ—ãƒ¬å´ã¨Direct Connectã‚„Internet VPNã§æŽ¥ç¶šã—ã¦ã„ã‚‹ã‚ˆã†ãªã€ã‚ˆãã‚ã‚‹ãã‚Œãªã‚Šã®è¦æ¨¡ã®æ§‹æˆã«ãªã‚Šã¾ã™ã€‚ å„VPCã®ä¸ã«ã¯è¤‡æ•°ã®ã‚µãƒ–ãƒãƒƒãƒˆãŒã‚ã‚Šã€ãã®ã†ã¡ã®
oonishin 2016/06/11
ElasticSearch

Amazon

aws

fluentd

log

ãƒã‚°
ãƒªãƒ³ã‚¯
Fluentd+Solr5.3ã§Javaã®GCãƒã‚°ã‚’åŽé›† - Qiita
æœ€è¿‘ã€Fluentd + ElasticSearch + Kibana ã‚’çµ„ã¿åˆã‚ã›ã¦ãƒã‚°ã®åŽé›†ãƒ»å¯è¦–åŒ–ã‚’ã‚„ã£ã¦ã„ã‚‹å–ã‚Šçµ„ã¿ã‚’ã‚ˆãè¦‹ã¾ã™ã€‚ ç§ã‚‚ã¡ã‚‡ã£ã¨è§¦ã£ã¦ã¿ãŸã„ãªãƒ¼ã¨æ€ã£ã¦ã„ãŸã®ã§ã™ãŒã€ElasticSearchã‚ˆã‚ŠSolrã®æ–¹ãŒã¾ã å°‘ã—ã¯çŸ¥ã£ã¦ã„ãŸã®ã§ã€Fluentd + Solr (å¯è¦–åŒ–éƒ¨åˆ†ã¯ã¾ãŸå¾Œæ—¥) ã‚„ã£ã¦ã¿ã¾ã—ãŸã€‚ Solrã¯ã€Apacheã ã‹ã‚‰(?)åŒã˜Apacheä»²é–“ã®Flumeã¨é€£æºã•ã›ã‚‹è¨˜äº‹ã¯ã‚ˆãè¦‹ã¾ã™ãŒã€Fluentdã¨ã®é€£æºã¯ã‚ã¾ã‚Šè¦‹ãªã„ã®ã§è‰²ã€…ä¸å®‰ã§ã—ãŸãŒã€Fluentdã®ãƒ—ãƒ©ã‚°ã‚¤ãƒ³ã‚’ä½œã£ã¦ãã ã•ã£ã¦ã„ã‚‹æ–¹ãŒã„ãŸã®ã§åŠ©ã‹ã‚Šã¾ã—ãŸã€‚ ç’°å¢ƒ CentOS 6.6 (32bit) Fluentd 0.12.15 ãƒ—ãƒ©ã‚°ã‚¤ãƒ³: fluent-plugin-out-solr 0.0.8 Apache Solr 5.3.1 Oracle JDK 8 Update 65 F
oonishin 2016/01/05
fluentd

Solr

GC

Log
ãƒªãƒ³ã‚¯
Fluentdã‹ã‚‰NSCA / Nagiosã«ã‚µãƒ¼ãƒ“ã‚¹ãƒã‚§ãƒƒã‚¯ã‚’é€ã‚‹ãƒ—ãƒ©ã‚°ã‚¤ãƒ³ã‚’æ›¸ãã¾ã—ãŸ - æ˜ ç”»ã¯ä¸åŠ‡
ã“ã®è¨˜äº‹ã¯Fluentd plugin to send NSCA / Nagios service checksã®æ—¥æœ¬èªžç‰ˆã§ã™ã€‚ Fluentdã‹ã‚‰NSCA / Nagiosã®ç›£è¦–ã‚µãƒ¼ãƒã«ã‚µãƒ¼ãƒ“ã‚¹ãƒã‚§ãƒƒã‚¯ã‚’é€ã‚‹ãƒ—ãƒ©ã‚°ã‚¤ãƒ³ã‚’æ›¸ãã¾ã—ãŸã€‚ã“ã®ãƒ—ãƒ©ã‚°ã‚¤ãƒ³ã‚’ä½¿ã£ã¦ã€Fluentdä¸Šã®ãƒã‚°ã®ç•°å¸¸ã«ã¤ã„ã¦ã€Nagiosã§é€šçŸ¥ã‚’ä¸Šã’ã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚ miyakawataku/fluent-plugin-nsca | GitHub fluent-plugin-nsca | RubyGems.org ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ« fluent-plugin-nscaã¨ã„ã†gemã‚’ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã—ã¦ãã ã•ã„ã€‚ ã“ã®ãƒ—ãƒ©ã‚°ã‚¤ãƒ³ã¯NSCAã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆã®Rubyå®Ÿè£…ã‚’ä½¿ã£ã¦ã„ã‚‹ãŸã‚ã€send_nscaã‚³ãƒžãƒ³ãƒ‰ã‚’ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã™ã‚‹å¿…è¦ã¯ã‚ã‚Šã¾ã›ã‚“ã€‚ ãƒ¦ãƒ¼ã‚¹ã‚±ãƒ¼ã‚¹: ã€Œã‚µãƒ¼ãƒã‚¨ãƒ©ãƒ¼å¤šã™ãŽã€ã‚¢ãƒ©ãƒ¼ãƒˆ æ¬¡ã®ç’°å¢ƒã‚’å‰æã—ã¾ã™ã€‚ ã€Œwebã€ã‚µãƒ¼
oonishin 2015/03/20
fluentd

log

Nagios
ãƒªãƒ³ã‚¯
Fluentd UIãŒå‡ºãŸã®ã§è§¦ã£ã¦ã¿ãŸ - ã™ãšã‘ã‚“ãƒ¡ãƒ¢
fluent/fluentd-ui https://github.com/fluent/fluentd-ui Fluentdç”¨ã®Web UIãŒå‡ºãŸã‚ˆã†ã§ã™ã€‚è©¦ã—ã«è§¦ã£ã¦ã¿ã¾ã™ã€‚ ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ« READMEã®ã¨ãŠã‚Šã§ã™ãŒã€ $ gem install fluentd-ui $ fluentd-ui start Open http://localhost:9292/ by your browser default account is username="admin" and password="changeme" ã‚‚ã—ãã¯ã€ $ git clone https://github.com/treasure-data/fluentd-ui $ cd fluentd-ui $ bundle install $ bundle exec rails s ã§ã™ã€‚ åƒ•ã¯bundlerã§ã„ã‚Œã‚‹ã“ã¨ã«ã—ã¾ã—ãŸ
oonishin 2014/08/02
fluentd

UI

ãƒã‚°
ãƒªãƒ³ã‚¯
BigQueryã«Twitterã®ã‚¿ã‚¤ãƒ ãƒ©ã‚¤ãƒ³ã‚’å…¥ã‚Œã‚‹ [Ruby]
Twitter ã®ã‚¿ã‚¤ãƒ ãƒ©ã‚¤ãƒ³ã‚’ä¿å˜ã—ã¦ãŠãã¨ãªã«ã‹ã¨ä¾¿åˆ©ãªã®ã§ã€è‰²ã€…ã¨ä¿å˜å½¢å¼ã‚’å¤‰ãˆãªãŒã‚‰ 4 å¹´ãã‚‰ã„è¨˜éŒ²ã—ç¶šã‘ã¦ã„ã‚‹ã€‚ãƒ„ã‚¤ãƒ¼ãƒˆã®ä¿å˜ãŒä¾¿åˆ©ã™ãŽã‚‹ã®ã§ã€ãƒ„ã‚¤ã‚»ãƒ¼ãƒ–ã¨ã„ã†ã‚µãƒ¼ãƒ“ã‚¹åŒ–ã¾ã§ã—ãŸã€‚ã‹ã¤ã¦ã¯ãƒ†ã‚ã‚¹ãƒˆã§ã€Mongo DB ã‚„ MySQL ã¨ã‹ Groonga ã¨ã‹ã„ã‚ã„ã‚ã‚„ã£ã¦ããŸã€‚ã©ã‚Œã‚‚å•é¡Œãªã„ã‚“ã ã‘ã©ã€å¢—ãˆç¶šã‘ã‚‹ãƒã‚°ãƒ‡ãƒ¼ã‚¿ã‚’ä¿å˜ã™ã‚‹å ´æ‰€ã¨ã—ã¦è€ƒãˆã‚‹ã¨ BigQuery ãŒç¾ä»£ã«ãƒžãƒƒãƒã—ã¦ã‚‹ã‚ˆã†ãªã®ã§ãã¡ã‚‰ã«ç§»è¡Œã—ãŸã€‚ BigQuery ã« TL ã‚’ä¿å˜ã™ã‚‹ã¨ã§ãã‚‹ã“ã¨ TL ã®å…¨ã¦ã®ãƒ‡ãƒ¼ã‚¿ã‚’ãƒ•ãƒ«ã‚¹ã‚ãƒ£ãƒ³ã§ãã‚‹ã€‚ã“ã‚Œã¯ã‹ãªã‚Šä¾¿åˆ©ã§ã€ä»Šå›žã“ã®ãƒ–ãƒã‚°è¨˜äº‹ã‚’æ›¸ãã«ã‚ãŸã£ã¦ã‚‚ â€˜BigQueryâ€™ ã‚’ TL ã‹ã‚‰æ¤œç´¢ã™ã‚Œã°ã€ä¿¡é ¼ã§ãã‚‹ãƒ•ã‚©ãƒãƒ¼ã‚¤ãƒ³ã‚°ã®äººã€…ã®å£°ã‚’è¦‹ã‚‹ã“ã¨ãŒã§ããŸã€‚ã“ã‚Œã«ã‚ˆã‚Šã€ŒæŸ CA ç¤¾ã§ã¯ 5000 å°ã® Mongo DB ã‚¯ãƒ©ã‚¹ã‚¿ã§ BigQuery ã«å¯¾æŠ—ã—ã¦ã„ã‚‹ã€ã¨ã„ã†
oonishin 2014/07/03
twitter

JSON

google

fluentd
ãƒªãƒ³ã‚¯
JMXã®ãƒ¡ãƒˆãƒªã‚¯ã‚¹ã‚’fluentdçµŒç”±ã§è“„ç©ã™ã‚‹ | nagaseyasuhito Daily works.
ã¿ãªã•ã‚“JMXã¯ä½¿ã£ã¦ã„ã¾ã™ã‹ï¼ŸJavaã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã®ãƒ¡ãƒ¢ãƒªä½¿ç”¨é‡ã‚’å§‹ã‚ã¨ã—ãŸçµ±è¨ˆæƒ…å ±ã‚’å–å¾—ã—ãŸã‚Šã§ãã‚‹ã€é‹ç”¨ã«ã¯æ¬ ã‹ã›ãªã„ãƒ¢ãƒ‹ã‚¿ãƒªãƒ³ã‚°ãƒ»ç®¡ç†ã®ä»•çµ„ã¿ã§ã™ãŒã€çµ±è¨ˆæƒ…å ±ã‚’è“„ç©ã™ã‚‹æ–¹æ³•ã«æ‚©ã‚“ã§ã„ã‚‹æ–¹ã‚‚å¤šã„ã®ã§ã¯ãªã„ã§ã—ã‚‡ã†ã‹ã€‚ ä»Šå›žã¯ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã‹ã‚‰å–å¾—ã§ãã‚‹æ§˜ã€…ãªçµ±è¨ˆæƒ…å ±ã‚’fluentdçµŒç”±ã§è“„ç©ã—ã€åˆ†æžã‚„ãƒˆãƒ©ãƒ–ãƒ«ã‚·ãƒ¥ãƒ¼ãƒˆã«æ´»ç”¨ã™ã‚‹æ–¹æ³•ã‚’ç´¹ä»‹ã—ã¾ã™ã€‚ JMXç”¨ã®fluentdãƒ—ãƒ©ã‚°ã‚¤ãƒ³ JMXã®çµ±è¨ˆæƒ…å ±ã‚’fluentdã§åŽé›†ã™ã‚‹fluent-plugin-jolokiaã¨ã„ã†ãƒ—ãƒ©ã‚°ã‚¤ãƒ³ã‚’ä½¿ã„ã¾ã™ã€‚ fluent-plugin-jmxã§ã¯ãªãfluent-plugin-jolokiaï¼Ÿã¨æ€ã‚ã‚Œã‚‹ã‹ã‚‚ã—ã‚Œã¾ã›ã‚“ã€‚ Jolokiaã¯JMXã‚’JSONãƒ™ãƒ¼ã‚¹ã®REST APIã¨ã—ã¦æä¾›ã™ã‚‹ãŸã‚ã®ã‚¨ãƒ¼ã‚¸ã‚§ãƒ³ãƒˆã§ã™ã€‚fluentdã®ãƒ—ãƒ©ã‚°ã‚¤ãƒ³ã¯Rubyã§æ›¸ã‹ã‚Œã¦ã„ã¾ã™ãŒã€Rubyã‹ã‚‰ç›´æŽ¥JMXã®ãƒ—
oonishin 2014/01/08
fluentd

jmx

Java
ãƒªãƒ³ã‚¯
1