[B! td-agent] T-miuraã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

T-miura id:T-miura

td-agentã«é–¢ã™ã‚‹T-miuraã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (5)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Fluentdã‹ã‚‰#SORACOM FunnelçµŒç”±ã§Amazon Kinesis Firehoseã«ãƒã‚°ã‚’é€ä¿¡ã™ã‚‹ | DevelopersIO
ã©ã‚‚ã€å¤§ç€§ã§ã™ã€‚ SORACOMã‹ã‚‰ç™ºè¡¨ã•ã‚ŒãŸæ–°ã‚µãƒ¼ãƒ“ã‚¹Funnelã¯ã€IoTãƒ‡ãƒã‚¤ã‚¹ã®é€šä¿¡ã‚’ãƒãƒƒã‚¯ã‚¨ãƒ³ãƒ‰ã®ã‚¯ãƒ©ã‚¦ãƒ‰ã‚µãƒ¼ãƒ“ã‚¹ã«è»¢é€ã—ã¾ã™ã€‚ä»Šå›žã¯ã€IoTãƒ‡ãƒã‚¤ã‚¹ã‹ã‚‰ã®é€šä¿¡ã¨ã—ã¦ã€Fluentd(td-agent)ã‹ã‚‰Kinesis Firehoseã¸ã®è»¢é€ã‚’è©¦ã—ã¦ã¿ã¾ã™ã€‚ Fluentdã¨ã¯ Fluentdã¯ã€ãƒã‚°ãªã©ã®ãƒ‡ãƒ¼ã‚¿åŽé›†ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã¨ã—ã¦åºƒãç”¨ã„ã‚‰ã‚Œã¦ã„ã‚‹OSSã§ã™ã€‚æ‰‹è»½ã«å°Žå…¥ã™ã‚‹ãŸã‚ã«ã€é–‹ç™ºä¸»ä½“ã®Treasure Dataç¤¾ãŒæä¾›ã™ã‚‹td-agentãƒ‡ã‚£ã‚¹ãƒˆãƒªãƒ“ãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã‚’åˆ©ç”¨ã™ã‚‹ã®ãŒä¸€èˆ¬çš„ã§ã™ã€‚ *1 Kinesis Firehoseã¨ã¯ Kinesis Firehoseã¯ã€AWSã®ãƒžãƒãƒ¼ã‚¸ãƒ‰ãªã‚¹ãƒˆãƒªãƒ¼ãƒŸãƒ³ã‚°åŸºç›¤ã‚µãƒ¼ãƒ“ã‚¹ã®ä¸€ã¤ã§ã€ç°¡å˜ã«S3ã‚„Redshiftã¸ã®ãƒ‡ãƒ¼ã‚¿æ ¼ç´ã‚’è¡Œã†ã“ã¨ãŒã§ãã¾ã™ã€‚ SORACOM Funnelãªã—ã§ã‚‚ã€Fluentdã«ã¯Kinesis Fireh
T-miura 2016/02/01
kinesis

td-agent

IoT
ãƒªãƒ³ã‚¯
td-agent + fluent-plugin-elb-log ã‚’ä½¿ã£ã¦ ELB ã®ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ã‚’ Elasticsearch + kibana ã§ã¡ã‚‡ã£ã¨è¦‹ã¦ã¿ã‚‹ - ã‚ˆã†ã¸ã„ã®æ—¥ã€…ç²¾é€²XP
ã¯ã˜ã‚ã« Sensu ã® RabbitMQ ã¨ã‹ Sensu API ã‚’ ELB çµŒç”±ã§åˆ©ç”¨ã™ã‚‹ã«ã‚ãŸã£ã¦ã€Œã‚ã‚ã€ã‚„ã£ã±ãƒã‚°è¦‹ãŸã„ã‚ˆãã€ã£ã¦ã“ã¨ã§ ELB ã®ãƒã‚°ã‚’ fluent-plugin-elb-log ã‚’ä»‹ã—ã¦ Elasticsearch + kibana ã®ã‚´ãƒ¼ãƒ«ãƒ‡ãƒ³ã‚³ãƒ³ãƒ“ï¼ˆå½“ç¤¾æ¯”ï¼‰ã§è¦‹ã¦ã¿ã‚‹ã“ã¨ã«ã—ãŸã€‚ å‚è€ƒ shinsaka / fluent-plugin-elb-log ELBã®ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ã‚’fluent-plugin-elb-logã‚’ä½¿ã£ã¦kibanaã§è¡¨ç¤ºã™ã‚‹ Configure an Amazon S3 Bucket for Storing Access Logs æº–å‚™ ç’°å¢ƒ Amazon Linux td-agent-1.1.18-0.x86_64 elasticsearch-1.0.1 fluent-plugin-elasticsearch fluent-plug
T-miura 2014/06/25
fluent

td-agent

elasticsearch
ãƒªãƒ³ã‚¯
fluentdã‚’è©¦ã—ã¦ã¿ãŸ - wyukawa's diary
ã‚¯ãƒ¬ã‚¸ãƒƒãƒˆã‚«ãƒ¼ãƒ‰ç¾é‡‘åŒ–è©æ¬ºã€æ¥ç•ŒäººãŒæ•™ãˆã‚‹å£ã‚³ãƒŸæƒ…å ±ã€‘ åƒ•ã¯è¡Œã£ã¦ãªã„ã‚“ã§ã™ãŒTwitterã€Ustreamã€ã‚¹ãƒ©ã‚¤ãƒ‰ã€ãƒ–ãƒã‚°ãªã©ã‚’è¦‹ã‚‹é™ã‚Šã ã„ã¶ç››ã‚Šä¸ŠãŒã£ãŸã‚ˆã†ã§ã™ããƒ¼ã€‚åƒ•è‡ªèº«ãŒä»•äº‹ã§ä½¿ã†äºˆå®šã¯ä»Šã®ã¨ã“ã‚ç„¡ã„ã‚“ã§ã™ãŒãƒã‚°è§£æžé–¢é€£ã®ä»•äº‹ã‚’ã—ã¦ã„ã‚‹ã“ã¨ã‚‚ã‚ã‚‹ã®ã§ç´ æŒ¯ã‚Šã—ã¦ã¿ã‚ˆã†ã¨æ€ã„ã¾ã™ã€‚ ç’°å¢ƒã¯VirtualBoxä¸Šã®CenOS 5.7(x86_64)ã‚’ä½¿ã„ã¾ã—ãŸã€‚ fluentdã¯Ruby 1.9ä¸Šã§å‹•ãã‚“ã§ã™ãŒCentOS 5.7ã«å…¥ã£ã¦ã„ã‚‹ã®ã¯Ruby 1.8.5ã§ã™ã€‚Ruby 1.9ã®ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã‹ã‚‰å§‹ã‚ã‚‹ã¨ã¯ã¾ã‚Šãã†ãªã®ã§yumã§ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã§ãã‚‹td-agentã‚’ä½¿ã„ã¾ã™ã€‚td-agentã¯fluentdã®å®‰å®šç‰ˆãƒ‘ãƒƒã‚±ãƒ¼ã‚¸ã¨ã„ã†ä½ç½®ä»˜ã‘ã®ã‚ˆã†ã§ã™ã€‚ è©¦ã—ãŸã®ã¯ä¸‹è¨˜ï¼“ã¤ã§ã™ã€‚ fluent-catã§ãƒã‚°ã‚’é€ã‚‹ Apacheã®ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ã‚’åŽé›† Apacheã®ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ã‚’Mong
T-miura 2014/02/06
td-agent

fluent

fluentd
ãƒªãƒ³ã‚¯
Nginxã®ãƒã‚°(LTSVå½¢å¼)ã‚’Fluentd(td-agent)ã§å‡¦ç†ã™ã‚‹ - Devlog
T-miura 2013/12/20
td-agent
ãƒªãƒ³ã‚¯
fluent-agent-lite ã¨ td-agent ã§ã€å°ã•ãã¯ã˜ã‚ã‚‹ fluentd - Studio3104::BLOG.new
fluentdã‚’ä½¿ã£ã¦ã¿ãŸã„ã‘ã©ã€ã€ŒJSONã§ã‚·ãƒªã‚¢ãƒ©ã‚¤ã‚ºã—ãªãã¦ã„ã„ã®ã«ãƒ»ãƒ»ãƒ»ç”Ÿã§ã„ã„ã®ã«ãƒ»ãƒ»ãƒ»ã€ã¨æ€ã£ã¦ãªã‹ãªã‹ä½¿ã„å‡ºã›ãªã„ã¨ã„ã†ã‚±ãƒ¼ã‚¹ã¯ã¾ã¾ã‚ã‚‹ã®ã§ã¯ãªã„ã§ã—ã‚‡ã†ã‹ã€‚ ã“ã‚“ãªã¨ãã«å›°ã£ã¦ã—ã¾ã†ã‹ã‚‰ã§ã™ã‚ˆãã€‚ rsyncã‚„scpã§æ¯Žæ—¥æ·±å¤œã«ã‚„ã£ã¦ãã‚‹ç”Ÿãƒã‚°ã‚’è§£æžã™ã‚‹ã‚¹ãƒ‘ã‚²ãƒƒãƒ†ã‚£ã‚¹ã‚¯ãƒªãƒ—ãƒˆãŸã¡ã‚’ä½¿ãˆãªããªã£ã¦ã—ã¾ã† ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã‚µãƒ¼ãƒã«ãƒã‚°ã‚’ãƒ‘ãƒ¼ã‚¹ã•ã›ã‚‹ãŸã‚ã®è² è·ã‚’ã‹ã‘ãŸããªã„ ãã‚Œã§ã‚‚ä½¿ã£ã¦ã¿ãŸã„ã€ç¾å˜ã®å¤è‡ã„è§£æžæ©Ÿæ§‹ã‚’ã‚¢ã‚¯ãƒ†ã‚£ãƒ–ã«ã—ãŸã¾ã¾ã€å¾ã€…ã«fluentdã«ã‚ˆã‚‹å…ˆé‹çš„ãªãƒã‚°è§£æžã‚’å§‹ã‚ã‚‰ã‚ŒãŸã‚‰ã„ã„ãªã¨æ€ã£ã¦ã„ã‚‹æ–¹ã€ fluent-agent-lite ã¨ td-agent ã§ã€fluentd ã‚’å°ã•ãã¯ã˜ã‚ã¦ã¿ãŸã‚‰ã„ã„ã¨æ€ã„ã¾ã™ã€‚ çµè«–ã‚’å…ˆã«è¨€ã†ã¨ã€fluent-agent-lite + fluent-plugin-file-alternative + fluent-plugi
T-miura 2013/12/20
fluentd

fluent

ã‚ã¨ã§èªã‚€

td-agent
ãƒªãƒ³ã‚¯
1