[B! fluentd] ko-ya-maã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

ko-ya-ma id:ko-ya-ma

fluentdã«é–¢ã™ã‚‹ko-ya-maã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (18)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

[Terraform]ECS Fargateã§FireLensã‚’ä½¿ã£ã¦è¤‡æ•°ã‚µãƒ¼ãƒ“ã‚¹ã«ãƒã‚°å‡ºåŠ›ã™ã‚‹ | DevelopersIO
ã“ã‚“ã«ã¡ã¯ï¼ã‚³ãƒ³ã‚µãƒ«éƒ¨ã®inomaso(@inomasosan)ã§ã™ã€‚ ECS Fargateã§FireLensã‹ã‚‰CloudWatch Logsã‚„Kinesis Data Firehoseã¸ã®ãƒã‚°å‡ºåŠ›ã‚’ã€Terraformã§ã‚³ãƒ¼ãƒ‰åŒ–ã—ãŸã®ã§ç´¹ä»‹ã—ã¾ã™ã€‚ æ¤œè¨¼ã«ã‚ãŸã‚Šã€å¼Šç¤¾ã®ä»¥ä¸‹ãƒ–ãƒã‚°ã‚’å‚è€ƒã«ã—ã¾ã—ãŸã€‚ ãã‚‚ãã‚‚FireLensã£ã¦ä½•ï¼Ÿ FireLensã¯ã€è¤‡æ•°ã®AWSã‚µãƒ¼ãƒ“ã‚¹ã‚„AWSãƒ‘ãƒ¼ãƒˆãƒŠãƒ¼ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯(Datadogç‰)ã«ãƒã‚°å‡ºåŠ›ã™ã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚ ECSã‚¿ã‚¹ã‚¯å®šç¾©ã§ã‚µã‚¤ãƒ‰ã‚«ãƒ¼ã¨ã—ã¦èµ·å‹•ã—ã€ä»–ã®ã‚³ãƒ³ãƒ†ãƒŠã‹ã‚‰ãƒã‚°ãƒ‰ãƒ©ã‚¤ãƒãƒ¼ã¨ã—ã¦ä½¿ç”¨ã—ã¾ã™ã€‚ ã‚³ãƒ³ãƒ†ãƒŠã‚¤ãƒ¡ãƒ¼ã‚¸ã«ã¯Fluentdã¨Fluent Bitã‚’é¸æŠžå¯èƒ½ã§ã™ã€‚ ä»Šå›žã®æ¤œè¨¼ã§ã¯ã€ãƒªã‚½ãƒ¼ã‚¹ä½¿ç”¨çŽ‡ãŒä½Žãã€ãƒã‚°ãƒ«ãƒ¼ã‚¿ã«æŽ¨å¥¨ã•ã‚Œã¦ã„ã‚‹Fluent Bitã‚’ä½¿ç”¨ã—ã¾ã™ã€‚ 2021/11/6æ™‚ç‚¹ã§Fluent Bitã§ã¯ã€ä»¥ä¸‹ã®AWSã‚µãƒ¼ãƒ“ã‚¹ã«
ko-ya-ma 2021/11/08
dev

fluentd

aws

log
ãƒªãƒ³ã‚¯
NLB + Fluentd ã®æ§‹æˆã§ãƒ•ã‚¡ã‚¤ãƒ«ãƒ‡ã‚£ã‚¹ã‚¯ãƒªãƒ—ã‚¿ãŒæž¯æ¸‡ã™ã‚‹è¬Žã®ç¾è±¡ã‚’è§£æ¶ˆã—ãŸè©± - Repro Tech Blog
Repro ã‚¤ãƒ³ãƒ•ãƒ©ãƒãƒ¼ãƒ (SRE + åˆ†æžåŸºç›¤) ã®ä¼Šè±†ã§ã™ã€‚ä»Šå›žã¯ã€Repro ã®ãƒ‡ãƒ¼ã‚¿åŽé›†åŸºç›¤ã§ç§ãŸã¡ãŒéé‡ã—ãŸå•é¡Œã‚’ç´¹ä»‹ã—ãŸã„ã¨æ€ã„ã¾ã™ã€‚ å…·ä½“çš„ã«ã¯ã€AWS Network Load Balancer(NLB) + Fluentd ã®æ§‹æˆã§ãƒ•ã‚¡ã‚¤ãƒ«ãƒ‡ã‚£ã‚¹ã‚¯ãƒªãƒ—ã‚¿ãŒæž¯æ¸‡ã™ã‚‹è¬Žã®ç¾è±¡ã«éé‡ã—ãŸã®ã§ã€ãã®å•é¡Œã®èª¿æŸ»è¨˜éŒ²ã¨è§£æ±ºç–ã‚’å…±æœ‰ã—ã¾ã™ã€‚ã¾ãŸã€ã“ã®å•é¡Œã‚’è§£æ¶ˆã™ã‚‹ã«ã‚ãŸã‚Š Fluentd ã« PR ã‚’é€ã£ãŸã®ã§ãã‚Œã®ç´¹ä»‹ã‚‚ã—ã¾ã™ã€‚ https://github.com/fluent/fluentd/pull/2352 ãƒ‡ãƒ¼ã‚¿åŽé›†åŸºç›¤ã®æ§‹æˆ Repro ã®ãƒ‡ãƒ¼ã‚¿åŽé›†åŸºç›¤ã¯Flunetd High Availability Configã‚’ã‚‚ã¨ã«æ§‹æˆã•ã‚Œã€å¤§ã¾ã‹ã«æ¬¡ã®ã‚ˆã†ã«ãªã£ã¦ã„ã¾ã™ã€‚ SDK ã‹ã‚‰ã‚¢ãƒƒãƒ—ãƒãƒ¼ãƒ‰ã•ã‚ŒãŸãƒ‡ãƒ¼ã‚¿ã¯ã€è»¢é€ç”¨ Fluentd(log forwarders)ã‚’çµŒç”±ã—
ko-ya-ma 2019/07/03
trouble

fluentd

dev
ãƒªãƒ³ã‚¯
Fluentd å…¥é–€ ã€œé‹ç”¨ã«å¿…è¦ãªåŸºç¤ŽçŸ¥è˜ã€œ
æœ€è¿‘æ¥å‹™ã§ Fluentd ã‚’è§¦ã‚‹ã“ã¨ãŒå‡ºã¦ãã¦å…¥é–€ã—ãŸã‚“ã§ã™ãŒã€æœ€åˆã®ã†ã¡ã¯ãƒˆãƒ©ãƒ–ãƒ«ãŒèµ·ããŸæ™‚ã«ä½•ãŒèµ·ãã¦ã„ã‚‹ã®ã‹ã€ã©ã†å¯¾å‡¦ã—ãŸã‚‰è‰¯ã„ã®ã‹ãŒã•ã£ã±ã‚Šã‚ã‹ã‚‰ãªã‹ã£ãŸã®ã§ã€ã€ŒFluentd ã£ã¦ãƒã‚°ã®åŽé›†ã¨ã‹ã«ä½¿ã‚ã‚Œã‚‹ã‚„ã¤ã§ã—ã‚‡ï¼Ÿã€ç¨‹åº¦ã®çŸ¥è˜ã—ã‹ãªã‹ã£ãŸéŽåŽ»ã®è‡ªåˆ†ã«å‘ã‘ã¦ã€Œã¨ã‚Šã‚ãˆãšã“ã‚Œãã‚‰ã„ã¯çŸ¥ã£ã¦ãŠã‘ï¼ã€ã¨è¨€ã„ãŸã„å†…å®¹ã‚’ã¾ã¨ã‚ã¦ã¿ã¾ã—ãŸã€‚ ãƒˆãƒ©ãƒ–ãƒ«ãŒèµ·ããŸæ™‚ã«ã©ã®å‡¦ç†ã§å•é¡ŒãŒèµ·ãã¦ã„ã‚‹ã®ã‹ç´ æ—©ãã‚³ãƒ¼ãƒ‰ã‚’è¿½ã†ã“ã¨ãŒã§ãã¦ã€ãƒ‡ãƒ¼ã‚¿ã®æ¶ˆå¤±ã‚’æœ€å°é™ã«æŠ‘ãˆã¤ã¤é©åˆ‡ã«å¯¾å‡¦ã§ãã‚‹ã‚ˆã†ã«ãªã‚‹ã“ã¨ã‚’ç›®çš„ã¨ã—ã¦ã„ã¾ã™ã€‚ ãªãŠã€ç¾æ™‚ç‚¹ã§æœ€æ–°ç‰ˆã® Fluentd v0.14.21 ã‚’å¯¾è±¡ã«ã—ã¦ã„ã¾ã™ã€‚ ã‚¢ã‚¸ã‚§ãƒ³ãƒ€ Getting Started Fluentd ã®ã‚¢ãƒ¼ã‚ãƒ†ã‚¯ãƒãƒ£ Processes Supervisor process Worker process Threads Input thread En
ko-ya-ma 2017/10/23
fluentd

log

dev

basic
ãƒªãƒ³ã‚¯
SlowQuery ã‚’æ¤œçŸ¥ã—ã¦ Explain ã§è§£æžã— Slack ã¸é€šçŸ¥ - é•·ç”Ÿæ‘æœ¬éƒ·Engineers'Blog
ä»¥ä¸‹ã«ç§»è¡Œã—ã¾ã—ãŸã€‚ kenzo0107.github.io
ko-ya-ma 2016/12/27
dev

db

slack

mysql

fluentd
ãƒªãƒ³ã‚¯
é«˜é€Ÿãƒ•ã‚¡ã‚¤ãƒ«/ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸è»¢é€ K2HFTFUSE ã®ç´¹ä»‹
ãƒ¤ãƒ•ãƒ¼æ ªå¼ä¼šç¤¾ã¯ã€2023å¹´10æœˆ1æ—¥ã«LINEãƒ¤ãƒ•ãƒ¼æ ªå¼ä¼šç¤¾ã«ãªã‚Šã¾ã—ãŸã€‚LINEãƒ¤ãƒ•ãƒ¼æ ªå¼ä¼šç¤¾ã®æ–°ã—ã„ãƒ–ãƒã‚°ã¯ã“ã¡ã‚‰ã§ã™ã€‚LINEãƒ¤ãƒ•ãƒ¼ Tech Blog ã“ã‚“ã«ã¡ã¯ã€Technical Yahoo ã®ä¸è°·ã§ã™ã€‚ ä»Šå›žã¯ã€Yahoo! JAPANã‹ã‚‰ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã¨ã—ã¦å…¬é–‹ã—ãŸé«˜é€Ÿãƒ•ã‚¡ã‚¤ãƒ«/ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸è»¢é€ã‚·ã‚¹ãƒ†ãƒ ã® K2HFTFUSE ã®ç´¹ä»‹ã‚’ã—ã¾ã™ã€‚ K2HFTFUSEã¯ã€ç¢ºå®Ÿã§é«˜é€Ÿãªãƒ•ã‚¡ã‚¤ãƒ«/ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸è»¢é€ã‚’ä½Žã‚³ã‚¹ãƒˆã§å®Ÿç¾ã™ã‚‹ãŸã‚ã«é–‹ç™ºã•ã‚ŒãŸã‚·ã‚¹ãƒ†ãƒ ã§ã™ã€‚ K2HFTFUSEï¼ˆK2Hash File Transaction by FUSE-based file systemï¼‰ã¨ã¯ã€FUSEï¼ˆFilesystem in Userspaceï¼‰ã«ã‚ˆã‚‹ãƒ¦ãƒ¼ã‚¶ãƒ¼ã‚¹ãƒšãƒ¼ã‚¹ã§ã®ãƒžã‚¦ãƒ³ãƒˆæ©Ÿèƒ½ã‚’åˆ©ç”¨ã—ãŸãƒ•ã‚¡ã‚¤ãƒ«/ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸è»¢é€ã‚·ã‚¹ãƒ†ãƒ ã§ã™ã€‚ K2HFTFUSEã¯ã€ä»®æƒ³ãƒ•ã‚¡ã‚¤ãƒ«ã‚·ã‚¹ãƒ†ãƒ ã‚’æä¾›ã—ã€ãƒžã‚¦
ko-ya-ma 2016/12/09
ãŠã‚‚ã—ã‚ãã†

fluentd

kafka

file

Apache

yahoo

FUSE

log

transfer

dev
ãƒªãƒ³ã‚¯
Fluentd + Kinesis + Elasticsearch + Kibana / Grafanaã§ã®ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ ãƒã‚°è§£æžåŸºç›¤ | Tech Blog - ãƒªã‚¯ãƒ«ãƒ¼ãƒˆä½ã¾ã„ã‚«ãƒ³ãƒ‘ãƒ‹ãƒ¼
ã“ã‚“ã«ã¡ã¯ã€SUUMOã‚¹ãƒžãƒ›ã‚µã‚¤ãƒˆã®é–‹ç™ºãƒãƒ¼ãƒ ã«æ‰€å±žã—ã¦ã„ã‚‹ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã®ä¸Šé‡Žã§ã™ã€‚ ä»Šå›žã¯ã€ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ ãƒã‚°è§£æžåŸºç›¤ã‚’ç´¹ä»‹ã—ã¾ã™ã€‚ èƒŒæ™¯ çš†æ§˜ã¯webã‚µãƒ¼ãƒãƒã‚°ç›£è¦–ï¼ˆã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ãƒ»ã‚¨ãƒ©ãƒ¼ãƒã‚°ãªã©ï¼‰ã‚’ã©ã®ã‚ˆã†ã«è¡Œã‚ã‚Œã¦ã„ã‚‹ã§ã—ã‚‡ã†ã‹ï¼Ÿ ã‚¹ãƒ¼ãƒ¢ã‚¹ãƒžãƒ›ã‚µã‚¤ãƒˆã§ã¯ã€ã‚¢ã‚¯ã‚»ã‚¹æ•°å¢—åŠ ã«ä¼´ã„ã‚µãƒ¼ãƒå°æ•°ãŒå¢—ãˆã€csshXåœ°ã“ã‚“ã«ã¡ã¯ã€SUUMOã‚¹ãƒžãƒ›ã‚µã‚¤ãƒˆã®é–‹ç™ºãƒãƒ¼ãƒ ã«æ‰€å±žã—ã¦ã„ã‚‹ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã®ä¸Šé‡Žã§ã™ã€‚ ä»Šå›žã¯ã€ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ ãƒã‚°è§£æžåŸºç›¤ã‚’ç´¹ä»‹ã—ã¾ã™ã€‚ èƒŒæ™¯ çš†æ§˜ã¯webã‚µãƒ¼ãƒãƒã‚°ç›£è¦–ï¼ˆã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ãƒ»ã‚¨ãƒ©ãƒ¼ãƒã‚°ãªã©ï¼‰ã‚’ã©ã®ã‚ˆã†ã«è¡Œã‚ã‚Œã¦ã„ã‚‹ã§ã—ã‚‡ã†ã‹ï¼Ÿ ã‚¹ãƒ¼ãƒ¢ã‚¹ãƒžãƒ›ã‚µã‚¤ãƒˆã§ã¯ã€ã‚¢ã‚¯ã‚»ã‚¹æ•°å¢—åŠ ã«ä¼´ã„ã‚µãƒ¼ãƒå°æ•°ãŒå¢—ãˆã€ csshX åœ°ç„ã«é™¥ã‚Šã¾ã—ãŸã€‚ï¼ˆä»¥ä¸‹ã®å›³ã®ã‚ˆã†ãªçŠ¶æ…‹ã®ã“ã¨ã§ã™ã€‚ï¼‰ ãƒã‚°ã®ç¢ºèªãŒå¿…è¦ã«ãªã£ãŸéš›ã«ã€ã“ã® csshX ã‚’ä½¿ç”¨ã—ã¦ç§˜ä¼ã®ãƒ¯ãƒ³ãƒ©ã‚¤ãƒŠãƒ¼ã§ç¢ºèªã—ãŸã„éƒ¨åˆ†ã‚’tailã—ã¦æŠ½å‡ºã—ã¦ã„ã¾ã—ãŸãŒ
ko-ya-ma 2016/06/02
dev

log

fluentd

elasticsearch

server
ãƒªãƒ³ã‚¯
fluentdã‚’å°Žå…¥æ™‚ã«ã¾ãšçŸ¥ã£ã¦ãŠã„ãŸã»ã†ãŒã‚ˆã•ãã†ãªã“ã¨ï¼ˆã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã€ç›£è¦–ã€HAæ§‹æˆã€ãƒãƒ¥ãƒ¼ãƒ‹ãƒ³ã‚°ãªã©ï¼‰ - Qiita
fluentdã‚’ä½¿ã†æ™‚ã«ã¾ãšçŸ¥ã£ã¦ãŠã„ãŸã»ã†ãŒã‚ˆã•ãã†ãªã“ã¨ ã¯ã˜ã‚ã« æœã‹ã‚‰Elasticsearchã¸ã®ãƒ‡ãƒ¼ã‚¿ã®æŠ•ã’è¾¼ã¿æ–¹ã‚’è€ƒãˆã¦ã„ã¾ã—ãŸã€‚ ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã‚„ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ã‚ãƒ¥ãƒ¼ãªã©ã«ãƒ‡ãƒ¼ã‚¿ã‚’æŠ•ã’è¾¼ã‚“ã§ãŠã„ã¦ã€ãƒ‹ã‚¢ãƒªã‚¢ãƒ«ãªãƒãƒƒãƒã§Elasticsearchã«æŠ•ã’è¾¼ã‚€ã‚ˆã‚Šã‚‚ã€fluentdã‚’ä½¿ã†æ–¹ãŒåœ§å€’çš„ã«ç°¡å˜ã§ä¿¡é ¼æ€§ãŒé«˜ã„ã‚‚ã®ãŒã§ãã¾ã™ãã€‚è‡ªåˆ†ã§ä½œã‚Šã“ã‚€ã®ãŒãƒã‚«ã‚‰ã—ããªã‚Šã¾ã™ãã€‚ ã¨ã„ã†ã“ã¨ã§ã€fluentdåˆ©ç”¨æ™‚ã«æ°—ã‚’ä»˜ã‘ã¦ãŠããŸã„ã“ã¨ã«ã¤ã„ã¦èª¿ã¹ã¦ã¿ã¾ã—ãŸã€‚å†…å®¹ã¯å…¬å¼ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆã®å†…å®¹ã‚’ãƒ™ãƒ¼ã‚¹ã«è‡ªèº«ã§èª¿ã¹ãŸã“ã¨ã‚’è¿½è¨˜ã—ã¦ã„ã¾ã™ã€‚å…¬å¼ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆã¸ã®ãƒªãƒ³ã‚¯ã‚‚è²¼ã£ã¦ã‚ã‚Šã¾ã™ã®ã§é©å®œãã¡ã‚‰ã‚’ã”è¦§ã„ãŸã ã‘ã‚Œã°ã¨ã€‚ ç’°å¢ƒ CentOS6.7 td-agent 0.12.19 Ruby2.2.2ï¼ˆãƒªã‚¹ãƒˆã‚¢ã‚¹ã‚¯ãƒªãƒ—ãƒˆã§åˆ©ç”¨ï¼‰ Fluent-Logger(0.5.1) Elasticsearch2.1.
ko-ya-ma 2016/01/27
fluentd

monitoring

log

tips

dev
ãƒªãƒ³ã‚¯
Fluentd UIãŒå‡ºãŸã®ã§è§¦ã£ã¦ã¿ãŸ - ã™ãšã‘ã‚“ãƒ¡ãƒ¢
fluent/fluentd-ui https://github.com/fluent/fluentd-ui Fluentdç”¨ã®Web UIãŒå‡ºãŸã‚ˆã†ã§ã™ã€‚è©¦ã—ã«è§¦ã£ã¦ã¿ã¾ã™ã€‚ ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ« READMEã®ã¨ãŠã‚Šã§ã™ãŒã€ $ gem install fluentd-ui $ fluentd-ui start Open http://localhost:9292/ by your browser default account is username="admin" and password="changeme" ã‚‚ã—ãã¯ã€ $ git clone https://github.com/treasure-data/fluentd-ui $ cd fluentd-ui $ bundle install $ bundle exec rails s ã§ã™ã€‚ åƒ•ã¯bundlerã§ã„ã‚Œã‚‹ã“ã¨ã«ã—ã¾ã—ãŸ
ko-ya-ma 2016/01/15
fluentd

log

server

ui
ãƒªãƒ³ã‚¯
ã€ŒFluentdã‚’ãã£ã‹ã‘ã«ãƒ“ã‚¸ãƒã‚¹ãŒå›žã‚‹ä»•æŽ›ã‘ãŒã¨ã£ã¦ã‚‚æ°—æŒã¡ã‚¤ã‚¤ã§ã™ã€‚ã€
ã‚¯ãƒ©ã‚¦ãƒ‰ã‚’æ´»ç”¨ã—ãŸãƒ‡ãƒ¼ã‚¿ãƒžãƒãƒ¼ã‚¸ãƒ¡ãƒ³ãƒˆã‚µãƒ¼ãƒ“ã‚¹ã‚’å±•é–‹ã™ã‚‹ãƒˆãƒ¬ã‚¸ãƒ£ãƒ¼ãƒ‡ãƒ¼ã‚¿ã®CTOã€å¤ªç”°ä¸€æ¨¹æ°ã«ã‚¤ãƒ³ã‚¿ãƒ“ãƒ¥ãƒ¼ã‚’è¡Œã£ãŸã€‚åŒç¤¾ãŒãƒ¡ã‚¤ãƒ³ã§é–‹ç™ºã‚’é€²ã‚ã‚‹ãƒã‚°åŽé›†ã®ãŸã‚ã®ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã€ŒFluentdã€ã¨ã‚³ã‚¢ãªãƒ“ã‚¸ãƒã‚¹ãƒ¢ãƒ‡ãƒ«ã¨ã®é–¢ä¿‚ã€ãƒˆãƒ¬ã‚¸ãƒ£ãƒ¼ãƒ‡ãƒ¼ã‚¿ã®ç‹™ã£ã¦ã„ã‚‹ãƒ¦ãƒ¼ã‚¶ãƒ¼å±¤ã€æ›´ã«ã¯ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã®é›‡ç”¨ã‹ã‚‰äººå·¥çŸ¥èƒ½ã®å¯èƒ½æ€§ã¾ã§å¹…åºƒã„ãƒˆãƒ”ãƒƒã‚¯ã«åŠã‚“ã ã€‚ ã¾ãšã¯CTOã¨ã—ã¦ã®æ¥å‹™é ˜åŸŸã‚’æ•™ãˆã¦ãã ã•ã„ã€‚ ç¾åœ¨ã¯CTOã¨ã„ã†è‚©æ›¸ãã§ã€ç´„80åã»ã©ã®ç¤¾å“¡ã®ä¸ã®30åãã‚‰ã„ã‚’å ã‚ã‚‹ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ãƒªãƒ³ã‚°ã¨ãƒ—ãƒãƒ€ã‚¯ãƒˆãƒžãƒãƒ¼ã‚¸ãƒ£ãƒ¼ã‚’çµ±æ‹¬ã™ã‚‹ä»•äº‹ã‚’ã—ã¦ã„ã¾ã™ã€‚ãƒ—ãƒãƒ€ã‚¯ãƒˆãƒžãƒãƒ¼ã‚¸ãƒ£ãƒ¼ã¨ã„ã†ã®ã¯ã‚¢ãƒ¡ãƒªã‚«ã®ITä¼æ¥ã§ã¯æ™®é€šãªã‚“ã§ã™ãŒã€è£½å“ã®ä½ç½®ä»˜ã‘ã¨ã‹é¡§å®¢ãƒ‹ãƒ¼ã‚ºã‚’ç†è§£ã—ãŸã‚Šã€é¡§å®¢å‘ã‘ã®ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ã‚’ä½œã‚‹å½¹ç›®ã§ã™ã€‚ãã‚Œã«åŠ ãˆã¦è£½å“ã‚’ä½¿ã£ã¦é ‚ã„ã¦ã„ã‚‹ãŠå®¢æ§˜ã¸ã®å¯¾å¿œã‚’è¡Œã†ã‚«ã‚¹ã‚¿ãƒžãƒ¼ã‚µãƒãƒ¼ãƒˆã®ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã¨ã„ã†äººãŸã¡ã‚‚çµ±æ‹¬ã—ã¦ã„ã¾ã™ã€‚ãã®
ko-ya-ma 2015/07/17
fluentd

biz

OpenSource
ãƒªãƒ³ã‚¯
PHPã‹ã‚‰Fluentdã«ãƒã‚°ã‚’æŠ•ã’ã‚‹ãŸã‚ã®ãƒ©ã‚¤ãƒ–ãƒ©ãƒªã‚’ä½œã‚Šã¾ã—ãŸã€‚ - Qiita
Deleted articles cannot be recovered. Draft of this article would be also deleted. Are you sure you want to delete this article?
ko-ya-ma 2015/04/26
log

php

fluentd

dev
ãƒªãƒ³ã‚¯
Googleã®è™Žã®åã€ŒBigQueryã€ã‚’Fluentdãƒ¦ãƒ¼ã‚¶ãƒ¼ãŒä½¿ã‚ãªã„ç†ç”±ãŒãªããªã£ãŸç†ç”± #gcpja - Qiita
From Fluentd Meetupã«è¡Œã£ã¦ãã¾ã—ãŸ ã“ã‚Œã‚’èªã‚“ã æ™‚ã€BigQueryã®æ¤œç´¢ã‚¹ãƒ”ãƒ¼ãƒ‰ã«ã¤ã„ã¦ã¡ã‚‡ã£ã¨è£œè¶³ã—ãŸããªã£ãŸã€‚ç¢ºã‹ã«Fluentd Meetupã®ãƒ‡ãƒ¢ã§ã¯9å„„ä»¶ã‚’7ç§’ç¨‹åº¦ã§æ¤œç´¢ã—ã¦ã„ãŸãŒã€BigQueryã®çœŸã®å®ŸåŠ›ã¯ã“ã‚Œã‚ˆã‚Š1ã€œ2ã‚±ã‚¿ä¸Šã ã‹ã‚‰ã ã€‚ã¡ã‚‡ã£ã¨æ‰‹å…ƒã§å°‘ã—å¤§ãã‚ã®ãƒ†ãƒ¼ãƒ–ãƒ«ã§è©¦ã—ã¦ã¿ãŸã‚‰ã€120å„„è¡Œã®æ£è¦è¡¨ç¾ãƒžãƒƒãƒä»˜ãé›†è¨ˆãŒ5ç§’ã§å®Œäº†ã—ãŸã€‚è«–ã‚ˆã‚Šè¨¼æ‹ ã§ã€ãƒ‡ãƒ¢ãƒ“ãƒ‡ã‚ªï¼ˆ1åˆ†16ç§’ï¼‰ã‚’ä½œã£ã¦ã¿ãŸï¼š From The Speed of Google BigQuery ã“ã‚Œã¯é€Ÿã™ãŽã‚‹ã€‚ä½•ã‹ã®ã‚¤ãƒ³ãƒã‚ã§ã‚ã‚‹ï¼ˆæœ€åˆã«ãƒ‡ãƒ¢ã‚’è¦‹ãŸæ™‚ãã†æ€ã£ãŸï¼‰ã€‚æ£è¦è¡¨ç¾ã‚’ã„ã‚ã„ã‚å¤‰ãˆã¦ã¿ã¦ã‚‚ã‚¹ãƒ”ãƒ¼ãƒ‰ã¯å¤‰ã‚ã‚‰ãªã„ã€‚ã¤ã¾ã‚Šã€ã‚¤ãƒ³ãƒ‡ãƒƒã‚¯ã‚¹ã‚’äº‹å‰æ§‹ç¯‰ã§ããªã„ã‚¯ã‚¨ãƒªã«å¯¾ã—ã¦ã“ã®ã‚¹ãƒ”ãƒ¼ãƒ‰ãªã®ã§ã‚ã‚‹ã€‚ ä¾¡æ ¼ã‚‚å®‰ã„ã€‚ã•ã™ãŒã«120å„„è¡Œã®ã‚¯ã‚¨ãƒªã¯1å›žã§200å††ã‚‚ã‹ã‹ã£ã¦æ°—è»½ã«å®Ÿè¡Œã§ããªã•ãã†ã§ã‚ã‚‹ãŒã€1.2å„„
ko-ya-ma 2014/05/19
120å„„è¡Œã®æ£è¦è¡¨ç¾ãƒžãƒƒãƒä»˜ãé›†è¨ˆãŒï¼•ç§’ã§å®Œäº†ã€‚

fluentd

google

data

analysis
ãƒªãƒ³ã‚¯
FluentdãŒæµè¡Œã‚‹ç†ç”±ãŒã„ã¾åˆ†ã‹ã‚‹ã€10ã®å®Ÿè·µé€†å¼•ããƒ¦ãƒ¼ã‚¹ã‚±ãƒ¼ã‚¹é›† - Y-Ken Studio
ãƒã‚°ãƒ‡ãƒ¼ã‚¿ã‚’æ´»ç”¨ã—ã¦ãƒ“ã‚¸ãƒã‚¹ã«å½¹ç«‹ã¦ã‚ˆã†ã¨ã„ã†æœ€è¿‘ã®ãƒˆãƒ¬ãƒ³ãƒ‰ã¯ç†è§£ã§ãã‚‹ã€‚ ã—ã‹ã—ã€ãªãœãƒã‚°åŽé›†ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã®FluentdãŒã“ã‚Œã»ã©ã¾ã§è©±é¡Œã«ãªã‚‹ã®ã‹ã€ä¸æ€è°ã«æ„Ÿã˜ã¦ã„ã‚‹æ–¹ã‚‚ã„ã‚‹ã®ã§ã¯ãªã„ã ã‚ã†ã‹ã€‚å˜ã«ãƒã‚°ãƒ‡ãƒ¼ã‚¿ã‚’åŽé›†ã™ã‚‹ãªã‚‰ã°syslog-ngã‚„rsyslogã§ååˆ†ã§ã¯ãªã„ã‹ã¨ã„ã†æ„è¦‹ã‚‚ã‚ã‚‹ã ã‚ã†ã€‚ ãã‚Œã‚‰ã¯æ—¢å˜ã®ãƒã‚°ã‚·ã‚¹ãƒ†ãƒ ã‚’ç½®ãæ›ãˆã‚‹ãƒ—ãƒãƒ€ã‚¯ãƒˆã§ã‚ã‚Šã€Fluentdã®ãã‚Œã¨ã¯æ ¹æœ¬çš„ã«ç•°ãªã‚‹ã€‚Fluentdã¯ã€æ—¢å˜ã®ãƒã‚°ã‚·ã‚¹ãƒ†ãƒ ã«æ‰‹ã‚’å…¥ã‚Œã‚‹ã“ã¨ãªãæ–°ãŸã«ãƒã‚°ã®åŽé›†ã‚’è¡Œã„ã€ã‚¹ãƒˆãƒªãƒ¼ãƒ ãƒ‡ãƒ¼ã‚¿å‡¦ç†ã‚’å®Ÿç¾ã™ã‚‹ãƒ—ãƒãƒ€ã‚¯ãƒˆãªã®ã§ã‚ã‚‹ã€‚ ä¸€èˆ¬çš„ã«ãƒã‚°ãƒ‡ãƒ¼ã‚¿ã¯ã‚µãƒ¼ãƒã®æ•°ã ã‘åˆ†æ•£ã—ã¦ãŠã‚Šã€ãã‚Œã‚’å®šæœŸå®Ÿè¡Œå‡¦ç†ã§åŽé›†ã™ã‚‹ã¨ã„ã†ã“ã¨ã ã‘ã§ã‚‚ã€ãªã‹ãªã‹éª¨ã®æŠ˜ã‚Œã‚‹ä»•äº‹ã§ã‚ã‚‹ã€‚ã•ã‚‰ã«é›†ã‚ã‚‹ã ã‘ã§ãªãã€æ—¥ã€…å¢—ãˆç¶šã‘ã‚‹ãƒã‚°ãƒ‡ãƒ¼ã‚¿ã‚’æ´»ç”¨ã§ãã‚‹å½¢ã«åŠ å·¥ã—ã¦ã—ã‹ã‚‹ã¹ããƒ‡ãƒ¼ã‚¿ã‚¹ãƒˆã‚¢ã«ä¿ç®¡ã™ã‚‹ã¨ã„ã†ã“ã¨ã«æŒ«æŠ˜ã—ãŸæ–¹ã‚‚ã„ã‚‹ã®ã§ã¯
ko-ya-ma 2013/12/05
fluentd

dev

sample
ãƒªãƒ³ã‚¯
S3ã¨Fluentdã‚’ç”¨ã„ãŸåŠ¹çŽ‡çš„ãªãƒã‚°ç®¡ç† | SmartNewsé–‹ç™ºè€…ãƒ–ãƒã‚°
ã‚´ã‚¯ãƒã®å¤§å¹³ã§ã™ã€‚ ç§ã«ã¨ã£ã¦ä¸€ç•ªå¤§äº‹ã§æ›¿ãˆã®åŠ¹ã‹ãªã„ãƒŸãƒ¥ãƒ¼ã‚¸ã‚·ãƒ£ãƒ³ã¯ã•ã ã¾ã•ã—ã•ã‚“ã§ã™ãŒã€ç§ã«ã¨ã£ã¦ã‚¯ãƒ©ã‚¦ãƒ‰ã‚³ãƒ³ãƒ”ãƒ¥ãƒ¼ãƒ†ã‚£ãƒ³ã‚°ã®ã‚µãƒ¼ãƒ“ã‚¹ã®ä¸ã§ä¸€ç•ªå¤§äº‹ã§æ›¿ãˆãŒåŠ¹ã‹ãªã„ã‚µãƒ¼ãƒ“ã‚¹ã¯S3ã§ã™ã€‚ å¤šç¨®å¤šæ§˜ãªAPIã‚’ç”¨ã„ã¦æŸ”è»Ÿã«ãƒ•ã‚¡ã‚¤ãƒ«ã®æ“ä½œãŒå‡ºæ¥ã‚‹äº‹ã‚„ã€â€99.999999999ï¼…â€ã¨è¬³ã‚ã‚Œã¦ã„ã‚‹é«˜ã„è€éšœå®³æ€§ã€S3ã«ã‚ã‚‹ãƒ‡ãƒ¼ã‚¿ã‚’Elastic MapReduceã‚„Redshiftãªã©ã‚’ç”¨ã„ã¦æ‰‹è»½ã«ãƒ‡ãƒ¼ã‚¿è§£æžã‚’è¡Œãˆã‚‹åŸºç›¤ãŒæä¾›ã•ã‚Œã¦ã„ã‚‹ã“ã¨ãªã©ã€ã‚ã¾ã‚Šã«ä¾¿åˆ©ã™ãŽã¦S3ã®ä»£æ›¿ã¨ãªã‚‹ã‚µãƒ¼ãƒ“ã‚¹ã‚’æŽ¢ã—ã ã™ã®ãŒé›£ã—ã„çŠ¶æ…‹ã§ã™ã€‚ ã‚‚ã¡ã‚ã‚“å¤šãã®AWSãƒ¦ãƒ¼ã‚¶ãƒ¼ãŒåŒã˜ã‚ˆã†ã«S3ã®ä¾¿åˆ©ã•ã‚’äº«å—ã—ã¦ã„ã‚‹ã¨æ€ã„ã¾ã™ã—ã€ã‚¤ãƒ³ã‚¿ãƒ¼ãƒãƒƒãƒˆä¸Šã§ã‚‚å¤šãã®ãƒ–ãƒã‚°ç‰ã§ãã®é…åŠ›ãŒèªžã‚‰ã‚Œã¦ã„ã¾ã™ã€‚ãã®ä¸ã§æœ¬è¨˜äº‹ã¯æ—¢ã«å˜åœ¨ã™ã‚‹è¨˜äº‹ã¨ä¼¼ãŸã‚ˆã†ãªå†…å®¹ã‚’æ›¸ã„ã¦ã—ã¾ã†ã‹ã‚‚ã—ã‚Œã¾ã›ã‚“ãŒã€å¼Šç¤¾ãªã‚Šã®S3ã®ä½¿ã„æ–¹ã«ã¤ã„ã¦ã”ç´¹ä»‹ã—ãŸã„ã¨æ€ã„ã¾ã™ã€‚ ãªãŠ
ko-ya-ma 2013/09/02
log

aws

fluentd

dev

tips

server
ãƒªãƒ³ã‚¯
æ—¥æœ¬èªžèªã¿ä¸Šã’å¯¾å¿œã€‚Fluentdã‹ã‚‰Twilioã®é›»è©±APIã‚’æ“ä½œã™ã‚‹ã€Œfluent-plugin-twilioã€ã‚’ä½¿ã£ã¦é›»è©±ã‚’æŽ›ã‘ã¦ã¿ãŸ - Y-Ken Studio
Twilioï¼ˆãƒˆã‚¥ã‚¤ãƒªã‚ªï¼‰ã¨ã„ã†è©±é¡Œã®é›»è©±APIã‚µãƒ¼ãƒ“ã‚¹ã‚’ã”å˜ã˜ã§ã—ã‚‡ã†ã‹ã€‚ ã“ã‚Œã‚’Fluentdã«çµ„ã¿è¾¼ã‚€ãƒ—ãƒ©ã‚°ã‚¤ãƒ³ã€Œfluent-plugin-twilioã€ã‚’ä½œæˆãƒ»å…¬é–‹ã—ã¾ã—ãŸã€‚ Boundioã¨ã„ã†é›»è©±APIã‚µãƒ¼ãƒ“ã‚¹ãŒå»ƒæ¢ã¨ãªã‚Šã€è¡Œãå ´ã‚’å¤±ã£ã¦ã„ãŸæ–¹ã«ã‚‚æœ—å ±ã§ã™ã€‚ fluent-plugin-twilio https://github.com/y-ken/fluent-plugin-twilio Fluentd Output plugin to make a call with twilio. Twilioã¨ã¯ Web APIã‚’åˆ©ç”¨ã—ã€é›»è©±ã‚’æŽ›ã‘ãŸã‚Šã€å—ã‘ã‚‹ã“ã¨ã®å‡ºæ¥ã‚‹ã‚µãƒ¼ãƒ“ã‚¹ã§ã™ã€‚ TwiMLã¨ã„ã†XMLè¨€èªžã‚’ç”¨ã„ã€å¤§å¤‰è‡ªç”±åº¦ã®é«˜ã„å‹•ä½œã‚’å®šç¾©ã™ã‚‹ã“ã¨ãŒå‡ºæ¥ã¾ã™ã€‚ æ–‡å—åˆ—ã¨ã—ã¦æ¸¡ã—ãŸæ¼¢å—ã‚’å«ã‚€æ—¥æœ¬èªžã‹ã‚‰ã€éŸ³å£°åˆæˆã‚’ã—ã¦èªã¿ä¸Šã’ã‚‹æ©Ÿèƒ½ã‚‚å‚™ã‚ã£ã¦ã„ã¾ã™ã€‚ Twilioã®æ–™é‡‘ï¼ˆ2013å¹´
ko-ya-ma 2013/05/31
telephone

fluentd

dev

sample

plugin
ãƒªãƒ³ã‚¯
Fluentdã§å§‹ã‚ã‚‹ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ ã§ã®ãƒã‚°æœ‰åŠ¹æ´»ç”¨
ã¯ã˜ã‚ã« Fluentdã¯ã€ãƒã‚°ã‚’åŽé›†ã—æ ¼ç´ã™ã‚‹ãŸã‚ã®ãƒã‚°åŽé›†åŸºç›¤ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã§ã™ã€‚Fluentdã«ã‚¤ãƒ³ãƒ—ãƒƒãƒˆã•ã‚ŒãŸã€ã™ã¹ã¦ã®ãƒã‚°ã‚’JSONã«å¤‰æ›ã—ã€ã‚¢ã‚¦ãƒˆãƒ—ãƒƒãƒˆã—ã¾ã™ã€‚ã‚¤ãƒ³ãƒ—ãƒƒãƒˆã¨ã‚¢ã‚¦ãƒˆãƒ—ãƒƒãƒˆã¯ãƒ¢ã‚¸ãƒ¥ãƒ¼ãƒ«åŒ–ã•ã‚Œã¦ãŠã‚Šã€ãƒ¢ã‚¸ãƒ¥ãƒ¼ãƒ«ã‚’è¿½åŠ ã™ã‚‹ã“ã¨ã§ã‚¤ãƒ³ãƒ—ãƒƒãƒˆå…ƒã¨ã‚¢ã‚¦ãƒˆãƒ—ãƒƒãƒˆå…ˆã‚’è¿½åŠ ã§ãã‚‹ã‚ˆã†ã«ãªã£ã¦ã„ã¾ã™ã€‚ Fluentdã¯æ€¥é€Ÿã«çŸ¥ååº¦ã‚’é«˜ã‚ã€å¤šãã®Webã‚µãƒ¼ãƒ“ã‚¹ä¼šç¤¾ã§å®Ÿéš›ã«ä½¿ç”¨ã•ã‚Œã‚‹ã‚ˆã†ã«ãªã‚Šã¾ã—ãŸã€‚å¾“æ¥ã®ãƒã‚°ãŒæŠ±ãˆã¦ã„ãŸå•é¡Œã‚‚ã€FluentdãŒé©åˆ‡ãªè§£æ±ºç–ã¨ãªã£ã¦ã„ã‚‹ã¨èªçŸ¥ã•ã‚Œã€ã‹ã¤ç°¡å˜ã«å°Žå…¥ãƒ»ã‚¹ãƒ¢ãƒ¼ãƒ«ã‚¹ã‚¿ãƒ¼ãƒˆã§ãã‚‹ãƒŸãƒ‰ãƒ«ã‚¦ã‚§ã‚¢ã§ã‚ã£ãŸã“ã¨ãŒå¤§ãã‹ã£ãŸã¨æ€ã„ã¾ã™ã€‚ æœ¬ç¨¿ã§ã¯ã€Fluentdã®ç°¡å˜ãªä»•çµ„ã¿ã¨å°Žå…¥æ–¹æ³•ã€ã‚·ãƒ³ãƒ—ãƒ«ãªå‹•ä½œäº‹ä¾‹ã«ã¤ã„ã¦ç´¹ä»‹ã—ã¾ã™ã€‚ å¯¾è±¡èªè€… ã‚·ã‚¹ãƒ†ãƒ ç®¡ç†è€… ãƒ‡ãƒ¼ã‚¿ã‚µã‚¤ã‚¨ãƒ³ãƒ†ã‚£ã‚¹ãƒˆ å¿…è¦ãªç’°å¢ƒ UNIXç³»OS Ruby 1.9 ãƒã‚°ã‚’å‡ºåŠ›ã™ã‚‹ç†ç”± ã‚·ã‚¹ãƒ†ãƒ é‹ç”¨ã‚’å§‹ã‚ã‚‹
ko-ya-ma 2013/03/29
dev

log

basic

server

fluentd
ãƒªãƒ³ã‚¯
ã€ä»ŠåŒ—ç”£æ¥ã€‘3åˆ†ã§åˆ†ã‹ã‚‹LTSVæ¥ç•Œã®ã¾ã¨ã‚ã€LTSVã€‘ - naoyaã®ã¯ã¦ãªãƒ€ã‚¤ã‚¢ãƒªãƒ¼
id:stanaka ãŒã¯ã¦ãªã§ä½¿ã£ã¦å±…ã‚‹ãƒã‚°ãƒ•ã‚©ãƒ¼ãƒžãƒƒãƒˆãŒ LTSV ã ã‚ˆãƒ¼ã¨ãƒ–ãƒã‚°ã«æ›¸ã Labeled Tab Separated Values (LTSV) ãƒŽã‚¹ã‚¹ãƒ¡ - stanaka's blog Webç•Œéšˆã®ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ãŸã¡ã€ç‰¹ã«ãƒã‚°ã¨ã‹ã€#fluentd é–¢ä¿‚è€…ãŒã–ã‚ã¤ã ã€Œã–ã‚ãƒ»ãƒ»ãƒ»ã–ã‚ãƒ»ãƒ»ãƒ»ã€ @t_wada ã€ŒUnix å“²å¦ã®å¤§äº‹ãªç‚¹ãŒå½¢ã«ãªã£ã¦ã„ã‚‹ã¨æ€ã†ã€‚ç´ æ™´ã‚‰ã—ã„ã€‚ã€ @hotchpotch ã€Œcoolã€ å…æœ¬æœ¨ã€æ¸‹è°·ã€ç™½é‡‘å°æ–¹é¢ã‹ã‚‰äº¬éƒ½ã¸ç†±ã„è¦–ç·šãŒé€ã‚‰ã‚Œã‚‹ id:naoya ãŒãŸã vagrant + chef ã‚’ä½¿ã„ãŸã„ãŒãŸã‚ã« LTSV ã«ä¹—ã£ã‹ã‚‹ GrowthForecast ã‚’ä½¿ã£ã¦ã„ãŸãŸã‚ GF ã®ä¸ã®äººãŒåå¿œã™ã‚‹ @kazeburo ã€Œ[growthforecast]ã€ id:naoya ãŒå‹¢ã„ã§ Text::LTSV ã‚’ä½œã‚‹ ã‚ã¾ã‚Šåå¿œãŒãªã„ã®ã§ã—ã‚‡
ko-ya-ma 2013/02/08
dev

ltsv

data

trend

log

fluentd

chef
ãƒªãƒ³ã‚¯
ã‚¢ã‚¯ã‚»ã‚¹è§£æžã‚·ã‚¹ãƒ†ãƒ ã®è£å´ ï¼ˆå…¬é–‹ç”¨ï¼‰
This slide was presented in Tokyo.R #22.It describes about design of experiment with R. DoE.base package is useful for software testing because it makes easier for us to make orthogonal array.
ko-ya-ma 2012/09/24
å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã‚’ã„ã‹ã«ã•ã°ãã‹

log

server

dev

hadoop

mongodb

fluentd
ãƒªãƒ³ã‚¯
http://dl.dropbox.com/u/224433/fluentd_casual_1/index.html
ko-ya-ma 2012/05/19
fluentd

server

presentation

dev
ãƒªãƒ³ã‚¯
1