[B! fluentd] MAXIMUM-PROã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

MAXIMUM-PRO id:MAXIMUM-PRO

fluentdã«é–¢ã™ã‚‹MAXIMUM-PROã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (4)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Fluentdã®ä»•çµ„ã¿ -ãƒãƒƒãƒ•ã‚¡æ©Ÿèƒ½ã§ãƒã‚°åŽé›†æ¼ã‚Œã‚’é˜²ã- - Tech-Sketch
OSSã®ãƒã‚°åŽé›†ç®¡ç†ãƒ„ãƒ¼ãƒ«Fluentdã‚’ç”¨ã„ã¦ãƒã‚°ã‚’çµ±åˆç®¡ç†ã—ã¦ã„ã‚‹å ´åˆã®æ‡¸å¿µç‚¹ã¨ã—ã¦ã€ãƒã‚°ã®åŽé›†æ¼ã‚ŒãŒè€ƒãˆã‚‰ã‚Œã¾ã™ã€‚ Fluentdã§ã¯ã€ãƒãƒƒãƒ•ã‚¡æ©Ÿèƒ½ã‚’æ´»ç”¨ã™ã‚‹ã“ã¨ã§ãƒã‚°ã‚’åŽé›†æ¼ã‚Œã™ã‚‹ã“ã¨ãªãç¢ºå®Ÿã«åŽé›†ã™ã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚ ã“ã®ãƒãƒƒãƒ•ã‚¡æ©Ÿèƒ½ã®ãƒ¡ã‚«ãƒ‹ã‚ºãƒ ã‚’ç†è§£ã™ã¹ãå‹•ä½œæ¤œè¨¼ã—ãŸçµæžœã‚’ç´¹ä»‹ã—ã¾ã™ã€‚å¯¾è±¡ã¨ã™ã‚‹Fluentdã®ãƒãƒ¼ã‚¸ãƒ§ãƒ³ã¯0.10.30ã§ã™ã€‚ Fluentdã¨ã¯ Rubyå®Ÿè£…ã®OSSã®ãƒã‚°åŽé›†ç®¡ç†ãƒ„ãƒ¼ãƒ«ã§ã™ã€‚ Fluentdã¯ã€Inputã€Bufferã€Outputã®3ã¤ã®ã‚³ãƒ³ãƒãƒ¼ãƒãƒ³ãƒˆã§å®Ÿç¾ã•ã‚Œã¦ã„ã¾ã™ã€‚ æ§˜ã€…ãªå ´æ‰€ã‹ã‚‰ãƒã‚°ã‚’åŽé›†ã€JSONå½¢å¼ã«å¤‰æ›ã—(Input)ã€è“„ç©(Buffer)ã€æ§˜ã€…ãªå‡ºåŠ›å…ˆã«ãƒ‡ãƒ¼ã‚¿å‡ºåŠ›(Output)ã—ã¾ã™ã€‚ ä¾‹ã¨ã—ã¦ã€ã‚ã‚‹ã‚µãƒ¼ãƒ(server01)ã®Apacheã®ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ã‚’åˆ¥ã®ã‚µãƒ¼ãƒ(server02)å†…ã«ãƒ•ã‚¡ã‚¤ãƒ«ã¨ã—ã¦å‡ºåŠ›ã™ã‚‹å ´åˆ
MAXIMUM-PRO 2015/07/09
fluentd
ãƒªãƒ³ã‚¯
Rails4 + Fluentd + MySQL ã§ãƒ©ãƒ³ã‚ãƒ³ã‚°æ©Ÿèƒ½ä½œã£ã¦ã¿ãŸ - ç‹è‚‰ã¨ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ãƒªãƒ³ã‚°ã§ ã™ã¹ã¦ã‚’è§£æ±ºã™ã‚‹ãƒ–ãƒã‚°
ã‚¢ã‚¯ã‚»ã‚¹ãƒ©ãƒ³ã‚ãƒ³ã‚°ã‚’ä½œã£ã¦ã¿ã‚ˆã†ï¼ ä»Šã€Rails4 ã‚’ä½¿ã£ã¦ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ã‹ã‚‰ãƒ©ãƒ³ã‚ãƒ³ã‚°ä½œã£ã¦ã¿ãŸã„ãªããƒ¼ã¨æ€ã£ã¦ãŸã‚“ã§ã™ãŒã€ã¿ã‚“ãªã©ã†ã‚„ã£ã¦ã‚“ã ã‚ã†ã£ã¦èžã„ã¦ã¿ãŸã¨ã“ã‚ã€ Fluentd ã£ã¦ã®ã‚’çµ„ã¿è¾¼ã‚€ã ã‘ã§ç°¡å˜ã«é›†è¨ˆã¨ã‹ã§ãã‚‹ã‚ˆãƒ¼ã£ã¦è©±ã ã£ãŸã®ã§ã€ä½¿ã£ã¦ã¿ã¾ã—ãŸã€‚ Fluentd ã¨ã¯ ã¾ãšèªã¿æ–¹ã¯ã€ ã€Œãµã‚‹ãƒ¼ãˆã‚“ã¨ã§ãƒãƒ¼ã€ã§ã‚ã£ã¦ã€ã€Œãµã‚‹ãƒ¼ãˆã‚“ã©ã€ã¨ã‹ã˜ã‚ƒãªã„ã£ã½ã„ã§ã™ã€‚d ã¯ãŸã¶ã‚“ãƒ‡ãƒ¼ãƒ¢ãƒ³ã® d ã€‚ è‰²ã€…èª¬æ˜Žé¢å€’ãªã‚“ã§çœç•¥ã—ã¾ã™ãŒã€ãƒã‚°åŽé›†å…ƒã¨ã‹å‡ºåŠ›å…ˆãŒç°¡å˜ã«è¨å®šã§ãã¦ã€è‡ªåˆ†ã®æ¬²ã—ã„å½¢ã§ãƒã‚°ä¿æŒã§ãã¾ã™ã‚ˆãƒ¼ã£ã¦æ„Ÿã˜ã£ã½ã„ã€‚ãªã®ã§ã€ ã€Œã‚·ã‚§ãƒ«ã‚¹ã‚¯ãƒªãƒ—ãƒˆã§å‡¦ç†ã—ãŸ tail ã®å‡¦ç†çµæžœã‚’ãƒ•ã‚¡ã‚¤ãƒ«ã«ã€ã€Œnginx ã‹ã‚‰å‡ºåŠ›ã•ã‚ŒãŸã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ã‚’ mongo DB ã«ã€ã¨ã‹ãã†ã„ã†å‡¦ç†ã‚’è‡ªå‰ã§æ›¸ãå¿…è¦ãªãã€ç°¡å˜ãªè¨å®šã ã‘ã§ã„ã‘ã¡ã‚ƒã†ã€‚ è©³ã—ãã¯ â†’ æŸ”è»Ÿãªãƒã‚°åŽé›†ã‚’å¯èƒ½ã«ã™ã‚‹ã€Œfluentd
MAXIMUM-PRO 2014/10/14
MySQL

fluentd

ãƒ©ãƒ³ã‚ãƒ³ã‚°
ãƒªãƒ³ã‚¯
MySQLãƒ†ãƒ¼ãƒ–ãƒ«ã¸ã®æ›´æ–°/å‰Šé™¤ã‚¤ãƒ™ãƒ³ãƒˆã‚’é€æ¬¡å–å¾—ã™ã‚‹Fluentdãƒ—ãƒ©ã‚°ã‚¤ãƒ³ã€Œfluent-plugin-mysql-replicatorã€ã‚’ãƒªãƒªãƒ¼ã‚¹ã—ã¾ã—ãŸ - Y-Ken Studio
ä»»æ„ã®SQLã‚¯ã‚¨ãƒªã§å–å¾—ã—ãŸçµæžœã®å·®åˆ†ã‹ã‚‰ã€insert/update/deleteã‚¤ãƒ™ãƒ³ãƒˆã‚’æ¤œçŸ¥ã™ã‚‹ãƒ—ãƒ©ã‚°ã‚¤ãƒ³ã‚’ãƒªãƒªãƒ¼ã‚¹ã—ã¾ã—ãŸã€‚ã‚¤ãƒ™ãƒ³ãƒˆæ¤œçŸ¥ã ã‘ã§ãªãã€ãƒ¬ã‚³ãƒ¼ãƒ‰ã®å†…å®¹ã¨å…±ã«Elasticsearch/Solrã¸åŒæœŸã‚’è¡Œã†ã€Outputãƒ—ãƒ©ã‚°ã‚¤ãƒ³ã‚‚åŒå°ã—ã¦ã„ã¾ã™ã€‚ ã“ã‚Œã¯ã‚ãˆã¦ãƒã‚¤ãƒŠãƒªãƒã‚°(MySQLBinlog API)ã¯ä½¿ã‚ãšã«ã€SQLã‚¯ã‚¨ãƒªã®å®Ÿè¡Œçµæžœã®å·®åˆ†ã‚’è¦‹ã¦insert/update/deleteã‚¤ãƒ™ãƒ³ãƒˆã‚’æ¤œçŸ¥ã—ã¾ã™ã€‚ ãã®ãŸã‚ã€ç´”ç²‹ãªãƒ†ãƒ¼ãƒ–ãƒ«åŒæœŸã ã‘ã§ãªãã€ä»»æ„ã®JOINã‚„VIEWãƒ†ãƒ¼ãƒ–ãƒ«ã‚’å…ƒã¨ã—ãŸå·®åˆ†åŒæœŸå‡¦ç†ãŒå®Ÿç¾ã§ãã‚‹ã®ãŒç‰¹å¾´ã§ã™ã€‚ y-ken/fluent-plugin-mysql-replicator https://github.com/y-ken/fluent-plugin-mysql-replicator http://rubygems.org/gems/flue
MAXIMUM-PRO 2014/01/10
MySQL

fluentd
ãƒªãƒ³ã‚¯
FluentdãŒæµè¡Œã‚‹ç†ç”±ãŒã„ã¾åˆ†ã‹ã‚‹ã€10ã®å®Ÿè·µé€†å¼•ããƒ¦ãƒ¼ã‚¹ã‚±ãƒ¼ã‚¹é›† - Y-Ken Studio
ãƒã‚°ãƒ‡ãƒ¼ã‚¿ã‚’æ´»ç”¨ã—ã¦ãƒ“ã‚¸ãƒã‚¹ã«å½¹ç«‹ã¦ã‚ˆã†ã¨ã„ã†æœ€è¿‘ã®ãƒˆãƒ¬ãƒ³ãƒ‰ã¯ç†è§£ã§ãã‚‹ã€‚ ã—ã‹ã—ã€ãªãœãƒã‚°åŽé›†ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã®FluentdãŒã“ã‚Œã»ã©ã¾ã§è©±é¡Œã«ãªã‚‹ã®ã‹ã€ä¸æ€è°ã«æ„Ÿã˜ã¦ã„ã‚‹æ–¹ã‚‚ã„ã‚‹ã®ã§ã¯ãªã„ã ã‚ã†ã‹ã€‚å˜ã«ãƒã‚°ãƒ‡ãƒ¼ã‚¿ã‚’åŽé›†ã™ã‚‹ãªã‚‰ã°syslog-ngã‚„rsyslogã§ååˆ†ã§ã¯ãªã„ã‹ã¨ã„ã†æ„è¦‹ã‚‚ã‚ã‚‹ã ã‚ã†ã€‚ ãã‚Œã‚‰ã¯æ—¢å˜ã®ãƒã‚°ã‚·ã‚¹ãƒ†ãƒ ã‚’ç½®ãæ›ãˆã‚‹ãƒ—ãƒãƒ€ã‚¯ãƒˆã§ã‚ã‚Šã€Fluentdã®ãã‚Œã¨ã¯æ ¹æœ¬çš„ã«ç•°ãªã‚‹ã€‚Fluentdã¯ã€æ—¢å˜ã®ãƒã‚°ã‚·ã‚¹ãƒ†ãƒ ã«æ‰‹ã‚’å…¥ã‚Œã‚‹ã“ã¨ãªãæ–°ãŸã«ãƒã‚°ã®åŽé›†ã‚’è¡Œã„ã€ã‚¹ãƒˆãƒªãƒ¼ãƒ ãƒ‡ãƒ¼ã‚¿å‡¦ç†ã‚’å®Ÿç¾ã™ã‚‹ãƒ—ãƒãƒ€ã‚¯ãƒˆãªã®ã§ã‚ã‚‹ã€‚ ä¸€èˆ¬çš„ã«ãƒã‚°ãƒ‡ãƒ¼ã‚¿ã¯ã‚µãƒ¼ãƒã®æ•°ã ã‘åˆ†æ•£ã—ã¦ãŠã‚Šã€ãã‚Œã‚’å®šæœŸå®Ÿè¡Œå‡¦ç†ã§åŽé›†ã™ã‚‹ã¨ã„ã†ã“ã¨ã ã‘ã§ã‚‚ã€ãªã‹ãªã‹éª¨ã®æŠ˜ã‚Œã‚‹ä»•äº‹ã§ã‚ã‚‹ã€‚ã•ã‚‰ã«é›†ã‚ã‚‹ã ã‘ã§ãªãã€æ—¥ã€…å¢—ãˆç¶šã‘ã‚‹ãƒã‚°ãƒ‡ãƒ¼ã‚¿ã‚’æ´»ç”¨ã§ãã‚‹å½¢ã«åŠ å·¥ã—ã¦ã—ã‹ã‚‹ã¹ããƒ‡ãƒ¼ã‚¿ã‚¹ãƒˆã‚¢ã«ä¿ç®¡ã™ã‚‹ã¨ã„ã†ã“ã¨ã«æŒ«æŠ˜ã—ãŸæ–¹ã‚‚ã„ã‚‹ã®ã§ã¯
MAXIMUM-PRO 2013/12/05
fluentd
ãƒªãƒ³ã‚¯
1