[B! norikra] i43sã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

i43s id:i43s

norikraã«é–¢ã™ã‚‹i43sã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (7)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Norikra Meetup #2 å‚åŠ ãƒ¬ãƒãƒ¼ãƒˆ - ç„¡å°å‰æ¾¤
ã‚¤ãƒ™ãƒ³ãƒˆãƒšãƒ¼ã‚¸: Norikra meetup #2 : ATND åƒ•è‡ªèº«ã¯Norikraä½¿ã£ãŸã“ã¨ãªã„ã®ã§ã™ãŒã€å‘¨å›²ã«ã¯ä½¿ã£ã¦ã„ã‚‹äººãŒã„ã¦è©•åˆ¤ã‚‚è‰¯ã„ã®ã§ã€ä»–ã®äººã®ãƒ¦ãƒ¼ã‚¹ã‚±ãƒ¼ã‚¹ã‚‚èžã„ã¦ã¿ãŸã„ã€ã‚ã‚ã‚ˆãã°è‡ªåˆ†ã¨ã“ã®æ¥å‹™ã«ã‚‚ãã˜è¾¼ã¿ãŸã„ã€ã¨æ€ã„å‚åŠ ã—ã¦ãã¾ã—ãŸã€‚æœŸå¾…é€šã‚Šã€ãƒ¦ãƒ¼ã‚¹ã‚±ãƒ¼ã‚¹ã‚’è‰²ã€…èžã‘ã¦é¢ç™½ã‹ã£ãŸã§ã™ã€‚ ä»Šå›žèžã„ãŸNorikraã®ãƒ¦ãƒ¼ã‚¹ã‚±ãƒ¼ã‚¹ã«ã¯ã€å¤§ä½“ä»¥ä¸‹ã®ã‚ˆã†ãªå…±é€šç‚¹ãŒã‚ã‚Šãã†ã«æ„Ÿã˜ã¾ã—ãŸã€‚ ã‚¹ãƒ†ãƒ¼ã‚¿ã‚¹ã‚³ãƒ¼ãƒ‰ã”ã¨ã®ä»¶æ•°ã‚’é›†è¨ˆã™ã‚‹ãŸã‚ã«ä½¿ã£ã¦ã„ã‚‹ã¨ã“ã‚ãŒå¤šã„ Norikraã§ã®é›†è¨ˆçµæžœã¯ã€Fluentdã‚’ä»‹ã—ã¦ã€ä»–ã®ãƒ„ãƒ¼ãƒ«ï¼ˆMackerelã‚„ã‚‰Zabbixã‚„ã‚‰ï¼‰ã«æ¸¡ã™ NorikraãŒè½ã¡ãŸã‚‰è½ã¡ãŸã§è«¦ã‚ã‚‹ã¨ã„ã†å‰²ã‚Šåˆ‡ã‚Šã§ä½¿ã†ï¼ˆå†—é•·åŒ–ã¯cold standbyç¨‹åº¦ï¼‰ åŒã˜ãƒ‡ãƒ¼ã‚¿ã‚’ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã«ã‚‚æµã—è¾¼ã¿ã€Norikraã¯ã‚ãã¾ã§é€Ÿå ±å€¤ã‚„ã‚¢ãƒ©ãƒ¼ãƒˆç”¨ã«ä½¿ã† ãƒ¡ãƒ¢ãƒªã‚’å¤§é‡ã«ç©ã‚“ã ãƒžã‚·ãƒ³ã‚’ç”¨æ„
i43s 2015/06/05
norikra
ãƒªãƒ³ã‚¯
Norikra meetupã‚„ã£ã¦ããŸ - ãŸã”ã‚‚ã‚Šã™ãƒ¡ãƒ¢
Norikra meetup : ATND DeNA Techno logy Seminar #Norikra meetup Norikra ãŒã„ã„æ„Ÿã˜ã«ãªã£ã¦ããŸã®ã§ã€ãƒ¦ãƒ¼ã‚¶(ã¨ã‚³ãƒŸãƒƒã‚¿)ã‚‚ã†ã¡ã‚‡ã£ã¨å¢—ãˆãªã„ã‹ãªãƒ¼ã¨æ€ã„ã€Norikra meetupã¨ã„ã†å‹‰å¼·ä¼šã‚’ã‚„ã£ãŸã€‚ä¼šå ´ã€Ustreamä¸ç¶™ãŠã‚ˆã³æ‡‡è¦ªä¼šã‚’:DeNAã•ã‚“ã«ã”æä¾›ã„ãŸã ãã¾ã—ãŸã€‚ã„ã¤ã‚‚ã„ã¤ã‚‚æœ¬å½“ã«ãŠä¸–è©±ã«ãªã£ã¦ã„ã¾ã™ãŒã€ã™ã°ã‚‰ã—ã„ä¼šå ´ã‚’ã‚ã‚ŠãŒã¨ã†ã”ã–ã„ã¾ã™ã€‚ å®šå“¡80äººã«å¯¾ã—ã¦å‚åŠ ã¯è©±ã™äººã‚‚å«ã‚ã¦60äººã¡ã‚‡ã£ã¨ãã‚‰ã„ï¼Ÿ è‡ªåˆ†ãŒæœ€è¿‘ä¸»å‚¬ã—ãŸå‹‰å¼·ä¼šã¯ã‚‚ã£ã¨å‡ºå¸çŽ‡è‰¯ã‹ã£ãŸæ°—ãŒã™ã‚‹ã®ã§æ°—ã«ã—ã¦ãªã‹ã£ãŸã‚‰ã€ä»Šå›žã¯å°‘ã—ä½Žã‹ã£ãŸã€‚ã‚‚ã†ã¡ã‚‡ã£ã¨ã‚µãƒèªã‚“ã å®šå“¡ã«ã—ã¦ãŠã‘ã°ã‚ˆã‹ã£ãŸã€‚è£œæ¬ ã‚‚å«ã‚ãŸç”³ã—è¾¼ã¿æ•°ã¯çµå±€170äººã¨ã‹ã®ã¾ã¾ã ã£ãŸã®ã§ã€ã‚‚ã£ãŸã„ãªã‹ã£ãŸã€‚ ã¨ã¯ã„ãˆã€èžã„ã¦ã¿ãŸã¨ã“ã‚ã“ã‚Œã‹ã‚‰è©¦ã—ã¦ã¿ã‚‹ï¼ã¨ã„ã†äººãŒã‘ã£ã“ã†ã„ãã†ã ã£ãŸã®ã§å¬‰ã—
i43s 2014/07/10
Norikraãƒžã‚¸ä¾¿åˆ©ãã†ã ã£ãŸ

norikra
ãƒªãƒ³ã‚¯
2014/07/10 #norikra meetup
fujiwara @fujiwara fluentdã‹ã‚‰norikraã«ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°æµã—ã¦ã€statusã”ã¨ã«countã—ãŸã®ã‚’fluentdã«æˆ»ã™ã¨ã“ã‚ã¾ã§ã§ããŸã®ã§ã€ã“ã‚Œã§äºˆç¿’ã§ããŸã“ã¨ã«ã—ã¦ãŠã“ã† 2014-07-09 18:08:25
i43s 2014/07/10
norikra
ãƒªãƒ³ã‚¯
http://blog.yoslab.com/entry/2014/07/09/202304
i43s 2014/07/09
norikra
ãƒªãƒ³ã‚¯
Norikra+Fluentdã§DoSæ”»æ’ƒã‚’ãƒ–ãƒãƒƒã‚¯ã™ã‚‹ä»•çµ„ã¿ã‚’ä½œã£ã¦ã¿ãŸ ï½œ Developers.IO
Norikraã¨ã¯ Norikraã¨ã¯ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ é›†è¨ˆãƒ—ãƒãƒ€ã‚¯ãƒˆã§ã™ã€‚ã‚¤ãƒ™ãƒ³ãƒˆã‚¹ãƒˆãƒªãƒ¼ãƒ ã«å¯¾ã—ã¦SQLãƒ©ã‚¤ã‚¯ãªè¨€èªžã§å‡¦ç†ã‚’æ›¸ãã“ã¨ãŒå‡ºæ¥ã¾ã™ã€‚ ä¾‹ãˆã°ã€Apacheã®ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ã‚’Norikraã«æµã—è¾¼ã¿ã€1åˆ†ã‚ãŸã‚Šã®ã‚¢ã‚¯ã‚»ã‚¹æ•°ã‚„ãƒ¬ã‚¹ãƒãƒ³ã‚¹ã‚¿ã‚¤ãƒ ã®æœ€å¤§å€¤ã‚’ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ ã«é›†è¨ˆã™ã‚‹ã“ã¨ãŒå‡ºæ¥ã¾ã™ã€‚ Norikraã®åˆ©ç”¨ä¾‹ã¯ä½œè€…ã§ã‚ã‚‹tagomorisã•ã‚“ã®ãƒ–ãƒã‚°ã§ç´¹ä»‹ãŒã‚ã‚Šã¾ã™ã€‚ ä»Šå›žã¯ã€Norikraã‚’ä½¿ã£ã¦DoSæ”»æ’ƒã‚’ãƒ–ãƒãƒƒã‚¯ã™ã‚‹ä»•çµ„ã¿ã‚’ä½œã£ã¦ã¿ã¾ã—ãŸã€‚ DoSæ”»æ’ƒãƒ–ãƒãƒƒã‚¯ã®ä»•çµ„ã¿ ã‚¢ã‚¯ã‚»ã‚¹å…ƒã¯Apacheã®ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ã‹ã‚‰å–å¾—ã—ã€ãƒã‚°ã®å—ã‘æ¸¡ã—ã«ã¯Fluentdã‚’åˆ©ç”¨ã—ã¾ã—ãŸã€‚ ãƒ–ãƒãƒƒã‚¯ã®æ‰‹é †ã¯ä»¥ä¸‹ã®ã‚ˆã†ã«ãªã‚Šã¾ã™ã€‚ ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ã‚’Fluentdã®in_tailãƒ—ãƒ©ã‚°ã‚¤ãƒ³ã§å–å¾—ã€‚ Fluentdã®out_norikraãƒ—ãƒ©ã‚°ã‚¤ãƒ³ã§ã€ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ã‚’Norikraã«æµã—è¾¼ã¿ã€‚ Norikra
i43s 2014/07/09
norikra
ãƒªãƒ³ã‚¯
Landscape of Norikra features
2. target/query persistence (1) Norikra does NOT save targets/queries by default. v1.0.4 warn on log Use â€œ--stats=PATHâ€ option to save targets/queries on speciï¬ed path at shutdown Targets/queries are loaded automatically after restarts if â€œ--statsâ€ speciï¬ed 14å¹´7æœˆ9æ—¥æ°´æ›œæ—¥ 3. target/query persistence (2) â€œ--dump-stat-interval=Nâ€ Autosave targets/queries every speciï¬ed interval (not only on shutdown) â€œ-
i43s 2014/07/09
norikra
ãƒªãƒ³ã‚¯
Stream processing and Norikra
7. Processing models Batch processing: RDBMS, Hadoop(Hive), BigQuery/RedShift Stream processing: Storm, Spark streaming, Norikra 14å¹´7æœˆ9æ—¥æ°´æ›œæ—¥ 8. Batch processing RDBMS, Hadoop/Hive, .... (transaction is out of this topic) Target window: hours - weeks (or more) Total throuput: HIGHEST Query Latency: LARGEST (20sec - mins - hours) 14å¹´7æœˆ9æ—¥æ°´æ›œæ—¥ 9. Stream processing Storm, Esper, Norikra, Fluentd, .... Ka
i43s 2014/07/09
norikra
ãƒªãƒ³ã‚¯
1