[B! ãƒã‚°] harumaki_netã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

harumaki_net id:harumaki_net

ãƒã‚°ã«é–¢ã™ã‚‹harumaki_netã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (15)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

S3ã«ã‚ã‚‹ALBãƒã‚°ã®èª¿æŸ»ã¯Athenaã‚ˆã‚ŠDuckDBã®ã»ã†ãŒç°¡å˜ - road288ã®æ—¥è¨˜
AWSã®ALB(Application Load Balancer)ã®ãƒã‚°ã¯S3ã«ç½®ã‹ã‚Œã‚‹ãŒã€ã“ã®ä¸èº«ã‚’ã‚µã‚¯ãƒƒã¨èª¿ã¹ãŸã„ã¨ãã€Athenaã‚’ä½¿ã†æ–¹æ³•ãŒæ¨™æº–çš„ã§ã€ä¸‹è¨˜ã§æ¡ˆå†…ã•ã‚Œã¦ã„ã‚‹ã‚ˆã†ã«ãƒ‘ãƒ¼ãƒ†ã‚£ã‚·ãƒ§ãƒ³å°„å½±(Partition Projection)ã§ãƒ†ãƒ¼ãƒ–ãƒ«ã‚’ä½œã£ã¦Athenaã‹ã‚‰ã‚¯ã‚¨ãƒªã™ã‚‹ã€‚ ãƒ‘ãƒ¼ãƒ†ã‚£ã‚·ãƒ§ãƒ³å°„å½±ã‚’ä½¿ç”¨ã—ã¦ Athena ã§ ALB ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ç”¨ãƒ†ãƒ¼ãƒ–ãƒ«ã‚’ä½œæˆã™ã‚‹ - Amazon Athena ç§ã‚‚å¾“æ¥ã¯ãã®æ–¹æ³•ã‚’ä½¿ã£ã¦ã„ãŸãŒã€Athenaã¯ãƒ–ãƒ©ã‚¦ã‚¶ã‹ã‚‰ä½¿ã†ã¨å‹•ä½œãŒã‚‚ã£ã•ã‚Šã—ã¦ã„ã‚‹ã—ã€æ±ºã¾ã£ãŸã‚¯ã‚¨ãƒªã‚’1å›žãã‚Šå®Ÿè¡Œã—ã¦çµæžœã‚’å–å¾—ã—ãŸã„ã ã‘ã®ã¨ããªã‚‰ã¾ã ã—ã‚‚ã€æŽ¢ç´¢çš„ã«ã‚¯ã‚¨ãƒªã‚’ä½•ç™ºã‚‚å®Ÿè¡Œã—ãŸã„ã¨ãã«ã¯ä½¿ã„å‹æ‰‹ãŒæ‚ªã„ã€‚ æœ€è¿‘ä»–ã®ãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã§DuckDBã‚’ä½¿ã†ã‚ˆã†ã«ãªã£ã¦ã€ä½¿ã„å‹æ‰‹ã®è‰¯ã•ã«æ„Ÿå‹•ã—ã¦ã„ãŸãŒã€DuckDBã¯ALBã®ãƒã‚°ã‚’æŽ¢ç´¢çš„ã«èª¿ã¹ãŸã„ã¨ãã«ã‚‚ã‚ã£ã¡ã‚ƒä½¿ãˆã‚‹ã¨æ€ã£ãŸ
harumaki_net 2024/11/07
aws

ãƒã‚°
ãƒªãƒ³ã‚¯
ãƒ¡ãƒˆãƒªã‚¯ã‚¹ã€ãƒã‚°ã€ãƒˆãƒ¬ãƒ¼ã‚¹ã‚’ã†ã¾ãä½¿ã„åˆ†ã‘ã¦å¯è¦³æ¸¬æ€§ã‚’é«˜ã‚ã‚ˆã†ï¼
ã‚¤ãƒ™ãƒ³ãƒˆå: ã‚ªãƒ–ã‚¶ãƒ¼ãƒãƒ“ãƒªãƒ†ã‚£å†å…¥é–€ - å¤§åˆ‡ã•ã¨é«˜ã‚æ–¹ã‚’çŸ¥ã‚ã†ï¼ ã‚¤ãƒ™ãƒ³ãƒˆURL: https://mackerelio.connpass.com/event/316449/ æ¦‚è¦: å¯è¦³æ¸¬æ€§ã®æ¦‚å¿µã‚’ç†è§£ã—ã€OpenTelemetryãªã©ã®å®Ÿè£…ã«å¿…è¦ãªé“å…·ãŒã‚ã£ã¦ã‚‚ã€è‡ªåˆ†ãŸã¡ã®ãƒ—ãƒãƒ€ã‚¯ãƒˆã‚„ãƒãƒ¼ãƒ â€¦
harumaki_net 2024/06/06
ç›£è¦–

ãƒã‚°

ã‚¤ãƒ™ãƒ³ãƒˆ
ãƒªãƒ³ã‚¯
console.logã¾ã¨ã‚ 2016å¹´å¤ - Qiita
console.logé–¢é€£ã«ã¤ã„ã¦ã¾ã¨ã‚ã¾ã—ãŸã€‚ ãƒ¢ãƒ€ãƒ³ãƒ–ãƒ©ã‚¦ã‚¶ã§ã‚ã‚Œã°ã©ã‚Œã‚‚ä½¿ç”¨ã§ãã‚‹ã¨æ€ã„ã¾ã™ãŒã€åŸºæœ¬å‡ºåŠ›çµæžœç‰ã¯chromeã§ç¢ºèªã—ãŸã‚‚ã®ã§ã™ã€‚ console.hogehogeã®ã„ã‚ã„ã‚ åŸºæœ¬ å¼•æ•°ã‚’å…¥ã‚Œã‚‹ã“ã¨ã§å‡ºåŠ›çµæžœã‚’ã‚«ã‚¹ã‚¿ãƒžã‚¤ã‚ºã§ãã¾ã™ console.infoã€console.warnã€console.error ãã‚Œãžã‚Œã§è¦‹ãŸç›®ã‚’å¤‰ãˆã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚ console.assert å¼ã‚’è©•ä¾¡ã—ã¦falseã®å ´åˆã«ãƒã‚°å‡ºåŠ›ã—ã¾ã™ã€‚ console.count ãƒã‚°ã®å‡ºåŠ›çµæžœãŒåŒã˜å ´åˆã«ã‚«ã‚¦ãƒ³ãƒˆæ•°ãŒè‡ªå‹•çš„ã«å¢—ãˆã¦ã„ãã¾ã™ã€‚ console.dir ã‚ªãƒ–ã‚¸ã‚§ã‚¯ãƒˆã®ãƒ—ãƒãƒ‘ãƒ†ã‚£ã®ä¸èº«ã‚’ãƒã‚°ã«å‡ºåŠ›ã—ã¾ã™ã€‚ console.dirxml HTMLã¨ã‹XMLã®è¦ç´ ã‚’æ¸¡ã™ã¨ã€ä¸‹ã®è¦ç´ ãŒå…¨éƒ¨è¦‹ã‚Œã‚‹ã‚ˆã†ã«ãªã‚Šã¾ã™ã€‚ console.groupã€conosle.groupCollapsed co
harumaki_net 2016/08/19
chrome

ãƒã‚°

ã¾ã¨ã‚
ãƒªãƒ³ã‚¯
ã€Œãƒã‚°ã®è¦‹ã‹ãŸã€ï½žåˆå¿ƒè€…ã§ã‚‚ã‚ˆãã‚ã‹ã‚‹ï¼VPSã«ã‚ˆã‚‹Webã‚µãƒ¼ãƒãƒ¼é‹ç”¨è¬›åº§(1) | ã•ãã‚‰ã®ãƒŠãƒ¬ãƒƒã‚¸
ã•ãã‚‰ã®VPSã‚’ä½¿ã£ãŸã€åˆå¿ƒè€…å‘ã‘ã®è¨˜äº‹ã€ŒVPSã«ã‚ˆã‚‹Webã‚µãƒ¼ãƒãƒ¼æ§‹ç¯‰è¬›åº§ã€ã‚’åŠå¹´å‰ã«å…¬é–‹ã—ã¾ã—ãŸã€‚ã•ãã‚‰ã®VPSã‚’ä½¿ã£ã¦Webã‚µãƒ¼ãƒãƒ¼ã‚’æ§‹ç¯‰ã—ã€WordPressã‚’ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã™ã‚‹ã¾ã§ã®æ‰‹é †ã‚’è§£èª¬ã—ã¾ã—ãŸã€‚ ã—ã‹ã—ã€ã‚µãƒ¼ãƒãƒ¼ã¯æ§‹ç¯‰ãŒå®Œäº†ã—ãŸã‚‰ãã“ã§çµ‚ã‚ã‚Šã§ã¯ãªãã€ç¨¼åƒã—ç¶šã‘ã¦ã„ã‚‹é–“ã¯ãƒ¡ãƒ³ãƒ†ãƒŠãƒ³ã‚¹ã‚’ã—ã¦ã„ã‹ãªã‘ã‚Œã°ã„ã‘ãªã„ã—ã€å®‰å…¨ã«é‹ç”¨ã™ã‚‹ã«ã¯ã‚»ã‚ãƒ¥ãƒªãƒ†ã‚£ã«ã‚‚æ°—ã‚’ã¤ã‹ã‚ãªã‘ã‚Œã°ãªã‚Šã¾ã›ã‚“ã€‚ ãã“ã§ã€VPSæ§‹ç¯‰è¬›åº§ã®ç¶šç·¨ã¨ã—ã¦ã€Œé‹ç”¨ç·¨ã€ã‚’ãŠå±Šã‘ã—ã¾ã™ã€‚ã„ã£ãŸã‚“Webã‚µãƒ¼ãƒãƒ¼ã¨ã—ã¦ç¨¼åƒã—ã¯ã˜ã‚ãŸã‚µãƒ¼ãƒãƒ¼ã«ã¤ã„ã¦ã€ç¶™ç¶šã—ã¦ã‚µãƒ¼ãƒ“ã‚¹ã‚’ç¶šã‘ã¦ã„ã‘ã‚‹ã‚ˆã†ã«é‹ç”¨ã®ãƒŽã‚¦ãƒã‚¦ã‚’ãŠå±Šã‘ã—ã¾ã™ã€‚ é‹ç”¨ç·¨ã®é€£è¼‰ã¯ï¼•å›žã«åˆ†ã‘ã¦è¡Œã†äºˆå®šã§ã™ãŒã€ã¾ãšåˆå›žã¯ã€Œãƒã‚°ãƒ•ã‚¡ã‚¤ãƒ«ã®è¦‹ã‹ãŸã€ã«ã¤ã„ã¦è§¦ã‚ŒãŸã„ã¨æ€ã„ã¾ã™ã€‚ ãƒã‚°ãƒ•ã‚¡ã‚¤ãƒ«ã«ã¤ã„ã¦å¤§ãã2ç¨®é¡žã®ãƒã‚°ã‚’ã”ç´¹ä»‹ã—ã¾ã™ã€‚ Webã‚µãƒ¼ãƒãƒ¼Apacheã®ãƒã‚°ã®è¦‹ã‹ãŸ sshé–¢é€£ã®
harumaki_net 2015/08/26
ãƒã‚°
ãƒªãƒ³ã‚¯
2ç¨®é¡žã®ãƒã‚°è§£æžåŸºç›¤ - wyukawa's diary
åƒ•ã¯ä»•äº‹ã§ã¯2ç¨®é¡žã®ãƒã‚°è§£æžåŸºç›¤ã‚’è¦‹ã¦ã„ã¾ã™ã€‚ 1ã¤ç›®ã¯ã©ã¡ã‚‰ã‹ã¨ã„ã†ã¨ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã‚ˆã‚Šã®è§£æžåŸºç›¤ã§ã‚µãƒ¼ãƒ“ã‚¹å´ã®ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ãŒShib, ShibUIã‚’é€šã—ã¦å¥½ãã«ã‚¯ã‚¨ãƒªã‚’æŠ•ã’ã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚ãŸã ã—tableã‚’createã—ãŸã‚Šdropã—ãŸã‚Šinsertã—ãŸã‚Šã¯ã§ãã¾ã›ã‚“ã€‚selectã®ã¿ã§ã™ã€‚ãƒ‡ãƒ¼ã‚¿ã®æ›´æ–°ä½œæ¥ã¯åˆ¥é€”cronã®hive batchã§è¡Œã„ã¾ã™ã€‚ãƒ‡ãƒ¼ã‚¿ã¯FluentdçµŒç”±ã§å„ã‚µãƒ¼ãƒ“ã‚¹ã®ã‚µãƒ¼ãƒãƒ¼ã‹ã‚‰åŽé›†ã—ã¾ã™ã€‚ã“ã£ã¡ã®ã‚·ã‚¹ãƒ†ãƒ ã¯å¤ãã‹ã‚‰ã‚ã£ã¦åƒ•ã¯å¼•ãç¶™ã„ã ã ã‘ãªã®ã§è¦‹ã¦ã„ã‚‹ã¨ã¯ã„ã£ã¦ã‚‚ãã‚“ãªã«ã‚„ã‚‹ã“ã¨ã¯ç„¡ã„ã§ã™ã—ã€èªžã‚Œã‚‹ã“ã¨ã‚‚å°‘ãªã„ã§ã™ã€‚ 2ã¤ç›®ã¯ç´„1å¹´å‰ã«åƒ•ãŒä¸€ã‹ã‚‰æ§‹ç¯‰ã—ãŸã‚·ã‚¹ãƒ†ãƒ ã§ãƒ—ãƒ©ãƒ³ãƒŠãƒ¼ã‚ˆã‚Šã®ã‚·ã‚¹ãƒ†ãƒ ã«ãªã£ã¦ã¾ã™ã€‚åƒ•ã®ãƒãƒ¼ãƒ å†…ã®ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã ã‘ãŒrawãƒ‡ãƒ¼ã‚¿ã‚’è§¦ã£ãŸã‚Šæ›´æ–°ã—ãŸã‚Šã™ã‚‹ã“ã¨ãŒã§ãã¦ã€ãƒ—ãƒ©ãƒ³ãƒŠãƒ¼ã¯ãƒ¬ãƒãƒ¼ãƒˆã‚’é€šã—ã¦åŠ å·¥ã•ã‚ŒãŸãƒ‡ãƒ¼ã‚¿ã‚’è¦‹ã‚‹å½¢ã«ãªã‚Šã¾ã™ã€‚ãªã®ã§1ã¤ç›®ã®ã‚·ã‚¹
harumaki_net 2015/05/03
ãƒ‡ãƒ¼ã‚¿

ãƒã‚°

ã‚¤ãƒ³ãƒ•ãƒ©
ãƒªãƒ³ã‚¯
Kibanaã§ãƒã‚°åˆ†æžã‚’1å¹´ç¶šã‘ã¦ã¿ãŸã‚‰æ¥å‹™ã‚·ã‚¹ãƒ†ãƒ ã®ä¿å®ˆã¨é‹ç”¨ãŒæ—ã£ãŸ / How&Why I have been leveraging Kibana for DevOps
2015/4/4, Elasticsearchå‹‰å¼·ä¼š in åå¤å±‹ https://elasticsearch.doorkeeper.jp/events/21984 ãƒ–ãƒã‚° http://blog.exoego.net/2015/04/kibana4-use-case.html
harumaki_net 2015/04/07
ãƒã‚°

é‹ç”¨
ãƒªãƒ³ã‚¯
ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã§ã‚‚ã‚¿ãƒ¼ãƒŸãƒŠãƒ«ä½œæ¥ãƒã‚°ã‚’æ®‹ã—ãŸã„!! - ç›®ã®å‰ã«åƒ•ã‚‰ã®é“ãŒã‚ã‚‹
ä»Šã¾ã§ä¸‹è¨˜ã®ã‚ˆã†ã«execã§æ¨™æº–å‡ºåŠ›ã¨æ¨™æº–ã‚¨ãƒ©ãƒ¼å‡ºåŠ›ã‚’ä½œæ¥ãƒã‚°ã«æ®‹ã™ã¨ã„ã†äº‹ã‚’ã—ã¦ãŸã‚“ã§ã™ãŒã€å®Ÿéš›ã«æ‰“ã£ãŸã‚³ãƒžãƒ³ãƒ‰ã¯å‡ºåŠ›ã•ã‚Œãªã„ã®ã§ã€ã¡ã‚‡ã£ã¨ä¸ä¾¿ã ãªãƒ¼ã¨æ€ã£ã¦ã¾ã—ãŸã€‚ exec > >(tee --append /tmp/$(date +"%Y.%m.%d")_$(id --user).work.log) 2>&1 ã¡ã‚‡ã£ã¨èª¿ã¹ã¦è¦‹ã‚‹ã¨scriptã‚³ãƒžãƒ³ãƒ‰ã‚’ä½¿ã†ã¨ã‚³ãƒžãƒ³ãƒ‰ã‚’å«ã‚ã¦å‡ºåŠ›ã§ãã‚‹ã“ã¨ã‚’çŸ¥ã‚Šã¾ã—ãŸã€‚ ã“ã‚Œã§ä½œæ¥ãƒã‚°ã‚’æ®‹ã™ã®ãŒã¯ã‹ã©ã‚‹! script --append --flush /tmp/$(date +"%Y.%m.%d")_$(id --user).work.log ãƒãƒ¼ãƒ ãƒ¡ãƒ³ãƒãƒ¼ã«ã“ã®ãƒã‚°ã‚’tailã•ã›ã¦ãŠã‘ã°ã€ç”»é¢å…±æœ‰ã‚‚å‡ºæ¥ãŸã‚Šã‚‚ã—ã¾ã™ã€‚ (ãã®ç”¨é€”ãªã‚‰ãƒ›ãƒ³ãƒˆã¯wem uxã¨ã‹ä½¿ã£ãŸæ–¹ãŒè‰¯ã„ã‚“ã§ã—ã‚‡ã†ã‘ã©ãã€‚ã€‚ tail -F /tmp/$(date +"%Y.%m.%
harumaki_net 2014/03/25
linux

ãƒã‚°
ãƒªãƒ³ã‚¯
tmuxã®pipe-paneã‚’åˆ©ç”¨ã—ã¦ãƒªãƒ¢ãƒ¼ãƒˆã‚µãƒ¼ãƒã§ã®ä½œæ¥ãƒã‚°ã‚’ãƒãƒ¼ã‚«ãƒ«ã«è¨˜éŒ²ã™ã‚‹ - Glide Note
sshã‚„moshã§ãƒªãƒ¢ãƒ¼ãƒˆã‚µãƒ¼ãƒã«æŽ¥ç¶šã™ã‚‹éš›ã«ã€tmuxã®windowã‚’è‡ªå‹•ã§ç”Ÿæˆã—ã¦ãŠã‚Šã€ ãƒªãƒ¢ãƒ¼ãƒˆã‚µãƒ¼ãƒã«æŽ¥ç¶šã¨tmuxãŒã‚»ãƒƒãƒˆã«ãªã£ã¦ã„ã‚‹ã®ã§ã€tmuxã‚’ä½¿ã£ã¦ãƒªãƒ¢ãƒ¼ãƒˆã‚µãƒ¼ãƒã§ã®ä½œæ¥ãƒã‚°ã‚’ãƒãƒ¼ã‚«ãƒ«ã«ä¿å˜å‡ºæ¥ãªã„ã‹ã¨æ€ã£ã¦èª¿ã¹ã¦ã„ãŸã‚‰ pipe-paneã‚’åˆ©ç”¨ã™ã‚‹ã¨å¯èƒ½ã½ã„ã®ã§ã‚„ã£ã¦ã¿ãŸã€‚ åˆ©ç”¨ç’°å¢ƒã¯tmux 1.7ã§ã™ã€‚(OSã¯Mountain Lionã€SL6.1ã€CentOS6.3å…¨ã¦ã§å‹•ä½œã—ã¾ã—ãŸã€‚) ãƒã‚°ç”¨ãƒ‡ã‚£ãƒ¬ã‚¯ãƒˆãƒªã‚’ç”¨æ„ pipe-paneã‚’åˆ©ç”¨ã™ã‚‹å‰ã«ãƒã‚°ç”¨ãƒ‡ã‚£ãƒ¬ã‚¯ãƒˆãƒªã‚’ä½œã£ã¦ãŠãã€‚ prefix key + Hã§ãƒã‚®ãƒ³ã‚°é–‹å§‹ prefix key + hã§ãƒã‚®ãƒ³ã‚°çµ‚äº† ã¨ã„ã†æ„Ÿã˜ã§ã™ã€‚ ãã†ã™ã‚‹ã¨~/.tmux/tmux-hogemoge.logã¿ãŸã„ãªãƒã‚°ãŒå‡ºæ¥ä¸ŠãŒã‚‹ã€‚ hogemogeã®éƒ¨åˆ†ã¯tmuxã®windowåãŒå…¥ã‚Šã¾ã™ã€‚tmuxã®ãƒãƒ¼ã‚¸ãƒ§ãƒ³ãŒå¤ã„ã¨ tmu
harumaki_net 2014/03/25
ã‚¿ãƒ¼ãƒŸãƒŠãƒ«

ãƒã‚°

ã‚ã¨ã§èªã‚€
ãƒªãƒ³ã‚¯
excale.net
This domain may be for sale!
harumaki_net 2014/02/27
ãƒã‚°

fluentd

ã‚ã¨ã§èªã‚€
ãƒªãƒ³ã‚¯
ãƒã‚°é›†è¨ˆã‚·ã‚¹ãƒ†ãƒ ã‚’è‡ªå‰ã§ä½œã‚‹ - Y's note
Index ãƒã‚°é›†è¨ˆã‚·ã‚¹ãƒ†ãƒ ã®è¦ä»¶ DBè¨è¨ˆ ãƒ‡ãƒ¼ã‚¿ä¿å˜æ–¹é‡ tableè¨è¨ˆ ã‚µãƒ¼ãƒæ§‹æˆ Fluentd fluentd,fluent-plugin-mysql-bulk install td-agent.conf mysqlã«ãƒ‡ãƒ¼ã‚¿ãŒæ ¼ç´ã•ã‚Œã‚‹äº‹ã‚’ç¢ºèªã™ã‚‹ é›†è¨ˆç”¨ã®ãƒãƒƒãƒ ãã®ä»– Tableè‚¥å¤§åŒ–é˜²æ¢ å¯è¦–åŒ– ãƒã‚°é›†è¨ˆã‚·ã‚¹ãƒ†ãƒ ã®è¦ä»¶ çˆ†å¼¾ãƒã‚°å‡¦ç†çã®@yutakikuchi_ã§ã™ã€‚ ãƒã‚°é›†è¨ˆã‚·ã‚¹ãƒ†ãƒ ã¨ã„ã†ã‚‚ã®ã‚’ä½œã‚‹æ™‚ã«çš†ã•ã‚“ã¯ã©ã®ã‚ˆã†ã«å¯¾å¿œã—ã¦ã„ã¾ã™ã‹ï¼Ÿ ä»¥ä¸‹ã®å€™è£œã‹ã‚‰è¦ä»¶ã®ãƒ¬ãƒ™ãƒ«ã§ä½¿ã„åˆ†ã‘ã‚’ã—ã¦ã„ã‚‹äººãŒå¤šã„ã¨äºˆæƒ³ã—ã¦ã„ã¾ã™ã€‚ã–ã£ãã‚Šã®è©•ä¾¡ã§ã™ãŒã€å°Žå…¥é›£æ˜“åº¦ã€æ£ç¢ºæ€§ã€å¯è¦–åŒ–ã€ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ ã€é•·æœŸé›†è¨ˆã€ã‚¹ã‚±ãƒ¼ãƒ«ã€é‹ç”¨è²»ç”¨ã¨ã„ã†ç‚¹ã§è©•ä¾¡ã‚’æ›¸ã„ã¦ã„ã¾ã™ã€‚ ãƒ„ãƒ¼ãƒ« å°Žå…¥é›£æ˜“åº¦ æ£ç¢ºæ€§ å¯è¦–åŒ– ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ é•·æœŸé›†è¨ˆ ã‚¹ã‚±ãƒ¼ãƒ« é‹ç”¨è²»ç”¨ ãƒªãƒ³ã‚¯ GA(ã‚¹ã‚¿ãƒ³ãƒ€ãƒ¼ãƒ‰) â—‹ Ã— â—‹ â—‹ â—‹ â—‹ â—‹ Go
harumaki_net 2014/02/12
ä»•äº‹ã§ãƒã‚°ã‚µãƒ¼ãƒãƒ¼ã‚’ç«‹ã¦ãªãã‚ƒã€ã¨æ€ã£ã¦ã„ãŸã®ã§å‚è€ƒãƒ–ã‚¯ãƒžã€‚

ãƒã‚°

MySQL

ã‚ã¨ã§èªã‚€
ãƒªãƒ³ã‚¯
ã‚«ã‚¹ã‚¿ãƒžã‚¤ã‚ºæ¸ˆã¿ã®Apacheãƒã‚°æ›¸å¼ã‚‚ãƒ‘ãƒ¼ã‚¹ã™ã‚‹ Apache::Log::Parser ã®è©± - ãŸã”ã‚‚ã‚Šã™ãƒ¡ãƒ¢
ã•ã¦ã€Perlã¨ã„ãˆã°ãƒ†ã‚ã‚¹ãƒˆå‡¦ç†ã€ãƒ†ã‚ã‚¹ãƒˆå‡¦ç†ã¨ã„ãˆã°Perlã§ã™ãã€‚ãã—ã¦ã“ã®ãƒ“ãƒƒã‚°ã§ãƒ‡ãƒ¼ã‚¿ãªç¾ä»£ã«ãŠã„ã¦ãƒ†ã‚ã‚¹ãƒˆå‡¦ç†ã¨ã„ãˆã°ãƒã‚°ã®å‡¦ç†ã«æ±ºã¾ã£ã¦ã„ã¾ã™ã€‚ ãƒã‚°ã®å‡¦ç†ã¨ã„ã£ã¦ã‚‚ã„ã‚ã„ã‚ã§ã™ãŒã€ã‚‚ã¡ã‚ã‚“å¼·ãé€žã—ãç”Ÿãã‚‹ç¾ä»£ã£åã®æˆ‘ã€…ã¯ä»¥ä¸‹ã®ã‚ˆã†ãªãƒã‚°ã‚’æ‰±ã„ã¾ã™ã€‚ Apacheã®ãƒã‚° Apacheã®ãƒã‚°ãªã‚“ã ã‘ã©ã„ãã¤ã‹ã®æ›¸å¼ãŒæ··ã–ã£ã¦ãŸã‚Šã™ã‚‹ combined ã«å½“ç„¶ã„ã‚ã„ã‚ãƒ‡ãƒ¼ã‚¿ãŒè¶³ã—ã¦ã‚ã‚‹ LTSVã£ã¦ãªã‚“ã§ã™ã‹ï¼Ÿ ãã®ã‚ˆã†ãªç´ æ•µãªå•é¡Œã‚’è§£æ±ºã™ã‚‹ãŸã‚ã®ãƒ¢ã‚¸ãƒ¥ãƒ¼ãƒ«ãŒCPANã«ã‚ã‚Šã¾ã™ã€‚Apache::Log::Parserã§ã™ã€‚ ã‚ã£ã€ãã®ãƒšãƒ¼ã‚¸ã¯ãƒ€ãƒ¡ã€ã“ã£ã¡ã€ã“ã£ã¡ãªã€‚ Apache::Log::Parser Apache::Log::Parserã¯å†…éƒ¨ã«2ç¨®é¡žã®è§£æžå™¨ã‚’å‚™ãˆã¦ãŠã‚Šã€ãƒ‘ãƒ¼ã‚µã‚’åˆæœŸåŒ–ã™ã‚‹ã¨ãã«ã©ã¡ã‚‰ã‹ã‚’é¸ã³ã¾ã™ã€‚ãã‚Œãžã‚Œä»¥ä¸‹ã®ã‚ˆã†ã«å‹•ä½œã—ã¾ã™ã€‚ fast mode Ap
harumaki_net 2013/12/10
Apache

ãƒã‚°

é‹ç”¨
ãƒªãƒ³ã‚¯
R ã¨ Treasure Data ã§ Web ã‚µãƒ¼ãƒã®ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°è§£æž - Data science & Software development
ã“ã®è¨˜äº‹ã§ã¯ã€Apache HTTP Server ã§ç¨¼åƒã—ã¦ã„ã‚‹ Web ã‚µãƒ¼ãƒã¸ Fluentd (td-agent) ã‚’å°Žå…¥ã—ã€Treasure Data ã§ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ã‚’åŽé›†ã—ã€R ã§åŽé›†ã—ãŸãƒ‡ãƒ¼ã‚¿ã®ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°è§£æžã‚’è¡Œã†ã¾ã§ã®æ‰‹é †ã‚’è§£èª¬ã—ã¾ã™ã€‚ Treasure Data (ãƒˆãƒ¬ã‚¸ãƒ£ãƒ¼ãƒ‡ãƒ¼ã‚¿) ã¨ã¯ Treasure Data ã¯ Cloud åž‹ DWH (Data Warehouse) ã‚µãƒ¼ãƒ“ã‚¹ã®ä¸€ã¤ã§ã€Cloud ä¸Šã§ SaaSã¨ã—ã¦ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ã®æ ¼ç´ã€å‡¦ç†ã‚’åˆ©ç”¨ã§ãã‚‹ã‚µãƒ¼ãƒ“ã‚¹ã§ã™ã€‚ ï¼ˆTreasure Data ç¤¾ã§ã¯ BigData-as-a-Service ã¨å‘¼ã‚“ã§ã„ã¾ã™ï¼‰ åŒæ§˜ã®ã‚µãƒ¼ãƒ“ã‚¹ã§ã¯ã€Amazon Web Services ã® Amazon Redshift ã‚„ Elastic MapReduce ç‰ãŒã‚ã‚Šã¾ã™ãŒã€Treasure Data ã®ç‰¹é•·ã§ã€ãƒãƒƒãƒã§
harumaki_net 2013/12/06
ãƒã‚°

Apache

fluentd
ãƒªãƒ³ã‚¯
é–‹ç™ºãƒ¡ãƒ¢#6 : ãƒã‚°ã®å–ã‚Šæ‰±ã„ : GrowthForecast, Amazon S3, Treasure Data ã§å¿ƒåŠ´ã‚¼ãƒ - naoyaã®ã¯ã¦ãªãƒ€ã‚¤ã‚¢ãƒªãƒ¼
é–‹ç™ºãƒ¡ãƒ¢#6 ã§ã™ã€‚å‰å›žã‹ã‚‰å°‘ã—é–“ãŒã‚ã„ã¦ã—ã¾ã„ã¾ã—ãŸã€‚ é–‹ç™ºãƒ¡ãƒ¢#2 : AWS ã§ã®ãƒ›ã‚¹ãƒˆ / ã‚¯ãƒ©ã‚¦ãƒ‰ãƒã‚¤ãƒ†ã‚£ãƒ–ãªãƒ‡ãƒ—ãƒã‚¤ - naoyaã®ã¯ã¦ãªãƒ€ã‚¤ã‚¢ãƒªãƒ¼ ã§æ›¸ã„ãŸã‚ˆã†ã«ã€EC2 ã¸ã®ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã®ãƒ‡ãƒ—ãƒã‚¤ã«ã‚ãŸã£ã¦ã¯ Elastic IP ã®åˆ©ç‚¹ã‚’æ´»ã‹ã—ã¦ã‚«ã‚¸ãƒ¥ã‚¢ãƒ«ã«ãƒ›ã‚¹ãƒˆã‚’å…¥ã‚Œæ›¿ãˆã¾ãã£ã¦ã„ã¾ã™ã€‚ã¡ã‚‡ã£ã¨ã“ã®ãƒ‡ãƒ—ãƒã‚¤ã¯æ…Žé‡ã«ãªã‚ŠãŸã„ãªã€ã¨æ€ã£ãŸã‚‰ã‚¹ãƒŠãƒƒãƒ—ã‚·ãƒ§ãƒƒãƒˆã‹ã‚‰ã‚¤ãƒ³ã‚¹ã‚¿ãƒ³ã‚¹ã‚’ç«‹ã¡ä¸Šã’ã¦ã¯åˆ‡ã‚Šæ›¿ãˆã‚‹ã€ã®ç¹°ã‚Šè¿”ã—ã€‚ ã“ã®é‹ç”¨ã‚’ã—ã¦ã„ã‚‹ã¨ã€ã‚¹ãƒŠãƒƒãƒ—ã‚·ãƒ§ãƒƒãƒˆã¨ã®å·®åˆ†ãŒã§ãã‚„ã™ã„ã®ã¯ chef-solo ã§å¸åŽã™ã‚‹ã¨ã„ã†ã®ãŒå‰å›žã€å‰ã€…å›žã®ã¯ãªã—ã€‚ ã‚‚ã†ä¸€ç‚¹å•é¡ŒãŒã‚ã‚Šã¾ã™ã€‚ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚°ã‚„ã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ã®ãƒã‚°ã§ã™ã€‚ãƒ•ãƒãƒ³ãƒˆã‚¨ãƒ³ãƒ‰ã®ã‚µãƒ¼ãƒã‚’ã‚ã£ã¡ã“ã£ã¡åˆ‡ã‚Šæ›¿ãˆã¦ã„ã‚‹ã†ã¡ã«ã€ãã®ã¾ã¾ã§ã¯ãƒã‚°ãŒåˆ†æ–ã•ã‚Œã¦ã—ã¾ã†ã€‚ãƒ›ã‚¹ãƒˆã‚’ Terminate ã—ã‚ˆã†ã‚‚ã®ãªã‚‰ãƒã‚°ã¯æ¶ˆå¤±ã—ã¦ã—ã¾ã„ã¾ã™ã€‚ ã“ã®
harumaki_net 2013/02/19
aws

ãƒã‚°

fluentd

ãŠå½¹ç«‹ã¡
ãƒªãƒ³ã‚¯
Labeled Tab-separated Values (LTSV)
Description Labeled Tab-separated Values (LTSV) format is a variant of Tab-separated Values (TSV). Each record in a LTSV file is represented as a single line. Each field is separated by TAB and has a label and a value. The label and the value have been separated by ':'. With the LTSV format, you can parse each line by spliting with TAB (like original TSV format) easily, and extend any fields with
harumaki_net 2013/02/08
ltsv

ãƒã‚°

ãƒ•ã‚©ãƒ¼ãƒžãƒƒãƒˆ
ãƒªãƒ³ã‚¯
Labeled Tab Separated Values (LTSV) ãƒŽã‚¹ã‚¹ãƒ¡ - stanaka's blog
è¿½è¨˜(2/8 11:30) id:naoyaã«ã‚ˆã‚‹ä¸€é€£ã®ã¾ã¨ã‚ãŒã€ä»ŠåŒ—ç”£æ¥ã€‘3åˆ†ã§åˆ†ã‹ã‚‹LTSVæ¥ç•Œã®ã¾ã¨ã‚ã€LTSVã€‘ - naoyaã®ã¯ã¦ãªãƒ€ã‚¤ã‚¢ãƒªãƒ¼ã«ã‚ã‚Šã¾ã™ã€‚ ã¾ãŸã€ä»•æ§˜ãªã©ã‚’ã¾ã¨ã‚ã‚‹ãŸã‚ã« http://ltsv.org/ ã‚’ç«‹ã¡ä¸Šã’ã¾ã—ãŸã€‚ è¿½è¨˜ã“ã“ã¾ã§ Labeled Tab Separated Values (LTSV) ã¨ã„ã†ã®ã¯ã€ã¯ã¦ãªã§ä½¿ã£ã¦ã„ã‚‹ãƒã‚°ãƒ•ã‚©ãƒ¼ãƒžãƒƒãƒˆã®ã“ã¨ã§ã€åºƒãä½¿ã‚ã‚Œã¦ã„ã‚‹TSV(Tab Separated Value)ãƒ•ã‚©ãƒ¼ãƒžãƒƒãƒˆã«ãƒ©ãƒ™ãƒ«ã‚’ä»˜ã‘ã¦æ‰±ã„æ˜“ãã—ãŸã‚‚ã®ã§ã™ã€‚ã¯ã¦ãªã§ã¯ã€ã‚‚ã†3å¹´ä»¥ä¸Šã€ã“ã®ãƒ•ã‚©ãƒ¼ãƒžãƒƒãƒˆã§ãƒã‚°ã‚’æ®‹ã—ã¦ã„ã¦ã€one-linerã‹ã‚‰fluentdã€Apache Hiveã¾ã§å¹…åºƒãä¾¿åˆ©ã«ä½¿ãˆã¦ã„ã¾ã™ã€‚ ãƒã‚°ãƒ•ã‚©ãƒ¼ãƒžãƒƒãƒˆã«æœŸå¾…ã•ã‚Œã‚‹ã“ã¨ã¯ã€ ãƒ•ã‚©ãƒ¼ãƒžãƒƒãƒˆãŒçµ±ä¸€ã•ã‚Œã¦ã„ã‚‹ â†’ å…±é€šã®ãƒ„ãƒ¼ãƒ«ã§é›†è¨ˆã—æ˜“ã„ æ–°ã—ã„ãƒ•ã‚£ãƒ¼ãƒ«ãƒ‰ã®è¿½åŠ ãŒå®¹æ˜“ â†’ ã‚µãƒ¼
harumaki_net 2013/02/08
ãƒã‚°

é‹ç”¨
ãƒªãƒ³ã‚¯
1