[B! Apache Flink] yassan0627ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

yassan0627 id:yassan0627

Apache Flinkã«é–¢ã™ã‚‹yassan0627ã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (6)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Learning Apache Flink S01E06: The Flink JDBC Driver
yassan0627 2023/11/17
ãƒ‡ãƒ¼ã‚¿

é–‹ç™º

Apache Flink
ãƒªãƒ³ã‚¯
Integrating Apache NiFi and Apache Flink
Hortonworks DataFlow delivers data to streaming analytics platforms, inclusive of Storm, Spark and Flink These are slides from an Apache Flink Meetup: Integration of Apache Flink and Apache Nifi, Feb 4 2016Read less
yassan0627 2016/12/11
NiFiã®Site-to-Siteã®è©±ã€‚pullåž‹ã¨pushåž‹ãŒã‚ã‚‹ã€‚

Apache NiFi

Apache Flink
ãƒªãƒ³ã‚¯
Apache Flinkã®stateç®¡ç†ã«ã¤ã„ã¦ - Tech Notes
ã¯ã˜ã‚ã« ã‚¹ãƒˆãƒªãƒ¼ãƒ å‡¦ç†ã®ä¸ã§ã€å‡¦ç†ã‚’statefulã«ã—ãŸã„ã€ã¨ã„ã†è¦æ±‚ã¯ã‚ˆãã‚ã‚‹ã€‚ä¾‹ãˆã°ã€1æ™‚é–“ã®time windowã§ä»¶æ•°ã‚’é›†è¨ˆã—ã¦ã„ã‚‹å ´åˆã€ã‚¹ãƒˆãƒªãƒ¼ãƒ ãŒæµã‚Œã‚‹ã«ã¤ã‚Œã¦å†…éƒ¨ã§ä¿æŒã—ã¦ã„ã‚‹ã‚«ã‚¦ãƒ³ã‚¿ã¯å¢—åŠ ã—ã¦ã„ã. ãã—ã¦ã€éšœå®³ç‰ã§å†èµ·å‹•ã‚’ã—ãŸæ™‚ã¨ã‹ã«ã¯ã€ãã®ã‚«ã‚¦ãƒ³ã‚¿ã®å€¤ã‚‚ä¸€ç·’ã«å¾©æ—§ã—ãŸã„. Flinkã«ãŠã‘ã‚‹stateã®ä¿å˜ ã“ã‚Œã«å¯¾ã—ã¦ã€Apache Flinkã¯å®šæœŸçš„ã«å‡¦ç†çŠ¶æ…‹ã®ã‚¹ãƒŠãƒƒãƒ—ã‚·ãƒ§ãƒƒãƒˆã‚’å–å¾—ã™ã‚‹ã€ã¨ã„ã†æ–¹æ³•ã§å¯¾å¿œã—ã¦ã„ã‚‹. ãã—ã¦ã€åˆ†æ•£ç’°å¢ƒã§ã¾ã¨ã‚‚ã«å…¨ã¦ã®ã‚¹ãƒŠãƒƒãƒ—ã‚·ãƒ§ãƒƒãƒˆã‚’å–ã‚‹ã®ã¯è¾›ã„ã®ã§ã€åˆ†æ•£ã—ã¦ã‚¹ãƒŠãƒƒãƒ—ã‚·ãƒ§ãƒƒãƒˆã‚’å–ã‚‹ã‚ˆã†ã«ã—ã¦ã„ã‚‹. å…·ä½“çš„ã«ã¯ã“ã“ ã«è©³ã—ã„ãŒã€ã‚¹ãƒˆãƒªãƒ¼ãƒ ã®ã‚½ãƒ¼ã‚¹ã‹ã‚‰å®šæœŸçš„ã«Barrierã¨å‘¼ã°ã‚Œã‚‹å°ã‚’æµã—ã¦ã€å„ã‚ªãƒšãƒ¬ãƒ¼ã‚¿ã¯ã“ã‚Œã‚’å—ã‘å–ã‚‹ã¨ã‚¹ãƒŠãƒƒãƒ—ã‚·ãƒ§ãƒƒãƒˆã‚’ä¿å˜ã™ã‚‹ã‚ˆã†ã«ãªã£ã¦ã„ã‚‹. ã“ã†ã™ã‚‹ã“ã¨ã§ã€å‡¦ç†å…¨ä½“ã‚’æ¢ã‚ãšã«ä¸€è²«æ€§ã®ã‚ã‚‹ã‚¹ãƒŠãƒƒãƒ—ã‚·ãƒ§ãƒƒãƒˆã‚’å–
yassan0627 2016/12/09
Apache Flink
ãƒªãƒ³ã‚¯
Apache Flinkã‚’è©¦ã—ã¦ã¿ã¦ã®æ„Ÿæƒ³ - Tech Notes
ã—ã°ã‚‰ãApache Flinkã‚’è©¦ã—ã¦ã¿ãŸã®ã§ã€æ„Ÿæƒ³ã‚’æ›¸ã„ã¦ãŠã“ã†ã¨æ€ã†. è©¦ã—ãŸã“ã¨ standalone modeã§ã®ã‚¯ãƒ©ã‚¹ã‚¿æ§‹ç¯‰ ã‚¹ãƒˆãƒªãƒ¼ãƒŸãƒ³ã‚°ã‚¸ãƒ§ãƒ–ã‚’æ›¸ã„ã¦ã¿ã‚‹ TumblingTimeWindowã‚„SlidingTimeWindowã§ã®é›†è¨ˆ Kafka Sourceã¨Elasticsearch Sinkã®åˆ©ç”¨ å¿…è¦ã ã£ãŸã®ã§ã€ã‚«ã‚¹ã‚¿ãƒ ãƒˆãƒªã‚¬ã¯æ›¸ã„ãŸ å¹¾ã¤ã‹ã®ã‚¸ãƒ§ãƒ–ã§æ€§èƒ½æ¸¬å®š ç¤¾å†…ã®æœ¬ç•ªfluentdã‹ã‚‰KafkaçµŒç”±ã§Flinkã«ã‚¹ãƒˆãƒªãƒ¼ãƒ ã‚’æŠ•å…¥ã—ã€ã‚¸ãƒ§ãƒ–ã‚’åæ•°æ—¥ãã‚‰ã„é€£ç¶šç¨¼åƒã—ã¦ã¿ã‚‹ state backendã‚’HDFSã‚„RocksDBã«ã—ã¦ã¿ã‚‹ JobManager HA TaskManagerã‚„JobManagerã‚’è½ã¨ã—ã¦ã¿ã‚‹ Flink on YARN (ã‚¸ãƒ§ãƒ–ã‚’èµ·å‹•ã—ã¦ã¿ãŸã ã‘) è©¦ã—ã¦ãªã„ã“ã¨ DataSet APIã®åˆ©ç”¨ savepoint, savepoint
yassan0627 2016/12/09
Apache Flink
ãƒªãƒ³ã‚¯
ç¾åœ¨ç¨¼åƒã—ã¦ã„ã‚‹Flinkã‚¯ãƒ©ã‚¹ã‚¿ã«ã¤ã„ã¦ - Tech Notes
å…ˆæ—¥ã®ç™ºè¡¨ã§ã€Apache Flinkã‚’å°Žå…¥ã™ã‚‹ã«è‡³ã£ãŸçµŒç·¯ã‚’è©±ã—ãŸã®ã ã‘ã©ã€å…·ä½“çš„ãªæ§‹æˆã¨ã‹ã«ã¯è§¦ã‚Œã‚‰ã‚Œãªã‹ã£ãŸã®ã§æ›¸ã„ã¦ãŠãã€‚ ã‚¯ãƒ©ã‚¹ã‚¿ã®æ§‹æˆã«ã¤ã„ã¦ ä»Šé‹ç”¨ã—ã¦ã‚‹Flinkã‚¯ãƒ©ã‚¹ã‚¿ã¯ï¼’ã¤ã€‚ã‚µãƒ¼ãƒ“ã‚¹ã§ä½¿ã†ãŸã‚ã®ãƒ‡ãƒ¼ã‚¿ã‚’ç”Ÿæˆã—ã¦ã„ã‚‹ã‚‚ã®ã¨ã€ç¤¾å†…ã®ãƒ¬ãƒãƒ¼ãƒ†ã‚£ãƒ³ã‚°ã‚„ãƒ¢ãƒ‹ã‚¿ãƒªãƒ³ã‚°ã§ä½¿ã£ã¦ã„ã‚‹ã‚‚ã®ã€‚å‰è€…ã®æ–¹ã¯å®‰å®šæ€§é‡è¦–ã€å¾Œè€…ã¯å‰²ã¨ã‚«ã‚¸ãƒ¥ã‚¢ãƒ«ã«ã‚¸ãƒ§ãƒ–ã‚’è¿½åŠ ã—ãŸã‚Šã€æ§‹æˆã‚’å¼„ã£ãŸã‚Šã§ãã‚‹ã‚‚ã®ã€ã¨ã„ã†æ„Ÿã˜ã«ãªã£ã¦ã„ã‚‹. Flinkã¨ã—ã¦ã¯ã€ã‚¯ãƒ©ã‚¹ã‚¿ã®ãƒ‡ãƒ—ãƒã‚¤ãƒ¡ãƒ³ãƒˆæ–¹å¼ã¨ã—ã¦ã€ç‹¬ç«‹ã—ãŸdaemonã¨ã—ã¦å‹•ã‹ã™æ–¹æ³•ã¨ã€YARNã®ä¸Šã§å‹•ã‹ã™æ–¹æ³•ãŒã‚ã‚‹ã®ã ã‘ã©ã€å‰è€…ã®æ–¹æ³•ã«ã—ã¦ã„ã‚‹. ãã®æ–¹ãŒé‹ç”¨ä¸Šã‚‚ã‚ã‹ã‚Šã‚„ã™ã„ã—ã€ãƒ¬ã‚¤ãƒ¤ãŒå°‘ãªã„åˆ†ãƒˆãƒ©ãƒ–ãƒ«ã‚‚å°‘ãªã„ã ã‚ã†ã€ã¨ã„ã†ã®ãŒç†ç”±. ã©ã¡ã‚‰ã‚‚ç‰©ç†ã‚µãƒ¼ãƒã§ã€TaskManagerã‚µãƒ¼ãƒã¯å‰è€…ãŒ3å°ã€å¾Œè€…ãŒ10å°ã«ãªã£ã¦ã„ã‚‹. Flinkã®ãƒãƒ¼ã‚¸ãƒ§ãƒ³ã¯ãã‚Œãžã‚Œ1.0.3ã¨1.
yassan0627 2016/12/09
Apache Flink
ãƒªãƒ³ã‚¯
Zalando Engineering Blog - Apache Showdown: Flink vs. Spark
yassan0627 2016/05/09
ãƒ‡ãƒ¼ã‚¿åˆ†æž

Apache spark

Apache Flink
ãƒªãƒ³ã‚¯
1