[B! hadoop] ttakezawaã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

ttakezawa id:ttakezawa

hadoopã«é–¢ã™ã‚‹ttakezawaã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (28)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

ä½•æ•…DeNAã‹ã‚™verticaã‚’é¸ã‚“ãŸã‚™ã‹ï¼Ÿ
2. Copyright (C) 2015 DeNA Co.,Ltd. All Rights Reserved. è‡ªå·±ç´¹ä»‹ ï® å±±ç”° æ†²æ™‹ï¼ˆã‚„ã¾ã ã‘ã‚“ã—ã‚“ï¼‰ ï® DeNA ã‚·ã‚¹ãƒ†ãƒ æœ¬éƒ¨ åˆ†æžåŸºç›¤éƒ¨ éƒ¨é•· ï® ç•¥æ´ âƒ 1995å¹´4æœˆ NECã«å…¥ç¤¾ã€‚TCP Offload Engineç‰ã®ç ”ç©¶é–‹ç™ºã«å¾“äº‹ã€‚ âƒ 2007å¹´7æœˆDeNAå…¥ç¤¾ã€‚Mobageã®ã‚µãƒ¼ãƒ“ã‚¹é–‹ç™ºãƒ»ã‚¤ãƒ³ãƒ•ãƒ©é‹ç”¨ã€ã‚½ ãƒ¼ã‚·ãƒ£ãƒ«ã‚²ãƒ¼ãƒ é–‹ç™ºãƒãƒ¼ãƒ ã®ãƒžãƒãƒ¼ã‚¸ãƒ¡ãƒ³ãƒˆã‚’ãˆã¦ã€2010å¹´ ã‚½ãƒ¼ã‚· ãƒ£ãƒ«ã‚²ãƒ¼ãƒ ã®åˆ†æžå¼·åŒ–ã®ãŸã‚åˆ†æžãƒãƒ¼ãƒ ã‚’ç«‹ã¡ä¸Šã’ã‚‹ã€‚ âƒ ç¾åœ¨ã¯ã€DeNAå…¨ç¤¾ã®åˆ†æžæ¥å‹™ã§åˆ©ç”¨ã•ã‚Œã‚‹åˆ†æžåŸºç›¤ã®æ§‹ç¯‰ãƒ»é‹ç”¨ã‚’ è¡Œã† åˆ†æžåŸºç›¤éƒ¨ã®ãƒžãƒãƒ¼ã‚¸ãƒ¡ãƒ³ãƒˆã‚’è¡Œã£ã¦ã„ã‚‹ã€‚ 2
ttakezawa 2015/03/04
vertica

bigquery

hadoop
ãƒªãƒ³ã‚¯
Facebookã€åˆ†æ•£SQLã‚¨ãƒ³ã‚¸ãƒ³ã€ŒPrestoã€å…¬é–‹ã€‚å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã‚’MapReduce/Hiveã®10å€åŠ¹çŽ‡ã‚ˆãå‡¦ç†ã™ã‚‹ã¨
Facebookã¯ã€æ•°ãƒšã‚¿ãƒã‚¤ãƒˆç´šã®å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã«å¯¾ã—ã¦ã‚‚ã€å¯¾è©±çš„ã«ã‚¢ãƒ‰ãƒ›ãƒƒã‚¯ãªå•ã„åˆã‚ã›ã‚’å¯èƒ½ã«ã™ã‚‹åˆ†æ•£SQLã‚¨ãƒ³ã‚¸ãƒ³ã€ŒPrestoã€ã‚’ã€ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã§å…¬é–‹ã—ã¾ã—ãŸã€‚ Prestoã¯Facebookç¤¾å†…ã§å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã®åˆ†æžã®ãŸã‚ã«é–‹ç™ºã•ã‚Œã€ã™ã§ã«åŒç¤¾ç¤¾å†…ä½¿ã‚ã‚Œã¦ã„ã‚‹ã‚‚ã®ã€‚ Facebookã¯Prestoã‚’é–‹ç™ºã—ãŸèƒŒæ™¯ã¨ã—ã¦ã€å¤§é‡ã®ãƒ‡ãƒ¼ã‚¿ã‚’Hadoop/HDFSãƒ™ãƒ¼ã‚¹ã§ä¿å˜ã—ãŸã‚‚ã®ã®ã€ãƒãƒƒãƒæŒ‡å‘ã®MapReduceã§ã¯ãªãã€ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ æ€§ã«å„ªã‚ŒãŸå‡¦ç†ãŒå¿…è¦ã«ãªã£ãŸãŸã‚ã ã¨ã€æ¬¡ã®ã‚ˆã†ã«èª¬æ˜Žã—ã¦ã„ã¾ã™ã€‚ Facebookâ€™s warehouse data is stored in a few large Hadoop/HDFS-based clusters. Hadoop MapReduce [2] and Hive are designed for large-scale, reliabl
ttakezawa 2013/11/08
facebook

presto

hadoop

hive

sql
ãƒªãƒ³ã‚¯
Apache Sparkã£ã¦ã©ã‚“ãªã‚‚ã®ã‹è¦‹ã¦ã¿ã‚‹ï¼ˆãã®ï¼‘ - å¤¢ã¨ã‚¬ãƒ©ã‚¯ã‚¿ã®é›†ç©å ´
ã“ã‚“ã«ã¡ã¯ã€‚ Kafkaã‚’è©¦ã—ã¦ã„ã‚‹æœ€ä¸ã§å¾®å¦™ã§ã™ãŒã€æœ€è¿‘ä½¿ãˆã‚‹ã®ã‹ãªãã€ã¨æƒ…å ±ã‚’é›†ã‚ã¦ã„ã‚‹ã®ãŒã€ŒApache Sparkã€ã§ã™ã€‚ MapReduceã¨åŒã˜ãåˆ†æ•£ä¸¦è¡Œå‡¦ç†ã‚’è¡Œã†åŸºç›¤ãªã®ã§ã™ãŒã€MapReduceã‚ˆã‚Šã‚‚æ•°åå€é€Ÿã„ã¨ã‹ã®æƒ…å ±ãŒã‚ã‚Šã¾ã™ã€‚ ãƒ»ãƒ»ãƒ»ã‚“ãªé˜¿å‘†ãªã€ã¨ã‚‚æ€ã£ãŸã®ã§ã™ãŒã€å†…éƒ¨ã§ä¿æŒã—ã¦ã„ã‚‹RDDã¨ã„ã†ä»•çµ„ã¿ãŒé¢ç™½ã„ã“ã¨ã‚‚ã‚ã‚Šã€ ã¨ã‚Šã‚ãˆãšè³‡æ–™ã‚„è«–æ–‡ã‚’èªã‚“ã§ã¿ã‚‹ã“ã¨ã«ã—ã¾ã—ãŸã€‚ ã¾ãšè¦‹ã¦ã¿ãŸè³‡æ–™ã¯ã€ŒOverview of Sparkã€ï¼ˆhttp://spark.incubator.apache.org/talks/overview.pdfï¼‰ã§ã™ã€‚ ã¨ã„ã†ã‚ã‘ã§ã€èªã‚“ã çµæžœã‚’ã¾ã¨ã‚ã¦ã¿ã¾ã™ã€‚ Sparkã¨ã¯ï¼Ÿ é«˜é€Ÿã§ã‚¤ãƒ³ã‚¿ãƒ©ã‚¯ãƒ†ã‚£ãƒ–ãªè¨€èªžçµ±åˆã‚¯ãƒ©ã‚¹ã‚¿ã‚³ãƒ³ãƒ”ãƒ¥ãƒ¼ãƒ†ã‚£ãƒ³ã‚°åŸºç›¤ Sparkãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã®ã‚´ãƒ¼ãƒ«ã¯ï¼Ÿ ä»¥ä¸‹ã®2ã¤ã®è§£æžãƒ¦ãƒ¼ã‚¹ã‚±ãƒ¼ã‚¹ã«ã‚ˆã‚Šé©åˆã™ã‚‹ã‚ˆã†MapReduceã‚’æ‹¡å¼µ
ttakezawa 2013/09/02
spark

mesos

mapreduce

hadoop
ãƒªãƒ³ã‚¯
Mapreduce2.0 - æ€¥ãŒã°å›žã‚Œã€é¸ã¶ãªã‚‰è¿‘é“
æ¬¡ä¸–ä»£Hadoopã®é–‹ç™ºãŒé€²ã‚“ã§ã„ã‚‹ã€‚ç¾çŠ¶ã®æŽ¨ç§»ã§ã¯ã€å°‘ãªãã¨ã‚‚åˆ†æ•£ã‚¯ãƒ©ã‚¦ãƒ‰ã§ã®ã€ŒOSSã‚¤ãƒ³ãƒ•ãƒ©ã€ã¨ã—ã¦ã¯HadoopãŒæœ€æœ‰åŠ›å€™è£œã§ã‚ã‚‹ã“ã¨ã¯é–“é•ã„ãªã„ã€‚ã‚¯ãƒ©ã‚¦ãƒ‰ä¸Šã§ã®åˆ†æ•£å‡¦ç†åŸºç›¤ã§ã®æŠ€è¡“ç«¶äº‰ã§ã¯Googleã‚„AmazonãŒç›¸å½“æŠœãã‚“ã§ã„ã‚‹ç¾åœ¨ã€ãã‚Œã«å¯¾æŠ—ã—ã†ã‚‹å¯èƒ½æ€§ãŒã‚ã‚‹OSSã¯Hadoopã®æ½®æµã®å»¶é•·ç·šä¸Šã«ã—ã‹è€ƒãˆã‚‰ã‚Œãªã„ã€‚ãã®å½¢ã¨ã—ã¦Hadoop-MapReduce2.0ãŒã‚ã‚‹ã‚ˆã†ã«è¦‹ãˆã‚‹ã€‚ç¾åœ¨ã®çŠ¶æ…‹ã§è‡ªåˆ†ãªã‚Šã®æ¬¡ä¸–ä»£Hadoopã®ç†è§£ã‚’ã¾ã¨ã‚ã¦ãŠãã€‚åŸºæœ¬çš„ã«å…¨éƒ¨ã¯è¦‹åˆ‡ã‚Œã¦ã„ãªã„ã®ã§ã€ãã®ã‚ãŸã‚Šã¯ã‚ã—ã‹ã‚‰ãšã€‚åŸºæœ¬çš„ã«æ¬¡ä¸–ä»£Hadoopã®ä»•çµ„ã¿ã¯å¤§ããäºŒã¤ã®è¦ç´ ã‹ã‚‰ãªã‚‹ ç¾åœ¨ã®ã¨ã“ã‚ã®æŸ±ã¯HDFSã¨Mapreduce2.0ã®äºŒã¤ã ã€‚ ã¾ãšMapReduceã€‚ã“ã‚Œã¯å¾“æ¥ã®ã€ŒMapReduceã€ã¨ã„ã†ã‚‚ã®ã‹ã‚‰ã¯ã»ã©é ã„ã€‚ã‚€ã—ã‚ã€Œä»»æ„ã€ã®åˆ†æ•£å‡¦ç†å®Ÿè¡Œãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã«ãŸã„ã—ã¦ã€é©åˆ‡ãªãƒªã‚½ãƒ¼ã‚¹ã‚’
ttakezawa 2011/10/21
hadoop

mapreduce
ãƒªãƒ³ã‚¯
Menjelajahi Masa Depan Teknologi
Instagram Stories hanya bertahan selama 24 jam, tetapi ada cara untuk menyimpan momen berharga tersebut. Dengan mengikuti beberapa langkah mudah, pengguna dapat download story IG sebelum menghilang. Teknik ini memungkinkan penyimpanan konten penting tanpa kehilangan data berharga. Teknologi CRISPR telah merevolusi bidang rekayasa genetik dengan kemampuannya untuk memodifikasi DNA secara presisi. T
ttakezawa 2011/07/10
webservice

hadoop

mapreduce
ãƒªãƒ³ã‚¯
FacebookãŒHBaseã‚’å¤§è¦æ¨¡ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ å‡¦ç†ã«åˆ©ç”¨ã—ã¦ã„ã‚‹ç†ç”±ï¼ˆå‰ç·¨ï¼‰
Facebookã¯å¤§è¦æ¨¡ãªãƒ‡ãƒ¼ã‚¿å‡¦ç†ã®åŸºç›¤ã¨ã—ã¦HBaseã‚’åˆ©ç”¨ã—ã¦ã„ã¾ã™ã€‚ãªãœFacebookã¯HBaseã‚’ç”¨ã„ã¦ã„ã‚‹ã®ã‹ã€ã©ã®ã‚ˆã†ã«åˆ©ç”¨ã—ã¦ã„ã‚‹ã®ã§ã—ã‚‡ã†ã‹ï¼Ÿ 7æœˆ1æ—¥ã«éƒ½å†…ã§è¡Œã‚ã‚ŒãŸå‹‰å¼·ä¼šã§ã€Facebookã®ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã§ã‚ã‚‹ã‚¸ãƒ§ãƒŠã‚µãƒ³ãƒ»ã‚°ãƒ¬ã‚¤ï¼ˆJonathan Grayï¼‰æ°ã«ã‚ˆã‚‹è§£èª¬ãŒè¡Œã‚ã‚Œã¾ã—ãŸã€‚ è§£èª¬ã¯ã»ã¼ã‚¹ãƒ©ã‚¤ãƒ‰ã®å†…å®¹ãã®ã¾ã¾ã§ã—ãŸã€‚å½“æ—¥ä½¿ã‚ã‚ŒãŸæ—¥æœ¬èªžè¨³ã•ã‚ŒãŸã‚¹ãƒ©ã‚¤ãƒ‰ãŒå…¬é–‹ã•ã‚Œã¦ã„ã‚‹ã®ã§ã€ãƒã‚¤ãƒ³ãƒˆã¨ãªã‚‹ãƒšãƒ¼ã‚¸ã‚’ç´¹ä»‹ã—ã¾ã—ã‚‡ã†ã€‚ Realtime Apache Hadoop at Facebook ãªãœãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ ãƒ‡ãƒ¼ã‚¿ã®åˆ†æžã«ã€Hadoop/HBaseã‚’ä½¿ã†ã®ã‹ï¼Ÿ MySQLã¯å®‰å®šã—ã¦ã„ã‚‹ãŒã€åˆ†æ•£ã‚·ã‚¹ãƒ†ãƒ ã¨ã—ã¦è¨è¨ˆã•ã‚Œã¦ãŠã‚‰ãšã€ã‚µã‚¤ã‚ºã«ã‚‚ä¸Šé™ãŒã‚ã‚‹ã€‚ä¸€æ–¹ã€Hadoopã¯ã‚¹ã‚±ãƒ¼ãƒ©ãƒ–ãƒ«ã ãŒãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°ãŒé›£ã—ãã€ãƒ©ãƒ³ãƒ€ãƒ ãªæ›¸ãè¾¼ã¿ã‚„èªã¿è¾¼ã¿ã«å‘ã„ã¦ã„ãªã„ã€‚ Faceb
ttakezawa 2011/07/04
facebook

hbase

hadoop
ãƒªãƒ³ã‚¯
OSS ã‚ªãƒ¼ãƒ—ãƒ³ãƒ»ãƒ©ãƒœ - ã€ŒRuby ç ”ä¿®ç”¨ã‚³ãƒ³ãƒ†ãƒ³ãƒ„ã€ã®åˆ©ç”¨
æ¦‚è¦ ã€ŒRuby ç ”ä¿®ç”¨ã‚³ãƒ³ãƒ†ãƒ³ãƒ„ã€ã¯ã€Rubyã®é…åŠ›ã‚’ä½“é¨“ã—ã€ãã®ç‰¹å¾´ã‚„åˆ©ç‚¹ã‹ã‚‰æŠ€è¡“ã®æœ€æ–°å‹•å‘ã€æ´»ç”¨æ–¹æ³•ã¾ã§å¹…åºƒãå¦ã¶ã“ã¨ã®ã§ãã‚‹ã€æ•™æã¨å®Ÿç¿’ç’°å¢ƒã‚’ã‚»ãƒƒãƒˆã¨ã—ãŸä½“é¨“åž‹é›†åˆæ•™è‚²ã®ãŸã‚ã®ã€ŒOSS ã‚ªãƒ¼ãƒ—ãƒ³ãƒ»ãƒ©ãƒœã€ã®ã‚µãƒ¼ãƒ“ã‚¹ã§ã™ã€‚ Rubyã®é›†åˆæ•™è‚²ã‚’æ¤œè¨Žã—ã¦ã„ã‚‹ç ”ä¿®é‹å–¶è€…ã¯ã€ã€ŒRubyç ”ä¿®ç”¨ã‚³ãƒ³ãƒ†ãƒ³ãƒ„ã€ã®åˆ©ç”¨ã‚’ç”³ã—è¾¼ã‚€ã“ã¨ã«ã‚ˆã‚Šã€å…¨å›½å„åœ°ã®ç ”ä¿®ä¼šå ´ã‹ã‚‰ã‚¤ãƒ³ã‚¿ãƒ¼ãƒãƒƒãƒˆçµŒç”±ã§ã€ŒRubyç ”ä¿®ç”¨ã‚³ãƒ³ãƒ†ãƒ³ãƒ„ã€ã‚’åˆ©ç”¨ã™ã‚‹ã“ã¨ãŒã§ãã€ç ”ä¿®ã®æº–å‚™æœŸé–“ã‚’å¤§å¹…ã«çŸç¸®ã—ã¦åŠ¹æžœçš„ãªå¦ç¿’ãŒå¯èƒ½ã«ãªã‚Šã¾ã™ã€‚ Ruby åˆ©ç”¨è€…å‘ã‘ã‚³ãƒ³ãƒ†ãƒ³ãƒ„ ç°¡å˜ãªã‚¢ãƒ—ãƒªã‚±ãƒ¼ã‚·ãƒ§ãƒ³ä½œæˆã®ä½“é¨“ã‚’é€šã—ã€RubyãŠã‚ˆã³Ruby on Railsã®é…åŠ›ã‚„ç‰¹å¾´ã‚’ç†è§£ã§ãã¾ã™ã€‚ã¾ãŸã€Rubyã®æ–°æ©Ÿèƒ½ã‚’åˆ©ç”¨ã—ãŸæŠ€è¡“ã‚„ã€ã‚¯ãƒ©ã‚¦ãƒ‰ç’°å¢ƒä¸‹ã§ã®Rubyã®æ´»ç”¨ä¾‹ãªã©ã®ç´¹ä»‹ã‚’é€šã—ã¦ã€Rubyã‚’å–ã‚Šå·»ãå¸‚å ´å‹•å‘ã«ã¤ã„ã¦ã€åŠæ—¥ã§å¦ã¹ã‚‹æ§‹æˆã¨ãªã£ã¦ã„ã¾ã™ã€‚Rubyã«èˆˆ
ttakezawa 2011/02/01
ruby

rails

tutorial

hadoop
ãƒªãƒ³ã‚¯
NTTãƒ‡ãƒ¼ã‚¿ã®Hadoopå ±å‘Šæ›¸ãŒã™ã”ã‹ã£ãŸ - ç§‘å¦ã¨éžç§‘å¦ã®è¿·å®®
æ¥ç•Œãƒˆãƒƒãƒ— ã®ã‚¨ãƒ³ã‚¿ãƒ¼ãƒ—ãƒ©ã‚¤ã‚º Hadoop ä¼æ¥ Cloudera ã«å…¥ç¤¾ã—ã¾ã—ãŸ http://www.cloudera.co.jp/ ä»Šå¹´ã®6æœˆã«ã€ã€Œå¹³æˆï¼’ï¼‘å¹´åº¦ ç”£å¦é€£æºã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢å·¥å¦å®Ÿè·µäº‹æ¥å ±å‘Šæ›¸ã€ã¨ã„ã†ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆç¾¤ãŒçµŒç”£çœã‹ã‚‰å…¬è¡¨ã•ã‚Œã¾ã—ãŸã€‚ ãã®ã†ã¡ã®ä¸€ã¤ã«ã€NTTãƒ‡ãƒ¼ã‚¿ã«å§”è¨—ã•ã‚ŒãŸHadoopã«é–¢ã™ã‚‹å®Ÿè¨¼å®Ÿé¨“ã®å ±å‘Šæ›¸ãŒã‚ã‚Šã¾ã—ãŸã®ã§ã€ä»Šæ›´ãªãŒã‚‰èªã‚“ã§ã¿ã‚‹ã“ã¨ã«ã—ã¾ã—ãŸã€‚ Hadoopç•Œéšˆã®äººã¯ã‚‚ã†ã¿ã‚“ãªã¨ã£ãã«èªã‚“ã§ã‚‹ã®ã‹ã‚‚ã—ã‚Œã¾ã›ã‚“ã‘ã©ã€‚ http://www.meti.go.jp/policy/mono_info_service/joho/downloadfiles/2010software_research/clou_dist_software.pdf ã€Œé«˜ä¿¡é ¼ã‚¯ãƒ©ã‚¦ãƒ‰å®Ÿç¾ç”¨ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢é–‹ç™ºï¼ˆåˆ†æ•£åˆ¶å¾¡å‡¦ç†æŠ€è¡“ç‰ã«ä¿‚ã‚‹ãƒ‡ãƒ¼ã‚¿ã‚»ãƒ³ã‚¿ãƒ¼é«˜ä¿¡é ¼åŒ–ã«å‘ã‘ãŸå®Ÿè¨¼äº‹æ¥ï¼‰ã€ã¨ã„ã†
ttakezawa 2010/10/01
hadoop

manual

tutorial
ãƒªãƒ³ã‚¯
Hadoop ã‚’ä½¿ã†ã¹ãå ´åˆãƒ»ä½¿ã†ã¹ãã§ãªã„å ´åˆ - æ¦è”µé‡Žæ—¥è¨˜
id:ny23 ã•ã‚“ãŒå‹•çš„ãƒ€ãƒ–ãƒ«é…åˆ—ã‚’ä½¿ã£ã¦ Wikipedia ã®ãƒ†ã‚ã‚¹ãƒˆå‡¦ç†ã‚’é«˜é€ŸåŒ–ãªã‚“ã¦ã®ã‚’æ›¸ã„ã¦ã„ã‚‹ã€‚ãŸã¶ã‚“ã“ã‚Œã®ã‚¨ãƒ³ãƒˆãƒªã‚’è¦‹ã‚‹å‰ã«MapReduce ã¨å››èº«ã®æ‹³ã‚’è¦‹ãŸæ–¹ãŒã‚³ãƒ³ãƒ†ã‚¯ã‚¹ãƒˆãŒåˆ†ã‹ã‚‹ã¨æ€ã†ã€‚Hadoop ä½¿ã£ã¦ãªã‚“ã§ã‚‚ã§ããã†ï¼ Hadoop ã®å‹‰å¼·ã—ãŸã„ï¼ãªã‚“ã¦æ€ã£ã¦ã„ã‚‹äººã¯èªã‚“ã§ã¿ã‚‹ã¨ã‚ˆã„ã€‚ è‡ªåˆ†ã®è€ƒãˆã«ã¤ã„ã¦æ›¸ã„ã¦ãŠãã¨ã€è‡ªåˆ†ã¯èª°ã‚‚å½¼ã‚‚ Hadoop ä½¿ã„ãŸãŒã‚‹çŠ¶æ³ã«ã¯è¾Ÿæ˜“ã—ã¦ã„ã‚‹ã€‚ã»ã¨ã‚“ã©ã®äººã«ã¯ä¸è¦ãªã¯ãšã ã—ã€ãã‚‚ãã‚‚ Hadoop ã¯(ny23 ã•ã‚“ã‚‚æ›¸ã‹ã‚Œã¦ã„ã‚‹ãŒ)ãƒ¡ãƒ¢ãƒªã«ä¹—ã‚Šåˆ‡ã‚‰ãªã„å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã‚’æ‰±ã„ãŸã„ã¨ãã«åŠ¹åŠ›ã‚’ç™ºæ®ã™ã‚‹ã®ã§ã‚ã£ã¦ã€ãƒ¡ãƒ¢ãƒªã«ä¹—ã‚Šåˆ‡ã‚‹ãã‚‰ã„ã®ã‚µã‚¤ã‚ºã§ã‚ã‚Œã°ã€ãƒ‡ãƒ¼ã‚¿æ§‹é€ ã‚’å·¥å¤«ã—ãŸã‚Šé©åˆ‡ãªã‚¢ãƒ«ã‚´ãƒªã‚ºãƒ ã‚’é¸æŠžã—ãŸæ–¹ãŒé¥ã‹ã«ã‚ˆã„(id:tsubosaka ã•ã‚“ã‚‚å®Ÿé¨“ã•ã‚Œã¦ã„ãŸãŒ)ã€‚ãŸã¨ãˆãƒ‡ãƒ¼ã‚¿ãŒå¤§è¦æ¨¡ã§ã‚ã£ãŸã¨ã—ã¦ã‚‚ã€ãŸã¨ãˆã°å½¢æ…‹ç´ è§£æžãªã‚“ã‹ã®ã‚¿
ttakezawa 2010/06/14
research

algorithm

hadoop
ãƒªãƒ³ã‚¯
Amazon.co.jp: Hadoop: Tom White (è‘—), çŽ‰å·ç«œå¸ (ç¿»è¨³), å…¼ç”°è–å£« (ç¿»è¨³): æœ¬
ttakezawa 2010/04/23
amazon

book

hadoop

google
ãƒªãƒ³ã‚¯
HBase å…¥é–€ (1) - ã“ã©ã‚‚(ã¦ã‚Œã³)
Hadoop ã¨ HBase ã§åˆ†æ•£å‡¦ç†ãŒæ›¸ã‘ã‚‹ã®ã¯ã‚ã‹ã£ãŸã‘ã©ã€ã„ã–ä½¿ã£ã¦ã¿ã‚‹ã¨ãªã‚‹ã¨ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆãŒå°‘ãªãã¦â€¦â€¦ã€ã¨ã„ã†ã‚ãªãŸã®ç‚ºã® HBase å…¥é–€ã€ä»Šå›žã¯ã‚»ãƒƒãƒˆã‚¢ãƒƒãƒ—ã‹ã‚‰ Java ã® API ã§ HBase ã‚’è§¦ã‚‹ã¾ã§ã‚’å‹‰å¼·ã—ã¾ã™ã€‚ ä½¿ç”¨ã™ã‚‹ãƒãƒ¼ã‚¸ãƒ§ãƒ³ã¯ Hadoop 0.17.2.1ã€HBase 0.2.1 ã§ã™ã€‚ 0. å‚è€ƒãƒšãƒ¼ã‚¸ http://hadoop.apache.org/core/docs/r0.17.2/ FrontPage - Hadoop Wiki http://hadoop.apache.org/core/docs/r0.17.2/api/index.html Hbase - Hadoop Wiki http://hadoop.apache.org/hbase/docs/r0.2.1/api/index.html 1. Hadoop ã®ã‚»ãƒƒãƒˆã‚¢ãƒƒãƒ— http:
ttakezawa 2010/04/21
hbase

hadoop

tutorial
ãƒªãƒ³ã‚¯
Amazon.co.jp: ã‚¯ãƒ©ã‚¦ãƒ‰å¤§å…¨: æ—¥çµŒBPç¤¾å‡ºç‰ˆå±€ (è‘—), æ—¥çµŒBPç¤¾å‡ºç‰ˆå±€ (ç·¨é›†): æœ¬
ttakezawa 2010/03/22
amazon

book

hadoop

mapreduce
ãƒªãƒ³ã‚¯
Mahout in Action
Mahout in Action is a hands-on introduction to machine learning with Apache Mahout. Following real-world examples, the book presents practical use cases and then illustrates how Mahout can be applied to solve them. Includes a free audio- and video-enhanced ebook. about the techno logy A computer system that learns and adapts as it collects data can be really powerful. Mahout, Apache's open source m
ttakezawa 2010/01/26
book

hadoop

mahout

machinelearning
ãƒªãƒ³ã‚¯
ã‚³ãƒ©ãƒ | ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹CMSãªã‚‰OpenCms
CMSãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã®ã€RFP(ææ¡ˆä¾é ¼æ›¸)ã€‘ä½œæˆã§ã¯ã€ãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã®èƒŒæ™¯ï¼ˆãªãœCMSåŒ–ãŒå¿…è¦ã‹ï¼‰ã€ç¾åœ¨ã®ã‚¦ã‚§ãƒ–ã‚µã‚¤ãƒˆã€ã‚·ã‚¹ãƒ†ãƒ ã®æ§‹æˆãƒ»æ©Ÿèƒ½ãƒ»å•é¡Œç‚¹ã€ãƒ‡ãƒ¼ã‚¿ç§»è¡Œã®æ–¹æ³•ã€CMSæ©Ÿèƒ½ã®è¦ä»¶ã¨ã„ã£ãŸãƒã‚¤ãƒ³ãƒˆã‚’ç››ã‚Šè¾¼ã¿ã¾ã—ã‚‡ã†ã€‚
ttakezawa 2009/12/16
java][manual]

nutch

hadoop
ãƒªãƒ³ã‚¯
PEGASUS: Peta-Scale Graph Mining System
Pegasus An award-winning, open-source, graph-mining system with massive scalability. Analyze petabytes of graph data with ease. English, all platforms We won the Open Source Software World Challenge, Silver Award DOWNLOAD USING PEGASUS PUBLICATIONS ABOUT SCHOOL OF COMPUTER SCIENCE
ttakezawa 2009/12/11
hadoop

graph

library

research
ãƒªãƒ³ã‚¯
å„ªè‰¯ä¼æ¥ã¯ãªãœHadoopã«èµ°ã‚‹ã®ã‹
ã¡ãªã¿ã«ã€ã“ã®åˆ†æžã®ãŸã‚ã«å¿…è¦ã¨ã•ã‚Œã‚‹MapReduceã®ã‚³ãƒ¼ãƒ‰ã§ã‚ã‚‹ãŒã€ãã®ã‚µã‚¤ã‚ºã¯ã‚ãšã‹20ã‚¹ãƒ†ãƒƒãƒ—ã ã¨ã„ã†ã€‚Yahoo!ã®ãƒ—ãƒ¬ã‚¼ãƒ³ãƒ†ãƒ¼ã‚¿ãƒ¼ã§ã‚ã‚‹ã€ã‚¨ãƒªãƒƒã‚¯ãƒ»ãƒãƒ«ãƒ‡ã‚·ãƒ¥ãƒã‚¤ãƒ©ãƒ¼æ°ã«ã‚ˆã‚‹ã¨ã€ãŸã¨ãˆçµŒé¨“ã®æµ…ã„ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã§ã‚ã£ã¦ã‚‚ã€MapReduceã«ã‚ˆã‚‹ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°ã¯å¯èƒ½ã§ã‚ã‚‹ã¨ã•ã‚Œã‚‹ã€‚ ã¾ãŸã€VISAã®ã‚¸ãƒ§ãƒ¼ãƒ»ã‚«ãƒ‹ãƒ³ã‚¬ãƒ æ°ã‹ã‚‰ã‚‚ã€è²´é‡ãªãƒ‡ãƒ¼ã‚¿ãŒæä¾›ã•ã‚Œã¦ã„ãŸã®ã§ä»¥ä¸‹ã«ç´¹ä»‹ã™ã‚‹ã€‚åŒç¤¾ã§ã¯ã€1æ—¥ã«1å„„ãƒˆãƒ©ãƒ³ã‚¶ã‚¯ã‚·ãƒ§ãƒ³ãŒç™ºç”Ÿã™ã‚‹ãŸã‚ã€2å¹´é–“ã§700å„„å¼·ã®ãƒˆãƒ©ãƒ³ã‚¶ã‚¯ã‚·ãƒ§ãƒ³ãƒã‚°ãŒè“„ç©ã•ã‚Œã€ãã®ãƒ‡ãƒ¼ã‚¿é‡ã¯36ãƒ†ãƒ©ãƒã‚¤ãƒˆã«è‡³ã‚‹ã¨ã„ã†ã€‚ã“ã†ã—ãŸã‚¹ã‚±ãƒ¼ãƒ«ã®ãƒ‡ãƒ¼ã‚¿ã‚’ã€å¾“æ¥ã®RDBã‚’ç”¨ã„ã¦åˆ†æžã™ã‚‹ã«ã¯ã€ç´„1ã‚«æœˆã®æ™‚é–“ãŒå¿…è¦ã¨ã•ã‚Œã¦ããŸãŒã€Hadoopã‚’ç”¨ã„ã‚‹ã“ã¨ã§13åˆ†ã«çŸç¸®ã•ã‚ŒãŸã¨ã„ã†ã€‚ ã“ã‚Œã¾ã§ã¯ã€Yahoo!ã«ã—ã‚VISAã«ã—ã‚ã€è†¨å¤§ãªãƒ‡ãƒ¼ã‚¿ã‚’RDBã«æŠ¼ã—è¾¼ã‚€ã»ã‹ã«æ–¹æ³•ã¯ãªãã€ãã®åˆ†æžã«æ•°åæ—¥ã‚’è¦ã™ã‚‹
ttakezawa 2009/10/16
hadoop
ãƒªãƒ³ã‚¯
Log In - Apache Software Foundation
Powered by a free Atlassian Confluence Open Source Project License granted to Apache Software Foundation. Evaluate Confluence today. ÄŒeÅ¡tina Dansk Deutsch Eesti English (UK) English (US) EspaÃ±ol FranÃ§ais Ãslenska Italiano Magyar Nederlands Norsk Polski PortuguÃªs RomÃ¢nÄƒ SlovenÄina Suomi Svenska Ð ÑƒÑÑÐºÐ¸Ð¹ ä¸æ–‡ æ—¥æœ¬èªž í•œêµì–´ Powered by Atlassian Confluence 7.19.30 Printed by Atlassian Confluence 7.19.30 Report
ttakezawa 2009/10/09
apache

mahout

lucene

hadoop

tutorial

book

machinelearning
ãƒªãƒ³ã‚¯
Hadoop World NYC å‚åŠ è¨˜ - moratorium
Hadoop World NYC å‚åŠ è¨˜ 2009-10-07 (Wed) 10:03 Hadoop ã¨è¨€ã†è¨³ã§Hadoop World NYC, 2009ã®å‚åŠ è¨˜ã‚’æ›¸ãã¾ã™ã€‚ 1æ—¥ç›®ã¯System Administratorç”¨ã®ãƒˆãƒ¬ãƒ¼ãƒ‹ãƒ³ã‚°ã‚³ãƒ¼ã‚¹ã‚’å—ã‘ã€2æ—¥ç›®ãŒã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹æœ¬ç•ªã§ã—ãŸã€‚ãƒˆãƒ¬ãƒ¼ãƒ‹ãƒ³ã‚°ã‚³ãƒ¼ã‚¹ã¯Developerå‘ã‘(3æ—¥é–“)ã¨Managerå‘ã‘ã®ãƒ“ã‚¸ãƒã‚¹å¯„ã‚Šã®ã‚³ãƒ¼ã‚¹ãŒæœ‰ã‚Šã€åˆè¨ˆã§100äººãã‚‰ã„ã¯å‚åŠ ã—ã¦ã„ãŸã¨æ€ã„ã¾ã™ã€‚ã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹ã®æœ¬ç•ªè‡ªä½“ã¯400ï½ž500äººã®å‚åŠ ã§ã—ãŸã€‚ ã¾ãšSystem Adminã‚³ãƒ¼ã‚¹ã§ã™ãŒã€å¤§ä½“ä»¥ä¸‹ã®ã‚ˆã†ãªå†…å®¹ã§ã—ãŸã€‚ MapReduceã®åŸºæœ¬æ¦‚å¿µ ãƒãƒ¼ãƒ‰ã‚¦ã‚§ã‚¢/ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯æ©Ÿå™¨ã®é¸å®šãƒã‚¤ãƒ³ãƒˆ OSã‚„Javaãªã©ã€ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã§ã®æ³¨æ„ç‚¹ Hadoop(Cloudera Distribution)ã®ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«æ–¹æ³• ãƒ‘ãƒ©ãƒ¡ãƒ¼ã‚¿ãƒ¼/ãƒ‘ãƒ•ã‚©ãƒ¼ãƒžãƒ³ã‚¹ãƒãƒ¥ãƒ¼
ttakezawa 2009/10/07
hadoop

conference
ãƒªãƒ³ã‚¯
Mapreduce & Hadoop Algorithms in Academic Papers | atbrox
The newest and most up-to-date version (May 2010) this blog post is available at http://mapreducebook.org An updated and extended version of this blog post can be found here. Motivation Learn from academic literature about how the mapreduce parallel model and hadoop implementation is used to solve algorithmic probl ems. Disclaimer: this is work in progress (look for updates) Input Data â€“ Academic P
ttakezawa 2009/10/04
hadoop

mapreduce

algorithm

paper

research
ãƒªãƒ³ã‚¯
Amazon EC2ã‚’ãƒ™ãƒ¼ã‚¹ã«åˆ†æ•£å‡¦ç†ã‚·ã‚¹ãƒ†ãƒ ã‚’æ§‹ç¯‰ã™ã‚‹Â·Cloud Crowd MOONGIFT
Cloud Crowdã¯Rubyè£½ã®ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ãƒ»ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã€‚å¤§é‡ã®ãƒ‡ãƒ¼ã‚¿ã‚’å‡¦ç†ã—ã‚ˆã†ã¨æ€ã£ãŸæ™‚ã«ã¯MapReduceã®ã‚ˆã†ãªä»•çµ„ã¿ã«æ³¨ç›®ãŒé›†ã¾ã‚‹ã€‚ãƒ†ã‚ã‚¹ãƒˆã®ã¿ãªã‚‰ãšã€å¤§é‡ã®OCRå‡¦ç†ãŒå¿…è¦ã«ãªã£ãŸã‚Šç”»åƒã‚’ã‚µãƒ ãƒã‚¤ãƒ«åŒ–ã—ãŸã„ã¨ã„ã£ãŸæ™‚ã«ã¯ã©ã®ã‚ˆã†ãªã‚·ã‚¹ãƒ†ãƒ ã‚’æ§‹ç¯‰ã™ã‚‹ã®ã ãŒè‰¯ã„ã ã‚ã†ã‹ã€‚ Rubyã‚’ä½¿ã£ã¦åˆ†æ•£å‡¦ç† ä¸€æ™‚çš„ã«ç„¡æ•°ã®ã‚·ã‚¹ãƒ†ãƒ ã‚’ç«‹ã¡ä¸Šã’å¹³è¡Œã§å‡¦ç†ã‚’èµ°ã‚‰ã›ã‚‹æ™‚ã«æ³¨ç›®ã—ãŸã„ã®ãŒAmazon EC2ã ã€‚ä»¥å‰ã€ãƒ‹ãƒ¥ãƒ¼ãƒ¨ãƒ¼ã‚¯ã‚¿ã‚¤ãƒ ã‚ºã§ã¯1,100ä¸‡æžšã‚’è¶Šãˆã‚‹ç”»åƒã‚’PDFã«å¤‰æ›ã™ã‚‹ã¨ã„ã†å‡¦ç†ã‚’Amazon EC2ã®ã‚¤ãƒ³ã‚¹ã‚¿ãƒ³ã‚¹ã‚’100ç«‹ã¡ä¸Šã’ã¦è¡Œã£ãŸã¨ã„ã†äº‹ä¾‹ãŒã‚ã‚‹ã€‚ã©ã†ã‚ˆã†ã®ã‚·ã‚¹ãƒ†ãƒ ã‚’æ§‹ç¯‰ã™ã‚‹ã®ãŒCloud Crowdã ã€‚ Cloud Crowdã‚‚åˆ©ç”¨ã™ã‚‹ã®ã¯Amazon EC2ã ã€‚ã‚¢ã‚¯ã‚·ãƒ§ãƒ³ã¯Rubyã§å®šç¾©ã™ã‚‹ã‚ˆã†ã«ãªã£ã¦ãŠã‚Šã€ãƒ†ã‚ã‚¹ãƒˆå‡¦ç†ã®ã¿ãªã‚‰ãšç”»åƒå¤‰æ›ãªã©ã®æŸ”è»Ÿãªã‚·ã‚¹ãƒ†ãƒ å‡¦ç†ãŒå¯
ttakezawa 2009/09/24
amazon

ec2

hadoop

ruby
ãƒªãƒ³ã‚¯
1 2 æ¬¡ã®ãƒšãƒ¼ã‚¸