Treasure Data, Inc. | Finding Gems in Your Big DataDeliver The Experiences You Can’t TodayUnlike other customer data platforms (CDPs), only Treasure Data combines batch and real-time data to personalize journeys with Al. The results? Increased conversions and optimized spend across channels.
Welcome to Apache Pig!
Apache Pig is a platform for analyzing large data sets that consists of a high-level language for expressing data analysis programs, coupled with infrastructure for evaluating these programs. The salient property of Pig programs is that their structure is amenable to substantial parallelization, which in turns enables them to handle very large data sets. At the present time, Pig's infrastructure l
ã„ã¾ã•ã‚‰èžã‘ãªã„Hadoopã¨ãƒ†ã‚ストマイニング入門
ビッグデータ時代ã®æ•‘世主「Hadoopã€ã¨ã¯ 「Apache Hadoopã€ã¯ä»Šã€æœ€ã‚‚注目を集ã‚ã¦ã„る技術ã®1ã¤ã§ã™ã€‚Hadoopã¨ã¯ã€å¤§é‡ã®ãƒ‡ãƒ¼ã‚¿ã‚’手軽ã«è¤‡æ•°ã®ãƒžã‚·ãƒ³ã«åˆ†æ•£ã—ã¦å‡¦ç†ã§ãるオープンソースã®ãƒ—ラットフォームã§ã™ã€‚ Hadoopを活用ã—ã¦ã„ã‚‹ä¼æ¥ã¯å¹´ã€…増ãˆç¶šã‘ã¦ã„ã¦ã€ä¸å¯æ¬ ãªæŠ€è¡“ã«ãªã‚Šã¤ã¤ã‚ã‚‹ã¨ã„ãˆã‚‹ã§ã—ょã†ã€‚ 本連載ã§ã¯ã€Hadoopã¨ã¯ä½•ã‹ã€HadoopãŒã©ã†æ´»ç”¨ã§ãã‚‹ã®ã‹ã¨ã„ã†ã“ã¨ã‚’ã€ã€Œãƒ†ã‚ストマイニングã€ã«ç„¦ç‚¹ã‚’当ã¦ã¦è§£èª¬ã—ã¦ã„ããŸã„ã¨æ€ã„ã¾ã™ã€‚ é‡ã„処ç†ã‚’複数ã®ãƒžã‚·ãƒ³ã«åˆ†æ•£ã•ã›ã‚‹ 複数ã®ãƒžã‚·ãƒ³ã«å‡¦ç†ã‚’分散ã•ã›ã‚‹ã«ã¯ã€ãƒ—ãƒã‚»ã‚¹åŒå£«ã®é€šä¿¡ã€ç›£è¦–ã€éšœå®³æ™‚ã®å¯¾å¿œãªã©ã‚’考ãˆãªã‘ã‚Œã°ãªã‚‰ãšã€ãƒ—ãƒã‚°ãƒ©ãƒžã«ã¨ã£ã¦ãƒãƒ¼ãƒ‰ãƒ«ãŒé«˜ã„ã‚‚ã®ã§ã™ã€‚ã—ã‹ã—ã€Hadoopã¯ãã†ã„ã£ãŸé¢å€’ãã•ã„処ç†ã‚’一手ã«å¼•ãå—ã‘ã¦ãã‚Œã€ãƒ—ãƒã‚°ãƒ©ãƒžã¯ã€ã‚„ã‚ŠãŸã„処ç†ã ã‘ã«é›†ä¸ã§ãã¾ã™ã€‚ 例ãˆã°ã€Hadoopを使ã†ã¨ã€1
クックパッドã¨Hadoop - クックパッド開発者ブãƒã‚°
ã¯ã˜ã‚ã¾ã—ã¦ã€‚今年ã®5月ã«å…¥ç¤¾ã—ãŸå‹é–“@ã•ãŒã™ãƒãƒ¼ãƒ ã§ã™ã€‚ 入社ã—ã¦ã‹ã‚‰ã¯ã€ãªã‹ãªã‹å¤§å¤‰ãªã“ã¨ã‚‚多ã„ã§ã™ãŒã€æœ€è¿‘ã¯ãŠé…’好ããŒé›†ã¾ã£ã¦æœˆæ›œã‹ã‚‰é£²ã¿åˆã† 「å‹é–“会ã€ãªã‚‹ã‚‚ã®ã‚‚発足ã—ã¦ã€ä»•äº‹é¢ã§ã‚‚仕事以外ã®é¢ã§ã‚‚密度ã®é«˜ã„毎日をéŽã”ã—ã¦ã„ã¾ã™ï¼ ã•ã¦ã€åƒ•ã¯ã€Œã•ãŒã™ã€ãƒãƒ¼ãƒ 所属ã¨ã„ã†ã“ã¨ã§ã€æ™®æ®µã¯ãƒ¬ã‚·ãƒ”を「ã•ãŒã™ã€ãƒ¦ãƒ¼ã‚¶ã®æº€è¶³åº¦ã‚’上ã’ã‚‹ãŸã‚ã«ã€ クックパッドã®æ¤œç´¢ã¾ã‚ã‚Šã«ã¤ã„ã¦ã€ã„ã‚ã„ã‚ãªé–‹ç™ºã‚’è¡Œã£ã¦ã„ã¾ã™ã€‚ 一方ã§ã€ãƒ¦ãƒ¼ã‚¶ã®ã€Œã•ãŒã™æ¬²æ±‚ã€ã«ã¤ã„ã¦æ·±ã知るãŸã‚ã«ã€å¤§è¦æ¨¡ãªãƒ‡ãƒ¼ã‚¿è§£æžã‚’è¡Œã„ã€æ¬²æ±‚ã®åˆ†æžã‚’è¡Œã†æ©Ÿä¼šã‚‚増ãˆã¦ãã¾ã—ãŸã€‚ ã¨ã“ã‚ãŒã€ã‚¯ãƒƒã‚¯ãƒ‘ッドã®ãƒã‚°ã¯è†¨å¤§ãªæ•°ãŒã‚ã‚‹ã®ã§ã€ä¸€å£ã®ãƒ‡ãƒ¼ã‚¿è§£æžã¨è¨€ã£ã¦ã‚‚通常ã®ãƒãƒƒãƒå‡¦ç†ã ã¨é–“ã«åˆã‚ãªã„ãŸã‚〠分散処ç†ç’°å¢ƒã®å¿…è¦æ€§ãŒé«˜ã¾ã£ã¦ãã¾ã—ãŸã€‚ ãã“ã§ã€ã¾ãšã¯æ‰‹è»½ã«è©¦ã›ã‚‹åˆ†æ•£å‡¦ç†ã®çŽ‹é“ã¨ã„ã†ã“ã¨ã§ã€æœ€è¿‘ã§ã¯Hadoopを使ã£ãŸãƒ‡ãƒ¼ã‚¿è§£æžç’°å¢ƒã‚’æ•´å‚™ã—ã¦ã„ã¾ã™ã€‚
Rubyã§Hadoopをラップã€åˆ†æ•£å‡¦ç†ãƒ„ールã‚ットãŒç™»å ´ ï¼ ï¼ IT
2009/05/12 米新èžç¤¾å¤§æ‰‹ã®ãƒ‹ãƒ¥ãƒ¼ãƒ¨ãƒ¼ã‚¯ãƒ»ã‚¿ã‚¤ãƒ ズã¯5月11æ—¥ã€Rubyã«ã‚ˆã‚‹å¤§è¦æ¨¡åˆ†æ•£å‡¦ç†ã®ãƒ„ールã‚ット「Map/Reduce Toolkitã€ï¼ˆMRToolkit）をGPLv3ã®ä¸‹ã«ã‚ªãƒ¼ãƒ—ンソースã§å…¬é–‹ã—ãŸã¨ç™ºè¡¨ã—ãŸã€‚MRToolkitã¯ã€ã™ã§ã«ç¨¼åƒã—ã¦ã„るクラスタ上ã®Hadoopã¨åˆã‚ã›ã¦ä½¿ã†ã“ã¨ã§Rubyã§å®¹æ˜“ã«Map/Reduce処ç†ã‚’記述ã™ã‚‹ã“ã¨ãŒã§ãる一種ã®ãƒ©ãƒƒãƒ‘ー。処ç†è‡ªä½“ã¯HadoopãŒè¡Œã†ã€‚ã™ã§ã«Hadoopを使ã£ã¦ã„るユーザーã§ã‚ã‚Œã°ã€ä¸å°è¦æ¨¡ã®ãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã«å¯¾ã—ã¦ã€ã™ãã«MRToolkitã‚’é©ç”¨å¯èƒ½ã¨ã—ã¦ã„る。 デフォルトã§æœ‰ç”¨ãªMapã€Reduceã®å‡¦ç†ãƒ¢ã‚¸ãƒ¥ãƒ¼ãƒ«ãŒå«ã¾ã‚Œã¦ã„ã¦ã€æ•°è¡Œã®Rubyスクリプトを書ãã ã‘ã§ã€ä¾‹ãˆã°è†¨å¤§ãªApacheã®ãƒã‚°ã‹ã‚‰IPアドレス別ã®é–²è¦§å±¥æ´ã‚’ã¾ã¨ã‚ã‚‹ã¨ã„ã£ãŸå‡¦ç†ãŒå¯èƒ½ã¨ã„ã†ã€‚独自ã«Mapã‚„Reduceã®å‡¦ç†ã‚’定義ã™ã‚‹ã“ã¨ã‚‚
Amazon Elastic MapReduceを使ã£ã¦ã¿ãŸ - moratorium
Amazon Elastic MapReduceを使ã£ã¦ã¿ãŸ 2009-04-03 (Fri) 3:06 Amazon EC2 連日ã®EC2ãƒã‚¿ã§ã™ã€‚本日ã€Amazonã‹ã‚‰Elastic MapReduceã¨ã„ã†ã‚µãƒ¼ãƒ“スãŒãƒªãƒªãƒ¼ã‚¹ã•ã‚Œã¾ã—ãŸã€‚大è¦æ¨¡ãƒ‡ãƒ¼ã‚¿å‡¦ç†æŠ€è¡“ãŒä¸€æ°—ã«æ°‘é–“ã®æ‰‹ã«ä¸‹ã‚Šã¦ãã‚‹ã€ã¾ã•ã«é©å‘½çš„ãªã‚µãƒ¼ãƒ“スã ã¨æ€ã„ã¾ã™ã€‚ Amazon Elastic MapReduce Amazon ElasticMapReduce 紹介ビデオ With Hadoop, Amazon Adds A Web-Scale Data Processing Engine To Its Cloud Computer by techcrunch.com Elastic MapReduceã¯ã€Googleã®åŸºç›¤æŠ€è¡“ã®ä¸€ã¤ã§ã‚ã‚‹MapReduceを時間å˜ä½èª²é‡‘ã§å®Ÿè¡Œã§ãるサービスã§ã™ã€‚MapReduceã«ã¤ã„ã¦ã¯ä»¥
hadoop-ec2ã§ã‚¢ã‚¯ã‚»ã‚¹è§£æžã—ã¦ã¿ãŸã‚ˆï¼
å‰å›žï¼ˆhttp://d.hatena.ne.jp/lopnor/20080831/1220183688）サンプルプãƒã‚°ãƒ©ãƒ ã‚’å‹•ã‹ã™ã¨ã“ã‚ã¾ã§è¡Œãã¾ã—ãŸã‘ã©ã€ä»Šå›žã¯ä¾‹ã®id:naoyaã®hadoop streamingã§ã‚¢ã‚¯ã‚»ã‚¹è§£æžï¼ˆhttp://d.hatena.ne.jp/naoya/20080513/1210684438）ã™ã‚‹ã®ã‚’ã‚„ã£ã¦ã¿ã¾ã™ã€‚ã¨ã„ã†ã‹ãªã‚“ã¨ã‹ãŸã©ã‚Šç€ã„ãŸã®ã§ã¾ã¨ã‚を書ãã¾ã™ã€‚ *ec2ã®ä½¿ã„æ–¹ id:rx7ã•ã‚“ãŒã¨ã¦ã‚‚ä¸å¯§ã«èª¬æ˜Žã•ã‚Œã¦ã„る資料（http://d.hatena.ne.jp/rx7/20080528/p1）ãŒã‚ã‚‹ã®ã§ã€ãã¡ã‚‰ã‚’èªã‚ã°å®Œç’§ã ã¨æ€ã„ã¾ã™ã€‚僕もã“ã‚Œã§ec2ãŒä½¿ãˆã‚‹ã‚ˆã†ã«ãªã‚Šã¾ã—ãŸã€‚ *hadoop-ec2ã®ä½¿ã„æ–¹ https://codezine.jp/article/detail/2841ãŒã‚¤ãƒ³ãƒˆãƒãƒ€ã‚¯ã‚·ãƒ§ãƒ³ã€‚http://d.hatena.n
1
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
{{#tags}}- {{label}}
{{/tags}}