Open Sourcing TensorFlowOnSpark: Distributed Deep... | Hadoop at Yahoo
By Lee Yang, Jun Shi, Bobbie Chern, and Andy Feng (@afeng76), Yahoo Big ML team Introduction Today, we are pleased to offer TensorFlowOnSpark to the community, our latest open source framework for distributed deep learning on big-data clusters. Deep learning (DL) has evolved significantly in recent years. At Yahoo, we’ve found that in order to gain insight from massive amounts of data, we need to
Etsukata blog: Hadoop : CPU system 使用率高騰 "zone_reclaim_mode = 1" 編
ã¯ã˜ã‚㫠会社㧠PB ç´šã® Hadoop クラスタをé‹ç”¨ã—ã¦ã„ã¾ã™ãŒã€ã‚ã‚‹æ—¥ã‹ã‚‰ Datanode ã® CPU system (Kernel 内ã§ã® CPU 使用率) ãŒé«˜é¨°ã—ã€Job ãŒé…延ã™ã‚‹ã¨ã„ã†ç—‡çŠ¶ãŒç™ºç¾ã—ã¾ã—ãŸã€‚Hadoop 㧠CPU system 高騰ã¨ã„ã†ã¨ã€ Transparent HugePage è¨å®šãŒæœ‰åã§ã™ãŒã€ãã¡ã‚‰ã«ã¤ã„ã¦ã¯æ—¢ã«ç‰¹å®šã—ã€å¯¾ç–済ã¿ã§ã—ãŸã€‚ THP 㨠Hadoop ã«é–¢ä¿‚ã«ã¤ã„ã¦ã¯ä¸‹è¨˜ Blog ãŒè©³ã—ã„ã§ã™ã€‚ Transparent Huge Pages and Hadoop Workloads 今回㯠THP ã§ã¯ãªã〠"zone_reclaim_mode" ã®è¨å®šã«ã‚ˆã‚‹æ€§èƒ½åŠ£åŒ–ã«ã¤ã„ã¦ã€ç¾è±¡ã‹ã‚‰åŽŸå› 特定ã«è‡³ã‚‹ã¾ã§ã®çµŒç·¯ã¨ã€æŽ¨å¥¨ã™ã‚‹è¨å®šã«ã¤ã„ã¦è§£èª¬ã—ã¾ã™ã€‚ ç¾è±¡ 観測ã•ã‚ŒãŸç¾è±¡ã«ã¤ã„ã¦ç°¡å˜ã«ç®‡æ¡æ›¸ãã—ã¾ã™ã€‚ CPU user ㌠5% 程度
Azkaban
Azkaban is a batch workflow job scheduler created at LinkedIn to run Hadoop jobs. Azkaban resolves the ordering through job dependencies and provides an easy to use web user interface to maintain and track your workflows. Features Compatible with any version of Hadoop Easy to use web UI Simple web and http workflow uploads Project workspaces Scheduling of workflows Modular and pluginable Authentic
Presto: Free, Open-Source SQL Query Engine for any Data
Calling our Presto community speakers – we want to hear from you! Fill out out community call for papers to speak at upcoming meetups and conferences. What is Presto?Presto is an open source SQL query engine that’s fast, reliable, and efficient at scale. Use Presto to run interactive/ad hoc queries at sub-second performance for your high volume apps.
リクルート全社検索基盤ã®ã‚¢ãƒ¼ã‚テクãƒãƒ£ã€æŽ¡ç”¨æŠ€è¡“ã€é–‹ç™ºä½“制ã¯ã©ã†ãªã£ã¦ã„ã‚‹ã®ã‹
リクルート全社検索基盤ã®ã‚¢ãƒ¼ã‚テクãƒãƒ£ã€æŽ¡ç”¨æŠ€è¡“ã€é–‹ç™ºä½“制ã¯ã©ã†ãªã£ã¦ã„ã‚‹ã®ã‹ï¼šElasticsearch＋Hadoopベースã®å¤§è¦æ¨¡æ¤œç´¢åŸºç›¤å¤§è§£å‰–（1）（1/2 ページ） リクルートã®äº‹ä¾‹ã‚’基ã«ã€å¤§è¦æ¨¡BtoCサービスã«æ±‚ã‚られる検索基盤ã¯ã©ã†æ§‹ç¯‰ã•ã‚Œã‚‹ã‚‚ã®ãªã®ã‹ã€ã©ã‚“ãªæŠ€è¡“ãŒæŽ¡ç”¨ã•ã‚Œã¦ã„ã‚‹ã®ã‹ã€é‹ç”¨ã¯ã©ã†ãªã£ã¦ã„ã‚‹ã®ã‹ãªã©ã«ã¤ã„ã¦è§£èª¬ã™ã‚‹é€£è¼‰ã€‚åˆå›žã¯å…¨ä½“çš„ãªã‚¢ãƒ¼ã‚テクãƒãƒ£ã€æŽ¡ç”¨æŠ€è¡“ã€é–‹ç™ºä½“制ã«ã¤ã„ã¦ã€‚ 連載目次 大è¦æ¨¡BtoCサービスã§æ±‚ã‚られる検索基盤ã¯ã€ã©ã†ã‚ã‚‹ã¹ããªã®ã‹ カスタマー（消費者）ãŒæ±‚ã‚ã‚‹ã‚‚ã®ãŒæ—¥ã€…変ã‚ã£ã¦ã„ãç¾åœ¨ã«ãŠã„ã¦ã€BtoCã®æ¤œç´¢åŸºç›¤ã¯ã©ã†ã‚ã‚‹ã¹ããªã®ã§ã—ょã†ã‹ã€‚ 例ãˆã°ã€ãƒªã‚¯ãƒ«ãƒ¼ãƒˆã§ä½¿ã‚ã‚Œã¦ã„る検索基盤ã®ã€ŒQass（Query analyze search system）ã€ã¯å˜ã«å…¨æ–‡æ¤œç´¢æ©Ÿèƒ½ã‚’æä¾›ã™ã‚‹ã®ã§ã¯ãªãã€ä»¥ä¸‹ã‚’軸ã¨ã—ã¦ã„ã¾ã™ã€‚ サービスã”ã¨ã«æœ€é©åŒ–ã•ã‚Œ
ãƒãƒƒãƒå‡¦ç†ã€ã‚¸ãƒ§ãƒ–管ç†ã«ã¤ã„ã¦æ›¸ã„ã¦ã¿ã‚‹ - wyukawa's diary
僕ã¯Hive, Pythonã§ãƒãƒƒãƒå‡¦ç†ã‚’書ã„ã¦Azkabanã§ã‚¸ãƒ§ãƒ–管ç†ã™ã‚‹ã‚·ã‚¹ãƒ†ãƒ を構築ã€é‹ç”¨ã—ãŸçµŒé¨“ãŒ2å¹´ã»ã©ã‚ã‚‹ã®ã§ä»Šæ—¥ã¯ãƒãƒƒãƒå‡¦ç†ã€ã‚¸ãƒ§ãƒ–管ç†ã«ã¤ã„ã¦æ›¸ã„ã¦ã¿ã‚ˆã†ã¨æ€ã„ã¾ã™ã€‚ 僕ã®çµŒé¨“上Hadoop特有ã®éƒ¨åˆ†ã€ä¾‹ãˆã°ãƒ†ã‚¹ãƒˆç’°å¢ƒãŒä½œã‚Šã¥ã‚‰ã„ã¨ã‹ãƒãƒƒãƒã‚µãƒ¼ãƒãƒ¼ã¯ã‚¸ãƒ§ãƒ–ã‚’submitã™ã‚‹ã ã‘ãªã®ã§è² è·ã¯ãã‚“ãªã«ã‹ã‹ã‚‰ãªã„ã¨ã‹ã€ã¯ã‚ã‚‹ã‘ã‚Œã©å‰²ã¨æ±Žç”¨çš„ãªã®ã§ã¯ãªã„ã‹ã¨æ€ã„ã¾ã™ã€‚ãã‚‚ãã‚‚ãƒãƒƒãƒå‡¦ç†ã€ã‚¸ãƒ§ãƒ–管ç†ã«ã¤ã„ã¦æ›¸ã‹ã‚ŒãŸã‚‚ã®ã¯ã»ã¨ã‚“ã©è¦‹ãŸäº‹ãŒãªã„ã®ã§å‚考ã«ãªã‚Œã°å¬‰ã—ã„ã—ã€ã“ã†ã„ã†è‰¯ã„方法もã‚るよï¼ã¨ã‹ã‚ã‚Œã°æ˜¯éžãƒ–ãƒã‚°ç‰ã«æ›¸ã„ã¦ã»ã—ã„ã¨æ€ã£ã¦ãŠã‚Šã¾ã™ã€‚ 最åˆã«è¨€ã£ã¦ãŠãã¨ãƒãƒƒãƒå‡¦ç†ã€ã‚¸ãƒ§ãƒ–管ç†ã«ãŠã„ã¦é‡è¦ãªã®ã¯éšœå®³æ™‚ã®ãƒªã‚«ãƒãƒªã®ã—ã‚„ã™ã•ã§ã™ã€‚æ£å¸¸æ™‚ã¯ã¾ã‚ã„ã„ã§ã—ょ。 ãªã®ã§ä¾‹ãˆã°å¼•æ•°ã«æ—¥ä»˜ã‚’æŒã¦ãªã„よã†ãªãƒãƒƒãƒæ›¸ã„ãŸã‚‰è¾›ã„ã§ã™ã—ã€LL言語ã§æ›¸ãæ–¹ãŒã‚³ãƒ³ãƒ‘イルã€ãƒ‘ッケージングã¨ã‹æ¥½ã§ã™ã€‚CP
å°ä¸è¦æ¨¡ã®ITç³»ä¼æ¥ã«ãŠã‘る技術的é¸æŠžã¨é›‡ç”¨æˆ¦ç•¥ã«é–¢ã™ã‚‹é›‘æ„Ÿ - ãŸã”ã‚‚ã‚Šã™ãƒ¡ãƒ¢
ã§ã£ã‹ã„主語ã§å…¥ã£ãŸãŒã€è¦ã™ã‚‹ã«2月ã«ã‚ã¡ã“ã¡ä¼šç¤¾å·¡ã‚Šã‚’ã—ãŸã¨ãã«æ„Ÿã˜ãŸã“ã¨ã«ã¤ã„ã¦ã¤ã‚‰ã¤ã‚‰æ›¸ã“ã†ã€ã¨ã„ã†ã®ãŒç›®çš„。 特定ã®ä¼šç¤¾ã«ã¤ã„ã¦æ›¸ã„ã¦ã‚‚ã—ょã†ãŒãªã„ã®ã§ã€ã‚ã‚Œã“ã‚Œ*1回ã£ãŸã†ã¡ã‹ã‚‰å°‘ãªãã¨ã‚‚2〜3ケースã§è©²å½“ã™ã‚‹ãªã‚ã€ã¨æ€ã£ãŸã“ã¨ã«ã¤ã„ã¦æ›¸ã。特定ã®1社ã®ã¿ã«è©²å½“ã™ã‚‹äº‹é …ã¯ã“ã®ã‚¨ãƒ³ãƒˆãƒªã«ã¯ã²ã¨ã¤ã‚‚出ã¦ãã¾ã›ã‚“。 ã¾ãŸã‚¨ãƒ³ãƒˆãƒªã®ä¸»æ—¨ã‹ã‚‰ã—ã¦è¶…上ã‹ã‚‰ç›®ç·šã«ãªã‚Šã¾ã™ãŒã€ã©ã†ã‹ã”容赦ãã ã•ã„。 ã“ã‚Œã‹ã‚‰æˆé•·ãŒæœ¬æ ¼åŒ–ã™ã‚‹ã®ã§ã‚¤ãƒ³ãƒ•ãƒ©ã‚’支ãˆã‚‰ã‚Œã‚‹äººæãŒã»ã—ã„ æ£ç›´ã«è¨€ã£ã¦ã“ã‚ŒãŒä¸€ç•ªå¤šã‹ã£ãŸãƒ‘ターン。スタートアップ的ã«ã‚µãƒ¼ãƒ“スを作ã£ã¦ããŸãŒãã®ä¸€æ–¹ã§ãƒ‡ãƒ—ãƒã‚¤ã‚„監視ãªã©ã®é‹ç”¨ã¾ã‚ã‚ŠãŒå¾Œæ‰‹å¾Œæ‰‹ã«ãªã£ã¦ãŠã‚Šã€ãã®ã‚ãŸã‚Šã‚’支ãˆã‚‰ã‚Œã‚‹äººç‰©ãŒã»ã—ã„。 話ã¨ã—ã¦ã¯ã‚ã‹ã‚‹ã®ã ãŒã€æ°—ã«ãªã£ãŸã®ã¯ã€ã“れをèžãã¨ãã€è©³ã—ã„内容をçªã£è¾¼ã‚“ã§ã¿ã‚‹ã¨ã€ã©ã†ã‚‚実際ã«ã¯ãã†å›°ã£ã¦ã¯ã„ãªã„ã€ã¨ã„ã†ã‚±ãƒ¼ã‚¹ãŒã»ã¨ã‚“ã©ã ã£ãŸã‚ˆã†ã«æ€ãˆ
Yahoo! Japanã®Hadoopã¯6000å°ã€ä»Šå¾Œã¯OSS開発ã«ã‚‚貢献
Yahoo! Japanã®Hadoopã¯6000å°ã€ä»Šå¾Œã¯OSS開発ã«ã‚‚貢献 ヤフー データソリューション本部 å°é–“基裕本部長 ãªã© 世界最大ã®ã€ŒHadoopã€ã‚¯ãƒ©ã‚¹ã‚¿ãƒ¼ã‚’é‹ç”¨ã—ã¦ã„ã‚‹ä¼æ¥ã¨è¨€ãˆã°ã€Hadoopã®é–‹ç™ºã‚’始ã‚ãŸç±³ãƒ¤ãƒ•ãƒ¼ã§ã‚る。åŒç¤¾ã¯2014å¹´6月ã®ã€ŒHadoop Summit 2014ã€ã§ã€3万2000å°ã®Hadoopクラスターをé‹ç”¨ã—ã¦ã„ã‚‹ã“ã¨ã‚’明らã‹ã«ã—ãŸã€‚ã§ã¯æ—¥æœ¬ã§æœ€å¤§ç´šã®Hadoopクラスターをé‹ç”¨ã—ã¦ã„ã‚‹ã®ã¯èª°ã‹ã€‚ãれもやã¯ã‚Šã€ãƒ¤ãƒ•ãƒ¼ï¼ˆYahoo! JAPAN）ã 。 Yahoo! JAPANãŒé‹ç”¨ã™ã‚‹Hadoopクラスターã®è¦æ¨¡ã¯6000å°ã§ã€åŒç¤¾ã®ãƒ“ッグデータ専門組織ã§ã‚るデータソリューション本部ã«ã¯ã€220人ã®ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã‚„データサイエンティストãŒé›†çµã™ã‚‹ã€‚åŒç¤¾ãƒ‡ãƒ¼ã‚¿ã‚½ãƒªãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³æœ¬éƒ¨ã®å°é–“基裕本部長ã€åŒæœ¬éƒ¨ã®å²¡æœ¬æ…Žä¸€éƒŽãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆãƒžãƒãƒ¼ã‚¸ãƒ£ãƒ¼ã€ã‚·ã‚¹ãƒ†ãƒ 統括本部ã®
Yahoo! JAPAN Selects Apache Hadoop Leader Hortonworks for their Enterprise
SANTA CLARA, Calif., March 4, 2015 /PRNewswire/ -- Hortonworks® (NASDAQ: HDP), the leading contributor to and provider of Apache™ Hadoop®, today announced it has expanded its customer base in Asia with the addition of Yahoo! JAPAN, a leading digital property focused on making the world's daily habits inspiring and entertaining. Yahoo! JAPAN will launch a comprehensive data platform based on the Ho
日本ä¼æ¥ã‹ã‚‰åˆã®Apache Hadoopã®ã‚³ãƒŸãƒƒã‚¿ï¼ˆä¸»è¦é–‹ç™ºè€…）就任
æ—¥æœ¬é›»ä¿¡é›»è©±æ ªå¼ä¼šç¤¾ï¼ˆæ±äº¬éƒ½åƒä»£ç”°åŒºã€ä»£è¡¨å–ç· å½¹ç¤¾é•·ï¼šéµœæµ¦ åšå¤«ã€ä»¥ä¸‹ï¼šNTT）ãŠã‚ˆã³æ ªå¼ä¼šç¤¾NTTデータ（本社：æ±äº¬éƒ½æ±Ÿæ±åŒºã€ä»£è¡¨å–ç· å½¹ç¤¾é•·ï¼šå²©æœ¬ æ•ç”·ã€ä»¥ä¸‹ï¼šNTTデータ）ã‹ã‚‰ã€å¤§è¦æ¨¡ãƒ‡ãƒ¼ã‚¿ã‚’対象ã¨ã—ãŸä¸¦åˆ—分散処ç†ã‚’実ç¾ã™ã‚‹ã‚ªãƒ¼ãƒ—ンソースソフトウェアApache Hadoop（以下：Hadoop）ãŠã‚ˆã³ãã®é–¢é€£ã®ãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã®ã‚³ãƒŸãƒƒã‚¿ã«ã€2014å¹´12月18æ—¥ã€å°æ²¢ å¥å²ï¼ˆNTTソフトウェアイノベーションセンタ）ã€é¯µå‚ 明ã€å²©å´Ž æ£å‰›ï¼ˆNTTデータ 基盤システム事æ¥æœ¬éƒ¨ï¼‰ã®3åãŒå°±ä»»ã™ã‚‹ã“ã¨ã«ãªã‚Šã¾ã—ãŸã€‚ コミッタã¨ã¯ã€Hadoopã®é–‹ç™ºã‚„メンテナンスã«ãŠã„ã¦ã€ãƒ—ãƒã‚°ãƒ©ãƒ を書ãæ›ãˆã‚‹æ¨©é™ï¼ˆã‚³ãƒŸãƒƒãƒˆæ¨©ï¼‰ã‚’æŒã¤ä¸»è¦é–‹ç™ºè€…ã®ã“ã¨ã§ã€ç¾åœ¨ã€Hadoopã®é–‹ç™ºã«é–¢ä¸Žã—ã¦ã„る全世界ã§ç´„3,000åã®ã†ã¡ã€ã‚³ãƒŸãƒƒã‚¿ã¯ã”ã一部［約100å（2014å¹´12月）］ã«é™ã‚‰ã‚Œã¦ã„ã¾ã™ã€‚Hadoopã«ãŠã„ã¦ã¯ã€
Spark Release 1.0.0 | Apache Spark
Spark 1.0.0 is a major release marking the start of the 1.X line. This release brings both a variety of new features and strong API compatibility guarantees throughout the 1.X line. Spark 1.0 adds a new major component, Spark SQL, for loading and manipulating structured data in Spark. It includes major extensions to all of Spark’s existing standard libraries (ML, Streaming, and GraphX) while also
Engineering
Engineering Building the platform where people around the world come to search, save and shop Our Engineering team is at the core of bringing our platform to life for Pinners worldwide. Working collaboratively and cross-functionally with teams across the company, our engineers tackle growth-driving challenges to build an inspired and inclusive platform for all. Natasha Magliui Engineering Manager,
ビッグデータ - Wikipedia
ã“ã®é …ç›®ã¯å†…容ãŒå°‚門的ã§ã‚ã‚Šã€ä¸€èˆ¬ã®é–²è¦§è€…ã«ã¯ã‚ã‹ã‚Šã«ãããªã£ã¦ã„ã‚‹ãŠãã‚ŒãŒã‚ã‚Šã¾ã™ã€‚ 専門用語をã‚ã‹ã‚Šã‚„ã™ã„表ç¾ã«ã™ã‚‹ãŸã‚ã®ä¿®æ£ã‚’ã—ã¦ä¸‹ã•ã‚‹å”力者を求ã‚ã¦ã„ã¾ã™ã€‚（2015å¹´4月） IBMã«ã‚ˆã‚‹Wikipediaã®å¯è¦–化イメージ 大ãã•ã¯ãƒ†ãƒ©ãƒã‚¤ãƒˆã§ãƒ“ッグデータã®å…¸åž‹çš„ãªä¾‹ã§ã‚る。 ビッグデータ [1][2]（英: big data）ã¨ã¯ã€çµ„ç¹”ãŒéžå¸¸ã«å¤§ããªãƒ‡ãƒ¼ã‚¿ã‚»ãƒƒãƒˆã¨ãれらãŒä¿å˜ã•ã‚Œã¦ã„ã‚‹æ–½è¨ã‚’作æˆã€æ“作ã€ãŠã‚ˆã³ç®¡ç†ã§ãるよã†ã«ã™ã‚‹ã™ã¹ã¦ã®æŠ€è¡“を指ã™[3]。一般的ãªãƒ‡ãƒ¼ã‚¿ç®¡ç†ãƒ»å‡¦ç†ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã§æ‰±ã†ã“ã¨ãŒå›°é›£ãªã»ã©å·¨å¤§ã§è¤‡é›‘ãªãƒ‡ãƒ¼ã‚¿ã®é›†åˆã‚’表ã™ç”¨èªžã§ã‚る。組織ãŒéžå¸¸ã«å¤§ããªãƒ‡ãƒ¼ã‚¿ã‚»ãƒƒãƒˆ[注釈 1]を作æˆã€æ“作ã€ãŠã‚ˆã³ç®¡ç†ã§ãるよã†ã«ã™ã‚‹ã™ã¹ã¦ã®ã‚‚ã®ã¨ã€ã“れらãŒæ ¼ç´ã•ã‚Œã¦ã„る機能を指ã™[4]。 ビッグデータをå–ã‚Šå·»ã課題ã®ç¯„囲ã¯ã€æƒ…å ±ã®åŽé›†ã€å–æ¨é¸æŠžã€ä¿ç®¡[5]ã€æ¤œç´¢ã€å…±æœ‰ã€è»¢é€ã€è§£æž
Big Data
TODAY ONLY! Save HALF on Snowflake Data Engineering and more!
Sqoop -
Apache Sqoop(TM) is a tool designed for efficiently transferring bulk data between Apache Hadoop and structured datastores such as relational databases. Sqoop successfully graduated from the Incubator in March of 2012 and is now a Top-Level Apache project: More information Latest stable release is 1.4.7 (download, documentation). Latest cut of Sqoop2 is 1.99.7 (download, documentation). Note that
デブサミ2014「グリーを支ãˆã‚‹ãƒ‡ãƒ¼ã‚¿åˆ†æžåŸºç›¤ã®éŽåŽ»ã¨ç¾åœ¨ã€è¬›æ¼”メモ #devsumi - å…ƒRX-7ä¹—ã‚Šã®é©å½“ãªæ—¥ã€…
ã©ã“ã‚‚ãã‚Œãªã‚Šã«è‹¦åŠ´ãƒ»å·¥å¤«ã—ã¦ã„るよãªãã¨ã€èˆˆå‘³æ·±ãèžã‹ã›ã¦ã„ãŸã ãã¾ã—ãŸã€‚ 「グリーを支ãˆã‚‹ãƒ‡ãƒ¼ã‚¿åˆ†æžåŸºç›¤ã®éŽåŽ»ã¨ç¾åœ¨ã€ 橋本 泰一 æ° ã‚°ãƒªãƒ¼ 10å¹´ã»ã©æ±å·¥å¤§ã§åŠ©æ‰‹ãƒ»ç‰¹ä»»å‡†æ•™æŽˆã—ãŸå¾Œã€2012å¹´ã«ã‚°ãƒªãƒ¼ã«ã‚¸ãƒ§ã‚¤ãƒ³ éŽåŽ»ã®è©±(2011å¹´) Webサーãƒã‹ã‚‰ãƒã‚°ã‚’rsyncã§ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã¸ ãƒãƒƒãƒå‡¦ç†ã§é›†è¨ˆã—ã¦DBã¸(MySQL) ストレージもDBã‚‚ãƒãƒ¼ãƒ‰ã‚¦ã‚§ã‚¢ã¯Solaris Sun Fire X4540 ã ã‚“ã ã‚“å›°ã£ã¦ã㟠データãŒã»ã—ã„人ãŒå¢—ãˆã¦ã㟠サービスや人ãŒå¢—ãˆã¦ã㟠データæä¾›ãŒæ£ç›´ã—ã‚“ã©ããªã£ã¦ã㟠今ã®è©±: コンセプト Accessability ã ã‚Œã§ã‚‚自由㫠Scalability ã©ã‚Œã ã‘貯ã‚ã“ã‚“ã§ã‚‚ グリーã®ãƒ‡ãƒ¼ã‚¿åˆ†æžåŸºç›¤ ゲームTreasure Data ベース ゲームã¸ã®ã‚¢ã‚¯ã‚»ã‚¹ãƒã‚° GREE Platform Hadoopベース ゲームã‹ã‚‰APIã¸ã®ãƒã‚°
Postgres by BigSQL
HadoopFDW: PostgreSQL Foreign Data Wrapper for accessing Hadoop HadoopFDW is currently available on Linux for version 10 of our distribution. This Foreign Data Wrapper helps you to leverage the power of Hadoop from within PostgreSQL. It uses many of the latest FDW features of PostgreSQL to give you native access to Hadoop data. PostgreSQL is the worlds most advanced open source RDBMS for transacti
Treasure Dataã®ã‚µãƒ¼ãƒ“スã¯ã‚¯ãƒ©ã‚¦ãƒ‰ä¸Šã§ã©ã†æ§‹ç¯‰ã•ã‚Œã¦ã„ã‚‹ã®ã‹ï¼ˆå‰ç·¨ï¼‰ï½žJuly Tech Festa 2013
Treasure Dataã®ã‚µãƒ¼ãƒ“スã¯ã‚¯ãƒ©ã‚¦ãƒ‰ä¸Šã§ã©ã†æ§‹ç¯‰ã•ã‚Œã¦ã„ã‚‹ã®ã‹ï¼ˆå‰ç·¨ï¼‰ï½žJuly Tech Festa 2013 Treasure Dataã¨ã„ãˆã°ã€æ—¥æœ¬äººãŒã‚·ãƒªã‚³ãƒ³ãƒãƒ¬ãƒ¼ã§å‰µæ¥ã—ãŸãƒ™ãƒ³ãƒãƒ£ãƒ¼ã¨ã—ã¦çŸ¥ã‚‰ã‚Œã¦ã„ã‚‹ä¼æ¥ã€‚ãã®ã‚·ãƒ‹ã‚¢ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ä¸å·çœŸå®æ°ãŒã€7月14æ—¥ã«è¡Œã‚ã‚ŒãŸJuly Tech Festa 2013ã®åŸºèª¿è¬›æ¼”ã§ã€åŒç¤¾ãŒã‚¯ãƒ©ã‚¦ãƒ‰ä¸Šã§æ§‹ç¯‰ã—ãŸã‚µãƒ¼ãƒ“スã«ã¤ã„ã¦ãã®ã‚¢ãƒ¼ã‚テクãƒãƒ£ã‚’ä¸å¿ƒã«è§£èª¬ã‚’è¡Œã£ã¦ã„ã¾ã™ã€‚ 注目ã•ã‚Œã¦ã„るクラウドサービスãŒã©ã®ã‚ˆã†ãªä»•çµ„ã¿ã«ãªã£ã¦ãŠã‚Šã€ãã‚Œã¯ã©ã®ã‚ˆã†ãªè€ƒãˆæ–¹ã§ä½œã‚‰ã‚Œã¦ã„ã‚‹ã®ã‹ã€‚クラウドã§ã‚·ã‚¹ãƒ†ãƒ 構築を考ãˆã¦ã„る多ãã®ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã®å‚考ã«ãªã‚‹ã¯ãšã§ã™ã€‚講演ã®å†…容をダイジェストã§ç´¹ä»‹ã—ã¾ã™ã€‚ Treasure Dataã®ã‚¯ãƒ©ã‚¦ãƒ‰æˆ¦ç•¥ Treasure Data, Inc。シニアソフトウェアエンジニア ä¸å·çœŸå®æ°ã€‚ スタートアップãªã“ã¨ã‚‚ã‚
“シリコンãƒãƒ¬ãƒ¼ã®æŠ€è¡“者集団â€ã§ã¯ãƒˆãƒ¬ã‚¸ãƒ£ãƒ¼ãƒ‡ãƒ¼ã‚¿ã‚’見誤る (1/5)
シリコンãƒãƒ¬ãƒ¼ã®æ—¥æœ¬äººãƒ™ãƒ³ãƒãƒ£ãƒ¼ã¨ã—ã¦æ³¨ç›®åº¦ã®é«˜ã„トレジャーデータã®CTOã§ã‚る太田一樹æ°ã¨ã®ã‚¤ãƒ³ã‚¿ãƒ“ューãŒå®Ÿç¾ã—ãŸã€‚CEO芳å·è£•èª æ°ã®å®¶ã®ãƒ™ãƒ©ãƒ³ãƒ€ã¨ç†±æµ·ã®æ¸©æ³‰ã§å§‹ã¾ã£ãŸä¼šç¤¾ã®èµ·æ¥ç‰©èªžã‚„サービスã®ãƒã‚¤ãƒ³ãƒˆãªã©ã‚’èžã„ãŸ1時間ã®ã‚¤ãƒ³ã‚¿ãƒ“ューをã»ã¼åŠ å·¥ãªã—ã§æŽ²è¼‰ã™ã‚‹ã€‚ Hadoopã®ãƒãƒ†ãƒ³ã‚·ãƒ£ãƒ«ã‚’æ„Ÿã˜å§‹ã‚ãŸã¨ãã«å£°ã‚’ã‹ã‘ã¦ã‚‚らã£ãŸ TECH.ASCII.jp 大谷（以下ã€TECH 大谷）：太田ã•ã‚“ã¨ã„ã†ã¨ã€Hadoopã®äººã¨ã„ã†ã‚¤ãƒ¡ãƒ¼ã‚¸ãŒã‚ã‚Šã¾ã™ãŒã€ãã‚‚ãã‚‚ã®ãƒãƒƒã‚¯ã‚°ãƒ©ã‚¦ãƒ³ãƒ‰ã‚’æ•™ãˆã¦ãã ã•ã„。 トレジャーデータ 太田æ°ï¼ˆä»¥ä¸‹ã€TD 太田）：ã¯ã„。もã¨ã‚‚ã¨ç§ã®ãƒãƒƒã‚¯ã‚°ãƒ©ã‚¦ãƒ³ãƒ‰ã¯HPC（High Performance Computing）ã®ã‚¨ãƒªã‚¢ã§ã€19æ³ãらã„ã‹ã‚‰ã‚ã¾ã‚Šå¦æ ¡ã«ã‚‚è¡Œã‹ãšï¼ˆç¬‘）ã€ãƒ—リファードインフラストラクãƒãƒ£ã¨ã„ã†ä¼šç¤¾ã®CTOをやらã›ã¦ã„ãŸã ãã¾ã—ãŸã€‚ã‚ã¨ã€ç±³ã‚ªãƒ¬ã‚´ãƒ³ã®å›½ç«‹ç ”究所ã§
ランã‚ング
ランã‚ング
ランã‚ング
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
GitHub - mongodb/mongo-hadoop: MongoDB Connector for Hadoop
{{#tags}}- {{label}}
{{/tags}}