The Hadoop Ecosystem Table
The Hadoop Distributed File System (HDFS) offers a way to store large files across multiple machines. Hadoop and HDFS was derived from Google File System (GFS) paper. Prior to Hadoop 2.0.0, the NameNode was a single point of failure (SPOF) in an HDFS cluster. With Zookeeper the HDFS High Availability feature addresses this problem by providing the option of running two redundant NameNodes in the s
Hadoop and Kerberos
4. Page 4 © Hortonworks Inc. 2014 Background: YARNã«ã‚ˆã‚‹Hadoopã®ãƒžãƒ«ãƒãƒ†ãƒŠãƒ³ãƒˆåŒ– •  Hadoop2ã§å°Žâ¼Šã•ã‚ŒãŸYARNã«ã‚ˆã‚Šã€Hadoopクラ スタを複数ã®ã²ã¨ã‚„組織ã€ãƒ¯ãƒ¼ã‚¯ãƒãƒ¼ãƒ‰ã«ã‚ˆã£ã¦ 共⽤ã™ã‚‹ã“ã¨ãŒå®¹æ˜“ã«ãªã£ãŸã€‚ •  巨⼤ãªHDFSクラスタã«æ§˜ã€…ãªãƒ‡ãƒ¼ã‚¿ã‚’æ ¼ç´ã—ã¦ãŠ ãã€ãã®ãƒ‡ãƒ¼ã‚¿ã«å¯¾ã—ã¦æ§˜ã€…ãªå‡¦ç†ã‚’⾛らã›ã‚‹ã“ ã¨ãŒå¯èƒ½ã«ã€‚ 5. Page 5 © Hortonworks Inc. 2014 1 ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° ° N HDFS Hadoop Distributed File System DATA MANAGEMENT ストレージ(HDFS)ã¨ã‚³ãƒ³ãƒ”ュー ティング(MapReduce)ãŒçµåˆã—㦠ã„㟠Before YARN MapReduce クラスタ全体ã®ãƒª
Hadoopã¨ã‚¯ãƒ©ã‚¦ãƒ‰ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸
ã–ã£ã¨è¦ç´„ã™ã‚‹ã¨ オンデマンドã€ã‚¢ãƒ‰ãƒ›ãƒƒã‚¯ãªãƒ¯ãƒ¼ã‚¯ãƒãƒ¼ãƒ‰ã¯ã‚¯ãƒ©ã‚¦ãƒ‰ã§å‹•ä½œã•ã›ã‚‹ã¨çµŒæ¸ˆåˆç†æ€§ãŒé«˜ã„。必è¦ãªãƒªã‚½ãƒ¼ã‚¹ã‚’å¿…è¦ãªåˆ†ã ã‘利用ã—ã€çµ‚ã‚ã£ãŸã‚‰ç ´æ£„ã§ãã‚‹ã‹ã‚‰ã€‚（当ãŸã‚Šå‰ã®è©±ã€‚）ãã“ã§ãƒã‚¤ãƒ³ãƒˆã«ãªã£ã¦ãã‚‹ã®ãŒAmazon S3ã‚„Windows Azure Storage Blobã®ã‚ˆã†ãªã‚¯ãƒ©ã‚¦ãƒ‰ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã€‚ã“れらã®ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã¯é«˜ã„å¯ç”¨æ€§ã¨åœ°ç†çš„分散ãªã©ã«ã‚ˆã‚‹ãƒ‡ãƒ¼ã‚¿è€ä¹…性ã€ãƒžãƒ«ãƒãƒ†ãƒŠãƒ³ã‚·ãƒ¼ã‚’æŒã¡ãªãŒã‚‰ã‚‚経済的ãªä¾¡æ ¼ã§åˆ©ç”¨ã§ãる。クラウド上ã®ãƒ‡ãƒ¼ã‚¿ãƒ¬ã‚¤ã‚¯ã¯é–“é•ã„ãªãã“れらã®ã‚¯ãƒ©ã‚¦ãƒ‰ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã¨ãªã‚‹ã€‚ã¨ã„ã†ã“ã¨ã§ã€ã‚¯ãƒ©ã‚¦ãƒ‰ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã‚’ä¸å¿ƒã«ã€ãã®å‘¨ã‚Šã«ãƒ‡ãƒ¼ã‚¿å‡¦ç†ã®ãŸã‚ã®ã‚¯ãƒ©ã‚¹ã‚¿ã‚’é…ç½®ã—ã¦ã„ã“ã†ã¨ã„ã†ã‚¢ãƒ¼ã‚テクãƒãƒ£ãŒèªžã‚‰ã‚Œã¦ã„る。ã—ã‹ã—ã€ã“ã“ã«ã¯ã„ãã¤ã‹è§£æ±ºã™ã¹ã課題ãŒã‚る。 クラウドストレージã¯File System APIã§ã¯ãªã REST APIã§åˆ©ç”¨ã™ã‚‹å¿…è¦ãŒã‚る。当然ãƒãƒ¼ã‚«ãƒ«ã«ã‚ã‚‹HDF
Hadoop入門ã¨ã‚¯ãƒ©ã‚¦ãƒ‰åˆ©ç”¨
This document discusses Hadoop and related technologies. It introduces Hadoop, its components MapReduce and HDFS, and how they work together. It also briefly mentions related Apache projects like Mahout and how companies like Amazon, Yahoo and Facebook use Hadoop in their systems. Finally, it covers Amazon's Elastic MapReduce service, which allows running Hadoop jobs in the cloud.Read less
1
ランã‚ング
ランã‚ング
ランã‚ング
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
IBM Developer
{{#tags}}- {{label}}
{{/tags}}