How-to: Apache Hadoopã§æ–°ã—ã„HDFS DataNodeディスク間ãƒãƒ©ãƒ³ã‚µã‚’使用ã™ã‚‹åŽŸæ–‡: http://blog.cloudera.com/blog/2016/10/how-to-use-the-new-hdfs-intra-datanode-disk-balancer-in-apache-hadoop/ ç¾åœ¨ã€HDFSã«ã¯ãƒŽãƒ¼ãƒ‰ã§ãƒ‡ãƒ¼ã‚¿ã‚’移動ã™ã‚‹ãŸã‚ã®åŒ…括的ãªã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸å®¹é‡ç®¡ç†ã‚¢ãƒ—ãƒãƒ¼ãƒãŒå«ã¾ã‚Œã¦ã„ã¾ã™ (CDH 5.8.2以é™)。 HDFSã§ã¯ã€DataNodeã¯hdfs-site.xmlã®dfs.datanode.data.dirを用ã„ã¦æŒ‡å®šã§ãã‚‹ãƒãƒ¼ã‚«ãƒ«ã®ãƒ•ã‚¡ã‚¤ãƒ«ã‚·ã‚¹ãƒ†ãƒ ディレクトリã«ãƒ‡ãƒ¼ã‚¿ãƒ–ãƒãƒƒã‚¯ã‚’分é…ã—ã¾ã™ã€‚HDFSã®ç”¨èªžã§ãƒœãƒªãƒ¥ãƒ¼ãƒ ã¨å‘¼ã°ã‚Œã‚‹å„ディレクトリã¯ã€ä¸€èˆ¬çš„ãªã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã§ã¯åˆ¥ã®ãƒ‡ãƒã‚¤ã‚¹ï¼ˆãŸã¨ãˆã°ã€åˆ¥ã®HDDã‚„SSD）上ã«ã‚ã‚Šã¾ã™ã€‚ æ–°ã—ã„ブãƒãƒƒã‚¯ã‚’HDFSã«æ›¸ã込む際ã€DataNodeã¯ãƒœãƒªãƒ¥ãƒ¼ãƒ é¸æŠžãƒãƒªã‚·ãƒ¼(volume-choosing po
HDFS Erasure Codingã®ç´¹ä»‹ã¨Yahoo! JAPANã«ãŠã‘ã‚‹é‹ç”¨äº‹ä¾‹
How-to: Use the New HDFS Intra-DataNode Disk Balancer in Apache Hadoop - Cloudera Blog
HDFSã®DataNodeã§ã€ãƒ‡ã‚£ã‚¹ã‚¯ã®ç©ºããŒå¤šã„æ–¹ã‹ã‚‰ãƒ‡ãƒ¼ã‚¿ã‚’書ã込む方法 - Qiita
Cloudera Standard ã®ã”案内 ~ 無償版 大幅機能強化ã®ãŠçŸ¥ã‚‰ã› | Cloudera Japan
HDFSã®ã‚·ãƒ§ãƒ¼ãƒˆã‚µãƒ¼ã‚ット雑感
{{#tags}}- {{label}}
{{/tags}}