[B! hbase] poriringooã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

poriringoo id:poriringoo

hbaseã«é–¢ã™ã‚‹poriringooã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (10)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Hadoopãƒªãƒ³ã‚¯ã¾ã¨ã‚(2) - ç§‘å¦ã¨éžç§‘å¦ã®è¿·å®®
Part1 / Part2 2010/05/31 ã¾ã§ã«ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ã—ãŸã‚‚ã®ã‚’ã¾ã¨ã‚ã¾ã—ãŸã€‚ æ³¨: Part1 ã‚‚å¤§åˆ†æ›´æ–°ã—ã¦ã¾ã™ã®ã§èˆˆå‘³ã®ã‚ã‚‹æ–¹ã¯ãã¡ã‚‰ã‚‚ã”è¦§ãã ã•ã„ã€‚ æ›´æ–°æƒ…å ± 2010/06/20 æ–°è¦è¿½åŠ HBaseã€Mahoutã€Cassandraã€é–‹ç™ºã€æ§‹ç¯‰ã€Streamingã€Hiveã€Clouderaã€Zookeeper Part1ã‚ˆã‚Šç§»å‹• Pigã€EC2ã€MapReduceã€HDFS HDFS Hadoop DFS _ Introduction | Agile Cat --- in the cloud HDFSã‚¢ãƒ¼ã‚ãƒ†ã‚¯ãƒãƒ£ã«é–¢ã™ã‚‹ãƒ‰ã‚ãƒ¥ãƒ¡ãƒ³ãƒˆã®ç¿»è¨³ã€‚ Hadoop DFS Architecture_1 | Agile Cat --- in the cloud "ãƒ‡ãƒ¼ã‚¿ï½¥ã‚¢ã‚¯ã‚»ã‚¹ã«ãŠã‘ã‚‹é…å»¶ã‚’ä½Žæ¸›ã™ã‚‹ã¨ã„ã†ã‚ˆã‚Šã€ãƒ‡ãƒ¼ã‚¿ï½¥ã‚¢ã‚¯ã‚»ã‚¹ã«ãŠã‘ã‚‹ã‚¹ãƒ«ãƒ¼ãƒ—ãƒƒãƒˆã‚’é«˜ã‚ã‚‹ã“ã¨ã«æ³¨åŠ›ã•ã‚Œã¦
poriringoo 2010/11/25
ã¾ã¨ã‚

hadoop

hbase
ãƒªãƒ³ã‚¯
tetsuro-memo: HBase Architecture
2010å¹´6æœˆ11æ—¥é‡‘æ›œæ—¥ HBase Architecture HBase Architecture 101 - Storage (Lars George Oct 12, 2009) ã®ä¸€éƒ¨ã‚’æ—¥æœ¬èªžã«è¨³ã—ã¦ã¿ã¾ã—ãŸã€‚é–“é•ã„ãŒã‚ã‚‹ã‹ã‚‚ã—ã‚Œã¾ã›ã‚“ãŒã”å®¹èµ¦ãã ã•ã„ã€‚ â— æ¦‚ç•¥ HBaseã¯åŸºæœ¬çš„ã«2ç¨®é¡žã®ã‚¿ã‚¤ãƒ—ã®ãƒ•ã‚¡ã‚¤ãƒ«ã‚’åˆ¶å¾¡ã—ã¾ã™ã€‚ 1ã¤ã¯write-aheadãƒã‚®ãƒ³ã‚°ã®ãŸã‚ã§ã‚ã‚Šã€ã‚‚ã†ä¸€æ–¹ã¯å®Ÿéš›ã®ãƒ‡ãƒ¼ã‚¿æ ¼ç´ã®ãŸã‚ã§ã™ã€‚ ãƒ•ã‚¡ã‚¤ãƒ«ã¯ä¸»ã«HRegionServerã«ã‚ˆã£ã¦åˆ¶å¾¡ã•ã‚Œã¾ã™ã€‚ ã—ã‹ã—ã„ãã‚‰ã‹ã®å ´åˆã«HMasterã‚‚ä½Žãƒ¬ãƒ™ãƒ«ã®ãƒ•ã‚¡ã‚¤ãƒ«æ“ä½œã‚’è¡Œã†å¿…è¦ãŒã‚ã‚Šã¾ã™ã€‚ HDFSã®ä¸ã«æ ¼ç´ã•ã‚Œã‚‹éš›ã€å®Ÿéš›ã®ãƒ•ã‚¡ã‚¤ãƒ«ã¯ã‚ˆã‚Šå°ã•ãªãƒ–ãƒãƒƒã‚¯ã«åˆ†å‰²ã•ã‚Œã¾ã™ã€‚ ã“ã‚Œã¯ã‚·ã‚¹ãƒ†ãƒ ãŒã‚ˆã‚Šå¤§ããªãƒ‡ãƒ¼ã‚¿ã‚‚ã—ãã¯å°ã•ãªãƒ‡ãƒ¼ã‚¿ã‚’ã‚ˆã‚Šè‰¯ãåˆ¶å¾¡ã™ã‚‹ã®ã‚’ãƒ¦ãƒ¼ã‚¶ãŒè¨å®šã§ãã‚‹éƒ¨åˆ†ã§ã™ã€‚ å…¨ä½“ã®æµã‚Œã¨ã—ã¦ã¯ã€ã‚¯ãƒ©ã‚¤ã‚¢
poriringoo 2010/11/02
hbase

*ã‚ã¨ã§èªã‚€
ãƒªãƒ³ã‚¯
HMaster Japan
2010å¹´6æœˆ1æ—¥ç«æ›œæ—¥ HBase ã«ã¤ã„ã¦ã€ä»Šå¾Œ å›žç”ã—ã¦ã„ããŸã„è³ªå•ãªã© Hadoop ã‚½ãƒ¼ã‚¹ã‚³ãƒ¼ãƒ‰ãƒªãƒ¼ãƒ‡ã‚£ãƒ³ã‚°ã®éš›ã«ã€ä¸»ã« Twitter ã‚¿ã‚¤ãƒ ãƒ©ã‚¤ãƒ³ä¸Šã§è¦‹ã‹ã‘ãŸ HBase ã«é–¢ã™ã‚‹è³ªå•ãƒ»ç–‘å•ç‚¹ã‚’ãƒªã‚¹ãƒˆã‚¢ãƒƒãƒ—ã—ã¾ã—ãŸã€‚ä»Šå¾Œã€å°‘ã—ãšã¤å›žç”ã—ã¦ã„ãã¾ã™ã®ã§ã€ã‚ˆã‚ã—ããŠé¡˜ã„ã—ã¾ã™ã€‚ï¼ˆå›žç”ã®é †åºã¯å¤šå°‘å‰å¾Œã™ã‚‹ã‹ã‚‚ã—ã‚Œã¾ã›ã‚“ï¼‰ Java VM ã®ã‚¬ãƒ™ãƒ¼ã‚¸ã‚³ãƒ¬ã‚¯ã‚·ãƒ§ãƒ³ï¼ˆGCï¼‰ã®æŒ™å‹•ãŒã€ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ æ€§èƒ½ã«å½±éŸ¿ã‚’ä¸ŽãˆãŸã‚Šã—ãªã„ã§ã—ã‚‡ã†ã‹ï¼Ÿ HDDã®ä»£ã‚ã‚Šã«SSDã‚’ä½¿ã†ã¨ random read ã®æ€§èƒ½ã¯å‘ä¸Šã—ã¾ã™ã‹ï¼Ÿ Big Dataã¨ã¯ã©ã†ã„ã†ã‚‚ã®ã‚’æŒ‡ã—ã¾ã™ã‹ï¼Ÿ â†’ @yutuki_r ã•ã‚“ã‹ã‚‰ã®è£œè¶³ï¼š Fatã€Wideã€Wide&Sparseã€Tallã¨ã„ã†åˆ†é¡žæ³• ãƒªãƒ¼ã‚¸ãƒ§ãƒ³ã®ã‚µã‚¤ã‚ºã¯ã©ã®ãã‚‰ã„ã«è¨å®šã•ã‚Œã¦ã„ã¾ã™ã‹ï¼Ÿ NULLå€¤ãŒãƒ‡ã‚£ã‚¹ã‚¯ã‚¹ãƒšãƒ¼ã‚¹ã‚’æ¶ˆè²»ã—ãªã„(?) ã®ã¯ãªãœã§ã™ã‹ï¼Ÿ è¿½
poriringoo 2010/10/21
hadoop

hbase
ãƒªãƒ³ã‚¯
HBaseãƒ¡ãƒ¢(Hishidama's HBase Memo)
HBase(ã‚¨ã‚¤ãƒãƒ™ãƒ¼ã‚¹)ã¯ã€Googleã®BigTableã‚’å…ƒã«ã—ãŸã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®åˆ—æŒ‡å‘åˆ†æ•£ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã€‚ï¼ˆãƒªãƒ¬ãƒ¼ã‚·ãƒ§ãƒŠãƒ«ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ï¼ˆRDBï¼‰ã§ã¯ãªã„ï¼‰ Javaã§ä½œã‚‰ã‚Œã¦ãŠã‚Šã€Apache Hadoopã®HDFSã‚’ä½¿ç”¨ã—ã¦ç¨¼å‹•ã™ã‚‹ã€‚ãã®ç‚ºã€Hadoopã¨ã®è¦ªå’Œæ€§ãŒé«˜ã„ã¨æ€ã‚ã‚Œã‚‹ã€‚ ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ« åˆå›žè¨å®š [/2010-08-07] æ“¬ä¼¼åˆ†æ•£ç’°å¢ƒ [/2010-07-06] hbase-site.xml [/2010-07-25] HBaseã®èµ·å‹•ãƒ»åœæ¢æ–¹æ³• ãƒ†ãƒ¼ãƒ–ãƒ«æ“ä½œã‚µãƒ³ãƒ—ãƒ« ãƒ†ãƒ¼ãƒ–ãƒ«æ§‹é€ ã®è€ƒãˆæ–¹ HBase Shell HBase0.20 [/2010-07-12] HBase0.89 [2010-07-12] Javaãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚° [/2012-04-28] Map/Reduceã‚µãƒ³ãƒ—ãƒ« [/2012-04-28]
poriringoo 2010/09/03
hbase
ãƒªãƒ³ã‚¯
Javaã‹ã‚‰Hbaseã‚’ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯è¶Šã—ã«ä½¿ã†
â˜†â˜†â˜†â˜…â˜… (2) AMD (13) Android (5) Asteria (11) AWS (7) Azure (1) boto (2) botocore (1) bottle (2) Camera (5) Cassandra (7) CentOS (1) Chromium (1) Cloud (43) CrystalArmor (1) css (7) DIGNO (1) EC2 (10) ESXi (5) Firefox (1) Fluent (1) GAE/J (1) github (1) Go (1) Google (16) Google+ (2) Hadoop (2) Hardware (29) HBase (13) Intel (1) iSCSI (1) Java (6) JavaScript (10) json (1) KVM (1) Linux (37) Nagios (
poriringoo 2010/09/02
hbase
ãƒªãƒ³ã‚¯
Cygwinã‚’åˆ©ç”¨ã—ã¦Windowsã«HBaseã‚’ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ« - Stay Hungry. Stay Foolish.
HBaseã¯åˆ—æŒ‡å‘DBMSã§å¤§è¦æ¨¡åˆ†æ•£å‡¦ç†ã«ç‰¹åŒ–ã—ã¦ã„ã‚‹DBMSã§ã™ã€‚ å¤§è¦æ¨¡ãªãƒ‡ãƒ¼ã‚¿å®¹é‡ã«ãªã£ã¦ã‚‚ãƒ‘ãƒ•ã‚©ãƒ¼ãƒžãƒ³ã‚¹ã®åŠ£åŒ–ãŒãŠãã«ãã„ã®ãŒç‰¹å¾´ã§ã€ æ¬¡ä¸–ä»£ã®ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã¨ã—ã¦æ³¨ç›®ã•ã‚Œã¦ã„ã¾ã™ã€‚ ã“ã“ã§ã¯HBaseã‚’WindowsXPãƒžã‚·ãƒ³ã«ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã™ã‚‹æ–¹æ³•ã«ã¤ã„ã¦è¨˜è¿°ã—ã¾ã™ã€‚ RDBMSã¨HBaseã®é•ã„ã‚’ãŠæ‰‹è»½ã«?ç¢ºèªã—ãŸã„ã¨ã„ã†æ–¹ã«ãŠå‹§ã‚ã§ã™ã€‚ ç’°å¢ƒ HBaseã‚’Windowsã§åˆ©ç”¨ã™ã‚‹ã«ã¯JDK6/Cygwin/SSHã‚µãƒ¼ãƒ“ã‚¹ãŒå¿…è¦ã¨ãªã‚Šã¾ã™ã€‚ ç’°å¢ƒã¯2010-02-01æ™‚ç‚¹ã®æœ€æ–°ãƒã‚¤ãƒŠãƒªã‚’åˆ©ç”¨ã—ã¾ã—ãŸã€‚ WindowsXP Professional SP2 HBase-0.20.3 http://www.apache.org/dyn/closer.cgi/hadoop/hbase/ JDK 6 Update 18 http://java.sun.com/javase/ja/6/d
poriringoo 2010/08/30
hbase
ãƒªãƒ³ã‚¯
HMaster Japan: HBaseå…¥é–€ - 5æœˆ27æ—¥ç™ºè¡¨
2010å¹´5æœˆ30æ—¥æ—¥æ›œæ—¥ HBaseå…¥é–€ - 5æœˆ27æ—¥ç™ºè¡¨ Hadoop ã‚½ãƒ¼ã‚¹ã‚³ãƒ¼ãƒ‰ãƒªãƒ¼ãƒ‡ã‚£ãƒ³ã‚°ï¼ˆç¬¬ï¼’å›žï¼‰ã«ã¦ã€HBaseã‚’ç´¹ä»‹ã—ã¾ã—ãŸã€‚ HBaseã®ç‰¹å¾´ ãƒ¦ãƒ¼ã‚¹ã‚±ãƒ¼ã‚¹ï¼ˆäº‹ä¾‹ç´¹ä»‹ï¼‰ å½“æ—¥ã¯80åã‚’è¶…ãˆã‚‹Hadoopãƒ•ã‚¡ãƒ³ã®æ–¹ã€…ã«ã”æ¥å ´ã„ãŸã ãã¾ã—ãŸã€‚æœ€å¾Œã¾ã§ç†±å¿ƒã«èžã„ã¦ã„ãŸã ãã‚ã‚ŠãŒã¨ã†ã”ã–ã„ã¾ã—ãŸï¼ å‚è€ƒï¼šå½“æ—¥ã® Twitter ã¾ã¨ã‚ æ¬¡å›žä»¥é™ã¯ã€ä»¥ä¸‹ã®å†…å®¹ã‚’äºˆå®šã—ã¦ã„ã¾ã™ã€‚ ã€ï¼–æœˆã€‘HBaseã¨Cassandraã®æ¯”è¼ƒï¼ˆè¨è¨ˆä¸Šã®ãƒˆãƒ¬ãƒ¼ãƒ‰ã‚ªãƒ•ã‚’ç†è§£ã™ã‚‹ï¼‰ ã€ï¼—æœˆã€‘HBaseã§ã¤ã¾ãšãã‚„ã™ã„ç‚¹ã¨ã€ãƒãƒ¼ãƒ‰ãƒžãƒƒãƒ—ï¼ˆæ¬¡æœŸãƒ¡ã‚¸ãƒ£ãƒ¼ãƒªãƒªãƒ¼ã‚¹ã®ç´¹ä»‹ï¼‰ ã‚¹ãƒ©ã‚¤ãƒ‰ã¯äº‹å‰ã«å…¬é–‹ã™ã‚‹äºˆå®šã§ã™ã€‚å®Ÿã¯ã€è‹±èªžãƒ»æ—¥æœ¬èªžç‰ˆå…±ã«ä¸‹æ›¸ãã¯ã§ãã¦ã„ã¦ã€HBaseã®é–‹ç™ºãƒªãƒ¼ãƒ€ãƒ¼ã®ãƒ¬ãƒ“ãƒ¥ãƒ¼æ¸ˆã¿ãªã‚“ã§ã™ã€‚ ãŸã ã€ä¼šå ´ã§ã€Cassandraã®é–‹ç™ºãƒãƒ¼ãƒ ã«ã‚‚ãƒ¬ãƒ“ãƒ¥ãƒ¼ã—ã¦ã‚‚ã‚‰ã†ã¨ã€ã‚ˆã‚Šå……å®Ÿã—ãŸãƒ—ãƒ¬ã‚¼ãƒ³ã«ãªã‚‹ã®ã§ã¯ï¼Ÿã¨
poriringoo 2010/08/27
Hadoop

hbase
ãƒªãƒ³ã‚¯
HBaseãƒ¡ãƒ¢(Hishidama's HBase Memo)
HBase(ã‚¨ã‚¤ãƒãƒ™ãƒ¼ã‚¹)ã¯ã€Googleã®BigTableã‚’å…ƒã«ã—ãŸã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã®åˆ—æŒ‡å‘åˆ†æ•£ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã€‚ï¼ˆãƒªãƒ¬ãƒ¼ã‚·ãƒ§ãƒŠãƒ«ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ï¼ˆRDBï¼‰ã§ã¯ãªã„ï¼‰ Javaã§ä½œã‚‰ã‚Œã¦ãŠã‚Šã€Apache Hadoopã®HDFSã‚’ä½¿ç”¨ã—ã¦ç¨¼å‹•ã™ã‚‹ã€‚ãã®ç‚ºã€Hadoopã¨ã®è¦ªå’Œæ€§ãŒé«˜ã„ã¨æ€ã‚ã‚Œã‚‹ã€‚ ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ« åˆå›žè¨å®š [/2010-08-07] æ“¬ä¼¼åˆ†æ•£ç’°å¢ƒ [/2010-07-06] hbase-site.xml [/2010-07-25] HBaseã®èµ·å‹•ãƒ»åœæ¢æ–¹æ³• ãƒ†ãƒ¼ãƒ–ãƒ«æ“ä½œã‚µãƒ³ãƒ—ãƒ« ãƒ†ãƒ¼ãƒ–ãƒ«æ§‹é€ ã®è€ƒãˆæ–¹ HBase Shell HBase0.20 [/2010-07-12] HBase0.89 [2010-07-12] Javaãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚° [/2012-04-28] Map/Reduceã‚µãƒ³ãƒ—ãƒ« [/2012-04-28]
poriringoo 2010/08/27
hbase
ãƒªãƒ³ã‚¯
20090713 Hbase Schema Design Case Studies
Most developers are familiar with the topic of â€œdatabase designâ€. In the relational world, normalization is the name of the game. How do things change when youâ€™re working with a scala ble, distributed, non-SQL database like HBase? This talk will cover the basics of HBase schema design at a high level and give several common patterns and examples of real-world schemas to solve interesting probl ems.
poriringoo 2010/08/24
hbase
ãƒªãƒ³ã‚¯
HBase At Meetup
poriringoo 2010/08/24
hbase
ãƒªãƒ³ã‚¯
1