[B! HBase] shiumachiã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

shiumachi id:shiumachi

HBaseã«é–¢ã™ã‚‹shiumachiã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (151)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

HBaseæœ¬ - ã²ã—ã ã¾ã®å¤‰æ›´å±¥æ´
ã²ã—ã ã¾ï¼¨ï¼°ã®æ›´æ–°å±¥æ´ã€‚ ä¸»ã«ï¼´ï¼²ï¼°ï¼§ãƒªãƒ—ãƒ¬ã‚¤ã®å…ƒãƒã‚¿é›†ã€ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°æŠ€è¡“ãƒ¡ãƒ¢ã¨è‡ªä½œã‚½ãƒ•ãƒˆã€å¥½ããªã‚²ãƒ¼ãƒ ã‚„éŸ³æ¥½ã§ã™ã€‚ çŽ‰å·ç«œå¸ã•ã‚“ãŒç¿»è¨³ã•ã‚ŒãŸã€ŽHBaseã€ã‚’shiumachiã•ã‚“çµŒç”±ã§ã‚ªãƒ©ã‚¤ãƒªãƒ¼æ§˜ã‹ã‚‰çŒ®æœ¬ã—ã¦ã„ãŸã ãã¾ã—ãŸã€‚ã‚ã‚ŠãŒã¨ã†ã”ã–ã„ã¾ã™ï¼ çŒ®æœ¬ã—ã¦ã„ãŸã ã„ãŸã‹ã‚‰è¨€ã†ã‚ã‘ã˜ã‚ƒãªã„ã§ã™ãŒ(ç¬‘)ã€ã“ã‚Œã¯HBaseã‚’ä½¿ã†äººã«ã¨ã£ã¦ã¯å¿…é ˆã®æœ¬ã§ã™ãï½—ã€€ã©ã®ç« ã‚’è¦‹ã¦ã‚‚ã€ã€Œã‚ã€ã“ã®æƒ…å ±ã¯è¦ã‚‹ã‚ˆãï¼ã€ã¨ã„ã†ã‚‚ã®ã°ã‹ã‚Šã€‚ ã¾ãŸã€HBaseã‚’ä½¿ã‚ãªã„äººã§ã‚‚æœ€åˆã®2ç« ã¯å¤§å¤‰å‹‰å¼·ã«ãªã‚‹ã®ã§ã€æ©Ÿä¼šãŒã‚ã£ãŸã‚‰è¦‹ã¦ãŠãã¨è‰¯ã„ã®ã§ã¯ãªã„ã‹ã¨æ€ã„ã¾ã™ã€‚ ä»¥ä¸‹ã€ç« ã”ã¨ã«èˆˆå‘³æ·±ã‹ã£ãŸç‚¹ã‚’æŒ™ã’ã¦ã¿ã¾ã™ã€‚ â– â– â– 1ç« HBaseã®ç´¹ä»‹ 2å¹´ãã‚‰ã„å‰ã«HBaseã‚„Cassandraã¨ã„ã£ãŸNoSQLÂ ã®å‹‰å¼·ä¼šãŒç››ã‚Šä¸ŠãŒã£ãŸãŒã€ãã®é ƒã«èžã‹ã‚ŒãŸï¼ˆãã—ã¦æœ€è¿‘ã¯ã‚ã¾ã‚Šèžã‹ã‚Œãªããªã£ãŸï¼‰RDBMSã¨ã®æ¯”è¼ƒã‚„CAPå®šç†ç‰ã®è©±é¡ŒãŒã¾
shiumachi 2012/08/06
"HBaseã‚’ä½¿ã†äººã«ã¨ã£ã¦ã¯å¿…é ˆã®æœ¬""HBaseã‚’ä½¿ã‚ãªã„äººã§ã‚‚æœ€åˆã®2ç« ã¯å¤§å¤‰å‹‰å¼·ã«ãªã‚‹ã®ã§ã€æ©Ÿä¼šãŒã‚ã£ãŸã‚‰è¦‹ã¦ãŠãã¨è‰¯ã„"

HBase
ãƒªãƒ³ã‚¯
HBase Sizing Notes
The document discusses several key factors for optimizing HBase performance including: 1. Reads and writes compete for disk, network, and thread resources so they can cause bottlenecks. 2. Memory allocation needs to balance space for memstores, block caching, and Java heap usage. 3. The write-ahead log can be a major bottleneck and increasing its size or number of logs can improve write performanc
shiumachi 2012/07/30
é¦¬æœ¬ã®è‘—è€… Lars George ã«ã‚ˆã‚‹ã€HBase ã®ã‚µã‚¤ã‚¸ãƒ³ã‚°ãƒ¡ãƒ¢ã€‚ã¿ã‚“ãªãŒå¤§å¥½ããªã€ã‚µã‚¤ã‚¸ãƒ³ã‚°ã®è¨ˆç®—å¼ãŒè¼‰ã£ã¦ã„ã‚‹ #cloudera #hadoop

HBase
ãƒªãƒ³ã‚¯
HBaseã®ãƒ‡ãƒ¼ã‚¿æ›¸ãè¾¼ã¿ãƒ•ãƒãƒ¼ - wyukawa's diary
é¦¬æœ¬ã‚’ã¤ã‚‰ã¤ã‚‰èªã‚“ã ã®ã§ãƒ‡ãƒ¼ã‚¿æ›¸ãè¾¼ã¿ã®ã‚ãŸã‚Šã«ã¤ã„ã¦ãƒ¡ãƒ¢ãŒã¦ã‚‰æ›¸ã„ã¦ã¿ã‚‹ã€‚ HBaseã¯Log-Structured Merge-tree (LSM-tree)ã¨ã„ã†æŠ€è¡“ã‚’ä½¿ã£ã¦ãƒ‡ãƒ¼ã‚¿ã®èªã¿æ›¸ãã‚’è¡Œã„ã¾ã™ã€‚ LSM-treeã¯Memtable, SS Table, Commit Logã¨ã„ã†ï¼“ã¤ã®è¨˜æ†¶é ˜åŸŸã‚’ä½¿ã„ã¾ã™ã€‚ Memtableã¯ãƒ¡ãƒ¢ãƒªä¸Šã®é ˜åŸŸã§HBaseç”¨èªžã§ã„ã†ã¨MemStoreã«ãªã‚Šã¾ã™ã€‚ SS Tableã¯ãƒ‡ã‚£ã‚¹ã‚¯ä¸Šã®é ˜åŸŸã§HBaseç”¨èªžã§ã„ã†ã¨HFileã«ãªã‚Šã¾ã™ã€‚ Commit Logã¯ãƒ‡ã‚£ã‚¹ã‚¯ä¸Šã®é ˜åŸŸã§HBaseç”¨èªžã§ã„ã†ã¨HLogã«ãªã‚Šã¾ã™ã€‚WAL(Write Ahead Log, å…ˆæ”»å…ˆè¡Œæ›¸ãè¾¼ã¿ãƒã‚°)ã§ã™ãã€‚ HBaseã§ãƒ‡ãƒ¼ã‚¿ã‚’æ›¸ãè¾¼ã‚€ã¨Memstoreã¨HLogã«æ›¸ãè¾¼ã¾ã‚Œã¾ã™ã€‚ MemstoreãŒä¸€å®šé‡ã«é”ã™ã‚‹ã¨HFileã«æ›¸ãè¾¼ã¾ã‚Œã¾ã™ã€‚HFileã¯ä¸€åº¦
shiumachi 2012/07/30
HBase
ãƒªãƒ³ã‚¯
ã‚µãƒ¼ãƒ“ã‚¹çµ‚äº†ã®ãŠçŸ¥ã‚‰ã› - NAVER ã¾ã¨ã‚
ã‚µãƒ¼ãƒ“ã‚¹çµ‚äº†ã®ãŠçŸ¥ã‚‰ã› NAVERã¾ã¨ã‚ã¯2020å¹´9æœˆ30æ—¥ã‚’ã‚‚ã¡ã¾ã—ã¦ã‚µãƒ¼ãƒ“ã‚¹çµ‚äº†ã„ãŸã—ã¾ã—ãŸã€‚ ç´„11å¹´é–“ã€NAVERã¾ã¨ã‚ã‚’ã”åˆ©ç”¨ãƒ»ã”æ„›é¡§ã„ãŸã ãèª ã«ã‚ã‚ŠãŒã¨ã†ã”ã–ã„ã¾ã—ãŸã€‚
shiumachi 2012/07/29
HBase
ãƒªãƒ³ã‚¯
HBaseã®Row Keyã®è¨è¨ˆã«ã¤ã„ã¦ã®ãƒ¡ãƒ¢ - wyukawa's diary
Facebook Messageã§ä½¿ã‚ã‚ŒãŸã‚Šã€LINEã®ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã§ä½¿ã‚ã‚ŒãŸã‚Šã€ã¨äº‹ä¾‹ã‚‚å¤šãå‡ºã¦ãã¦ã„ã‚‹HBaseï¼ˆBã¯å¤§æ–‡å—ã€‚ã“ã‚Œé‡è¦ï¼‰ã§ã™ãŒã€å€‹äººçš„ã«å°‘ã—èˆˆå‘³ã‚‚æ¹§ã„ã¦ããŸã®ã§ã¡ã‚‡ã£ã¨èª¿ã¹ã¦ã¾ã™ã€‚HBaseã¯Log-Structured Merge-tree (LSM-tree)ã¨ã„ã†ã‚¢ãƒ¼ã‚ãƒ†ã‚¯ãƒãƒ£ã‚’ä½¿ã£ã¦ãŠã‚Šå¤§é‡ãƒ‡ãƒ¼ã‚¿ã®æ›¸ãè¾¼ã¿ã«æœ€é©åŒ–ã•ã‚Œã¦ã„ã¾ã™ã€‚ãªã®ã§å¤§é‡ã®æ›¸ãè¾¼ã¿ãŒã‚ã‚Šèªã¿è¾¼ã¿ã¯ç›´è¿‘ã®ã‚‚ã®ã®ã¿ã¨ã„ã†ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ç³»ã‚¢ãƒ—ãƒªã«å‘ã„ã¦ã„ã‚‹ã‚“ã ã¨æ€ã„ã¾ã™ã€‚ ãã†ã„ãˆã°åŠé¡ã«é‡£ã‚‰ã‚Œã¦Manning | HBase in Actionã‚‚è²·ã£ã¦ã—ã¾ã„ã¾ã—ãŸã€‚ ã“ã®æœ¬ã®4ç« ã®Row Keyã®è¨è¨ˆã«ã¤ã„ã¦ã®è©±ãŒã‚ã£ã¦ãã‚ŒãŒã¡ã‚‡ã£ã¨é¢ç™½ã‹ã£ãŸã®ã§é–¢é€£ã—ã¦Row Keyã«ã¤ã„ã¦å°‘ã—æ›¸ã„ã¦ã¿ã¾ã™ã€‚ ã¾ãšHBaseã¯ã‚«ãƒ©ãƒ æŒ‡å‘ã®ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã¨å‘¼ã°ã‚Œã¾ã™ãŒãƒ‡ãƒ¼ã‚¿ãƒ¢ãƒ‡ãƒ«ã¯å¤šæ¬¡å…ƒã‚½ãƒ¼ãƒˆãƒžãƒƒãƒ—ã§ã™ã€‚ å›³è§£ã™ã‚‹ã¨ä¸‹è¨˜ã®
shiumachi 2012/07/24
ã‚°ãƒƒãƒ‰

HBase
ãƒªãƒ³ã‚¯
HBaseCon 2012 å‚åŠ ãƒ¬ãƒãƒ¼ãƒˆ
2012å¹´6æœˆ25æ—¥ã®Hadoopã‚½ãƒ¼ã‚¹ã‚³ãƒ¼ãƒ‰ãƒªãƒ¼ãƒ‡ã‚£ãƒ³ã‚° ç¬¬10å›žã§ã®ã€ŽHBaseCon 2012 ã‚¤ãƒ™ãƒ³ãƒˆå‚åŠ ãƒ¬ãƒãƒ¼ãƒˆã€ã®ç™ºè¡¨è³‡æ–™ã§ã™ã€‚NTTãƒ‡ãƒ¼ã‚¿ã®çŒ¿ç”°ã¨å²©å´Žã«ã‚ˆã‚‹ç™ºè¡¨ã§ã™ã€‚ â–¼HBaseCon 2012 http://www.hbasecon.com/ â–¼NTTãƒ‡ãƒ¼ã‚¿ BizXaaS Hadoopæ§‹ç¯‰ãƒ»é‹ç”¨ã‚½ãƒªãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ http://oss.nttdata.co.jp/hadoop/Read less
shiumachi 2012/06/26
Cloudera ä¸»å‚¬ãªã®ã«ã€ä¸€è¨€ã‚‚æ›¸ã‹ã‚Œã¦ã„ãªã„ã®ã¯å¯‚ã—ã„ã€ã£ã¦æ›¸ã„ãŸã‚‰NTTãƒ‡ãƒ¼ã‚¿ã•ã‚“ã®å´ã§è¿½åŠ ã—ã¦ãã‚ŒãŸï¼ã‚ã‚ŠãŒã¨ã†ã”ã–ã„ã¾ã™ï¼

hbase

cloudera
ãƒªãƒ³ã‚¯
[HBASE-3272] Remove no longer used options - ASF JIRA
shiumachi 2012/05/08
0.90ã§é©ç”¨ã€‚ãƒãƒ¼ãƒ‰ã‚³ãƒ¼ãƒ‰ã•ã‚Œã¦ã„ãŸè¨å®šå€¤ãŒå¤§åˆ†å¤‰ã‚ã£ãŸ

HBase
ãƒªãƒ³ã‚¯
MapReduceã§HBaseã¸æ›¸ãè¾¼ã‚€ã¨ãã®æ³¨æ„ç‚¹
ã›ã¡ã‚ãƒ¼ @sechiro HBaseã®TableOutputFormatã®å±é™ºæ€§ã£ã¦ã€å‰ã«è¦‹ã¦ãŸautoFlushãŒFalseã«ãªã£ã¦ã‚‹ã‹ã‚‰ã£ã¦ã“ã¨ã‹ãªï¼Ÿ Hadoop Hacksã‚’è¦‹ã‚Œã°ã‚ˆã„ã‹ã€‚å˜ç´”ãªè¿½è¨˜ã§ä½¿ã†ãªã‚‰å•é¡Œãªã„ã‘ã©ã€ãƒ‡ãƒ¼ã‚¿ã®æ›´æ–°ã¿ãŸã„ãªå‡¦ç†ã ã¨TaskãŒè½ã¡ãŸæ™‚ã«ã¯æˆ»ã›ãªã„ã‚ˆã£ã¦ã“ã¨ã ã¨äºˆæƒ³ 2012-04-29 01:33:44
shiumachi 2012/04/29
MRè‡ªåˆ†ã§æ›¸ã„ã¦HBaseã«æ›¸ãã“ã‚€ã®ã¯ã€ç¦æ¢ã¨ã¯è¨€ã‚ãªã„ã¾ã§ã‚‚ã€Œä¸Šç´šè€…å‘ã‘ã€ã£ã¦è¦å‘Šã—ã¨ã„ãŸæ–¹ãŒã„ã„æ°—ãŒã™ã‚‹

mapreduce

HBase
ãƒªãƒ³ã‚¯
[HBASE-3340] Eventually Consistent Secondary Indexing via Coprocessors - ASF JIRA
shiumachi 2012/04/27
eventual consistencyãªã‚»ã‚«ãƒ³ãƒ€ãƒªã‚¤ãƒ³ãƒ‡ãƒƒã‚¯ã‚¹ã‚’ã‚³ãƒ—ãƒã‚»ãƒƒã‚µã‚’ç”¨ã„ã¦ä½œæˆã™ã‚‹ã¨ã„ã†JIRAã€‚å®Ÿè£…ã‚€ãšã™ãŽã¦æ”¾ç½®ä¸ã®æ¨¡æ§˜

HBase
ãƒªãƒ³ã‚¯
[HBASE-5634] document how to use uberhbck - ASF JIRA
shiumachi 2012/04/24
HBase
ãƒªãƒ³ã‚¯
[HBASE-5128] [uber hbck] Online automated repair of table integrity and region consistency problems - ASF JIRA
shiumachi 2012/04/24
Cloudera ã® Jonathan Hsieh ã«ã‚ˆã‚‹æ”¹è‰¯åž‹ hbck "uber hbck" ã®ãƒ‘ãƒƒãƒ

HBase
ãƒªãƒ³ã‚¯
[HBASE-3335] Add BitComparator for filtering - ASF JIRA
shiumachi 2012/04/08
hbase
ãƒªãƒ³ã‚¯
ACID in HBase
By Lars Hofhansl As we know, ACID stands for Atomicity, Consistency, Isolation, and Durability. HBase supports ACID in limited ways, namely Puts to the same row provide all ACID guarantees. (HBASE-3584 adds multi op transactions and HBASE-5229 adds multi row transactions, but the principle rem ains the same) So how does ACID work in HBase? HBase employs a kind of MVCC. And HBase has no mixed read/w
shiumachi 2012/04/08
HBase
ãƒªãƒ³ã‚¯
Cloudian nosql casestudy_20120318
2012å¹´3æœˆ18æ—¥é–‹å‚¬InfoTalkã«ãŠã‘ã‚‹ãƒ—ãƒ¬ã‚¼ãƒ³ãƒ†ãƒ¼ã‚·ãƒ§ãƒ³è³‡æ–™ã§ã™ã€‚Cloudianã®æ¦‚è¦ã€Cloudianã¸ã®Cassandraã¨Redisã®å®Ÿè£…ã€NOSQLãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã®æ€§èƒ½æ¯”è¼ƒã€ç‹¬è‡ªé–‹ç™ºã®HyperStoreã«ã¤ã„ã¦èª¬æ˜Žã—ã¦ã„ã¾ã™ã€‚Read less
shiumachi 2012/03/28
æ€§èƒ½æ¸¬å®šçµæžœã«Cassandraã®ä¸€è²«æ€§ãƒ¬ãƒ™ãƒ«ã‚’ä½µè¨˜ã—ãªã„ã®ã¯ãªã‚“ã‹ã‚ºãƒ«ã„ã¨æ€ã£ãŸâ€¦â€¦ãŒã€æ›¸ç±ã«ã¯ãã¡ã‚“ã¨æ›¸ã„ã¦ã‚ã‚‹ã‚‰ã—ã„ã€‚æ›¸ç±ã‚’è²·ãŠã†

HBase

Cassandra

NoSQL
ãƒªãƒ³ã‚¯
Managing connections in HBase 0.90 and beyond
shiumachi 2012/03/14
HBase
ãƒªãƒ³ã‚¯
Designing an HBase Application â€“ Database Tutorials & Videos
shiumachi 2012/03/14
HBase
ãƒªãƒ³ã‚¯
HBase and Accumulo | Washington DC Hadoop User Group
1. HBase and Accumulo Washington DC Hadoop User Group Jan 25th, 2012 Todd Lipcon Software Engineer, Cloudera [email protected] / @tlipcon Copyright 2011 Cloudera Inc. All rights reserved 2. Background â€“ Overview â€¢ HBase and Accumulo are both open-source, Apache 2.0 licensed implementations of Googleâ€™s BigTable infrastructure, running on Apache Hadoop â€¢ Scala ble, distributed storage â€¢ Scala ble data
shiumachi 2012/03/12
Cloudera ã® Todd Lipcon @tlipcon ãŒ1æœˆã«HUGã§ãƒ—ãƒ¬ã‚¼ãƒ³ã—ãŸã¨ãã®è³‡æ–™

HBase

Accumulo
ãƒªãƒ³ã‚¯
GitHub - hbase-sculptor/sculptor
Sculptor is a framework and command line interface that makes using Apache HBase much easier. == Features == - Human friendly output - Interactive command line interface - Run ad-hoc MapReduce over HBase - Customized client framework Please see the doc at the wiki page. == Pre-requirements == - Apache Ivy is required to build Sculptor - Apache HBase installed - Hadoop MapReduce (Sculptor MapReduce
shiumachi 2012/03/09
ã“ã‚ŒãŒä¾‹ã®æ¥½å¤©ã®HBaseã‚³ãƒžãƒ³ãƒ‰ãƒ©ã‚¤ãƒ³ã‚¤ãƒ³ã‚¿ãƒ•ã‚§ãƒ¼ã‚¹ã‹ã€‚ã‚½ãƒ¼ã‚¹ã®ã‚³ãƒ¡ãƒ³ãƒˆãŒæ—¥æœ¬èªžã‹â€¦â€¦ã€‚ç¤¾å†…ã‚’è‹±èªžåŒ–ã™ã‚‹å‰ã«çœŸã£å…ˆã«è‹±èªžåŒ–ã—ã¦ã»ã—ã„ã¨ã“ã‚ãªã‚“ã§ã™ãŒ

sculptor

HBase
ãƒªãƒ³ã‚¯
ï¼»Cloud Days Osakaï¼½æ¥½å¤©ã€ç‹¬è‡ªé–‹ç™ºã®HBaseã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆã‚’OSSåŒ–
æ¥½å¤©ã¯2012å¹´3æœˆ9æ—¥ã€ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã‚½ãƒ•ãƒˆã‚¦ã‚¨ã‚¢ï¼ˆOSSï¼‰ã®ã‚«ãƒ©ãƒ åž‹ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ï¼ˆDBï¼‰ã€ŒHBaseã€ã®ã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆã€ŒSculptor, a HBase Client Frameworkã€ã‚’OSSã¨ã—ã¦å…¬é–‹ã—ãŸã€‚å¤§é˜ªå¸‚ã§é–‹å‚¬ã•ã‚ŒãŸã‚¯ãƒ©ã‚¦ãƒ‰ã‚³ãƒ³ãƒ”ãƒ¥ãƒ¼ãƒ†ã‚£ãƒ³ã‚°ã®å°‚é–€å±•ã€ŒCloud Days Osaka 2012ã€ã§ã€æ¥½å¤©ã®ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã§ã‚ã‚‹è’‹é€¸å³°æ°ï¼ˆå†™çœŸï¼‰ãŒæ˜Žã‚‰ã‹ã«ã—ãŸã€‚ HBaseã¯ã€OSSã®åˆ†æ•£ãƒãƒƒãƒå‡¦ç†ã‚½ãƒ•ãƒˆã€ŒHadoopã€ã‚’ãƒ™ãƒ¼ã‚¹ã«ã—ãŸã‚«ãƒ©ãƒ åž‹DBã§ã‚ã‚‹ã€‚æ¥½å¤©ã§ã¯2010å¹´ã‹ã‚‰ã€æ§˜ã€…ãªWebã‚µã‚¤ãƒˆã®ãƒãƒƒã‚¯ã‚¨ãƒ³ãƒ‰ã«HBaseã‚’ä½¿ã£ã¦ã„ã‚‹ã€‚ä»Šå›žåŒç¤¾ãŒé–‹ç™ºã—ãŸSculptorã¯ã€DBç®¡ç†è€…ãŒHBaseã®ãƒ¡ãƒ³ãƒ†ãƒŠãƒ³ã‚¹ãªã©ã‚’è¡Œã†éš›ã«ä½¿ç”¨ã™ã‚‹DBã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆãƒ„ãƒ¼ãƒ«ã§ã‚ã‚‹ã€‚HBaseã«ã‚‚æ¨™æº–ã®ã‚·ã‚§ãƒ«ãŒç”¨æ„ã•ã‚Œã¦ã„ã‚‹ãŒã€ã€Œä½¿ã„å‹æ‰‹ãŒæ‚ªã„ã€ï¼ˆè’‹æ°ï¼‰ã“ã¨ã‹ã‚‰ç‹¬è‡ªã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆã‚’é–‹ç™ºã—ãŸã€‚ Sculptor
shiumachi 2012/03/09
ã‚½ãƒ¼ã‚¹ããã£ãŸãŒè¦‹ã¤ã‹ã‚‰ãªã„ã®ã§ã ã‚Œã‹ã‚½ãƒ¼ã‚¹ã®ã‚½ãƒ¼ã‚¹ãã ã•ã„

HBase

æ¥½å¤©
ãƒªãƒ³ã‚¯
ã„ã¾ã•ã‚‰èžã‘ãªã„KVSã®å¸¸è˜ã‚’Hbaseã§èº«ã«ã¤ã‘ã‚‹
ã„ã¾ã•ã‚‰èžã‘ãªã„KVSã®å¸¸è˜ã‚’Hbaseã§èº«ã«ã¤ã‘ã‚‹ï¼šãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿å‡¦ç†ã®å¸¸è˜ã‚’Javaã§èº«ã«ã¤ã‘ã‚‹ï¼ˆ3ï¼‰ï¼ˆ1/3 ãƒšãƒ¼ã‚¸ï¼‰ Hadoopã‚’ã¯ã˜ã‚ã€Javaè¨€èªžã‚’ä½¿ã£ã¦æ§‹ç¯‰ã•ã‚Œã‚‹ã“ã¨ãŒå¤šã„ã€Œãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ã€å‡¦ç†ã®ãŸã‚ã®ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ï¼ãƒ©ã‚¤ãƒ–ãƒ©ãƒªã‚’ç´¹ä»‹ã—ãªãŒã‚‰ã€å¤§é‡ãƒ‡ãƒ¼ã‚¿ã‚’æ´»ç”¨ã™ã‚‹ãŸã‚ã®æŠ€è¡“ã®å¸¸è˜ã‚’èº«ã«ä»˜ã‘ã¦ã„ãé€£è¼‰ ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ã®è¦ï¼ KVSã¨ã¯ä½•ãªã®ã‹ ã€ŒKVSï¼ˆKey-Value Storeï¼‰ã€ã¨ã¯ã€Keyå€¤ã‚’æŒ‡å®šã—ã¦Valueå€¤ã®æ ¼ç´ã‚„å–å¾—ã‚’è¡Œã†æ–¹å¼ã§ã™ã€‚ãã‚Œã«å¯¾ã—ã¦ã€RDBã§ã¯ã‚ãƒ¼ï¼ˆãƒ—ãƒ©ã‚¤ãƒžãƒªã‚ãƒ¼ï¼‰ãŒå¿…é ˆã§ã¯ãªãã€é€†ã«è¤‡æ•°ã®ã‚«ãƒ©ãƒ ã‚’ã‚»ãƒƒãƒˆã—ã¦ã‚ãƒ¼ã«ã™ã‚‹ã“ã¨ã‚‚ã§ãã¾ã™ã€‚ ãƒ†ãƒ¼ãƒ–ãƒ«æ§‹é€ ã ã‘ã‚’è¦‹ã‚Œã°ã€KVSã¨RDBã¯ä¼¼ã¦ã„ã¾ã™ã€‚ä¾‹ãˆã°ã€RDBã§ãƒ—ãƒ©ã‚¤ãƒžãƒªã‚ãƒ¼ã¨1ã¤ã®BLOBåž‹ã‚’æŒã£ãŸãƒ†ãƒ¼ãƒ–ãƒ«ã‚’ä½œã‚Œã°ã€KVSã¨åŒã˜ã‚ˆã†ãªæ§‹é€ ã«ã‚‚ãªã‚Šã¾ã™ã€‚ã—ã‹ã—ã€RDBã§KVSã®ã¾ãã”ã¨ã‚’ã™ã‚‹ã®ã¨ã€KVSã¨ã—ã¦
shiumachi 2012/02/27
"ãŸã¨ãˆæ•°ãƒã‚¤ãƒˆã®ãƒ•ã‚¡ã‚¤ãƒ«ã‚’ç½®ã„ãŸã ã‘ã§ã‚‚ã€HDDã‚’64Mbytesã‚‚ä½¿ç”¨ã—ã¦ã—ã¾ã„ã¾ã™"ã“ã‚Œã¯èª¤ã‚Šã§ã™ã€‚å®Ÿéš›ã®ã‚µã‚¤ã‚ºåˆ†ã—ã‹ä½¿ç”¨ã—ã¾ã›ã‚“

HBase
ãƒªãƒ³ã‚¯
1 2 3 4 5 6 7 8 æ¬¡ã®ãƒšãƒ¼ã‚¸