[B! hbase] somemoã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

somemo id:somemo

hbaseã«é–¢ã™ã‚‹somemoã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (27)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

Cloudera Blog
In an era where artificial intelligence (AI) is reshaping enterprises across the globeâ€”be it in healthcare, finance, or manufacturingâ€”itâ€™s hard to overstate the transf ormation that AI has had on businesses, regardless of industry or size. At Cloudera, we recognize the urgent need for bold steps to harness this potential and dramatically accelerate the time to [â€¦] Read blog post
somemo 2015/01/15
hbase

Spark
ãƒªãƒ³ã‚¯
Amazon.co.jp: HBaseå¾¹åº•å…¥é–€: Hadoopã‚¯ãƒ©ã‚¹ã‚¿ã«ã‚ˆã‚‹é«˜é€Ÿãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã®å®Ÿç¾: ã‚µã‚¤ãƒãƒ¼ã‚¨ãƒ¼ã‚¸ã‚§ãƒ³ãƒˆ: æœ¬
somemo 2015/01/15
hbase

hadoop
ãƒªãƒ³ã‚¯
ã‚¹ã‚±ãƒ¼ãƒ©ãƒ–ãƒ«ãªã‚·ã‚¹ãƒ†ãƒ ã®ãŸã‚ã®HBaseã‚¹ã‚ãƒ¼ãƒžè¨è¨ˆ #hcj13w
Cloudera HBase ãƒˆãƒ¬ãƒ¼ãƒ‹ãƒ³ã‚°: http://tiny.cloudera.com/jptraininghbase Hadoop Conference Japan 2013 Winter ã§ç™ºè¡¨ã—ãŸã€HBaseã®ã‚¹ã‚ãƒ¼ãƒžè¨è¨ˆã«é–¢ã™ã‚‹è³‡æ–™ã§ã™ã€‚ Cloudera ã® HBase ã‚µãƒãƒ¼ãƒˆã€Cloudera Enterprise RTD http://tiny.cloudera.com/jpcertdRead less
somemo 2014/08/28
hbase

hadoop
ãƒªãƒ³ã‚¯
HBaseã§deleteå¾Œã«putã—ãŸãƒ‡ãƒ¼ã‚¿ãŒscanã‚„getã§å–å¾—ã§ããªã„ä»¶ - æ–°ã—ã„ãƒ•ã‚©ãƒ«ãƒ€ (3)
ä»•äº‹ã§ã¶ã¡å½“ãŸã£ãŸã®ã§å‚™å¿˜éŒ²ã€‚ çµè«–ã¨ã—ã¦ã¯HBaseã«ãŠã‘ã‚‹å‰Šé™¤ã¨ã„ã†ã‚‚ã®ã®æ¦‚å¿µã‚’å–ã‚Šé•ãˆã¦ãŸã ã‘ã¨ã„ã†æ‚²ã—ã„çµæžœã ã£ãŸã®ã§ã™ãŒã€åŒã˜è½ã‚’è¸ã¾ãªã„ã‚ˆã†ã«ã‚¨ãƒ³ãƒˆãƒªã«æ®‹ã—ã¦ãŠãã¾ã™ã€‚ ãƒãƒ¼ã‚¸ãƒ§ãƒ³æ©Ÿèƒ½ä½¿ã£ã¦ã‚‹å ´åˆã¯ç‰¹ã«æ³¨æ„ã—ãŸã»ã†ãŒã‚ˆã•ãã†ã§ã™ã€‚ ä½•ãŒã‚ã£ãŸã®ï¼Ÿ ä»¥ä¸‹ã®ã‚³ãƒžãƒ³ãƒ‰ã‚’HBase Shellã§å®Ÿè¡Œã—ã¾ã—ãŸã€‚ # (1) hogehogeãƒ†ãƒ¼ãƒ–ãƒ«ã®rowkey1ã§æŒ‡å®šã•ã‚Œã‚‹è¡Œã®cf:cqã‚«ãƒ©ãƒ ã®ãƒãƒ¼ã‚¸ãƒ§ãƒ³1000ã‚’value1ã§æ›´æ–° put 'hogehoge', 'rowkey1', 'cf:cq', 'value1', 1000 # (2) æ¤œç´¢ scan 'hogehoge' # (3) hogehogeãƒ†ãƒ¼ãƒ–ãƒ«ã®rowkey1ã§æŒ‡å®šã•ã‚Œã‚‹è¡Œã®cf:cqã‚«ãƒ©ãƒ ã®ãƒãƒ¼ã‚¸ãƒ§ãƒ³1000ã‚’å‰Šé™¤ delete 'hogehoge', 'rowkey1', 'cf:cq', 1000 # (
somemo 2014/08/28
hbase
ãƒªãƒ³ã‚¯
HBase Hadoopãƒ¡ãƒ¢(Hishidama's HBase Hadoop Memo)
S-JIS[2010-07-11/2012-04-28] å¤‰æ›´å±¥æ´ HBaseã®Hadoopé–¢é€£ã‚¯ãƒ©ã‚¹ HBaseã«Hadoopã§ã‚¢ã‚¯ã‚»ã‚¹ã™ã‚‹ç‚ºã®ã‚¯ãƒ©ã‚¹ã€‚ WordCountã‚µãƒ³ãƒ—ãƒ« HBaseã®ãƒ†ãƒ¼ãƒ–ãƒ«ã®å…¨é …ç›®ã‚’èªã¿è¾¼ã¿ã€å˜èªžæ•°ã‚’æ•°ãˆã‚‹ã‚µãƒ³ãƒ—ãƒ«ã€‚ å‡ºåŠ›å…ˆã¯ãƒ•ã‚¡ã‚¤ãƒ«ã€‚ï¼ˆé€šå¸¸ã®Hadoopã¨åŒã˜ï¼‰ ï¼ˆâ†’HBaseã®ãƒ†ãƒ¼ãƒ–ãƒ«ã«å‡ºåŠ›ã™ã‚‹WordCountï¼‰ package jp.hishidama.sample.hbase; import java.io.IOException; import java.util.StringTokenizer; import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.conf.Configured; import org.apache.hadoop.fs.Path; impor
somemo 2014/08/25
hadoop

hbase
ãƒªãƒ³ã‚¯
HBaseã®ãƒãƒ«ã‚¯ãƒãƒ¼ãƒ‰ã¨ã„ã†ã‹HFileç”Ÿæˆæ–¹æ³• - wyukawa's diary
HBaseã«ãƒ‡ãƒ¼ã‚¿ã‚’ãƒãƒ¼ãƒ‰ã™ã‚‹å ´åˆã¯ãƒãƒ«ã‚¯ãƒãƒ¼ãƒ‰ã‚’ä½¿ã†ã®ãŒæ€§èƒ½çš„ã«ã¯è‰¯ã„ã¨æ€ã„ã¾ã™ã€‚ HTable#putã ã¨WALã‚’ã‚ªãƒ•ã«ã—ã¦ã‚‚é…ã„ã‚“ã§ã™ã‚ˆãã€‚ ãƒãƒ«ã‚¯ãƒãƒ¼ãƒ‰ã«é–¢ã—ã¦ã¯é¦¬æœ¬ã®12.2.3ã‚’èªã‚€ã¨è‰¯ã„ã¨æ€ã„ã¾ã™ã€‚ ãƒãƒ«ã‚¯ãƒãƒ¼ãƒ‰ã‚’ä½¿ã†ãŸã‚ã«ã¯HBaseç”¨ã®ãƒ‡ãƒ¼ã‚¿ãƒ•ã‚¡ã‚¤ãƒ«ã€HFileã‚’ç”Ÿæˆã™ã‚‹å¿…è¦ãŒã‚ã‚Šã¾ã™ã€‚ MapReduceã‚¸ãƒ§ãƒ–ã§HFileã‚’ç”Ÿæˆã™ã‚‹ãŸã‚ã«ã¯å‡ºåŠ›ãƒ•ã‚©ãƒ¼ãƒžãƒƒãƒˆã¨ã—ã¦HFileOutputFormatã‚’ä½¿ã„ã¾ã™ã€‚ MapReduceã‚¸ãƒ§ãƒ–ã‚’åŠ¹çŽ‡çš„ã«å‹•ä½œã•ã›ã‚‹ãŸã‚ã«ã¯å‡ºåŠ›ã—ãŸHFileã‚’1ã¤ã®ãƒªãƒ¼ã‚¸ãƒ§ãƒ³ã«åŽã¾ã‚‹ã‚ˆã†ã«ã™ã‚‹ã‚ã‘ã§ã™ãŒã€ãã®è¾ºã®å‡¦ç†ã¯HFileOutputFormat#configureIncrementalLoadã‚’å‘¼ã¹ã°ã„ã„ã§ã™ã€‚å‘¼ã¹ã°TotalOrderPartitionerã‚’partitionerã¨ã—ã¦ã‚»ãƒƒãƒˆã—ã¦ã‚ˆã‚ã—ãã‚„ã£ã¦ãã‚Œã¾ã™ã€‚ MapReduceã§
somemo 2014/08/25
hbase

hadoop
ãƒªãƒ³ã‚¯
MapReduceã§HBaseã¸æ›¸ãè¾¼ã‚€ã¨ãã®æ³¨æ„ç‚¹
ã›ã¡ã‚ãƒ¼ @sechiro HBaseã®TableOutputFormatã®å±é™ºæ€§ã£ã¦ã€å‰ã«è¦‹ã¦ãŸautoFlushãŒFalseã«ãªã£ã¦ã‚‹ã‹ã‚‰ã£ã¦ã“ã¨ã‹ãªï¼Ÿ Hadoop Hacksã‚’è¦‹ã‚Œã°ã‚ˆã„ã‹ã€‚å˜ç´”ãªè¿½è¨˜ã§ä½¿ã†ãªã‚‰å•é¡Œãªã„ã‘ã©ã€ãƒ‡ãƒ¼ã‚¿ã®æ›´æ–°ã¿ãŸã„ãªå‡¦ç†ã ã¨TaskãŒè½ã¡ãŸæ™‚ã«ã¯æˆ»ã›ãªã„ã‚ˆã£ã¦ã“ã¨ã ã¨äºˆæƒ³ 2012-04-29 01:33:44
somemo 2014/08/25
hbase

hadoop
ãƒªãƒ³ã‚¯
HBaseã¸ãƒ‡ãƒ¼ã‚¿æŠ•å…¥(importtsvã®ä½¿ã„æ–¹) - ãã¾ãã¾ãƒ¼Z
create 'sample', 'data' ('a'..'z').each {|i| put 'sample', i, 'data:alpha', i} scan 'samples' ROW COLUMN+CELL a column=data:alpha, timestamp=1333387516755, value=a b column=data:alpha, timestamp=1333387516772, value=b ... æ‰‹ã”ã‚ãªfixtureä½œæˆã«ã¯ã‚ˆã„ãŒã€ã“ã‚Œã§1å„„ä»¶ã‚„ã‚‹æ°—ã¯ã—ãªã„ b) importtsv ã®ä½¿ã„æ–¹ æ—¢å˜ã®ã‚¤ãƒ³ãƒãƒ¼ãƒˆãƒ„ãƒ¼ãƒ«ã‚’åˆ©ç”¨ã™ã‚‹æ–¹æ³•ã€‚ å…¥åŠ›ãƒ‡ãƒ¼ã‚¿ã¯tsv,csvã«é™å®šã•ã‚Œã‚‹ãŒã€hbase.jarã«å«ã¾ã‚Œã‚‹ImportTsvãŒç›®çš„ã«åˆè‡´ã™ã‚‹ã€‚ å®Ÿè¡Œã«ã¯hbase.jarãƒ•ã‚¡ã‚¤ãƒ«ã®ãƒ•ãƒ«ãƒ‘ã‚¹ãŒå¿…è¦ãªã®ã§ã€ã¾ãšã¯jarã‚’locateãªã©ã§æŽ¢ã™ã€‚ % lo
somemo 2014/08/25
hbase

hadoop
ãƒªãƒ³ã‚¯
Acroquest Technologyã€Hadoop/HBaseã®å†…éƒ¨å‹•ä½œã‚’å¯è¦–åŒ–ã™ã‚‹ã€Œhalookã€ã‚’ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã¨ã—ã¦å…¬é–‹ã€WGP1.0Î²ãŠã‚ˆã³ENdoSnipe5.0Î²ã‚’åŒæ™‚ãƒªãƒªãƒ¼ã‚¹ | gihyo.jp
Acroquest Techno logyã€Hadoop/HBaseã®å†…éƒ¨å‹•ä½œã‚’å¯è¦–åŒ–ã™ã‚‹ã€Œhalookã€ã‚’ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã¨ã—ã¦å…¬é–‹ã€WGP1.0Î²ãŠã‚ˆã³ENdoSnipe5.0Î²ã‚’åŒæ™‚ãƒªãƒªãƒ¼ã‚¹ Acroquest Techno logyæ ªå¼ä¼šç¤¾ã¯2012å¹´11æœˆ9æ—¥ã€Hadoop/HBaseã®å†…éƒ¨å‹•ä½œã‚’å¯è¦–åŒ–ã™ã‚‹ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã€Œhalookã€ã‚’ã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã¨ã—ã¦å…¬é–‹ã—ã€ä½µã›ã¦WGP1.0Î²ãŠã‚ˆã³ENdoSnipe5.0Î²ã‚’ãƒªãƒªãƒ¼ã‚¹ã—ãŸã€‚ DataNodeé–“ã®åã‚Šã‚„MapReduce Taskã®å‹•ä½œçŠ¶æ³ã‚’å¯è¦–åŒ– Hadoopåˆ†æ•£ãƒ•ã‚¡ã‚¤ãƒ«ã‚·ã‚¹ãƒ†ãƒ ã§ã‚ã‚‹HDFSã¯ã€ã‚¯ãƒ©ã‚¹ã‚¿ã‚’æ§‹æˆã™ã‚‹DataNodeã«ã€ãƒ‡ãƒ¼ã‚¿ã‚’åˆ†æ•£ã—ã¦ä¿å˜ã™ã‚‹ã€‚ä»Šå›žãƒªãƒªãƒ¼ã‚¹ã•ã‚ŒãŸhalookã¯ã€ã“ã®DataNodeé–“ã«ãŠã‘ã‚‹ãƒ‡ãƒ¼ã‚¿ã®åã‚Šæ–¹ã‚’å¯è¦–åŒ–ã™ã‚‹ã‚‚ã®ã€‚ halookã§DataNodeé–“ã®æ§˜åã‚’å¯è¦–åŒ– ã¾ãŸã€MapReduceã«
somemo 2014/08/09
hadoop

hbase
ãƒªãƒ³ã‚¯
Facebookã®ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ Big Data å‡¦ç†
2. oï¯â€¯ã€€æ¯Žæœˆã®ã‚¢ã‚¯ãƒ†ã‚£ãƒ–ãƒ»ãƒ¦ãƒ¼ã‚¶ 8å„„4500ä¸‡äºº oï¯â€¯ã€€ä¸€æ—¥ã®ã€Œã„ã„ãã€ã¨ã‚³ãƒ¡ãƒ³ãƒˆ 27å„„ oï¯â€¯ã€€ä¸€æ—¥ã«ã‚¢ãƒƒãƒ—ãƒãƒ¼ãƒ‰ã•ã‚Œã‚‹å†™çœŸ 2å„„5000ä¸‡æžš oï¯â€¯ã€€Facebookä¸Šã®å‹äººé–¢ä¿‚ 1000å„„ 3. æ§‹ç¯‰ã•ã‚Œã‚‹ã¹ãã‚¤ãƒ³ãƒ•ãƒ©ã®ç›®çš„ oï¯â€¯ ä¸–ç•Œã®èª°ã¨ã§ã‚‚ã¤ãªãŒã‚‹ã“ã¨ã€èª°ã«ã‚‚å£°ã‚’ ä¸Žãˆã‚‹ã“ã¨ã€æœªæ¥ã®ãŸã‚ã«ç¤¾ä¼šã‚’å¤‰é©ã™ã‚‹ ã®ã‚’åŠ©ã‘ã‚‹ã“ã¨ã€‚ã“ã‚Œã‚‰ã«ã¯ã€å·¨å¤§ãªãƒ‹ãƒ¼ ã‚ºã¨å·¨å¤§ãªãƒãƒ£ãƒ³ã‚¹ãŒã‚ã‚Šã¾ã™ã€‚ oï¯â€¯ ã“ã®ãƒ†ã‚¯ãƒŽãƒã‚¸ãƒ¼ã¨ã€æ§‹ç¯‰ã•ã‚Œã‚‹ã¹ãã‚¤ãƒ³ãƒ• ãƒ©ã®è¦æ¨¡ã¯ã€å‰ä¾‹ã®ãªã„ã‚‚ã®ã§ã™ã€‚ç§ãŸ ã¡ã¯ã€ã“ã‚Œã“ããŒç§ãŸã¡ãŒé›†ä¸ã™ã‚‹ã“ã¨ã® å‡ºæ¥ã‚‹ã€ã‚‚ã£ã¨ã‚‚é‡è¦ãªå•é¡Œã ã¨ç¢ºä¿¡ã—ã¦ ã„ã¾ã™ã€‚ -- Facebookä¸Šå ´ç”³è«‹æ–‡æ›¸ã‹ã‚‰ 4. Real-Time Analytics System http://highscalability.com/blog/ 2011/3/22/facebooks-new-re
somemo 2014/07/30
hadoop

hbase
ãƒªãƒ³ã‚¯
Tokyo HBase Meetup - Realtime Big Data at Facebook with Hadoop and HBase (ja)
This is the Japanese translation of the presentation at Tokyo HBase Meetup (July 1, 2011) Author: Jonathan Gray Software Engineer / HBase Commiter at FacebookRead less
somemo 2014/07/30
hbase

hadoop
ãƒªãƒ³ã‚¯
Takuya Ueshin, Nautilus technologies, inc.
Takuya UESHIN12 SlideShares92 Followers74 FollowingsFollowBlock User12 SlideShares92 Followers74 FollowingsPersonal InformationOrganization / WorkplaceKawasaki, Kanagawa JapanWebsitehappy-camper.stContact DetailsPresentations(12)Â See all20100724 HBaseãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°20100724 HBaseãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°Takuya UESHINÂ 20110616 HBaseå‹‰å¼·ä¼š(ç¬¬äºŒå›ž)20110616 HBaseå‹‰å¼·ä¼š(ç¬¬äºŒå›ž)Takuya UESHINÂ Introduction to Spark SQL & CatalystIntroduction
somemo 2014/07/29
hbase

hadoop
ãƒªãƒ³ã‚¯
Osc2012 spring HBase Report
1. ä»Šè©±é¡Œã®Hadoop HBaseã® æ€§èƒ½æ¤œè¨¼çµæžœã¨ Zabbixã«ã‚ˆã‚‹æ€§èƒ½ç›£è¦–ã®ã”ç´¹ä»‹ æ—¥æœ¬ãƒ’ãƒ¥ãƒ¼ãƒ¬ãƒƒãƒˆãƒ»ãƒ‘ãƒƒã‚«ãƒ¼ãƒ‰æ ªå¼ä¼šç¤¾ ãƒ†ã‚¯ãƒŽãƒã‚¸ãƒ¼ ã‚³ãƒ³ã‚µãƒ«ãƒ†ã‚£ãƒ³ã‚°çµ±æ‹¬æœ¬éƒ¨ ãƒ‡ãƒ¼ã‚¿ã‚»ãƒ³ã‚¿ãƒ¼ã‚½ãƒªãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ç¬¬ä¸€æœ¬éƒ¨ã‚³ã‚¢ãƒ†ã‚¯ãƒŽãƒã‚¸ãƒ¼éƒ¨ çŸ³ç”°ç²¾ä¸€éƒŽ Â© Copyright 2012 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Confidentiality label goes here 2. ãŠè©±ã—ã—ãŸã„å†…å®¹ â€¢ ã‚¤ãƒ³ãƒ•ãƒ©ã®è¦³ç‚¹ã‹ã‚‰ã®HBase â€¢ ã©ã®ã‚ˆã†ã«ä¿¡é ¼æ€§ãŒç¢ºä¿ã•ã‚Œã¦ã„ã‚‹ã®ã‹ â€¢ ã‚¹ã‚±ãƒ¼ãƒ«ã‚¢ã‚¦ãƒˆã‚„IOã®ã‚¢ãƒ¼ã‚ãƒ†ã‚¯ãƒãƒ£ â€¢ æ€§èƒ½ç›£è¦–ã®ãƒã‚¤ãƒ³ãƒˆ â€¢ æ¤œè¨¼ã®è¦³ç‚¹ã¨ãƒãƒžã‚Šã©ã“ã‚ â€¢ ãƒ—ãƒãƒ€ã‚¯ãƒˆã®åŸºæœ¬çš„ãªç‰¹å¾´ã€æ€§èƒ½ç‰¹æ€§ã®ç¢º
somemo 2014/07/29
hbase

hadoop

zabbix
ãƒªãƒ³ã‚¯
HBaseã®Row Keyã®è¨è¨ˆã«ã¤ã„ã¦ã®ãƒ¡ãƒ¢ - wyukawa's diary
Facebook Messageã§ä½¿ã‚ã‚ŒãŸã‚Šã€LINEã®ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã§ä½¿ã‚ã‚ŒãŸã‚Šã€ã¨äº‹ä¾‹ã‚‚å¤šãå‡ºã¦ãã¦ã„ã‚‹HBaseï¼ˆBã¯å¤§æ–‡å—ã€‚ã“ã‚Œé‡è¦ï¼‰ã§ã™ãŒã€å€‹äººçš„ã«å°‘ã—èˆˆå‘³ã‚‚æ¹§ã„ã¦ããŸã®ã§ã¡ã‚‡ã£ã¨èª¿ã¹ã¦ã¾ã™ã€‚HBaseã¯Log-Structured Merge-tree (LSM-tree)ã¨ã„ã†ã‚¢ãƒ¼ã‚ãƒ†ã‚¯ãƒãƒ£ã‚’ä½¿ã£ã¦ãŠã‚Šå¤§é‡ãƒ‡ãƒ¼ã‚¿ã®æ›¸ãè¾¼ã¿ã«æœ€é©åŒ–ã•ã‚Œã¦ã„ã¾ã™ã€‚ãªã®ã§å¤§é‡ã®æ›¸ãè¾¼ã¿ãŒã‚ã‚Šèªã¿è¾¼ã¿ã¯ç›´è¿‘ã®ã‚‚ã®ã®ã¿ã¨ã„ã†ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ç³»ã‚¢ãƒ—ãƒªã«å‘ã„ã¦ã„ã‚‹ã‚“ã ã¨æ€ã„ã¾ã™ã€‚ ãã†ã„ãˆã°åŠé¡ã«é‡£ã‚‰ã‚Œã¦Manning | HBase in Actionã‚‚è²·ã£ã¦ã—ã¾ã„ã¾ã—ãŸã€‚ ã“ã®æœ¬ã®4ç« ã®Row Keyã®è¨è¨ˆã«ã¤ã„ã¦ã®è©±ãŒã‚ã£ã¦ãã‚ŒãŒã¡ã‚‡ã£ã¨é¢ç™½ã‹ã£ãŸã®ã§é–¢é€£ã—ã¦Row Keyã«ã¤ã„ã¦å°‘ã—æ›¸ã„ã¦ã¿ã¾ã™ã€‚ ã¾ãšHBaseã¯ã‚«ãƒ©ãƒ æŒ‡å‘ã®ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã¨å‘¼ã°ã‚Œã¾ã™ãŒãƒ‡ãƒ¼ã‚¿ãƒ¢ãƒ‡ãƒ«ã¯å¤šæ¬¡å…ƒã‚½ãƒ¼ãƒˆãƒžãƒƒãƒ—ã§ã™ã€‚ å›³è§£ã™ã‚‹ã¨ä¸‹è¨˜ã®
somemo 2014/07/29
hbase

hadoop
ãƒªãƒ³ã‚¯
Facebookã«ãƒã‚°ã‚¤ãƒ³
Facebookã«ãƒã‚°ã‚¤ãƒ³ã—ã¦ã€å‹é”ã‚„å®¶æ—ã¨å†™çœŸã‚„è¿‘æ³ã‚’ã‚·ã‚§ã‚¢ã—ã¾ã—ã‚‡ã†ã€‚
somemo 2014/07/29
Cassandra

hbase
ãƒªãƒ³ã‚¯
Blog - LINE ENGINEERING
As of October 1, 2023, LINE has been rebranded as LY Corporation. Visit the new blog of LY Corporation here: LY Corporation Tech Blog
somemo 2014/07/29
hbase

redis
ãƒªãƒ³ã‚¯
PHPï¼‹Thriftï¼‹HBaseã‚’è©¦ã—ã¦ã¿ãŸ - Do You PHP ã¯ã¦ãƒ–ãƒ
ä½¿ã£ã¦ã‚‹äººã«ã¨ã£ã¦ã¯ä½•å‘¨ç›®ã‹ã®ä»Šã•ã‚‰æ„Ÿæ¼‚ã„ã¾ã™ãŒã€ã²ã‚‡ã‚“ãªã“ã¨ã‹ã‚‰èª¿ã¹ã‚‹å¿…è¦ãŒå‡ºã¦ããŸã®ã§ã–ã£ãã‚Šã¾ã¨ã‚ã¦ã¿ã¾ã—ãŸã€‚ ç’°å¢ƒ CentOS6.3 PHP5.5.3 JDK1.6.0-45 HBase0.94.11 Thrift0.9.1 HBaseã¨ã¯ HBaseã¯KVS(Key-Value Store)ã®1ã¤ã§ã€ASF(Apache Software Foundation)ã®Hadoopãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã®ä¸€ç’°ã¨ã—ã¦ä½œã‚‰ã‚ŒãŸã‚ªãƒ¼ãƒ—ãƒ³ã‚½ãƒ¼ã‚¹ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã§ã™ã€‚æœ¬å®¶ã¯Apache HBase â€“ Apache HBaseâ„¢ Homeã§ã™ã€‚ HBaseã®ã‚¢ãƒ¼ã‚ãƒ†ã‚¯ãƒãƒ£ã‚’ç†è§£ã—ã‚ˆã† (1/3)ï¼šCodeZineï¼ˆã‚³ãƒ¼ãƒ‰ã‚¸ãƒ³ï¼‰ ã¨ã‚Šã‚ãˆãšã€ä»¥ä¸‹ã®è¨˜äº‹ã‚’ã–ã£ã¨èªã‚€ã¨è‰¯ã„ã‹ã¨ã€‚ ã„ã¾ã•ã‚‰èžã‘ãªã„KVSã®å¸¸è˜ã‚’Hbaseã§èº«ã«ã¤ã‘ã‚‹ (1/3)ï¼šãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿å‡¦ç†ã®å¸¸è˜ã‚’Javaã§èº«ã«ã¤ã‘ã‚‹ï¼ˆ3ï¼‰ - ï¼ IT HB
somemo 2014/07/29
php

hbase

thrift
ãƒªãƒ³ã‚¯
Hadoopã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹20140707
11. ã€æœŸå¾…ã•ã‚Œã‚‹åŠ¹æžœã€‘ â‘ ãƒ¦ãƒ¼ã‚¶æ¯Žã®å—œå¥½ãŒã‚½ãƒ¼ãƒˆã«åæ˜ ã•ã‚Œã‚‹ãŸã‚ CVRãŒä¸ŠãŒã‚‹ â‘¡ æ¤œç´¢è¡Œç‚ºã‚’ã—ãªãã¦ã‚‚æ±‚äººã«å¿œå‹Ÿã§ãã‚‹ãŸã‚ å¿œå‹Ÿæ•°å¢—ãŒè¦‹è¾¼ã‚ã‚‹ â‘¢ ä¸€è¦§ãŒãƒ¦ãƒ¼ã‚¶ã«æœ›ã¾ã—ã„æ±‚äººã®é †ç•ªã«ãªã‚‹ãŸã‚ è¡¨ç¤ºä¸Šä½ã‹ã‚‰å¿œå‹Ÿã•ã‚Œã¦ã€å¿œå‹Ÿæ•°å¢—ãŒè¦‹è¾¼ã‚ã‚‹ ãƒ¦ãƒ¼ã‚¶æ¯Žã«ãŠã™ã™ã‚ã®æ±‚äººã‚’ã‚¹ã‚³ã‚¢ãŒé«˜ã„é †ã§ä¸€è¦§è¡¨ç¤ºã™ã‚‹ ï¼‹ ãƒ¦ãƒ¼ã‚¶ãŒé–²è¦§ã—ãŸã‚¿ã‚¤ãƒŸãƒ³ã‚°ã§ãŠã™ã™ã‚ãŒå¤‰åŒ–ã™ã‚‹ ã‚¿ã‚¦ãƒ³ãƒ¯ãƒ¼ã‚¯ï¼šã‚¹ãƒžãƒ›ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ ãƒ¬ã‚³ãƒ¡ãƒ³ãƒ‰ 15. Hbaseã®æ§‹é€ ï½žãƒ¬ã‚³ãƒ¡ãƒ³ãƒ‰ãƒ‡ãƒ¼ã‚¿ã®æ ¼ç´ 15 ãƒ•ã‚£ãƒ¼ãƒ«ãƒ‰ å€¤ ã‚µãƒ³ãƒ—ãƒ«å€¤ ãƒ†ãƒ¼ãƒ–ãƒ«å fs_rec_it em - ãƒ†ãƒ¼ãƒ–ãƒ«æ¦‚è¦ ãƒãƒƒã‚·ãƒ¥åŒ–æ¸ˆã¿ã®IDã¨ãã®ãƒ¦ãƒ¼ã‚¶ã®ãƒ¬ã‚³ãƒ¡ãƒ³ãƒ‰ãƒªã‚¹ãƒˆã‚’ä¿æŒã™ã‚‹ã€‚ - è¡Œã‚ãƒ¼ MD5(RID).substr(1, 16) 900150983cd24fb0 ãƒ•ã‚£ãƒ¼ãƒ«ãƒ‰ ç‰©ç†å è«–ç†å - ã‚«ãƒ©ãƒ ãƒ•ã‚¡ãƒŸãƒªãƒ¼ rec <ãƒ¬ã‚³ãƒ¡ãƒ³ãƒ‰ãƒ‡ãƒ¼ã‚¿> - ã‚«ãƒ©ãƒ ä¿®é£¾å list
somemo 2014/07/23
hadoop

hbase
ãƒªãƒ³ã‚¯
HBase 0.96 ã§å°Žå…¥ã•ã‚Œã‚‹æ–°ã—ã„ã‚³ãƒ³ãƒ‘ã‚¯ã‚·ãƒ§ãƒ³ã€ŒExploring Compactionã€ - ç§‘å¦ã¨éžç§‘å¦ã®è¿·å®®
Hadoopã‚¢ãƒ‰ãƒ™ãƒ³ãƒˆã‚«ãƒ¬ãƒ³ãƒ€ãƒ¼2013ã€3æ—¥ç›®ã‚’æ‹…å½“ã™ã‚‹ @shiumachi ã§ã™ã€‚ ä»Šå›žã¯ HBase 0.96 ã®æ–°æ©Ÿèƒ½ã‚’ä¸€ã¤ç´¹ä»‹ã—ã¾ã™ã€‚ è¦ç´„ HBase 0.96 ã¯è³¢ããªã£ãŸã®ã§ã¿ã‚“ãªä½¿ãŠã†ã€‚ ã‚³ãƒ³ãƒ‘ã‚¯ã‚·ãƒ§ãƒ³ã®ãŠã•ã‚‰ã„ HBase ã§ã¯ã€Log Structured-Merge tree (LSM-tree) ã¨ã„ã†ãƒ‡ãƒ¼ã‚¿æ§‹é€ ã‚’ä½¿ã£ã¦ã„ã¾ã™ã€‚ LSM-tree ã‚’ç°¡å˜ã«èª¬æ˜Žã™ã‚‹ã¨ã€å…¥åŠ›ã•ã‚ŒãŸãƒ‡ãƒ¼ã‚¿ã‚’ãƒã‚°ã¨ãƒ¡ãƒ¢ãƒªä¸Šã®ãƒ‡ãƒ¼ã‚¿ã‚¹ãƒˆã‚¢(Memstoreã€ãƒ¡ãƒ¢ãƒªã‚¹ãƒˆã‚¢) ã«æ›¸ãè¾¼ã¿ã¾ã™ã€‚ ãƒ¡ãƒ¢ãƒªã‚¹ãƒˆã‚¢ãŒã„ã£ã±ã„ã«ãªã‚‹ã¨ã€ã¾ã¨ã‚ã¦ãƒ‡ã‚£ã‚¹ã‚¯ã«ãƒ•ãƒ©ãƒƒã‚·ãƒ¥ã—ã€æ–°ã—ã„ã‚¹ãƒˆã‚¢ãƒ•ã‚¡ã‚¤ãƒ«ã‚’ç”Ÿæˆã—ã¾ã™ã€‚ ã“ã®ã‚¹ãƒˆã‚¢ãƒ•ã‚¡ã‚¤ãƒ«ãŒãŸã¾ã£ã¦ããŸã¨ãã«ã€å°‘ã—ã¥ã¤ä¸€ã¾ã¨ã‚ã«ã—ã¦ãªã‚‹ã¹ããƒ•ã‚¡ã‚¤ãƒ«æ•°ã‚’å°‘ãªãã™ã‚‹ã‚ˆã†ã«ã—ã¾ã™ã€‚ã“ã‚ŒãŒã‚³ãƒ³ãƒ‘ã‚¯ã‚·ãƒ§ãƒ³ã§ã™ã€‚ ã‚³ãƒ³ãƒ‘ã‚¯ã‚·ãƒ§ãƒ³ã‚’å®Ÿè¡Œã™ã‚‹ã“ã¨ã«ã‚ˆã‚Šã€ãƒ•ã‚¡ã‚¤ãƒ«ã¯ä¸€ã¤ã«ã¾ã¨ã¾ã‚Šã¾ã™ã€‚ã“
somemo 2014/07/15
hbase

hadoop
ãƒªãƒ³ã‚¯
Hadoopã€hBaseã§æ§‹ç¯‰ã™ã‚‹å¤§è¦æ¨¡åˆ†æ•£ãƒ‡ãƒ¼ã‚¿å‡¦ç†ã‚·ã‚¹ãƒ†ãƒ
CodeZineç·¨é›†éƒ¨ã§ã¯ã€ç¾å ´ã§æ´»èºã™ã‚‹ãƒ‡ãƒ™ãƒãƒƒãƒ‘ãƒ¼ã‚’ã‚¹ã‚¿ãƒ¼ã«ã™ã‚‹ãŸã‚ã®ã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹ã€ŒDevelopers Summitã€ã‚„ã€ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã®ç”Ÿãã–ã¾ã‚’ãƒ–ãƒ¼ã‚¹ãƒˆã™ã‚‹ãŸã‚ã®ã‚¤ãƒ™ãƒ³ãƒˆã€ŒDevelopers Boostã€ãªã©ã€ã•ã¾ã–ã¾ãªã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹ã‚’ä¼ç”»ãƒ»é‹å–¶ã—ã¦ã„ã¾ã™ã€‚
somemo 2014/07/15
hadoop

hbase
ãƒªãƒ³ã‚¯
1 2 æ¬¡ã®ãƒšãƒ¼ã‚¸