HBaseを使ã£ã¦ç°¡æ˜“ブãƒã‚°ã‚µãƒ¼ãƒ“スを作ã£ã¦ã¿ã‚ˆã†
CodeZine編集部ã§ã¯ã€ç¾å ´ã§æ´»èºã™ã‚‹ãƒ‡ãƒ™ãƒãƒƒãƒ‘ーをスターã«ã™ã‚‹ãŸã‚ã®ã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹ã€ŒDevelopers Summitã€ã‚„ã€ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã®ç”Ÿãã–ã¾ã‚’ブーストã™ã‚‹ãŸã‚ã®ã‚¤ãƒ™ãƒ³ãƒˆã€ŒDevelopers Boostã€ãªã©ã€ã•ã¾ã–ã¾ãªã‚«ãƒ³ãƒ•ã‚¡ãƒ¬ãƒ³ã‚¹ã‚’ä¼ç”»ãƒ»é‹å–¶ã—ã¦ã„ã¾ã™ã€‚
1å°ã®ãƒžã‚·ãƒ³ã®æ€§èƒ½åŠ£åŒ–ã¸ã®å¯¾ç–（HBase）
メールアドレスãŒã“ã®ã‚°ãƒ«ãƒ¼ãƒ—ã§ã¯åŒ¿å化ã•ã‚Œã¦ã„ã‚‹ã‹ã€ãƒ¡ãƒ³ãƒãƒ¼ã®ãƒ¡ãƒ¼ãƒ«ã‚¢ãƒ‰ãƒ¬ã‚¹ã‚’表示ã™ã‚‹æ¨©é™ãŒãªã„ãŸã‚ã€å…ƒã®ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸ã‚’表示ã§ãã¾ã›ã‚“ è½åˆã¨ç”³ã—ã¾ã™ã€‚ HBaseを使ã£ã¦ã„ãŸéš›ã«ã€ 1å°ã®ãƒžã‚·ãƒ³ã®æ€§èƒ½åŠ£åŒ–ã§æ›¸ãè¾¼ã¿é€Ÿåº¦ãŒå¤§å¹…ã«åŠ£åŒ–ã™ã‚‹å•é¡ŒãŒèµ·ã“ã‚Šã¾ã—ãŸã€‚ ã“ã®ã‚ˆã†ãªå•é¡ŒãŒè¨å®šã§å›žé¿å¯èƒ½ã‹ã€ ã”教示ã„ãŸã ã‘ã¾ã™ã§ã—ょã†ã‹ã€‚ 構æˆï¼š ZooKeeper用サーãƒï¼ˆZooKeeper） 1å° Masterサーãƒï¼ˆNameNode, JobTracker, HBaseMaster） 1å° Slaveサーãƒï¼ˆDataNode, TaskTracker, HRegionServer） 6å° 1å°ã®Slaveサーãƒã«ç™ºç”Ÿã—ãŸå•é¡Œï¼š Slaveã®ã†ã¡1å°ã ã‘〠Masterã‹ã‚‰ã®pingã®å¿œç”ãŒã€0.45ms ã»ã©ã‹ã‹ã£ã¦ã„ã‚‹ã“ã¨ã‚’確èªã—ã¾ã—ãŸã€‚ ä»–ã®Slaveã¸ã®pingã®å¿œç”ã¯ã€0.15ms ã§ã€ç´„3å€
分散データベース「HBaseã€ã®å®‰å®šé‹ç”¨ã‚’目指ã—㦠- Preferred Networks Research & Development
1年経ã£ã¦iPhone4ã®é›»æ± ãŒãƒ˜ã‚¿ã£ã¦ããŸã€å¤ªç”°ã§ã™ã€‚ 指数関数的ã«ã‚¨ãƒ³ãƒˆãƒªæ•°ãŒå°‘ãªããªã£ã¦ããŸæœ¬ãƒ–ãƒã‚°ã§ã™ãŒwã€æ™¯æ°—付ã‘ã®ãŸã‚ã«ã‚¨ãƒ³ãƒˆãƒªã‚’投稿ã—ãŸã„ã¨æ€ã„ã¾ã™ï¼æœ¬æ—¥ã¯HBaseã«ã¤ã„ã¦ã§ã™ã€‚ Linux 㨠Hadoop 㨠HBase 㨠ZooKeeper ã«è©³ã—ã„ã‚ãªãŸï¼ã‚ãªãŸãŒã‚¿ãƒ¼ã‚²ãƒƒãƒˆã§ã™ã€‚ HBaseã¨ã¯? HBaseã¨ã¯ã€HDFS (Hadoop Distributed File System)上ã«æ§‹ç¯‰ã•ã‚ŒãŸåˆ†æ•£ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã§ã™ã€‚大é‡ã®éžå¸¸ã«ç´°ã‹ã„データをリアルタイムã«èªã¿æ›¸ã出æ¥ã‚‹ã®ãŒç‰¹å¾´ã§ã™ã€‚最近ã§ã¯Facebook Messageã®åŸºç›¤æŠ€è¡“ã¨ã—ã¦ä½¿ç”¨ã•ã‚ŒãŸäº‹ã§æ³¨ç›®ã‚’集ã‚ã¦ã„ã¾ã™ã€‚ HBaseå…¬å¼ã‚µã‚¤ãƒˆ Apache HBase ブック ä¿å˜ã•ã‚ŒãŸãƒ‡ãƒ¼ã‚¿ã¯HDFS上ã«ä¿å˜ã•ã‚Œã€HDFSã®ä»•çµ„ã¿ã«ã‚ˆã£ã¦ãƒ¬ãƒ—リケーションã•ã‚Œã‚‹ãŸã‚安全ã«ãƒ‡ãƒ¼ã‚¿ã‚’ä¿æŒã™ã‚‹ã“ã¨ãŒå‡ºæ¥ã¾ã™ã€‚ ã¾
Hive/HBaseIntegration - Hadoop Wiki
Introduction This page documents the Hive/HBase integration support originally introduced in HIVE-705. This feature allows Hive QL statements to access HBase tables for both read (SELECT) and write (INSERT). It is even possible to combine access to HBase tables with native Hive tables via joins and unions. A presentation is available from the HBase HUG10 Meetup This feature is a work in progress,
Apache HBase 入門 (第３回）
Apache HBase 入門 (第３回） Big Data ã®ãŸã‚ã® Hadoop データベース by Tatsuya Kawano <http://twitter.com/tatsuya6502> Hadoop ソースコードリーディング æ±äº¬, #4, 2010å¹´8月17æ—¥ 2010å¹´8月17æ—¥ç«æ›œæ—¥ [ ]自己紹介 Twitter: @tatsuya6502 証券会社㮠グãƒãƒ¼ãƒãƒ« IT部門ã«å‹¤å‹™ シニア Java / Scala デベãƒãƒƒãƒ‘ー å€‹äººç ”ç©¶ã¨ã—ã¦ã€2009年秋ã‹ã‚‰ HBase ã‚’è©•ä¾¡ä¸ ã‚°ãƒ©ãƒ•ã‚£ãƒƒã‚¯ãƒ‡ã‚¶ã‚¤ãƒŠãƒ¼ã§ã‚‚ã‚ã‚‹ ニューヨークã®ç¾Žå¤§ Pratt Institute ã‚’å’æ¥ã— æ•°å¹´é–“ã€ç¾åœ°ã‚¢ãƒ¡ãƒªã‚«ä¼æ¥ã«å‹¤å‹™ HBase エãƒãƒ³ã‚¸ã‚§ãƒªã‚¹ãƒˆï¼ 2010å¹´8月17æ—¥ç«æ›œæ—¥ [ ]内容 HBase 㨠Cassandra ̶ トレードオフをç†è§£ã™ã‚‹ï¼ˆç¶šã） Map Redu
Apache HBase 入門 (第２回)
This document appears to be test results from running the Yahoo! Cloud Serving Benchmark on a system. It includes performance metrics like request latency distributions and throughput for different request sizes and concurrency levels. Various graphs and tables are presented showing results from multiple benchmark runs. The benchmark was run to test the performance of the system for serving reques
Apache HBase 入門 (第１回)
The document discusses big data and Hadoop concepts. It covers Hadoop operations like put, get, scan, filter, delete as well as join and group by. It also discusses the different types of data access patterns like random write, sequential read, sequential write and random read. The document focuses on big data, Hadoop operations, and data access patterns.Read less
Facebook Messaging - HBase Comes of Age
Update: I want to thank Ben Black, Todd Lipcon, and Kelley Reynolds for pointing out the inaccuracies in the original post. I’ve gone through the references they provided and made corrections. Facebook, the data giant of the internet, recently unveiled a new messaging system. To be fair, I would normally ignore feature roll outs and marketing flimflam, but Facebook’s announcement is worthy of atte
FacebookãŒæ–°ã‚µãƒ¼ãƒ“スã®åŸºç›¤ã«ã—ãŸã®ã¯ã€MySQLã§ã‚‚Cassandraã§ã‚‚ãªãã€HBaseã ã£ãŸ
FacebookãŒ15æ—¥ã«ç™ºè¡¨ã—ãŸæ–°ã—ã„サービス「Facebook Messagesã€ã¯ã€ãƒãƒ£ãƒƒãƒˆã‚„ã¤ã¶ã‚„ãã€ãã—ã¦é›»åメールãªã©ã€è‡ªåˆ†å®›ã®ãƒ†ã‚ストやメッセージをã™ã¹ã¦1ã¤ã®ã‚¤ãƒ³ãƒœãƒƒã‚¯ã‚¹ã§ç®¡ç†ã§ãã‚‹ã¨ç™ºè¡¨ã•ã‚Œã¾ã—ãŸã€‚ åŒç¤¾ãŒ15カ月ã‹ã‘ã¦é–‹ç™ºã—ã¦ããŸã“ã®æ–°ã‚µãƒ¼ãƒ“スã®ãƒãƒƒã‚¯ã‚¨ãƒ³ãƒ‰ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã¯ã€ã“ã‚Œã¾ã§åŒç¤¾ãŒå¤§è¦æ¨¡é‹ç”¨ã—ã¦ããŸMySQLã§ã‚‚ã€åŒç¤¾ãŒé–‹ç™ºã—ãŸNoSQLデータベースã®Cassandraã§ã‚‚ãªãã€ã‚°ãƒ¼ã‚°ãƒ«ã®BigTableをモデルã¨ã—ã¦ã‚ªãƒ¼ãƒ—ンソースã§é–‹ç™ºã•ã‚ŒãŸåˆ†æ•£ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã€ŒHBaseã€ã§ã—ãŸã€‚ Facebookã®ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã€Kannan Muthukkaruppanæ°ãŒFacebookã«ãƒã‚¹ãƒˆã—ãŸè¨˜äº‹ã€ŒThe Underlying Technology of Messagesã€ã§ã€ãã®æŠ€è¡“的背景ãŒç´¹ä»‹ã•ã‚Œã¦ã„ã¾ã™ã€‚ MySQLã¨CassandraãŒè½é¸ã—ãŸç†ç”± H
Cassandraã¨HBaseã®æ¯”較ã—ã¦å…¥é–€ã™ã‚‹NoSQL
第10回Cassandra勉強会ã«ã¦ç™ºè¡¨ã—ãŸã‚¹ãƒ©ã‚¤ãƒ‰ã«ã€å‹‰å¼·ä¼šå¾Œã®ãƒ•ã‚£ãƒ¼ãƒ‰ãƒãƒƒã‚¯ã‚’åæ˜ ã•ã›ãŸç‰©ã§ã™ã€‚Read less
第1回HBaseã¨Cassandra討論会
ICHIRO SATOH @ichiro_satoh 分散システム屋的ã«ã¯Vector Clockã¯å®Ÿã‚·ã‚¹ãƒ†ãƒ ã§ã¯ä½¿ãˆãªã„ã¨ã„ã†ã€ã‚ˆã知られãŸçµŒé¨“則ãŒã‚ã‚Šã¾ã—ã¦ï¼ˆã‚¹ã‚±ãƒ¼ãƒ«ã—ãªã„ã‚“ã§ã™ã‚ˆï¼‰RT @shot6: ã¡ãªã¿ã«Cassandraã§æŽ¡ç”¨ã—よã†ã¨ã—ã¦ã„ã‚‹ã®ã¯Vector Clockã§ã¯ãªãVersioned Clockãªã®ã§ã£ã™ã€‚
[email protected] - Cassandra versus HBase performance study
Hi folks, We have been conducting a performance study comparing Cassandra and HBase (and Yahoo! PNUTS and MySQL) on identical hardware under identical workloads. Our focus has been on serving workloads (e.g. read and write individual records, rather than scan a whole table for MapReduce.) This is part of a larger effort to develop a benchmark for these kinds of systems (which we are calling YCSB,
Legacy Communities - IBM Community
If you’re looking for a developerWorks forum — Don't panic! You are in the right place. You are here because specific IBM developerWorks forums, blogs and other Connections content have been decommissioned. This page will help you find the content you are looking for, get answers to your questions, and find a new community to call home. Where am I? You are on the IBM Community area, a collection o
And now for something a little different: graphviz candy at Netuality
No self-respecting geek can resist either of these incredible temptations: Correct something wrong on “the internets†Produce a little bit of graphviz candy (what a fantastic tool) Imagine my total happiness discovering that I can exercise both of them simultaneously. I can only thank Digg’s John Quinn for creating the opportunity in his otherwise very interesting presentation, by including this d
Hbaseã®ã‚ャッシュè¨å®šã«ã¤ã„ã¦ã®Twitterã®ãƒã‚° - Guutaraã®æ—¥è¨˜
Twitterã§ã€@tatsuya6502(Tatsuya Kawano (@tatsuya6502) | Twitter)ã•ã‚“ãŒã€è‰²ã€…ã€æ•™ãˆã¦ãã‚Œã¦ã„ãŸã®ã§ æ®ç™ºæ€§ã®é 脳ã¨ã—ã¦ã¯ã€å¿˜å‚™éŒ²ã¨ã—ã¦æ›¸ã„ã¦ãŠã‹ãªãã¦ã¯ã€‚。 補足：http://jp.hmaster.info/ã§ã€è‰²ã€…ãªè³‡æ–™ã‚’公開ã•ã‚Œã¦ã„ã¾ã™ã€‚ 最åˆã¯ã€ã‚ャッシュè¨å®šã®ä¾‹ã‚’æ•™ãˆã¦ãã‚Œã¦ã„ãŸã€‚ tatsuya6502. @yutuki_r 今æœã® HBase ã®ã‚ャッシュ関連ã®ä»¶ã§ã™ãŒã€åƒ•ã®ãŠã™ã™ã‚ã®åŸºæœ¬è¨å®šã‚’æ•™ãˆã¾ã™ ( 2010-04-23 01:04:50 )tatsuya6502. @yutuki_r ã¾ãšã€hbase-env.shã§ã€ HBASE_HEAPSIZEを最低ã§ã‚‚2000ã«è¨å®šã—ã¦ãã ã•ã„。ã“ã‚Œã«ã‚ˆã‚Šã€-XX:+UseConcMarkSweepGCãŒæœ‰åŠ¹ã«åƒã„ã¦ã€ã‚¬ãƒ™ãƒ¼ã‚¸ã‚³ãƒ¬ã‚¯ã‚·ãƒ§ãƒ³ã®å½±éŸ¿ã‚’å—ã‘ã«ãããªã‚Šã¾ã™ (
KeyValueストア - LunaBiblos
ã“ã®ãƒšãƒ¼ã‚¸ã®æœ€çµ‚更新㯠2009å¹´10月15æ—¥ (木) 09:45 ã«è¡Œã‚ã‚Œã¾ã—ãŸã€‚ ã“ã®ãƒšãƒ¼ã‚¸ã¯ 214 回アクセスã•ã‚Œã¾ã—ãŸã€‚ プライãƒã‚·ãƒ¼ãƒ»ãƒãƒªã‚·ãƒ¼ LunaBiblosã«ã¤ã„㦠å…è²¬äº‹é …
1
ãŠçŸ¥ã‚‰ã›
ランã‚ング
ランã‚ング
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
Twitter, Pig, and HBase. For Bay Area Hadoop User Group May 2010 | PDF | Apache Hadoop | Database Index
https://www.docstoc.com/docs/7493304/HBase-Goes-Realtime/
{{#tags}}- {{label}}
{{/tags}}