Kafka, HBase, SparkStreamingã«ã‚ˆã‚‹å¤§è¦æ¨¡æƒ…å ±åŽé›†è§£æž
DMMã®ãƒ“ッグデータåŽé›†ã®ã”紹介
Kafka, HBase, SparkStreamingã«ã‚ˆã‚‹å¤§è¦æ¨¡æƒ…å ±åŽé›†è§£æž
Kuduリリースï¼
オープンソースã®æ–°ã—ã„ストレージエンジンã€Kudu ã¤ã„ã«æœ¬æ—¥ã‚¢ãƒŠã‚¦ãƒ³ã‚¹ã•ã‚ŒãŸ Kudu (クドゥ）ã€æ¬¡ä¸–代ãƒãƒ¼ãƒ‰ã‚¦ã‚§ã‚¢ã«ã‚‚対応ã™ã‚‹ã‚ªãƒ¼ãƒ—ンソースã®ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã‚¨ãƒ³ã‚¸ãƒ³ã§ã™ã€‚ã¾ã ベータ版ã§ã™ãŒã€3å¹´ã‚‚ã®é–‹ç™ºæœŸé–“を経ã¦ã¤ã„ã«å…¬é–‹ã•ã‚Œã¾ã—ãŸï¼ Super excited to finally talk about what I've been working on the last 3 years: Kudu! http://t.co/1W4sqFBcyH http://t.co/1mZCwgdOO5 — Todd Lipcon (@tlipcon) September 28, 2015 æ•°æ—¥å‰ã«ãƒªãƒ¼ã‚¯ã•ã‚ŒãŸè¨˜äº‹ã«ã€ŒKuduã¯HDFSã‚„HBaseã‚’ç½®ãæ›ãˆã‚‹ã‚‚ã®ã ã€ã¨æ›¸ã‹ã‚Œã¦ã„ã¾ã—ãŸãŒã€ãã‚Œã¯é–“é•ã„ã§ã™ã€‚詳細ã¯FAQãªã©ã«ã‚‚書ã‹ã‚Œã¦ã„ã¾ã™ãŒã€HDFSã¨HBaseを補ã†æ–°ã—ã„ストレージエンジンã§ã™
FacebookãŒHBaseを大è¦æ¨¡ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ 処ç†ã«åˆ©ç”¨ã—ã¦ã„ã‚‹ç†ç”±ï¼ˆå¾Œç·¨ï¼‰
Facebookã¯å¤§è¦æ¨¡ãªãƒ‡ãƒ¼ã‚¿å‡¦ç†ã®åŸºç›¤ã¨ã—ã¦HBaseを利用ã—ã¦ã„ã¾ã™ã€‚ãªãœFacebookã¯HBaseを用ã„ã¦ã„ã‚‹ã®ã‹ã€ã©ã®ã‚ˆã†ã«åˆ©ç”¨ã—ã¦ã„ã‚‹ã®ã§ã—ょã†ã‹ï¼Ÿ 7月1æ—¥ã«éƒ½å†…ã§è¡Œã‚ã‚ŒãŸå‹‰å¼·ä¼šã§ã€Facebookã®ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã§ã‚るジョナサン・グレイ（Jonathan Gray）æ°ã«ã‚ˆã‚‹è§£èª¬ãŒè¡Œã‚ã‚Œã¾ã—ãŸã€‚ ã“ã®è¨˜äº‹ã¯ã€ã€ŒFacebookãŒHBaseを大è¦æ¨¡ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ 処ç†ã«åˆ©ç”¨ã—ã¦ã„ã‚‹ç†ç”±ï¼ˆå‰ç·¨ï¼‰ã€ã®ç¶šãã§ã™ã€‚ 事例1 Titan（Facebookメッセージ） HBaseãŒFacebookã§ã©ã®ã‚ˆã†ãªã‚¢ãƒ—リケï¼ã‚·ãƒ§ãƒ³ã§ä½¿ã‚ã‚Œã¦ã„ã‚‹ã®ã‹ã‚’紹介ã—よã†ã€‚ Facebookã®æ–°ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸æ©Ÿèƒ½ã€‚
FacebookãŒHBaseを大è¦æ¨¡ãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ 処ç†ã«åˆ©ç”¨ã—ã¦ã„ã‚‹ç†ç”±ï¼ˆå‰ç·¨ï¼‰
Facebookã¯å¤§è¦æ¨¡ãªãƒ‡ãƒ¼ã‚¿å‡¦ç†ã®åŸºç›¤ã¨ã—ã¦HBaseを利用ã—ã¦ã„ã¾ã™ã€‚ãªãœFacebookã¯HBaseを用ã„ã¦ã„ã‚‹ã®ã‹ã€ã©ã®ã‚ˆã†ã«åˆ©ç”¨ã—ã¦ã„ã‚‹ã®ã§ã—ょã†ã‹ï¼Ÿ 7月1æ—¥ã«éƒ½å†…ã§è¡Œã‚ã‚ŒãŸå‹‰å¼·ä¼šã§ã€Facebookã®ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ã§ã‚るジョナサン・グレイ（Jonathan Gray）æ°ã«ã‚ˆã‚‹è§£èª¬ãŒè¡Œã‚ã‚Œã¾ã—ãŸã€‚ 解説ã¯ã»ã¼ã‚¹ãƒ©ã‚¤ãƒ‰ã®å†…容ãã®ã¾ã¾ã§ã—ãŸã€‚当日使ã‚ã‚ŒãŸæ—¥æœ¬èªžè¨³ã•ã‚ŒãŸã‚¹ãƒ©ã‚¤ãƒ‰ãŒå…¬é–‹ã•ã‚Œã¦ã„ã‚‹ã®ã§ã€ãƒã‚¤ãƒ³ãƒˆã¨ãªã‚‹ãƒšãƒ¼ã‚¸ã‚’紹介ã—ã¾ã—ょã†ã€‚ Realtime Apache Hadoop at Facebook ãªãœãƒªã‚¢ãƒ«ã‚¿ã‚¤ãƒ データã®åˆ†æžã«ã€Hadoop/HBaseを使ã†ã®ã‹ï¼Ÿ MySQLã¯å®‰å®šã—ã¦ã„ã‚‹ãŒã€åˆ†æ•£ã‚·ã‚¹ãƒ†ãƒ ã¨ã—ã¦è¨è¨ˆã•ã‚Œã¦ãŠã‚‰ãšã€ã‚µã‚¤ã‚ºã«ã‚‚上é™ãŒã‚る。一方ã€Hadoopã¯ã‚¹ã‚±ãƒ¼ãƒ©ãƒ–ルã ãŒãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°ãŒé›£ã—ãã€ãƒ©ãƒ³ãƒ€ãƒ ãªæ›¸ãè¾¼ã¿ã‚„èªã¿è¾¼ã¿ã«å‘ã„ã¦ã„ãªã„。 Faceb
Outerthought :: Lily - the Scalable Content Repository
What is Lily? Lily does Smart Data, at Scale. Lily is the first Big Data content storage and search repository, built on top of Apache HBase and SOLR. It is made available under the Apache license by Outerthought. Lily is a scalable foundation for large-scale content applications, such as SaaS-style content management, archiving, media publishing, and document management. It offers a flexible data
第1回HBaseã¨Cassandra討論会
ICHIRO SATOH @ichiro_satoh 分散システム屋的ã«ã¯Vector Clockã¯å®Ÿã‚·ã‚¹ãƒ†ãƒ ã§ã¯ä½¿ãˆãªã„ã¨ã„ã†ã€ã‚ˆã知られãŸçµŒé¨“則ãŒã‚ã‚Šã¾ã—ã¦ï¼ˆã‚¹ã‚±ãƒ¼ãƒ«ã—ãªã„ã‚“ã§ã™ã‚ˆï¼‰RT @shot6: ã¡ãªã¿ã«Cassandraã§æŽ¡ç”¨ã—よã†ã¨ã—ã¦ã„ã‚‹ã®ã¯Vector Clockã§ã¯ãªãVersioned Clockãªã®ã§ã£ã™ã€‚
Hadoopソースコードリーディング第3回 ãƒãƒƒã‚·ãƒ¥ã‚¿ã‚°ã¾ã¨ã‚
Tatsuya Kawano @tatsuya6502 今日ã¯ãƒ¨ãƒ¡ã•ã‚“ã«ãŠé¡˜ã„ã—ã¦ã€è‚²å…ã¨å®¶äº‹ã‚’åŠæ—¥ãŠä¼‘ã¿ã€‚近所ã®ã‚«ãƒ•ã‚§ã§ã€ #hadoopreading ã®ã‚¹ãƒ©ã‚¤ãƒ‰ä½œæˆã€‚連続作æ¥æ™‚é–“ãŒï¼‘時間を超ãˆã‚‹ã¨ãƒšãƒ¼ã‚¹ãŒæ•°å€ã«ä¸ŠãŒã‚‹ã€‚ã¯ã‹ã©ã‚‹ã€ã¯ã‹ã©ã‚‹ ♬ Tatsuya Kawano @tatsuya6502 #hadoopreading 明日（6/28）ã®ãƒ—レゼン資料ã®ãƒ‰ãƒ©ãƒ•ãƒˆç‰ˆãŒã§ãã¾ã—ãŸã€‚ã‚‚ã†å°‘ã—ä¿®æ£ã™ã‚‹äºˆå®šã§ã™ãŒã€ç¾æ™‚点ã§ã„ã£ãŸã‚“公開ã—ã¾ã™ã€‚ Cassandra ã«ã¤ã„ã¦ã¯è©³ã—ããªã„ã®ã§ã€é–“é•ã„ãªã©ã‚ã‚Œã°ã”指摘ã„ãŸã ã‘ã‚‹ã¨å¬‰ã—ã„ã§ã™ã€‚ http://ow.ly/23Ka4
ã¸ã€œãŸã®ã‚ã‚‚:Riak 㨠Cassandra 㨠HBaseã€ã‚らã¾ãƒ¼! - livedoor Blog（ブãƒã‚°ï¼‰
2010å¹´05月25æ—¥ Riak 㨠Cassandra 㨠HBaseã€ã‚らã¾ãƒ¼! Mozilla Blog Riak and Cassandra and HBase, Oh My!ã®å‹æ‰‹è¨³ã€‚å„分散 KVS ã®ç‰¹å¾´ãŒåˆ†æžã•ã‚Œã¦ã„ã¦èˆˆå‘³æ·±ã„……ã¨æ€ã£ã¦è¨³ã—ã¦ã¿ãŸã€‚ã“ã®ç„¡æ§˜ãªã‚¿ã‚¤ãƒˆãƒ«ã¯ Google 翻訳ã«ã‚ˆã‚‹ã€‚ Riak 㨠Cassandra 㨠HBaseã€ã‚らã¾ãƒ¼! 我々ã¯ã€SoCorro Crash プãƒã‚¸ã‚§ã‚¯ãƒˆã«ãŠã„㦠HBase ã¨ã®çµ±åˆã‚’進ã‚ã¦ã„ã‚‹ãŒã€ãã®è©±ã¯ã¡ã‚‡ã£ã¨ç½®ã„ã¦ãŠã„ã¦ã€ä»Šå›žã¯ãƒ¡ãƒˆãƒªãƒƒã‚¯ãƒ»ãƒãƒ¼ãƒ ãŒå·»ãè¾¼ã¾ã‚Œã¦ã„る別ã®ãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã«ã¤ã„ã¦è©±ã‚’ã—よã†ã€‚ Mozilla Labs Test Pilotã¯ã€å®Ÿä¸–界㮠Firefox ユーザをã‹ã‚‰é›†ã‚ãŸãƒ‡ãƒ¼ã‚¿ã‚’分æžã—ã¦ã€ãƒ¦ãƒ¼ã‚¶ãƒ»ã‚¨ã‚¯ã‚¹ãƒšãƒªã‚¨ãƒ³ã‚¹ã‚’å‘上ã•ã›ã‚‹ãŸã‚ã®å®Ÿé¨“ã‚’ã—ãŸã‚Šã€å®šé‡çš„データを集ã‚ãŸã‚Šã™ã‚‹ãŸã‚ã®ãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã 。 ç§
Arbitrarily anything...: Comparing PNUTS, HBase and Cassandra
Tuesday, May 18, 2010 Comparing PNUTS, HBase and Cassandra A lot of NoSQL systems have been sprouting up recently and an increasing number of people are using NoSQL data stores and moving away from RDBMS systems. There's nothing wrong with relational database systems but they are optimized for certain use cases, which they handle very well. NoSQL systems (Bigtable, Dynamo, PNUTS, CouchDB, MongoDB,
HBase vs Cassandra: why we moved
Occasionally useful posts about RIAs, Web scale computing & miscellanea My team is currently working on a brand new product – the forthcoming MMO www.FightMyMonster.com. This has given us the luxury of building against a NOSQL database, which means we can put the horrors of MySQL sharding and expensive scalability behind us. Recently a few people have been asking why we seem to have changed our pr
Pig, Cascalog & HBase Among Highlights of May Hadoop Meet-Up (Hadoop and Distributed Computing at Yahoo!)
YDN Hadoop and Distributed Computing at Yahoo! Pig, Cascalog & HBase Among Highlights of May Hadoop Meet-Up Hi Hadoopers Thanks to close to 300 developers who came this week to Yahoo! for our monthly Hadoop User Group meeting. The energy in the packed room was phenomenal and conversations continued long after the formal sessions. Hundreds of Hadoop Fans Flock to Yahoo! for the May Hadoop User Grou
Hadoopリンクã¾ã¨ã‚(1) - 科å¦ã¨éžç§‘å¦ã®è¿·å®®
Part1 / Part2 æ›´æ–°å±¥æ´ 2010/06/20 ãƒªãƒ³ã‚¯è¿½åŠ å…¥é–€ã€äº‹ä¾‹ç´¹ä»‹ã€ãƒ‹ãƒ¥ãƒ¼ã‚¹ Part2ã¸ç§»å‹• EC2ã€Pigã€MapReduceã€HDFS æ–°è¦è¿½åŠ 性能測定 å…¬å¼ Welcome to Apache Hadoop! 日本語訳 Hadoopユーザー会 Welcome to Hadoop MapReduce! "大è¦æ¨¡ãªè¨ˆç®—ノード・クラスタ上ã«ãŠã„ã¦è†¨å¤§ãªãƒ‡ãƒ¼ã‚¿ã‚’高速ã§ä¸¦åˆ—処ç†ã™ã‚‹ã‚¢ãƒ—リケーションを作æˆã™ã‚‹ãŸã‚ã®ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°ãƒ¢ãƒ‡ãƒ«ãŠã‚ˆã³ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ãƒ•ãƒ¬ãƒ¼ãƒ ワーク" Welcome to Pig! "大è¦æ¨¡ãªãƒ‡ãƒ¼ã‚¿ã‚»ãƒƒãƒˆã‚’分æžã™ã‚‹ãŸã‚ã®ãƒ—ラットフォーム""Pig ã®è¨€èªžãƒ¬ã‚¤ãƒ¤ã‚’構æˆã—ã¦ã„ã‚‹ã®ã¯ã€Pig Latin ã¨å‘¼ã°ã‚Œã‚‹ãƒ†ã‚ストベースã®è¨€èªž" wikipedia Apache Hadoop - Wikipedia, the free encyclopedia Apa
1
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
Socorro: Mozilla’s Crash Reporting System
NoSQL Case Study: Migrating to HBase/Hadoop to Handle Firefox Crash Reports at Mozilla
Good night, Posterous
{{#tags}}- {{label}}
{{/tags}}