HBase at LINE
1. HBase at LINE ~ How to grow our storage together with service ~ ä¸æ‘ 俊介, Shunsuke Nakamura (LINE, twitter, facebook: sunsuk7tp) NHN Japan Corp. 2. 自己紹介 ä¸æ‘ 俊介 • 2011.10 æ—§ Japanæ–°å’入社 (2012.1ã‹ã‚‰ Japan) • LINE server engineer, storage team • Master of Science@æ±å·¥å¤§é¦–è—¤ç ” • Distributed Processing, Cloud Storage, and NoSQL • MyCassandra [CASSANDRA-2995]: A modular NoSQL with Pluggable Storage Engine based on
LINE Storage: Storing billions of rows in Sharded-Redis and HBase per Month « NAVER Engineers' Blog
Hi, I’m Shunsuke Nakamura (@sunsuk7tp). Just half a year ago, I completed the Computer Science Master’s program in Tokyo Tech and joined to NHN Japan as a member of LINE server team. My ambition is to hack distributed processing and storage systems and develop the next generation’s architecture. In the LINE server team, I’m in charge of development and operation of the advanced storage system whi
Apache Goraâ„¢ - Welcome to Apache Goraâ„¢
The Apache Goraâ„¢ open source framework provides an in-memory data model and persistence for big data. Gora supports persisting to column stores, key value stores, document stores, distributed in-memory key/value stores, in-memory data grids, in-memory caches, distributed multi-model stores, and hybrid in-memory architectures. Gora also enables analysis of data with extensive Apache Hadoop MapReduc
storage infrastructure behind facebook messages
Storage Infrastructure Behind Facebook Messages HBase/HDFS/ZK/MapReduce Kannan Muthukkaruppan Software Engineer, Facebook Big Data Experiences & Scars, HPTS 2011 Oct 24th, 2011 The New Facebook Messages Emails Chats SMS Messages Why we chose HBase â–ª High write throughput â–ª Good random read performance â–ª Horizontal scalability â–ª Automatic Failover â–ª Strong consistency â–ª Benefits of HDFS â–ª Fault tol
分散データベース「HBaseã€ã®å®‰å®šé‹ç”¨ã‚’目指ã—㦠- Preferred Networks Research & Development
1年経ã£ã¦iPhone4ã®é›»æ± ãŒãƒ˜ã‚¿ã£ã¦ããŸã€å¤ªç”°ã§ã™ã€‚ 指数関数的ã«ã‚¨ãƒ³ãƒˆãƒªæ•°ãŒå°‘ãªããªã£ã¦ããŸæœ¬ãƒ–ãƒã‚°ã§ã™ãŒwã€æ™¯æ°—付ã‘ã®ãŸã‚ã«ã‚¨ãƒ³ãƒˆãƒªã‚’投稿ã—ãŸã„ã¨æ€ã„ã¾ã™ï¼æœ¬æ—¥ã¯HBaseã«ã¤ã„ã¦ã§ã™ã€‚ Linux 㨠Hadoop 㨠HBase 㨠ZooKeeper ã«è©³ã—ã„ã‚ãªãŸï¼ã‚ãªãŸãŒã‚¿ãƒ¼ã‚²ãƒƒãƒˆã§ã™ã€‚ HBaseã¨ã¯? HBaseã¨ã¯ã€HDFS (Hadoop Distributed File System)上ã«æ§‹ç¯‰ã•ã‚ŒãŸåˆ†æ•£ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã§ã™ã€‚大é‡ã®éžå¸¸ã«ç´°ã‹ã„データをリアルタイムã«èªã¿æ›¸ã出æ¥ã‚‹ã®ãŒç‰¹å¾´ã§ã™ã€‚最近ã§ã¯Facebook Messageã®åŸºç›¤æŠ€è¡“ã¨ã—ã¦ä½¿ç”¨ã•ã‚ŒãŸäº‹ã§æ³¨ç›®ã‚’集ã‚ã¦ã„ã¾ã™ã€‚ HBaseå…¬å¼ã‚µã‚¤ãƒˆ Apache HBase ブック ä¿å˜ã•ã‚ŒãŸãƒ‡ãƒ¼ã‚¿ã¯HDFS上ã«ä¿å˜ã•ã‚Œã€HDFSã®ä»•çµ„ã¿ã«ã‚ˆã£ã¦ãƒ¬ãƒ—リケーションã•ã‚Œã‚‹ãŸã‚安全ã«ãƒ‡ãƒ¼ã‚¿ã‚’ä¿æŒã™ã‚‹ã“ã¨ãŒå‡ºæ¥ã¾ã™ã€‚ ã¾
[HBASE-3529] Add search to HBase - ASF JIRA
Using the Apache Lucene library we can add freetext search to HBase. The advantages of this are: HBase is highly scalable and distributed HBase is realtime Lucene is a fast inverted index and will soon be realtime (see LUCENE-2312) Lucene offers many types of queries not currently available in HBase (eg, AND, OR, NOT, phrase, etc) It's easier to build scalable realtime systems on top of already ar
Outerthought :: Lily - the Scalable Content Repository
What is Lily? Lily does Smart Data, at Scale. Lily is the first Big Data content storage and search repository, built on top of Apache HBase and SOLR. It is made available under the Apache license by Outerthought. Lily is a scalable foundation for large-scale content applications, such as SaaS-style content management, archiving, media publishing, and document management. It offers a flexible data
PerformanceTuning - HADOOP2 - Apache Software Foundation
Powered by a free Atlassian Confluence Open Source Project License granted to Apache Software Foundation. Evaluate Confluence today. Powered by Atlassian Confluence 7.19.25 Printed by Atlassian Confluence 7.19.25 Report a bug Atlassian News
åˆå¤œä¸‰çº§ç†è®ºåœ¨çº¿è§‚看,ä¸å¡ä¸æ–‡å—幕ä¸æ–‡æ— ç ,开心婷婷ä¸æ–‡å—幕,欧美喷潮最猛CYTHEREA
åˆå¤œä¸‰çº§ç†è®ºåœ¨çº¿è§‚看,ä¸å¡ä¸æ–‡å—幕ä¸æ–‡æ— ç ,开心婷婷ä¸æ–‡å—幕,欧美喷潮最猛CYTHEREA,产精å“视频在线观å…è´¹,乱女å°èŠ³å…¨é›†ç¬¬ä¸€ç« ,æ—¥æœ¬æ— ç 一区二区三区avå…è´¹
Hadoopã€hBaseã§æ§‹ç¯‰ã™ã‚‹å¤§è¦æ¨¡åˆ†æ•£ãƒ‡ãƒ¼ã‚¿å‡¦ç†ã‚·ã‚¹ãƒ†ãƒ ：CodeZine
ã¯ã˜ã‚ã«ã€€ã“ã®é€£è¼‰ã§ã¯ã€å¤§è¦æ¨¡åˆ†æ•£è¨ˆç®—フレームワーク「Hadoopã€ã¨ã€ãã®ä¸Šã«ã¤ãられãŸå¤§è¦æ¨¡åˆ†æ•£ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã€ŒhBaseã€ã®ä»•çµ„ã¿ã¨ç°¡å˜ãªã‚µãƒ³ãƒ—ルアプリケーションを紹介ã—ã¾ã™ã€‚Hadoopã¨hBaseã¯ã€Googleã®åŸºç›¤ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã®ã‚ªãƒ¼ãƒ—ンソースクãƒãƒ¼ãƒ³ã§ã™ã€‚機能やコンセプトã«ã¤ã„ã¦ã¯ã€GoogleãŒç™ºè¡¨ã—ã¦ã„ã‚‹å¦è¡“è«–æ–‡ã«ä¾ã£ã¦ã„ã¾ã™ã€‚　ã“れらã®å¦è¡“è«–æ–‡ã«ã‚ˆã‚‹ã¨ã€Googleã§ã¯å¤§è¦æ¨¡åˆ†æ•£ãƒ•ã‚¡ã‚¤ãƒ«ã‚·ã‚¹ãƒ†ãƒ 「Google File Systemã€ã€å¤§è¦æ¨¡åˆ†æ•£è¨ˆç®—フレームワーク「MapReduceã€ã€å¤§è¦æ¨¡åˆ†æ•£ãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã€ŒBigTableã€ã€åˆ†æ•£ãƒãƒƒã‚¯ã‚µãƒ¼ãƒ“ス「Chubbyã€ã¨ã„ã†4ã¤ã®ã‚¤ãƒ³ãƒ•ãƒ©ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ãŒä½¿ã‚ã‚Œã¦ã„ã¾ã™ã€‚ 図1ã«Googleã®åŸºç›¤æŠ€è¡“é–“ã®ä¾å˜é–¢ä¿‚ã€ãã—ã¦ãã‚Œã«å¯¾å¿œã™ã‚‹OSSã®å¯¾å¿œé–¢ä¿‚を示ã—ã¾ã—ãŸã€‚ã¾ãšã¯å¯¾å¿œã™ã‚‹Googleã®åŸºç›¤æŠ€è¡“ãã‚Œãžã‚Œã®æ©Ÿèƒ½ã‚„特徴をã–ã£ãã‚Šã¨
1
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
[HBASE-1730] Near-instantaneous online schema and table state updates - ASF JIRA
Tokyo HBase Meetup - Realtime Big Data at Facebook with Hadoop and HBase (ja)
The Underlying Technology of Messages Tech Talk (12/7/10) | The engineering team behind Facebook Messages spent the past year building out a robust, scalable infrastructure. We shared some details about the... | By Engineering at Meta | Facebook
{{#tags}}- {{label}}
{{/tags}}