GitHub - lordofthejars/nosql-unit: NoSQL Unit is a JUnit extension that helps you write NoSQL unit tests.
Unit testing is a method by which the smallest testable part of an application is validated. Unit tests must follow the FIRST Rules; these are Fast, Isolated, Repeatable, Self-Validated and Timely. It is strange to think about a JEE application without persistence layer (typical Relational databases or new NoSQL databases) so should be interesting to write unit tests of persistence layer too. When
JVM Operation Casual Talksã«å‚åŠ ã—ã¾ã—㟠#jvmcasual
JVM Operation Casual Talksã«å‚åŠ ã—ã¾ã—ãŸã€‚ ã‚ã‚“ã¾ã‚Šã€é‹ç”¨ã¨ã‹ã‚„ã£ã¦ãªã„ã®ã§ã€ã¤ã„ã¦ã„ã‘ã‚‹ã‹ä¸å®‰ã§ã™ãŒã€æ¥½ã—ãã†ã ã£ãŸã®ã§ã€‚ 懇親会ã¯äºˆå®šã•ã‚Œã¦ãªã„らã—ã„。 @stanaka 15分ã§ã‚ã‹ã‚‹JVMã®ãƒ¡ãƒ¢ãƒªç®¡ç† スライド：https://speakerdeck.com/stanaka/understanding-memory-management-of-javavm-in-15-minutes JVMã®åŸºç¤ŽçŸ¥è˜ æŸç ”究所ã§ã€‚。。 Elasticsearchã€Solrã®åå‰ãŒï¼ JVMå›°ã‚Šã©ã“ã‚。ãƒãƒƒãƒˆã®æƒ…å ±ãŒå¤ã„ã®ãŒå¤šã„ã¨ã‹ã€‚ 使ã„ã“ãªã™ã«ã¯ãã¡ã‚“ã¨çŸ¥è˜ãŒå¿…è¦ã€‚ Memory Model å›°ã£ãŸã‚‰Java8ã«ã€‚。。 Heapã®ãƒãƒ¥ãƒ¼ãƒ‹ãƒ³ã‚°ãŒé‡è¦ Heapã®æ§‹æˆã‚„GC処ç†ã®èª¬æ˜Ž CMSã§ã‚‚ã™ã¹ã¦ä¸¦åˆ—ã§ã¯ãªã„ OlgGenãŒãƒ•ãƒ©ã‚°ãƒ¡ãƒ³ãƒˆã—ã¦ç¢ºä¿ãŒé…ããªã£ã¦ã„ã G1GC
『cassandraé‹ç”¨ç›£è¦–å°ãƒã‚¿é›†ã€
ã¯ã˜ã‚ã¾ã—ã¦ã€‚サービスインフラã¨ã„ã†ãƒãƒ¼ãƒ ã«æ‰€å±žã—ã¦ã„ã‚‹@oranieã¨ç”³ã—ã¾ã™ã€‚å‰å›žã®å¼Šç¤¾ã€€ä½é‡Žã‹ã‚‰Cassandra芸人ã«ã‚ˆã‚‹ä»–ã®ãƒã‚¿ã‚‚・・・ã¨ã„ã†è©±ãŒã‚ã£ãŸã®ã§ã“れ幸ã„ã¨Cassandraãƒã‚¿ã§ãŠèŒ¶ã‚’æ¿ãã†ã¨æ€ã£ã¦ã„ã¾ã™ã€‚ãã‚‚ãã‚‚ä»–ã«ã‚‚ãƒã‚¿ã‚’æŒã£ã¦ã„るエンジニアãŒã„ã‚‹ä¸ã§åƒ•ã«åŸ·ç†ä¾é ¼ã‚’出ã™æ™‚点ã§ã€ãªã‚“ã¦ç¯€æ“ã®ç„¡ã„寛容ãªäººé”ã ã¨ãƒ“ックリã—ã¾ã—ãŸã€‚多分ダーツã‹ãªã‚“ã‹ã§æ±ºã‚ãŸã‚“ã ã¨æ€ã„ã¾ã™ã€‚ 入社以æ¥ã€ãªãœã‹å¼Šç¤¾ã§ãƒ‡ãƒ•ã‚¡ã‚¯ãƒˆã¨ã—ã¦ä½¿ã‚ã‚Œã¦ã„るデータストアã®MySQLã«ã‚‚ã»ã¨ã‚“ã©è§¦ã‚‰ãšã€ã²ãŸã™ã‚‰Cassandraé‹ç”¨ã¨ã‹ä»–ã«ã¯ä»•äº‹ãƒãƒ£ãƒƒãƒˆä¸Šã§ä¸€äººã ã‘å‹æ‰‹ã«ç››ã‚Šä¸Šã‚ãŒã£ã¦éº»å‘‚ã®AAを貼りã¤ã‘ãŸã‚Šç‰ã®ç¤¾å†…ピエãƒé›‘用をやã£ã¦ã„ã¾ã™ã€‚ãŠã‹ã’ã•ã¾ã§ã‚¨ã‚サイティングãªæ—¥ã€…を毎日é€ã‚‹äº‹ãŒå‡ºæ¥ãŸç‚ºã€é…’ã®é‡ãŒä¸€æ™‚期増ãˆãŸã®ã¨å¤šå°‘ã¯å°ãƒã‚¿ã‚’覚ãˆãŸã®ã§ã¾ã é‹ç”¨ã—ã¦ã„ãªã„æ–¹ã«å°‘ã—ã§ã‚‚é‹ç”¨ãƒ»ç›£è¦–周りã®ãŠå½¹ã«ç«‹ã¦ã‚Œã°å¹¸
ã“ã‚ŒãŒCassandra
3. ã‚·ã‚¹ãƒ†ãƒ æ§‹æˆ â€¢ Node数：97å° â€¢ サーãƒã‚¹ãƒšãƒƒã‚¯ 機器：Dell R410ã€R420 メモリ：64GB CPU:16コアã€24コア HDD：600GBx4 (RAID-10) 600GBx2(RAID-1)+SSD 512GB(RAID-0) • クラスタ数：1 • Cassandraã®ãƒãƒ¼ã‚¸ãƒ§ãƒ³ï¼š1.1.5-2(独自ãƒãƒ¼ã‚¸ãƒ§ãƒ³) • KeySpace数：8 • ColumnFamily数：156 4. é‹ç”¨çŠ¶æ³ã¨ã‹ Cluseter Writes Request: 32000/sec Cluseter Reads Request : 58000/sec 1 nodeã‚ãŸã‚Šã®ãƒ‡ãƒ¼ã‚¿ãƒãƒ¼ãƒ‰ã‚µã‚¤ã‚º ç´„200～230GB
Cassandra Data Modeling Best Practices, Part 1
This is the first in a series of posts on Cassandra data modeling, implementation, operations, and related practices that guide our Cassandra utilization at eBay. Some of these best practices we’ve learned from public forums, many are new to us, and a few still are arguable and could benefit from further experience. September 2014 Update: Readers should note that this article describes data modeli
Dealing With JVM Limitations in Apache Cassandra
A couple of most notable NoSQL databases targeting large scalable systems are written in Java: Cassandra, HBase, BigCouch. Then there’s also Hadoop. Plus a series of caching and data grid solutions like Terracotta, Gigaspaces. They are all facing the same challenge: tuning the JVM garbage collector for predictable latency and throughput. Jonathan Ellis’s slides presented at Fosdem 2012 are coverin
Cassandra Garbage Collection Tuning
Tweet Last week, I discussed our experiences with configuring Cassandra. As some of the commenters pointed out, my conclusions about the garbage collection were not fully accurate. I did some more experiments with different kinds of GC settings, which I will discuss in this post. On the bottom line, it is not that hard to get Cassandra run in a stable manner, but you still need a lot more heap spa
Benchmarking Cassandra Scalability on AWS
by Adrian Cockcroft and Denis Sheahan Netflix has been rolling out the Apache Cassandra NoSQL data store for production use over the last six months. As part of our benchmarking we recently decided to run a test designed to validate our tooling and automation scalability as well as the performance characteristics of Cassandra. Adrian presented these results at the High Performance Transaction Syst
Brisk - 低é…延アプリケーションã¨Hadoop/Hive分æžç”¨ã®Big-Dataプラットフォーãƒ
Spring Bootã«ã‚ˆã‚‹APIãƒãƒƒã‚¯ã‚¨ãƒ³ãƒ‰æ§‹ç¯‰å®Ÿè·µã‚¬ã‚¤ãƒ‰ 第2版 何åƒäººã‚‚ã®é–‹ç™ºè€…ãŒã€InfoQã®ãƒŸãƒ‹ãƒ–ック「Practical Guide to Building an API Back End with Spring Bootã€ã‹ã‚‰ã€Spring Bootを使ã£ãŸREST API構築ã®åŸºç¤Žã‚’å¦ã‚“ã 。ã“ã®æœ¬ã§ã¯ã€å‡ºç‰ˆæ™‚ã«æ–°ã—ãリリースã•ã‚ŒãŸãƒãƒ¼ã‚¸ãƒ§ãƒ³ã§ã‚ã‚‹ Spring Boot 2 を使用ã—ã¦ã„る。ã—ã‹ã—ã€Spring Boot3ãŒæœ€è¿‘リリースã•ã‚Œã€é‡è¦ãªå¤‰...
Enabling JNA in Apache Cassandra 0.6 | Paul Querna
What is it? Java Native Access is a library to provide access to native function calls on top of the JVM — from its website: JNA provides Java programs easy access to native shared libraries (DLLs on Windows) without writing anything but Java code—no JNI or native code is required. This functionality is comparable to Windows’ Platform/Invoke and Python’s ctypes. Access is dynamic at runtime withou
Riak and Cassandra and HBase, oh my! « Blog of Data
We are marching along in our integration of HBase with the Socorro Crash Stats project, but I wanted to take a minute away from that to talk about a separate project the Metrics team has also been involved with. Mozilla Labs Test Pilot is a project to experiment and analyze data from real world Firefox users to discover quantifiable ways to improve our user experience. I was very interested and e
How does HBase write performance differ from write performance in Cassandra with consistency level ALL?
Answer (1 of 3): While setting the a write consistency level of ALL with a read level of ONE in Cassandra provides a strong consistency model similar to what HBase provides (and in fact using quorum writes and reads would as well), the two operations are actually semantically different and lead t...
Facebook Messaging - HBase Comes of Age
Update: I want to thank Ben Black, Todd Lipcon, and Kelley Reynolds for pointing out the inaccuracies in the original post. I’ve gone through the references they provided and made corrections. Facebook, the data giant of the internet, recently unveiled a new messaging system. To be fair, I would normally ignore feature roll outs and marketing flimflam, but Facebook’s announcement is worthy of atte
第12回Cassandra勉強会å‚åŠ
データモデルãƒãƒƒã‚«ã‚½ãƒ³ã¨ã‚ã£ãŸã®ã§ã³ãã³ãã—ãªãŒã‚‰å‚åŠ ã—ã¾ã—ãŸã€‚ ä¼šå ´ 楽天タワー。 å‚åŠ è€…ã¯23人。MacãŒ5人ã€PCãŒ11人。紙ãŒ4人。 主催ã®å†¨ç”°ã•ã‚“ 今ã¾ã§RDBMSを使ã£ã¦ã„ãŸäººãŒCassandraã«ä¹—ã‚Šæ›ãˆã‚‹ã¨ãã®ãƒ‡ãƒ¼ã‚¿è¨è¨ˆã«ã¤ã„ã¦ã€‚ã„ã‚ã„ã‚é•ã†ã®ã§è‹¦åŠ´ã—ã¦ã„る。ã¿ã‚“ãªã©ã†ã‚„ã£ã¦ã‚‹ã®ã‹ã‚’èžããŸã„。 事å‰ã«ãŠé¡ŒãŒå‡ºã¦ã„ãŸã‚‰ã—ã„。Googleグループã®ãƒ¡ãƒ¼ãƒ«é…信を無効ã«ã—ã¦ã„ãŸã®ã§ã€è¦‹é€ƒã—ã¦ãŸãƒ»ãƒ»ãƒ»ã€‚ 西島ã•ã‚“ Cassandraã§ãƒã‚°è§£æžã—ãŸã‚Šã—ã¦ã„る。リリース予定ã®å®Ÿéš›ã®ã‚·ã‚¹ãƒ†ãƒ ã®ã‚¹ã‚ãƒ¼ãƒžã‚’ç´¹ä»‹ã€‚åŠ å·¥ã™ã‚‹æ™‚é–“ãŒãªã‹ã£ãŸã®ãã®ã¾ã¾ã¨ï¼¾ï¼¾ï¼› Google Docsã§è¤‡æ•°äººã§ã‚¬ãƒãƒ£ã‚¬ãƒãƒ£åŒæ™‚編集ã—ã¦è¨è¨ˆã—ã¦ã„る。 QA ä¿å˜ã—ãŸãƒã‚°ã¯ã©ã†ã‚„ã£ã¦ä½¿ã£ã¦ã‚‹ï¼Ÿâ†’アクセス解æžã®ã‚µãƒ¼ãƒ“スをã—ã¦ã„る。 リアルタイム？ãƒãƒƒãƒå‡¦ç†ï¼Ÿâ†’ Keyを日時ã«ã—ã¦from-to検索ã—ã¦ã‚‚ã¾ã¨ã‚‚ã«ä½¿ãˆã‚‹ï¼Ÿâ†’åŒæ™‚
YCSB ã®è«–æ–‡ã«ã§ã¦ãã‚‹ HBase ã®èª¬æ˜Ž: ãŠã¡ã‚¨ãƒ³ã®ãƒ–ãƒã‚°
YCSB ã¨ã¯ã€Yahoo! Cloud Servicing Benchmark ã®ã“ã¨ã§ã€Yahoo! Research ãŒä½œã£ãŸæ§˜ã€…㪠cloud serviceã€ã¨ã„ã†ã¨ã‹ãªã‚Šæ›–昧ã§ã™ãŒã€NoSQL ã ã‘ã«é™ã‚‰ãšã€sharded MySQL ãªã©ã‚‚å«ã‚㟠storage ã® benchmark ã‚’è¡Œã†ãŸã‚ã®ãƒ„ールã§ã™ã€‚ YCSB ã®è«–æ–‡ã§ã¯ã€å®Ÿéš›ã«ã€ Cassandra HBase Yahoo! PNUTS sharded MySQL ã® benchmark ã‚’å–ã£ã¦ã„ã¾ã™ã€‚ 論文自体ã¯ã€ http://www.brianfrankcooper.net/pubs/ycsb.pdfã‹ã‚‰èªã‚ã¾ã™ãŒã€HBase ã®èª¬æ˜Žã«ã¤ã„ã¦ã€ã‚“？ã¨æ€ã†ã¨ã“ã‚ãŒã‚ã‚Šã¾ã—ãŸã€‚ 具体的ã«ã¯ "6.1 Experimental Setup" ã®ä»¥ä¸‹ã®éƒ¨åˆ†ã€ For Cassandra, sharded MySQ
メンテナンス
ãŠçŸ¥ã‚‰ã›
障害
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
GitHub - reggoodwin/ferrit: Ferrit is a web crawler service written in Scala using Akka, Spray and Cassandra.
Cassandra Community Webinar | CEP Distributed Processing on Cassandra with Storm
A Big Data Trifecta: Storm, Kafka and Cassandra
Cassandra NYC 2011: Nathan Marz - The Storm and Cassandra Realtime Computation Stack
Google Code Archive - Long-term storage for Google Code Project Hosting.
{{#tags}}- {{label}}
{{/tags}}