Revisiting 1 Million Writes per second
by Christos Kalantzis In an article we posted in November 2011, Benchmarking Cassandra Scalability on AWS — Over a million writes per second, we showed how Cassandra (C*) scales linearly as you add more nodes to a cluster. With the advent of new EC2 instance types, we decided to revisit this test. Unlike the initial post, we were not interested in proving C*’s scalability. Instead, we were looking
Accelerate large-scale applications with BOLT
Highly complex services, such as those here at Facebook, have large source code bases in order to deliver a wide range of features and functionality. Even after the machine code for one of these services is compiled, it can range from 10s to 100s of megabytes in size, which is often too large to fit in any modern CPU instruction cache. As a result, the hardware spends a considerable amount of proc
Linuxãƒã‚¤ãƒŠãƒªã‚’最é©åŒ–ã—ã¦æ€§èƒ½ã‚’å‘上ã•ã›ã‚‹ã€ŒBOLTã€ã€FacebookãŒã‚ªãƒ¼ãƒ—ンソースã§å…¬é–‹ã€‚言語やコンパイラã«ä¾å˜ã›ãšé«˜é€ŸåŒ–
Linuxãƒã‚¤ãƒŠãƒªã‚’最é©åŒ–ã—ã¦æ€§èƒ½ã‚’å‘上ã•ã›ã‚‹ã€ŒBOLTã€ã€FacebookãŒã‚ªãƒ¼ãƒ—ンソースã§å…¬é–‹ã€‚言語やコンパイラã«ä¾å˜ã›ãšé«˜é€ŸåŒ– Facebookã¯ã€Linuxãƒã‚¤ãƒŠãƒªã®å†…部é…置を最é©åŒ–ã™ã‚‹ã“ã¨ã«ã‚ˆã‚ŠCPUã®ã‚ャッシュ効率ãªã©ã‚’å‘上ã•ã›ã€å®Ÿè¡Œé€Ÿåº¦ã‚’改善ã™ã‚‹ã€ŒBOLTã€ã‚’オープンソースã§å…¬é–‹ã—ã¾ã—ãŸã€‚ BOLTã¯ã€ŒBinary optimization and layout toolã€ã®ç•¥ã¨ã•ã‚Œã¦ã„ã¾ã™ï¼ˆã‚‚ã—ã‹ã—ãŸã‚‰ã€ã‚ˆã‚Šé€Ÿãèµ°ã‚‹ã¨ã„ã†æ„味ã§ã‚¦ã‚µã‚¤ãƒ³ãƒ»ãƒœãƒ«ãƒˆæ°ã«ã‹ã‘ã¦ã„ã‚‹ã®ã‹ã‚‚ã—ã‚Œã¾ã›ã‚“）。 BOLTã¯è¨€èªžã‚„コンパイラã«ä¾å˜ã›ãšã€ã‚½ãƒ¼ã‚¹ã‚³ãƒ¼ãƒ‰ã‚‚ä¸è¦ BOLTã®ãŠã‚‚ãªåŠ¹æžœã¯ã€Linuxãƒã‚¤ãƒŠãƒªã®å®Ÿè¡ŒçŠ¶æ³ã‚’perfコマンドã§å–å¾—ã—ã€é«˜é »åº¦ã§å®Ÿè¡Œã•ã‚Œã¦ã„る部分ãªã©ã‚’判別ã—ãŸä¸Šã§ã€ãã†ã—ãŸéƒ¨åˆ†ãŒCPUã‚ャッシュã«ãƒ’ットã—ã‚„ã™ã„よã†ã«ãƒã‚¤ãƒŠãƒªã®å†…部é…置を改善ã™ã‚‹ã“ã¨ãªã©ã§å®Ÿè¡Œé€Ÿåº¦ã‚’å‘上ã•ã›ã‚‹ã“ã¨ã¨
MyRocks Performance
In this blog post, I’ll look at MyRocks performance through some benchmark testing. As the MyRocks storage engine (based on the RocksDB key-value store http://rocksdb.org ) is now available as part of Percona Server for MySQL 5.7, I wanted to take a look at how it performs on a relatively high-end server and SSD storage. I wanted to check how it performs for different amounts of available memory f
DockerコンテナãŒé…ããªã‚‹ã‚‚ã†ä¸€ã¤ã®åŽŸå› | POSTD
å‰å›žã® ブãƒã‚°è¨˜äº‹ ã§ã¯ã€Kubernetesã®è©±ã¨ã€ ThoughtSpot ãŒKubernetesを開発インフラã®ãƒ‹ãƒ¼ã‚ºã«åˆã‚ã›ã¦ã©ã®ã‚ˆã†ã«å–り入れãŸã‹ã‚’ã”紹介ã—ã¾ã—ãŸã€‚今回ã¯ãã®ç¶šå ±ã¨ã—ã¦ã€æœ€è¿‘ã®èˆˆå‘³æ·±ã„デãƒãƒƒã‚°çµŒé¨“ã«ã¤ã„ã¦å°‘々駆ã‘足ã«ãªã‚Šã¾ã™ãŒãŠè©±ã—ã—ã¦ã„ãã¾ã™ã€‚本記事も「コンテナ化ã¨ä»®æƒ³åŒ–ã¯ãƒŽãƒƒãƒˆã‚¤ã‚³ãƒ¼ãƒ«ã§ã‚ã‚‹ã€ã¨ã„ã†äº‹å®Ÿã«åŸºã¥ã„ã¦ãŠã‚Šã€ãŸã¨ãˆcgroupã®ä¸Šé™ãŒã©ã‚Œã‚‚高ããªã„値ã«è¨å®šã•ã‚Œãƒ›ã‚¹ãƒˆãƒžã‚·ãƒ³ã§å分ãªæ¼”算能力ãŒåˆ©ç”¨ã§ãã‚‹ã¨ã—ã¦ã‚‚ã€ã‚³ãƒ³ãƒ†ãƒŠåŒ–ã•ã‚ŒãŸãƒ—ãƒã‚»ã‚¹åŒå£«ãŒãƒªã‚½ãƒ¼ã‚¹ã®ç«¶åˆã‚’èµ·ã“ã™å ´åˆãŒã‚ã‚‹ã“ã¨ã‚’示ã—ãŸã„ã¨æ€ã„ã¾ã™ã€‚ ThoughtSpotã§ã¯å†…部ã®Kubernetesクラスタ㧠多数ã®CI/CDや開発関連ã®ãƒ¯ãƒ¼ã‚¯ãƒ•ãƒãƒ¼ を稼åƒã•ã›ã¦ãŠã‚Šã€ã‚ã‚‹1点を除ã„ã¦ã¯å…¨ã¦ãŒé †èª¿ã§ã—ãŸã€‚唯一å•é¡Œã ã£ãŸã®ã¯ã€ãƒ‰ãƒƒã‚«ãƒ¼åŒ–ã•ã‚ŒãŸè£½å“コピーを起動ã™ã‚‹ã¨ã€ãƒ‘フォーマンスãŒæœŸå¾…を極端ã«ä¸‹å›žã‚‹ãƒ¬ãƒ™
HTTP/2㧠速ããªã‚‹ã¨ã ãªã‚‰ãªã„ã¨ã
ãŸã„ã¸ã‚“é…ã‚Œã°ã›ãªãŒã‚‰ã€YAPC::Okinawa 2018 ONNNASONã§ä½¿ç”¨ã—ãŸã‚¹ãƒ©ã‚¤ãƒ‰ã‚’ã€ã“ã¡ã‚‰ã«ã¦å…¬é–‹ã™ã‚‹æ¬¡ç¬¬ã§ã™ã€‚ ベンãƒãƒžãƒ¼ã‚¯ã®é›£ã—ã•ã¨ãƒãƒ¥ãƒ¼ãƒ‹ãƒ³ã‚°ã®å¥¥æ·±ã•ã€æ¥½ã—ã•ã‚’共有ã§ããŸçµæžœãŒãƒ™ã‚¹ãƒˆãƒˆãƒ¼ã‚¯è³žã«ã¤ãªãŒã£ãŸã®ã‹ãªã¨è€ƒãˆã¦ã„ã¾ã™ã€‚ã‚ã‚ŠãŒã¨ã†ã”ã–ã„ã¾ã—ãŸï¼†ä»Šå¾Œã¨ã‚‚よã‚ã—ããŠé¡˜ã„ã„ãŸã—ã¾ã™ã€‚ HTTP/2㧠速ããªã‚‹ã¨ã ãªã‚‰ãªã„ã¨ã from Kazuho Oku
GitHub - gperftools/gperftools: Main gperftools repository
gperftools ---------- (originally Google Performance Tools) The fastest malloc we’ve seen; works particularly well with threads and STL. Also: thread-friendly heap-checker, heap-profiler, and cpu-profiler. OVERVIEW --------- gperftools is a collection of a high-performance multi-threaded malloc() implementation, plus some pretty nifty performance analysis tools. gperftools is distributed under the
Ruby 2.5 ã®æ”¹å–„を自慢ã—ãŸã„ - クックパッド開発者ブãƒã‚°
技術部ã§ãƒ•ãƒ«ã‚¿ã‚¤ãƒ Ruby コミッタをã—ã¦ã„る笹田ã§ã™ã€‚最近ã²ã•ã³ã•ã« Ruby ã®ãƒ©ã‚¤ãƒ–ラリ㫠pull request ã‚’ã—ã¾ã—ãŸï¼ˆshow valid break point lines #393）。 12/25 ã®ã‚¯ãƒªã‚¹ãƒžã‚¹ã«ã€Ruby 2.5 ãŒç„¡äº‹ã«ãƒªãƒªãƒ¼ã‚¹ã•ã‚Œã¾ã—ãŸï¼ˆRuby 2.5.0 リリース）。関係å„ä½ã®åŠªåŠ›ã«æ„Ÿè¬ã—ã¾ã™ã€‚ã„ã‚ã„ã‚ãªãƒã‚°ä¿®æ£ã€ã„ã‚ã„ã‚ãªæ–°æ©Ÿèƒ½ã€ã„ã‚ã„ã‚ãªæ€§èƒ½æ”¹å–„ãŒã‚ã‚Šã¾ã™ï¼ˆè©³ç´°ã¯ã€ä¸Šè¨˜ãƒªãƒªãƒ¼ã‚¹ãƒŽãƒ¼ãƒˆã€ã‚‚ã—ã㯠Ruby ã®ã‚½ãƒ¼ã‚¹ã‚³ãƒ¼ãƒ‰ã«ã‚ã‚‹ NEWS ファイルをã”å‚ç…§ãã ã•ã„）ã®ã§ã€è©¦ã—ã¦é ‚ã‘ã‚‹ã¨è‰¯ã„ã¨æ€ã„ã¾ã™ã€‚ãã†ã„ãˆã°ã€ç§ãŒã‚¯ãƒƒã‚¯ãƒ‘ッドã«å…¥ç¤¾ã—ã¦åˆã‚ã¦ã® Ruby リリースã§ã—ãŸã€‚ å‰å›žã® techlife ブãƒã‚°ï¼ˆ Ruby ã® NODE ã‚’ GC ã‹ã‚‰å’æ¥ã•ã›ãŸ ）ã§é è—¤ã•ã‚“㌠クックパッドã‹ã‚‰ã®ä¸»ãªè²¢çŒ®ã¨ã—ã¦ã¯ã€ã€Œtrace 命令ã®å‰Šé™¤ã«ã‚ˆã‚‹
Performance Optimizations in Apache Impala
Apache Impala is a modern, open-source MPP SQL engine architected from the ground up for the Hadoop data processing environment. Impala provides low latency and high concurrency for BI/analytic read-mostly queries on Hadoop, not delivered by batch frameworks such as Hive or SPARK. Impala is written from the ground up in C++ and Java. It maintains Hadoop’s flexibility by utilizing standard componen
Meltdown fix impact on Redis performances in virtualized environments
meltdown_redis.md Meltdown fix impact on Redis performances in virtualized environments UPDATE: apparently kernel difference may have a serious impact, so I'll redo the test from scratch. Test performed with AOF enabled, fsync policy 1 second, allowing the rewrites to be triggered. Command lines used: ./redis-benchmark -q -P 32 -n 1000000 -t set,get -r 1000000 ./redis-benchmark -q -n 1000000 -t se
ddb_benchmark.md
ddb_benchmark.md Write Performance Benchmark This document will allow anyone to verify the benchmark result of writing 2 - 3 million metrics per second into DalmatinerDB. This is a single node benchmark to keep things simple and easily comparable between time series databases that don't support clustering. We will setup 2 Haggar servers to generate metrics and fire them at a single node Dalmatiner
AWS EC2 Virtualization 2017: Introducing Nitro
Recent posts: 28 Apr 2023 » eBPF Observability Tools Are Not Security Tools 01 Mar 2023 » USENIX SREcon APAC 2022: Computing Performance: What's on the Horizon 17 Feb 2023 » USENIX SREcon APAC 2023: CFP 02 May 2022 » [email protected] 15 Apr 2022 » Netflix End of Series 1 09 Apr 2022 » TensorFlow Library Performance 19 Mar 2022 » Why Don't You Use ... 26 Sep 2021 » The Speed of Time 06 Sep 2021 »
Making dev.to insanely fast
It makes me smile when someone raves about how fast this website loads, because that's no accident. We put a lot of effort into making it so. It is the sort of thing that usually goes unnoticed, but when your readers are developers, there's a better chance they notice and appreciate it. I have written about this in the past, but it's worth re-examining because these ideas are always evolving. From
ミドルウェア性能検証ã®æ‰‹å¼•ã | 外é“父ã®åŒ
インフラエンジニアã®å¤šåˆ†ã€è¯å½¢ã®ãŠä»•äº‹ã®ï¼‘ã¤ã§ã‚るミドルウェアã®æ€§èƒ½æ¤œè¨¼ã‚’久々ã«ã‚¬ãƒƒãƒ„リやる機会ãŒã‚ã‚Šã¾ã—ãŸã®ã§ã€æ¤œè¨¼ä½œæ¥ã®åŸºæœ¬çš„ãªé …ç›®ã«ã¤ã„ã¦åˆå¿ƒã‹ã‚‰æŒ¯ã‚Šè¿”ã£ã¦ãŠããŸã„ã¨æ€ã„ã¾ã™ã€‚èªã¿ã‚„ã™ã•åº¦å¤–視ã®è©°ã‚è¾¼ã¿è¨˜äº‹æ³¨æ„è¦å ±ã§ã™ã€‚ 世ã®ä¸ã€é›‘ãªæ¤œè¨¼çµæžœã‚‚ã¡ã‚‡ã„ã¡ã‚‡ã„散乱ã—ã¦ã„ã¦ã€ç§è‡ªèº«ã‚‚ãã†ãªã‚‰ãªã„よã†æ³¨æ„を払ã£ã¦ã„ã‚‹ã‚ã‘ã§ã™ãŒã€ã‚¬ãƒã§ã‚„ã‚‹ã¨æ°—ã‚’ã¤ã‘ã‚‹é …ç›®ãŒå¤šãã¦ã€è‡ªåˆ†ã§å¿˜ã‚ŒãŸã‚Šã—ãªã„よã†ã«ã¨ã€èª°ã‹ã«ã‚„ã£ã¦ã‚‚らã„ãŸã„時ã«åŸºæœ¬ã‚’抑ãˆã¦ã‹ã‚‰å–り掛ã‹ã£ã¦ã‚‚らã†ãŸã‚ã«ã€å½¢ã«ã—ã¦æ®‹ã—ã¦ãŠã“ã†ã¨æ€ã£ãŸæ¬¡ç¬¬ã§ã‚ã‚Šã¾ã™ã€‚ 目次 ãªãœæ€§èƒ½æ¤œè¨¼ã‚’ã™ã‚‹ã®ã‹ 環境ã®æº–å‚™ インスタンスã®ç”¨æ„ クライアントã®ç”¨æ„ サーãƒãƒ¼ã®ç”¨æ„ ボトルãƒãƒƒã‚¯ã«ãªã‚Šã†ã‚‹é …ç›® CPU Utilization Memory Network Bandwidth Disk Bandwidth Disk IOPS Disk Latency Disk
EuroBSDcon: System Performance Analysis Methodologies
Recent posts: 29 Oct 2024 » AI Flame Graphs 22 Jul 2024 » No More Blue Fridays 24 Mar 2024 » Linux Crisis Tools 17 Mar 2024 » The Return of the Frame Pointers 10 Mar 2024 » eBPF Documentary 28 Apr 2023 » eBPF Observability Tools Are Not Security Tools 01 Mar 2023 » USENIX SREcon APAC 2022: Computing Performance: What's on the Horizon 17 Feb 2023 » USENIX SREcon APAC 2023: CFP 02 May 2022 » Brendan
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
cassandra write throughput and scalability
Goã¨ã‚³ãƒ³ãƒ†ãƒŠã§ä½œã‚‹Webアプリケーションベンãƒãƒžãƒ¼ã‚«ãƒ¼ / Benchmarker built with Go and Container
GitHub - dgryski/go-perfbook: Thoughts on Go performance optimization
The DEV Community
International Conference on Performance Engineering: ICPE 2017
{{#tags}}- {{label}}
{{/tags}}