Speeding up Linux disk encryption
Data encryption at rest is a must-have for any modern Internet company. Many companies, however, don't encrypt their disks, because they fear the potential performance penalty caused by encryption overhead. Encrypting data at rest is vital for Cloudflare with more than 200 data centres across the world. In this post, we will investigate the performance of disk encryption on Linux and explain how w
Everything I've seen on optimizing Postgres on ZFS
UPDATE (2021/12/21) After lots of feedback on Reddit (thanks /u/BucketOfSpinningRust!) and doing some more experimenting and digging, I've updated this post with more information -- new/updated sections are marked "Update". tl;dr - Tips for running Postgres on (Open)ZFS-on-Linux (ZoL), which I’m nicknaming “PoZoLâ€, check out the TOC (or skip to the resource list at the bottom) and browse to whatev
Fast CSV processing with SIMD
This article was discussed on Hacker News. I recently learned of csvquote, a tool that encodes troublesome CSV characters such that unix tools can correctly process them. It reverses the encoding at the end of the pipeline, recovering the original input. The original implementation handles CSV quotes using the straightforward, naive method. However, there’s a better approach that is not only simpl
æ¡ä»¶åˆ†å²ã¨cmovã¨maxps
3. 自己紹介 ï®å…‰æˆæ»‹ç”Ÿï¼ˆã‚µã‚¤ãƒœã‚¦ã‚ºãƒ»ãƒ©ãƒœï¼‰ ï®å§‘æ¯ãªæœ€é©åŒ–ãŒå¤§å¥½ã ï®ä»¥å‰ã¯ã‚³ãƒ¼ãƒ‡ãƒƒã‚¯ç³»ã®è¶£å‘³ãƒ»ä»•äº‹ã‚’ã‚„ã£ã¦ã„㟠ï®æœ€è¿‘ã¯ä»•äº‹ã®ãŸã‚ã«æ©Ÿæ¢°å¦ç¿’ã‚’å‹‰å¼·ä¸ ï®PRMLã‚ã‚“ã¡ã‚‡ã“公開ä¸ï¼ˆhttps://github.com/herumi/prml/） ï®blog : http://homepage1.nifty.com/herumi/ ï®mail : herumi@nifty.com ï®twitter : @herumi 3 /24 5. プãƒãƒ•ã‚¡ã‚¤ãƒ« ï®ãƒ—ãƒãƒ•ã‚¡ã‚¤ãƒ© ï®é–¢æ•°çµ„ã¿è¾¼ã¿ã‚¿ã‚¤ãƒ— ï®ãƒ—ãƒã‚°ãƒ©ãƒ 自体ã«çµ„ã¿è¾¼ã¾ã‚Œã‚‹ ï®ãれ自体ãŒãƒ—ãƒã‚°ãƒ©ãƒ ã«å½±éŸ¿ã‚’与ãˆã‚‹ ï®å›žæ•°ã¯æ£ç¢º ï®gprofã‚„DevPartner, Vtune ï®ã‚¿ã‚¤ãƒŸãƒ³ã‚°å‰²ã‚Šè¾¼ã¿ã«ã‚ˆã‚‹é›†è¨ˆã‚¿ã‚¤ãƒ— ï®å‰²ã‚Šè¾¼ã¿ã§ãã®çž¬é–“ã®eipã‚’å–å¾—ã—集計 ï®ãƒ—ãƒã‚°ãƒ©ãƒ ã«å½±éŸ¿ã‚’（殆ã©ï¼‰ä¸Žãˆãªã„ ï®å›žæ•°ã¯ä¸æ£ç¢ºï¼Œæ™‚é–“ã¯æ¦‚ãæ£ç¢º ï®CodeAnalys
é«˜è² è·ã‚·ã‚¹ãƒ†ãƒ ã§NVMeデãƒã‚¤ã‚¹ä½¿ç”¨æ™‚ã®fstrimã¨discard mount optionã®è©± - ãŸã”ã‚‚ã‚Šã™ãƒ¡ãƒ¢
å…ˆã«ã¾ã¨ã‚る㨠ディスクI/Oã«é«˜ã„è² è·ã‚’ã‹ã‘るシステムã§NVMeデãƒã‚¤ã‚¹ã‚’使ã†ã¨ãweekly cron jobã§fstrimãŒèµ°ã‚‹çŠ¶æ³ã«ãªã£ã¦ãŸã‚‰åœæ¢ã—ã‚ ã˜ã‚ƒãªã„ã¨fstrimãŒèµ°ã£ãŸçž¬é–“ã«I/OパフォーマンスãŒåˆºã•ã£ã¦æ»ã¬ fstrimã‚’åœæ¢ã™ã‚‹ãªã‚‰discard mount optionを有効化ã—ã‚ã€ãŸã ã—ãã®çŠ¶æ…‹ã§ã®I/O性能ã§å•é¡Œãªã„ã‹ã©ã†ã‹æ¸¬ã£ã¦ãŠã‘ discard mount optionを有効化ã—ã¦ã‚‚大ãã„ファイルã®å‰Šé™¤ã«ã¯æ°—ã‚’ã¤ã‘ã‚ã€ãƒ—ãƒfstrimã¿ãŸã„ã«ãªã‚‹ãž 追記ã•ã‚Œã‚‹ã°ã‹ã‚Šã§å¤§ãããªã‚‹ãƒ•ã‚¡ã‚¤ãƒ«(ãã—ã¦å‰Šé™¤ã•ã‚Œã‚‹ãƒ•ã‚¡ã‚¤ãƒ«)ã¯NVMeã˜ã‚ƒãªã„デãƒã‚¤ã‚¹ã«ç½®ã„ã¨ã‘ 高I/Oスループットを期待ã™ã‚‹ã‚·ã‚¹ãƒ†ãƒ ã§ã®NVMeã¨fstrim 社内ã§å°ã•ã‚ã®ã‚¤ãƒ³ã‚¹ã‚¿ãƒ³ã‚¹ã‚’多ã並ã¹ã¦ãƒˆãƒ©ãƒ•ã‚£ãƒƒã‚¯ã‚’æŒã„ã¦ãŸã®ã‚’色々è¦ä»¶ãŒã‚ã£ã¦å¤§ãã‚ã®ã‚¤ãƒ³ã‚¹ã‚¿ãƒ³ã‚¹ã«ã¾ã¨ã‚るよã†ãªã‚·ã‚¹ãƒ†ãƒ アップデートをや
Scaling SQLite to 4M QPS on a Single Server (EC2 vs Bare Metal)
Expensify has an unusual technology stack in many ways. For example, we don't use DNS internally -- just configuration-managed /etc/hosts files -- and it works great. Similarly, we only make limited use of AWS -- instead hosting our own hardware for the web and database layer -- and it works great. But most surprising of all is that we don't use MySQL or Postgres -- instead using none other tha
Intel MKL on AMD Zen | Daniël de Kok
Aug 31, 2020 Tags: dev, linux Introduction Disclaimer: this post investigates how recent MKL versions behave on Zen CPUs. You should read the MKL license before using MKL. I shall not be held responsible for how you use MKL. Intel MKL has been known to use a SSE code paths on AMD CPUs that support newer SIMD instructions such as those that use the Zen microarchitecture. A (by now) well-known trick
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
Process priority and cpu speed
The container throttling problem
GitHub - google/tcmalloc
GitHub - cifsd-team/ksmbd: ksmbd kernel server(SMB/CIFS server)
GitHub - nitely/nim-regex: Pure Nim regex engine. Guarantees linear time matching
Bug #1856335 “Cache Layout wrong on many Zen Arch CPUs†: Bugs : QEMU
[PATCH RFC 2/2] futex: Implement mechanism to wait on any of several futexes - Gabriel Krisman Bertazi
The 5-year journey to bring restartable sequences to Linux - EfficiOS
GitHub - clearlinux/make-fmv-patch
Open Ecosystem
Intel® Memory Drive Technology
[RFC PATCH] mm, page_alloc: double zone's batchsize - Aaron Lu
Measuring the memory-level parallelism of a system using a small C++ program? – Daniel Lemire's blog
{{#tags}}- {{label}}
{{/tags}}