Monitoring and Tuning the Linux Networking Stack: Sending Data | Packagecloud Blog
Monitoring and Tuning the Linux Networking Stack: Sending Data TL;DR This blog post explains how computers running the Linux kernel send packets, as well as how to monitor and tune each component of the networking stack as packets flow from user programs to network hardware. This post forms a pair with our previous post Monitoring and Tuning the Linux Networking Stack: Receiving Data. It is imposs
100万ppsã‚’å—ä¿¡ã™ã‚‹ãƒ—ãƒã‚°ãƒ©ãƒ を書ãã®ã¯ã©ã®ãらã„難ã—ã„ã®ã‹ï¼Ÿã€ç¿»è¨³ã€‘CloudFlare ブãƒã‚° | FAworksブãƒã‚°
100万ppsã‚’å—ä¿¡ã™ã‚‹ãƒ—ãƒã‚°ãƒ©ãƒ を書ãã®ã¯ã©ã®ãらã„難ã—ã„ã®ã‹ï¼Ÿã€ç¿»è¨³ã€‘CloudFlare ブãƒã‚° ç„¡æ–™æž ãŒå……実ã—ã¦ã„ã‚‹ã“ã¨ã§ã‚‚人気ãªã‚³ãƒ³ãƒ†ãƒ³ãƒ„デリãƒãƒªãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯ (CDN) ã‚’æä¾›ã™ã‚‹CloudFlareã¯ã€æœ€è¿‘1å„„1000万ドルã®è³‡é‡‘調é”ãŒç™ºè¡¨ã•ã‚Œã€ã¾ã™ã¾ã™æ³¨ç›®ã‚’集ã‚ã¦ã„る。ãã‚“ãªCloudFlareã®ãƒ–ãƒã‚°ã‹ã‚‰ã€ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯ãƒãƒ¥ãƒ¼ãƒ‹ãƒ³ã‚°ã®çŸ¥è¦‹ã‚’紹介ã—ãŸã„。 原文：https://blog.cloudflare.com/how-to-receive-a-million-packets/ (2015-11-20) ※元記事ã®ç†è€…ã«ã¯ç›´æŽ¥ç¿»è¨³ã®è¨±å¯ã‚’é ‚ã„ã¦ã€ç¿»è¨³ãƒ»å…¬é–‹ã—ã¦ãŠã‚Šã¾ã™ã€‚ CC BY-SA 2.0 image by Bob McCaffrey 先週ã€ä½•æ°—ãªã„会話ã®ä¸ã§åŒåƒšãŒã“ã†è©±ã™ã®ã‚’ãµã¨è€³ã«ã—ãŸã€‚「Linuxã®ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯ãƒ»ã‚¹ã‚¿ãƒƒã‚¯ãŒé…ã„ã‚“ã よï¼1コアã‚ãŸã‚Š5万pps以上
User-space Network Processing
3. • B3 k6 z 2 l • mTCP +4Intel4DPDK wi • github mTCP+4DPDK orz • Key4Value4Store w k Linux l • RADIS → • d v orz • Memcached → • d 3 4. A G 7 LNPMXXT 4 0 0.2 0.4 0.6 0.8 1 0 20 40 60 80 100 Key size (bytes) Key size CDF by appearance USR APP ETC VAR SYS 0 0.2 0.4 0.6 0.8 1 1 10 100 1000 10000 100000 1e+06 Value size (bytes) Value Size CDF by appearance USR APP ETC VAR SYS 0 0.2 0.4 0.6 0.8 1 1 10
How to receive a million packets per second
Last week during a casual conversation I overheard a colleague saying: "The Linux network stack is slow! You can't expect it to do more than 50 thousand packets per second per core!" That got me thinking. While I agree that 50kpps per core is probably the limit for any practical application, what is the Linux networking stack capable of? Let's rephrase that to make it more fun: On Linux, how hard
DnsHiveをリリースã—ã¾ã—㟠| ã‚ã‚‹ç ”ç©¶è€…ã®æ‰‹è¨˜
DnsHiveã¯ãƒ‘ケットã‚ャプãƒãƒ£ã«ã‚ˆã£ã¦DNSåå‰è§£æ±ºæƒ…å ±ã®è“„ç©ã¨ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯ç›£è¦–ã‚’åŒæ™‚ã«å®Ÿè¡Œã—ã€ãƒ„ールã§ã™ã€‚tcpdumpコマンドを使ã£ãŸã“ã¨ãŒã‚る人ã«ç«¯çš„ã«æ©Ÿèƒ½ã‚’説明ã™ã‚‹ã¨ã€ä»¥ä¸‹ã®æ§˜ãªä½¿ã„æ–¹ãŒã§ãã¾ã™ã€‚ # dnshive -i eth0 | grep google.com 1391871175.057028 TCP 10.0.0.5/63906 -> safebrowsing.google.com.(173.194.126.233)/443 Len:107 1391871175.102049 TCP safebrowsing.google.com.(173.194.126.233)/443 -> 10.0.0.5/63906 Len:66 1391871332.255500 TCP 10.0.0.5/63921 -> www3.l.google.com.(173.194.117.1
WireEdit is a full-stack Desktop Packet Processor for Captured Packets (Pcap) data files.
WireEdit allows WYSIWYG editing of Pcap data in situ for any network stack at any stack layer while preserving the binary integrity of the data. Data editing is done in a break-proof manner with the lengths, checksums, offsets, and other inter- and intra-packet dependencies recalculated on-the-fly for all affected packets and protocol layers. $3499/User/Year, 5 users min
Packetbeat - Application Monitoring - Open Source
Packetbeat is an Open Source Application Monitoring and Packet Tracing (Packet Sniffer) system. It works by sniffing the traffic and analyzing network protocols like HTTP, MySQL and REDIS.Don't know how to start troubleshooting an issue? Try opening the topological map. It's guaranteed to give you the big picture and you'll be surprised how often it sends you in the right direction. You can set fi
high-performance packet filtering with pflua — wingolog
Greets! I'm delighted to be able to announce the release of Pflua, a high-performance packet filtering toolkit written in Lua. Pflua implements the well-known libpcap packet filtering language, which we call pflang for short. Unlike other packet filtering toolkits, which tend to use the libpcap library to compile pflang expressions bytecode to be run by the kernel, Pflua is a completely new implem
hpingã§ä½œã‚‹ãƒ‘ケット
2. hpingã¨ã¯ •自由ã«ãƒ‘ケットã®å¤‰æ›´ã—ã¦é€ä¿¡ã§ãるツール •pingコマンドã®ã‚ˆã†ãªã‚¤ãƒ³ã‚¿ãƒ¼ãƒ•ã‚§ãƒ¼ã‚¹ •TCP, UDP, ICMP, RAWIPをサãƒãƒ¼ãƒˆ •パケットã®ã‚ªãƒ—ションも変更å¯èƒ½ãªã‚‚ã®ãŒå¤šã„ •ãƒãƒ¼ãƒˆã‚¹ã‚ャンやtracerouteç‰ã‚‚å¯ â€¢ã¤ã¾ã‚Šâ€¦ HentaiãªPing!! （ãŸã ã—ã€10å¹´å‰ã‹ã‚‰ã‚¢ãƒƒãƒ—デートãŒãªã„…） 3. インストール方法 •Linux •apt-get install hping3 •Mac •brew install hping •MacPortsã¯çŸ¥ã‚‰ãªã„ã§ã™â€¦ •Windows •2.0ãªã‚‰å®Ÿè¡Œãƒ•ã‚¡ã‚¤ãƒ«ã‚’å…¬å¼ã‹ã‚‰ãƒ€ã‚¦ãƒ³ãƒãƒ¼ãƒ‰å¯ •ソースコードをダウンãƒãƒ¼ãƒ‰ã—ã¦ã‚³ãƒ³ãƒ‘イルã§ã‚‚å¯ â€¢http://www.hping.org/download.php
Wireshark ã ã‘ã«é ¼ã‚‰ãªã„! パケット解æžãƒ„ールã®ç´¹ä»‹
2. $ whoami • åå‰ï¼šæ£®ä¹… å’Œæ˜ â€¢ Twitter：@k_morihisa • æƒ…å ±ã‚»ã‚ュリティエンジニア・アナリスト • 趣味ã§ãƒãƒ‹ãƒ¼ãƒãƒƒãƒˆã‚’観察ã—ã¦ã¾ã™ http://www.morihi-soc.net/ ! • 第10回「ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯ãƒ‘ケットをèªã‚€ä¼šï¼ˆä»®ï¼‰ã€ 何ãŒå¤‰ã‚ã£ãŸ!? Wireshark 1.8 http://www.slideshare.net/morihisa/wireshark-18 2
Receive Side Scaling and Receive Packet Steering
Lets cover some basic terminologies before we dig into Receive Side Scaling and Receive Packet Steering. Network Interface Card: A network interface controller (NIC) (also known as a network interface card, network adapter) is an electronic device that connects a computer to a computer network/ Modern NIC usually comes up with speed of 1-10Gbps. #Find your NIC speed [root@machine1 ~]# ethtool eth0
第2回　ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯é…延ã¨é«˜é€ŸåŒ– | gihyo.jp
皆ã•ã‚“ã“ã‚“ã«ã¡ã¯ã€‚今回ã¯ã€å‰å›žã®è©±ã®ç¶šãã§ã™ã€‚ ã¾ãšå‰å›žã®ãŠã•ã‚‰ã„ã‚’ã™ã‚‹ã¨ã€ä»¥ä¸‹ã®ã‚ˆã†ã«ãªã‚‹ã¨ã„ã†ã“ã¨ã§ã—ãŸã。 â—TCPを用ã„るアプリケーションã®æœ€å¤§ã‚¹ãƒ«ãƒ¼ãƒ—ットã¯ã€å¾€å¾©ã®é…延時間（RTT：Round Trip Time）ã®å½±éŸ¿ã‚’ã†ã‘ã‚‹ â—ウィンドウサイズãŒ64Kãƒã‚¤ãƒˆã®å ´åˆã®TCP最大スループットã®ç†è«–値ã¯ä»¥ä¸‹ã®ã¨ãŠã‚Š RTT 1msec ã®ã¨ã 512Mbps RTT 5msec ã®ã¨ã 102.4Mbps RTT 10msec ã®ã¨ã 51.2Mbps RTT 15msec ã®ã¨ã 34.1Mbps RTT 20msec ã®ã¨ã 25.6Mbps RTT 50msec ã®ã¨ã 10.24Mbps RTT 100msec ã®ã¨ã 5.12Mbps RTT 200msec ã®ã¨ã 2.56Mbps ã§ã¯ã€ç¾å®Ÿã®ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯ã§ã¯ã©ã®ãらã„ã®é…延ãŒç™ºç”Ÿã™ã‚‹ã®ã§ã—ょã†ã‹ï¼Ÿ ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯ã«ã‹ã‹
My Website | Linux est un système d'exploitation extrêmement modulable et pas si facile d'accès au premier abord mais ne vous fiez pas qu'à son apparence car il peut se révéler très ergonomique !
Linux est un système d'exploitation extrêmement modulable et pas si facile d'accès au premier abord mais ne vous fiez pas qu'à son apparence car il peut se révéler très ergonomique ! Gagner honorablement sa vie est l’une des choses à laquelle chaque être humain ne saurait déroger. Et quand le travail ou le boulot pour lequel on a été engagé ne suffit pas, il convient de trouver d’autres issues en
Dropwatchã®ã”紹介
カテゴリー DX (2) 一般 (59) ç ”ç©¶ä¼š (6) åƒãæ–¹ (4) 技術 (353) Edge AI (2) Edge Computing (13) Erlang (1) FIWARE (2) Fog Computing (10) Infiniband (31) Internet of Things (32) Key Value Store (17) Linux (3) Linux KVM (10) Machine Learning (6) RealTime Web (14) SRE (3) Webサービス (42) インフラ (8) コンテナ (4) ストレージ (93) データセンター (7) データベース (47) データæµé€š (6) テレプレゼンス (2) ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯ (215) 仮想化 (111) ç½å®³ã‚³ãƒŸãƒ¥ãƒ‹ã‚±ãƒ¼ã‚·ãƒ§ãƒ³ (26) ç©ºé–“æƒ…å ± (30) é‡åコンピューティン
Ostinato Traffic Generator for Network Engineers
✨ Special Black Friday Offer! Whether you are testing circuit bandwidth, storm control, L2/L3 forwarding, QOS, load balancing, SD WAN application policies, multicast snooping or any of the other myriad things network engineers do during their day, you need to test with traffic - in lab or production. Why test with traffic? Imagine, ACL rules not working as expected Improper load balancing because
LAN Ethernet Maximum Rates, Generation, Capturing & Monitoring - NST Wiki
LAN Ethernet Maximum Rates, Generation, Capturing & Monitoring Introduction Designing and managing an IP network requires an in-depth understanding of both the network infrastructure and the performance of devices that are attached, including how packets are handled by each network device. Network computing engineers typically refer to the performance of network devices by using the speed of the i
100Gbpsソフトウェアルータã®å®Ÿç¾å¯èƒ½æ€§ã«é–¢ã™ã‚‹è«–æ–‡
1. Building a Single-Box 100 Gbps Software Router Sangjin Han, Keon Jang, KyoungSoo Park, Sue Moon KAIST In IEEE Workshop on Local and Metropolitan Area Networks, 2010 id:y_uuki / @y_uuk1 1 2. PacketShader: a GPU-accelerated Software Router Sangjin Han, Keon Jang, KyoungSoo Park and Sue Moon. In proceedings of ACM SIGCOMM 2010, Delhi, India. September 2010 SSLShader: Cheap SSL Acceleration with Co
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
パケットã‚ャプãƒãƒ£ã®å‹˜ã©ã“ã‚ Ssmjp 201501
Echoing packets with Snabb Switch - Luke Gorrie's blog
https://nuclearcat.com/mediawiki/index.php/Intel_Gigabit_Performance
{{#tags}}- {{label}}
{{/tags}}