STF Distributed Object Storage - Home
Distributed Object Storage Made Easy! Use commodity hardware/software to build your own scalable object storage! Learn more » What is STF? STF is a simple, yet very scalable distribute storage system. STF powers sites like livedoor Blog, loctouch and many more, serving gigabytes after gigabytes of data. On one such system, it's serving 400Mbps of image at peak hours without a hitch. GET STF! STF i
Q4Mã‚’ç°¡å˜ã«å°Žå…¥ã™ã‚‹æ–¹æ³• - MySQL Casual Advent Calendar 2011 - blog.nomadscafe.jp
xaicronã¨ãƒã‚¿ãŒè¢«ã£ãŸã‚ˆã†ã ã‘ã©æ°—ã«ã—ãªã„＞＜ livedoorã§Operations Engineerã‚„ã£ã¦ã‚‹kazeburoã Yo。最近livedoorã‹ã‚‰ã‚ªãƒ¼ãƒ—ンソース化ã•ã‚ŒãŸ3億ファイルを管ç†ã—ã¦ã‚‹ã‚ªãƒ–ジェクトストレージ「STFã€ã§ã‚‚使ã£ã¦ã‚‹Message Queueã®Q4Mã®ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«æ–¹æ³•ã‚’紹介ã™ã‚‹ã‚ˆï¼ã€€ã‚«ã‚¸ãƒ¥ã‚¢ãƒ«ã ã‹ã‚‰ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã ã‘ï¼ çŸ¥ã£ã¦ã‚‹äººã‚‚多ã„ã¨æ€ã†ã‘ã©Q4Mã¯kazuhoã•ã‚“ã«ã‚ˆã£ã¦é–‹ç™ºã•ã‚ŒãŸMySQLã®ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã‚¨ãƒ³ã‚¸ãƒ³ã¨ã—ã¦å®Ÿè£…ã•ã‚Œã¦ã‚‹Message Queue。livedoorã§ã¯ã‚‚ã¡ã‚ã‚“ã€mixiã‚„DeNAã‚’ã¯ã˜ã‚ソーシャルゲームå„社ã§ã‚‚使ã‚ã‚Œã¦ã„る。 Message Queueã®èª¬æ˜Žã‚„使ã„æ–¹ã¯DIS_COMMENTã§ãƒ†ãƒ¼ãƒ–ルスペースフルã®çŒ«ç¥žæ§˜ãŒæ›¸ã„ã¦ã‚‹ã®ã§å‚考ã«ãªã‚‹ãï¼ Perl Hackers Hub 第10回　ジョブã‚ューã§å¾Œå›žã—大作戦―Th
STF Distributed Object Storage - Home
Distributed Object Storage Made Easy! Use commodity hardware/software to build your own scalable object storage! Learn more » What is STF? STF is a simple, yet very scalable distribute storage system. STF powers sites like livedoor Blog, loctouch and many more, serving gigabytes after gigabytes of data. On one such system, it's serving 400Mbps of image at peak hours without a hitch. GET STF! STF i
YAPC Asia 2010 ã§ã®ã‚¹ãƒ©ã‚¤ãƒ‰å…¬é–‹ã¨è£œè¶³ã€ã‚ã¨æ„Ÿæƒ³ãªã© - æ—¥å‘å¤ç‰¹æ®Šå¿œæ´éƒ¨éšŠ
ã¯ã„ã€@941 ã•ã‚“ã‚’åˆã‚ã¨ã—ã¦ã€@lestrrat ã•ã‚“ã€JPA ã®çš†æ§˜ã£ã¦åƒ•ã‚‚ã§ã™ã‘ã©ã€ãã‚Œã¨ãƒœãƒ©ãƒ³ãƒ†ã‚£ã‚¢ã‚¹ã‚¿ãƒƒãƒ•ã®çš†ã•ã‚“ã€ã‚¹ãƒ”ーカーã®çš†ã•ã‚“ã€ã”æ¥å ´è€…ã®çš†ã•ã‚“3日間ãŠç–²ã‚Œæ§˜ã§ã—ãŸã€‚ãã—ã¦ã€ä»Šå¹´ã‚‚盛り上ãŒã‚Šã¾ã—ãŸã。 ã•ã¦ã€å¾ŒåŠã ã„ã¶æ™‚é–“ãŒæŠ¼ã—ã¦æ—©å£ã«ãªã£ã¦ã—ã¾ã„ã¾ã—ãŸãŒå½“æ—¥ã®ã‚¹ãƒ©ã‚¤ãƒ‰ã‚’公開ã—ã¾ã™ã€‚ Inside mobage platformView more presentations from zigorou. ã•ã¦ã¨ç‰¹ã«å¾ŒåŠã® Q4M を複数å°æ§‹æˆã«ã—ãŸéš›ã®è² è·ã®ã°ã‚‰ã¤ãã§ã™ãŒã€INSERT ã®æ–¹ã¯ DNSRR ã¨ã‹ã§ã‚„ã‚Œã°ã„ã„ã®ã§ã™ãŒã€queue_wait() ã—ã¦å®Ÿéš›ã«ä½•ã‹ã‚¿ã‚¹ã‚¯ã‚’実行ã™ã‚‹éš›ã«ã€å‡¦ç†æ™‚é–“ã«åã‚ŠãŒã‚ã‚‹å ´åˆã€queue_wait() ã® sleep ãŒç„¡è¦–出æ¥ãªããªã£ã¦ç‰‡å´ã«æŽ¥ç¶šãŒåã£ã¦ã—ã¾ã†ç¾è±¡ãŒä½•åº¦ã‹èµ·ãã¾ã—ãŸã€‚ ã“れを解決ã™ã‚‹ãŸã‚ã«ã€ã²ã¨ã¤ã®Q4Mã«æŽ¥ç¶šã™
q4m ã‚’ rpm 化ã™ã‚‹ with checkinstall - æ—¥å‘å¤ç‰¹æ®Šå¿œæ´éƒ¨éšŠ
作æ¥ãƒ¡ãƒ¢ã§ã™ã€‚ src.rpm ã®å–å¾— # cd /usr/src/redhat/SRPMS # wget http://dev.mysql.com/get/Downloads/MySQL-5.1/MySQL-community-5.1.42-0.rhel5.src.rpm/from/http://ftp.iij.ad.jp/pub/db/mysql/ rpmbuild --recompile ビルド時ã®ã‚½ãƒ¼ã‚¹ãƒ„リーãŒå¿…è¦ãªã®ã§ recompile # rpmbuild --recompile --define 'community 1' /usr/src/redhat/SRPMS/MySQL-community-5.1.42-0.rhel5.src.rpm checkinstall 㧠rpm 化 make 時㫠MYSQL_LIBDIR ã‚’ã¤ã‘ã¦ã‚‹ã®ã¯ libmysqlclient.s
ãƒã‚¿ã•ã‚“ã®ãƒ–ãƒã‚°(復刻版) : PHPカンファレンス2009「Q4Mã¨Flareを使ã£ã¦ スケーラブルãªã‚µãƒ¼ãƒ“スを作るï¼ã€ã®è³‡æ–™
ã™ã„ã¾ã›ã‚“ã€é…ããªã£ã¦ã„ã¾ã—ãŸãŒã€ã¨ã‚Šã‚ãˆãšã“ã“ã«ç½®ã„ã¦ãŠãã¾ã™ã€‚ ref - http://www.slideshare.net/nowelium/building-highscalable-web-applications-using-q4m-and-flare Building High-Scalable Web Applications Using Q4M and Flare View more documents from nowelium. Ustreamã¯ã“ã®è¾º ref - http://www.ustream.tv/recorded/2107541 ã„ãã¤ã‹è³ªå•ãŒã‚ã£ãŸã‚‚ã®ã¯ã€åˆ¥é€”書ãã¾ã™
mixiã®å¹´æœ«å¹´å§‹å¯¾ç– 日記投稿システムã®æ”¹å–„ - mixi engineer blog
æœæ™©å†·ãˆã¦ãã¾ã—ãŸã。風邪ãªã©å¼•ã„ã¦ã„ã¾ã›ã‚“ã§ã—ょã†ã‹ã€‚ã•ã¦ã€å¹´æœ«ãŒè¿‘ã¥ã„ã¦ãã‚‹ã“ã®æ™‚期ã«å¼Šç¤¾ã®ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ãŒæœ€ã‚‚æ°—ã«ãªã‚‹ã®ã¯ã€ãŠæ£æœˆã€‚ãれもæ¥å¹´1月1日を迎ãˆãŸçž¬é–“ã§ã™ã€‚ 1æ—¥1æ—¥0時ã«ä½•ãŒã‚ã‚‹ã®ã§ã—ょã†ï¼Ÿãã†ã€mixiã®ã‚µãƒ¼ãƒ“スã§æœ€ã‚‚日記ãŒæ›¸ãè¾¼ã¾ã‚Œã‚‹ã‚¿ã‚¤ãƒŸãƒ³ã‚°ã«ãªã‚‹ã®ã§ã™ã€‚個人的ã«ã€Œã‚ã‘ãŠã‚ã“ã¨ã‚ˆã‚アタックã€ã¨å‘¼ã‚“ã§ã„ã¾ã™ã€‚今年ã¯æ—¥è¨˜ã ã‘ã§ã¯ãªãã€ã‚¨ã‚³ãƒ¼ã§ã‚‚メッセージãŒé£›ã³äº¤ã†ã“ã¨ã§ã—ょã†ã€‚ã“ã®æ™‚期ã¯æºå¸¯é›»è©±ã®ã‚ャリアã§ã‚‚ã•ã¾ã–ã¾ãªå¯¾ç–ã‚’è¡Œã£ã¦ã„ã¾ã™ãŒã€ãƒŸã‚¯ã‚·ã‚£ã§ã‚‚年末年始ã§ã‚‚ユーザã®æ–¹ã«å¿«é©ã«ã‚µãƒ¼ãƒ“スæä¾›ãŒã§ãるよã†ã«åŠªã‚ã¦ã„ã¾ã™ 以下ã¯æ˜¨å¹´ã®å¹´æœ«å¹´å§‹ã®æ—¥è¨˜æŠ•ç¨¿æ•°ã®æŽ¨ç§»ã§ã™ã€‚é’色ãŒ12/31ã‹ã‚‰1/1ã€èµ¤è‰²ãŒ1/1ã‹ã‚‰1/2ã«ãªã‚Šã¾ã™ 1/1ã®æ–¹ãŒå…¨ä½“çš„ã«å¤šã„ã§ã™ãŒã€ç‰¹ã«å¹´ãŒå¤‰ã‚ã‚‹å‰å¾Œã®æŠ•ç¨¿æ•°ã¯å€è¿‘ããªã£ã¦ã„ã‚‹ã“ã¨ãŒã‚ã‹ã‚Šã¾ã™ã€‚ã“ã®æ™‚ã«è² è·ã«ã‚ˆã‚Šæ—¥è¨˜ã®æŠ•ç¨¿ãŒã—ã¥ã‚‰ã„状態ã«ãªã£ã¦ã„ãŸã®
Shibuya.pmã§ã—ゃã¹ã£ã¦ãã¾ã—㟠- 最速転è·ç ”究会
é…ããªã£ãŸã‘ã©è³‡æ–™ã€ã¨ã€å‹•ç”»ã€‚最近ã®ãŠä»•äº‹ã«ã¤ã„ã¦è©±ã—ã¾ã—ãŸã€‚ http://svn.coderepos.org/share/docs/mala/20081127-shibuyapm10-lt/index.html http://svn.coderepos.org/share/docs/mala/20081127-shibuyapm10-lt/main.txt 転è·ã¨ã‹é€€è·ã¨ã‹ä½•ã®ã“ã¨ã ã‹è‰¯ã分ã‹ã‚‰ãªã„。
ãƒã‚¿ã•ã‚“ã®ãƒ–ãƒã‚° : Q4Mã‚’PHP(PDO)ã§
Q4MãŒç„¡äº‹ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã§ããŸã®ã§ã€PHPã‹ã‚‰è§¦ã£ã¦ã¿ã‚‹ã€‚詳細ãªã“ã¨ã¯ä»Šåº¦æ›¸ã。ã¨ã‚Šã‚ãˆãšè§¦ã‚Šã ã‘ã§ã‚‚ テーブル定義 drop table if exists hoge_queue; create table hoge_queue( id int not null, name varchar(25) not null ) engine=queue; ã“ã‚“ãªã‚¹ã‚¯ãƒªãƒ—トをガンガン回ã—ã¦ã€ç›£è¦– $conn = new PDO('mysql:host=localhost; dbname=hogetest', 'user', 'password'); $wait = $conn->prepare('SELECT queue_wait("hoge_queue", 10)'); $abort = $conn->prepare('SELECT queue_abort()'); $e = $conn->pr
[æ±äº¬] microblog conference #1ã®å‹•ç”» - TechTalk.jp
2008å¹´8月27æ—¥ã«ã‚µã‚¤ãƒœã‚¦ã‚ºãƒ»ãƒ©ãƒœã‚’ä¼šå ´ã¨ã—ã¦é–‹å‚¬ã•ã‚ŒãŸ Microblog conference#1 ã§ã®Tech Talksを録画ã—ãŸå‹•ç”»ã‚’ニコニコ動画ã«ã‚¢ãƒƒãƒ—ãƒãƒ¼ãƒ‰ã—ã¾ã—ãŸã€‚ ã€ãƒ‹ã‚³ãƒ‹ã‚³å‹•ç”»ã€‘Microblog Conference #1 以下ã€å€‹åˆ¥ã®å‹•ç”»ã¸ã®ãƒªãƒ³ã‚¯ã§ã™ã€‚ サービサー講演 ã€ãƒ‹ã‚³ãƒ‹ã‚³å‹•ç”»ã€‘Inside Echo - kazeburo ã€ãƒ‹ã‚³ãƒ‹ã‚³å‹•ç”»ã€‘Queueueueueue - tokuhirom ミドルウェア講演 ã€ãƒ‹ã‚³ãƒ‹ã‚³å‹•ç”»ã€‘memchached pluggable engine concept - tmaesaka ã€ãƒ‹ã‚³ãƒ‹ã‚³å‹•ç”»ã€‘Q4M a high perfomance message queue for MySQL - kazuho LT ã€ãƒ‹ã‚³ãƒ‹ã‚³å‹•ç”»ã€‘クライアントアプリã®çŸœæŒ - kan ã€ãƒ‹ã‚³ãƒ‹ã‚³å‹•ç”»ã€‘acotieã®ãƒ‰ã‚ドã‚Perlプãƒ
mixi Engineers’ Blog » 期間é™å®šã®æ–°æ©Ÿèƒ½ã€Œã‚¨ã‚³ãƒ¼ã€ç™»å ´
ã“ã‚“ã«ã¡ã¯ã€‚mixi開発部ã®youheiã§ã™ã€‚ 今回ã¯å…ˆæ—¥8月4æ—¥ã«ãƒªãƒªãƒ¼ã‚¹ã—ãŸã€Œã‚¨ã‚³ãƒ¼ã€ã«ã¤ã„ã¦æ›¸ããŸã„ã¨æ€ã„ã¾ã™ã€‚ エコーã¨ã¯ ã¾ãšã¯ã‚¨ã‚³ãƒ¼ã¨ã¯ã©ã†ã„ã†æ©Ÿèƒ½ã‹ã®ã”紹介ã§ã™ãŒã€ãƒ—ãƒãƒ¢ãƒ¼ã‚·ãƒ§ãƒ³ãƒšãƒ¼ã‚¸ãŒã”ã–ã„ã¾ã™ã®ã§ãã¡ã‚‰ã‚’ã”覧ã„ãŸã ã‘ã‚Œã°å¹¸ã„ã§ã”ã–ã„ã¾ã™ã€‚ http://mixi.jp/guide_echo.pl ã„ãã¤ã‹æŠœç²‹ã—ã¾ã™ã¨ã€ ã‚ãªãŸã®"今"を一言ã«ã—ã¦ã¿ã¾ã›ã‚“ã‹ï¼Ÿèª°ã‹ã«ä¼ãˆãŸã„ã“ã¨ã€ã²ã¨ã‚Šã”ã¨ç‰ã€ä½•ã§ã‚‚OKï¼ æ°—è»½ãªæ–°ã‚³ãƒŸãƒ¥ãƒ‹ã‚±ãƒ¼ã‚·ãƒ§ãƒ³æ©Ÿèƒ½ã§ã™ã€‚ ãŸã¨ãˆã°ã€ã€Œä»Šæ—¥ã¯ã„ã„天気ã ãªã€œã€ã¨ã„ã†ã€ã²ã¨ã‚Šã”ã¨ã‹ã‚‰ã€ã€ŒãŠè…¹ã™ã„ãŸãƒ¼ï¼èª°ã‹ãƒ©ãƒ³ãƒã«ã„ã“ã†ã‚ˆï¼ã€ã¨ã„ã†ãƒ¡ãƒƒã‚»ãƒ¼ã‚¸çš„ãªä½¿ã„æ–¹ã¾ã§ã€ã€Œã‚¨ã‚³ãƒ¼ã€ã®æ¥½ã—ã¿æ–¹ã¯ã‚ãªãŸæ¬¡ç¬¬ï¼ マイミクシィåŒå£«ã§ã€Œã‚¨ã‚³ãƒ¼ã€ã‚’使ã†ã¨ãƒ›ãƒ¼ãƒ ã«ãŠäº’ã„ã®æ›¸ãã“ã¿ãŒè¡¨ç¤ºã•ã‚Œã¾ã™ã€‚ æ°—ã«ãªã£ãŸæ›¸ãã“ã¿ã«ã¯ã€è¿”ä¿¡ã™ã‚‹ã“ã¨ã‚‚ã§ãã¡ã‚ƒã„ã¾ã™ã€‚ã‚ãªãŸãŒãµã¨æ›¸ãã“ã‚“ã 一言ã«ã€æ€ã‚ã¬è¿”
Q4M - a Message Queue for MySQL
Q4M (Queue for MySQL) is a message queue licensed under GPL that works as a pluggable storage engine of MySQL, designed to be robust, fast, flexible. It is already in production quality, and is used by several web services (see Users of Q4M). To start using Q4M, download either a binary or source distribution from the install page, and follow the installation instructions. A small tutorial is also
1
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
https://labs.cybozu.co.jp/blog/kazuho/archives/2009/04/mysql_conference_expo_2009.php
https://labs.cybozu.co.jp/blog/kazuho/archives/2008/08/microblogcon1_q4m_081.php
https://labs.cybozu.co.jp/blog/kazuho/archives/2008/05/road_to_mq_with_q4m.php
{{#tags}}- {{label}}
{{/tags}}