LINE Storage: Storing billions of rows in Sharded-Redis and HBase per Month « NAVER Engineers' Blog
Hi, I’m Shunsuke Nakamura (@sunsuk7tp). Just half a year ago, I completed the Computer Science Master’s program in Tokyo Tech and joined to NHN Japan as a member of LINE server team. My ambition is to hack distributed processing and storage systems and develop the next generation’s architecture. In the LINE server team, I’m in charge of development and operation of the advanced storage system whi
check_drbd - Nagios Exchange
Monitoring Made Magically Better Nagios Core on Overdrive Powerful Monitoring Dashboards Time-Saving Configuration Wizards Open Source Powered Monitoring On Steroids And So Much More! +++ Usage: check_drbd [-d ] [-e expect] [-p proc] [-r role] [-o states] [-w states] [-c states] [--debug] Options: -d STRING [default: 0. Example: 0,1,2 ] -p STRING [default: /proc/drbd. Use '-' for stdin] -e STRING
drbd.conf
ストレージã«ã¯å¯¿å‘½ãŒã‚ã‚Šã€ä¿å˜ã•ã‚ŒãŸæƒ…å ±ã¯æ°¸é ã«æ£å¸¸æ€§ã‚’ä¿è¨¼ã•ã‚Œã‚‹ã‚ã‘ã§ã¯ã‚ã‚Šã¾ã›ã‚“。ãã®ç‚ºã«åˆ¥ã®ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã«ãƒ‡ãƒ¼ã‚¿ã‚’ãƒãƒƒã‚¯ã‚¢ãƒƒãƒ—ã—ãŸã‚Šã€ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ãã®ã‚‚ã®ã‚’多é‡åŒ–ã—ã¦ãƒ‡ãƒ¼ã‚¿ã‚’ä¿è·ã™ã‚‹ã“ã¨ãŒé‡è¦ã§ã™ã€‚今回紹介ã™ã‚‹ã¯ã€ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ãƒ‡ãƒã‚¤ã‚¹ã‚’多é‡åŒ–ã—ã€ãƒ‡ãƒ¼ã‚¿ã‚’複数ã®ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã«ä¿å˜ã™ã‚‹ä»•çµ„ã¿ã§ã€DRBD(Distributed Replicated Block Device)ã¨å‘¼ã°ã‚Œã¦ã„ã‚‹ã‚‚ã®ã§ã™ã€‚åŒæ§˜ã®ä»•çµ„ã¿ã«ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ï¼ãƒãƒ¼ãƒ‰ã‚¦ã‚§ã‚¢RAIDãŒã‚ã‚Šã¾ã™ã€‚ DRBD(Distributed Replicated Block Device)ã¨ã¯ã€TCP/IPãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯ã‚’通ã˜ã¦è¤‡æ•°ã®ã‚µãƒ¼ãƒã®ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ï¼ˆãƒ‘ーティション）をリアルタイムã«ãƒŸãƒ©ãƒ¼ãƒªãƒ³ã‚°ï¼ˆè¤‡è£½ï¼‰ã™ã‚‹ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã§ã™ã€‚RAID1ã®ã‚ˆã†ãªãƒŸãƒ©ãƒ¼ãƒ‡ã‚£ã‚¹ã‚¯ã‚’構築ã™ã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚ソフトウェアï¼ãƒãƒ¼ãƒ‰ã‚¦ã‚§ã‚¢RAIDã¯åŒã˜ã‚µãƒ¼ãƒå†…ã®ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã‚’使
CentOS52_DRBDインストールã€åˆæœŸè¨å®š - ベリラボ - wiki
導入環境 †CentOS 5.2 DRBD drbd82-8.2.6-1.el5.centos kmod-drbd82-xen-8.2.6-2 ↑ grub.confã®ãƒãƒƒã‚¯ã‚¢ãƒƒãƒ— †drbdをインストールã™ã‚‹ã¨grub.confãŒæ›¸ãæ›ãˆã‚‰ã‚ŒOSãŒèµ·å‹•ã§ããªããªã‚‹ãŸã‚〠grub.confã‚’ãƒãƒƒã‚¯ã‚¢ãƒƒãƒ—ã—ã¦ãŠãã€drbdインストール後ã€æˆ»ã™ã€‚ â€»åŽŸå› èª¿æŸ»ä¸ã€‚ # cp -ip /boot/grub/grub.conf ~/ ↑
DRBDã¨Heartbeat2ã§MySQLã‚’HA対応ã«ã—ã¦ã¿ã‚‹: 1/4 - DRBDã®ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã¨è¨å®š - - メモ帳
2007/12ã«æ›¸ã„ãŸã‚‚ã®ãŒåŸ‹ã‚‚ã‚Œã¦ã„ãŸã®ã§æ•´ç†ã€‚ DRBDã®ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«æ–¹æ³•ã¯ã€ã„ãã¤ã‹ã‚る。 1. drbd.orgã‹ã‚‰ã‚½ãƒ¼ã‚¹ã‚’ダウンãƒãƒ¼ãƒ‰ã—ã¦ãƒ“ルドã€ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ« 2. LINBIT社æä¾›ã®RPMを利用ã™ã‚‹ï¼ˆæœ‰å„Ÿï¼‰ 3. MySQL Enterpriseã®ã‚ªãƒ—ションを購入ã—ã¦ã€LINBIT社æä¾›ã®RPMを利用ã™ã‚‹ï¼ˆæœ‰æ–™ï¼‰ 4. CentOSã®yumを利用ã™ã‚‹ã€‚（CentOS4.5ã§ã¯Ver.0.7.23ã®ã¿drbd本体ã¨kernel moduleå…±ã«ç”¨æ„ã•ã‚Œã¦ã„ã‚‹ãŒã€CentOS5ã§ã¯Ver.8.0.3ã®drbd本体ã®ã¿ã§kernel moduleã¯æä¾›ã•ã‚Œã¦ã„ãªã„。 ） 5. SUSE Linux（SUSE Linux Professional 9.3以é™ã€SUSE Linux Enterprise Server 9以é™ï¼‰ã§ã¯æ¨™æº–パッケージã¨ã—ã¦æä¾›ã•ã‚Œã¦ã„る（らã—ã„） 今回ã¯ã€ŒL
DRBD+Heartbeat+NFS
ã¾ãšã€DRBDã¨Heartbeatã®æ§‹ç¯‰ã‚’ã—ã¦ãŠãã¾ã™ã€‚ã“ã¡ã‚‰ã¯çœç•¥ã—ã¾ã™ã€‚ 続ã„ã¦ã€Heartbeatã® /etc/ha.d/haresoureces ã®è¨å®šã‚’è¡Œãªã„ã¾ã™ã€‚ # vim /etc/ha.d/haresources testserver1 drbddisk::drbd0 Filesystem::/dev/drbd0::/var/drbd::ext3 IPaddr::192.168.99.3/24/eth0 ã“ã¡ã‚‰ã®è¨å®šã§ DRBD ã®å¾©å¸°ã¨ã€ /dev/drbd0 ã‚’ /var/drbd ã¸ã®ãƒžã‚¦ãƒ³ãƒˆã€ä»®æƒ³IPã®å‰²ã‚Šã‚ã¦ãŒè¡Œãªãˆã¾ã™ã€‚ã‚‚ã¡ã‚ã‚“ã€testserver1ã¨testserver2㧠/var/drbd を作æˆã—ã¦ãŠãå¿…è¦ãŒã‚ã‚Šã¾ã™ã€‚ # mkdir /var/drbd ã“ã®æ®µéšŽã§ä¸€åº¦ heartbeat ã®ãƒ†ã‚¹ãƒˆã‚’ã—ã¾ã™ã€‚testserver1ã§heartbeat
DRBDã®ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«
DRBDã¨ã¯Distributed Replicated Block Deviceã®ç•¥ã§ã€æœ¬å®¶WEBサイト㯠http://www.drbd.org/ã§ã™ã€‚ ブãƒãƒƒã‚¯ãƒ‡ãƒã‚¤ã‚¹å…¨ä½“ã‚’ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯çµŒç”±ã§ãƒŸãƒ©ãƒ¼ãƒªãƒ³ã‚°ã—ã¦ã„ã¾ã™ã€‚ è¦ã¯ã€æ˜”ã¯rsyncã¨cronを利用ã—ã¦ãƒŸãƒ©ãƒ¼ãƒªãƒ³ã‚°ã—ã¦ã„ãŸã‚‚ã®ã‚’ã€DRBDã§ã§ãã¡ã‚ƒã†ã‚ˆã¨ã„ã†ã“ã¨ã§ã™ã€‚ Ruby案件ã§å¿…è¦ã ã£ãŸã®ã§DRBDã¨HeartBeatを利用ã•ã›ã¦ã‚‚らã„ã¾ã—ãŸã€‚ ãªã‹ãªã‹è‹¦æˆ¦ã—ã¾ã—ãŸãŒã€å…ˆé§†è€…ãŒã®ã“ã—ã¦ãã‚Œã¦ã„ã‚‹ã‚ã‚ŠãŒãŸã„æƒ…å ±ã‚’å…ƒã«è¨å®šã‚’è¡Œã£ã¦ã„ãã¾ã—ãŸã€‚ å‚考ã«ã•ã›ã¦ã„ãŸã ã„ãŸã®ã¯ã€ä»¥ä¸‹ã®ã‚µã‚¤ãƒˆã§ã™ã€‚http://www.wbc.co.jp/~drbd/http://www.valinux.co.jp/contents/tech/techlib/eos/drbd_heartbeat/drbd_heartbeat_01.html Webサー
DRBD+heartbeat+LVM(on Fedora Core10)ã«ã‚ˆã‚‹ã‚¯ãƒ©ã‚¹ã‚¿ãƒªãƒ³ã‚°
ã“ã‚“ã«ã¡ã¯ã€äº€æœ¬ã§ã™ã€‚ 今回ã¯ã€PHPã¨ã‹ã‹ã‚‰å°‘ã—離れã¦ã€ã‚µãƒ¼ãƒã®ã‚¯ãƒ©ã‚¹ã‚¿ãƒªãƒ³ã‚°ã®ãŠè©±ã§ã™ã€‚ ã¡ã‚‡ã£ã¨ä»•äº‹ã§å†—長化システムを組む必è¦ãŒã‚ã£ãŸã®ã§ã€ã›ã£ã‹ããªã®ã§è¨˜äº‹ã«ã¾ã¨ã‚ã¾ã—ãŸã€‚ ã•ã¦ã€ã“ã“ã§ç›®æŒ‡ã™ã®ã¯ã€DRBDを使ã£ãŸãƒ‡ãƒ¼ã‚¿ãƒ¬ãƒ—リケーションサーãƒ( Master / Slave æ§‹æˆ )ã®è‡ªå‹•ãƒ•ã‚§ã‚¤ãƒ«ã‚ªãƒ¼ãƒãƒ¼ã‚¯ãƒ©ã‚¹ã‚¿( éžãƒ•ã‚§ã‚¤ãƒ«ãƒãƒƒã‚¯æ§‹æˆ )ã§ã™ã€‚ ãƒãƒƒãƒˆãƒ¯ãƒ¼ã‚¯æ§‹æˆã¨ã—ã¦ã¯ã€ãƒ«ãƒ¼ã‚¿ã‹ã‚‰çµã°ã‚Œã‚‹LAN(eth0ã«æŽ¥ç¶š)ã¨ã¯åˆ¥ã«ã€eth1ã§ï¼‘対１ã®LAN接続を行ã„ã¾ã™ã€‚ ã¾ãŸã€heartbeatã§ã®ã‚¯ãƒ©ã‚¹ã‚¿æ§‹æˆå¾Œã¯ã€eth0ã«ä»®æƒ³IPã¨ã—ã¦192.168.1.100を割り振るよã†ã«ã—ã¾ã™ã€‚ eth1ã®è¨å®šã¯ã€ # vi /etc/sysconfig/network-scripts/ifcfg-eth1 DEVICE=eth1 HWADDR=00:00:00:00:00:00 ONBOOT
ãµãŸã¤ã®å·ã†ã‚‹ãŠã†æ—¥è¨˜ - DRBD 8.xã§åˆæœŸåŒæœŸã‚’スã‚ップã™ã‚‹æ–¹æ³•
<< 2008/11/ 1 2 1. RRDtoolã®ãƒ‡ãƒ¼ã‚¿ãƒ•ã‚¡ã‚¤ãƒ«ã‚’i386ã‹ã‚‰x86_64環境ã¸ç§»è¡Œã™ã‚‹ 3 4 5 1. Seasar Project用ã®Hudsonテスト環境 6 7 8 9 10 1. スパムフィルタã®è¨å®šã‚’壮大ã«é–“é•ãˆã¦ãŸãƒ»ãƒ»ãƒ» 11 12 13 14 15 16 17 18 19 20 21 22 23 24 1. æ±äº¬å·¥æ¥å¤§å¦ã‚¯ãƒãƒ¼ãƒãƒ«COEプãƒã‚°ãƒ©ãƒ â€è¨ˆç®—世界観ã®æ·±åŒ–ã¨å±•é–‹â€ 25 26 27 28 1. DRBD 8.xã§åˆæœŸåŒæœŸã‚’スã‚ップã™ã‚‹æ–¹æ³• 29 1. DRBD 8.3ã‹ã‚‰ã¯16TBã®ãƒ–ãƒãƒƒã‚¯ãƒ‡ãƒã‚¤ã‚¹ã‚’3å°ä»¥ä¸Šã§åŒæœŸã§ãるよã†ã«ãªã‚‹ 30 1. DRBD 8.3ãŒã§ã‚‹ã‚‰ã—ã„ã¨æ›¸ã„ãŸå‚ã‹ã‚‰DRBD 8.3.0 rc1ãŒãƒªãƒªãƒ¼ã‚¹ã•ã‚ŒãŸ >> _ [Server][Admin][Linux] DRBD 8.xã§åˆæœŸåŒæœŸã‚’スã‚ップã™ã‚‹æ–¹æ³•
ウノウラボ Unoh Labs: DRBDã«ã‚ˆã‚‹ã‚³ãƒ³ãƒ†ãƒ³ãƒ„ã®ç›¸äº’ãƒãƒƒã‚¯ã‚¢ãƒƒãƒ—
GT Nitro: Car Game Drag Raceã¯ã€å…¸åž‹çš„ãªã‚«ãƒ¼ã‚²ãƒ¼ãƒ ã§ã¯ã‚ã‚Šã¾ã›ã‚“。ã“ã‚Œã¯ã‚¹ãƒ”ードã€ãƒ‘ワーã€ã‚¹ã‚ル全開ã®ã‚«ãƒ¼ãƒ¬ãƒ¼ã‚¹ã‚²ãƒ¼ãƒ ã§ã™ã€‚ブレーã‚ã¯å¿˜ã‚Œã¦ã€ã“ã‚Œã¯ãƒ‰ãƒ©ãƒƒã‚°ãƒ¬ãƒ¼ã‚¹ã€ãƒ™ã‚¤ãƒ“ーï¼å¤å…¸çš„ãªã‚¯ãƒ©ã‚·ãƒƒã‚¯ã‹ã‚‰æœªæ¥çš„ãªãƒ“ーストã¾ã§ã€æœ€ã‚‚クールã§é€Ÿã„車ã¨ã‚«ãƒ¼ãƒ¬ãƒ¼ã‚¹ã§ãã¾ã™ã€‚スティックシフトをマスターã—ã€ãƒ‹ãƒˆãƒã‚’è³¢ã使ã£ã¦ç«¶äº‰ã‚’打ã¡ç ´ã‚‹å¿…è¦ãŒã‚ã‚Šã¾ã™ã€‚ã“ã®ã‚«ãƒ¼ãƒ¬ãƒ¼ã‚¹ã‚²ãƒ¼ãƒ ã¯ãã®ãƒªã‚¢ãƒ«ãªç‰©ç†å¦ã¨ç´ 晴らã—ã„グラフィックスã§ã‚ãªãŸã®å¿ƒã‚’爆発ã•ã›ã¾ã™ã€‚ã“ã‚Œã¾ã§ãƒ—レイã—ãŸã“ã¨ã®ãªã„よã†ãªã‚‚ã®ã§ã™ã€‚ GT Nitroã¯ã€ãƒªãƒ•ãƒ¬ãƒƒã‚¯ã‚¹ã¨ã‚¿ã‚¤ãƒŸãƒ³ã‚°ã‚’試ã™ã‚«ãƒ¼ãƒ¬ãƒ¼ã‚¹ã‚²ãƒ¼ãƒ ã§ã™ã€‚æ£ã—ã„瞬間ã«ã‚®ã‚¢ã‚’シフトã—ã€ã‚¬ã‚¹ã‚’æ€ã„切りè¸ã‚€å¿…è¦ãŒã‚ã‚Šã¾ã™ã€‚ã¾ãŸã€å¤§ç‰©ãŸã¡ã¨ç«¶ã„ã¤ã¤ã€è»Šã®ãƒãƒ¥ãƒ¼ãƒ‹ãƒ³ã‚°ã¨ã‚¢ãƒƒãƒ—グレードも行ã‚ãªã‘ã‚Œã°ãªã‚Šã¾ã›ã‚“。世界ä¸ã§æœ€é«˜ã®ãƒ‰ãƒ©ã‚¤ãƒãƒ¼ã¨è»Šã¨ã‚«ãƒ¼ãƒ¬ãƒ¼ã‚¹ã«æŒ‘ã‚€ã“ã¨ã«ãªã‚Šã€ãƒ‰ãƒ©ãƒƒã‚°ãƒ¬ãƒ¼ã‚¹ã®çŽ‹å†
1
ランã‚ング
ランã‚ング
メンテナンス
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
Blog
DRBDã¨Heartbeat2ã§MySQLã‚’HA対応ã«ã—ã¦ã¿ã‚‹: 2/4 - DRBDã®ç¨¼åƒãƒ†ã‚¹ãƒˆ - - メモ帳
DRBD:What is DRBD
{{#tags}}- {{label}}
{{/tags}}