Making Apache Airflow Highly Available - Home
In a previous post, we discussed Setting up an Apache Airflow Cluster. In this post we’ll talk about the shortcomings of a typical Apache Airflow Cluster and what can be done to provide a Highly Available Airflow Cluster. A Typical Apache Airflow Cluster In a typical multi-node Airflow cluster you can separate out all the major processes onto separate machines. Here are the main processes: Web Ser
fstaidã¨ã„ã†HAデーモンを作ã£ãŸ - so what
fstaidã¨ã„ã†HAデーモンを作りã¾ã—ãŸã€‚ github.com Heartbeatã¨ã‹Corosyncã¨ã‹Pacemakerã®ä»£æ›¿ã‚’考ãˆã¦ä½œã£ãŸã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã§ã™ã€‚ ãªãœä½œã£ãŸã®ã‹ï¼Ÿ ãã‚Œã»ã©å¤šãã¯ãªã„ã‚“ã§ã™ãŒãŸã¾ã«ã€Œå…ˆæ–¹ã®è¨±å¯ã™ã‚‹IPアドレスã¯ï¼‘ã¤ã—ã‹ãªã„ã‹ã‚‰ã€ãƒ•ã‚§ã‚¤ãƒ«ã‚ªãƒ¼ãƒãƒ¼æ™‚ã«ElasticIPを付ã‘替ãˆã‚‹æ„Ÿã˜ã§ã€ã¨ã„ã†æ¡ˆä»¶ãŒãŸã¾ã«ã‚ã‚‹ã‚“ã§ã™ã‚ˆã€‚ ãã†ã™ã‚‹ã¨ã€ŒCorosync/Pacemakerã§ã‚¯ãƒ©ã‚¹ã‚¿çµ„ã‚€ã‹ã€‚ã ã‚‹ã„ãªâ€¦ã€ã¨ã„ã†ã“ã¨ã«ãªã£ã¦ã€Heartbeat/Corosync/Pacemakerを使ã„ãŸããªã„欲ãŒé«˜ã¾ã£ãŸçµæžœã€ä½œæˆã•ã‚Œã¾ã—ãŸã€‚ Keepalivedã‚„Serfを使ã£ã¦ã‚¯ãƒ©ã‚¹ã‚¿ã‚’組むã“ã¨ã‚‚ã§ãã‚‹ã‚“ã§ã™ãŒã€ã©ã†ã‚‚ã‚„ã‚ŠãŸã„ã“ã¨ã«å¯¾ã—ã¦ã€ã‚ªãƒ¼ãƒãƒ¼ã‚ル感ã¨ã‹æ˜Žå¾Œæ—¥ã®æ–¹å‘æ„ŸãŒã¬ããˆãªã„æ„Ÿã˜ã§ã„ã¾ã—ãŸã€‚ 話ã¯å¤‰ã‚ã£ã¦MHAã§ã™ã€‚ MHAã„ã„ã§ã™ã‚ˆã。安定ã—ãŸå‹•ä½œã‚‚レプリケーショ
mysqlã®HAãŒã‚‰ã¿ã®ãƒˆãƒ©ãƒ–ルã®æ€ã„出 - smallpalace's blog
ã„ーã¤ã®ã“ã¨ãƒ¼ã ã‹ãƒ¼æ€ã„出ã—ã¦ã”ーらんã€ã‚ã‚“ãªã“ã¨ãƒ¼ãã‚“ãªã“ã¨ãƒ¼ã‚ーã£ãŸã§ã—ょー。 ã¨ã„ã†ã‚ã‘ã§ã“ã‚“ã«ã¡ã¯ã€‚smallpalaceã§ã™ã€‚ ã¡ã‚‡ã£ã¨å‰ã«ãƒ†ã‚¯ãƒ‹ã‚«ãƒ«ã‚»ãƒŸãƒŠãƒ¼çš„ãªæ©Ÿä¼šãŒã‚ã£ã¦æ€ã„出ã—ã¦ãã‚Œã¨ã„ã†ã“ã¨ã«ãªã‚Šæ€ã„出ã—ãŸã®ã§ã‹ã‘る範囲ã§æ›¸ã„ã¨ãã¾ã™ã€‚ mysqlã®é‹ç”¨æ™‚ã®ãƒˆãƒ©ãƒ–ルã¾ã¨ã‚。HAãŒã‚‰ã¿ã®ã¨ã“ã‚ã»ã‹é †ä¸åŒã§ã™ã€‚ ãƒ»é«˜è² è·å¾Œã®ã€Œmax_connect_errorsã€ãŒã‚‰ã¿ã§ãƒ›ã‚¹ãƒˆã«ã‚ˆã£ã¦ã¯æ‹’å¦ã•ã‚Œã¦ã‚¢ã‚¯ã‚»ã‚¹ã§ããªã‹ã£ãŸã‚Šãªã©ã€‚対ç–ã¨ã—ã¦ã¯ã€flush hosts;ã¨max_connect_errors=999999999ã§ã‚¨ãƒ©ãƒ¼ã‚«ã‚¦ãƒ³ãƒˆç„¡åŠ¹ã«ãªã‚‹ã‚ˆã†ã§ã™ã€‚ ・主ã«ã‚¯ãƒ©ã‚¦ãƒ‰ä¸Šã§I/Oスパイクã§F/Oã—ã‚„ã™ã„。（I/O共有ãªã®ã§ã—ょã†ãŒãªã„ã§ã™ï¼‰ãƒ™ãƒ³ãƒ€ã«ã‚ˆã£ã¦ã¯DBã ã‘物ç†ã§æ供（ç´æœŸã¯ã‹ã‹ã‚‹ï¼‰ã¨ã„ã†ã®ã‚‚メニューã«ã‚ã£ãŸã‚Šã—ã¦äººæ°—ãŒã‚るよã†ã§ã™ã€‚予算ãŒè¨±ã›ã°ioDriveã¨ã‹ã‚¹ãƒ†ã‚
RabbitMQ 3.1ã®å°Žå…¥ã¨Cluster構æˆã‚’検証ã™ã‚‹
RabbitMQ 3.1ã®å°Žå…¥ã¨å†—長化ã®æ¤œè¨¼ã‚’ã—ãŸã®ã§ãƒ¡ãƒ¢ã€‚ 検証ã®ãŸã‚ã®æ§‹æˆã¯ãƒ•ãƒãƒ³ãƒˆã®APサーãƒãƒ¼ã€RabbitMQãŒå‹•ä½œã™ã‚‹ã‚ューサーãƒãƒ¼ã€ãƒ¯ãƒ¼ã‚«ãƒ¼ãã‚Œãžã‚ŒäºŒå°ã¥ã¤ã€‚ã‚ューサーãƒãƒ¼ãŒç‰‡æ–¹æ»ã‚“ã§ã‚‚全体ãŒå‹•ä½œã—続ã‘られる事ã€ä¸¡æ–¹ãŒãƒ€ã‚¦ãƒ³ã—ãŸã¨ã—ã¦ã‚‚データã¯æ失ã—ãªã„事ãŒç¢ºèªã§ãã‚Œã°è‰¯ã„。è¦ã™ã‚‹ã«å˜ä¸€éšœå®³ç‚¹ã«ãªã‚‰ãªã„よã†ã«RabbitMQを使ã„ãŸã„。 サーãƒãƒ¼ã®æº–å‚™ 仮想マシン6å°ã¯Vagrantを使ãˆã°ä¸€ç™ºã§ç”¨æ„ã§ãã‚‹ã€ãƒ¡ãƒ¢ãƒª16GBç©ã‚“ã§ã¦ã‚ˆã‹ã£ãŸã€‚ホストåを後ã§ã„ã˜ã‚‹ã¨rabbitmqctlã§åœæ¢ãƒ»å†èµ·å‹•ãŒã†ã¾ãã„ã‹ãªããªã£ãŸã€‚ホストå周りã¯EC2ã§ä½¿ã†æ™‚ã«é¢å€’ãªäº‹ã«ãªã‚Šãã†ã 。 å„サーãƒãƒ¼ã® /etc/hosts ã«rabbit1ã¨rabbit2ã¯è¿½åŠ ã—ã¦ãŠã。 RabbitMQ 3.1 ã®ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ« èµ·å‹•ç¢ºèª vagrant@rabbit1:~$ sudo rabbitmq-s
第4回Linux-HA勉強会資料 Pacemakerã®ç´¹ä»‹
1. 第4回Linux-HA 勉強会資料 オープンソースHAクラスタソフトウェア Pacemakerã®ç´¹ä»‹ 2011å¹´9月16æ—¥ Linux-HA Japan プãƒã‚¸ã‚§ã‚¯ãƒˆ http://linux-ha.sourceforge.jp/ 森 啓介 Copyright(c) 2011 Linux-HA Japan Project 2. 自己紹介 ï® åå‰: 森 啓介 (Keisuke MORI) ï° twitter: @ksk_ha ï® Linux-HA Japanプãƒã‚¸ã‚§ã‚¯ãƒˆé–¢é€£ã®æ´»å‹• ï° Pacemaker-1.0ç³»(安定版)ã®ãƒ‘ッãƒãƒ¡ãƒ³ãƒ†ãƒŠ ï® ç¾åœ¨Pacemaker-1.0.12リリースã«å‘ã‘ã¦é‹æ„作æ¥ä¸ã§ã™! ï° æœ¬å®¶Linux-HA開発コミュニティã®ãƒœãƒ¼ãƒ‰ãƒ¡ãƒ³ãƒ(ã§ã‚‚åå‰ã ã‘…) ï® æœ¬æ¥ ï° æ‰€å±žä¼šç¤¾: NTTãƒ‡ãƒ¼ã‚¿å…ˆç«¯æŠ€è¡“æ ªå¼ä¼šç¤¾ ï® æ‰€åœ¨åœ°: 月島 ー ãœã²ã‚‚ã‚“ã˜ã‚ƒã‚’食ã¹ã«
Automating master failover is possible but needs care
I was asked from a few people about my opinion of the Github's recent service outage. As a creator of MHA, I have lots of MySQL failover experiences. Here are my points about failover design. Most of them duplicate with Robert's points. - "Too Many Connections" is not a reason to start automated failover - Do not repeat failover I know some unsuccessful failover stories that "1. failover happens b
Notes on Keepalived and DNS — AntonLindstrom.com
Following the HA trend I created with the last post I though I would write down some notes on high availability DNS with Keepalived. When implementing this I found out that it was poorly documented when using both UDP and TCP traffic. It seems like some people refer to DNS as UDP only. This would disable features like zone transfers and queries over 512 bytes. Keepalived is a load balancer with HA
Data Center High Availability Clusters Design Guide - Data Center High Availability Clusters [Design Zone for Data Centers] - Cisco Systems
Table Of Contents Data Center High Availability Clusters High Availability Clusters Overview HA Clusters Basics HA Clusters in Server Farms Applications Concept of Group LAN Communication Virtual IP Address Public and Private Interface Heartbeats Layer 2 or Layer 3 Connectivity Disk Considerations Shared Disk Quorum Concept Network Design Considerations Routing and Switching Design Importance of t
F5 Networks Japan K.K. - ç©æ¥µçš„ãªå–り組ã¿ã§ã‚µã‚¤ãƒˆã®å®‰å®šæ€§ã¨ä¿¡é ¼æ„ŸNo.1*ã‚’ç²å¾—
F5ã®ã‚µã‚¤ãƒˆ サãƒãƒ¼ãƒˆ ãƒãƒ¼ã‚¿ãƒ« F5製å“ãŠã‚ˆã³ã‚µãƒ¼ãƒ“スã«é–¢ã™ã‚‹ã‚»ãƒ«ãƒ•ã‚µãƒ¼ãƒ“ス ヘルプã®è¨˜äº‹ DevCentral 弊社主催ã®ã‚³ãƒŸãƒ¥ãƒ‹ãƒ†ã‚£ã§ã¤ãªãŒã‚Šã€å¦ã¶ My F5 サブスクリプションãŠã‚ˆã³ç™»éŒ²ã‚ーã®ç®¡ç† Partner Central F5パートナーã®ãŸã‚ã®ãƒªã‚½ãƒ¼ã‚¹ãŠã‚ˆã³ã‚µãƒãƒ¼ãƒˆ ãƒãƒ¼ã‚¿ãƒ« LearnF5 Learn to use F5 products F5ã¸ã®ãŠå•ã„åˆã‚ã› F5販売担当部ã¸ã®ãŠå•ã„åˆã‚㛠詳ã—ãã¯ã€F5ã®å–¶æ¥æ‹…当社ã«ãŠå•ã„åˆã‚ã›ãã ã•ã„ F5サãƒãƒ¼ãƒˆã¸ã®ãŠå•ã„åˆã‚ã› ãŠè¿‘ãã®ã‚µãƒãƒ¼ãƒˆæ‹…当者ã«ãŠå•ã„åˆã‚ã›ãã ã•ã„ プãƒãƒ•ã‚§ãƒƒã‚·ãƒ§ãƒŠãƒ«ã‚µãƒ¼ãƒ“スã¸ã®ãŠå•ã„åˆã‚ã› F5ソリューションを最é©åŒ–ã™ã‚‹ãŸã‚ã®ã‚µãƒãƒ¼ãƒˆã‚’å—ã‘ã‚‹ 無料トライアル 複数ã®ç’°å¢ƒã«ã‚ãŸã‚Šã‚¢ãƒ—リケーションã®å®‰å…¨æ€§ã€é€Ÿåº¦ã€ä¿¡é ¼æ€§ã‚’確ä¿ã™ã‚‹ã“れらã®è£½å“ã‚’ã€ç„¡æ–™ã§ãŠè©¦ã—ãã ã•ã„。 F5 Distributed Clou
HA構æˆã¨å¾©æ—§ä½œæ¥æ™‚é–“ã¨ä¿¡é ¼æ€§ - kazuhoã®ãƒ¡ãƒ¢ç½®ãå ´
ï¼’å°ã§HAノードを組んã§ã„ã¦ï¼‘å°ãŒè½ã¡ãŸå ´åˆã«ã€ä½•æ™‚間以内ã«å†åº¦ï¼’å°æ§‹æˆã«å¾©å¸°ã•ã›ã‚‹å¿…è¦ãŒã‚ã‚‹ã®ã‹ãªãƒ¼ã¨æ€ã£ã¦ã€ã¡ã‚‡ã£ã¨è¨ˆç®—ã—ã¦ã¿ãŸã€‚ノード毎ã®éšœå®³ç™ºç”Ÿã®ç¢ºçŽ‡ãŒç‹¬ç«‹ã§ã‚ã‚‹ã¨ä»®å®šã™ã‚‹ã¨ã€ $ perl -le 'print exp(log($ARGV[0])/(365*24))**$ARGV[1]' 0.97 1 0.999996522927565ã®ã‚ˆã†ã«ã€ã‚µãƒ¼ãƒã®éšœå®³ç™ºç”ŸçŽ‡ãŒ 3%/year ã§ã€ã‹ã¤å¾©æ—§ã«ï¼‘時間ã‹ã‹ã‚‹å ´åˆã€å¾©æ—§ä¸ã«æ®‹å˜ãƒŽãƒ¼ãƒ‰ã«ã‚‚障害ãŒç™ºç”Ÿã—ã¦ã‚µãƒ¼ãƒ“スãŒåœæ¢ã™ã‚‹å¯èƒ½æ€§ã¯ 0.001% 以下。 $ perl -le 'print exp(log($ARGV[0])/(365*24))**$ARGV[1]' 0.97 24 0.999916553598325ï¼’å°æ§‹æˆã«æˆ»ã‚‹ã¾ã§24時間ã‹ã‹ã‚‹å ´åˆã ã¨ã€ç´„0.01%。 $ perl -le 'print exp(log($ARGV[
最強ã®MySQL HA化手法 - Semi-Synchronous Replication
MySQL 6.0ã§æ載ã•ã‚Œã‚‹äºˆå®šã®æ©Ÿèƒ½ã®ä¸€ã¤ã«ã€Semi-Synchronous Replicationã¨ã„ã†ã‚‚ã®ãŒã‚る。コイツを使ã†ã¨ã¨ã‚“ã§ã‚‚ãªã凄ã„HA化ãŒã§ãã‚‹ã®ã§ã€ä»Šæ—¥ã¯ãã®æ–¹æ³•ã‚’紹介ã—よã†ã€‚ ã¾ãšã¯Semi-Synchronous Replicationã®æ©Ÿèƒ½èª¬æ˜Žã‹ã‚‰ã€‚ãã‚‚ãã‚‚Semi-Synchrounousã£ã¦ãƒŠãƒ‹ï¼Ÿã©ã†ã—ã¦å®Œå…¨ãªåŒæœŸã§ã‚‚ãªãéžåŒæœŸã§ã‚‚ãªãSemi-Synchronousãªã®ï¼Ÿã¨ã„ã†ç–‘å•ã‚’ã¾ãšã¯è§£æ¶ˆã—ãŸã„ã¨æ€ã†ã€‚ã•ã£ãã次ã®å›³ã‚’見ã¦æ¬²ã—ã„。 ã“ã‚Œã¯Semi-Synchronous Replicationã®å‹•ä½œã‚’図ã§è¡¨ã—ãŸã‚‚ã®ã§ã‚る。図ã ã‘ã§ã¯ãªã‚“ã ã‹ã‚ˆã分ã‹ã‚‰ãªã„ã¨æ€ã†ã®ã§ã€ä»¥ä¸‹ã«å„ステップã®è©³ç´°ã‚’説明ã™ã‚‹ã€‚ アプリケーション（クライアント）ã‹ã‚‰ãƒˆãƒ©ãƒ³ã‚¶ã‚¯ã‚·ãƒ§ãƒ³ã‚’COMMITè¦æ±‚を出ã™ã€‚ ãƒã‚¤ãƒŠãƒªãƒã‚°ã‚’æ›´æ–°ã™ã‚‹ã€‚ ストレージエンジン（テーブル）を更新ã™ã‚‹ã€‚
Zero-Downtime Restarts with HAProxy - igvita.com
By Ilya Grigorik on December 02, 2008 Putting up a maintenance page while you are doing an update and restarting your application servers is good practice, but it definitely hurts the user experience. This, in turn, translates to less frequent releases and frustration for both the developer and the users (release often, release early!). To address this, the Rails community has come up with a coupl
ldirectordã§ã€LVS（Linux Virtual Server）ã«ã‚ˆã‚‹è² è·åˆ†æ•£ã‚·ã‚¹ãƒ†ãƒ ã®æ§‹ç¯‰
EnterpriseZine（エンタープライズジン）編集部ã§ã¯ã€æƒ…å ±ã‚·ã‚¹ãƒ†ãƒ æ‹…å½“ã€ã‚»ã‚ュリティ担当ã®æ–¹ã€…å‘ã‘ã«ã€EnterpriseZine Dayã€Security Online Dayã€DataTechã¨ã„ã†ã€3ã¤ã®ã‚¤ãƒ™ãƒ³ãƒˆã‚’開催ã—ã¦ãŠã‚Šã¾ã™ã€‚ãã‚Œãžã‚Œç·¨é›†éƒ¨ç‹¬è‡ªã®åˆ‡ã‚Šå£ã§ã€æ¥ç•Œãƒˆãƒ¬ãƒ³ãƒ‰ã‚„最新事例を網羅。最新ã®å‹•å‘を知るã“ã¨ãŒã§ãã‚‹å ´ã¨ã—ã¦ã€å¥½è©•ã‚’å¾—ã¦ã„ã¾ã™ã€‚
Heartbeatã®ç‰¹å¾´ã¨ãƒ¦ãƒ‹ãƒ¼ã‚¯ãªæ©Ÿèƒ½
ã¯ã˜ã‚㫠今回ã‹ã‚‰æ•°å›žã«ã‚ãŸã£ã¦ã€ã‚ªãƒ¼ãƒ—ンソースã®HA（高å¯ç”¨æ€§ï¼‰ã‚¯ãƒ©ã‚¹ã‚¿æ§‹ç¯‰ã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã€ŒHeartbeatã€ã‚’é¡Œæã«ã—ã¦ã€ã€Œã‚¯ãƒ©ã‚¹ã‚¿ãƒªãƒ³ã‚°ã¨ã¯ä½•ã‹ï¼Ÿã€ã¨ã„ã†ã¨ã“ã‚ã‹ã‚‰ã€Heartbeat自体ã®è§£èª¬ã€Heartbeatを用ã„ã¦ã®HAクラスタã®æ§‹ç¯‰ã€ãƒ¢ãƒ‹ã‚¿ãƒªãƒ³ã‚°ãªã©ã«ã¤ã„ã¦è§£èª¬ã—ã¦ã„ããŸã„ã¨æ€ã„ã¾ã™ã€‚皆ã•ã‚“ãŠä»˜ãåˆã„ã®ã»ã©ã€ã‚ˆã‚ã—ããŠé¡˜ã„ã„ãŸã—ã¾ã™ã€‚ クラスタリングã£ã¦ä½•ã ã‚ã†ï¼Ÿ ã¾ãšã€ã€Œã‚¯ãƒ©ã‚¹ã‚¿ãƒªãƒ³ã‚°ã¨ã¯ä½•ã‹ã€ã¨ã„ã†ã¨ã“ã‚ã‹ã‚‰å§‹ã‚ã¦ã¿ã¾ã—ょã†ã€‚ã“ã®è³ªå•ã«ç°¡å˜ã«ç”ãˆã¦ã—ã¾ã†ã¨ã€Œã‚るミッションã«å¯¾ã—ã€è¤‡æ•°ã®ã‚³ãƒ³ãƒ”ュータ（群ï¼ã‚¯ãƒ©ã‚¹ã‚¿ï¼‰ã‚’ã‚‚ã£ã¦å¯¾å‡¦ã™ã‚‹æ§‹æˆã€ã ã¨ã„ãˆã¾ã™ã€‚ã§ã™ãŒã€çŠ¶æ³ã«å¿œã˜ã¦ã•ã¾ã–ã¾ãªãƒŸãƒƒã‚·ãƒ§ãƒ³ã®ã‚¿ã‚¤ãƒ—ãŒã‚ã‚Šã¾ã™ã‹ã‚‰ã€ãã‚Œã«å¯¾ã™ã‚‹ã‚¯ãƒ©ã‚¹ã‚¿ãƒªãƒ³ã‚°ï¼ˆæ§‹æˆï¼‰ã‚‚自然ã¨å¤‰ã‚ã£ã¦ãã¾ã™ã€‚ ãªãŠã€Linuxã§ã®ã‚¯ãƒ©ã‚¹ã‚¿ãƒªãƒ³ã‚°ã®æ´å²ã¯æ„外ã¨å¤ãã¾ã§ã•ã‹ã®ã¼ã‚‹ã“ã¨ãŒã§ãã¾ã™ã€‚ç´„åå¹´å‰ã®é›‘誌ã§ã™ã§
1
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
æ ªå¼ä¼šç¤¾TAP
æ ªå¼ä¼šç¤¾TAP
âš¡ Page Not Found
http://backhand.org/wackamole/
{{#tags}}- {{label}}
{{/tags}}