SlideShare a Scribd company logo

1台から500台までのMySQL運用 MySQL Beginners

•Download as KEY, PDF•
•
Masahiro Nagano
Masahiro Nagano
1 of 20
Downloaded 181 times
1台から500台までの MySQL運用 MySQL Beginners Talks #1
Me •長野雅広 •@kazeburo •Operations Engineer, NHN Japan (livedoor) •MySQL歴10年の初心者
お詫びと訂正 $title = s/500台/400台弱/
Our Service (livedoor) 2011年9月26日月曜日
On-Demand WorkforceWorkforce On-Demand On-Demand Workforce On-Demand Workforce On-Demand Workforce Our Service (livedoor) Amazon MechanicalAmazon Mechanical Turk Mechanical Turk Amazon Mechanical Turk Mechanical Turk Turk Amazon Amazon t/ Workers Workers Requester Requester On-Demand WorkforceWorkforce On-Demand On-Demand Workforce On-Demand Workforce On-Demand Workforce Amazon MechanicalAmazon Mechanical Turk Mechanical Turk Amazon Mechanical Turk Mechanical Turk Turk Amazon Amazon Amazon Amazon Human Intelligence IntelligenceIntelligence Human Intelligence Workers Workers Workers Workers Amazon Human Amazon Human Amazon Human Intelligence WorkersAssignment/ Assignment/Assignment/ Assignment/ Assignment/ Requester Requester Requester Requester Requester quester Requester Mechanical MechanicalMechanicalMechanical Turk Tasks (HIT) Mechanical Turk Turk Tasks Turk TasksTurk Tasks (HIT) (HIT) (HIT) Task Task Tasks (HIT) Task Task Task On-Demand WorkforceWorkforce On-Demand Amazon Mechanical Turk Amazon Mechanical Turk Amazon Amazon Human Intelligence IntelligenceIntelligence Human Intelligence Workers Workers Workers Workers Amazon Human Amazon Human Amazon Human Intelligence WorkersAssignment/ Assignment/Assignment/ Assignment/ Assignment/ Requester Requester Requester Requester Requester Non-Service Specific Specific Specific Specific Specific TasksTask Non-Service Tasks Non-Service Tasks (HIT) Non-Service TasksNon-Service Tasks (HIT) (HIT) (HIT) Task Task (HIT) Task Task Mechanical Turk Mechanical MechanicalMechanicalMechanical Turk Turk Turk Turk Mobile ClientMultimedia MultimediaCorporate CorporateTraditional Traditional bile Client data center data center server server r Requester Non-Service On-Demand WorkforceWorkforce Non-Service On-Demand Non-Service On-Demand Workforce Non-Service Specific Specific Specific Specific Specific Non-Service Amazon MechanicalAmazon Mechanical Turk Amazon Mechanical Turk Turk Amazon Amazon Human Intelligence Intelligence Human Assignment/Assignment/ Workers Workers Requester Requester Mechanical Turk Tasks (HIT) Tasks (HIT) Mechanical Turk Task Task User User Users User Users User Users User Client Users Client Mobile Client Client Users Client Mobile ClientMultimedia MultimediaCorporate Multimedia Multimedia Traditional Traditional Traditional Traditional Client Mobile Client Multimedia CorporateTraditional Corporate Corporate Mobile Client Mobile Client Corporate Corporate CorporateTraditional Traditional Traditional Multimedia Corporate data center data center data centerdata centerdata center server server server server server data centerExample: data center server xample: data center server uester server M Add-on IAM Add-on Non-Service Specific Specific Non-Service User User Users User Users User Users User Client Users Client Mobile Client Client Users Client Mobile ClientMultimedia MultimediaCorporate Multimedia Multimedia Traditional Traditional Traditional Traditional Client Mobile Client Multimedia CorporateTraditional Corporate Corporate Mobile Client Mobile Client Corporate Amazon Amazon Human Intelligence IntelligenceIntelligence Amazon Human HumanAssignment/Assignment/ Workers data center data center data centerdata centerdata center server Requester server Assignment/ Workers Workers Requester server Requester server server Mechanical Mechanical Turk Tasks (HIT)Tasks (HIT) Mechanical Turk Turk Tasks (HIT) Task Task Task ester Requester Internet Internet Management AWS Internet Internet IAM Add-on IAM Add-onIAM Add-on Example: Example: Example: Example: AWS Internet AWS ManagementManagement AWS Management Add-on AWS ManagementExample: IAM IAM Add-on mediaCorporate rights reserved. rvices LLC or All CorporateTraditional Traditional or its affiliates. its affiliates. All rights reserved. Console Console Console Console Console IAM Add-on IAM Add-onIAM Add-on IAM Add-onIAM Add-on data center data center server server Non-Service Specific Specific Specific Non-Service Non-Service User User Users Users Client Client Mobile Client Mobile ClientMultimedia MultimediaCorporate CorporateTraditional Traditional Internet Internet Management AWS Internet Internet IAM Add-on IAM Add-onIAM Add-on Example: Example: Example: Example: AWS Internet AWS ManagementManagement AWS Management Add-on AWS ManagementExample: IAM IAM Add-on data center data center server server Console Console Console Console Console IAM Add-on IAM Add-onIAM Add-on IAM Add-on IAM Add-on CorporateTraditional Traditional Traditional Corporate data center data center server server server ©2011 Amazon Web Services LLC©2011affiliates. its affiliates.its affiliates. AllLLC orreserved. reserved. reserved. ©2011 Amazon Web ServicesAmazon All Amazon Web Servicesaffiliates. All rights All rights ©2011 Amazon Web Servicesrightsor All LLC orreserved. its affiliates. or its LLC or Web Services rights its rights ©2011 LLC reserved. d. reserved. hts User User Users User Users Users Client Client Client Mobile ClientMultimedia MultimediaCorporate CorporateTraditional Traditional Traditional Mobile Client Mobile Client Multimedia Corporate Internet data center data center data center server Internet Amazon AWS Services LLC©2011affiliates. its affiliates.its affiliates. AllLLC orreserved. reserved. reserved. server server ultimedia CorporateTraditional Traditional Traditional rporate Corporate ©2011 Management ©2011 Amazon WebIAM Add-onServices LLCExample: AWS ©2011 Amazon Web ServicesAmazon All Amazon Web Servicesaffiliates. All rights All rights Web Management or its LLC or Web Example: orreserved. its affiliates. IAM Add-on Servicesrightsor All rights its rights ©2011 LLC reserved. a center data center data center server server server Console Console IAM Add-on IAM Add-on served. Internet Internet Management AWS Internet AWS Management Add-on IAM Add-onIAM Add-on Example: Example: AWS Management IAM Example: 2011年9月26日月曜日 ©2011 Amazon Web Services LLC or its affiliates. its affiliates. All rights reserved. ©2011 Amazon Web Services LLC or All rights reserved. Console Console Console IAM Add-on IAM Add-onIAM Add-on .
Amazon Mechanical Turk On-Demand WorkforceWorkforce On-Demand On-Demand Workforce On-Demand Workforce On-Demand Workforce On-Demand W On-Demand Workforce Our Service (livedoor) Amazon MechanicalAmazon Mechanical Turk Mechanical Turk Amazon Mechanical Turk Mechanical Turk Turk Amazon Amazon Amazon Mech t/ Workers AmazonWorkers Requester Requester Mechanical Turk Amazon Human Intelligence Assignment/ Workers Requester Mechanical Turk Tasks (HIT) Task On-Demand WorkforceWorkforce On-Demand On-Demand Workforce On-Demand Workforce On-Demand Workforce On-Demand W Amazon MechanicalAmazon Mechanical Turk Mechanical Turk Amazon Mechanical Turk Mechanical Turk Turk Amazon Amazon Amazon Mech Non-Service Specific On-Demand Workforce Amazon Amazon Human Intelligence IntelligenceIntelligence Human Intelligence Workers Workers Workers Workers Amazon Human Amazon Human Amazon Human Intelligence WorkersAssignment/ Assignment/Assignment/ Assignment/ Assignment/ Requester Requester Requester Requester Requester Amazon quester Requester Amazon Mechanical Turk Mechanical MechanicalMechanicalMechanical Turk Tasks (HIT) Mechanical Turk Human Intelligence Turk Tasks Turk TasksTurk Tasks (HIT) Requester Task Assignment/ (HIT) (HIT) Workers Task Task Tasks (HIT) Task Task Mechanical Turk Amazon Mechanical Turk Tasks (HIT) TaskOn-Demand WorkforceWorkforce On-Demand On-Demand Workforce Amazon Mechanical Turk Amazon Mechanical Turk Amazon Mechanical Tu Amazon Amazon Human Intelligence IntelligenceIntelligence Human Intelligence Workers Workers Workers Workers Amazon HumanAmazon HumanAmazon Human Intelligence WorkersAssignment/ Assignment/Assignment/ Assignment/ Assignment/ Requester Requester Requester Requester Requester Non-Service Specific Specific Specific Specific Specific TasksTask Non-Service Tasks Non-Service Tasks (HIT) Non-Service TasksNon-Service Tasks (HIT) Non-Service S Amazon Mechanical Turk (HIT) (HIT) Task Mechanical MechanicalMechanicalMechanical Turk Turk Turk Turk Task (HIT) Task Task Non-Service Multimedia MultimediaCorporate User Mobile ClientSpecific bile Client CorporateTraditional Users Traditional Mechanical Turk Client Mobile Client Multimedia Corporate Traditional data center data center server server data center server r Requester Amazon Human Intelligence Assignment/ Workers Requester Mechanical Turk Non-Service On-Demand Workforce On-Demand Workforce Tasks (HIT) Non-ServiceTask Non-Service On-Demand Workforce Non-Service Specific Specific Specific Specific Specific Non-Service Non-Service S Amazon MechanicalAmazon Mechanical Turk Amazon Mechanical Turk Turk On-Demand Workforce Amazon Amazon Human Intelligence Intelligence Human Assignment/Assignment/ Workers Workers Requester Requester H Amazon Amazon Mechanical Turk Mechanical Turk Tasks (HIT) Tasks (HIT) Mechanical Turk Task Task User User Users User Users User Users User Client Users Client Mobile ClientMultimedia MultimediaCorporate Multimedia Multimedia Traditional Traditional Traditional Mechanical Turk Client Mobile Client Client Users Client Mobile Client Multimedia CorporateTraditional Corporate Corporate Mobile Client Mobile Client Corporate Traditional User Non-Service Specific Corporate User Multimedia CorporateTraditional Users Corporate Traditional Traditional Client Multimedia Corporate Traditional data center data center data centerdata centerdata center server server server server server Mobile Client data centerExample: data center server xample: data center server uester serverInternet AWS Management IAM Add-on Example: data center server On-Demand Workforce M Add-on IAM Add-on Console IAM Add-on Amazon Mechanical Turk Non-Service Specific Specific Non-Service Non-Service Specific User User Users User Users User Users User Client Users Client Mobile Client Client Users Client Mobile ClientMultimedia MultimediaCorporate Multimedia Multimedia Traditional Traditional Traditional Traditional Client Mobile Client Multimedia CorporateTraditional Corporate Corporate Mobile Client Mobile Client Corporate data center data center data centerdata centerdata center server User Amazon Amazon Human Intelligence IntelligenceIntelligence Amazon Human HumanAssignment/Assignment/ Workers Assignment/ Workers Workers Requester server Requester server Requester server server Mechanical Mechanical Turk Tasks (HIT)Tasks (HIT) Mechanical Turk Turk Tasks (HIT) Task Task Task ester Requester Amazon Human Intelligence Assignment/ Workers Requester Mechanical Turk Tasks (HIT) Internet Internet Management TaskAWS Internet Internet IAM Add-on IAM Add-onIAM Add-on Example: Example: Example: Example: AWS Internet AWS Management Management AWS Management Add-on AWS ManagementExample: IAM IAM Add-on Internet mediaCorporate affiliates. All rights reserved. rvices LLC or All CorporateTraditional Traditional or its affiliates. its rights reserved. User Users Client ©2011 Amazon Web Multimedia Corporate Add-on Traditional Mobile Console Console Console or its affiliates.IAMrights reserved. IAM Add-on Client Services LLC All dataInternet data center server center AWS Management server IAM Add-on Console Example: Console IAM Add-on IAM Add-on data center IAM Add-on server Console IAM Add-on Non-Service Specific Specific Specific Non-ServiceNon-Service Amazon Human User User Users Users Client Client Mobile Client Mobile Client Multimedia MultimediaCorporate CorporateTraditional Traditional Mechanical Turk User Tas Non-Service Specific Internet Internet Management AWS Internet Internet IAM Add-on IAM Add-onIAM Add-on Example: Example: Example: Example: AWS Internet AWS Management Management AWS Management Add-on AWS ManagementExample: IAM IAM Add-on data center data center server server Internet Console Console Console Console Console IAM Add-on IAM Add-onIAM Add-on IAM Add-on IAM Add-on CorporateTraditional Traditional Traditional Corporate data center data center server server server ©2011 Amazon Web Services LLC©2011affiliates. its affiliates.its affiliates. AllLLC orreserved. reserved. reserved. ©2011 Amazon Web ServicesAmazon All Amazon Web Servicesaffiliates. All rights All rights ©2011 Amazon Web Servicesrightsor All LLC orreserved. its affiliates. or its LLC or Web Services rights its rights ©2011 LLC reserved. Non-Service Specific d. reserved. hts ©2011 Amazon Web Services LLC or its affiliates. All rights reserved. Internet AWS Management IAM Add-on Example: Console IAM Add-on User User Users User Users Users Client Client Mobile Client Client Mobile ClientMultimedia MultimediaCorporate CorporateTraditional Traditional Traditional Mobile Client Multimedia Corporate Internet data center data center data center server Internet Amazon AWS Services LLC©2011affiliates. its affiliates.its affiliates. AllLLC orreserved. reserved. reserved. server server ultimedia CorporateTraditional Users rporate User Corporate Traditional Traditional Client ©2011 Management ©2011 Amazon WebIAM Add-onServices LLCExample: AWS ©2011 Amazon Web ServicesAmazon All Amazon Web Servicesaffiliates. All rights All rights Web Management or its CorporateWeb Example: orreserved. its affiliates. Multimedia IAM Add-on Servicesrightsor All rights its rights LLC or ©2011 LLC reserved.Traditional Internet AWS Mobile Client Console Console IAM Add-on IAM Add-on a center data center data center server server server data center server C served. User Use ©2011 Amazon Web Services LLC or its affiliates. All rights reserved. Internet Internet Management AWS Internet AWS Management Add-on IAM Add-onIAM Add-on Example: Example: AWS Management IAM Example: 2011年9月26日月曜日 ©2011 Amazon Web Services LLC or its affiliates. its affiliates. All rights reserved. ©2011 Amazon Web Services LLC or All rights reserved. Console Console Console IAM Add-on IAM Add-onIAM Add-on Internet AWS Management IAM Add-on Example: Console IAM Add-on . Internet AWS Mana
Amazon Mechanical Turk On-Demand WorkforceWorkforce On-Demand On-Demand Workforce On-Demand Workforce On-Demand Workforce On-Demand W On-Demand Workforce Our Service (livedoor) Amazon MechanicalAmazon Mechanical Turk Mechanical Turk Amazon Mechanical Turk Mechanical Turk Turk Amazon Amazon Amazon Mech t/ Workers AmazonWorkers Requester Requester Mechanical Turk Amazon Human Intelligence Assignment/ Workers Requester Mechanical Turk Tasks (HIT) Task On-Demand WorkforceWorkforce On-Demand On-Demand Workforce On-Demand Workforce On-Demand Workforce On-Demand W Amazon MechanicalAmazon Mechanical Turk Mechanical Turk Amazon Mechanical Turk Mechanical Turk Turk Amazon Amazon Amazon Mech Non-Service Specific On-Demand Workforce Amazon Amazon Human Intelligence IntelligenceIntelligence Human Intelligence Workers Workers Workers Workers Amazon Human Amazon Human Amazon Human Intelligence WorkersAssignment/ Assignment/Assignment/ Assignment/ Assignment/ Requester Requester Requester Requester Requester Amazon quester Requester Amazon Mechanical Turk Mechanical MechanicalMechanicalMechanical Turk Tasks (HIT) Mechanical Turk Human Intelligence Turk Tasks Turk TasksTurk Tasks (HIT) Requester Task Assignment/ (HIT) (HIT) Workers Task Task Tasks (HIT) Task Task Mechanical Turk Amazon Mechanical Turk Tasks (HIT) TaskOn-Demand WorkforceWorkforce On-Demand On-Demand Workforce Amazon Mechanical Turk Amazon Mechanical Turk Amazon Mechanical Tu Amazon Amazon Human Intelligence IntelligenceIntelligence Human Intelligence Workers Workers Workers Workers Amazon HumanAmazon HumanAmazon Human Intelligence WorkersAssignment/ Assignment/Assignment/ Assignment/ Assignment/ Requester Requester Requester Requester Requester Non-Service Specific Specific Specific Specific Specific TasksTask Non-Service Tasks Non-Service Tasks (HIT) Non-Service TasksNon-Service Tasks (HIT) Non-Service S Amazon Mechanical Turk (HIT) (HIT) Task Mechanical MechanicalMechanicalMechanical Turk Turk Turk Turk Task (HIT) Task Task Non-Service Multimedia MultimediaCorporate User Mobile ClientSpecific bile Client CorporateTraditional Users Traditional Mechanical Turk Client Mobile Client Multimedia Corporate Traditional data center data center server server data center server r Requester Amazon Human Intelligence Assignment/ Workers Requester Mechanical Turk Non-Service On-Demand Workforce On-Demand Workforce Tasks (HIT) Non-ServiceTask Non-Service On-Demand Workforce Non-Service Specific Specific Specific Specific Specific Non-Service Non-Service S Amazon MechanicalAmazon Mechanical Turk Amazon Mechanical Turk Turk On-Demand Workforce Amazon Amazon Human Intelligence Intelligence Human Assignment/Assignment/ Workers Workers Requester Requester H Amazon Amazon Mechanical Turk Mechanical Turk Tasks (HIT) Tasks (HIT) Mechanical Turk Task Task User User Users User Users User Users User Client Users Client Mobile ClientMultimedia MultimediaCorporate Multimedia Multimedia Traditional Traditional Traditional Mechanical Turk Client Mobile Client Client Users Client Mobile Client Multimedia CorporateTraditional Corporate Corporate Mobile Client Mobile Client Corporate Traditional User Non-Service Specific Corporate User Multimedia CorporateTraditional Users Corporate Traditional Traditional Client Multimedia Corporate Traditional data center data center data centerdata centerdata center server server server server server Mobile Client data centerExample: data center server xample: data center server uester serverInternet AWS Management IAM Add-on Example: data center server On-Demand Workforce M Add-on IAM Add-on Console IAM Add-on Amazon Mechanical Turk Non-Service Specific Specific Non-Service Non-Service Specific User User Users User Users User Users User Client Users Client Mobile Client Client Users Client Mobile ClientMultimedia MultimediaCorporate Multimedia Multimedia Traditional Traditional Traditional Traditional Client Mobile Client Multimedia CorporateTraditional Corporate Corporate Mobile Client Mobile Client Corporate data center data center data centerdata centerdata center server User Amazon Amazon Human Intelligence IntelligenceIntelligence Amazon Human HumanAssignment/Assignment/ Workers Assignment/ Workers Workers Requester server Requester server Requester server server Mechanical Mechanical Turk Tasks (HIT)Tasks (HIT) Mechanical Turk Turk Tasks (HIT) Task Task Task ester Requester Amazon Human Intelligence Assignment/ Workers Requester Mechanical Turk Tasks (HIT) Internet Internet Management TaskAWS Internet Internet IAM Add-on IAM Add-onIAM Add-on Example: Example: Example: Example: AWS Internet AWS Management Management AWS Management Add-on AWS ManagementExample: IAM IAM Add-on Internet mediaCorporate affiliates. All rights reserved. rvices LLC or All CorporateTraditional Traditional or its affiliates. its rights reserved. User Users Client ©2011 Amazon Web Multimedia Corporate Add-on Traditional Mobile Console Console Console or its affiliates.IAMrights reserved. IAM Add-on Client Services LLC All dataInternet data center server center AWS Management server IAM Add-on Console Example: Console IAM Add-on IAM Add-on data center IAM Add-on server Console IAM Add-on Non-Service Specific Specific Specific Non-ServiceNon-Service Amazon Human User User Users Users Client Client Mobile Client Mobile Client Multimedia MultimediaCorporate CorporateTraditional Traditional Mechanical Turk User Tas Non-Service Specific Internet Internet Management AWS Internet Internet IAM Add-on IAM Add-onIAM Add-on Example: Example: Example: Example: AWS Internet AWS Management Management AWS Management Add-on AWS ManagementExample: IAM IAM Add-on data center data center server server Internet Console Console Console Console Console IAM Add-on IAM Add-onIAM Add-on IAM Add-on IAM Add-on CorporateTraditional Traditional Traditional Corporate data center data center server server server ©2011 Amazon Web Services LLC©2011affiliates. its affiliates.its affiliates. AllLLC orreserved. reserved. reserved. ©2011 Amazon Web ServicesAmazon All Amazon Web Servicesaffiliates. All rights All rights ©2011 Amazon Web Servicesrightsor All LLC orreserved. its affiliates. or its LLC or Web Services rights its rights ©2011 LLC reserved. Non-Service Specific d. reserved. hts ©2011 Amazon Web Services LLC or its affiliates. All rights reserved. Internet AWS Management IAM Add-on Example: Console IAM Add-on User User Users User Users Users Client Client Mobile Client Client Mobile ClientMultimedia MultimediaCorporate CorporateTraditional Traditional Traditional Mobile Client Multimedia Corporate Internet data center data center data center server Internet Amazon AWS Services LLC©2011affiliates. its affiliates.its affiliates. AllLLC orreserved. reserved. reserved. server server ultimedia CorporateTraditional Users rporate User Corporate Traditional Traditional Client ©2011 Management ©2011 Amazon WebIAM Add-onServices LLCExample: AWS ©2011 Amazon Web ServicesAmazon All Amazon Web Servicesaffiliates. All rights All rights Web Management or its CorporateWeb Example: orreserved. its affiliates. Multimedia IAM Add-on Servicesrightsor All rights its rights LLC or ©2011 LLC reserved.Traditional Internet AWS Mobile Client Console Console IAM Add-on IAM Add-on a center data center data center server server server data center server C served. User Use ©2011 Amazon Web Services LLC or its affiliates. All rights reserved. Internet Internet Management AWS Internet AWS Management Add-on IAM Add-onIAM Add-on Example: Example: AWS Management IAM Example: 2011年9月26日月曜日 ©2011 Amazon Web Services LLC or its affiliates. its affiliates. All rights reserved. ©2011 Amazon Web Services LLC or All rights reserved. Console Console Console IAM Add-on IAM Add-onIAM Add-on それぞれの管理状況が異なっていた Internet AWS Management IAM Add-on Example: Console IAM Add-on . Internet AWS Mana
http://h50146.www5.hp.com/products/servers/proliant/casestudy/livedoor/ サーバの設定等を見直す良い機会!
4桁台サーバ => 400台 仮想化により集約率 耐障害性・安定性 パフォーマンス
移行の際に注意した 400台になっても 運用できるための MySQLのポイント
1. バージョン MySQL 5.1.x、5.5.x InnoDB Plugin 必須 Fast Index Creation様々
2. my.cnf 共通化 setupツールの提供 オレオレmy.cnfテンプレート server_idの生成と埋め込み InnoDB Pluginのロード(5.1.x) よくあるチューニング
my-modern.cnf •標準のmy.cnfではきっとイマイチ •オレオレmy.cnfに自信があるひと？ •各社秘伝のmy.cnfがあるはず •モダンなmy.cnfの公開が待たれる
3. No MyISAM Engine=InnoDB default-storage-engine=InnoDB 耐障害性 ホットバックアップ mysqldump --single-transaction xtrabackup
4. ログ系テーブル hoge_log テーブルに注意! STOP! Expire処理忘れ! 件数が多くなる場合は削除方法の検討も
5. モニタリング メトリクス・リソース監視 Cacti・Munin・CloudForecast MySQL Enterprise Monitor
まとめ
•MySQL 5.1 or 5.5, InnoDB Plugin •my.cnf 共通化 •MyISAMを使わない •ログ系テーブルの運用 •モニタリング
400台くらいあっても 安定したサービス提供 できてます
おわり。

More Related Content

1台から500台までのMySQL運用 MySQL Beginners

  • 1. 1台から500台までの MySQL運用 MySQL Beginners Talks #1
  • 2. Me •長野雅広 •@kazeburo •Operations Engineer, NHN Japan (livedoor) •MySQL歴10年の初心者
  • 4. Our Service (livedoor) 2011年9月26日月曜日
  • 5. On-Demand WorkforceWorkforce On-Demand On-Demand Workforce On-Demand Workforce On-Demand Workforce Our Service (livedoor) Amazon MechanicalAmazon Mechanical Turk Mechanical Turk Amazon Mechanical Turk Mechanical Turk Turk Amazon Amazon t/ Workers Workers Requester Requester On-Demand WorkforceWorkforce On-Demand On-Demand Workforce On-Demand Workforce On-Demand Workforce Amazon MechanicalAmazon Mechanical Turk Mechanical Turk Amazon Mechanical Turk Mechanical Turk Turk Amazon Amazon Amazon Amazon Human Intelligence IntelligenceIntelligence Human Intelligence Workers Workers Workers Workers Amazon Human Amazon Human Amazon Human Intelligence WorkersAssignment/ Assignment/Assignment/ Assignment/ Assignment/ Requester Requester Requester Requester Requester quester Requester Mechanical MechanicalMechanicalMechanical Turk Tasks (HIT) Mechanical Turk Turk Tasks Turk TasksTurk Tasks (HIT) (HIT) (HIT) Task Task Tasks (HIT) Task Task Task On-Demand WorkforceWorkforce On-Demand Amazon Mechanical Turk Amazon Mechanical Turk Amazon Amazon Human Intelligence IntelligenceIntelligence Human Intelligence Workers Workers Workers Workers Amazon Human Amazon Human Amazon Human Intelligence WorkersAssignment/ Assignment/Assignment/ Assignment/ Assignment/ Requester Requester Requester Requester Requester Non-Service Specific Specific Specific Specific Specific TasksTask Non-Service Tasks Non-Service Tasks (HIT) Non-Service TasksNon-Service Tasks (HIT) (HIT) (HIT) Task Task (HIT) Task Task Mechanical Turk Mechanical MechanicalMechanicalMechanical Turk Turk Turk Turk Mobile ClientMultimedia MultimediaCorporate CorporateTraditional Traditional bile Client data center data center server server r Requester Non-Service On-Demand WorkforceWorkforce Non-Service On-Demand Non-Service On-Demand Workforce Non-Service Specific Specific Specific Specific Specific Non-Service Amazon MechanicalAmazon Mechanical Turk Amazon Mechanical Turk Turk Amazon Amazon Human Intelligence Intelligence Human Assignment/Assignment/ Workers Workers Requester Requester Mechanical Turk Tasks (HIT) Tasks (HIT) Mechanical Turk Task Task User User Users User Users User Users User Client Users Client Mobile Client Client Users Client Mobile ClientMultimedia MultimediaCorporate Multimedia Multimedia Traditional Traditional Traditional Traditional Client Mobile Client Multimedia CorporateTraditional Corporate Corporate Mobile Client Mobile Client Corporate Corporate CorporateTraditional Traditional Traditional Multimedia Corporate data center data center data centerdata centerdata center server server server server server data centerExample: data center server xample: data center server uester server M Add-on IAM Add-on Non-Service Specific Specific Non-Service User User Users User Users User Users User Client Users Client Mobile Client Client Users Client Mobile ClientMultimedia MultimediaCorporate Multimedia Multimedia Traditional Traditional Traditional Traditional Client Mobile Client Multimedia CorporateTraditional Corporate Corporate Mobile Client Mobile Client Corporate Amazon Amazon Human Intelligence IntelligenceIntelligence Amazon Human HumanAssignment/Assignment/ Workers data center data center data centerdata centerdata center server Requester server Assignment/ Workers Workers Requester server Requester server server Mechanical Mechanical Turk Tasks (HIT)Tasks (HIT) Mechanical Turk Turk Tasks (HIT) Task Task Task ester Requester Internet Internet Management AWS Internet Internet IAM Add-on IAM Add-onIAM Add-on Example: Example: Example: Example: AWS Internet AWS ManagementManagement AWS Management Add-on AWS ManagementExample: IAM IAM Add-on mediaCorporate rights reserved. rvices LLC or All CorporateTraditional Traditional or its affiliates. its affiliates. All rights reserved. Console Console Console Console Console IAM Add-on IAM Add-onIAM Add-on IAM Add-onIAM Add-on data center data center server server Non-Service Specific Specific Specific Non-Service Non-Service User User Users Users Client Client Mobile Client Mobile ClientMultimedia MultimediaCorporate CorporateTraditional Traditional Internet Internet Management AWS Internet Internet IAM Add-on IAM Add-onIAM Add-on Example: Example: Example: Example: AWS Internet AWS ManagementManagement AWS Management Add-on AWS ManagementExample: IAM IAM Add-on data center data center server server Console Console Console Console Console IAM Add-on IAM Add-onIAM Add-on IAM Add-on IAM Add-on CorporateTraditional Traditional Traditional Corporate data center data center server server server ©2011 Amazon Web Services LLC©2011affiliates. its affiliates.its affiliates. AllLLC orreserved. reserved. reserved. ©2011 Amazon Web ServicesAmazon All Amazon Web Servicesaffiliates. All rights All rights ©2011 Amazon Web Servicesrightsor All LLC orreserved. its affiliates. or its LLC or Web Services rights its rights ©2011 LLC reserved. d. reserved. hts User User Users User Users Users Client Client Client Mobile ClientMultimedia MultimediaCorporate CorporateTraditional Traditional Traditional Mobile Client Mobile Client Multimedia Corporate Internet data center data center data center server Internet Amazon AWS Services LLC©2011affiliates. its affiliates.its affiliates. AllLLC orreserved. reserved. reserved. server server ultimedia CorporateTraditional Traditional Traditional rporate Corporate ©2011 Management ©2011 Amazon WebIAM Add-onServices LLCExample: AWS ©2011 Amazon Web ServicesAmazon All Amazon Web Servicesaffiliates. All rights All rights Web Management or its LLC or Web Example: orreserved. its affiliates. IAM Add-on Servicesrightsor All rights its rights ©2011 LLC reserved. a center data center data center server server server Console Console IAM Add-on IAM Add-on served. Internet Internet Management AWS Internet AWS Management Add-on IAM Add-onIAM Add-on Example: Example: AWS Management IAM Example: 2011年9月26日月曜日 ©2011 Amazon Web Services LLC or its affiliates. its affiliates. All rights reserved. ©2011 Amazon Web Services LLC or All rights reserved. Console Console Console IAM Add-on IAM Add-onIAM Add-on .
  • 6. Amazon Mechanical Turk On-Demand WorkforceWorkforce On-Demand On-Demand Workforce On-Demand Workforce On-Demand Workforce On-Demand W On-Demand Workforce Our Service (livedoor) Amazon MechanicalAmazon Mechanical Turk Mechanical Turk Amazon Mechanical Turk Mechanical Turk Turk Amazon Amazon Amazon Mech t/ Workers AmazonWorkers Requester Requester Mechanical Turk Amazon Human Intelligence Assignment/ Workers Requester Mechanical Turk Tasks (HIT) Task On-Demand WorkforceWorkforce On-Demand On-Demand Workforce On-Demand Workforce On-Demand Workforce On-Demand W Amazon MechanicalAmazon Mechanical Turk Mechanical Turk Amazon Mechanical Turk Mechanical Turk Turk Amazon Amazon Amazon Mech Non-Service Specific On-Demand Workforce Amazon Amazon Human Intelligence IntelligenceIntelligence Human Intelligence Workers Workers Workers Workers Amazon Human Amazon Human Amazon Human Intelligence WorkersAssignment/ Assignment/Assignment/ Assignment/ Assignment/ Requester Requester Requester Requester Requester Amazon quester Requester Amazon Mechanical Turk Mechanical MechanicalMechanicalMechanical Turk Tasks (HIT) Mechanical Turk Human Intelligence Turk Tasks Turk TasksTurk Tasks (HIT) Requester Task Assignment/ (HIT) (HIT) Workers Task Task Tasks (HIT) Task Task Mechanical Turk Amazon Mechanical Turk Tasks (HIT) TaskOn-Demand WorkforceWorkforce On-Demand On-Demand Workforce Amazon Mechanical Turk Amazon Mechanical Turk Amazon Mechanical Tu Amazon Amazon Human Intelligence IntelligenceIntelligence Human Intelligence Workers Workers Workers Workers Amazon HumanAmazon HumanAmazon Human Intelligence WorkersAssignment/ Assignment/Assignment/ Assignment/ Assignment/ Requester Requester Requester Requester Requester Non-Service Specific Specific Specific Specific Specific TasksTask Non-Service Tasks Non-Service Tasks (HIT) Non-Service TasksNon-Service Tasks (HIT) Non-Service S Amazon Mechanical Turk (HIT) (HIT) Task Mechanical MechanicalMechanicalMechanical Turk Turk Turk Turk Task (HIT) Task Task Non-Service Multimedia MultimediaCorporate User Mobile ClientSpecific bile Client CorporateTraditional Users Traditional Mechanical Turk Client Mobile Client Multimedia Corporate Traditional data center data center server server data center server r Requester Amazon Human Intelligence Assignment/ Workers Requester Mechanical Turk Non-Service On-Demand Workforce On-Demand Workforce Tasks (HIT) Non-ServiceTask Non-Service On-Demand Workforce Non-Service Specific Specific Specific Specific Specific Non-Service Non-Service S Amazon MechanicalAmazon Mechanical Turk Amazon Mechanical Turk Turk On-Demand Workforce Amazon Amazon Human Intelligence Intelligence Human Assignment/Assignment/ Workers Workers Requester Requester H Amazon Amazon Mechanical Turk Mechanical Turk Tasks (HIT) Tasks (HIT) Mechanical Turk Task Task User User Users User Users User Users User Client Users Client Mobile ClientMultimedia MultimediaCorporate Multimedia Multimedia Traditional Traditional Traditional Mechanical Turk Client Mobile Client Client Users Client Mobile Client Multimedia CorporateTraditional Corporate Corporate Mobile Client Mobile Client Corporate Traditional User Non-Service Specific Corporate User Multimedia CorporateTraditional Users Corporate Traditional Traditional Client Multimedia Corporate Traditional data center data center data centerdata centerdata center server server server server server Mobile Client data centerExample: data center server xample: data center server uester serverInternet AWS Management IAM Add-on Example: data center server On-Demand Workforce M Add-on IAM Add-on Console IAM Add-on Amazon Mechanical Turk Non-Service Specific Specific Non-Service Non-Service Specific User User Users User Users User Users User Client Users Client Mobile Client Client Users Client Mobile ClientMultimedia MultimediaCorporate Multimedia Multimedia Traditional Traditional Traditional Traditional Client Mobile Client Multimedia CorporateTraditional Corporate Corporate Mobile Client Mobile Client Corporate data center data center data centerdata centerdata center server User Amazon Amazon Human Intelligence IntelligenceIntelligence Amazon Human HumanAssignment/Assignment/ Workers Assignment/ Workers Workers Requester server Requester server Requester server server Mechanical Mechanical Turk Tasks (HIT)Tasks (HIT) Mechanical Turk Turk Tasks (HIT) Task Task Task ester Requester Amazon Human Intelligence Assignment/ Workers Requester Mechanical Turk Tasks (HIT) Internet Internet Management TaskAWS Internet Internet IAM Add-on IAM Add-onIAM Add-on Example: Example: Example: Example: AWS Internet AWS Management Management AWS Management Add-on AWS ManagementExample: IAM IAM Add-on Internet mediaCorporate affiliates. All rights reserved. rvices LLC or All CorporateTraditional Traditional or its affiliates. its rights reserved. User Users Client ©2011 Amazon Web Multimedia Corporate Add-on Traditional Mobile Console Console Console or its affiliates.IAMrights reserved. IAM Add-on Client Services LLC All dataInternet data center server center AWS Management server IAM Add-on Console Example: Console IAM Add-on IAM Add-on data center IAM Add-on server Console IAM Add-on Non-Service Specific Specific Specific Non-ServiceNon-Service Amazon Human User User Users Users Client Client Mobile Client Mobile Client Multimedia MultimediaCorporate CorporateTraditional Traditional Mechanical Turk User Tas Non-Service Specific Internet Internet Management AWS Internet Internet IAM Add-on IAM Add-onIAM Add-on Example: Example: Example: Example: AWS Internet AWS Management Management AWS Management Add-on AWS ManagementExample: IAM IAM Add-on data center data center server server Internet Console Console Console Console Console IAM Add-on IAM Add-onIAM Add-on IAM Add-on IAM Add-on CorporateTraditional Traditional Traditional Corporate data center data center server server server ©2011 Amazon Web Services LLC©2011affiliates. its affiliates.its affiliates. AllLLC orreserved. reserved. reserved. ©2011 Amazon Web ServicesAmazon All Amazon Web Servicesaffiliates. All rights All rights ©2011 Amazon Web Servicesrightsor All LLC orreserved. its affiliates. or its LLC or Web Services rights its rights ©2011 LLC reserved. Non-Service Specific d. reserved. hts ©2011 Amazon Web Services LLC or its affiliates. All rights reserved. Internet AWS Management IAM Add-on Example: Console IAM Add-on User User Users User Users Users Client Client Mobile Client Client Mobile ClientMultimedia MultimediaCorporate CorporateTraditional Traditional Traditional Mobile Client Multimedia Corporate Internet data center data center data center server Internet Amazon AWS Services LLC©2011affiliates. its affiliates.its affiliates. AllLLC orreserved. reserved. reserved. server server ultimedia CorporateTraditional Users rporate User Corporate Traditional Traditional Client ©2011 Management ©2011 Amazon WebIAM Add-onServices LLCExample: AWS ©2011 Amazon Web ServicesAmazon All Amazon Web Servicesaffiliates. All rights All rights Web Management or its CorporateWeb Example: orreserved. its affiliates. Multimedia IAM Add-on Servicesrightsor All rights its rights LLC or ©2011 LLC reserved.Traditional Internet AWS Mobile Client Console Console IAM Add-on IAM Add-on a center data center data center server server server data center server C served. User Use ©2011 Amazon Web Services LLC or its affiliates. All rights reserved. Internet Internet Management AWS Internet AWS Management Add-on IAM Add-onIAM Add-on Example: Example: AWS Management IAM Example: 2011年9月26日月曜日 ©2011 Amazon Web Services LLC or its affiliates. its affiliates. All rights reserved. ©2011 Amazon Web Services LLC or All rights reserved. Console Console Console IAM Add-on IAM Add-onIAM Add-on Internet AWS Management IAM Add-on Example: Console IAM Add-on . Internet AWS Mana
  • 7. Amazon Mechanical Turk On-Demand WorkforceWorkforce On-Demand On-Demand Workforce On-Demand Workforce On-Demand Workforce On-Demand W On-Demand Workforce Our Service (livedoor) Amazon MechanicalAmazon Mechanical Turk Mechanical Turk Amazon Mechanical Turk Mechanical Turk Turk Amazon Amazon Amazon Mech t/ Workers AmazonWorkers Requester Requester Mechanical Turk Amazon Human Intelligence Assignment/ Workers Requester Mechanical Turk Tasks (HIT) Task On-Demand WorkforceWorkforce On-Demand On-Demand Workforce On-Demand Workforce On-Demand Workforce On-Demand W Amazon MechanicalAmazon Mechanical Turk Mechanical Turk Amazon Mechanical Turk Mechanical Turk Turk Amazon Amazon Amazon Mech Non-Service Specific On-Demand Workforce Amazon Amazon Human Intelligence IntelligenceIntelligence Human Intelligence Workers Workers Workers Workers Amazon Human Amazon Human Amazon Human Intelligence WorkersAssignment/ Assignment/Assignment/ Assignment/ Assignment/ Requester Requester Requester Requester Requester Amazon quester Requester Amazon Mechanical Turk Mechanical MechanicalMechanicalMechanical Turk Tasks (HIT) Mechanical Turk Human Intelligence Turk Tasks Turk TasksTurk Tasks (HIT) Requester Task Assignment/ (HIT) (HIT) Workers Task Task Tasks (HIT) Task Task Mechanical Turk Amazon Mechanical Turk Tasks (HIT) TaskOn-Demand WorkforceWorkforce On-Demand On-Demand Workforce Amazon Mechanical Turk Amazon Mechanical Turk Amazon Mechanical Tu Amazon Amazon Human Intelligence IntelligenceIntelligence Human Intelligence Workers Workers Workers Workers Amazon HumanAmazon HumanAmazon Human Intelligence WorkersAssignment/ Assignment/Assignment/ Assignment/ Assignment/ Requester Requester Requester Requester Requester Non-Service Specific Specific Specific Specific Specific TasksTask Non-Service Tasks Non-Service Tasks (HIT) Non-Service TasksNon-Service Tasks (HIT) Non-Service S Amazon Mechanical Turk (HIT) (HIT) Task Mechanical MechanicalMechanicalMechanical Turk Turk Turk Turk Task (HIT) Task Task Non-Service Multimedia MultimediaCorporate User Mobile ClientSpecific bile Client CorporateTraditional Users Traditional Mechanical Turk Client Mobile Client Multimedia Corporate Traditional data center data center server server data center server r Requester Amazon Human Intelligence Assignment/ Workers Requester Mechanical Turk Non-Service On-Demand Workforce On-Demand Workforce Tasks (HIT) Non-ServiceTask Non-Service On-Demand Workforce Non-Service Specific Specific Specific Specific Specific Non-Service Non-Service S Amazon MechanicalAmazon Mechanical Turk Amazon Mechanical Turk Turk On-Demand Workforce Amazon Amazon Human Intelligence Intelligence Human Assignment/Assignment/ Workers Workers Requester Requester H Amazon Amazon Mechanical Turk Mechanical Turk Tasks (HIT) Tasks (HIT) Mechanical Turk Task Task User User Users User Users User Users User Client Users Client Mobile ClientMultimedia MultimediaCorporate Multimedia Multimedia Traditional Traditional Traditional Mechanical Turk Client Mobile Client Client Users Client Mobile Client Multimedia CorporateTraditional Corporate Corporate Mobile Client Mobile Client Corporate Traditional User Non-Service Specific Corporate User Multimedia CorporateTraditional Users Corporate Traditional Traditional Client Multimedia Corporate Traditional data center data center data centerdata centerdata center server server server server server Mobile Client data centerExample: data center server xample: data center server uester serverInternet AWS Management IAM Add-on Example: data center server On-Demand Workforce M Add-on IAM Add-on Console IAM Add-on Amazon Mechanical Turk Non-Service Specific Specific Non-Service Non-Service Specific User User Users User Users User Users User Client Users Client Mobile Client Client Users Client Mobile ClientMultimedia MultimediaCorporate Multimedia Multimedia Traditional Traditional Traditional Traditional Client Mobile Client Multimedia CorporateTraditional Corporate Corporate Mobile Client Mobile Client Corporate data center data center data centerdata centerdata center server User Amazon Amazon Human Intelligence IntelligenceIntelligence Amazon Human HumanAssignment/Assignment/ Workers Assignment/ Workers Workers Requester server Requester server Requester server server Mechanical Mechanical Turk Tasks (HIT)Tasks (HIT) Mechanical Turk Turk Tasks (HIT) Task Task Task ester Requester Amazon Human Intelligence Assignment/ Workers Requester Mechanical Turk Tasks (HIT) Internet Internet Management TaskAWS Internet Internet IAM Add-on IAM Add-onIAM Add-on Example: Example: Example: Example: AWS Internet AWS Management Management AWS Management Add-on AWS ManagementExample: IAM IAM Add-on Internet mediaCorporate affiliates. All rights reserved. rvices LLC or All CorporateTraditional Traditional or its affiliates. its rights reserved. User Users Client ©2011 Amazon Web Multimedia Corporate Add-on Traditional Mobile Console Console Console or its affiliates.IAMrights reserved. IAM Add-on Client Services LLC All dataInternet data center server center AWS Management server IAM Add-on Console Example: Console IAM Add-on IAM Add-on data center IAM Add-on server Console IAM Add-on Non-Service Specific Specific Specific Non-ServiceNon-Service Amazon Human User User Users Users Client Client Mobile Client Mobile Client Multimedia MultimediaCorporate CorporateTraditional Traditional Mechanical Turk User Tas Non-Service Specific Internet Internet Management AWS Internet Internet IAM Add-on IAM Add-onIAM Add-on Example: Example: Example: Example: AWS Internet AWS Management Management AWS Management Add-on AWS ManagementExample: IAM IAM Add-on data center data center server server Internet Console Console Console Console Console IAM Add-on IAM Add-onIAM Add-on IAM Add-on IAM Add-on CorporateTraditional Traditional Traditional Corporate data center data center server server server ©2011 Amazon Web Services LLC©2011affiliates. its affiliates.its affiliates. AllLLC orreserved. reserved. reserved. ©2011 Amazon Web ServicesAmazon All Amazon Web Servicesaffiliates. All rights All rights ©2011 Amazon Web Servicesrightsor All LLC orreserved. its affiliates. or its LLC or Web Services rights its rights ©2011 LLC reserved. Non-Service Specific d. reserved. hts ©2011 Amazon Web Services LLC or its affiliates. All rights reserved. Internet AWS Management IAM Add-on Example: Console IAM Add-on User User Users User Users Users Client Client Mobile Client Client Mobile ClientMultimedia MultimediaCorporate CorporateTraditional Traditional Traditional Mobile Client Multimedia Corporate Internet data center data center data center server Internet Amazon AWS Services LLC©2011affiliates. its affiliates.its affiliates. AllLLC orreserved. reserved. reserved. server server ultimedia CorporateTraditional Users rporate User Corporate Traditional Traditional Client ©2011 Management ©2011 Amazon WebIAM Add-onServices LLCExample: AWS ©2011 Amazon Web ServicesAmazon All Amazon Web Servicesaffiliates. All rights All rights Web Management or its CorporateWeb Example: orreserved. its affiliates. Multimedia IAM Add-on Servicesrightsor All rights its rights LLC or ©2011 LLC reserved.Traditional Internet AWS Mobile Client Console Console IAM Add-on IAM Add-on a center data center data center server server server data center server C served. User Use ©2011 Amazon Web Services LLC or its affiliates. All rights reserved. Internet Internet Management AWS Internet AWS Management Add-on IAM Add-onIAM Add-on Example: Example: AWS Management IAM Example: 2011年9月26日月曜日 ©2011 Amazon Web Services LLC or its affiliates. its affiliates. All rights reserved. ©2011 Amazon Web Services LLC or All rights reserved. Console Console Console IAM Add-on IAM Add-onIAM Add-on それぞれの管理状況が異なっていた Internet AWS Management IAM Add-on Example: Console IAM Add-on . Internet AWS Mana
  • 9. 4桁台サーバ => 400台 仮想化により集約率 耐障害性・安定性 パフォーマンス
  • 11. 1. バージョン MySQL 5.1.x、5.5.x InnoDB Plugin 必須 Fast Index Creation様々
  • 12. 2. my.cnf 共通化 setupツールの提供 オレオレmy.cnfテンプレート server_idの生成と埋め込み InnoDB Pluginのロード(5.1.x) よくあるチューニング
  • 14. 3. No MyISAM Engine=InnoDB default-storage-engine=InnoDB 耐障害性 ホットバックアップ mysqldump --single-transaction xtrabackup
  • 15. 4. ログ系テーブル hoge_log テーブルに注意! STOP! Expire処理忘れ! 件数が多くなる場合は削除方法の検討も
  • 16. 5. モニタリング メトリクス・リソース監視 Cacti・Munin・CloudForecast MySQL Enterprise Monitor
  • 18. •MySQL 5.1 or 5.5, InnoDB Plugin •my.cnf 共通化 •MyISAMを使わない •ログ系テーブルの運用 •モニタリング

Editor's Notes

  1. \n
  2. \n
  3. \n
  4. \n
  5. \n
  6. \n
  7. \n
  8. \n
  9. \n
  10. \n
  11. \n
  12. \n
  13. \n
  14. \n
  15. \n
  16. \n
  17. \n
  18. \n
  19. \n