Blog
MPI Cluster with Python and Amazon EC2 (part 2 of 3) » Data Wrangling Blog
Posted by Peter Skomoroch on Apr 09, 2007 to cluster computing, python, mpi, amazon ec2, and cloud computing Today I posted a public AMI which can be used to run a small beowulf cluster on Amazon EC2 and do some parallel computations with C, Fortran, or Python. If you prefer another language (Java, Ruby, etc) just install the appropriate MPI library and rebundle the EC2 image. The following set of
続：Amazon Clusterインスタンスã§è¨ˆç®—: 週記
震ç½ã‹ã‚‰2週間ãŒéŽãŽã¾ã—ãŸã€‚ ã¾ãšã€ä»Šå›žã®éœ‡ç½ã§è¢«å®³ã«éã‚ã‚ŒãŸæ–¹ã€…ã€ã¾ãŸã”家æ—ãŒè¢«å®³ã«éã‚ã‚ŒãŸæ–¹ã€…ã«ãŠè¦‹èˆžã„申ã—上ã’ã¾ã™ã€‚ 被ç½åœ°åŸŸç›´æŽ¥ã§ã¯ã‚ã‚Šã¾ã›ã‚“ãŒã€éœ‡ç½ã®å½±éŸ¿ç¯„囲ã«ç§ãªã‚Šã«å°‘ã—ã§ã‚‚出æ¥ã‚‹ã“ã¨ã‚’ã¨è€ƒãˆã€ã“ã®è¨˜äº‹ã‚’書ãã“ã¨ã«ã—ã¾ã—ãŸã€‚ ã”å˜ã˜ã®é€šã‚Šã€ç¾åœ¨ã®æ±æ—¥æœ¬ã§ã¯é›»åŠ›çŠ¶æ³ãŒåˆ‡è¿«ã—ã¦ãŠã‚Šã€è¼ªç•ªåœé›»ãŒå®Ÿæ–½ã•ã‚Œã¦ãŠã‚Šã¾ã™ã€‚ ã“ã‚Œã¯ã€è¨ˆç®—機クラスタを日常的ã«ç ”究ã«ä½¿ã†è€…ã«ã¨ã£ã¦ã¯éžå¸¸ã«åŽ³ã—ã„状æ³ã§ã™ã€‚ å„ç ”ç©¶å®¤ã§æ‰€æœ‰ã—ã¦ã„るクラスタもã€ç¯€é›»ã¨è¼ªç•ªåœé›»ã®ãŸã‚å‹•ã‹ã›ãªã„状æ³ãŒç¶šã„ã¦ã„ã‚‹ã¨ä¼ºã£ã¦ã„ã¾ã™ã€‚ ã¾ãŸã€å¤–部計算リソースã«ã¤ã„ã¦ã‚‚ã€ç¾åœ¨ã®æ—¥æœ¬ã®å¤–部利用å¯èƒ½ãªè¨ˆç®—æ©Ÿã®çŠ¶æ³ã‚’@plus7ã•ã‚“ãŒãƒ–ãƒã‚°ã§çºã‚ã¦ä¸‹ã•ã„ã¾ã—ãŸã€‚ã“ã‚Œã¯ã»ã¼å£Šæ»…çš„ã¨è¨€ã£ã¦è‰¯ã„状æ³ã§ã™ã€‚ ãã“ã§ã€æœ¬è¨˜äº‹ã§ã¯Amazon Elastic Compute Cloud (EC2)を使ã£ã¦ã€å³å¸è¨ˆç®—ãƒªã‚½ãƒ¼ã‚¹ã‚’ä½œã‚‹æ‰‹é †ã‚’è¨˜è¿°ã—ã¦ã¿ã‚ˆã†ã¨
yebo blog: Appleã€iCloudã«Microsoft Azureã¨Amazon AWSを採用
2011/09/04 Appleã€iCloudã«Microsoft Azureã¨Amazon AWSを採用 The Registerã«ã‚ˆã‚Œã°ã€Appleã¯iCloudã®æ§‹ç¯‰ã«2ã¤ã®ã‚¯ãƒ©ã‚¦ãƒ‰ãƒ—ãƒãƒã‚¤ãƒ€Microsoft Azureã¨Amazon AWSを利用ã—ã¦ã„ã‚‹ã¨ã®äº‹ã€‚メインã¯Azureã®ã‚ˆã†ã§ã€ãƒªã‚¹ã‚¯åˆ†æ•£ã®ãŸã‚ã«2ã¤ã®ã‚¯ãƒ©ã‚¦ãƒ‰ã‚µãƒ¼ãƒ“スを利用ã—ã¦ã„る。異ãªã‚‹ã‚¯ãƒ©ã‚¦ãƒ‰ã‚’çµã³ã¤ã‘ã‚‹ãŸã‚ã«Javaã®ã‚ˆã†ãªã‚¯ãƒã‚¹ãƒ—ラットフォームを利用ã—ãŸã®ã§ã¯è¤‡é›‘性ãŒå¢—ã™ã ã‘ãªã®ã§ã€AWSã§Windowsã‚’å‹•ã‹ã™ã‚ˆã†ã«ã—ãŸã®ã§ã¯ãªã„ã‹ã¨ã„ã†è©±ã‚‚ã‚ã‚‹(AWSã¯Linuxã®ä¸Šã§æ§‹ç¯‰ã•ã‚Œã¦ã„ã‚‹)。ã¾ãŸã€Azureã¯ã‚³ãƒ³ãƒ”ューティングã€ã‚³ãƒ³ãƒˆãƒãƒ¼ãƒ«ã€SQLデータベースを使ã„ã€AWSã¯ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã®ã¿ã‚’使用ã—ã€Microsoftã®ã‚³ãƒ³ãƒãƒ¼ãƒãƒ³ãƒˆã¨å®Œå…¨ã‚¹ãƒˆãƒ©ã‚¤ãƒ—ã•ã‚Œã¦ã„ã‚‹ã¨ã„ã†è©±ã‚‚ã‚ã‚‹[electronista]。ã„ãšã‚Œã«ã—
Ruby/Amazon S3を使ㆠ- 俺ã®åŸºåœ°
ãƒãƒ¼ã‚¸ãƒ§ãƒ³ã¨è£½é€ 年月日 2009å¹´09月08æ—¥ Ruby 1.8.6 aws-s3 0.6.2 WindowsXP SP3 ▲ ▼ 環境構築 Amazonã®ã‚¹ãƒˆãƒ¬ãƒ¼ã‚¸ã‚µãƒ¼ãƒ“スをS3ã‹ã‚‰ä½¿ã†ãƒ©ã‚¤ãƒ–ラリ　aws-s3　ãŒã‚ã‚‹ã®ã§ã“ã„ã¤ã‚’インストールã™ã‚‹ gem install aws-s3 ã“ã„ã¤ã«ã¯3ã¤ã®ä¾å˜æ€§ãŒã‚ã‚Šgemãªã‚‰è‡ªå‹•çš„ã«ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã•ã‚Œã‚‹ã‚“ã ãŒã€ä¸€å¿œä¹—ã£ã‘ã¦ãŠã xml-simple http://rubyforge.org/projects/xml-simple/ builder http://rubyforge.org/projects/builder/ mime-types http://rubyforge.org/projects/mime-types/ ▲ ▼ 接続è¨å®š ã¾ãšæŽ¥ç¶šè¨å®šã‚’è¡Œã†ã€‚ã“ã„ã¤ã¯Amazonã®ã‚µãƒ¼ãƒ“スã§æ¯Žåº¦ä½¿ã†ã€ç”Ÿæˆidã¨keyã®
Amazon Elastic MapReduceã«ä»Šã•ã‚‰å…¥é–€ã—ã¦ã¿ãŸ - nokunoã®æ—¥è¨˜
ã¨ã„ã†ã‚ã‘ã§å†¬ä¼‘ã¿æœ€å¾Œã®è‡ªç”±ç ”究ã¨ã—ã¦ã€Amazon Elastic MapReduce（EMR）を使ã£ã¦ã¿ã¾ã—ãŸã€‚今ãªã‚‰å…¬å¼ãƒšãƒ¼ã‚¸ã‚‚ã»ã¼æ—¥æœ¬èªžåŒ–ã—ã¦ã„ã¦æ¥½ãƒãƒ³ã§ã™ã€‚Amazon Web Services (日本語) Amazon Elastic MapReduceã¨ã¯Amazon EMRã¯ã€Amazonã®ã‚¤ãƒ³ãƒ•ãƒ©ä¸Šã§å‹•ä½œã™ã‚‹ä»®æƒ³ã‚µãƒ¼ãƒãƒ¼ã‚’使ã£ãŸHadoopクラスタを時間å˜ä¾¡ã§è²¸ã—出ã™ã‚µãƒ¼ãƒ“スã§ã™ã€‚少々ã‚ã‹ã‚Šã«ãã„ã®ã§ã€Amazon Web Service(AWS)ã®é–¢é€£ã™ã‚‹è£½å“群ã«ã¤ã„ã¦æ•´ç†ã—ã¦ãŠãã¾ã™ã€‚EC2 (Elastic Compute Cloud) EC2ã¯ã€ä»®æƒ³ãƒžã‚·ãƒ³ã‚’時間å˜ä¾¡ã§è²¸ã—出ã™ã‚µãƒ¼ãƒ“スã§ã™ã€‚ EMRを使ã‚ãšã«ã€EC2ã«è‡ªå‰ã§Hadoopをインストールã—ã¦ä½¿ã†ã‚„り方もã‚ã‚Šã¾ã™ï¼ˆEMRãŒå‡ºæ¥ã‚‹ä»¥å‰ã¯ãã‚Œã—ã‹ãªã‹ã£ãŸï¼‰ã€‚ EMRを使ã†å ´åˆã§ã‚‚ã€ãƒãƒƒã‚¯ã‚°ãƒ©ã‚¦ãƒ³ãƒ‰ã§ã¯è‡ªå‹•çš„ã«
Rudy: Not your grandparents' EC2 deployment tool | Solutious Inc, the home of good natured tools.
Rudy is a development and deployment tool for Amazon EC2. Define infrastructure and processes using a powerful Ruby DSL* and Rudy takes care of the rest (like creating security groups and keypairs). env :stage do # Define an environment ami 'ami-e348af8a' role :app do # Define a role addresses '11.22.33.44' # Use elastic IPs disks do # Define EBS volumes path "/rudy/disk1" do size 100 device "/dev
Amazon EBSã¨RightAwsを使ã£ã¦è‡ªå‹•ãƒãƒƒã‚¯ã‚¢ãƒƒãƒ—環境を構築ã™ã‚‹
Amazon EBSã¨ã¯ã€EC2ã«ã‚¢ã‚¿ãƒƒãƒã™ã‚‹äº‹ã®å‡ºæ¥ã‚‹å¤–部ボリュームã§ã™ã€‚以下ã«ç´ 晴らã—ã„解説記事ãŒã‚ã‚Šã¾ã™ã€‚ Amazon EBSを活用ã—ã¦ãƒ‡ãƒ¼ã‚¿ã‚’ãƒãƒƒã‚¯ã‚¢ãƒƒãƒ—ã—ã¦ã¿ã‚ˆã† ～Amazon EC2/S3環境構築ã®ã™ã¹ã¦ï½žï¼ˆ1/6）：CodeZine è¦ã¯å¤–付ã‘ãƒãƒ¼ãƒ‰ãƒ‡ã‚£ã‚¹ã‚¯ãªã®ã§ã™ãŒã€é…力的ãªã®ãŒãƒœãƒªãƒ¥ãƒ¼ãƒ 毎ã«ä¸¸ã”ã¨ãƒãƒƒã‚¯ã‚¢ãƒƒãƒ—ãŒå–れるã¨ã„ã†ç‚¹ã§ã™ã€‚ã“れを定期的ã«å®Ÿè¡Œã—ã¦ãŠã‘ã°ã€ã„ã–ã¨ã„ã†æ™‚ã®ãƒãƒƒã‚¯ã‚¢ãƒƒãƒ—ã«ãªã‚Šã¾ã™ã®ã§ã€å¤œã‚‚良ãçœ ã‚Œã¾ã™w ※ã¡ãªã¿ã«ã€ä¸Šè¨˜è¨˜äº‹ã§ã¯ã‚³ãƒžãƒ³ãƒ‰ãƒ©ã‚¤ãƒ³ã§ã®æ“作ã¨ãªã£ã¦ã„ã¾ã™ãŒã€Amazonã®GUIコンソールã‹ã‚‰ã‚‚ボタン一発ã§ã‚¹ãƒŠãƒƒãƒ—ショットãŒå–ã‚Œã¾ã™ã€‚ ãƒãƒƒã‚¯ã‚¢ãƒƒãƒ—ã¯å®šæœŸçš„ã«å–らãªã„ã¨æ„味ãŒç„¡ã„ã®ã§ã€è‡ªå‹•åŒ–ã—ãŸã„所ã§ã™ã€‚自動ãƒãƒƒã‚¯ã‚¢ãƒƒãƒ—ã®è¨˜äº‹ã¯ã„ãã¤ã‹è¦‹ã¤ã‘ã¾ã—ãŸãŒã€Ruby版ãŒè¦‹ã¤ã‹ã‚‰ãªã‹ã£ãŸã®ã§è‡ªåˆ†ã§ä½œã‚Šã¾ã—ãŸã€‚ãã®ãƒ¡ãƒ¢ã‚’残ã—ã¦ãŠãã¾ã™ã€‚ å‚考ã«ã•ã›ã¦ã„ãŸã
Amazon EC2ã€EBS(Elastic Block Store)を使ã£ã¦ã¿ãŸ ｜ 横浜ã®ãƒ›ãƒ¼ãƒ ページ制作 スタジオFIXã®ç¤¾é•·ãƒ–ãƒã‚°
ãŸã ã®Webデザイナーã§ã™ãŒã€ Amazon EC2ã‚’ãƒãƒ¼ãƒãƒ£ãƒ«ãƒ‰ãƒ¡ã‚¤ãƒ³ã§é‹ç”¨ ã§ãã¡ã‚ƒã£ãŸã‚Šã—ãŸã®ã§ã€ 「ITコスト削減ã€ä¸‡æ³ï¼ã€ã¨å”±ãˆãªãŒã‚‰æ˜¨å¤œã¯å®¶è·¯ã«ã¤ãã¾ã—ãŸã€‚ ãã—ã¦é”æˆæ„Ÿã¨ã¨ã‚‚ã«ã€ã‚ˆã†ã‚„ãæ怖感も芽生ãˆã¦ãã¾ã—ãŸã€‚ ã ã£ã¦ã€Amazon EC2 ã®ã‚¤ãƒ³ã‚¹ã‚¿ãƒ³ã‚¹ã£ã¦ã€ シャットダウンã•ã›ã‚‹ã¨ãƒ‡ã‚£ã‚¹ã‚¯ä¸Šã®ãƒ‡ãƒ¼ã‚¿ãŒæ¶ˆæ»…ã—ã¡ã‚ƒã‚“ã よ？ 普通ã€ãƒžã‚·ãƒ³ã®é›»æºã‚’OFFã«ã—ã¦ã‚‚データã¯æ®‹ã‚Šã¾ã™ã‚ˆã？ 「全データ消去ã€ã£ã¦ã€ã©ã‚“ã ã‘ーーーーーーー!! Amazon EC2 ã¯ã€99.95%ã®ã‚µãƒ¼ãƒ“スレベルをä¿è¨¼ã—ã¦ãã‚Œã¦ã„ã‚‹ã®ã§ 万ãŒä¸€ã€0.05%ã®ç¢ºç«‹ã§ä½•ã‹ãŒèµ·ãã¦ã‚‚ é‹ãŒæ‚ªã‹ã£ãŸã§ç‰‡ä»˜ã‘られãã†ãªæ°—ãŒã—ã¾ã™ãŒã€ ã‚ãŸã—ãらã„ã«ãªã‚‹ã¨ã€è‡ªåˆ†ã§ã†ã£ã‹ã‚Š （ã—ã‹ã‚‚自信をもã£ã¦å ‚々ã¨ï¼‰ãƒãƒã£ã¨å‰Šé™¤ã—ã¡ã‚ƒã†å¯èƒ½æ€§ã®æ–¹ãŒå¤§ããã†â€¦ã€‚ ãã®ãŸã‚ã« Amazon S3 ã¨ã„ㆠストレージサービスãŒæä¾›ã•ã‚Œã¦
http://collectivemeta.com/9bzrq
For full functionality of this site it is necessary to enable JavaScript. Here are the instructions how to enable JavaScript in your web browser.
dilshod's right_aws at master - GitHub
This repository is private. All pages are served over SSL and all pushing and pulling is done over SSH. No one may fork, clone, or view it unless they are added as a member. Every repository with this icon () is private. This repository is public. Anyone may fork, clone, or view it. Every repository with this icon () is public.
Amazon Web Services Developer Community : RightScale Ruby library to access Amazon CloudFront, EC2, S3, SQS, and SDB
RightScale's AWS gems provide Ruby interfaces to five key Amazon Web Services: CloudFront, EC2, S3, SQS, and SDB. The gems use Amazon's REST and query interfaces to provide full programmatic control. An optional HTTP layer retries and clears transient errors. These Gems have been used in production by RightScale since February 2007 and are continuously improved and updated with any new features of
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
STAR: Cluster - Home
United States
Google Code Archive - Long-term storage for Google Code Project Hosting.
right_aws/lib/ec2/right_ec2.rb at 199568b29ff85472007a065ed841b734667cb71f · flexera-public/right_aws
GitHub - grempe/amazon-ec2: WARNING : You probably don't want this code. Its archived and ancient and probably doesn't work. Try the official AWS Ruby SDK instead.
API_v1.4 - Eucalyptus
RightScale Forums - Powered by vBulletin
http://rightscale.rubyforge.org/right_aws_gem_doc/
{{#tags}}- {{label}}
{{/tags}}