GitHub - google-deepmind/xmanager: A platform for managing machine learning experimentsYou signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert
Dkron - Cloud native job scheduling system | Dkron
Dkron is a system service for workload automation that runs scheduled jobs, just like unix cron service but distributed in several machines in a cluster. This is the only job scheduler in the market with truly no SPOF. It is open source and available for free. Easy integration Dkron is easy to setup and use. Choose your OS package and it's ready to run out-of-the-box. The administration panel and
Scheduling Dataflow pipelines using App Engine Cron Service or Cloud Functions | Google Cloud Blog
Try Google CloudStart building on Google Cloud with $300 in free credits and 20+ always free products. Free Trial Google Cloud Dataflow provides a unified programming model for batch and stream data processing along with a managed service to execute parallel data processing pipelines on Google Cloud Platform. ">Google Cloud Dataflow provides a unified programming model for batch and stream data pr
スケジューラ色々
Chinachuã®ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‰ã‚¸ãƒ§ãƒ–ã®ãƒãƒƒãƒç®¡ç†ã«Azkabanを使ã£ã¦ã„ãŸã®ã ãŒã€è‹¥å¹²ä¸æº€ã‚‚ã‚ã‚‹ã®ã§ä»–ã«è‰¯ã„ツールãŒãªã„ã‹èª¿ã¹ã¦ã¿ãŸã€‚ çµæžœã€ä»Šã®ã¨ã“ã‚AzkabanãŒæœ€é©ã ã¨ã„ã†çµè«–ã«ãªã£ã¦ã—ã¾ã£ãŸã€‚ Azkabanã®ä¸æº€ Project（ジョブã®ã¾ã¨ã¾ã‚Šï¼‰ã®åå‰ãŒè‹±æ•°å—ã¨ã„ãã¤ã‹ã®è¨˜å·ã§ã—ã‹ä½¿ãˆãªã„。使ã„æ–¹ãŒChinachuã®ã‚¨ãƒ³ã‚³ãƒ¼ãƒ‰ç®¡ç†ãªã®ã§ã€ Projectåã«ã€Œã‚¿ã‚¤ãƒˆãƒ«-日付ã€ã¨ã‹ã«ã—ãŸã„。 エンコードをãšã£ã¨ã‚„ã£ã¦ã„ã‚‹ã¨ProjectãŒãŸã¾ã‚Šã¾ãã£ã¦å‰²ã‚Šã¨ã†ã£ã¨ã†ã—ã„。検索ã¨ã‹ã—ã‚„ã™ããªã‚‹ã¨è‰¯ã„ã®ã ã‘ã© è¦ä»¶ フãƒãƒ¼ãƒ»ã‚¸ãƒ§ãƒ–ã®ç™»éŒ²ãŒã‚·ã‚§ãƒ«ã‚¹ã‚¯ãƒªãƒ—トãªã©ã‹ã‚‰ã§ãる（recordedCommandã§å®Ÿè¡Œã™ã‚‹ã®ã§ï¼‰ ジョブã®ä¾å˜é–¢ä¿‚ã§DAGフãƒãƒ¼ãŒä½œæˆã§ãã‚‹ フãƒãƒ¼ã®å³æ™‚実行ãŒã§ãã‚‹ フãƒãƒ¼ã®ä¸¦åˆ—度を制御ã™ã‚‹ ã§ãã‚Œã°ã€ç™»éŒ²ã—ãŸã‚¸ãƒ§ãƒ–・フãƒãƒ¼ã®æ¤œç´¢æ€§ãŒè‰¯ã„ã“㨠調査çµæžœ airfl
Nomad vs. Other Software | Nomad | HashiCorp Developer
The following characteristics generally differentiate Nomad from related products: Simplicity: Nomad runs as a single process with zero external dependencies. Operators can easily provision, manage, and scale Nomad. Developers can easily define and run applications.Flexibility: Nomad can run a diverse workload of containerized, legacy, microservice, and batch applications. Nomad can schedule servi
Airflow: a workflow management platform
Airbnb is a fast growing, data informed company. Our data teams and data volume are growing quickly, and accordingly, so does the complexity of the challenges we take on. Our growing workforce of data engineers, data scientists and analysts are using Airflow, a platform we built to allow us to move fast, keep our momentum as we author, monitor and retrofit data pipelines. Today, we are proud to an
『Amebaã®ãƒã‚°è§£æžåŸºç›¤ã®ãƒ¯ãƒ¼ã‚¯ãƒ•ãƒãƒ¼ã‚¹ã‚±ã‚¸ãƒ¥ãƒ¼ãƒ©ãƒ¼ã€
技術本部ã§ãƒã‚°è§£æžåŸºç›¤ã‚’担当ã—ã¦ã„る善明ã§ã™ã€‚ Amebaã®ãƒã‚°è§£æžåŸºç›¤Patriotå‘ã‘ã«é–‹ç™ºã—ãŸãƒ¯ãƒ¼ã‚¯ãƒ•ãƒãƒ¼ã‚¹ã‚±ã‚¸ãƒ¥ãƒ¼ãƒ©ãƒ¼ã‚’オープンソースã¨ã—ã¦å…¬é–‹ã—ãŸã®ã§ã€ãã®ç´¹ä»‹ã‚’ã•ã›ã¦é ‚ããŸã„ã¨æ€ã„ã¾ã™ã€‚ 開発ã®èƒŒæ™¯Patriotã®ã‚ˆã†ãªãƒã‚°è§£æžåŸºç›¤ã§ã¯ã€ãƒ‡ãƒ¼ã‚¿ã®å–ã‚Šè¾¼ã¿ã€å¤‰æ›ã€é›†è¨ˆã¨ã„ã†ä¸€é€£ã®å‡¦ç†ã®æµã‚Œï¼ˆãƒ¯ãƒ¼ã‚¯ãƒ•ãƒãƒ¼ï¼‰ã‚’管ç†ã™ã‚‹å¿…è¦ãŒã‚ã‚Šã¾ã™ã€‚ ã“ã‚ŒãŒãªã„ã¨ã€ä¾‹ãˆã°ã€å¿…è¦ãªãƒ‡ãƒ¼ã‚¿ãŒãã‚ã£ã¦ãªã„ã®ã«é›†è¨ˆå‡¦ç†ãŒå®Ÿè¡Œã•ã‚Œèª¤ã£ãŸæ•°å—ãŒãƒ¬ãƒãƒ¼ãƒ†ã‚£ãƒ³ã‚°ã•ã‚Œã‚‹ã€ã¨ã„ã£ãŸäº‹æ…‹ã‚’引ãèµ·ã“ã—ã¦ã—ã¾ã„ã¾ã™ã€‚ Patriotã§ã¯Amebaã®æ§˜ã€…ãªã‚µãƒ¼ãƒ“スã®ãƒ‡ãƒ¼ã‚¿ã‚’扱ã£ã¦ãŠã‚Šã€ãれを処ç†ã™ã‚‹ãŸã‚ã®ãƒ¯ãƒ¼ã‚¯ãƒ•ãƒãƒ¼ã¯å¤§è¦æ¨¡ã§è¤‡é›‘ãªã‚‚ã®ã«ãªã‚Šã¾ã™ã€‚ ã¾ãŸã€ä¾‹ãˆã°ã€ãƒ–ãƒã‚°ã¨ãƒ”ã‚°ã®ä¸¡æ–¹ã‚’使ã£ã¦ã„るユーザ数ãªã©ã®è¤‡æ•°ã®ã‚µãƒ¼ãƒ“スをã¾ãŸã集計も行ã£ã¦ã„ã‚‹ã®ã§ã‚µãƒ¼ãƒ“ス毎ã«ãƒ¯ãƒ¼ã‚¯ãƒ•ãƒãƒ¼ã‚’分割ã—ã¦ç®¡ç†ã™ã‚‹ã®ã¯é›£ã—ãã€ç¶™ç¶šçŽ‡ã‚„累計利用日数ãªã©å‡¦
巨大ãªãƒãƒƒãƒã‚’分割ã—ã¦æ§‹æˆã™ã‚‹ 〜SQLãƒãƒƒãƒãƒ•ãƒ¬ãƒ¼ãƒ ワークBricolage〜 - クックパッド開発者ブãƒã‚°
トレンド調査ラボã®é’木峰郎（id:mineroaoki）ã§ã™ã€‚ 好ããªRubyã®ãƒ¡ã‚½ãƒƒãƒ‰ã¯10å¹´å‰ã‹ã‚‰String#slice(re, nth)ã§ã™ãŒã€ 最近ã¯RubyよりCoffeeScriptã¨SQLã®ã»ã†ãŒæ›¸ãé‡ãŒå¤šãã¦æ‚©ã‚“ã§ã„ã¾ã™ã€‚ 今日ã¯ã‚ãŸã—ãŒé–‹ç™ºã—ã¦ã„る「ãŸã¹ã¿ã‚‹ã€ã®èƒŒå¾Œã§åƒã„ã¦ã„ã‚‹ 巨大ãƒãƒƒãƒã®æ§‹æˆã«ã¤ã„ã¦è©±ã—ãŸã„ã¨æ€ã„ã¾ã™ã€‚ ãŸã¹ã¿ã‚‹ã®ãƒãƒƒãƒã¯ç´„3000è¡Œã®SQLã§æ§‹æˆã•ã‚Œã¦ãŠã‚Šã€ 処ç†æ™‚é–“ãŒ1æ—¥ã§4時間程度ã‹ã‹ã‚‹ã€ãã“ãã“ã®è¦æ¨¡ã®ãƒ—ãƒã‚°ãƒ©ãƒ ã§ã™ã€‚ ã“ã®ãƒãƒƒãƒå‡¦ç†ãƒ—ãƒã‚°ãƒ©ãƒ ã‚’Bricolage（ブリコラージュ）ã¨ã„ã†ãƒ•ãƒ¬ãƒ¼ãƒ ワークã§æ§‹é€ 化ã™ã‚‹æ‰‹æ³•ã«ã¤ã„ã¦èª¬æ˜Žã—ã¾ã™ã€‚ 「ãŸã¹ã¿ã‚‹ã€ã¨ã¯ ã¾ãšæœ€åˆã«ã€ã€ŒãŸã¹ã¿ã‚‹ã€ãŒã©ã†ã„ã†ã‚‚ã®ãªã®ã‹ã”ãç°¡å˜ã«ãŠè©±ã—ã—ã¦ãŠãã¾ã—ょã†ã€‚ 「ãŸã¹ã¿ã‚‹ã€ã¯ä¼æ¥ã®ã¿ã«æä¾›ã—ã¦ã„ã‚‹B2Bã®åˆ†æžã‚µãƒ¼ãƒ“スã§ã€ クックパッドã®ãƒ¬ã‚·ãƒ”検索ã®åˆ†æžã‚’ã™ã‚‹ã“ã¨ãŒã§ãã¾
Rundeck - cronã‹ã‚‰ç§»è¡Œã—ã‚„ã™ã„ジョブスケジューラを使ã£ã¦ã¿ã‚ˆã†
ã“ã‚“ã«ã¡ã¯ã€‚æ–Žè—¤ã§ã™ã€‚ 最近ã€Dockerãªã©ã®ã‚³ãƒ³ãƒ†ãƒŠåž‹ä»®æƒ³åŒ–技術ã€Chef, Ansible, Itamae ãªã©ã«ã‚ˆã‚‹ITインフラ構築・é‹ç”¨è‡ªå‹•åŒ–技術ã®åˆ©ç”¨ãŒé€²ã‚“ã§ã„ã¾ã™ã€‚一方ã§ã€ä½•å¹´ã‚‚å‹•ã„ã¦ã€Œæ´å²ã€ã‚’ç©ã¿é‡ãã¦ã„るシステムも数多ãã‚ã‚Šã¾ã™ã€‚ãã—ã¦ã€ç§ã‚’å«ã‚ã¦ãれらã®é‹ç”¨ã«é–¢ã‚る事もã‚ã‚‹ã§ã—ょã†ã€‚ãã‚“ãªã€Œæ´å²ã€ã®ã‚るシステムもã€ä½•ã¨ã‹é‹ç”¨ã‚’効率化ã—ãŸã„ã¨æ€ã†äº‹ãŒã‚ã‚‹ã‹ã‚‚ã—ã‚Œã¾ã›ã‚“。 今日ã¯ã€ãƒãƒƒãƒã‚¸ãƒ§ãƒ–や複数サーãƒã«å¯¾ã™ã‚‹é‹ç”¨ã‚’効率化ã™ã‚‹Rundeckã‚’å–り上ã’ã¾ã™ã€‚「何ãŒã§ãã‚‹ã®ï¼Ÿã€ã€Œã¯ã˜ã‚ã‹ãŸã€ãã—ã¦ã€Œåˆ©ç”¨æ™‚ã®ç•™æ„点ã€ã®3点ã«ã¤ã„ã¦ãŠè©±ã—ã—ã¾ã™ã€‚ ※OSã¯CentOS 6ç³»ã€Rundeck ã¯ãƒãƒ¼ã‚¸ãƒ§ãƒ³ 2.4.0ã€Java VM 㯠Oracle JDK 1.7.0_72 を利用ã—ã¦ã„ã¾ã™ã€‚ cron。Linuxç³»OSã«æ¨™æº–æ載ã•ã‚Œã¦ã„るジョブスケジューラã§ã™ã€‚標準ã§ä½¿ãˆã‚‹ãŸã‚
Engineering
Engineering Building the platform where people around the world come to search, save and shop Our Engineering team is at the core of bringing our platform to life for Pinners worldwide. Working collaboratively and cross-functionally with teams across the company, our engineers tackle growth-driving challenges to build an inspired and inclusive platform for all. Natasha Magliui Engineering Manager,
メンテナンス
ãŠçŸ¥ã‚‰ã›
障害
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
GSoC2019 Working Hours Plugin - UI Improvements
GitHub - coursera/dataduct: DataPipeline for humans.
Apache Aurora
HugeDomains.com
HugeDomains.com
SequenceIq.com is for sale | HugeDomains
[YARN-326] Add multi-resource scheduling to the fair scheduler - ASF JIRA
SequenceIq.com is for sale | HugeDomains
River - A data flow management infrastructure, by Harel Ben Attia, Reversim Summit 2013
Mike Starr - Dataswarm
{{#tags}}- {{label}}
{{/tags}}