BigQueryエミュレータを使ã£ãŸETLã®ã‚¤ãƒ³ãƒ†ã‚°ãƒ¬ãƒ¼ã‚·ãƒ§ãƒ³ãƒ†ã‚¹ãƒˆ - MonotaRO Tech BlogTL;DR BigQuery Emulator 㨠fake-gcs-server を組ã¿åˆã‚ã›ã‚‹ã“ã¨ã§bqコマンドã§CSVファイルをèªã¿è¾¼ã‚“ã§ETLã®ã‚¤ãƒ³ãƒ†ã‚°ãƒ¬ãƒ¼ã‚·ãƒ§ãƒ³ãƒ†ã‚¹ãƒˆãŒã§ããŸã€‚ ã¯ã˜ã‚ã« ã“ã‚“ã«ã¡ã¯ã€‚先日ã“ã¡ã‚‰ã®è¨˜äº‹ã‚’書ã„ãŸCTO-Officeã®è—¤æœ¬ã§ã™ã€‚ãã“ã§ã¯æ›¸ããã‚Œãªã‹ã£ãŸETLã«ã¤ã„ã¦æ›¸ã„ã¦ãŠããŸã„ã¨æ€ã„ã¾ã™ã€‚ ビッグデータを扱ã†ETLã®ãƒ†ã‚¹ãƒˆã‚’è¡Œã„ãŸã„å ´åˆã«ã€DBã‹ã‚‰Extractã™ã‚‹Eã®éƒ¨åˆ†ãªã©ã€ãƒ¦ãƒ‹ãƒƒãƒˆãƒ†ã‚¹ãƒˆã‚„モックã§ã¯æ‹…ä¿ã§ããªã„ã¨ã“ã‚ãŒå‡ºã¦ãã¾ã™ã€‚ ãã®ã‚ˆã†ãªã‚¤ãƒ³ãƒ†ã‚°ãƒ¬ãƒ¼ã‚·ãƒ§ãƒ³ãƒ†ã‚¹ãƒˆã«ã€OSSã®BigQuery Emulatorを活用ã§ãã‚‹å ´åˆãŒã‚ã‚Šã¾ã™ã€‚ 背景 モノタãƒã‚¦ã§ã¯ã€ãƒžã‚¤ã‚¯ãƒã‚µãƒ¼ãƒ“スã§å®Ÿè£…ã—ãŸGoã®ãƒã‚¸ãƒƒã‚¯ã‚’Apache Beam Go SDKã§ãƒ©ãƒƒãƒ—ã—ã¦ã€Cloud Dataflowã§å®šæœŸå®Ÿè¡Œã™ã‚‹ã“ã¨ã§å•†å“ã®å‡ºè·ç›®å®‰ã®ãƒ‡ãƒ¼ã‚¿ã‚’生æˆã—ã¦æ§˜ã€…ãªãƒãƒ£ãƒãƒ«
[AWS CDK]Seleniumã‚’å‹•ã‹ã™DockerイメージをLambdaã§å®Ÿè¡Œã™ã‚‹ | DevelopersIO![[AWS CDK]Seleniumã‚’å‹•ã‹ã™DockerイメージをLambdaã§å®Ÿè¡Œã™ã‚‹ | DevelopersIO](https://cdn-ak-scissors.b.st-hatena.com/image/square/3f047ea142eff06ac03d91ff00ec5d6bf61e4284/height=288;version=1;width=512/https%3A%2F%2Fdevio2023-media.developers.io%2Fwp-content%2Fuploads%2F2023%2F08%2Faws-lambda.png)
GitHub - gaia-docker/tugbot: Testing in Production (TiP) Framework for Docker
Jenkins + dockerã§ãƒ†ã‚¹ãƒˆã®ä¸¦åˆ—化 - Qiita
CircleCIライクã«ã€JenkinsジョブをDockerコンテナ内ã§å®Ÿè¡Œã—ã¦ã¿ã‚‹ - Qiita
NightmareJS+Dockerã«ã‚ˆã‚‹ç’°å¢ƒéžä¾å˜ãªUIテストã®å°Žå…¥ - Alpaca技術ブãƒã‚°
Gradleã‹ã‚‰dockerã‚’èµ·å‹•ã—ã¦åˆ†æ•£ãƒ†ã‚¹ãƒˆã•ã›ã¦ã¿ãŸ #gradle #docker - mike-neckã®ãƒ–ãƒã‚°
Quipper を支ãˆã‚‹ãƒ†ã‚¹ãƒˆæŠ€è¡“@æ™‚é›¨ç¥ 2015/03/21
「Jenkins ユーザ・カンファレンス 2015 æ±äº¬ã€ ã«ãŠã„㦠「ã¯ã¦ãªã«ãŠã‘る継続的デプãƒã‚¤ãƒ¡ãƒ³ãƒˆã®ç¾çŠ¶ã¨ Docker ã®å°Žå…¥ã€ ã¨ã„ã†ç™ºè¡¨ã‚’è¡Œã„ã¾ã—㟠- Hatena Developer Blog
Docker コンテナ㧠MySQL を使ã£ãŸãƒ†ã‚¹ãƒˆã®é«˜é€ŸåŒ– - stfuawsc
Docker Node Testerを使ã£ã¦Node.jsã‚’ãƒãƒ¼ã‚¸ãƒ§ãƒ³æ¯Žã«ãƒ†ã‚¹ãƒˆã™ã‚‹ #葉桜js - from scratch
test-kitchen + kitchen-docker 㨠serverspec 㧠cookbook をテストã™ã‚‹ - よã†ã¸ã„ã®æ—¥ã€…精進XP
Code coverage with gocov and wercker
開発åˆå®¿ã§Dockerã¨Mesosを使ã£ã¦ã„ã„æ„Ÿã˜ã«ãƒªã‚½ãƒ¼ã‚¹æä¾›ã¨ãƒ‡ãƒ—ãƒã‚¤ã™ã‚‹ã‚„ã¤ã‚’作ã£ã¦ãŸ - wtatsuruã®æŠ€è¡“æ–¹é¢ã®ãƒ–ãƒã‚°
Testing chef cookbook with docker and test kitchen
{{#tags}}- {{label}}
{{/tags}}