[B! Docker][æ©Ÿæ¢°å¦ç¿’] clavierã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

clavier id:clavier

Dockerã¨æ©Ÿæ¢°å¦ç¿’ã«é–¢ã™ã‚‹clavierã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (4)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

ML Pipelineäº‹å§‹ã‚ â€“ kedro(+notebook)ã¨MLflow Trackingã§å§‹ã‚ã‚‹pipelineå…¥é–€ â€“ - GMOã‚¤ãƒ³ã‚¿ãƒ¼ãƒãƒƒãƒˆã‚°ãƒ«ãƒ¼ãƒ— ã‚°ãƒ«ãƒ¼ãƒ—ç ”ç©¶é–‹ç™ºæœ¬éƒ¨
2020.07.06 ML Pipelineäº‹å§‹ã‚ â€“ kedro(+notebook)ã¨MLflow Trackingã§å§‹ã‚ã‚‹pipelineå…¥é–€ â€“ ã“ã‚“ã«ã¡ã¯ã€‚æ¬¡ä¸–ä»£ã‚·ã‚¹ãƒ†ãƒ ç ”ç©¶å®¤ã®T.S.ã§ã™ AI/æ©Ÿæ¢°å¦ç¿’ãŒä¸å¯æ¬ ã¨ãªã£ãŸæ˜¨ä»Šã€æ•°å¤šãã®æ–¹ãŒKaggleãªã©ã®åˆ†æžã‚³ãƒ³ãƒšå‚åŠ ã‹ã‚‰æ©Ÿæ¢°å¦ç¿’ãƒ¢ãƒ‡ãƒ«ã®å®Ÿé¨“ã€ãã—ã¦æœ¬ç•ªç’°å¢ƒã¸ã®é©ç”¨ã¾ã§è‰²ã€…å®Ÿæ–½ã—ã¦ã‚‰ã£ã—ã‚ƒã‚‹ã¨æ€ã„ã¾ã™ã€‚ ç§ã‚‚ãã®ä¸€å“¡ã§ã€æ—¥ã€…ãƒ¢ãƒ‡ãƒ«ã®å®Ÿé¨“ã‹ã‚‰æœ¬ç•ªæ©Ÿæ¢°å¦ç¿’åŸºç›¤ã®æ§‹ç¯‰ã¾ã§è‰²ã€…ãªåˆ†é‡Žã®æ©Ÿæ¢°å¦ç¿’é–¢é€£æ¥å‹™ã«å¾“äº‹ã—ã¦ãŠã‚Šã¾ã™ã€‚ ãã†ã—ãŸä¸ã§ï¼ˆçš†æ§˜ã‚‚åŒã˜æ‚©ã¿ã‚’æŠ±ãˆã¦ã„ã‚‹ã‹ã¨æ€ã„ã¾ã™ãŒï¼‰å®Ÿé¨“->æœ¬ç•ªé©ç”¨->é‹ç”¨ã«æ¸¡ã£ã¦ã€è‰²ã€…ãªæ‚©ã¿ã‚’æŠ±ãˆã¦ã„ã¾ã™ã€‚ ä¸€ä¾‹ã§ã™ãŒã€ã“ã‚“æ‚©ã¿ãŒã‚ã‚Šã¾ã™ å®Ÿé¨“ã‚’è¤‡æ•°å›žç¹°ã‚Šè¿”ã—ãŸçµæžœã€å®Ÿè¡Œçµæžœã¨ãƒã‚¤ãƒ‘ãƒ‘ãƒ©ãƒ¡ãƒ¼ã‚¿ã®çµ„ã¿åˆã‚ã›ãŒã‚´ãƒãƒ£ã‚´ãƒãƒ£ã«ãªã‚‹ å®Ÿé¨“æ™‚ã®å‡¦ç†ãŒãƒ¢ã‚¸ãƒ¥ãƒ¼ãƒ«åŒ–ã—ã¦ã„ãªã„ãŸã‚ã€å‡¦ç†é †åºã®å…¥ã‚Œæ›¿ãˆã‚„è¿½åŠ ãŒå›°é›£ å®Ÿé¨“æ™‚
clavier 2021/10/31
data

machinelearning

æ©Ÿæ¢°å¦ç¿’

docker

python

model
ãƒªãƒ³ã‚¯
MLflowã‚’ã•ãã£ã¨å°Žå…¥ã§ãã‚‹docker-composeã‚’ä½œã£ãŸ - ã‚„ã‚€ã‚„ã‚€ã‚‚ã‚„ã‚€ãªã—
tl;dr docker-composeã‚’å©ãã ã‘ã§ã•ãã£ã¨èªè¨¼ä»˜ãã®MLflowã‚µãƒ¼ãƒãƒ¼ã‚’ç«‹ã¦ã‚‰ã‚Œã‚‹ã‚ˆã†ã«ã—ã¾ã—ãŸ ã“ã¡ã‚‰ã‹ã‚‰ã©ã†ãž: ymym3412/mlflow-docker-compose ã¿ãªã•ã‚“æ©Ÿæ¢°å¦ç¿’ã®å®Ÿé¨“ã‚’ã—ã¦ã„ã¾ã™ã‹ï¼Ÿ å¦ç¿’ã«ä½¿ã£ãŸãƒã‚¤ãƒ‘ãƒ¼ãƒ‘ãƒ©ãƒ¡ãƒ¼ã‚¿ãƒ¼ã‚„ãƒ‡ãƒ¼ã‚¿ã€Train/Valãƒ‡ãƒ¼ã‚¿ã®ãƒã‚¹ã€ã€Testãƒ‡ãƒ¼ã‚¿ã§ã®å„ç¨®è©•ä¾¡æŒ‡æ¨™ã€ã“ã‚Œã‚‰ã‚’äººæ‰‹ã§ç®¡ç†ã—ã¦ãŠãã®ã¯éžå¸¸ã«å¤§å¤‰ã§ã™ã€‚ ãƒ¢ãƒ‡ãƒ«ã®é–‹ç™ºã‚„æ¯”è¼ƒå®Ÿé¨“ã«é›†ä¸ã—ã¦ã„ã‚‹ã¨ã€Œã‚ã‚Œã€ã“ã®æœ€é«˜ç²¾åº¦ã®ãƒ¢ãƒ‡ãƒ«ã¯ã©ã‚“ãªæ¡ä»¶ã§å®Ÿé¨“ã—ãŸã‚‚ã®ã ã£ã‘...ã€ã¨ãªã‚‹ã“ã¨ã‚‚ã‚ã‚Šã€å†ç¾æ€§ãŒå¤±ã‚ã‚Œã¦ã—ã¾ã†ã“ã¨ã«ã‚‚ã¤ãªãŒã‚Šã¾ã™ã€‚ ã“ã®æ©Ÿæ¢°å¦ç¿’ã«ã¾ã¤ã‚ã‚‹èª²é¡Œã‚’è§£æ±ºã™ã‚‹ã²ã¨ã¤ã®æž çµ„ã¿ãŒå®Ÿé¨“ç®¡ç†ã¨å‘¼ã°ã‚Œã‚‹ã‚‚ã®ã§ã€å¦ç¿’æ™‚ã«ä½¿ç”¨ã—ãŸãƒã‚¤ãƒ‘ãƒ¼ãƒ‘ãƒ©ãƒ¡ãƒ¼ã‚¿ãƒ¼ã‚„Train Lossã€Test ãƒ‡ãƒ¼ã‚¿ã§ã®è©•ä¾¡çµæžœãªã©ã‚’è¨˜éŒ²ã—ã¦ç®¡ç†ã—ã¦ãŠãã‚‚ã®ã§ã™ã€‚ ä»£è¡¨çš„ãªã‚‚ã®ã§ã„ã†ã¨MLflo
clavier 2020/01/04
docker

GCP

æ©Ÿæ¢°å¦ç¿’

MLflow
ãƒªãƒ³ã‚¯
Dockerç’°å¢ƒã§PyTorch ã€œç”»åƒè§£æžã€œ #01 ç’°å¢ƒæ§‹ç¯‰ç·¨ - Qiita
ã¯ã˜ã‚ã« æ ªå¼ä¼šç¤¾ã‚¯ãƒªã‚¨ã‚¤ã‚¹CTOã®å¿—æ‘ã§ã™ã€‚ ä½•å›žã‹ã«æ¸¡ã‚Šã€PyTorch(ãƒ‡ã‚£ãƒ¼ãƒ—ãƒ©ãƒ¼ãƒ‹ãƒ³ã‚°)ã§ç”»åƒè§£æžã‚’ã™ã‚‹å®Ÿè·µã§ä½¿ãˆãã†ãªã‚³ãƒ¼ãƒ‰ã‚’æŽ²è¼‰ã—ã¦ã„ããŸã„ã¨æ€ã„ã¾ã™ã€‚ ã›ã£ã‹ããªã®ã§Dockerã§ç’°å¢ƒæ§‹ç¯‰ã‚’ã—ã¦ã„ãã¾ã™ã€‚ æœ€çµ‚çš„ã«ã¯ã‚ãƒ£ãƒ—ãƒãƒ£ãƒ¼èªè¨¼ã‚’çªç ´ã§ãã‚‹ãƒ¬ãƒ™ãƒ«ã¾ã§æŒã£ã¦ã‘ãŸã‚‰ã¨æ€ã£ã¦ã„ã¾ã™ã€‚(ã§ããªã‹ã£ãŸã‚‰ã”ã‚ã‚“ãªã•ã„) å¤§å‰æã¨ã—ã¦è‡ªåˆ†ã€AIçµ¡ã¿ã®è£ã®ä»•çµ„ã¿ã¯å…¨ãã¨è¨€ã£ã¦ã„ã„ã»ã©ç†è§£ã—ã¦ã„ã¾ã›ã‚“ã‹ã‚‰ã€‚ ä»Šã¨ãªã£ã¦ã¯å¾®åˆ†ç©åˆ†ã™ã‚‰æ€ªã—ã„ã§ã™ã€‚ã¯ã„ã€‚ ãã‚“ãªæ„Ÿã˜ã§ã™ãŒã€ãã®è¾ºã®æ„å‘³ä¸æ˜Žãªè¨ˆç®—å¼ã‚’å‹æ‰‹ã«ã‚„ã£ã¦ãã‚Œã‚‹ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ãŒã›ã£ã‹ãã‚ã‚‹ã®ã§ã™ã‹ã‚‰ã‚ã‚„ã‹ã‚Œã°è‰¯ã„ã‚“ã§ã™ã€‚ çµŒç·¯ ä¸Šç”°ã€ŒPyTorchãŒæ£å¼ãƒªãƒªãƒ¼ã‚¹ã•ã‚ŒãŸã‹ã‚‰ä»–ã®ãƒ•ãƒ¬ãƒ¼ãƒ ãƒ¯ãƒ¼ã‚¯ã¨ä½•ãŒé•ã†ã®ã‹è§¦ã£ã¦ã¿ã‚ˆã†ã€ å¿—æ‘ã€Œæ¥ãŸAIï¼ï¼ã‚¯ãƒªã‚¨ã‚¤ã‚¹ã‚‚ã¨ã†ã¨ã†ã“ã®åˆ†é‡Žã«æ‰‹ã‚’å‡ºã—ã¡ã‚ƒã„ã¾ã™ã‹ï¼ã€ æ›½å®®ãƒ»ãƒ¢ãƒˆã‚ã€ŒAIï¼Ÿãã‚Œã£ã¦ãŠã„ã—ã„ã‚“ã§ã™ã‹ï¼Ÿ
clavier 2018/07/21
docker

PyTorch

python

æ©Ÿæ¢°å¦ç¿’

ç’°å¢ƒæ§‹ç¯‰
ãƒªãƒ³ã‚¯
æ©Ÿæ¢°å¦ç¿’ã§ã¯ã˜ã‚ã‚‹Docker - ã«ã»ã‚“ã”ã®ã‚Œã‚“ã—ã‚…ã†
ç›®æ¬¡ã¨ãŠæ–ã‚Š ã“ã®è³‡æ–™ã‚’ã¾ã¨ã‚ã‚‹ã«å½“ãŸã£ã¦ã€å®Ÿéš›ã«é–‹ç™ºã—ãŸã‚Šé‹ç”¨ã—ãŸã‚Šã¨ã„ã†çµŒé¨“ã®ã‚¹ãƒ‹ãƒšãƒƒãƒˆã‹ã‚‰ã€ã§ãã‚‹ã ã‘ç·¨é›†ã—ã¦ã€è‡ªåˆ†ãªã‚Šã«ä½“ç³»åŒ–ã—ãŸã‚‚ã®ã§ã™ æ§˜ã€…ãªè§’åº¦ã®ãƒ‡ãƒ¼ã‚¿ãŒä¹±é›‘ãªã£ã¦ã¦ã‚ã‹ã‚Šã«ãã„ã‹ã‚‚ã—ã‚Œã¾ã›ã‚“ãŒã€ã”äº†æ‰¿ã„ãŸã ã‘ã‚‹ã¨å¹¸ã„ã§ã™ "1. Dockerã¨ã¯" "2. Dockerã‚’ç”¨ã„ã‚‹ãƒ¡ãƒªãƒƒãƒˆ" "3. docker.ioã®ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«" "4. dockerã§ã‚³ãƒ³ãƒ†ãƒŠã®èµ·å‹•" "5. åŸºæœ¬çš„ãªæ“ä½œ" "6. Dockerã‚³ãƒ³ãƒ†ãƒŠã«sshdãªã©ã®å¿…é ˆã‚½ãƒ•ãƒˆã‚¦ã‚§ã‚¢ã‚’ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã™ã‚‹" "7. dockerã‚³ãƒ³ãƒ†ãƒŠã®exportã¨import" "8. æ©Ÿæ¢°å¦ç¿’ã‚ˆã†ã«èª¿æ•´ã—ãŸã‚³ãƒ³ãƒ†ãƒŠã®åˆ©ç”¨" "9. å®Ÿéš›ã«ä½¿ç”¨ã—ã¦ã„ã‚‹ä¾‹" "10. Docker Hubé€£ä¿‚" "11. Docker Compose" "12. Dockerã®ã‚³ãƒ³ãƒ†ãƒŠã¨ãƒ›ã‚¹ãƒˆãƒžã‚·ãƒ³é–“ã§ãƒ•ã‚¡ã‚¤ãƒ«ã®å…±æœ‰ã‚’ã™ã‚‹" "13.
clavier 2017/12/18
docker

æ©Ÿæ¢°å¦ç¿’
ãƒªãƒ³ã‚¯
1