ishideoã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ / 2021å¹´8æœˆ23æ—¥ - ã¯ã¦ãªãƒ

å¾³ä¸¸æµ©ã®ã‚¦ã‚§ãƒ–ã‚»ã‚ãƒ¥ãƒªãƒ†ã‚£è¬›åº§

å¾³ä¸¸æµ©ãŒã‚¦ã‚§ãƒ–ã‚»ã‚ãƒ¥ãƒªãƒ†ã‚£ã«ã¤ã„ã¦ãƒ”ãƒ³ãƒã‚¤ãƒ³ãƒˆã§è§£èª¬ã™ã‚‹ãƒãƒ£ãƒ³ãƒãƒ«ã§ã™

ishideo 2021/08/23

ãƒªãƒ³ã‚¯

é‡Žçƒã®ãƒ“ãƒƒã‚°ãƒ‡ãƒ¼ã‚¿ã‚’GCPã¨PySparkã§ã„ã„æ„Ÿã˜ã«ä½¿ã„ã‚„ã™ãã—ã¦ã¿ãŸ - Dataprocã¨GCFã‚’ä½¿ã£ãŸç·©ã„ãƒ‡ãƒ¼ã‚¿åŸºç›¤ - Lean Baseball

æœ€è¿‘ã®é‡Žçƒç•Œéšˆã®å‡ºæ¥äº‹ãŒæ–œã‚ä¸Šã™ãŽã¦é©šã„ã¦ã‚‹ãƒžãƒ³ã§ã™.*1 æœ¬æ¥ã®ä»•äº‹ãŠã‚ˆã³, æœ¬æ¥ã˜ã‚ƒãªã„å€‹äººé–‹ç™ºã‚„è¶£å‘³ãƒ—ãƒã‚°ãƒ©ãƒŸãƒ³ã‚°ã«ãŠã„ã¦, ãƒ‡ãƒ¼ã‚¿ã®é‡ãŒå¤šãã¦ å˜ä½ã‚„ãƒ•ã‚©ãƒ¼ãƒžãƒƒãƒˆãŒä¸æƒã„ã§ ãã‚Œã§ã‚‚ä»•äº‹ï¼ˆã‚‚ã—ãã¯è¶£å‘³ã®åˆ†æžï¼‰ã‚’ã“ãªã™ãŸã‚, ã„ã„æ„Ÿã˜ã®ä½¿ã„ã‚„ã™ã„ãƒ‡ãƒ¼ã‚¿ã‚»ãƒƒãƒˆã«ã—ãªã„ã¨ï¼ˆä½¿å‘½æ„Ÿï¼‰ ã¨ã„ã†æ©Ÿä¼šã¯éžå¸¸ã«å¤šã„ã§ã™. ã„ã‚„, æ©Ÿä¼šãŒå¤šã„ã¨ã„ã†ã‚ˆã‚Šå¤šã‹ã‚Œå°‘ãªã‹ã‚Œæ¯Žæ—¥æˆ¦ã£ã¦ã„ã‚‹æ°—ãŒã—ã¾ã™. ä»Šå›žã¯, ã¡ã‚‡ã£ã¨ã—ãŸåˆ†æžã¨ãŠéŠã³ã®ãŸã‚, ãƒ¡ã‚¸ãƒ£ãƒ¼ãƒªãƒ¼ã‚°ã®å…¬å¼ãƒ‡ãƒ¼ã‚¿ã‚µã‚¤ãƒˆã€ŒBaseball Savantã€ã®ãƒ‡ãƒ¼ã‚¿ã‚’ä½¿ã£ãŸBigQueryãƒ‡ãƒ¼ã‚¿ãƒ™ãƒ¼ã‚¹ã‚’ä½œã‚ŠãŸããªã£ãŸã®ã§, ã‚¯ãƒãƒ¼ãƒ©ãƒ¼ã§Baseball Savantã®ãƒ‡ãƒ¼ã‚¿ã‚’å–ã£ã¦CSVã«ã—ã¦ CSVã‹ã‚‰ãƒ‡ãƒ¼ã‚¿ã‚’é›†è¨ˆã—ãŸã‚Šæ•´ãˆãŸã‚Šã—ã¦ã„ã„æ„Ÿã˜ã®å˜ä½ã«ã—ã¦ BigQueryã‹ã‚‰ä½¿ãˆã‚‹ã‚ˆã†ã«ã—ã¦ã¿ãŸã‚ˆï¼ ã¨ã„ã†ã‚¿ã‚¹ã‚¯ã‚’Google Cloud Platform