æ±äº¬ GCP ãªã¼ã¸ã§ã³ã§ BigQuery ã®æä¾éå§
Google Cloud Japan Team
BigQuery ã¯ã¨ã³ã¿ã¼ãã©ã¤ãºåããã¼ã¿ã¦ã§ã¢ãã¦ã¹ ã½ãªã¥ã¼ã·ã§ã³ã¨ãã¦ã2011 å¹´ã«ç»å ´ãã¾ãããGoogle ãæ¯ããã¤ã³ãã©ã®å¦çè½åãæ´»ç¨ãã¦ãè¶ é«éã§ã® SQL ã¯ã¨ãªå¦çãå®ç¾ã以æ¥ãå½ãå°åã«é¢ããããä¸çä¸ãã¹ã¦ã®ã客æ§ã«åã㦠BigQuery ãæä¾ãã¦ãã¾ããããã®ä¸ã§ãå¤ãã®ã客æ§ããããã¼ã¿ä¿ç®¡ãåæãããµã¼ãã¹ãéç¨ããå°åå ã§å¯è½ã«ãã¦ã»ãããã¨ãã声ãå¤æ°ããã ãã¾ããã
æ¬æ¥ãGoogle 㯠æ±äº¬ GCP ãªã¼ã¸ã§ã³ã§ã® BigQuery æä¾éå§ãçºè¡¨ãã¾ããGoogle ã§ã¯ã2018 å¹´ã 2019 å¹´ã«ãã㦠BigQuery ãã使ãããã ãããªã¼ã¸ã§ã³ã®æ¡å¤§ãäºå®ãã¦ãããæ±äº¬ GCP ãªã¼ã¸ã§ã³ã§ã®æä¾éå§ã¯ããã®ç¬¬ä¸å¼¾ã«å½ããã¾ãã
ããã«ãããæ¢åã®ãã¼ã¿ã¦ã§ã¢ãã¦ã¹ã§ã¯ä¸å¯è½ãªã¹ã±ã¼ã«ã¨ã¹ãã¼ãã§ã®ãã¼ã¿åæåºç¤ããæ¥æ¬ã«æ ç¹ãç½®ãå¤æ°ã®ä¼æ¥ã®çæ§ã«æä¾ãã次ã®ä¸æã«ã¤ãªããã¤ã³ãµã¤ãã®çºè¦ã«è²¢ç®ãããã¨ãæå¾ ãã¦ãã¾ãã
ä»åãæ±äº¬ GCP ãªã¼ã¸ã§ã³ã§ã® BigQuery æä¾éå§ã«å ç«ã¡ãã¢ã¹ã¯ã«æ ªå¼ä¼ç¤¾ ã ã¨ãã»ãã£ã»ãã£ã»ã³ãã¥ãã±ã¼ã·ã§ã³ãºæ ªå¼ä¼ç¤¾ãæ ªå¼ä¼ç¤¾éæç·åç 究æãæ ªå¼ä¼ç¤¾ã¿ãã»éè¡ãæ ªå¼ä¼ç¤¾LIXILãæ ªå¼ä¼ç¤¾ãªã¯ã«ã¼ããã¯ããã¸ã¼ãº çã試é¨éç¨ãè¡ãã¾ãããæ¥æ¬æ大ç´ã®é¡§å®¢åºç¤ãæã¤ã°ãã¼ãã«ãã³ã¯ã®ã¿ãã»éè¡ã¯ãä»åã®æ¤è¨¼ã«ãããä¸è¨ã®ããã«ä»å¾ã®æ´»ç¨ã¸ã®æå¾ ãå¯ãã¾ããã
BigQueryã¯ãå½è¡ã®ãã¼ã¿ã¢ããªãã£ã¹ãããã¼ã¿è§£æã»åæè ã®åãæ¹ãå¤ããä¸ã¤ã®ãã©ã¤ãã¼ã«ãªãå¾ããã®ã§ãã ç¾å¨ããªã³ãã¬ãã¹ã§æ§æãããåæç¨ DWH ç°å¢ã§ãSQLã§ã¯ã¨ãªãå®è¡ãã¦ãããã®ã®ãå¦çãªã½ã¼ã¹ã®ä¸éããããã¨ããå¦çæéãé·æéåãã¦ããã¨ãã課é¡ãæ±ãã¦ãã¾ããã以åããããããã¯ã©ã¦ãåãããã¨èãã¦ãã¾ããããä»åãæ±äº¬ GCP ãªã¼ã¸ã§ã³ã§ã® BigQuery 使ç¨ãå¯è½ã¨ãªã£ããã¨ã§ãå½è¡ãå®ããã»ãã¥ãªãã£è¦ä»¶ãæºããå½¢ã§å®è¨¼å®é¨ãå®æ½ãã¾ãããå®è¨¼å®é¨ã«ã¯ãå®éã«æ¥åã§ä½¿ç¨ãããã¼ã¿ãå©ç¨ããå®æ¥åã§ã®æ´»ç¨ãè¦æ®ããå½¢ã§æ§æãã¦ãã¾ãã BigQuery ãæ´»ç¨ãããã¨ã§ãå¦çãªã½ã¼ã¹ã®ä¸éãæ°ã«ãããã¨ãªããå¦çã¿ã¹ã¯ãéç´ã»ä¸¦åããå¤éå¦çãããã¨ãå¯è½ã«ãªãã¾ããããã«ãããè¤æ°é¨éã«æ¸¡ããã¼ã¿åæè ã®æ¥åæéãç縮ã»å¹çåãããä¼ç»ç«æ¡ãåæçµæããã®æ´å¯ã»æ¨å¯ãå°ãããã®æéãå¢ãããã¨ã«ç¹ããã¨æå¾ ãã¦ãã¾ããç¾è¡ãããã³ã¹ããæå¶ãããã¨ãã§ããã®ã«å ããBigQuery ã«ã¯é£æºããã使ãæããµã¼ãã¹ãç¨æããã¦ãã¾ãã Dataprep ã Data Studio ã¨ãããã¼ã¿å¦çãå¯è¦åæ©è½ã BigQueryã¨å ±ã«æ´»ç¨ãããã¨ã§ãã¯ã©ã¦ãä¸ã§ã®åææ¥åãä¸æ°é貫ã§é²ãããã¨ãå¯è½ã«ãªããã¨ãä»åã®æ¤è¨¼ã§ç¢ºèªã§ãããã¨ã¯å¤§ããªåç©«ã¨ãªãã¾ããã
ã¿ãã»éè¡ å人ãã¼ã±ãã£ã³ã°æ¨é²é¨ åäºå½¹ ã·ãã¢ããã¼ã¸ã£ã¼ é»é ç¾©ä¸ æ°
åæ§ã«ãBigQuery ã¨å æ¥æä¾éå§ãçºè¡¨ãã VPC Service Controlï¼ã¢ã«ãã¡çï¼ãç¨ãã å®è¨¼å®é¨ãè¡ã£ãã¨ãã»ãã£ã»ãã£ã»ã³ãã¥ãã±ã¼ã·ã§ã³ãºæ ªå¼ä¼ç¤¾ãæ ªå¼ä¼ç¤¾éæç·åç 究æãé度ã¨è¦æ¨¡ã®é¢ãã BigQuery ã®ãããªããã¸ãã¹å©ç¨ã¸ã®æå¾ ãè¿°ã¹ã¦ãã¾ãã
æ±äº¬ GCP ãªã¼ã¸ã§ã³ã§ã® BigQuery ã®æä¾ãæè¿ãã¾ãã å¼ç¤¾ã¯ãä¼æ¥åãã¯ã©ã¦ããµã¼ãã¹ãEnterprise Cloudãã«ããã¦ä»¥åãã BigQuery ãæ´»ç¨ãããããã¯ã¼ã¯ããµã¼ãã¼ã®ç°å¸¸æ¤ç¥ã»åæãè¡ã£ã¦ãã¾ããä»åãæ±äº¬ GCP ãªã¼ã¸ã§ã³ã§ã® BigQuery å®è¨¼å®é¨ã§ã¯ãä¸ç 9 æ ç¹ãããªã¢ã«ã¿ã¤ã ã«ã¹ããªã¼ãã³ã°ããã大è¦æ¨¡ãªãã°ãã¼ã¿ï¼ç´¯è¨ 278 å件ï¼ãç¨ãã¦è©ä¾¡ãå®æ½ãã¾ããããã¼ã¿åæåºç¤ã«ã¯ãæ©å¨ãã½ããã¦ã§ã¢ãçæãã大éã®ãã°ãã¼ã¿ããªã¢ã«ã¿ã¤ã ã«åæ ããããã¤ãéå»ãã¼ã¿ã¾ã§å«ããè¶ é«éã®åæã¨åºåãå¯è½ãªã¹ãã¼ãã¨ãã¯ã¼ãæ±ãããã¾ããBigQuery ã¯ãé«ãã³ã¹ãããã©ã¼ãã³ã¹ã§ç·æ¥æã§ãé«éã®ã¬ã¹ãã³ã¹ãå®ç¾ããæ¢åã® DWH ã§ã¯ä¸å¯è½ã ã£ã大è¦æ¨¡ãªãã°ãã¼ã¿ã®å©æ´»ç¨ãå¯è½ã«ãã¾ããä»å¾ãã BigQuery ãã¯ããã¨ãã GCP ã®ãµã¼ãã¹ã¨ã®é£æºãå¼·åããã客ãã¾ã®ã»ãã¥ã¢ãªãã¼ã¿æ´»ç¨ãæ¯æ´ããã¯ã©ã¦ãã½ãªã¥ã¼ã·ã§ã³ã®æä¾ã«åãã¦åãçµãã§ã¾ããã¾ãã
ã¨ãã»ãã£ã»ãã£ã»ã³ãã¥ãã±ã¼ã·ã§ã³ãºæ ªå¼ä¼ç¤¾ åç· å½¹ã¯ã©ã¦ããµã¼ãã¹é¨é· 森ææ£å½°æ°
ã¨ã³ã¿ã¼ãã©ã¤ãºä¼æ¥ã®åºå¹¹ã·ã¹ãã ã§èç©ãã¦ãããã¼ã¿ãæ´»ç¨ããããã©ã¤ãã¼ã DMP ãªã©ã§ BigQuery ãå©ç¨ãã¦ããã¾ããä»å BigQuery ãæ±äº¬ãªã¼ã¸ã§ã³ã§ãµãã¼ããããæ¥æ¬å½å ã«éãããã¼ã¿é ç½®ãå¯è½ã¨ãªãã¾ããã ã¾ããBigQuery 㯠Interconnect ã VPC Service Control ã¨çµã¿åãããã¨ããªã³ãã¬ãã¹ç°å¢ãããããªãã¯ãªãããã¯ã¼ã¯ãä»ããªãéåæ¥ç¶ãå¯è½ã§ããæ±äº¬ãªã¼ã¸ã§ã³ã® BigQuery ãæ´»ç¨ãããã¨ã§ããã¼ã¿ã®é ç½®å ´æãéä¿¡çµè·¯ã«é¢ãã¦å¶ç´ãããã客æ§ã«ã¤ãã¦ãã¯ã©ã¦ãä¸ã§ã®ãã¼ã¿åæåºç¤ã®æ§ç¯ãç©æ¥µçã«ææ¡ãããã¨ãå¯è½ã«ãªãã¾ããã
æ ªå¼ä¼ç¤¾éæç·åç 究æ åºç¤ã¤ã³ãã°ã¬ã¼ã·ã§ã³æ¨é²é¨ ã·ã¹ãã ã¨ã³ã¸ã㢠å°å³¶ä»å¿æ°
Google Cloud ã®å¼·åºãªã»ãã¥ãªãã£ã¨ä»åã®çºè¡¨ããä¼æ¥ã®å¤æ§ãªäºæ¥è¦ä»¶ãæºãããªãããæ©å¯ãã¼ã¿ãå«ãæ§ã ãªãã¼ã¿æ´»ç¨ã®æ©ä¼æ¡å¤§ã«ã¤ãªãããã¨ãæå¾ ãã¦ãã¾ãã
BigQuery ã®è©³ç´°ã«ã¤ãã¦ã¯ããã¡ããã覧ãã ãããç±³å½ãEUãããã³æ±äº¬ã§ BigQuery ã使ç¨ããéã®ãã¼ã¿ã»ãã ãã±ã¼ã·ã§ã³è¨å®ã¯ ãã¡ãã®ããã¥ã¡ã³ããã覧ãã ããã