AWS Glue for Apache Spark announces native connectivity for Google BigQuery
AWS Glue for Apache Spark now supports native connectivity to Google BigQuery, which enables users to efficiently read and write data from BigQuery without the need to install or manage BigQuery connector for Apache Spark libraries. Users can now add BigQuery as a source or target within AWS Glue Studio's no-code, drag-and-drop visual interface or use the connector directly in an AWS Glue ETL job
Canonicalã€Spark on Kubernetesソリューション「Charmed Sparkã€ã®ãƒ™ãƒ¼ã‚¿ç‰ˆã‚’公開 | gihyo.jp
Linux Daily Topics Canonicalâ â ã€Spark on Kubernetesソリューション「Charmed Sparkã€ã®ãƒ™ãƒ¼ã‚¿ç‰ˆã‚’公開 Canonicalã¯7月3æ—¥ã€Kubernetes上ã§Sparkジョブをデプãƒã‚¤/実行ã™ã‚‹ã‚ªãƒ¼ãƒ—ンソースソリューション「Charmed Sparkã€ã®æœ€åˆã®ãƒ™ãƒ¼ã‚¿ç‰ˆãƒªãƒªãƒ¼ã‚¹ã‚’発表ã—ãŸã€‚ Charmed Spark beta release is out – try it today | Canonical Charmed Sparkã¯Canonical Data Fabricãƒãƒ¼ãƒ ãŒé–‹ç™ºã‚’主導ã™ã‚‹ã‚½ãƒªãƒ¥ãƒ¼ã‚·ãƒ§ãƒ³ã®ã²ã¨ã¤ã§ã€Charmed Sparkã®ã»ã‹ã«ã€ŒCharmed Kafkaã€ã€Œâ Charmed MongoDBã€ã€Œâ Charmed OpenSearchã€ã€Œâ Charmed PostgreSQLã€ã€Œâ Charmed MySQ
Dataproc ã®æ–°ã—ã„テーブル形å¼ã‚’使ã£ã¦ã¿ã‚‹ | Google Cloud å…¬å¼ãƒ–ãƒã‚°
※ã“ã®æŠ•ç¨¿ã¯ç±³å›½æ™‚é–“ 2020 å¹´ 1 月 4 æ—¥ã«ã€Google Cloud blog ã«æŠ•ç¨¿ã•ã‚ŒãŸã‚‚ã®ã®æŠ„訳ã§ã™ã€‚ Google Cloud ã¯å¸¸ã«ã€ä¼æ¥ãŒãƒ‡ãƒ¼ã‚¿ã‚½ãƒ¼ã‚¹ã‚’接続ã—ã€æ¥å‹™ã§é›†ã‚ãŸãƒ“ッグデータを最大é™ã«æ´»ç”¨ã§ãるよã†ã«ã™ã‚‹ãŸã‚ã®æ”¯æ´ç–を模索ã—ã¦ã„ã¾ã™ã€‚Dataproc ã¯ã€Apache Hiveã€Apache Spark ã‚’å«ã‚€å¤šæ•°ã® Apache Hadoop エコシステムソフトウェアをクラウドã§å®Ÿè¡Œã™ã‚‹ãŸã‚ã®ãƒ•ãƒ«ãƒžãƒãƒ¼ã‚¸ãƒ‰ サービスã§ã™ã€‚テーブル形å¼ã®ãƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆã§ã‚ã‚‹ Delta Lake 㨠Apache Iceberg（Incubating）をã€Cloud Dataproc（ãƒãƒ¼ã‚¸ãƒ§ãƒ³ 1.5 プレビュー）ã§åˆ©ç”¨ã§ãるよã†ã«ãªã‚Šã¾ã—ãŸã€‚ã™ãã« Spark ã‚„ Presto ã§ã”利用ã„ãŸã ã‘ã¾ã™ã€‚Apache Hudi 㯠Dataproc 1.3 ã§ã‚‚ã”利用ã«ãªã‚Œ
1
リリースã€éšœå®³æƒ…å ±ãªã©ã®ã‚µãƒ¼ãƒ“スã®ãŠçŸ¥ã‚‰ã›
最新ã®äººæ°—エントリーã®é…ä¿¡
処ç†ã‚’実行ä¸ã§ã™
j次ã®ãƒ–ックマーク
kå‰ã®ãƒ–ックマーク
lã‚ã¨ã§èªã‚€
eコメント一覧を開ã
oページを開ã
{{#tags}}- {{label}}
{{/tags}}