[B! dbt] Akinekoã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯

Akineko id:Akineko

dbtã«é–¢ã™ã‚‹Akinekoã®ãƒ–ãƒƒã‚¯ãƒžãƒ¼ã‚¯ (6)

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

${{author_name}}$
{{author_name}}{{created}}
{{ #comment }}{{ comment }}{{ /comment }}
- {{ label }}

${{author_name}}$

{{{comment_expanded}}}

{{label}}

{{#is_bookmark}}ãƒªã‚¹ãƒˆ{{/is_bookmark}}{{^is_bookmark}}ãƒªãƒ³ã‚¯{{/is_bookmark}}

ã‚³ãƒ¼ãƒ‰ã‹ã‚‰dbtã‚’ç†è§£ã™ã‚‹
ãƒ‘ãƒƒã‚±ãƒ¼ã‚¸ã‚’ä½œã‚ŠãŸã„ã¨ãã€ãƒã‚°ã£ã½ã„æŒ™å‹•ã«å‡ºãã‚ã—ãŸã¨ãã€å˜ãªã‚‹çŸ¥çš„å¥½å¥‡å¿ƒâ€¦ãªã©ãªã©ã€dbtã®è£å´ã®ã‚³ãƒ¼ãƒ‰ã‚’èªã‚€æ©Ÿä¼šãŒã‚ã‚‹ã‹ã‚‚ã—ã‚Œã¾ã›ã‚“ã€‚dbtã®ã‚³ãƒ¼ãƒ‰ã‚’èªã‚€ã¨ãã«ã€ã©ã“ã‚’è¦‹ã‚Œã°ã„ã„ã®ã‹ã€ã©ã®ã‚ˆã†ãªæ§‹é€ ã«ãªã£ã¦ã„ã‚‹ã®ã‹ã€ã¨ã„ã£ãŸã“ã¨ã‚’ã„ãã¤ã‹ã®ä¾‹ã¨ä¸€ç·’ã«ã¾ã¨ã‚ã¦ã¿ã¾ã—ãŸã€‚ è¦ç´„ dbt-coreã§ã¯ãªãã€dbt-bigqueryãªã©adapterå´ã®å®Ÿè£…ã®æ–¹ãŒé‡è¦ãªã“ã¨ãŒå¤šã„ã§ã™ã€‚ ã‚¢ãƒ¼ã‚ãƒ†ã‚¯ãƒãƒ£ ã¾ãšã¯dbtã®ã‚¢ãƒ¼ã‚ãƒ†ã‚¯ãƒãƒ£ã‚’ã–ã£ãã‚Šã¨èª¬æ˜Žã—ã¾ã™ã€‚dbtã§ã¯ç’°å¢ƒæ§‹ç¯‰æ™‚ã«coreã¨å„DWHç”¨ã®adapterã‚’ã‚¤ãƒ³ã‚¹ãƒˆãƒ¼ãƒ«ã—ã¾ã™ãŒã€ãã‚Œãžã‚Œä»¥ä¸‹ã®ã‚ˆã†ãªå½¹å‰²ã‚’æ‹…ã£ã¦ã„ã¾ã™ã€‚ dbt-core: CLIç‰ã®ãƒ¦ãƒ¼ã‚¶ãƒ¼ã‚¤ãƒ³ã‚¿ãƒ¼ãƒ•ã‚§ãƒ¼ã‚¹ã‚’æ‹…å½“ dbt-adapters: DWHã¨ã®æŽ¥ç¶šã‚’æ‹…å½“ã™ã‚‹æŠ½è±¡åŒ–ãƒ¬ã‚¤ãƒ¤ãƒ¼ dbt-bigquery ãªã©å„ç¨®adapter: dbt-adaptersã‚’ç¶™æ‰¿ã—ãŸå…·ä½“çš„
Akineko 2024/10/04
dbt
ãƒªãƒ³ã‚¯
dbtå°Žå…¥ã«ãŠã‘ã‚‹ãƒ‡ãƒ¼ã‚¿ãƒ¢ãƒ‡ãƒªãƒ³ã‚°ç’°å¢ƒæ•´å‚™ - pixiv inside
ã¯ã˜ã‚ã« åˆã‚ã¾ã—ã¦ã€‚ãƒ—ãƒ©ãƒƒãƒˆãƒ•ã‚©ãƒ¼ãƒ é–‹ç™ºéƒ¨ã«ã¦ãƒ‡ãƒ¼ã‚¿åŸºç›¤ã®æ•´å‚™ã‚’ã—ã¦ã„ã‚‹azukiã¨ç”³ã—ã¾ã™ã€‚ ä»Šå›žã¯dbt(Data build tool)ã‚’å°Žå…¥ã—ãŸçµŒç·¯ã¨éžä¸å¤®é›†æ¨©çš„ãªdbtã®ä½¿ã„æ–¹ã«ã¤ã„ã¦ã”ç´¹ä»‹ã—ãŸã„ã¨æ€ã„ã¾ã™ã€‚ ä»Šå›žã¯å°Žå…¥ã«é–¢ã—ã¦ã¾ã¨ã‚ã¦ã„ã¾ã™ã®ã§ã€dbtã®é‹ç”¨é¢ã®è©³ç´°ã¯åˆ¥è¨˜äº‹ã§è§£èª¬äºˆå®šã§ã™ã€‚ ãƒ‡ãƒ¼ã‚¿ãƒ¢ãƒ‡ãƒªãƒ³ã‚°ãƒ„ãƒ¼ãƒ«å°Žå…¥ã®èƒŒæ™¯ ãƒ”ã‚¯ã‚·ãƒ–ã§ã¯ãƒ—ãƒãƒ€ã‚¯ãƒˆã®å¤šã•ã‚’ç†ç”±ã«éžä¸å¤®é›†æ¨©ãƒ‡ãƒ¼ã‚¿çµ„ç¹”ã‚’æŽ¡ç”¨ã—ã¦ã„ã¾ã™ã€‚ ãƒ‰ãƒ¡ã‚¤ãƒ³ãƒãƒ¼ãƒ ãŒãƒ¡ã‚¤ãƒ³ã§ãƒ‡ãƒ¼ã‚¿ã®å–ã‚Šçµ„ã¿ã‚„ãƒ‡ãƒ¼ã‚¿ãƒ¢ãƒ‡ãƒªãƒ³ã‚°ã‚’è¡Œã„ã€ãƒ‡ãƒ¼ã‚¿é§†å‹•æŽ¨é€²å®¤ã‚„ãƒ‡ãƒ¼ã‚¿åŸºç›¤ãƒãƒ¼ãƒ ã¯ãã®ã‚µãƒãƒ¼ãƒˆã‚„æ•´å‚™ã‚’æ‹…å½“ã—ã¦ã„ã¾ã™ã€‚ ãã®èƒŒæ™¯ã«é–¢ã—ã¦ã¯ã€ã€PIXIV MEETUP 2023ã€‘ã®æ–¹ã§ãŠè©±ã—ã¦ã„ã¾ã™ã®ã§ãœã²ã”è¦§ä¸‹ã•ã„ã€‚ speakerdeck.com ä»Šã¾ã§BigQueryã®ãƒ‡ãƒ¼ã‚¿åŠ å·¥SQLã¯è‡ªç¤¾ã§é–‹ç™ºã—ãŸãƒ„ãƒ¼ãƒ«ã§ç®¡ç†ã—ã¦ã„ã¾ã—ãŸã€‚ pythonã‹ã‚‰å¤‰æ•°åŸ‹ã‚è¾¼ã¿
Akineko 2024/06/18
dbt

ãƒ‡ãƒ¼ã‚¿åˆ†æž
ãƒªãƒ³ã‚¯
dbtå°Žå…¥ã«ã‚ˆã‚‹ãƒ‡ãƒ¼ã‚¿ãƒžãƒ¼ãƒˆæ•´å‚™ - ZOZO TECH BLOG
ã¯ã˜ã‚ã« ã“ã‚“ã«ã¡ã¯ã€MLãƒ»ãƒ‡ãƒ¼ã‚¿éƒ¨æŽ¨è–¦åŸºç›¤ãƒ–ãƒãƒƒã‚¯ã®æ æ¾¤ï¼ˆ@i_125ï¼‰ã§ã™ã€‚ç§ã¯ZOZOã®ãƒ‡ãƒ¼ã‚¿åŸºç›¤ã«ãŠã‘ã‚‹ãƒ‡ãƒ¼ã‚¿ã‚¬ãƒãƒŠãƒ³ã‚¹å¼·åŒ–ã‚’å®Ÿç¾ã™ã‚‹ãŸã‚ã«ã€Analytics Engineerã¨ã—ã¦è¤‡æ•°ã®éƒ¨é–€ã‚’è·¨ããƒ—ãƒã‚¸ã‚§ã‚¯ãƒˆãƒãƒ¼ãƒ ã«å‚åŠ ã—ã¦ã„ã¾ã™ã€‚æœ¬è¨˜äº‹ã§ã¯ZOZOã«ãŠã‘ã‚‹ãƒ‡ãƒ¼ã‚¿ã‚¬ãƒãƒŠãƒ³ã‚¹ä¸Šã®èª²é¡Œã¨ã€ãã®èª²é¡Œã®è§£æ±ºç–ã®1ã¤ã¨ã—ã¦dbtã‚’å°Žå…¥ã—ãŸè©±ã‚’ã”ç´¹ä»‹ã—ã¾ã™ã€‚ ç›®æ¬¡ ã¯ã˜ã‚ã« ç›®æ¬¡ èƒŒæ™¯ èª²é¡Œ ãƒ‡ãƒ¼ã‚¿ãƒžãƒ¼ãƒˆã®ä¹±ç«‹ é›†è¨ˆå®šç¾©ã®ã°ã‚‰ã¤ã ä¾å˜é–¢ä¿‚ã®æ´—ã„å‡ºã—ãŒå›°é›£ ãƒ‡ãƒ¼ã‚¿ãƒ¢ãƒ‡ãƒªãƒ³ã‚°ãƒ„ãƒ¼ãƒ«ã®æ¯”è¼ƒæ¤œè¨Ž ãƒ‡ãƒ¼ã‚¿å¤‰æ›ã«é–¢ã™ã‚‹è¦ä»¶ ãƒ‡ãƒ¼ã‚¿ãƒ¢ãƒ‡ãƒªãƒ³ã‚°ãƒ„ãƒ¼ãƒ«ã®é¸å®š ãƒ¬ã‚¤ãƒ¤ãƒªãƒ³ã‚°ã«ã‚ˆã‚‹è²¬å‹™ã®åˆ†é›¢ å®Ÿè£…æ–¹é‡ ä»Šå¾Œã®å±•æœ› dbtãƒ¢ãƒ‡ãƒ«ã‚’é–‹ç™ºã™ã‚‹ä¸Šã§å·¥å¤«ã—ãŸã“ã¨ ç’°å¢ƒã®åˆ†é›¢ èƒŒæ™¯ å·¥å¤«ã—ãŸã“ã¨ ãƒ€ãƒŸãƒ¼ãƒ‡ãƒ¼ã‚¿ã‚»ãƒƒãƒˆã®ç”Ÿæˆ èƒŒæ™¯ å·¥å¤«ã—ãŸã“ã¨ SQLFluffã‚’ä½¿ã£ãŸãƒ•ã‚©ãƒ¼ãƒžãƒƒãƒˆçµ±ä¸€ ä¾å˜ãƒ¢ãƒ‡ãƒ«ã‚’å«ã‚€ãƒ†ã‚¹ãƒˆ dbt Doc
Akineko 2024/03/05
ãƒ‡ãƒ¼ã‚¿åˆ†æž

dbt
ãƒªãƒ³ã‚¯
Terraformã¨dbtã‚’æ´»ç”¨ã—ã¦ãƒ‡ãƒ¼ã‚¿åŸºç›¤æ•´å‚™ã®ç”Ÿç”£æ€§ãŒå‘ä¸Šã—ãŸè©±
ã¯ã˜ã‚ã« ç§ãŒæ‰€å±žã—ã¦ã„ã‚‹ãƒ©ã‚¤ãƒ•ã‚¤ã‚ºãƒ†ãƒƒã‚¯ã®ãƒ‡ãƒ¼ã‚¿åŸºç›¤ã‚°ãƒ«ãƒ¼ãƒ—ã§ã€ã“ã“2å¹´ã»ã©ã§dbtã¨terraformã‚’æ´»ç”¨ã—ã¦DataOpsã‚’é€²ã‚ã€ãƒ‡ãƒ¼ã‚¿åŸºç›¤ã®æ•´å‚™ã®ç”Ÿç”£æ€§ãŒå‘ä¸Šã—ãŸè©±ã‚’ã¾ã¨ã‚ã¾ã™ã€‚ å°Žå…¥å‰ã®çŠ¶æ³ã¨èª²é¡Œ å¼Šç¤¾ã®ãƒ‡ãƒ¼ã‚¿åŸºç›¤ã§ã¯ãƒ‡ãƒ¼ã‚¿åŸºç›¤ãŒç¶ºéº—ã«æ•´å‚™ã•ã‚Œã¦ã„ã‚‹ã“ã¨ã‚ˆã‚Šã‚‚ã€ãƒ—ãƒãƒ€ã‚¯ãƒˆã‚„äº‹æ¥ã«è²¢çŒ®ã§ãã¦ã„ã‚‹ã‹ã‚’é‡è¦ã¨è€ƒãˆã€ã¾ãšãƒ‡ãƒ¼ã‚¿ã‚’ä½¿ãˆã‚‹çŠ¶æ…‹ã«ã™ã‚‹ã“ã¨ã‚’ç›®æŒ‡ã—ãŸã‚µãƒ¼ãƒ“ã‚¹ã®å°Žå…¥ã‚„åŸºç›¤æ§‹ç¯‰ã‚’è¡Œã„ã¾ã—ãŸã€‚ è€ƒãˆæ–¹ã¨ã—ã¦ã¯ã“ã¡ã‚‰ã® DWHã«ãŠã‘ã‚‹ãƒ‡ãƒ¼ã‚¿ãƒ¢ãƒ‡ãƒªãƒ³ã‚°ã§å¤§äº‹ã«ã—ã¦ã„ã‚‹è€ƒãˆæ–¹ã«æ›¸ã‹ã‚Œã¦ã„ã‚‹å†…å®¹ã«è¿‘ã„è€ƒãˆæ–¹ã«ãªã‚Šã¾ã™ã€‚ ãã®ãŸã‚ã€ãƒ‡ãƒ¼ã‚¿ãƒ¢ãƒ‡ãƒªãƒ³ã‚°ã®å‰ã«Redashã‚„CRM Analyticsã¨ã„ã†BIãƒ„ãƒ¼ãƒ«å‘ã‘ã«ãƒ‡ãƒ¼ã‚¿ãƒ¬ã‚¤ã‚¯ã‹ã‚‰ãƒ‡ãƒ¼ã‚¿ãƒžãƒ¼ãƒˆã‚’å…ˆã«æ§‹ç¯‰ã—ã¦ã„ã¾ã—ãŸã€‚ terraformã¨dbtå°Žå…¥å‰ã¯ã€å›³ã®ã‚ˆã†ãªæµã‚Œã§ SQLã§Snowflakeä¸Šã«DBã‚„ã‚¹ã‚ãƒ¼ãƒžãªã©ã‚’ä½œæˆ ELTã‚µãƒ¼ãƒ“ã‚¹ã¨ã—
Akineko 2024/03/02
Terraform

dbt

ãƒ‡ãƒ¼ã‚¿åˆ†æž
ãƒªãƒ³ã‚¯
DWHã«ãŠã‘ã‚‹ãƒ‡ãƒ¼ã‚¿ãƒ¢ãƒ‡ãƒªãƒ³ã‚°ã§å¤§äº‹ã«ã—ã¦ã„ã‚‹è€ƒãˆæ–¹Â
ã“ã‚“ã«ã¡ã¯ã€‚ãƒ‡ãƒ¼ã‚¿ã‚¨ãƒ³ã‚¸ãƒ‹ã‚¢ãƒªãƒ³ã‚°ã®æ”¯æ´ã‚’è¡Œã£ã¦ã„ã‚‹stableæ ªå¼ä¼šç¤¾ã®ä»£è¡¨ã®å®®ï¨‘ï¼ˆ@ikki_mzï¼‰ã§ã™ã€‚å¼Šç¤¾ã§ã¯ã€ã‚¯ãƒ©ã‚¤ã‚¢ãƒ³ãƒˆç¤¾å†…ã®ãƒ‡ãƒ¼ã‚¿ã‚¦ã‚§ã‚¢ãƒã‚¦ã‚¹ï¼ˆDWHï¼‰ã«ãŠã‘ã‚‹ãƒ‡ãƒ¼ã‚¿ãƒ¢ãƒ‡ãƒªãƒ³ã‚°ã‚’ã‚µãƒãƒ¼ãƒˆ...
Akineko 2024/02/04
dbt

ãƒ‡ãƒ¼ã‚¿åˆ†æž

è¨è¨ˆ
ãƒªãƒ³ã‚¯
dbtã§è¦‹ã‚„ã™ã„ERå›³ã‚’ç”Ÿæˆã™ã‚‹ - yasuhisa's blog
èƒŒæ™¯: dbtã‚’ä½¿ã£ã¦ã„ã¦ã‚‚ERå›³ã¯æ¬²ã—ã„! ã©ã†ã‚„ã£ã¦ERå›³ã‚’ç”Ÿæˆã™ã‚‹ã‹ ã©ã†ã‚„ã£ã¦ERå›³ã‚’è¦‹ã‚„ã™ãã™ã‚‹ã‹ ã¾ã¨ã‚ èƒŒæ™¯: dbtã‚’ä½¿ã£ã¦ã„ã¦ã‚‚ERå›³ã¯æ¬²ã—ã„! dbtã¯ãƒ¢ãƒ‡ãƒ«é–“ã®ãƒªãƒãƒ¼ã‚¸ãªã©å¯è¦–åŒ–ãŒå¾—æ„ãªãƒ„ãƒ¼ãƒ«ã§ã¯ã‚ã‚Šã¾ã™ãŒã€ä¸‡èƒ½ãªã‚ã‘ã§ã¯ã‚ã‚Šã¾ã›ã‚“ã€‚ãƒ¢ãƒ‡ãƒ«ã®ç”ŸæˆéŽç¨‹ãªã©ã¯ãƒªãƒãƒ¼ã‚¸ã§æ‹…ä¿ã§ãã¾ã™ãŒã€åˆ†æžæ™‚ã«ã€Œã©ã‚Œã¨ã©ã®ãƒ¢ãƒ‡ãƒ«ãŒJOINã§ãã¦ã€JOINã™ã‚‹éš›ã®ã‚ãƒ¼ã¯ã“ã‚Œã‚’ä½¿ã£ã¦ã€ã¨ã„ã†ERå›³ã§æ‰±ã†ã‚ˆã†ãªå¯è¦–åŒ–ã¯ãƒ‡ã‚£ãƒ•ã‚©ãƒ«ãƒˆã§ã¯ã§ãã¾ã›ã‚“ã€‚ DWHã‚’ä½œã£ã¦ã„ã‚‹å´ã‹ã‚‰ã™ã‚‹ã¨ã€Œã“ã®ãƒ†ãƒ¼ãƒ–ãƒ«ã¯ã‚ã®è¾ºã®ãƒ†ãƒ¼ãƒ–ãƒ«ã¨ä¸€ç·’ã«ä½¿ã†ã¨ä¾¿åˆ©ã§ã€ã„ã¤ã‚‚ã‚ã®ã‚ãƒ¼ã§JOINã—ã¦ã€ã¨ã„ã†ã®ãŒé ã®ä¸ã«å…¥ã£ã¦ã„ã‚‹ã“ã¨ãŒå¤šã„ãŸã‚ã€ERå›³ãŒãªãã¦ã‚‚ã©ã†ã«ã‹ãªã‚‹ã“ã¨ã‚‚å¤šã„ã§ã—ã‚‡ã†ã€‚ã—ã‹ã—ã€åˆ†æžã«æ…£ã‚Œã¦ã„ãªã„äººã‚„åˆ†æžã«æ…£ã‚Œã¦ã„ã‚‹äººã§ã‚ã£ã¦ã‚‚ã€æ™®æ®µã¨ç•°ãªã‚‹ãƒ‰ãƒ¡ã‚¤ãƒ³ã®ãƒ†ãƒ¼ãƒ–ãƒ«ã‚’è§¦ã‚‹ã¨ãã¯ERå›³ãŒæä¾›ã—ã¦ãã‚Œã‚‹æƒ…å ±ã¯æœ‰ç”¨ã§ã™ã€‚ã¡ãªã¿ã«
Akineko 2024/02/04
è¨è¨ˆ

dbt

ãƒ‡ãƒ¼ã‚¿åˆ†æž
ãƒªãƒ³ã‚¯
1