Tools Overview

Dependency Management

Poetry: Manages Python package dependencies.

Version Control & Git Hooks

Git: Distributed version control system.
GitLeaks: Scans for hardcoded secrets to prevent them from being committed to Git.
pre-commit: Framework for managing and maintaining multi-language pre-commit hooks.

Infrastructure as Code

Terraform: Manages infrastructure resources.
Infracost: Provides cost estimates for Terraform projects.
TFLint: Linting tool for Terraform, used as a pre-commit hook.
Trivy: Security scanning tool, used as a pre-commit hook.

Data processing

dbt:
duckdb: OLAP database
sqlfluff: SQL Linter

Local Testing

Minikube: Runs a local Kubernetes cluster for testing and development.