Apache Kafka and Related Projects

Create terraform module for deploying AWS MSK cluster

Stream CDC into an Amazon S3 data lake in Apache Iceberg format with AWS Glue Streaming using Amazon MSK Serverless and MSK Connect (Debezium)

AWS MSK Connect workshop helps first time users explore and get started to deploy fully managed Apache Kafka Connect workloads using Amazon MSK Connect.

Exemplary data pipeline for Pinterest to ingest, process and analyse its vast dataset, delivering real-time business intelligence.

Pinterest Data Pipeline that simulate data ingestion and processing for both batch and streaming data.