Personal Data Engineering Projects

Spark, Airflow, Kafka

Projects of the Udacity Data Engineering Nanodegree Program.

Udacity Data Engineering Nanodegree Capstone project that covers almost all the aspects of Data Engineering - Data Exploration, Data Cleaning, Data modeling, ELT(Extract, Load & Transform), Data Processing on AWS Cloud using Apache Spark and automating data-pipelines using Apache Airflow.

Data pipeline with Apache Airflow - Data Engineering Nanodegree (DEND) 5th Project

This repository is the collection point for all of the projects completed during the Udacity Data Engineering Nano Degree program.

Udacity Data Engineering Nanodegree

Projects Completed in the Data Engineering Nanodegree By Udacity

Data modeling with Cassandra - Data Engineering Nanodegree 2nd project

Projects related to Udacity Data Engineering Nanodegree including Data Modeling, Infrastructure setup on AWS cloud, Data Warehousing and Data Lake development on Amazon EMR and Redshift, developing Data Pipelines using Apache Airflow.

Ayush @ Data Engineering Portfolio

This repo contains my projects submissions for Data Engineering Nanodegree by Udacity

Data Engineering project. Data modeling and ETL pipeline development for a small postrgres database. (Udacity Data Engineering Nanodegree program project)

Notes and Projects for Data Engineering Nanodegree

Creates a relational database for direct analysis of opioid prescriptions and distribution in the state of Ohio using various data sources.

Udacity Data Engineering Nanodegree - Project #2