Mass processing data with a complete ETL for .net developers

Terraform modules for provisioning and managing AWS Glue resources

A Python PySpark Projet with Poetry

Code for unofficial API for the brazillian stocks data website called Fundamentus. Uses requests and bs4 for scraping

python script for ETL job with pyspark, both the source and destination databses are MySQL (the spark job is embedded into flask for the sake of deployment)

Developed an Extract, Transform and Load (ETL) program to extract dataset from various types of sources, applied various transformation techniques and loaded to various destination types.

Ferramenta para Cópia de Dados SQL Server, que foi desenvolvida para auxiliar na geração de arquivos e cópia eficiente de dados entre bases de dados SQL Server.

Provides guidance for fast ETL jobs, an IDataReader implementation for SqlBulkCopy (or the MySql or Oracle equivalents) that wraps an IEnumerable, and libraries for mapping entites to table columns.

ETL (Extract, Transform, Load) job using PySpark - submodule

Repositório dedicado ao programa de captação de talentos da Compass UOL.

Create Tables Dynamically from Flat Files and load Data using SSIS Package

quzrtz dynamic job f or etl system demo

A comprehensive Business Intelligence (BI) solution tailored for Starboard Adventures, a global cycling equipment manufacturer. Utilizing Power BI Desktop, it empowers executives with intuitive dashboards to track KPIs, compare regional performance, analyze product trends, and identify high-value customers.

A Python and Spark based ETL framework. While it operates within speed limits that is framework and standards, but offers boundless possibilities.

A Scala and Spark based ETL framework. The name SpeedFlux implies movement of data and the agility with which it flows.

Project to practice airflow and python - ETL

Extracting and loading data from amazon website to create a product details table

An end-to-end Twitter Data Pipeline that extracts data from Twitter and loads it into AWS S3.

Proyecto Individual que desarrolla la limpieza y análisis de un dataset de películas, para crear un modelo de ML de recomendación de peliculas.