Data cleaning, pre-processing, and Analytics on a million movies using Spark and Scala.

Apache Spark Course Material

Spark BigQuery Parallel

Lightweight type-safe operations for Spark

This repository is created by Dharshan Kumar K S and Siva Prakash as part of our semester project from 'Big Data Analysis' subject

Hadoop hdfs mapreduce hive spark使用案例

Techniques for analyzing and visualizing data at scale.

A Spark framework written in Scala with gradle as build tool.

Demonstration of basic data transformations using Spark RDD and Spark DataFrame in Scala

This is the repository for Youtube Project for the subject PBDA. We are implementing analysis for finding top videos in each and every category. Also, we are planning to find the top trending words in each category.

Assignment for Scalable Machine Learning which aims to study the basics of regression and classification in Spark.

Demo of spark program with cucumber framework using scala

Repository to demonstrate sample data engineering assignment

A sample using Java / Scala Spark / ReactJS

Using Scala for big data computations for basic tasks

This Spark App analyses various covid cases data and enables you to create custom mathematical insights using a unified data structure and a trait method. After processing data it then writes to Cassandra which is then used as primary source for Data Visualization.

Learning Journey: Spark using Scala, Python, PySpark

Spark Scala

Coursework from Functional Programming in Scala Coursera specialization.