Python scripts to process, and analyze log files using PySpark.

Using SparkML to build different machine learning models for simulating a small scale of big data management

FuzzyMatch a Query Set with a Reference Set Using Spark

This Project about Build Machine Learning Pipeline using SparkML with Jupyter Notebook

In this notebook I’ll use the HMP dataset and perform some basic operations using Apache SparkML Pipeline component. This dataset is a public collection of labelled accelerometer data recordings to be used for the creation and validation of acceleration models of human motion primitives.

Spark DE&ML assignments from the "Data Engineering and Machine Learning with Spark" course (offered by IBM Skills Network)