Skip to content

A collection of tutorials and examples for solving and understanding machine learning and pattern classification tasks

License

Notifications You must be signed in to change notification settings

PSJoshi/pattern_classification

 
 

Repository files navigation

logo


**A collection of tutorials and examples for solving and understanding machine learning and pattern classification tasks.**

New Intro Tutorial

Entry Point: Data

  • Using Python's sci-packages to prepare data for Machine Learning tasks and other data analyses







Machine-learning tutorials for Python's scikit-learn



Sections


 • Techniques for Dimensionality Reduction

   • Projection
      • Component Analyses
          • Linear Transformation
              • Principal Component Analysis (PCA)
              • Multiple Discriminant Analysis (MDA)

   • Feature Selection
      • Sequential Feature Selection Algorithms

 • Techniques for Parameter Estimation
      • Parametric Techniques
         • Introduction to the Maximum Likelihood Estimate (MLE)
         • How to calculate Maximum Likelihood Estimates (MLE) for different distributions
      • Non-Parametric Techniques
         • Kernel density estimation via the Parzen-window technique
         • The K-Nearest Neighbor (KNN) technique

Regression Analysis
   • Linear Regression
   • Non-Linear Regression

Statistical Pattern Recognition Examples
   • Supervised Learning
      • Parametric Techniques
         • Univariate Normal Density
         • Multivariate Normal Density
      • Non-Parametric Techniques

   • Unsupervised Learning







#Techniques for Dimensionality Reduction [back to top]


Projection

[back to top]

Component Analyses

[back to top]

Linear Transformation

[back to top]

Principal Component Analyses (PCA)

[back to top]

./Images/principal_component_analysis.png

View IPython Notebook

Download PDF



Multiple Discriminant Analysis (MDA)

[back to top]

./Images/mda_overview2.png

View IPython Notebook




Feature Selection

[back to top]

Sequential Feature Selection Algorithms

[back to top]

View IPython Notebook

Download PDF



## Techniques for Parameter Estimation [[back to top](#sections)]

### Parametric Techniques [[back to top](#sections)]

### Introduction to the Maximum Likelihood Estimate (MLE) [[back to top](#sections)]
![](./Images/mle.png)

View IPython Notebook

### Maximum Liklihood parameter Estimation (MLE) for different distributions [[back to top](#sections)]

![](./Images/mle_distributions.png)

View IPython Notebook



Non-Parametric Techniques

[back to top]



### Kernel density estimation via the Parzen-window technique [[back to top](#sections)]
![](./Images/parzen_window_effect.png)

View IPython Notebook

Download PDF





#Regression Analysis [[back to top](#sections)]

##Linear Regression [[back to top](#sections)]

Implementing the least squares fit method for linear regression and speeding it up via Cython


View IPython Notebook




##Non-Linear Regression [[back to top](#sections)]





# Statistical Pattern Recognition [[back to top](#sections)]

## Supervised Learning

[back to top]

### Parametric Techniques

[back to top]

#### Univariate Normal Density [[back to top](#sections)]
## Example 1 [[back to top](#sections)]
Problem Category:
  • Statistical Pattern Recognition
  • Supervised Learning
  • Parametric Learning
  • Bayes Decision Theory
  • Univariate data
  • 2-class problem
  • equal variances
  • equal priors
  • Gaussian model (2 parameters)
  • No Risk function

View IPython Notebook

Download PDF


Example 2

[back to top]

Problem Category:
  • Statistical Pattern Recognition
  • Supervised Learning
  • Parametric Learning
  • Bayes Decision Theory
  • Univariate data
  • 2-class problem
  • different variances
  • equal priors
  • Gaussian model (2 parameters)
  • No Risk function

View IPython Notebook

Download PDF


Example 3

[back to top]

Problem Category:
  • Statistical Pattern Recognition
  • Supervised Learning
  • Parametric Learning
  • Bayes Decision Theory
  • Univariate data
  • 2-class problem
  • equal variances
  • different priors
  • Gaussian model (2 parameters)
  • No Risk function

View IPython Notebook

Download PDF


Example 4

[back to top]

Problem Category:
  • Statistical Pattern Recognition
  • Supervised Learning
  • Parametric Learning
  • Bayes Decision Theory
  • Univariate data
  • 2-class problem
  • different variances
  • different priors
  • Gaussian model (2 parameters)
  • With conditional Risk (loss functions)

View IPython Notebook

Download PDF


Example 5

[back to top]

Problem Category:
  • Statistical Pattern Recognition
  • Supervised Learning
  • Parametric Learning
  • Bayes Decision Theory
  • Univariate data
  • 2-class problem
  • different variances
  • equal priors
  • Cauchy model (2 parameters)
  • With conditional Risk (1-0 loss functions)

View IPython Notebook

Download PDF


#### Multivariate Normal Density

Example 1

[back to top]

Problem Category:
  • Statistical Pattern Recognition
  • Supervised Learning
  • Parametric Learning
  • Bayes Decision Theory
  • Multivariate data (2-dimensional)
  • 2-class problem
  • different variances
  • equal prior probabilities
  • Gaussian model (2 parameters)
  • with conditional Risk (1-0 loss functions)

View IPython Notebook

Download PDF


About

A collection of tutorials and examples for solving and understanding machine learning and pattern classification tasks

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors