Machine Learning Algorithms

Machine Learning Algorithms

Machine learning algorithms can be categorised into three major groups

• supervised learning (deals with the labelled data)
• unsupervised learning (deals with the unlabelled data)
• reinforcement learning (a feedback-based Machine learning technique that allows an agent to learn in an interactive environment by trial and error)

List of Common Machine Learning Algorithms

Classification Algorithms

• Naive Bayes
• Decision Tree
• kNN
• SVM
• Logistic Regression

Regression Analysis

• Linear Regression
• Lasso Regression (Least absoulute selection and shrinkage operator)
• Ridge Regression (L2)
• Elastic Net Regression

Ensemble

• Random Forest
• Gradient Boosting algorithms
  • GBM
  • XGBoost
  • LightGBM
  • CatBoost

Clustering

• K-Means

Regularization Regularization is used to prevent overfitting.

• LASSO Regularization (Least Absolute Shrinkage and Selection Operator)
• Ridge Regularization
• Elastic Net Regularization

Neural Networks

• Perceptron
• Multilayer Perceptron (MLP)
• Recurrent Neural Network (RNN)
• Convolutional Neural Network (CNN)
• Deep Belief Network (DBN)
• Hopfield Networks
• Learning Vector Quantization (LVQ)
• Stacked Autoencoder
• Boltzmann Machine
• Restricted Boltzmann Machine (RBM)
• Generative Adversarial Networks (GANs)

Dimensionality Reduction Algorithms

• Principal Component Analysis (PCA)
• Latent Dirichlet Analysis (LDA)
• Multidimensional Scaling (MDS)
• Isomap