Lec-4 Nonlinear Activation Units and Learning Mechanisms

Course Lectures

• Lec-1 Introduction to Artificial Neural Networks

  Prof. Somnath Sengupta

  Play
• Lec-2 Artificial Neuron Model and Linear Regression

  Prof. Somnath Sengupta

  Play
• Lec-3 Gradient Descent Algorithm

  Prof. Somnath Sengupta

  Play
• Lec-4 Nonlinear Activation Units and Learning Mechanisms

  Prof. Somnath Sengupta

  Playing
• Lec-5 Learning Mechanisms-Hebbian,Competitive,Boltzmann

  Prof. Somnath Sengupta

  Play
• Lec-6 Associative memory

  Prof. Somnath Sengupta

  Play
• Lec-7 Associative Memory Model

  Prof. Somnath Sengupta

  Play
• Lec-8 Condition for Perfect Recall in Associative Memory

  Prof. Somnath Sengupta

  Play
• Lec-9 Statistical Aspects of Learning

  Prof. Somnath Sengupta

  Play
• Lec-10 V.C. Dimensions: Typical Examples

  Prof. Somnath Sengupta

  Play
• Lec-11 Importance of V.C. Dimensions Structural Risk Minimization

  Prof. Somnath Sengupta

  Play
• Lec-12 Single-Layer Perceptions

  Prof. Somnath Sengupta

  Play
• Lec-13 Unconstrained Optimization: Gauss-Newtons Method

  Prof. Somnath Sengupta

  Play
• Lec-14 Linear Least Squares Filters

  Prof. Somnath Sengupta

  Play
• Lec-15 Least Mean Squares Algorithm

  Prof. Somnath Sengupta

  Play
• Lec-16 Perceptron Convergence Theorem

  Prof. Somnath Sengupta

  Play
• Lec-17 Bayes Classifier&Perceptron: An Analogy

  Prof. Somnath Sengupta

  Play
• Lec-18 Bayes Classifier for Gaussian Distribution

  Prof. Somnath Sengupta

  Play
• Lec-19 Back Propagation Algorithm

  Prof. Somnath Sengupta

  Play
• Lec-20 Practical Consideration in Back Propagation Algorithm

  Prof. Somnath Sengupta

  Play
• Lec-21 Solution of Non-Linearly Separable Problems Using MLP

  Prof. Somnath Sengupta

  Play
• Lec-22 Heuristics For Back-Propagation

  Prof. Somnath Sengupta

  Play
• Lec-23 Multi-Class Classification Using Multi-layered Perceptrons

  Prof. Somnath Sengupta

  Play
• Lec-24 Radial Basis Function Networks: Cover's Theorem

  Prof. Somnath Sengupta

  Play
• Lec-25 Radial Basis Function Networks: Separability&Interpolation

  Prof. Somnath Sengupta

  Play
• Lec-26 Radial Basis Function as ill-Posed Surface Reconstruc

  Prof. Somnath Sengupta

  Play
• Lec-27 Solution of Regularization Equation: Greens Function

  Prof. Somnath Sengupta

  Play
• Lec-28 Use of Greens Function in Regularization Networks

  Prof. Somnath Sengupta

  Play
• Lec-29 Regularization Networks and Generalized RBF

  Prof. Somnath Sengupta

  Play
• Lec-30 Comparison Between MLP and RBF

  Prof. Somnath Sengupta

  Play
• Lec-31 Learning Mechanisms in RBF

  Prof. Somnath Sengupta

  Play
• Lec-32 Introduction to Principal Components and Analysis

  Prof. Somnath Sengupta

  Play
• Lec-33 Dimensionality reduction Using PCA

  Prof. Somnath Sengupta

  Play
• Lec-34 Hebbian-Based Principal Component Analysis

  Prof. Somnath Sengupta

  Play
• Lec-35 Introduction to Self Organizing Maps

  Prof. Somnath Sengupta

  Play
• Lec-36 Cooperative and Adaptive Processes in SOM

  Prof. Somnath Sengupta

  Play
• Lec-37 Vector-Quantization Using SOM

  Prof. Somnath Sengupta

  Play