Regularization

IIT Roorkee 2019

“Underfit” or “High bias” “Just right” “Overfit” or “High variance”
“Underfit” or “High bias” “Just right” “Overfit” or “High variance”
Regularized Cost Function

Choose parameter θ:
Regularization parameter
Regularized Linear Regression

Cost function:

Gradient descent:
 Normal Equation

(Without regularization)

(n+1) * (n+1) – dimension matrix

(With regularization)
 Regularized Logistic Regression

Cost function:

Gradient descent: