How does Lasso regression differ from Ridge regression?
- Both use L1 regularization
- Both use L2 regularization
- Lasso uses L1 regularization, Ridge uses L2
- Lasso uses L2 regularization, Ridge uses L1
Lasso (Least Absolute Shrinkage and Selection Operator) regression uses L1 regularization, which can lead to some coefficients being exactly zero, thus performing feature selection. Ridge regression uses L2 regularization, which shrinks the coefficients but doesn't set them to zero. These different regularization techniques define their behavior and application.
Loading...
Related Quiz
- In a situation where the data is densely packed in some regions and sparse in others, how would the choice of K and distance metric influence the results, and what would be the best approach?
- Which machine learning algorithm works by recursively splitting the data set into subsets based on the value of features until it reaches a certain stopping criterion?
- The Naive Bayes classifier assumes that the presence or absence of a particular feature of a class is ________ of the presence or absence of any other feature.
- In the context of building a model, the _________ are carefully selected and processed to improve the model's performance.
- The ___________ regression technique can be used when the relationship between the independent and dependent variables is not linear.