What is dimensionality reduction, and why is it used in machine learning?
- All of the above
- Increasing model accuracy
- Reducing computational complexity
- Reducing number of dimensions
Dimensionality reduction refers to the process of reducing the number of input variables or dimensions in a dataset. It is used to simplify the model and reduce computational complexity, potentially improving model interpretability, but it does not inherently increase model accuracy.
If the relationship between variables in a dataset is best fit by a curve rather than a line, you might use _________ regression.
- Linear
- Logistic
- Polynomial
- Ridge
If the relationship between variables is best fit by a curve rather than a line, Polynomial regression would be used. It can model nonlinear relationships by including polynomial terms in the equation.
You have two models with similar Accuracy but different Precision and Recall values. How would you decide which model is better for a given application?
- Choose based on the specific application's needs and tolerance for false positives/negatives
- Choose the one with higher Precision
- Choose the one with higher Recall
- nan
When models have similar Accuracy but different Precision and Recall, the choice between them should be based on the specific application's needs. If false positives are more costly, prioritize Precision; if false negatives are more crucial, prioritize Recall.
In what situations would it be appropriate to use Logistic Regression with the Logit link function?
- All regression problems
- Binary classification with a nonlinear relationship between predictors
- Binary classification with linear relationship between predictors
- Multi-class classification
Logistic Regression with the Logit link function is particularly suited for binary classification problems where there is a linear relationship between the predictors and the log-odds of the response.
One method to mitigate multicollinearity is to apply ___________ regression, which adds a penalty term to the loss function.
- Lasso
- Logistic
- Polynomial
- Ridge
Ridge regression is a technique that can mitigate multicollinearity by adding a penalty term to the loss function. The penalty term helps in reducing the effect of correlated variables, leading to more stable coefficients.
How is the Logit function related to Logistic Regression?
- It is a type of cost function
- It is an alternative name for Logistic Regression
- It's the inverse of the Sigmoid function and maps probabilities to log-odds
- It's used for multi-class classification
In Logistic Regression, the Logit function is the inverse of the Sigmoid function. It maps probabilities to log-odds and forms the link function in logistic modeling.
In the context of Machine Learning, the term _________ refers to the algorithm's ability to generalize from the training data to unseen data.
- Generalization
- Optimization
- Overfitting
- Regularization
Generalization refers to the model's ability to make accurate predictions on new, unseen data, as opposed to fitting only to the training data.
What is the name of the process where a Machine Learning model learns patterns from the data?
- Classification
- Clustering
- Training
- Validation
The process where a Machine Learning model learns patterns from the data is referred to as "Training." This involves adjusting the model's parameters to minimize error and accurately predict outcomes.
How would you tune the hyperparameters for a Random Forest model for a given classification problem, and what factors would you consider?
- Focus only on the number of trees
- Grid Search considering the number of trees, depth, and other hyperparameters
- Manual selection without considering the problem
- Random selection
Tuning the hyperparameters for a Random Forest model can be effectively done using Grid Search. Considering factors such as the number of trees, depth, minimum samples split, and others allows for a comprehensive search through the hyperparameter space to find the optimal configuration tailored to the specific classification problem.
What is a Support Vector Machine (SVM) used for in Machine Learning?
- Classification and Regression
- Clustering
- Image Compression
- Text Mining
SVM is a supervised learning algorithm mainly used for classification and regression tasks.