You have built a Logistic Regression model, but the link test indicates that the Logit link function may not be appropriate. What could be the issue?
- Incorrect loss function
- Multicollinearity
- Non-linearity between predictors and log-odds
- Overfitting
If the Logit link function is not appropriate, it might indicate that there is a non-linear relationship between the predictors and the log-odds of the response, violating the assumptions of Logistic Regression.
You notice that your KNN model is highly sensitive to outliers. What might be causing this, and how could the choice of K and distance metric help in alleviating this issue?
- Choose a larger K and an appropriate distance metric to mitigate sensitivity
- Choose a small K and ignore outliers
- Focus only on the majority class
- Outliers have no effect
Choosing a larger K and an appropriate distance metric can help mitigate the sensitivity to outliers, as it would reduce the influence of individual data points.
Explain how weighting the contributions of the neighbors can improve the KNN algorithm's performance.
- Allows more influence from nearer neighbors
- Improves sensitivity to outliers
- Increases bias
- Reduces complexity
Weighting the contributions of the neighbors allows nearer neighbors to have more influence on the prediction, often leading to improved performance in KNN.
Can you differentiate between Logistic Regression and K-Nearest Neighbors (KNN) in terms of use case and functionality?
- LR is for classification, KNN for classification; LR uses probability, KNN uses distance
- LR is for classification, KNN for regression; LR uses distance, KNN uses probability
- LR is for classification, KNN for regression; LR uses probability, KNN uses distance
- LR is for regression, KNN for classification; LR uses distance, KNN uses probability
Logistic Regression is used for classification and models the probability of a binary outcome. KNN is also used for classification but works by considering the 'K' nearest data points. The fundamental difference lies in the approach: LR uses a logistic function, while KNN uses distance metrics.
Your K-Means clustering algorithm is converging to a local minimum. What role might centroid initialization play in this, and how could you address it?
- Increase the number of clusters
- Initialize centroids based on labels
- Poor initialization; Try multiple random initializations
- Use a fixed number of centroids
Converging to a local minimum in K-Means is often due to poor initialization. Running the algorithm multiple times with different random initializations can help avoid local minima and lead to a more globally optimal solution.
Describe the relationship between the Logit function, Odds Ratio, and the likelihood function in Logistic Regression.
- The Logit function is used for multi-class, Odds Ratio for binary, likelihood for regression
- The Logit function maps probabilities to log-odds, Odds Ratio quantifies effect on odds, likelihood function is used for estimation
- The Logit function maps probabilities to odds, Odds Ratio quantifies effect on odds, likelihood function maximizes probabilities
- They are unrelated
In Logistic Regression, the Logit function maps probabilities to log-odds, the Odds Ratio quantifies the effect of predictors on odds, and the likelihood function is used to estimate the model parameters by maximizing the likelihood of observing the given data.
Explain how Ridge and Lasso handle multicollinearity among the features.
- Both eliminate correlated features
- Both keep correlated features
- Ridge eliminates correlated features; Lasso keeps them
- Ridge keeps correlated features; Lasso eliminates them
Ridge regularization keeps correlated features but shrinks coefficients; Lasso can eliminate some by setting coefficients to zero.
What are some common applications for each of the four types of Machine Learning: Supervised, Unsupervised, Semi-Supervised, and Reinforcement?
- Specific to finance
- Specific to healthcare
- Specific to manufacturing
- Varies based on the problem domain
The applications for these types of Machine Learning vary and can be tailored to various problem domains, not confined to specific industries.
What is the difference between simple linear regression and multiple linear regression?
- Number of dependent variables
- Number of equations
- Number of independent variables
- Number of observations
Simple linear regression involves one independent variable to predict a dependent variable, whereas multiple linear regression uses two or more independent variables for prediction. The inclusion of more variables in multiple linear regression allows for more complex models and can lead to a better understanding of the relationships between variables.
The performance of an LDA model can be evaluated using ___________, which considers both within-class and between-class variances.
- accuracy metrics
- error rate
- feature selection
- principal components
"Accuracy metrics" that consider both within-class and between-class variances can be used to evaluate the performance of an LDA model. It gives a comprehensive view of how well the model has separated the classes.