What are the main challenges in training a Machine Learning model with imbalanced datasets?
- Computational complexity
- Dimensionality reduction
- Lack of suitable algorithms
- Overfitting to the majority class
Training on imbalanced datasets can lead to models that are biased towards the majority class, since they have seen more examples of it. This can make the model perform poorly on the minority class.
While estimating the coefficients in Simple Linear Regression, you find that one of the assumptions is not met. How would this affect the reliability of the predictions?
- Increase Accuracy
- Make Predictions More Reliable
- Make Predictions Unreliable
- No Effect
If the assumptions of Simple Linear Regression are not met, the reliability of the predictions may be compromised, and the model may become biased or inefficient.
You have a dataset with many correlated features, and you decide to use PCA. How would you determine which Eigenvectors to keep?
- By choosing the eigenvectors with the highest eigenvalues
- By randomly selecting eigenvectors
- By selecting the eigenvectors with negative eigenvalues
- By using all eigenvectors without exception
You would keep the eigenvectors corresponding to the highest eigenvalues, as they explain the most variance in the data. The lower the eigenvalue, the less significant the corresponding eigenvector.
Explain the application of clustering algorithms in customer segmentation for marketing strategies.
- Clustering Customers
- Image Recognition
- Supply Chain Management
- Text Classification
Clustering algorithms are used in customer segmentation to group customers based on similar characteristics or behaviors. These clusters help marketing teams to target specific segments with tailored marketing strategies, improving engagement and conversion rates.
What are the underlying assumptions of Logistic Regression?
- Linearity of predictors and log-odds, Independence of errors, No multicollinearity
- Linearity, Independence, Normality, Equal Variance
- No assumptions required
- Nonlinearity, Dependence, Non-Normality
Logistic Regression assumes a linear relationship between predictors and log-odds, independence of errors, and no multicollinearity among predictors. It does not assume normality or equal variance of errors.
What are the underlying assumptions of LDA, and how do they affect the performance?
- Assumes different covariance matrices, normal distribution; affects adaptability
- Assumes equal class sizes; affects bias
- Assumes equal variance, non-normal distribution; affects robustness
- Assumes normal distribution, equal covariance matrices; affects classification accuracy
LDA assumes that the features are normally distributed and that the classes have equal covariance matrices. These assumptions, if met, lead to better "classification accuracy," but if violated, may lead to suboptimal performance.
__________ is a boosting algorithm that builds trees one at a time, where each tree corrects the errors of the previous one.
- AdaBoost
- Bagging
- Gradient Boosting
- Random Forest
AdaBoost is a boosting algorithm that builds trees sequentially, with each tree correcting the errors of the previous one by giving more weight to the misclassified instances.
What is the relationship between dimensionality reduction and the curse of dimensionality?
- Depends on the method
- Has no relationship
- Helps in mitigating the curse
- Intensifies the curse
The relationship between dimensionality reduction and the curse of dimensionality is that dimensionality reduction helps in mitigating the curse. The curse of dimensionality refers to the challenges that arise as the number of dimensions increases, and reducing dimensions can alleviate these problems.
You need to improve the performance of a weak learner. Which boosting algorithm would you select, and why?
- AdaBoost
- Any boosting algorithm will suffice
- Gradient Boosting without considering the loss function
- Random Boosting
AdaBoost is a boosting algorithm designed to improve the performance of weak learners. By adjusting the weights of misclassified instances and focusing on them in subsequent models, AdaBoost iteratively corrects errors and enhances the overall model's performance.
You are using KNN for a regression problem. What are the special considerations in selecting K and the distance metric, and how would you evaluate the model's performance?
- Choose K and metric considering data characteristics, evaluate using regression metrics
- Choose fixed K and Manhattan metric, evaluate using recall
- Choose large K and any metric, evaluate using accuracy
- Choose small K and Euclidean metric, evaluate using precision
Selecting K and distance metric considering the data characteristics and evaluating the model using regression metrics like RMSE or MAE is the right approach for KNN in regression.