You have a dataset with many correlated features, and you decide to use PCA. How would you determine which Eigenvectors to keep?
- By choosing the eigenvectors with the highest eigenvalues
- By randomly selecting eigenvectors
- By selecting the eigenvectors with negative eigenvalues
- By using all eigenvectors without exception
You would keep the eigenvectors corresponding to the highest eigenvalues, as they explain the most variance in the data. The lower the eigenvalue, the less significant the corresponding eigenvector.
Explain the application of clustering algorithms in customer segmentation for marketing strategies.
- Clustering Customers
- Image Recognition
- Supply Chain Management
- Text Classification
Clustering algorithms are used in customer segmentation to group customers based on similar characteristics or behaviors. These clusters help marketing teams to target specific segments with tailored marketing strategies, improving engagement and conversion rates.
What are the underlying assumptions of Logistic Regression?
- Linearity of predictors and log-odds, Independence of errors, No multicollinearity
- Linearity, Independence, Normality, Equal Variance
- No assumptions required
- Nonlinearity, Dependence, Non-Normality
Logistic Regression assumes a linear relationship between predictors and log-odds, independence of errors, and no multicollinearity among predictors. It does not assume normality or equal variance of errors.
The ___________ test in Logistic Regression can be used to assess if the Logit link function is the correct specification for the model.
- AIC
- Hosmer-Lemeshow
- Likelihood-ratio
- Link
The Link test in Logistic Regression can be used to determine if the Logit link function is the correct specification for the model.
Which field utilizes Machine Learning to recommend products or media to consumers based on their past behavior?
- Autonomous Driving
- Education
- Healthcare
- Recommender Systems
Recommender Systems use machine learning algorithms to suggest products, media, or content to users based on their past interactions and behavior, creating personalized experiences.
What are the underlying assumptions of LDA, and how do they affect the performance?
- Assumes different covariance matrices, normal distribution; affects adaptability
- Assumes equal class sizes; affects bias
- Assumes equal variance, non-normal distribution; affects robustness
- Assumes normal distribution, equal covariance matrices; affects classification accuracy
LDA assumes that the features are normally distributed and that the classes have equal covariance matrices. These assumptions, if met, lead to better "classification accuracy," but if violated, may lead to suboptimal performance.
__________ is a boosting algorithm that builds trees one at a time, where each tree corrects the errors of the previous one.
- AdaBoost
- Bagging
- Gradient Boosting
- Random Forest
AdaBoost is a boosting algorithm that builds trees sequentially, with each tree correcting the errors of the previous one by giving more weight to the misclassified instances.
What is the relationship between dimensionality reduction and the curse of dimensionality?
- Depends on the method
- Has no relationship
- Helps in mitigating the curse
- Intensifies the curse
The relationship between dimensionality reduction and the curse of dimensionality is that dimensionality reduction helps in mitigating the curse. The curse of dimensionality refers to the challenges that arise as the number of dimensions increases, and reducing dimensions can alleviate these problems.
You need to improve the performance of a weak learner. Which boosting algorithm would you select, and why?
- AdaBoost
- Any boosting algorithm will suffice
- Gradient Boosting without considering the loss function
- Random Boosting
AdaBoost is a boosting algorithm designed to improve the performance of weak learners. By adjusting the weights of misclassified instances and focusing on them in subsequent models, AdaBoost iteratively corrects errors and enhances the overall model's performance.
You are using KNN for a regression problem. What are the special considerations in selecting K and the distance metric, and how would you evaluate the model's performance?
- Choose K and metric considering data characteristics, evaluate using regression metrics
- Choose fixed K and Manhattan metric, evaluate using recall
- Choose large K and any metric, evaluate using accuracy
- Choose small K and Euclidean metric, evaluate using precision
Selecting K and distance metric considering the data characteristics and evaluating the model using regression metrics like RMSE or MAE is the right approach for KNN in regression.