You have built an SVM for a binary classification problem but the model is overfitting. What changes can you make to the kernel or hyperparameters to improve the model?
- Change the kernel's color
- Change to a simpler kernel or adjust the regularization parameter 'C'
- Ignore overfitting
- Increase the kernel's complexity
Overfitting can be mitigated by choosing a simpler kernel or adjusting the regularization parameter 'C', allowing for a better balance between bias and variance.
How does DBSCAN handle outliers compared to other clustering algorithms?
- Considers them as part of existing clusters
- Ignores them completely
- Treats more isolated points as noise
- Treats them as individual clusters
DBSCAN has a unique way of handling outliers, treating more isolated points as noise rather than forcing them into existing clusters or forming new clusters. This approach allows DBSCAN to identify clusters of varying shapes and sizes while ignoring sparse or irrelevant points, making it more robust to noise and outliers compared to some other clustering methods.
What could be the potential problems if the assumptions of Simple Linear Regression are not met?
- Model May Become Biased or Inefficient
- Model May Overfit
- Model Will Always Fail
- No Impact on Model
If the assumptions of Simple Linear Regression are not met, the model may become biased or inefficient, leading to unreliable estimates. It may also affect the validity of statistical tests.
Ridge regularization adds a ________ penalty to the loss function, which helps to constrain the coefficients.
- L1
- L1 and L2
- L2
- nan
Ridge regularization adds an L2 penalty to the loss function, which helps to reduce the coefficients' magnitude without setting them to zero.
Imagine you are working with a large dataset, and the Elbow Method is computationally expensive. What alternative methods might you consider for determining the number of clusters?
- Double the number of centroids
- Gap Statistic, Silhouette Method
- Randomly choose the number of clusters
- Use the Elbow Method with reduced data
Alternatives like the Gap Statistic and Silhouette Method are used to determine the optimal number of clusters when the Elbow Method is computationally expensive. These methods consider cluster cohesion and separation without requiring extensive computations.
How can you detect whether a model is overfitting or underfitting the data?
- By analyzing the training and validation errors
- By increasing model complexity
- By looking at the model's visualizations
- By reducing model complexity
Detecting overfitting or underfitting can be done "by analyzing the training and validation errors." Overfitting shows high training accuracy but low validation accuracy, while underfitting shows poor performance on both.
Describe a scenario where you would use the F1-Score as the main performance metric, and explain why it would be suitable.
- In a balanced dataset, to ensure model fairness
- In a scenario where only false negatives are important
- In an imbalanced dataset, to balance both false positives and false negatives
- nan
F1-Score is especially suitable for imbalanced datasets, as it balances both Precision and Recall, ensuring that the model does not bias towards the majority class. It gives an equal weight to false positives and false negatives, providing a more holistic evaluation of the model's performance.
What is the branch of Machine Learning that involves neural networks with three or more layers, which work to analyze various factors of data?
- Deep Learning
- Reinforcement Learning
- Supervised Learning
- Unsupervised Learning
Deep Learning is a subset of Machine Learning that uses neural networks with three or more layers to analyze complex patterns in data.
What are the advantages and limitations of using Bootstrapping in Machine Learning?
- Fast computation but lacks precision
- Reduced bias but increased computation complexity
- Robust statistical estimates but can introduce high variance
- Robust statistical estimates but may not always be appropriate for all data types
The advantages of Bootstrapping include robust statistical estimates, even with small samples, by resampling with replacement. However, it may not always be appropriate for all data types, especially if the underlying distribution of the data is not well represented by resampling. It provides valuable insights but needs to be applied considering the nature of the data and problem.
While R-Squared describes the proportion of variance explained by the model, ________ adjusts this value based on the number of predictors, providing a more nuanced understanding of the model's fit.
- Adjusted R-Squared
- MSE
- R-Squared
- RMSE
Adjusted R-Squared is an extension of R-Squared that adjusts the value based on the number of predictors in the model. While R-Squared describes the proportion of variance explained by the model, Adjusted R-Squared takes into account the complexity of the model by considering the number of predictors. This leads to a more nuanced understanding of the model's fit, particularly when comparing models with different numbers of predictors.