How does ElasticNet combine the properties of both Ridge and Lasso regularization?
- Does not combine properties
- Uses L1 penalty only
- Uses L2 penalty only
- Uses both L1 and L2 penalties
Elastic Net combines both L1 and L2 penalties, thus including properties of both Ridge (L2) and Lasso (L1) regularization.
The slope of your Simple Linear Regression model is close to zero, but the intercept is significant. What does this indicate, and what could be the potential reason?
- Error in Model, Incorrect Data
- No Relationship, Constant Value of Dependent Variable
- Strong Relationship, Outliers
- Weak Relationship, Lack of Variation in Independent Variable
A slope close to zero may indicate a weak or no relationship between the variables, and this could be due to a lack of variation in the independent variable.
What is clustering in the context of Machine Learning?
- A classification algorithm
- A regression method
- A supervised learning technique
- An unsupervised learning technique for grouping similar data
Clustering is an unsupervised learning technique used to group similar data points together without any labeled responses.
Your model is showing signs of overfitting. How could bagging or boosting be utilized to address this problem?
- Bagging to average predictions of overfitted models
- Bagging with increased complexity
- Boosting with reduced complexity
- Both bagging and boosting can't address overfitting
Bagging can help address overfitting by averaging predictions from overfitted models trained on different subsets of data. This helps to cancel out the noise and reduce the overall variance of the ensemble.
In what scenarios would you prefer Polynomial Regression over Simple Linear Regression?
- When the data is categorical
- When the relationship is linear
- When the relationship is logarithmic
- When the relationship is quadratic or higher-order
Polynomial Regression is preferred over Simple Linear Regression when the relationship between the dependent and independent variables is not linear but can be modeled as a polynomial (quadratic, cubic, etc.). Polynomial regression can capture more complex patterns in the data, making it suitable for non-linear relationships.
How can overfitting and underfitting be detected through training and testing data?
- Overfitting detected by high training error; Underfitting by low testing error
- Overfitting detected by low complexity; Underfitting by high complexity
- Overfitting detected by low training error and high testing error; Underfitting by high training and testing errors
- Underfitting detected by low training error; Overfitting by low testing error
Overfitting is detected when there is low training error but high testing error, as the model fits the training data too well but fails to generalize. Underfitting is detected when both training and testing errors are high, indicating that the model fails to capture underlying trends.
A weather forecasting agency is looking to improve the accuracy of its predictions. What Machine Learning methods would be relevant here?
- Clustering, Text Classification
- Image Recognition, Drug Development
- Recommender Systems, Financial Data
- Weather Data, Time-Series Forecasting
Weather Data and Time-Series Forecasting methods, like ARIMA or deep learning models, can be used to analyze and predict weather patterns, leveraging historical weather data and atmospheric conditions to improve accuracy.
You are using K-Means clustering on a dataset with varying densities among clusters. How might this affect the choice of centroid initialization method?
- Initializing centroids randomly without consideration to density
- Varying densities have no impact on initialization
- Varying densities necessitate careful centroid initialization
- Varying densities require different distance metrics
When working with varying densities among clusters, careful centroid initialization is needed to ensure that the K-Means algorithm doesn't bias toward denser clusters. The selection of initial centroids can have a significant impact on the final clustering when densities vary widely.
How does boosting reduce bias in a machine learning model?
- By averaging the predictions of many models
- By focusing on one strong model
- By training only on the easiest examples
- By training sequentially on misclassified examples
Boosting reduces bias by training models sequentially, with each model focusing on the examples that were misclassified by the previous ones. This iterative correction process reduces bias and enhances the overall performance of the model.
Why is entropy used in Decision Trees?
- Increase Efficiency
- Increase Size
- Measure Purity
- Predict Outcome
Entropy is used to measure the purity of a split, helping to determine the best attribute for splitting at each node.