_________ regression adds a penalty equivalent to the square of the magnitude of coefficients, whereas _________ regression adds a penalty equivalent to the absolute value of the magnitude.
- Lasso
- Linear
- Polynomial
- Ridge
Ridge regression adds a penalty equivalent to the square of the magnitude of coefficients, whereas Lasso regression adds a penalty equivalent to the absolute value of the magnitude.
In regression analysis, the metric that tells you the proportion of the variance in the dependent variable that is predictable from the independent variables is called _________.
- Adjusted R-Squared
- Mean Squared Error
- R-Squared
- Root Mean Squared Error
In regression analysis, R-Squared tells you the proportion of the variance in the dependent variable that is predictable from the independent variables. It provides a measure of how well the regression line fits the data.
An educational institution wants to personalize its online learning platform for individual student needs. How would you leverage Machine Learning to achieve this goal?
- Image Recognition, Fraud Detection
- Personalized Learning Paths, Data Analysis
- Recommender Systems, Drug Development
- Supply Chain Management, Weather Prediction
Creating Personalized Learning Paths and analyzing student data using techniques like clustering or decision trees allows for the customization of content and resources according to individual student performance and preferences.
You are working on a project where Simple Linear Regression seems appropriate, but the independent variable is categorical. How would you handle this situation?
- Change the Dependent Variable
- Ignore the Variable
- Treat as Continuous Variable
- Use Dummy Variables
For a categorical independent variable in Simple Linear Regression, you can create dummy variables to represent the categories.
A linear regression model's R-Squared value significantly improves after polynomial features are added. What could be the reason, and what should you be cautious about?
- Reason: Improved fit to nonlinear patterns; Caution: Risk of overfitting
- Reason: Increased bias; Caution: Risk of complexity
- Reason: Increased complexity; Caution: Risk of bias
- Reason: Reduced error; Caution: Risk of underfitting
The significant improvement in R-Squared value after adding polynomial features indicates an improved fit to potentially nonlinear patterns in the data. However, caution should be exercised as adding too many polynomial features may lead to overfitting, where the model fits the noise in the training data rather than the underlying trend. Regularization techniques and cross-validation can be used to mitigate this risk.
What type of problems is Logistic Regression mainly used to solve?
- Binary classification problems
- Clustering problems
- Regression problems
- Unsupervised learning problems
Logistic Regression is mainly used to solve binary classification problems, where the goal is to classify instances into one of two classes.
When interpreting a dendrogram in Hierarchical Clustering, the height of the _________ represents the distance at which clusters are merged.
- Branches
- Leaves
- Lines
- Nodes
In a dendrogram, the height of the branches represents the distance at which clusters are merged. The higher the branch, the greater the distance, indicating that the clusters being merged are less similar. This information can guide the selection of the number of clusters and provides insights into the underlying structure of the data.
A business stakeholder wants to use a very high-degree Polynomial Regression for forecasting, arguing that it fits the historical data perfectly. How would you explain the risks of this approach and suggest a more robust method?
- Encourage the high-degree approach
- Explain the risk of overfitting and suggest using cross-validation or regularization
- Focus only on training data
- Ignore the stakeholder's suggestion
The high-degree approach is prone to overfitting and may not generalize well to future data. Explaining this risk and suggesting more robust methods such as cross-validation or regularization can help in building a more reliable forecasting model.
You are using Bootstrapping to estimate the confidence interval for a model parameter. Explain how the process works.
- By calculating the mean and standard deviation without resampling
- By randomly selecting without replacement from the dataset
- By resampling with replacement and calculating empirical quantiles of the distribution
- By splitting the data into training and validation sets
Bootstrapping to estimate the confidence interval for a model parameter involves resampling with replacement from the original data, calculating the parameter for each resampled dataset, and then determining empirical quantiles of the parameter's distribution. It allows the estimation of confidence intervals even when the underlying distribution is unknown.
What are the key differences between Hierarchical Clustering and K-Means Clustering?
- Algorithm Complexity
- Cluster Number & Structure
- Data Type
- Learning Type
Hierarchical Clustering builds a tree-like structure and does not require a predefined number of clusters, whereas K-Means requires the number of clusters in advance and builds non-hierarchical clusters.