What is the purpose of 'normalization' or 'standardization' in the pre-processing step of cluster analysis?

  • To decrease the number of clusters
  • To ensure that all features contribute equally to the distance calculation
  • To handle missing values
  • To increase the computational complexity
Normalization or standardization ensures that all features contribute equally to the final distance calculation, regardless of their original scale. Without this step, features with larger scales would dominate the distance calculation, potentially leading to misleading clusters.

Conditional independence of A and B given C means that knowing that C has occurred does not change the ________ between A and B.

  • Difference
  • Intersection
  • Ratio
  • Relationship
Conditional independence of A and B given C means that knowing that C has occurred does not change the relationship between A and B. In other words, the occurrence of event C does not affect the independence of events A and B.

What is the assumption made when computing the Pearson correlation coefficient?

  • The correlation is zero
  • The variables are independent
  • The variables are normally distributed
  • There is a linear relationship between variables
When computing the Pearson correlation coefficient, it is assumed that there is a linear relationship between the variables. Furthermore, it's also assumed that the variables are continuous and that the data is homoscedastic (i.e., the variance of the errors is the same across all levels of the variables).

How is the variance related to the standard deviation in a data set?

  • The variance is the average of the standard deviation
  • The variance is the square of the standard deviation
  • The variance is the square root of the standard deviation
  • The variance is twice the standard deviation
The variance is the square of the standard deviation. Standard deviation is a measure of dispersion in a dataset and variance is a square of it, meaning that they both represent the same concept of dispersion, but in different units.

What does a residual plot tell us about the fit of the model?

  • It indicates how well the model's predictions match the actual data
  • It indicates the variance of the residuals
  • It shows the correlation between the dependent and independent variables
  • It shows the relationship between the dependent and independent variables
A residual plot shows the residuals on the y-axis and the independent variable on the x-axis. If the points in a residual plot are randomly dispersed around the horizontal axis, a linear regression model is appropriate for the data; otherwise, a non-linear model is more appropriate.

Can PCA be used for both supervised and unsupervised learning?

  • No
  • Only for supervised learning
  • Only for unsupervised learning
  • Yes
No, PCA is a technique for unsupervised learning. It does not use any class label information in its algorithm, making it unsupervised. However, the transformed dataset from PCA can be used for subsequent supervised learning tasks.

What is the effect of outliers on PCA?

  • It depends on the distribution of the data
  • They can distort the principal components
  • They enhance the performance of PCA
  • They have no effect on PCA
Outliers can significantly distort the principal components identified by PCA, as they can artificially inflate the variance along their direction. It's generally a good practice to address outliers before applying PCA.

What is the concept of "Type I" error in the context of hypothesis testing?

  • Failing to reject a false null hypothesis
  • Failing to reject a true alternative hypothesis
  • Rejecting a false alternative hypothesis
  • Rejecting a true null hypothesis
A Type I error in hypothesis testing is the incorrect rejection of a true null hypothesis, often signified by the Greek letter alpha (α). In other words, a Type I error happens when the researcher incorrectly concludes that the null hypothesis is false when, in fact, it is true.

When can we apply the Chi-square test for goodness of fit?

  • When the data are continuously distributed
  • When the data are normally distributed
  • When we have categorical data and want to see if it follows a specific distribution
  • When we want to compare means
The Chi-square test for goodness of fit is used when we have categorical data and we want to see if the data follows a specific distribution.

How does Spearman's Rank Correlation react to outliers as compared to Pearson's correlation?

  • Both are equally sensitive to outliers
  • Less sensitive to outliers
  • More sensitive to outliers
  • Neither is sensitive to outliers
Spearman's Rank Correlation is less sensitive to outliers than Pearson's correlation. This is because Spearman's correlation is based on rank orders rather than raw data values, making it more robust against outliers.