Non-parametric tests are also known as ________ tests because they make fewer assumptions about the data.
- assumption-free
- distribution-free
- free-assumption
- free-distribution
Non-parametric tests are also known as distribution-free tests because they make fewer assumptions about the data, specifically, they do not require the data to follow a specific distribution.
How can you test the assumption of independence in a Chi-square test for goodness of fit?
- By calculating the standard deviation of the observations
- By conducting a separate Chi-square test of independence
- By conducting a t-test
- By examining the correlation between observations
To test the assumption of independence in a Chi-square test for goodness of fit, you can conduct a separate Chi-square test of independence. This test compares the observed frequencies in each category with what we would expect if the variables were independent.
How does skewness affect the relationship between the mean, median, and mode of a distribution?
- Changes the relationship
- Increases the standard deviation
- No effect
- Reduces the kurtosis
Skewness affects the relationship between the mean, median, and mode. In a positively skewed distribution, the mean is usually greater than the median, which is greater than the mode. In a negatively skewed distribution, the mode is usually greater than the median, which is greater than the mean.
Under what conditions does the Central Limit Theorem hold true?
- When the data is skewed
- When the population is normal
- When the sample size is sufficiently large
- When the standard deviation is zero
The Central Limit Theorem holds true when the sample size is sufficiently large (usually n > 30), regardless of the shape of the population distribution. This theorem states that if you have a population with mean μ and standard deviation σ and take sufficiently large random samples from the population with replacement, then the distribution of the sample means will be approximately normally distributed.
What is the difference between a parameter and a statistic in the field of statistics?
- A parameter and a statistic are the same thing
- A parameter is based on a sample; a statistic is based on the population
- A statistic is a numerical measure; a parameter is a graphical representation
- A statistic is based on a sample; a parameter is based on the population
In the field of statistics, a parameter is a numerical characteristic of a population, whereas a statistic is a numerical characteristic of a sample. Parameters are often unknown because we cannot examine the entire population. We use statistics, which we compute from sample data, to estimate parameters.
How does adding more predictors to a multiple linear regression model affect its inferences?
- It always improves the model
- It always makes the model worse
- It can lead to overfitting
- It has no effect on the model
Adding more predictors to a model may increase the R-squared value, making it appear that the model is improving. However, if these additional predictors are not truly associated with the response variable, it may result in overfitting, making the model perform poorly on new, unseen data.
How does ridge regression help in dealing with multicollinearity?
- By eliminating the correlated variables.
- By increasing the sample size.
- By introducing a penalty term to shrink the coefficients.
- By transforming the variables.
Ridge regression introduces a regularization term (penalty term) into the loss function which helps to shrink the coefficients towards zero and mitigate the effect of multicollinearity.
Which mathematical concept is at the core of PCA?
- Differentiation
- Eigenvalues and Eigenvectors
- Integration
- Matrix Multiplication
PCA relies heavily on the concepts of Eigenvalues and Eigenvectors. These allow it to determine the axes along which the data has the most variance, which are used to form the new variables (principal components).
___________ refers to the condition where the variance of the errors or residuals is constant across all levels of the explanatory variables.
- Autocorrelation
- Heteroscedasticity
- Homoscedasticity
- Multicollinearity
Homoscedasticity is the condition in which the variance of the errors or residuals is constant across all levels of the explanatory variables. It is one of the key assumptions of linear regression.
What does it mean if two events are independent in probability?
- The occurrence of one affects the occurrence of the other
- The occurrence of one does not affect the occurrence of the other
- They have the same probability of occurrence
- They occur at the same time
In probability, two events are independent if the occurrence of one event does not affect the occurrence of the other. This means that the probability of both events occurring is the product of their individual probabilities.