When two or more predictors in a multiple linear regression model are highly correlated, it is known as __________.

  • Autocorrelation
  • Homoscedasticity
  • Multicollinearity
  • Overfitting
Multicollinearity is a phenomenon in which one predictor variable in a multiple regression model can be linearly predicted from the others with a substantial degree of accuracy. This can lead to unstable estimates of the coefficients.

In the presence of multicollinearity, the estimated regression coefficients are _______.

  • biased
  • equal to zero
  • negative
  • unbiased
Even in the presence of multicollinearity, the least squares estimates of the regression coefficients are still unbiased. However, they are less precise and have high standard errors.

How does standard deviation differ from the mean absolute deviation?

  • Mean absolute deviation is always greater
  • Standard deviation is always greater
  • Standard deviation squares the deviations while mean absolute deviation takes absolute values
  • They are the same
The standard deviation and mean absolute deviation both measure the dispersion in a dataset. The key difference lies in how they treat deviations from the mean: standard deviation squares the deviations before averaging them, while mean absolute deviation takes the absolute value of deviations before averaging. As a result, standard deviation is more sensitive to extreme values than the mean absolute deviation.

Quantitative data represents quantities and can be measured on a ________ scale.

  • Categorical
  • Nominal
  • Numerical
  • Ordinal
Quantitative data represents quantities and can be measured on a Numerical scale. It includes both discrete data (e.g., the number of students in a class) and continuous data (e.g., the weight of a person).

How do we define expectation of a random variable?

  • It is the most likely outcome of the variable
  • It is the range of the variable
  • It is the variance of the variable
  • It is the weighted average of all possible values the variable can take, with weights being the respective probabilities
The expected value or expectation of a random variable is a key concept in probability and statistics and represents the weighted average of all possible values that the variable can take, with weights being the respective probabilities.

The Chi-square test for goodness of fit is only applicable to ________ data.

  • categorical
  • continuous
  • normally distributed
  • time series
The Chi-square test for goodness of fit is applicable only to categorical data. It is used to determine whether the observed frequencies differ from the expected frequencies.

What is the difference between the Law of Large Numbers and the Central Limit Theorem?

  • Both are essentially the same.
  • The Central Limit Theorem is a law, while the Law of Large Numbers is a theorem.
  • The Law of Large Numbers is used for calculating probabilities, while the Central Limit Theorem is used for integration.
  • The Law of Large Numbers states that as a sample size increases, the sample mean approaches the population mean, while the Central Limit Theorem states that the distribution of sample means approximates a normal distribution as the sample size increases.
The Law of Large Numbers and the Central Limit Theorem are both key concepts in probability and statistics, but they say different things. The Law of Large Numbers states that as the size of a sample is increased, the sample mean will get closer to the population mean. The Central Limit Theorem, on the other hand, states that as the sample size increases, the distribution of sample means approaches a normal distribution.

When the effect of one independent variable on the dependent variable varies with the level of another independent variable, it's known as an ________ effect.

  • Additive
  • Constant
  • Interaction
  • Subtractive
This is known as an interaction effect. In the context of regression analysis, an interaction effect occurs when the effect of one independent variable on the dependent variable depends on the value of another independent variable.

The total probability of all outcomes of an experiment is _______.

  • 0
  • 0.5
  • 1
  • It depends on the number of outcomes
The total probability of all outcomes of an experiment is 1. This is a fundamental rule of probability, known as the Law of Total Probability, which states that the sum of the probabilities of all possible outcomes of an experiment is equal to 1.

When is it appropriate to use polynomial regression?

  • When the dependent variable is categorical
  • When the relationship between variables is linear
  • When the relationship between variables is non-linear
  • When there is no relationship between variables
Polynomial regression is appropriate when the relationship between variables is non-linear. It allows for modeling of relationships that change in direction at different levels of the independent variables, which can be useful when dealing with complex data sets that do not follow a simple linear relationship.