You have a dataset where the relationships between variables are not linear. Which correlation method is better to use and why?
- Covariance
- Kendall's Tau
- Pearson's correlation coefficient
- Spearman's correlation coefficient
For non-linear relationships between variables, Spearman's correlation coefficient would be a better choice. This is because Spearman's correlation measures the monotonic relationship between two variables and does not require the relationship to be linear.
Which of the following is a type of data distribution?
- Age Bracket Distribution
- Binomial Distribution
- Household Distribution
- Sales Distribution
The Binomial Distribution is a type of probability distribution that describes the number of successes in a fixed number of independent Bernoulli trials each with the same probability of success.
How does Robust scaling minimize the effect of outliers?
- By ignoring them during the scaling process
- By removing the outliers
- By scaling based on the median and interquartile range instead of mean and variance
- By transforming the outliers
Robust scaling minimizes the effects of outliers by using the median and the interquartile range for scaling, instead of the mean and variance used by standardization. The interquartile range is the range between the 1st quartile (25th percentile) and the 3rd quartile (75th percentile). As the median and interquartile range are not affected by outliers, this method is robust to them.
Which measure of dispersion is defined as the difference between the largest and smallest values in a data set?
- Interquartile Range (IQR)
- Range
- Standard Deviation
- Variance
The "Range" is the measure of dispersion that is defined as the difference between the largest and smallest values in a data set.
The missing data mechanism where missingness is related only to the observed data is referred to as _________.
- All missing data
- MAR
- MCAR
- NMAR
In MAR (Missing at Random), the missingness is related only to the observed data.
You are given a dataset for an upcoming data analysis project. What initial EDA steps would you take before moving to model building?
- Explore the structure of the dataset, summarize the data, and create visualizations
- Perform a detailed statistical analysis
- Run a quick ML model to test the data
- Start cleaning and wrangling the data
Before moving to model building, it's important to first understand the dataset you're working with. The initial EDA steps would typically include exploring the structure of the dataset, summarizing the data (such as calculating central tendency measures and dispersion), and creating visualizations to uncover patterns, trends, and relationships.
How does standardization (z-score) affect the distribution of data?
- It doesn't affect the shape of the distribution
- It makes the distribution normal
- It makes the distribution uniform
- It skews the distribution
Standardization does not change the shape of the distribution of the feature; rather, it standardizes the scale. This means that it doesn't change the distribution's skewness or kurtosis but it does center the data around zero with a standard deviation of 1.
Can the IQR method be applied to multimodal data sets for outlier detection? Explain.
- No, it can only be applied to normally distributed data
- No, it only works with unimodal distributions
- Yes, but it may not be effective
- Yes, it works well with any distribution
The IQR method can be applied to multimodal datasets for outlier detection, but it may not be effective as it's based on percentiles which can be influenced by multiple modes.
In _____ scaling, we scale the data between the 1st quartile (25th quantile) and the 3rd quartile (75th quantile).
- Min-Max
- Robust
- Standard
- Z-score
In Robust scaling, we scale the data between the 1st quartile (25th quantile) and the 3rd quartile (75th quantile). This approach minimizes the impact of outliers.
What is the primary goal of Exploratory Data Analysis (EDA)?
- To confirm a pre-existing hypothesis
- To create an aesthetic representation of the data
- To make precise predictions about future events
- To understand the underlying structure of the data
The primary goal of EDA is to understand the underlying structure of the data, including distribution, variability, and relationships among variables. EDA allows analysts to make informed decisions about further data processing steps and analysis.