Which term refers to a subset of AI that deals with algorithms designed to identify patterns and make decisions with minimal human intervention?
- Data Mining
- Machine Learning
- Neural Networks
- Robotics
Machine Learning is a subset of AI that focuses on creating algorithms to identify patterns and make decisions with little or no human intervention.
Can dimensionality reduction be used to improve the performance of machine learning models? If so, how?
- All of the above
- By improving computational efficiency
- By reducing overfitting
- By simplifying the model
Dimensionality reduction can improve the performance of machine learning models by reducing overfitting (as the model becomes less complex), simplifying the model (making it easier to interpret), and improving computational efficiency (reducing training time and resource requirements).
The _________ linkage method in Hierarchical Clustering considers the average distance between all pairs of points in two clusters.
- Average Linkage
- Complete Linkage
- Single Linkage
- Ward's Method
Average Linkage considers the average distance between all pairs of points in two clusters. It falls between the Single and Complete Linkage methods, often providing a balance that avoids some of the extremes of either method. It can be a good choice when clusters are relatively compact but not necessarily spherical.
What are the strengths and weaknesses of using the Ward's method in Hierarchical Clustering?
- Maximizes mean distance but sensitive to initial configuration
- Maximizes variance but creates well-separated clusters
- Minimizes mean distance but less compact clusters
- Minimizes variance but sensitive to outliers
Ward's method in Hierarchical Clustering aims to minimize the variance within clusters, leading to tightly packed clusters. Strength: It often results in compact and balanced clusters. Weakness: It can be sensitive to outliers, as it minimizes the total within-cluster variance, which can be disproportionately influenced by extreme values.
What are some common methods of initializing centroids in K-Means clustering?
- Data Transformation
- Normalization
- Principal Component Analysis
- Random Selection, K-Means++
Common methods for initializing centroids in K-Means include Random Selection and K-Means++. These methods can affect the convergence speed and quality of the final clusters.
You are working with a small dataset, and your model is prone to overfitting. What techniques could you employ to mitigate this issue?
- Add complexity
- Reduce complexity
- Use L1 regularization
- Use cross-validation and data augmentation
Using techniques like cross-validation and data augmentation can mitigate overfitting when working with a small dataset. Cross-validation ensures that the model is evaluated on unseen data, and data augmentation artificially increases the size of the dataset, reducing the risk of overfitting.
What is the main difference between supervised and unsupervised learning?
- The algorithms used
- The complexity of the models
- The data size
- The use of labeled data
Supervised learning uses labeled data where the output is known, while unsupervised learning deals with unlabeled data and finds hidden patterns without guidance on the expected outcome.
While AI aims to mimic human intelligence, Machine Learning focuses on learning from data, and Deep Learning emphasizes learning from data using __________.
- clustering
- neural networks
- regression
- statistical methods
Deep Learning emphasizes learning from data using neural networks, particularly multi-layered structures known as deep neural networks.
In a situation where the data is densely packed in some regions and sparse in others, how would the choice of K and distance metric influence the results, and what would be the best approach?
- Choose a fixed K and Euclidean distance
- Choose a large K and any distance metric
- Choose a small K and ignore distance metric
- Choose an appropriate K and distance metric, considering data distribution
Considering the data distribution and choosing an appropriate value of K and distance metric can help address the issue of varying data density in KNN.
Why is centroid initialization important in K-Means clustering?
- All of the Above
- It determines the final clusters
- It prevents overfitting
- It speeds up the convergence process
Centroid initialization is important in K-Means as it can significantly affect the final clusters. Poor initialization can lead to suboptimal clusters or slow convergence.