One of the challenges in DQN is that small updates to Q values can lead to significant changes in the policy, making the learning process highly ________.
- Sensitive
- Efficient
- Predictable
- Robust
The term 'sensitive' in this context refers to the fact that small changes in Q values can have a disproportionate impact on the policy, making it unstable and hard to control.
The multi-armed bandit problem can be viewed as a simplified version of the reinforcement learning problem where the number of ________ is just one.
- Episodes
- States
- Actions
- Rewards
The multi-armed bandit problem simplifies reinforcement learning to just one action, where you need to decide which arm of a bandit to pull.
In a video game with multiple levels and complex interactions, what approach is suitable for training an AI agent optimally?
- Transfer Learning
- Curriculum Learning
- Random Search
- Supervised Learning
Curriculum Learning is ideal for training an AI agent to handle various levels with different challenges. It starts with easy levels, gradually increasing difficulty based on the agent's performance in earlier stages, ensuring effective learning.
Random Forests introduce randomness in two main ways: by bootstrapping the data and by selecting a random subset of ______ for every split.
- Data Points
- Features
- Leaves
- Trees
Random Forests introduce randomness by selecting a random subset of "Features" for every split in each tree. This helps in creating diverse trees, which collectively improve the overall performance and reduce the risk of overfitting.
The ability of an individual or a group to understand and trust the model's decisions is often tied to the model's ________.
- Explainability
- Complexity
- Accuracy
- Processing speed
Model explainability is essential for understanding and trusting a model's decisions, especially in critical applications like healthcare or finance, where transparency is key for decision-making and accountability.
Hierarchical clustering that starts with each data point as its own cluster and gradually merges them is termed as ________ hierarchical clustering.
- Agglomerative
- Divisive
- Exclusive
- Partitioning
Agglomerative hierarchical clustering is the method where individual data points begin as clusters and then merge step by step based on similarity until they form a single cluster.
Which neural network architecture is specifically designed to work with sequences of data, such as time series or natural language?
- Convolutional Neural Network (CNN)
- Recurrent Neural Network (RNN)
- Long Short-Term Memory (LSTM)
- Gated Recurrent Unit (GRU)
Recurrent Neural Networks (RNNs) are designed for sequential data. They maintain hidden states that capture sequential dependencies, making them suitable for time series and language modeling.
In the k-NN algorithm, when two classes have a similar number of instances close to a test data point, the choice of an odd 'k' can help to avoid ________
- Ambiguity
- Bias
- Overfitting
- Underfitting
When two classes have a similar number of instances nearby, using an odd 'k' value can help avoid ambiguity in classifying the test data point, as it prevents ties. An even 'k' can lead to ties, making classification less clear.
What term refers to the ability to understand and interpret machine learning model decisions?
- Explainability
- Predictability
- Efficiency
- Generalization
Explainability is the term that refers to the ability to understand and interpret machine learning model decisions. It's crucial for trust and accountability in AI systems.
Which variant of RNN is designed to better capture long-term dependencies in sequence data?
- Vanilla RNN
- Bidirectional RNN
- Long Short-Term Memory (LSTM)
- Gated Recurrent Unit (GRU)
Long Short-Term Memory (LSTM) is designed to capture long-term dependencies in sequences by maintaining cell states that are less susceptible to the vanishing gradient problem.