In a DQN, the primary function of the neural network is to approximate which function?
- State-Action Value Function
- Policy Function
- Environment Dynamics Function
- Reward Function
The primary role of the neural network in a Deep Q Network (DQN) is to approximate the State-Action Value Function (Q-function).
In the Actor-Critic model, what role does the Critic's feedback play in adjusting the Actor's policies?
- Evaluating policy
- Selecting actions
- Providing rewards
- Discovering optimal actions
The Critic in the Actor-Critic model evaluates the current policy by estimating the value function. This evaluation helps the Actor make better decisions by guiding it towards actions that result in higher expected rewards, ultimately improving the policy.
An online retailer wants to recommend products to users. They have a vast inventory, and they're unsure which products are most likely to be purchased. Every time a product is recommended and purchased, the retailer gets a reward. This setup is reminiscent of which problem?
- Recommender Systems
- NLP for Sentiment Analysis
- Clustering and Dimensionality Reduction
- Reinforcement Learning
The retailer's challenge of recommending products and receiving rewards upon purchase aligns with Recommender Systems. In this problem, algorithms are used to predict user preferences and recommend items to maximize user satisfaction and sales.
Which term describes a model that has been trained too closely to the training data and may not perform well on new, unseen data?
- Bias
- Generalization
- Overfitting
- Underfitting
Overfitting is a common issue in machine learning where a model becomes too specialized to the training data and fails to generalize well to new data. It's essential to strike a balance between fitting the training data and generalizing to unseen data.
Which RNN architecture is more computationally efficient but might not capture all the intricate patterns that its counterpart can: LSTM or GRU?
- GRU
- LSTM
- Both capture patterns efficiently
- Neither captures patterns effectively
The GRU (Gated Recurrent Unit) is more computationally efficient than LSTM (Long Short-Term Memory) but may not capture all intricate patterns in data due to its simplified architecture. LSTM is more expressive but computationally demanding.
In the context of machine learning, what is the primary concern of fairness?
- Bias
- Overfitting
- Underfitting
- Feature Selection
The primary concern in fairness within machine learning is 'Bias.' Bias can lead to unequal treatment or discrimination, especially when making predictions in sensitive areas like lending or hiring.
In ________ learning, algorithms are trained on labeled data, where the answer key is provided.
- Reinforcement
- Semi-supervised
- Supervised
- Unsupervised
In supervised learning, algorithms are trained using labeled data, which means each input is associated with the correct answer. This helps the algorithm learn and make predictions or classifications.
Which term refers to the error introduced by the tendency of a model to fit the training data too closely, capturing noise?
- Bias
- Overfitting
- Underfitting
- Variance
Overfitting is the term used to describe when a model fits the training data too closely, capturing noise and leading to poor generalization on unseen data. It results in a high variance.
When a machine learning algorithm tries to group data into clusters without prior labels, it is using which type of learning?
- Reinforcement Learning
- Semi-Supervised Learning
- Supervised Learning
- Unsupervised Learning
Unsupervised Learning is the technique where the algorithm groups data into clusters without prior labels. This can help identify patterns and relationships within the data.
Hierarchical clustering can be broadly classified into two types based on how the hierarchy is constructed. What are these two types?
- Agglomerative and Divisive
- Linear and Non-linear
- QuickSort and MergeSort
- Recursive and Iterative
Hierarchical clustering can be Agglomerative (bottom-up) or Divisive (top-down) based on how clusters are merged or divided in the hierarchy.