Machine Learning Methods Flashcards

Model Types (64 cards)

1
Q

What is supervised learning?

A

A type of machine learning where the model is trained on labeled data.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is unsupervised learning?

A

A type of machine learning that deals with unlabeled data to find hidden patterns.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

True or False: Reinforcement learning involves training models using a reward system.

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Fill in the blank: In supervised learning, the goal is to learn a mapping from inputs to _______.

A

outputs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is a common application of unsupervised learning?

A

Clustering data into groups.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is the main difference between supervised and unsupervised learning?

A

Supervised learning uses labeled data, while unsupervised learning uses unlabeled data.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Name one algorithm used in supervised learning.

A

Linear regression.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What type of model is a decision tree?

A

A supervised learning model.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

True or False: K-means is an example of a supervised learning algorithm.

A

False

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What does reinforcement learning optimize?

A

The cumulative reward over time.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Fill in the blank: In reinforcement learning, an agent interacts with an _______.

A

environment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What type of model is used in reinforcement learning?

A

An agent-based model.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is the purpose of a loss function in supervised learning?

A

To measure the difference between predicted and actual outcomes.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Name one example of unsupervised learning.

A

Principal Component Analysis (PCA).

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

True or False: Neural networks can be used for both supervised and unsupervised learning.

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is the primary goal of clustering in unsupervised learning?

A

To group similar data points together.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is a common evaluation metric for classification models?

A

Accuracy.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Fill in the blank: In reinforcement learning, the _______ function is used to evaluate the quality of an action.

A

value

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What is the main advantage of using ensemble methods?

A

They often improve model performance by combining multiple models.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Name one common ensemble method.

A

Random Forest.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

True or False: Support Vector Machines (SVM) can only be used for binary classification.

A

False

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is the purpose of cross-validation?

A

To assess how the results of a statistical analysis will generalize to an independent dataset.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What type of learning does a generative adversarial network (GAN) utilize?

A

Unsupervised learning.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Fill in the blank: In supervised learning, the training dataset consists of input-output _______.

A

pairs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
What is overfitting in machine learning?
When a model learns noise in the training data rather than the underlying pattern.
26
What is the role of a validation set?
To tune model hyperparameters and prevent overfitting.
27
True or False: A linear regression model assumes a linear relationship between the input and output variables.
True
28
What is the main purpose of feature selection?
To improve model performance by selecting the most relevant features.
29
What does the term 'hyperparameter' refer to?
A parameter whose value is set before the learning process begins.
30
Fill in the blank: The _______ method is used in supervised learning to minimize the error of predictions.
gradient descent
31
Name one advantage of using deep learning models.
They can automatically learn features from raw data.
32
What is a key characteristic of semi-supervised learning?
It combines a small amount of labeled data with a large amount of unlabeled data.
33
True or False: All machine learning models require feature engineering.
False
34
What is a discriminative model?
A model that learns the boundary between classes rather than modeling the distribution of each class.
35
What is a generative model?
A model that learns how the data is generated, modeling the distribution of each class.
36
True or False: Discriminative models can be used for both classification and regression tasks.
True
37
Fill in the blank: Generative models can generate new data points by sampling from the ________ distribution.
learned
38
Which of the following is an example of a discriminative model: A) Logistic Regression B) Gaussian Mixture Model?
A) Logistic Regression
39
What is the main objective of a discriminative model?
To model the conditional probability P(Y|X), where Y is the label and X is the feature.
40
What is the main objective of a generative model?
To model the joint probability P(X, Y) of the features and labels.
41
True or False: Generative models typically require more data to train effectively than discriminative models.
True
42
Name one advantage of discriminative models over generative models.
Discriminative models usually achieve higher accuracy on classification tasks.
43
Name one advantage of generative models over discriminative models.
Generative models can generate new samples from the learned distribution.
44
Multiple Choice: Which of the following is NOT a generative model? A) Variational Autoencoder B) Support Vector Machine C) Naive Bayes
B) Support Vector Machine
45
Short Answer: What is the role of the likelihood function in generative models?
It quantifies how likely the observed data is given the model parameters.
46
True or False: Discriminative models ignore the underlying distribution of the data.
True
47
What type of model is a Neural Network typically classified as?
Discriminative model
48
Fill in the blank: In generative models, the data is often modeled using ________ functions.
probability
49
What is an example of a generative model?
Gaussian Mixture Model
50
Multiple Choice: Which of the following tasks can generative models perform? A) Classify data B) Generate new data C) Both A and B
C) Both A and B
51
What does the term 'overfitting' refer to in the context of machine learning?
When a model learns noise in the training data rather than the underlying distribution.
52
True or False: Discriminative models are generally simpler and faster to train than generative models.
True
53
What is a common application of generative models?
Image generation, such as in Generative Adversarial Networks (GANs).
54
Fill in the blank: The performance of a discriminative model is often evaluated using ________ metrics.
classification
55
What is the difference in training data requirements between discriminative and generative models?
Discriminative models require less data as they focus on boundaries, while generative models require more to model distributions.
56
True or False: Generative models can improve semi-supervised learning by generating labels for unlabeled data.
True
57
What is a potential drawback of using generative models?
They can be more complex and computationally intensive to train.
58
Multiple Choice: Which model is specifically designed to separate classes? A) Discriminative Model B) Generative Model
A) Discriminative Model
59
What does 'latent variable' mean in the context of generative models?
Variables that are not directly observed but are inferred from the model.
60
Fill in the blank: Discriminative models are primarily focused on ________ prediction.
conditional
61
Short Answer: Name a common technique used in discriminative models.
Support Vector Machines (SVM)
62
What is the impact of noise on discriminative models?
Discriminative models can be sensitive to noise, which can lead to overfitting.
63
True or False: Generative models can be used for anomaly detection.
True
64
What is the primary focus of a generative model during training?
To learn the distribution of the input data.