Foundations of Machine Learning Flashcards

- **Importance of ML in AI** - Differences: **Statistical ML vs. Classical ML** - Applications: **Computer Vision, NLP, etc.** (30 cards)

1
Q

What is the primary focus of Statistical Machine Learning?

A

Statistical Machine Learning focuses on understanding the underlying statistical properties of data and making inferences based on these properties.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is the main objective of Classical Machine Learning?

A

The main objective of Classical Machine Learning is to develop algorithms that can learn from and make predictions based on data.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

True or False: Statistical ML relies heavily on probability theory.

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Fill in the blank: In Statistical ML, the model is often built through __________ methods.

A

inferential

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Which type of machine learning is typically concerned with feature engineering?

A

Classical Machine Learning

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is a key characteristic of Classical ML algorithms?

A

They often require extensive feature extraction and manual tuning.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Multiple Choice: Which technique is commonly used in Statistical ML for parameter estimation? A) Gradient Descent B) Maximum Likelihood Estimation C) Decision Trees

A

B) Maximum Likelihood Estimation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is one application of Statistical ML in real-world scenarios?

A

Statistical ML is often used in fields like epidemiology for understanding disease spread.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

True or False: Classical ML techniques are generally more flexible than Statistical ML techniques.

A

False

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Fill in the blank: __________ is a common application area for Classical Machine Learning.

A

Computer Vision

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is a common algorithm used in Classical ML for classification tasks?

A

Support Vector Machines (SVM)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Multiple Choice: Which of the following is NOT a focus area of Statistical ML? A) Hypothesis Testing B) Predictive Modelling C) Image Recognition

A

C) Image Recognition

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What type of data is often analyzed using Statistical ML?

A

Structured data with known distributions.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

True or False: Statistical ML can be used for both supervised and unsupervised learning.

A

True

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Fill in the blank: __________ is a popular application of Statistical ML in the finance sector.

A

Risk assessment

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is a major limitation of Classical ML?

A

It often requires a large amount of labeled data for training.

17
Q

Multiple Choice: Which of the following fields primarily applies Statistical ML? A) Natural Language Processing B) Video Games C) Climate Modeling

A

C) Climate Modeling

18
Q

What is the role of hypothesis testing in Statistical ML?

A

Hypothesis testing is used to determine if observed patterns in data are statistically significant.

19
Q

True or False: Classical ML techniques are typically less interpretable than Statistical ML techniques.

20
Q

Fill in the blank: __________ is a common evaluation metric used in Classical ML.

21
Q

What is an example of a task that can be performed using Statistical ML?

A

Estimating the average treatment effect in clinical trials.

22
Q

What is the primary data type used in Natural Language Processing (NLP)?

23
Q

Multiple Choice: Which of the following is a common application of Classical ML in NLP? A) Sentiment Analysis B) Word Embeddings C) Topic Modeling

A

A) Sentiment Analysis

24
Q

True or False: Statistical ML models can handle missing data more effectively than Classical ML models.

25
What is a common challenge faced by both Statistical and Classical ML?
Overfitting to training data.
26
Fill in the blank: __________ models are often preferred in Statistical ML for their robustness to outliers.
Bayesian
27
What is a key advantage of Statistical ML over Classical ML?
Statistical ML can provide more insight into the uncertainty of predictions.
28
Multiple Choice: Which of the following is a method used in Classical ML for dimensionality reduction? A) Principal Component Analysis B) Bayesian Inference C) Regression Analysis
A) Principal Component Analysis
29
What is a primary goal of machine learning in computer vision?
To enable computers to interpret and understand visual information from the world.
30
True or False: Both Statistical ML and Classical ML can be applied to the same problem but may yield different insights.
True