Artificial Intelligence Flashcards

1
Q

Define artificial intelligence

A

Technology that leverages computers and machines to mimic the problem-solving and decision-making capabilities of the human mind.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Define machine learning

A

A branch of artificial intelligence (AI) and computer science which focuses on the use of data and algorithms to imitate the way that humans learn, gradually improving its accuracy.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

State 4 reasons why AI is now commercially available

A
  • Computer power is great enough that AI models have become commercially viable
  • Several models have been developed that show promise
  • Commercial products have become available
  • The public are gradually accepting AI as a positive development
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

State 9 clinical applications of AI

A

1) Automatic image segmentation
2) Automatic optimisation of radiotherapy planning parameters
3) Identification of images with abnormal pathology
4) Highlighting areas of interest in images
5) Prioritising images for further (human) review
6) MRI ‘acceleration’
7) Patient scheduling and bed management
8) Early warning about changes in equipment performance
9) Generating synthetic patient data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What are the 4 general classes of AI models?

A
  • Image or data classification
  • Regression (predicting the output of a given input)
  • Object detection
  • Generative AI
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is the Turing test?

A

A measurement of the maturity of an AI system.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

How does an AI system pass the Turing test?

A

If the computer’s output is indistinguishable from that of a human, then the test passes.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What are ‘reverse Turing tests’ used for?

A

To distinguish between AI and humans.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What happens without a feedback loop in AI models?

A

For a given input, the same output will always be given.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

How is an AI model trained?

A

The model is fed training models, which stimulate the model and produce initial outputs. Multiple learning cycles are then run to improve the model. The hyperparameters for each learning cycle (the parameters that control the learning process of the model) are saved to understand the impacts of different configurations.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What type of model were the AI tools for predicting the diagnosis and prognosis of covid-19?

A

Regression

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What are the dangers of implementing unreliable, biased AI models in healthcare?

A

Unreliable predictions could cause more harm than benefit in guiding clinical decisions.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

The dataset for training an AI model should always be _______ to the model for validating an AI model.

A

Training
Validating

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Which 2 datasets should be used for AI model development?

A
  • Training set
  • Tuning set
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Which 2 datasets should be used for AI model evaluation?

A
  • Internal validation test set
  • External validation test set
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Describe the datasets used for AI model training (development and evaluation)

A
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is a confusion matrix?

A

A table that evaluates the performance of a classification model by comparing its predictions against the true values.

18
Q

What is the recall (sensitivity) of a classification model?

A

The proportion of all actual positive cases that were correctly predicted as positive by the model.

19
Q

What is the specificity of a classification model?

A

A model’s ability to correctly identify true negative cases.

20
Q

What is the F1 score of a classification model?

A

A metric used to evaluate a models precision for true positives AND recall. It is the harmonic mean of precision and recall so penalises models that have either high precision or recall but not both.

21
Q

Give the equation for the precision of a classification model for a positive predictive value

A

TP = true positive
FP = false positive

22
Q

Give the equation for the precision of a classification model for a negative predictive value

A

TN = true negative
FN = false negative

23
Q

Give the equation for the recall (sensitivity) of a classification model

A

TP = true positive
FN = false negative

24
Q

Give the equation for the specificity of a classification model

A

TN = true negative
FP = false positive

25
Give the equation for the accuracy of a classification model
TP = true positive TN = true negative FP = false positive FN = false negative
26
Give the equation for the F1 score of a classification model
TP = true positive FP = false positive FN = false negative
27
What is a receive operating characteristic (ROC) curve?
A graph that visualises the performance of a classification model at different decision thresholds by plotting the true positive rate against the false positive rate. It is used to assess teh diagnostic performance of a test using the area under the curve, and can be used to compare the performance of different tests.
28
What are the 6 main roles of clinical scientists in AI?
1) Updating or repurposing models 2) Identifying and specifying applications for AI 3) Training models 4) Implementing and testing models 5) Developing a quality assurance programme 6) Developing new models (rare)
29
Describe the role of a clinical scientist when implementing new software (including AI)
30
What is bias?
An inclination to treat one group of people more or less favourably than another, especially in a way which is considered unfair.
31
How can AI introduce bias clinically?
Models need sufficient breadth of training data so that they can accomodate all anticipated patients because they cant recognise and adapt to situations that they haven't encountered before (i.e. rare cases, different demographics). However, it is not possible to ever accomodate ALL patients in this way.
32
How can AI bias be overcome clinically?
- Testing pre-trained model using data representive of the local population - Frequently re-training the model using sufficiently detailed local data
33
State 5 challenges of adopting AI
1) Involving the right people during the AI system lifecycle 2) Collating an appropriately sized and comprehensive training, testing, and validation dataset 3) Controlling who has access to the data 4) Deciding who is responsible for decisions made by AI 5) Potential deskilling of human operators
34
How could AI decision making present GDPR issues?
Under GDPR, data subjects have the right to not be subjected to a decision based soley on automated processes, unless performing a contract or there is explicit consent.
35
How is equipment defined under IR(ME)R 2017?
Equipment, including software, that: - Delivers ionisnig radiation to a person undergoing an exposure - Directly controls or influences the extent of an exposure
36
How is an operator defined under IR(ME)R 2017?
Any person who is entitled, in accordance with the employer's procedures, to carry out practical aspects of an exposure.
37
38
How is AI used in radiotherapy?
AI is used to aid contouring for radiotherapy treatment planning and generate radiotherapy plans.
39
Is AI software considered a medical device?
Yes
40
What are large language models (LLMs)?
'Deep learning' models based on neutral networks that are trained on vast amounts of unlabelled text data. They are genreally 'encoder-decoder' models which predict a squential output from a sequential input. These models are self-supervised, meaning that they refine themselves.
41
What is the most common type of large language model?
Generative pre-trained transformers (GPTs)