Week 3

Question 1

List the types of environment

Answer 1

Single-Agent / Multi-Agent
Fully Observable
Partially Observable
Static
Dynamic

Question 2

what is deterministic environment?

Answer 2

An environment is deterministic to an agent when the next state
of the environment is completely determined by the current state

Question 3

What is Episodic (vs. sequential)?

Answer 3

An environment is episodic to an agent when the agent’s
experience is divided into “episodes“ ; each episode consists of an
agent perceiving and then performing a single action, and choice
of the action in each episode depends only on episode itself (next
episode does not depend on actions taken in previous episodes)

• In sequential environments, the current decision would affect all
  future decisions

Question 4

Static vs Dynamic

Answer 4

An environment is static if it’s unchanged while an agent is
deliberating (environment is ‘semi-dynamic’ if environment itself
does not change with passage of time but the agent’s performance
score does)

• Crossword puzzle: Static
• Playing chess? Semi-dynamic
• Taxi driver? Dynamic

Question 5

Discrete vs Continuous

Answer 5

An environment is discrete if it has a limited number of distinct
and clearly defined percepts and actions.

• Playing chess: Discrete
• Taxi driving: Continuous

Question 6

Single-Agent vs Multi-Agent

Answer 6

An environment is single agent if only an agent operates by itself
in an environment:

• Medical diagnosis: Single-agent
• Playing chess: Multi-agent
• Taxi driving: Multi-agent

Question 7

List the 5 types of agents

Answer 7

• Simple reflex
• Model-based reflex
• Goal-based
• Utility-based
• Learning agents