Week 6: Genetic Algorithms # 1 Flashcards
<p>What are the 2 classes/types of meta-heuristics</p>
Population-based methods & Trajectory Methods

<p>In population-based methods, what does a "population" refer to?</p>
<p>A group of solutions/states</p>
<p>A population of individuals exists in an environment with limited \_\_\_\_\_\_\_</p>
<p>resources</p>
<p></p>
<p></p>
<p>Individuals with higher fitness act as seeds for the next \_\_\_\_\_\_ of individuals through \_\_\_\_\_\_ and \_\_\_\_\_\_</p>
generation/population
recombination/mutation
mutation
<p></p>
<p></p>
<p>New individuals have their \_\_\_\_\_ evaluated and compete for survival</p>
<p></p>
<p></p>
<p>fitness</p>
<p></p>
<p></p>
<p>Over time \_\_\_\_\_ \_\_\_\_\_ causes a rise in the \_\_\_\_\_ of the population</p>
<p></p>
<p></p>
<p>Natural Selection
<br></br>Fitness</p>
<p></p>
<p></p>
<p>What are stochastic algorithms?</p>
<p></p>
<p></p>
<p>algorithms that explicitly use randomness to find the next state - it is not determined by the current state</p>
<p></p>
<p></p>
<p>Are Evolutionary Algorithms Deterministic or Stochastic?
<br></br>
<br></br>Are they population based? or Trajectory based?</p>
<p></p>
<p></p>
<p>Evolutionary Algorithms are stochastic, population-based algorithms</p>
<p></p>
<p></p>
<p>Are Evolutionary Algorithms Deterministic or Stochastic?
<br></br>
<br></br>Are they population based? or Trajectory based?</p>
<p></p>
<p></p>
<p>Evolutionary Algorithms are stochastic, population-based algorithms</p>
<p></p>
<p></p>
<p>What must a search algorithm do in order to perform better than a random search?</p>
<p></p>
<p></p>
<p>The search algorithm must take advantage of problem-specific information about the search target or the environment (just like heuristics)</p>
<p></p>
<p></p>
<p>What is Active information</p>
Measures the contribution of problem-specific information for successfully finding a target
<p></p>
<p></p>
<p>An algorithm does not create \_\_\_\_\_ information, it performs very valuable transformation of \_\_\_\_\_ information</p>
<p></p>
<p></p>
<p>new
| known</p>
In Genetic Algorithms, each point in the parameter space has a _____ value. The problem of the search is to find a sufficiently good such value
fitness
<p></p>
<p></p>
<p>For evolutionary algorithms, we require \_\_\_\_\_ information. This prevents the algorithm from behaving like a \_\_\_\_\_\_ search</p>
active
random
In Genetic Algorithms, the fitness of an individual is determined by the _______ traits.
These can be behavioural features, or physical features
phenotypic
in Genetic Algorithms, Selected individuals _______, passing their properties to the _______. Whereas other individuals die without _______, and their properties are ______
reproduce
offspring
mating/reproducing
discarded
<p></p>
<p></p>
<p>In Genetic Algorithms, small random variations called \_\_\_\_\_\_ occur in phenotypic traits during \_\_\_\_\_\_\_</p>
mutations
reproduction
In Genetic Algorithms, through mutations, new ______ of traits occur and get evaluated
combinations
<p></p>
<p></p>
<p>In Genetic Algorithms, for a given population, the basic operations are \_\_\_\_\_\_, \_\_\_\_\_\_ and \_\_\_\_\_\_</p>
<p></p>
<p></p>
<p>Selection
Reproduction
Mutation</p>
<p></p>
<p></p>
<p>A Genetic Algorithm maintains a \_\_\_\_\_\_ of candidate solutions for the problem at hand, and makes it \_\_\_\_\_\_ by iteratively \_\_\_\_\_\_ a set of \_\_\_\_\_\_ operators</p>
population
evolve
applying
stochastic (random)
describe the flow of a Genetic Algorithm
<p></p>
<p></p>

<p></p>
<p>Genetic Algorithms evolve from one \_\_\_\_\_\_\_\_ to the next according to selection and the \_\_\_\_\_\_\_</p>
population/iteration
search operators
<p></p>
<p>What are the search operators in GA?</p>
Recombination (crossover)
Mutation
Selection
<p></p>
<p>What is the general flow for Simple Genetic Algorithm?</p>
<p></p>

What is the specialty of Simple Genetic Algorithms?
Emphasis on crossover
Describe the Simple Genetic Algorithm procedure in steps
What should the termination criteria be in SGA?
- Specified number of generations - A minimum threshold from optimal reached - No improvement is possible - Memory/time constraints
In SGA, a mapping is applied from the ______ domain to the ______ domain.
parameter
binary
Abstract representation of phenotype is called _______ or ________
chromosomes | genotype
in SGA, a ______ is a string in the binary domain.
0 and 1 represents the presence or absence of ______
The _____ of genes can be important
Genotype/Chromosome
Features
Order
The ______ is a lower-level (less abstracted) encoding of a ______
genotype
phenotype
How do you go from phenotype space to genotype space?
How about the other way around?
Phenotype -> Genotype: Encode into a binary string.
Genotype -> Phenotype: Decode binary string
What does the SGA reproduction cycle consist of?
- Selecting parents for the mating pool - Shuffling the mating pool - Applying crossover for each consecutive pair with probability Pc - Apply mutation for each offspring with probability Pm - Replace the whole population with the resulting offspring
What does mutation do to a binary represented genotype in SGA?
flips bits in order to randomly change the features of an individual
In SGA, parents are selected with a probability proportional to their ______
fitness
What is the main idea behind SGA selection?
Better individuals (who have higher fitness) get higher chance
Roulette wheel technique
- Assign each individual part of the roulette wheel to a normalized probability (they should all add up to 1)
- Spin the wheel "n" times to get "n" individuals
In SGA, if crossover does not happen, how are the 2 parents copied over into their children?
They are copied into the offspring unmodified
In SGA, the crossover probability is Pc. What is the typical range of Pc?
between 0.6 and 0.9
What is the 1-point crossover? Note that this is only for binary strings (genotypes)
- Choose a random point on the two parents
- Split the Parents at this crossover point
- Create two children by exchanging tails (they become opposites of each other)

How does the n-point crossover (in the binary case) work?
- Choose `n` random crossover points
- Split along these points
- Glue parts, alternating between parents
- The 2 children become opposites of each other

How does the Uniform Crossover (binary) work?
- Treats genes independently
- Assigns "heads" to one parent, and "tails" to another
- Flips a coin for each gene (bit) of the first child
- Make an inverse copy which is the second child
- The 2 children are opposites

In SGA mutation, we alter each _____ independently with a probability Pm
gene/bit
In SGA mutation, Pm is the mutatuon rate. What is the typical range for this?
between 1/pop_size and 1/chromosome_length.
Note that chromosome_length is the same as genotype_length
What is the motivation behind crossover and mutation in SGA?
In SGA:
Crossover is _______, it makes a big jump into an area somewhere between the 2 parent areas
Mutation is _______, it creates random small diversions, thereby staying near (in the area of) the parent
explorative
exploitative
In SGA:
only ______ can combine information from two parents, whereas only ______ can introduce new information
crossover
mutation
An alternative binary representation is "Gray Coding". What is Gray coding, and why is it prefered for GAs?
Gray code is a system of binary representation in which the hamming distance between any conscecutive numbers is always 1.
Using Gray Coding in genotype representation means that small changes in the genotype (binary form) causes small changes in the phenotype (non-binary form). This results in "smoother" genotype-phenotype mapping & speeds up the GA
What are other possible representations are possible for phenotypes?
- Integers
- Real-valued or floating-point numbers
- Permutations
Crossover and mutation implementation depends on the representation
What are the characteristics of Generational Genetic Algorithms (GGAs)?
- Each individual survives for exactly one generation
- The entire set of parents is replaced by the offspring
What is the Steady-State Genetic Algorithm (SSGA) model?
- Only part of the population is replaced by the offspring
- Usually only one member of population is replaced
- The proportion of the population replaced is called the "Generational Gap"
- Generational Gap is 1 for GGA and 1/pop_size for SSGA
In Genetic Algorithms, Selection can occur in two places. What are they?
- Selection from current generation to take part in mating (parent selection)
- Selection from parents + offspring to go into next generation (survivor selection)
In GA parent selection, what is Fitness-Proportionate Selection (FPS)?
What is the expected number of copies of an individual being selected `i` in FPS?
FPS is when the probability of parent `i` selection is:
(fitness of `i`) / (sum of all fitnesses)
The expected number of coppies of an individual `i` is:
(fitness of `i`) / (average fitness)
Fitness-Proportionate Selection can be implemented using 2 methods:
Roulette Wheel Algorithm, and Baker's Stochastic Universal Sampling Algorithm
Describe both of these methods and how they work