Randomized Algorithms Flashcards

1
Q

What are randomized algorithms?

A

Randomized algorithms are algorithms that make random decisions during their process to solve computational problems.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What is the primary benefit of randomized algorithms?

A

Randomized algorithms may handle worst-case scenarios effectively and can simplify complex deterministic solutions.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

How do randomized algorithms differ from average-case analysis?

A

Randomized algorithms make random internal decisions

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is the contention resolution problem?

A

A problem where multiple processes compete for a single shared resource and need to resolve conflicts to access it.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is the randomized algorithm for contention resolution?

A

Each process independently decides to attempt accessing the resource with a probability p in each round.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is the probability of success for a process in contention resolution?

A

The probability is ( p(1-p)^{n-1} ) for n processes.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

How is p optimized in contention resolution algorithms?

A

Set ( p = 1/n ) to maximize the success probability.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

What is the expected time for a process to succeed in contention resolution?

A

( O(n \log n) ) rounds for all processes to succeed with high probability.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What is the contraction algorithm for finding minimum cuts?

A

A randomized algorithm that repeatedly contracts edges in a graph until only two nodes remain.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is the probability that the contraction algorithm finds the minimum cut?

A

At least ( \frac{1}{n^2} ) for a graph with n nodes.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is linearity of expectation?

A

The property that ( E[X+Y] = E[X] + E[Y] ) for any random variables X and Y

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

How is linearity of expectation used in randomized algorithms?

A

It allows breaking complex random variables into simpler ones and summing their expectations.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is the coupon collector’s problem?

A

A problem asking how many trials are needed to collect all n types of coupons.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is the expected number of trials in the coupon collector’s problem?

A

( nH(n) )

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is the probabilistic method?

A

A technique showing the existence of a structure by proving a random construction produces it with positive probability.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is the approximation factor of the random assignment for MAX 3-SAT?

A

A random assignment satisfies at least ( \frac{7}{8} ) of the clauses in expectation.

17
Q

How can the randomized algorithm for MAX 3-SAT be turned into a high-probability algorithm?

A

Repeat the random assignment process until a ( \frac{7}{8} ) satisfaction rate is achieved.

18
Q

What does the union bound state?

A

The probability of the union of events is at most the sum of their probabilities.

19
Q

How is the union bound applied in contention resolution?

A

It provides an upper bound for the probability that not all processes succeed.

20
Q

What is the harmonic number ( H(n) )?

A

The sum ( H(n) = 1 + 1/2 + 1/3 + … + 1/n )

21
Q

What does it mean for events to be independent?

A

Two events E and F are independent if ( Pr[E \cap F] = Pr[E] \cdot Pr[F] ).

22
Q

What is the expected value of the number of trials to get the first success?

23
Q

What is the role of randomization in symmetry breaking?

A

Randomization allows processes to independently make decisions

24
Q

How is the contraction algorithm’s success probability amplified?

A

Run the algorithm ( O(n^2 \log n) ) times and take the best result to achieve high probability of finding the minimum cut.

25
Explain the term 'expected value' in probability.
The average value a random variable takes over many trials
26
How is probability used to analyze algorithm performance?
By calculating the likelihood of events and their expected outcomes under random choices.
27
Why is randomization beneficial in distributed systems?
It reduces explicit communication and coordination while managing contention among processes.
28
Explain the MAX 3-SAT problem.
An optimization problem where the goal is to satisfy the maximum number of clauses in a 3-SAT formula.
29
What is the probabilistic guarantee for random assignment in MAX 3-SAT?
It satisfies at least \( \frac{7}{8} \) of the clauses in expectation.
30
Give an example of using the probabilistic method in algorithms.
Proving that a random assignment satisfies \( \frac{7}{8} \) of the clauses in any 3-SAT instance.