1.3 Testing Principles Flashcards
(22 cards)
Testing Principles:
1. Testing shows the “p…”, not “ “ of “d…”.
presence
absence
defects.
Testing reduces the probability of defects remaining “ “ in the t…
But even if no defects are found “ “ can’t prove t…
undiscovered
test object.
testing
test object correctness.
Testing Principles:
2. Exhaustive “ “ is “i…”.
testing
impossible.
Rather than attempting to test exhaustively:
- test t…
- test c…
- risk-b… should be used to focus t…
- test techniques
- test case prioritization
- risk-based testing
test efforts.
Testing Principles:
3. Early “t…” saves “ “ and “m…”.
testing
time
money
Defects removed “e…” in the “ “ will not cause subsequent “d…” in d…
early
process
defects
derived work products.
Quality cost will be “r…” since fewer “ “ will occur “l…” in the “ “.
reduced
failures
later
SDLC
To find defects early s… and d… should be started as s…
Static testing
dynamic testing
soon as possible.
Testing Principles:
4. Defects c…
cluster together.
A small number of s… usually contain most of the d… or are responsible for most of the o…
system components
discovered defects
operational failures.
Illustrated example of P…
Pareto principle.
Predicted defect clusters and actual defect clusters observed during “ “ or i… are important input for r…
testing
in operation
risk-based testing.
Testing Principles:
5. Tests w…
wear out.
If the same tests are “r…” many times, they become increasingly “ “ in detecting new “d…”.
repeated
ineffective
defects.
To overcome this effect, existing “t…” and t… may need to be “m…” and new tests may need to be “ “.
tests
test data
modified
written
However, in some cases repeating the same “ “ can have a b… e.g. in automated r…
tests
beneficial outcome,
regression testing.
Testing Principles:
6. Testing is c…
context dependent.
Testing is done differently in d…
different contexts.
Testing Principles:
7. Absence-of-…
defects fallacy.
It is a fallacy (i.e. a misconception) to expect that s… will ensure s…
software verification
system success.
Thoroughly testing all the specified requirements and fixing all the defects found could still produce a system that:
- does not fulfill the u… and “ “
- does not help in achieving the c…
- is inferior compared to other c…
- users’ needs
expectations - customer’s business goals
- competing systems
In addition to verification, “ “ should also be c…
validation
carried out.