Evaluating efficiency and effectiveness

Question 1

What is the difference between effectiveness and efficiency?

Answer 1

Efficiency gauges the time, cost, and effort invested in a solution,

Effectiveness measures how well it achieves intended results. This involves evaluating factors like completeness, clarity, functionality, and usability.

Question 2

Explain how an improvement in efficiency may cause a decrease in effectiveness.

Answer 2

An increase in efficiency may require a reduction in time or resources, this will
restrict effectiveness as quality to be thorough is no longer available.

Quality often suffers with increases in efficiency, or “cost-effectiveness”

Question 3

Describe how efficiency and effectiveness might be measured. How might these quantities be measured?

Answer 3

Efficiency is measured by observation of time and costs.

Effectiveness is measured by survey and interviews
e.g.
- customer satisfaction in terms of
- completeness
- readability
- attractiveness
- clarity
- functionality
- accuracy
- accessibility
- timeliness
- report formats
- relevance
- usability
- communication of message.

Question 4

The phrase “Testing is not evaluation” implies that evaluation goes beyond test results. Consider what aspects evaluation will measure.

Answer 4

Evaluation measures user acceptance and whether the solution delivers the promises of the SRS.

Question 5

When should evaluation take place?

Answer 5

Evaluation usually takes place after implementation or installation, to
determine the user experience.