Test Oracles and Prioritization Flashcards
What is a test oracle?
A mechanism to check correctness of program output for test cases.
How does a test oracle work?
Test case are givenato oracle and program under test, outputs comapred.
What is needed for the oracle to determine correct behavior?
Unambiguous specification of expected behavior that is error-free
How are some test oracles generated?
Automatically from specification of programs or modules
What assurance do automatically generated oracles provide?
Their output is consistent with the program specifications.
What are the key components involved with a test oracle?
Test cases, program under test, expected output specification
Why is an unambiguous specification important for the oracle?
To clearly define the correct behavior to compare against
What is the conceptual view of testing with an oracle?
A process where test cases go both for oracle and program under test
Fill in the Blanks
What is Test Case Prioritization?
Assigning priority levels to test cases based on three (3) factors
Assigning priority levels to test cases based on significance, criticality, and potential impact.
Why is Test Case Priority imporant?
Ensures five (5) things. Mnemonic is CE-FR-IUE-ERU-BC
Ensures cost-effectiveness, faster releases, improved user experience, efficient resource utilization, and better control.
What are different test case priority levels?
4 Priority Levels
Priority 1: Must execute, consequences may worsen
Priority 2: Could execute with time
Priority 3: Not important before current release
Priority 4: Never important
Who needs to prioritize tests?
Developers, QAs, Products Managers, Business Analysts
What are the different techniques used to decide priority of test cases?
There are five (5) of them. Mnemonic is C-R-R-H-C.
Coverage-based, risk-based, requirements-based, history-based, and cost-based
What is coverage-based prioritization?
Testing based on recent code changes to focus on defect-prone areas
What is risk-based prioritization?
Organizing tests by potential impact, concentrating on high-rish components
