Lesson 2 - QA and Standards Flashcards

(75 cards)

1
Q

What are QA and standards?

A

Often documents that specify the quality requirements for a product/service

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

True are false: QA and standards are usually mandatory.

A

False, they are often voluntary

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

How are QA and standards developed? What is the benefit of this?

A

Developed by consensus, makes them more robust and defensible.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

List the two important areas that help establish appropriate standards in forensic science.

A

The organization of scientific area committees
Accreditation

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What group is OSAC administered by?

A

The national institute of standards and technology (NIST)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

What is the aim of OSAC?

A

To strengthen the use of forensic science by facilitating the development of technically sound forensic science standards and promoting their adoption.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What does OSAC produce?

A

Documents that define minimum requirements, best practices, standard protocols, and other guidance to help ensure that the results of forensic analysis are reliable and reproducible.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

Outline the multi-level organizational structure of OSAC.

A

A forensic science standards board
Seven scientific area committees
22 discipline-specific subcommittees
FSSB resource task groups

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are the seven SACs in OSAC?

A

Digital/multimedia
Biology
Chemistry: seized drugs and toxicology
Chemistry: trace evidence
Physics/pattern interpretation
Scene examination
Medicine

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is the role of the forensic science standards board (FSSB) in OSAC?

A

Promulgation of standards,
address standard development issues,
coordinate scientific area committee work

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is the role of OSAC’s scientific area committees?

A

provide direction and oversee work performed by discipline specific subcommittees

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

What is the role of OSAC’s subcommittees?

A

do the work and draft the documents

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

True or false: OSAC has the authority to approve and enforce standards.

A

False. OSAC approves the standards but does not have the authority to make them standards.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What are standards development organizations (SDO)

A

organizations that are accredited to develop and approve standards.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Give examples of SDOs.

A

AAFS standards board
ASTM international
American dental association
International organization for standardization
National fire protection association

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

How many standards are on the OSAC registry?

A

200

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What is accreditation?

A

Formal recognition by an independent body that an organization is operating according to defined standards through an assessment of laboratory and staff competence

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Why might a lab want to become accredited?

A

Increases confidence in laboratory services
Helps to ensure laboratory is performing according as expected/defined by standards
Mandatory in some jurisdictions or required to obtain grants or private work

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

Explain how standards might be amplified.

A

accreditation standards set out requirements.
Standard may be applicable to many industries
Standards may be amplified with a supplemental document that is specific to the industry in question

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

Give an example of a supplemental document

A

ANAB 3125 supplements ISO/IEC 17025

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

What is ISO/IEC 17025

A

General requirements for the competence of testing and calibration laboratories

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What is ANAB 3125?

A

Accreditation requirements for forensic testing and calibration

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

What are accrediting bodies?

A

The groups that assess laboratories/agencies against the standards

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
24
Q

Give examples of accrediting bodies

A

ANAB
SCC
CALA
A2LA
UKAS
IAS

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
25
Who accredits the accrediting bodies?
ISO 17011
26
What is validation?
Process of taking a method and evaluating the ability to provide accurate and reproducible results.
27
Outline ISO 17025 s. 7.2.2
The lab shall validate non-standard methods, laboratory-developed methods and standard methods used outside their intended scope or otherwise modified. The validation shall be as extensive as is necessary to meet the needs of the given application or field of application.
28
Outline ANAB 3125, s. 7.2.2.1.1
Method validation shall: a) Be conducted according to a validation plan b) Include the associated data analysis and interpretation c) Establish the data and acceptance criteria required to report a result, opinion, interpretation, or statement of conformity; and d) identify limitations of the method
29
What is ISO/IEC 17025?
General requirements for competence testing and calibration laboratories
30
What areas does the ISO/IEC 17025 standard cover?
Reporting Management Measurement uncertainty Proficiency Method validation Personnel Lab structure Equipment Reagents Non-conforming work Control of records etc.
31
Outline ISO/IEC 17020.
Requirements for the operation of various types of bodies performing inspection.
32
Give examples of forensic inspection body disciplines under ISO/IEC 17020.
Anthropology Digital and video/imaging analysis Firearms/toolmarks Impressions Medicolegal death investigations Scene investigations
33
What is ISO/IEC 17020 used for?
For forensic practitioners that do not conduct analytical scientific testing using instrumentation and equipment found in a traditional science lab.
34
What factors does the ISO/IEC 17020 standard focus on?
Impartiality Independence Confidentiality Item selection Item handling
35
True or false: Firearms/toolmarks can be accredited under either ISO/IEC 17020 OR 17025?
True
36
Outline the six steps of the accreditation process.
Develop quality management system Application Pre-assessment Assessment Response Surveillance
37
Who has the ultimate authority over QMS?
Quality manager but quality is everyone's responsibility
38
Describe the pre-assessment stage of the accreditation process.
External group assesses how you're expected to do and then addresses issues
39
Outline the assessment stage of the accreditation process.
~ 1 week Each section's standards are evaluated Then identify findings
40
How long does accreditation certification last?
4 years
41
Describe the surveillance stage of the accreditation process/
Individual assessments made annually
42
What information is provided to assessors? (6)
General policies Analytical methods Validation records Info about staff qualifications Court monitoring Complaint process
43
Outline the accreditation assessment. (7)
On-site assessment Observe testing in progress Resolution of any non-conformities Review training records Staff interviews Accreditation decision Conformance monitoring and reassessment
44
What are the downsides to accreditation?
cost complicated documentation Not a panacea that prevents every problem
45
Why are proficiency tests often used in court?
To help establish expertise and reliability of examiner
46
What two main questions does proficiency testing aim to investigate?
Is the testing method reliable? How often does a particular analyst make an error?
47
Where do you get proficiency testing from?
Internal External
48
Do external proficiency test providers have to be accredited?
Yes
49
What is blind proficiency testing?
Submitted as an authentic case Test recipients don't know it's a test
50
What are the benefits of blind proficiency testing?
Treated like a regular case Evaluates lab as a whole
51
What is non-conforming work?
When policy/procedure is not followed
52
What needs to be done if non-conforming work indicates a systemic problem?
Further action needs to be taken by the laboratory quality assurance manager
53
What is preventive action?
A process that occurs when a potential non-conformity or general area of improvement is noticed.
54
Give examples of when preventive action could arise.
Data monitoring over time Review of technical procedures New available techniques Following published guidelines
55
How would actual issues be identified? (5)
Proficiency testing Case file reviews Laboratory staff Internal auditing Client complaints
56
What are Forensic Science Oversight Bodies in the US typically involved in? (4)
Ensuring that standards are implemented, especially accreditation Coordinating state or grant funding Preventing or mitigating problems by serving as investigator of misconduct or professional negligence Licensing/certification, complaint review
57
How is forensic science governed in canada? ON?
Forensic laboratories - provincial legislation Ontario- forensic laboratories act, 2018
58
Outline the accreditation requirements in s. 2 of the forensic laboratories act in ON.
No person shall, in laboratory, conduct a test to which this section applies, unless, a) the lab is accredited, by an accrediting body prescribed by the regulations, to a prescribed general standard; and b) if the test is a prescribed test, the laboratory is accredited, by an accrediting body prescribed by the regulations, to a prescribed standard for that test.
59
What disciplines does s. 2 of the forensic laboratories act apply to?
Biology and toxicology
60
Are there similar requirements as s. 2 of the forensic laboratories act anywhere other than ON?
No
61
What is root cause analysis?
Tool designed to help identify not only what happened, how it happened, but also why it happened.
62
Who can use root cause analysis?
May be used in many different areas
63
What did the National commission on forensic science say about root cause analysis?
It is recommended that appropriate root cause analysis protocols for all forensic science service providers or forensic science medical providers be adopted.
64
What is the important thing to remember about root cause analysis?
Purpose is learning, not punishment
65
What are the 5 classifications of an error during root cause analysis?
Catastrophic Major Moderate I Moderate II Minor
66
Describe the 'catastrophic' classification of root cause analysis.
Systemic errors in procedure(s) that affect several outcomes or reported results; intentional misconduct by personnel
67
Describe the 'Major' classification of root cause analysis.
Casework error that affects outcome or reported result. Could include potential problems that may affect the reliability or accuracy of a test procedure or serious negligence by personnel.
68
Describe the 'Moderate I' classification of root cause analysis.
Clerical error - Does affect result but corrected during the review process prior to release of report
69
Describe the 'moderate II' classification of root cause analysis.
Clerical error nonconformity that does not affect outcome of reported result.
70
Describe the 'minor' classification of root cause analysis.
Clerical error - does not affect outcome or reported result.
71
What was the root and cultural cause analysis of report and testimony errors by FBI MHCA examiners?
Review by FBI started in 2012 of microscopic hair comparison after cases were highlighted where errors had occurred.
72
What was the main finding of the root and cultural cause analysis of report and testimony errors by FBI MHCA examiners?
The most important cause of report and testimony errors was that the MHCA examiners did not have sufficiently specific guidance
73
Outline the root cause model. (6)
Identify event Define the issue Collect and analyze data Identify contributing factors Implement corrective action Monitor the quality system
74
Why is the goal of root cause analysis to ask follow up questions five times/
Not all problems have a single root cause To uncover multiple root causes, the method must be repeated asking a different sequence of questions each time
75
What is the difference between quality control and quality assurance?
QC - Day-to-day things done to ensure quality of results QA - ensuring entire product is fit for purpose