1.9 Standards, Regulations and AI

Question 2

Sources of AI Standards

Answer 2

ISO/IEC JTC1; Regional level; National level; Industry bodies; Regulatory standards

Question 3

ISO/IEC JTC1’s Contribution to AI Standards

Answer 3

Prepares international standards; Subcommittee on AI (ISO/IEC JTC 1/SC42) set up in 2017; ISO/IEC JTC1/SC7 published technical report on “Testing of AI-based systems” [S01]

Question 4

ISO/IEC JTC 1/SC42

Answer 4

Subcommittee on AI; Set up in 2017

Question 5

ISO/IEC JTC1/SC7

Answer 5

Covers software and system engineering; Published technical report on “Testing of AI-based systems” [S01]

Question 6

Regional Level AI Standards

Answer 6

European standards

Question 7

National Level AI Standards

Answer 7

German national standards body (DIN) developed AI Quality Metamodel ([S02], [S03])

Question 8

German National Standards Body (DIN)

Answer 8

Developed the AI Quality Metamodel ([S02], [S03])

Question 9

Industry Bodies Publishing AI Standards

Answer 9

Institute of Electrical and Electronics Engineers (IEEE)

Question 10

Institute of Electrical and Electronics Engineers (IEEE)

Answer 10

Working on a range of standards on ethics and AI (The IEEE Global Initiative for Ethical Considerations in Artificial Intelligence and Autonomous Systems); Many standards still in development

Question 11

EU-wide General Data Protection Regulation (GDPR)

Answer 11

Came into effect May 2018; Sets obligations for data controllers regarding personal data and automated decision-making [B06]; Includes requirements to assess/improve AI system functional performance (mitigating discrimination); Ensures individuals’ rights not to be subjected to automated decision-making; Most important aspect from testing perspective: personal data (including predictions) should be accurate

Question 12

GDPR’s Requirement for Personal Data Accuracy

Answer 12

System should be accurate enough for purposes used; Not every single prediction must be accurate

Question 13

Regulatory Standards for AI in Safety-Related Systems

Answer 13

Applicable where AI is used in safety-related systems; ISO 26262 [S04] for automotive systems; ISO/PAS 21448 (SOTIF) [S05] for automotive systems; Typically mandated by government bodies

Question 14

Examples of Regulatory Standards for Automotive Systems

Answer 14

ISO 26262 [S04]; ISO/PAS 21448 (SOTIF) [S05]

Question 15

Nature of Standards in Isolation

Answer 15

Voluntary documents; Use normally only made mandatory by legislation or contract

Question 16

Reasons for Users Adopting Standards

Answer 16

Benefit from expertise of authors; Create products of higher quality