Term Glossary (Topic 1.4-1.6)

Question 1

State the three stages of data profiling

Answer 1

1) Create simple summary statistics (Counts, means, min/max)
2) Check data quality
3) Identify problems for future data integrations (mislabelled columns, inconsistent data formats)

Question 2

What are the four options when an error is found

Answer 2

1) Accept it - Keep the error (perhaps flag it or offer an explanation)
2) Reject the data entry (remove the entry)
3) Correct the error (if possible, identify and amend the data entry)
4) Create default value (replace the error with a set value to help with data consistency)

Question 3

What does CUVCAT stand for

Answer 3

C - Completeness
U - Uniqueness
V - Validity
C - Consistency
A - Accuracy
T - Timeliness

Question 4

Describe ‘Data Migration’

Answer 4

The physical movement of data from one source to a destination.

Question 5

Explain ‘Master Data Management (MDM)’

Answer 5

This describes identifying, protecting and properly handling of data that is core to business operations. It is important to identify the specific datasets that are critically sensitive.

Question 6

State the three elements that should be considered within ‘Integration Design’

Answer 6

1) Rules and Requirements
2) Objectives and Deliverables
3) Support models and SLAs

Question 7

Describe ‘Rules and Requirements’ with relation to Integration Design

Answer 7

An organisation will likely have a set of rules and requirements that govern how its data is integrated to remain legally compliant, maintain security, retain performance…etc

Question 8

.

Answer 8

.

Question 9

Describe ‘Support models and SLAs’ with relation to Integration Design

Answer 9

Database models (recap from Data analysis concepts) should be set up to support easy data integration. Remember that even dashboards linked to multiple tables are examples of data integration. SLAs can define the level of output required from the data integrating system.

Question 10

State the three elements that should be considered within ‘Data Integration Tools’

Answer 10

1) Future Scalability
2) Implementation
3) Support Costs

Question 11

Describe ‘Future Scalability’ & state three requirements for future scalability with relation to Data Integration Tools

Answer 11

When setting up databases, it is important to account for the possibility that further tables may need to be added in future. Making sure that:
 All tables have primary keys (even tables that do not connect to other tables).
 Keep consistent field names (so that columns can me matched with equivalent columns in other tables).
 Keep consistent data formats.

Question 12

Describe ‘Implementation’ with relation to Data Integration Tools

Answer 12

A major issue is combining data that was previously measured/recorded in different ways. This would lead inconsistent data stores. This would have to be solved prior to integration.

Question 13

Describe ‘Support costs’ with relation to Data Integration Tools

Answer 13

Integrating large amounts of data efficiently will involve significant expense primarily from man-hours needed and new hardware/software required.

Question 14

Define ‘Data Synchronisation’

Answer 14

This is a form of data integration that aims to keep the records stored in one location consistent with records stored in another location through a continuous updating process. By contrast, data integration is the process of connecting data sets together often in single events. There are number of reasons for synchronising data.

Question 15

Define ‘Technical Acceptance Testing (TAT)’

Answer 15

Set of tests designed to find whether a piece of software (such as a dashboard) has satisfied its technical requirements. It is often done just before or simultaneously with User Acceptance Testing (UAT). TAT is often done if non-functional requirements of a system change.

Question 16

Define ‘User Acceptance Testing (UAT)’

Answer 16

This is where a system is tested by end users to see if it functions properly, fulfils business requirements. UAT is often done if functional requirements of a system change.

Question 17

Define ‘Performance Stress Testing (PST)’

Answer 17

This form of test to see how a system performs when under excessive and sudden increases in demand/load. For example, a live database needs to be tested with multiple complex queries occurring simultaneously to see if it remains stable.