Process Data from Dirty to Clean (Terms)

Question 1

A range of values that conveys how likely a statistical estimate reflects the population

Answer 1

Confidence interval

Question 2

A character that indicates the beginning or end of a data item

Answer 2

Delimiter

Question 3

A data value that cannot be left blank or empty

Answer 3

Mandatory

Question 4

A file containing a chronologically ordered list of modifications made to a project

Answer 4

Changelog

Question 5

A function that removes leading, trailing, and repeated spaces in data

Answer 5

TRIM

Question 6

A function that returns a segment from the middle of a text string

Answer 6

MID

Question 7

A function that returns a set number of characters from the left side of a text string

Answer 7

LEFT

Question 8

A function that returns a set number of characters from the right side of a text string

Answer 8

RIGHT

Question 9

A function that returns the length of a text string by counting the number of characters it contains

Answer 9

LEN

Question 10

A group of characters within a cell, most often composed of letters

Answer 10

Text string

Question 11

A keyword that is added to a SQL SELECT statement to retrieve only non-duplicate entries

Answer 11

DISTINCT

Question 12

A number that contains a decimal

Answer 12

Float

Question 13

A process that ensures certain conditions for multiple data fields are satisfied

Answer 13

Cross-field validation

Question 14

A process to confirm that a data-cleaning effort was well executed and the resulting data is accurate and reliable

Answer 14

Verification

Question 15

A process to determine if a survey or experiment has meaningful results

Answer 15

Hypothesis testing

Question 16

A professional who develops processes and procedures to effectively store and organize data

Answer 16

Data warehousing specialist

Question 17

A professional who transforms data into a useful format for analysis and gives it a reliable infrastructure

Answer 17

Data engineer

Question 18

A rule that says the values in a table must match a prescribed pattern

Answer 18

Regular expression (RegEx)

Question 19

A spreadsheet function that calculates the number of days, months, or years between two dates

Answer 19

DATEDIF

Question 20

A spreadsheet function that counts the total number of values within a specified range

Answer 20

COUNTA

Question 21

A spreadsheet function that divides text around a specified character and puts each fragment into a new, separate cell

Answer 21

Split

Question 22

A spreadsheet function that joins together two or more text strings

Answer 22

CONCATENATE

Question 23

A spreadsheet function that returns the number of cells in a range that match a specified value

Answer 23

COUNTIF

Question 24

A spreadsheet function that vertically searches for a certain value in a column to return a corresponding piece of information

Answer 24

VLOOKUP

Question 25

A spreadsheet tool that automatically searches for and eliminates duplicate entries from a spreadsheet

Answer 25

Remove duplicates

Question 26

A spreadsheet tool that changes how cells appear when values meet specific conditions

Answer 26

Conditional formatting

Question 27

A SQL function that adds strings together to create new text strings that can be used as unique keys

Answer 27

CONCAT

Question 28

A SQL function that converts data from one datatype to another

Answer 28

CAST

Question 29

A SQL function that extracts a substring from a string variable

Answer 29

SUBSTR

Question 30

A SQL function that returns non-null values in a list

Answer 30

COALESCE

Question 31

A SQL statement that returns records that meet conditions by including an if/then statement in a query

Answer 31

CASE

Question 32

A subset of a text string

Answer 32

Substring

Question 33

A tool for checking the accuracy and quality of data

Answer 33

Data validation

Question 34

A tool for determining how many characters can be keyed into a spreadsheet field

Answer 34

Field length

Question 35

A tool that finds a specified search term and replaces it with something else

Answer 35

Find and replace

Question 36

A value that can’t have a duplicate

Answer 36

Unique

Question 37

A way of selecting a sample from a population so that every possible type of the sample has an equal chance of being chosen

Answer 37

Random sampling

Question 38

An agreement that unites two organizations into a single new one

Answer 38

Merger

Question 39

An indication that a value does not exist in a dataset

Answer 39

Null

Question 40

Any data that has been superseded by newer and more accurate information

Answer 40

Outdated data

Question 41

Any record that inadvertently shares data with another record

Answer 41

Duplicate data

Question 42

Converting data from one type to another

Answer 42

Typecasting

Question 43

Data that is complete but inaccurate

Answer 43

Incorrect/inaccurate data

Question 44

Data that uses different formats to represent the same thing

Answer 44

Inconsistent data

Question 45

Data that is complete, correct, and relevant to the problem being solved

Answer 45

Clean data

Question 46

Data that is incomplete, incorrect, or irrelevant to the problem to be solved

Answer 46

Dirty data

Question 47

Data that is missing important fields

Answer 47

Incomplete data

Question 48

How well two or more datasets are able to work together

Answer 48

Compatibility

Question 49

Nontechnical traits and behaviors that relate to how people work

Answer 49

Soft skills

Question 50

Numerical values that fall between predefined maximum and minimum values

Answer 50

Data range

Question 51

Skills and qualities that can transfer from one job or industry to another

Answer 51

Transferable skills

Question 52

The accuracy, completeness, consistency, and trustworthiness of data throughout its life cycle

Answer 52

Data integrity

Question 53

The average number of people who typically complete a survey

Answer 53

Estimated response rate

Question 54

The criteria that determine whether a piece of a data is clean and valid

Answer 54

Data constraints

Question 55

The degree to which data conforms to constraints when it is input, collected, or created

Answer 55

Validity

Question 56

The degree to which data conforms to the actual entity being measured or described

Answer 56

Accuracy

Question 57

The degree to which data contains all desired components or measures

Answer 57

Completeness

Question 58

The degree to which data is repeatable from different points of entry or collection

Answer 58

Consistency

Question 59

The maximum amount that sample results are expected to differ from those of the actual population

Answer 59

Margin of error

Question 60

The number of characters in a text string

Answer 60

Length

Question 61

The predetermined structure of a language that includes all required words, symbols, and punctuation, as well as their proper placement

Answer 61

Syntax

Question 62

The probability that a sample size accurately reflects the greater population

Answer 62

Confidence level

Question 63

The probability that a test of significance will recognize an effect that is present

Answer 63

Statistical power

Question 64

The probability that sample results are not due to random chance

Answer 64

Statistical significance

Question 65

The process of changing data to make it more organized and easier to read

Answer 65

Data manipulation

Question 66

The process of combining two or more datasets into a single dataset

Answer 66

Data merging

Question 67

The process of copying data from a storage device to computer memory or from one computer to another

Answer 67

Data transfer

Question 68

The process of matching fields from one data source to another

Answer 68

Data mapping

Question 69

The process of storing data in multiple locations

Answer 69

Data replication

Question 70

The process of testing two variations of the same web page to determine which page is more successful at attracting user traffic and generating revenue

Answer 70

A/B testing