6: Using Data to Create and Preserve Value Flashcards
(15 cards)
feedback
whenever you take results for a process, gather results and use the information to influence future performance by adjusting inputs
single feedback loop control system
go around in circles without human intervention
highly automated and dependable - think about a home central heating system
sensor senses outputs, feeds that into a comparator, which plays with the effector which adjusts inputs to control the process
double loop feedback system
higher level of human control with the human adjusting the standard
data extraction, transformation and loading (ETL) systems
3 part process
- extract - taking data from one database and putting it into another
- transform - converting the data for the new database
- loading - writing the transformed data into the target database
data supplied by the ETL system is data drawn by a lot of independent business systems within the organisation
sitting above the ETL system is software analysing data supplied by the ETL system
then above that is data dashboards and data visualisations
business intelligence (BI) systems
systems describing the technological architecture that extract, assemble, store and access data to provide reports and analysis
structure of business intelligence (BI) systems/stack
IT infrastructure at the bottom as the basic hardware/software
then specialist information systems like CRM, finance, ERP, HR, etc.
ETL systems drag data together to recode and resort it before loading it into the centralised warehouse
systems store the transformed data and manage it for use by higher-level systems
OLAP systems process inputs on a real-time basis and data mining allows us to extract information from data
main systems we use to make business decisions
real-time access to reports, dashboards and updates
hadoop
technological solution allowing us to deal with big data
example - GoogleBigQuery
increases the speed at which tasks can be completed
- breaks down the task into component parts, each of which is sent to a separate server which works independently so systems are not overloaded with excessive data or processing requirements
hadoop distribute file system (HDFS)
software coordinating what process goes to which server
MapReduce framework
data modelling
understanding of what data the business needs to support business processes
data manipulation
reorganising and transforming the data you have to make it easier to use
data analysis
collecting, cleansing, manipulating and modelling of data to support decision-making
3 stages of data modelling
- conceptual model - what data do you have? what do you need?
- logical model - thinking about what the system looks like, finance function reviews to ensure completion and accuracy
- physical model - finance function tests to ensure the physical model aligns with the conceptual model
advantages of data modelling
data compliance
enhancing the quality of data
good foundation for data handling and facilitation processes
improving the consistency in which the database is built
data manipulation language (DML)
allows us to automate the process of handling data sets
levels/types of data analysis which informs decision-making
exploratory data analysis
confirmatory data analysis
predictive data analysis
text data analysis