Integration and Interoperability Flashcards

1
Q

Define integration and interoperability

A

Managing the movement and consolidation of data within and between applications and organisations

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Deliverables of integration and interoperability

A
  • DII architecture
  • Data exchange Specifications
  • Data Access Agreements
  • Data Services
  • Complex Event Processing (Thresholds and Alerts)
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Metrics of integration and interoperability

A
  • volumes
  • latency
  • value delivered
  • costs and times
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Integration

A

movement and consolidation of data into consistent forms

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

interoperability

A

providing the mechanisms for multiple systems to process data

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

goals of integration and interoperability

A
  • consolidate the data and make available
  • lower the cost and complexity of managing solutions
  • identify meaningful events and support business analytics
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

four common use case of integration and interoperability

A
  1. INTEGRATION of data between data stores
  2. CONSOLIDATION of data stores, including application consolidation, data hub management, mergers and aquisitions.
  3. DISTRUBUTING data across data store and data centres.
  4. Moving data into ARCHIVES, and updating data from one archive technology to another to enable future use
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

RAID

A

redundant array of inexpensive discs

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

Styles of integration and interoperability approaches

A

point to point
hub distrubution
message synchronisation
Bus distrubution
ETL/ELT/CDC
Abstraction / Virtual Consolidation (API)

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

point to point integration approaches

A

device linked to device with communications each way between

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

Point to point advantages

A
  • fast
  • good when small number of devices
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

point to point disadvantages

A
  • lots of detailed code (takes a long time to code, support may be difficult when people leave)
  • run time issues with many systems
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

hub distrubution interoperability approach

A

changes are submitted to a central hub and routes it to the people who are authorised to recieve it

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

Messaging Bus interoperability approach

A

application makes a change and then a bus pushes the data into a central service which then pushes it to systems that are authorised to recieve it

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

Service Oriented Architechture (SOA)

A

based on bus distrubition

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

Hub compared to bus model

A

Bus is more scalable

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

Concerns of hub and bus model

A

single point of failure

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

Integration is…

A

database to database

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

ETL acronym

A

extract transform load

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

CDC acronym

A

change data capture (drip)

21
Q

ETL, ELT

A

Batch distrubution for the mass movement of data collected over time from source data structure

22
Q

CDC

A

event driven distrubution

23
Q

ETL vs ELT

A

ETL - higher quality longer time
ELT - lower quality, quicker time (good for data scientists etc, bad because it might get forgotten about)

24
Q

Message Synchronisation and propagation integration approach

A

put code in for application to application integration
event driven

25
Tight coupling
both applications know of each other (direct communication)
26
Loose coupling
applications remain anonymous, communicate via and API (indirect)
27
Integration vs interoperability
integration is data to data interoperability is application to application
28
EII
Enterprise Information Integration (data to appplication, virtualisarion)
29
Virtualisation approach
transforms on the fly to present the data to the consuming application as though it were native to its own application
30
3 major components of virtualisation
- access layer - transformation layer - virtualisation layer
31
Canonical data model
data model that aims to present data entities and relationships in the simplest possible form to integrate processes across various systems and databases.
32
Mapping requirement and rules for moving data from source to target enables
transformation
33
When integrating two data stores using batch or real-time synchronous approaches the result is
latency
34
If two data stores are able to be inconsistent during normal operations then the integration approach is
asynchonous
35
A content distrubution network supporting a multi national website is like to use
a replication solution
36
Functions of the enterprise service bus (ESB)
Support near real time data integration Act as an intermediary passing messages between systems Continuously “polling” applications connected, looking for new data they're subscribed to Allow data integration solutions to execute more frequently than batch processing otherwise allows
37
Why combine data?
consolidate data from multiple sources to make it easier to understand and analyse
38
ETL
extract transform load
39
Change data capture
filters out only the data that changed, saving resources
40
point to point model
efficiently directly connect to exchange data. get complicated when multiple systems are involved.
41
hub and spoke model
centralises data in the hub, and systems can access from here. reduces the number of interfaces.
42
publish and subscribe model
systems that push out data and others subscribing to receive it (consistent delivery)
43
Enterprise service bus
act as an intermediary, connecting systems and passing messages enabling loosely coupled and flexible data sharing
44
Service oriented architechtures
uses well-defined service calls between applications promoting application independence and the ability to replace systems with minimal disruption
45
ESB vs ETL
ETL is bulk data ESB is smaller real time communications (application integration)
46
Managing the availability of data throughout the data lifecycle is...
not a goal of data integration and interoperability
47
In an ETL process, Lookups and Mappings are part of which step?
Transform
48
Activities part of the planning and analysing stage if data integration processing
- Define data integration and lifecycle requirements - Perform data discovery - perform data profiling - documenting data lineages