10 - Reports and dashboards Flashcards

1
Q

What is the purpose of improving reporting and implementing dashboards?

A

To focus the organization on a single source of truth and make data-driven decisions

This requires data skills and the ability to drive cultural change.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

Define a business report.

A

An analysis of data to evaluate an issue, set of circumstances, or operational goal related to business performance.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

What is role-based reporting?

A

A discipline stating that internal reporting is done only when it makes a difference to a task or role in the organization.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

What is a business dashboard?

A

An information management tool used to present relevant data points for business performance at a glance.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

What is a certified report?

A

A report or dashboard that meets specific quality and governance standards.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

True or False: Most businesses create reports that add value.

A

False

The majority of reports create excuses rather than suggest improvements.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

What is the first task in a report audit?

A

To discover the size and scope of the challenge by investigating how reports are compiled and used.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

List the five levels of value in any report.

A
  • Quality and source of data
  • Clarity of definition
  • Transparency of data presentation
  • Insights and story the data tells
  • Actions that these insights suggest
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What issue did the audit reveal regarding the number of reports?

A

More than 500 reports were being used across the organization, many of which were duplicated.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

What is the Dunning-Kruger effect?

A

A cognitive bias where individuals overestimate their understanding of a subject, often evident in managers regarding data quality.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

What is the outcome of implementing role-based reporting?

A

Increased alignment of KPIs and metrics to business goals, resulting in a 64% increase in margin.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Fill in the blank: A business dashboard is used to present data points relevant to the _______.

A

[performance of a business]

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What is a common problem with static reports?

A

They are out of date as soon as they are created and may not support timely decision-making.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What should a dashboard focus on according to the data and analytics strategy?

A

It should tell the user where to focus today, aligned to the business strategy.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

True or False: Dashboards should only show positive metrics.

A

False

It is essential to focus on what needs attention most, even if it is negative.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is the risk of using low-quality data in dashboards?

A

It can lead to poor decision-making and is potentially as dangerous as a bad report.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
17
Q

What should be done to reconcile data for a dashboard?

A

Align user preferences with the data and analytics strategy while managing internal conflicts.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
18
Q

What is the goal of role-based reporting?

A

To produce reports with clear KPIs and metrics that drive change and behaviors across the business.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
19
Q

What is a potential benefit of uncovering implicit incentives in a business?

A

It may explain why the business is failing to realize strategic objectives.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
20
Q

What should be prioritized when addressing business issues?

A

Focus on what needs to be fixed first.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
21
Q

Why might a dashboard with mostly red traffic lights be more effective over time?

A

It indicates areas needing attention and drives change.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
22
Q

What do visualizations on dashboards provide?

A

Context and a quick message at a glance.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
23
Q

Fill in the blank: A dashboard should always send a signal prompting _______.

24
Q

What is the purpose of drill-down functionality in a dashboard?

A

To allow users to investigate and create the story from the data.

25
What is necessary for successful dashboard implementation?
Cooperation with the people who will use it.
26
True or False: There is only one type of dashboard suitable for all departments.
False.
27
What is a quick-win dashboard?
A dashboard that delivers early results and shows visible improvements.
28
What should be considered when dealing with data quality issues?
Reconcile what is possible and prioritize decision-making.
29
What are key decisions when specifying elements of a dashboard?
* Precise definitions * Appropriate performance indicators
30
What is the importance of taking a mock-up of the dashboard back to the business?
It helps gather useful feedback on its usefulness.
31
What can create tension when implementing dashboards?
The feeling of being monitored by detailed data.
32
What is the significance of negotiating common thresholds in dashboard metrics?
It creates a company-wide policy that defines failure using data.
33
What does Goodhart's Law warn against in performance measures?
When a measure becomes a target, it ceases to be a good measure.
34
What should a dashboard avoid to be effective?
Too much information at first glance.
35
What is a certified report or dashboard?
A business report that has been certified in terms of data quality and governance.
36
What should be included in a dashboard to enhance user trust?
A label that certifies the data and indicates when it was last updated.
37
What can reports and dashboards expose in a business?
Underlying business problems, potential flaws in processes, and data collection issues.
38
What is a common reaction when people see reports and dashboards?
They will ask for more data.
39
Fill in the blank: A dashboard should allow for _______ capabilities.
[what-if].
40
What is the purpose of having realistic measures of performance in a dashboard?
To reflect the long-term health of the business.
41
What can happen if short-term measures dominate dashboard metrics?
People may try to manipulate indicators in ways that are not beneficial for the business.
42
What is the role of dashboards in the transition to future-facing disciplines like analytics?
They provide a foundation for using data to inform future decisions.
43
What is the first priority when ensuring the quality of reports?
To ensure that those reports are of the highest possible quality and are trusted.
44
What issue do most businesses face regarding reports?
Too many reports with inconsistent data.
45
What is the purpose of an audit in the context of reports?
To discover how many reports have inconsistencies and where those inconsistencies come from.
46
What role do dashboards play in data reporting?
They use dynamic, regularly updated information.
47
What is the first step in creating effective reports and dashboards?
Ask the people who will use them what information has the highest value.
48
Why is clear communication essential when making changes to reports?
To ensure users understand the changes being made.
49
What should be avoided when presenting data to users?
Overcomplicating the data that users see.
50
What opportunity may be appropriate to provide users in relation to data?
The opportunity to drill down into the details.
51
What decision may cause conflict and require changes in business practice?
The decision to use single, high-quality, governed sources of data.
52
What does Goodhart’s Law state?
Any observed statistical regularity will tend to collapse once pressure is placed upon it for control purposes.
53
Who coined the generalization of Goodhart’s Law?
Marilyn Strathern.
54
What is the title of the book recommended for further reading about dashboards?
The Big Book of Dashboards: Visualizing your data using real-world business scenarios.
55
Fill in the blank: Goodhart’s Law actually states: ‘Any observed statistical regularity will tend to _______ once pressure is placed upon it for control purposes.’
collapse
56
True or False: Dashboards are static and do not update regularly.
False