SMART Methodology to Ask Effective Questions Flashcards

1
Q

What is the SMART methodology?

A

A tool for determining a question’s effectiveness based on whether it is specific, measurable, action-oriented, relevant, and time-bound

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
2
Q

What 5 characteristics do effective questions have?

A
  1. Specific
  2. Measurable
  3. Action-Oriented
  4. Relevant
  5. Time Bound
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
3
Q

Describe Specific Questions

A

Specific questions are simple, significant, and focused on a single topic or a few closely related ideas.

Is the question specific?
Does it address the problem?
Does it have context?
Will it uncover a lot of the information you need?

Example
Non-Specific
Are kids getting enough exercise these days?

Specific
What percentage of kids achieve the recommended 60 minutes of physical activity at least five days a week?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
4
Q

Describe Measurable Questions

A

Measurable questions can be quantified and assessed.

Will the question give you answers that you can measure?

Example
Unmeasurable
Why did our recent video go viral?

Measurable
How many times was our video shared on social channels the first week it was posted?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
5
Q

Describe Action-Oriented Questions

A

They encourage change

Will the answers provide information that helps you devise some type of plan?

Example
Instead of
How can we get customers to recycle our product packaging?

Try
What design features will make our packaging easier to recycle?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
6
Q

Describe Relevant Questions

A

Relevant questions matter, are important, and have significance to the problem you’re trying to solve.

Is the question about the particular problem you are trying to solve?

Example
Instead of
Why does it matter that Pine Barrens tree frogs started disappearing?

Try
What environmental factors changed in Durham, North Carolina, between 1983 and 2004 that could cause Pine Barrens tree frogs to
disappear from the Sandhills Regions?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
7
Q

Describe Time-Bound Questions

A

Time-bound questions specify the time to be studied

Are the answers relevant to the specific time being studied?

Example
1983 to 2004

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
8
Q

How does fairness apply to asking questions?

A
  • Fairness in the context of asking questions as a Data Analyst means ensuring that your questions don’t create or reinforce bias.
  • Craft questions that make sense to everyone.
  • Questions should be clear and have a straightforward wording that anyone can easily understand.

Example
Unfair
- These are the best sandwiches ever, aren’t they?
- What do you love most about our exhibits

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
9
Q

What are good questions to answer when starting a project?

A

1. Objective
What is the objective. For example, what are the goals of the deep dive? What, if any, questions are expected to be answered by this deep dive?

2. Audience
Who is the audience. For example, who are the stakeholders? Who is interested or concerned about the results of this deep dive? Who is the audience for the presentation?

3. Time
What is the due date. For example, what is the time frame for completion? By what date does this need to be done?

4. Resources
What resources are avaialble to you. For example, what resources are available to accomplish the deep dive’s goals?

5. Security
Who should have access to the data. For example, who should have access to the information?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
10
Q

Why is it important to ask thorough questions?

A

Asking thorough and specific questions means clarifying details until you get to concrete requirements. With clear requirements and goals, it’s much easier to plan and execute a successful data analysis project and avoid time-consuming problems down the road.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
11
Q

How could you use the SMART method to determine what questions to ask in order to answer “What features do people look for when buying a new car”

A

Specific: Does the question focus on a particular car feature?
Measurable: Does the question include a feature rating system?
Action-oriented: Does the question influence creation of different or new feature packages?
Relevant: Does the question identify which features make or break a potential car purchase?
Time-bound: Does the question validate data on the most popular features from the last three years?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
12
Q

Examples of questions you could aim to answer around “What features do people look for when buying a new car”

A

Ask open ended questions:

On a scale of 1-10 (with 10 being the most important) how important is your car having four-wheel drive? Explain.

What are the top five features you would like to see in a car package?

What features, if included with four-wheel drive, would make you more inclined to buy the car?

How does a car having four-wheel drive contribute to its value, in your opinion?

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
13
Q

What types of questions should you avoid?

A
  1. Leading Questions
  2. Closed-Ended Questions
  3. Vague Questions
How well did you know this?
1
Not at all
2
3
4
5
Perfectly
14
Q

What is an example of a leading question?

A

This product is too expensive, isn’t it?

This is a leading question because it suggests an answer as part of the question. A better question might be, “What is your opinion of this product?” There are tons of answers to that question, and they could include information about usability, features, accessories, color, reliability, and popularity, on top of price.

Now, if your problem is actually focused on pricing, you could ask a question like “What price (or price range) would make you consider purchasing this product?” This question would provide a lot of different measurable responses.

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
15
Q

What is an example of a closed-ended question?

A

Were you satisfied with the customer trial?

This is a closed-ended question because it doesn’t encourage people to expand on their answer. It is really easy for them to give one-word responses that aren’t very informative.

A better question might be, “What did you learn about customer experience from the trial.” This encourages people to provide more detail besides “It went well.”

How well did you know this?
1
Not at all
2
3
4
5
Perfectly
16
Q

What is an example of a vague question?

A

Does the tool work for you?

This question is too vague because there is no context. Is it about comparing the new tool to the one it replaces? You just don’t know.

A better inquiry might be, “When it comes to data entry, is the new tool faster, slower, or about the same as the old tool? If faster, how much time is saved? If slower, how much time is lost?” These questions give context (data entry) and help frame responses that are measurable (time).

17
Q

What are three things to focus on when preparing for your first meeting with a stakeholder?

A

Prioritize your questions: Prepare to ask the most important and interesting questions first.

Make your time count: Stay on subject during the conversation.

Clarify your understanding: To avoid confusion, build in some time to summarize answers to make sure you understood them correctly. This will go a long way in helping you avoid mistakes. For example, in a conversation with a teacher, you might check your understanding with a statement like, “Just to double check that I understand what you’re saying correctly, you currently use test scores in the following ways…”

18
Q

What does it mean to use the SMART framework?

A

Use the SMART question framework to make sure each question you ask makes sense based on the project. Each question should meet as many of the SMART criteria as possible.

19
Q

Example of SMART framework when questioning someone who works in retail

A

Specific: Do you currently use data to drive decisions in your business? If so, what kind(s) of data do you collect, and how do you use it?

Measurable: Do you know what percentage of sales is from your top-selling products?

Action-oriented: Are there business decisions or changes that you would make if you had the right information? For example, if you had information about how umbrella sales change with the weather, how would you use it?

Relevant: How often do you review data from your business?

Time-bound: Can you describe how data helped you make good decisions for your store(s) this past year?

20
Q

Example of SMART framework when questioning someone who works as a teacher

A

Specific: What kind of data do you use to build your lessons?

Measurable: How well do student benchmark test scores correlate with their grades?

Action-oriented: Do you share your data with other teachers to improve lessons?

Relevant: Have you shared grading data with an entire class? If so, do students seem to be more or less motivated, or about the same?

Time-bound: In the last five years, how many times did you review data from previous academic years?

21
Q

Example of SMART framework when questioning someone who owns a small ice cream shop

A

Specific: What data do you use to help with purchasing and inventory?

Measurable: Can you order (rank) these factors from most to least influential on sales: price, flavor, and time of year (season)?

Action-oriented: Is there a single factor you need more data on so you can potentially increase sales?

Relevant: How do you advertise to or communicate with customers?

Time-bound: What does your year-over-year sales growth look like for the last three years?

22
Q

What does taking effective notes look like when interviewing stakeholders?

A

General Notetaking Guideance
It is important to take good notes during your conversation. Your notes should be comprehensive and useful. To help you capture meaningful notes, you should stick to a process of asking a question, clarifying your understanding of their response, and then briefly recording it in your notes.

The notes you will take will differ greatly based on the data conversation you have. The important thing is that your notes are clear, organized, and concise.

Remember: If a question is worth asking, then the answer is worth recording. Commit yourself to taking great notes during your conversation.

Helpful aspects of your conversation to note include:

Facts: Write down any concrete piece of information, such as dates, times, names, and other specifics.

Context: Facts without context are useless. Note any relevant details that are needed in order to understand the information you gather.

Unknowns: Sometimes you may miss an important question during a conversation. Make a note when this happens so you can figure out the answer later.

23
Q

Example of notes from a meeting with the ice cream shop owner

A

The SMART questions led the ice cream shop owner to propose a project to analyze customer flavor preferences. Your notes might look like this.

Project: Collect customer flavor preference data.

Overall business goal: Use data to offer or create more popular flavors.

Two data sources: Cash register receipts and completed customer surveys (email).

Target completion date: Q2

To do: Call back later and speak with the manager about the location of survey data.