Leadership Without Self-Abandonment

Presenting Data With Uncertainty: A Clearer Brief

ShareLinkedInFacebookX
Illustrative reports on a conference table beside a pencil and water glass, with a blurred presentation screen behind.
AI-generated illustration of a briefing workspace. The charts are decorative, not actual data or a forecast.

Presenting data with uncertainty means showing what you measured, what you estimated, and what you assumed. The goal is not to sound vague. It is to make the decision clear while keeping the evidence honest.

What is your goal when presenting data with uncertainty?

Decide the decision first, then choose what to show. A board weighing one question needs the numbers that could change the answer. It also needs a plain statement of how much trust each number carries.

Open with the request: what you want decided, by whom, and when. Keep key limits and evidence against your view in the main brief. Put supporting method detail in the appendix so readers can check your work.

Which numbers are observations, estimates or scenarios?

Label each number by its source. An observation is something you counted or recorded. An estimate is a value drawn from a sample, model or benchmark. A scenario uses chosen assumptions to explore what could happen. Keep these labels clear when you show the numbers together.

A count and a rate differ too. Sixteen purchases is a count. For a purchase rate of 8 percent, state how many leads the rate is based on. State the group, time window and source date beside the number.

Here is an illustration, not a real client and not a validated forecast. A pilot ran in two phases. Phase A produced 16 purchases from 200 leads. Phase B produced 24 purchases from 300 leads. Both phases show an observed rate of 8 percent. The purchase count rose 50 percent, and the lead count rose 50 percent. On these figures, there is no visible gain in conversion. Present the second phase as growth, and the denominator is doing the work.

ItemPhase APhase B
Leads200300
Purchases1624
Observed rate8.0%8.0%

The two rates of 8% do not prove that both groups perform equally beyond this sample. Season, lead mix, follow-up and tracking can differ between groups.

Suppose next month brings 1,000 leads. The table below shows what three different assumed rates would imply at that volume.

Assumed rateLeadsImplied purchases
5%1,00050
8%1,00080
11%1,000110

These are chosen assumptions for illustration. They are not best and worst cases, not confidence bounds, not probabilities, and not a validated forecast. No treatment was assigned, so no causal effect is established either.

What does the uncertainty range actually mean?

Different questions yield different ranges. A descriptive spread shows how much the values varied. A range for an estimate may reflect sampling or model error. Scenarios show what chosen assumptions imply. These answer different questions. Do not give them one unexplained shaded band.

Ask the analyst what a band means before you show it. Do not invent a confidence level or label scenario endpoints as a 95 percent interval. Even a sound interval does not cover all bias, missing data or untested assumptions. If its meaning is unknown, find out. Until then, state the limit in words; do not hide it.

Visualization research is often read too loosely here. In crowdsourced visual inference experiments, how means and uncertainty were encoded changed how participants judged the data. The authors discuss how ambiguous error bar meanings affect particular inference tasks rather than naming one best chart (Correll & Gleicher, 2014). Those were controlled online tasks, not executive briefings. Treat the finding as a caution about ambiguity, not a ban on error bars.

A practitioner survey and interviews with visualization designers found a real tension between valuing uncertainty and leaving it out of finished work (Hullman, 2020). That study describes practices and beliefs among people who make charts. It does not show that disclosure improves trust or decisions. The participants were not a representative sample of managers.

Online experiments tested how people read charts, including chart size and gridlines, and repeated earlier tests (Heer & Bostock, 2010). These visual tasks were not a field test of business persuasion.

How can chart choices change what people infer?

Chart form shapes the argument before you speak. A truncated axis can make small movements look dramatic. A single line with no range can imply a precision the data may not carry. None of this is dishonest by itself. Each choice nudges the inference.

Start bars at zero so their lengths match the values in proportion. A line chart may use a narrowed axis to show change. Label that axis clearly and explain its start point. State the units. Add text or a table with the same facts for readers who cannot use the chart. Do not rely on colour alone.

Show a range when you can explain its meaning and method. Keep it visible if it matters to the decision. Do not drop it just because it is hard to explain. A caption can state what the number means. It cannot make weak evidence strong.

How do you build a clear brief without hiding limits?

Try a one-page brief with fixed fields. Name the decision and its owner. Add the observed facts and any estimates or scenarios, with their assumptions. State key unknowns, the downside, the next evidence needed and when to review it.

This example points to checking like-for-like data, costs and capacity before expansion. Conversion alone does not settle the decision. The scenario endpoints do not set safe bounds for action.

If the pilot covered one region, one season or one customer type, name that limit in the brief.

For sensitive or high-stakes quantitative decisions, work with the qualified analyst and follow your organisation's review rules. A speaker should never manufacture a statistical interval or present scenario endpoints as confidence bounds. You can own the narrative without owning the statistics.

When the facts themselves are still missing, the approach in answering questions when facts are missing applies directly. Measurement instruments deserve the same care described in interpreting feedback measures carefully. More context sits in the Insights library.

What should you check before the audience acts?

Run the same short check every time. Does the brief name the decision and its owner? Is every number labelled as observed, estimated or scenario? Does each range have a stated meaning and a stated method? Are denominators, time windows and source dates visible? Is the missing information named, and is there a next-evidence step with an update trigger?

Then check the language. A decisive delivery does not turn an estimate into a fact. You can recommend a course of action and still say which part rests on measurement and which rests on assumption.

Finally, ask what the room would do if the number were wrong. If the answer is nothing, the decision may not depend on the data at all. If the answer is serious, the brief needs the downside stated before anyone votes.

If you would like to discuss speaking fit for a team session on decision-ready briefs, that conversation starts with the decision you face.

Key takeaways

  • Label each number as observed, estimated or scenario, and never blend the three.
  • State denominator, time window and source date beside the number.
  • Equal observed rates do not prove equal underlying performance; season, lead mix and tracking can differ.
  • Show a range only when its meaning and method can be explained, and never hide a real unknown by dropping it.
  • Use one brief with fixed fields, including material unknowns, downside and an update trigger.
  • A firm delivery style does not upgrade the evidence behind it.

Frequently asked questions

Do error bars always show a confidence interval?
No. They can represent standard deviation, standard error, a range, or something the chart maker chose without explanation. Ask which one, because the meaning changes the reading. If nobody can say, describe the limitation in words instead.
Can a clear recommendation include uncertainty?
Yes. You can suggest gathering more comparable data while naming what remains unknown. Clear is not the same as certain. The audience needs both the next step and its limits.
Does a higher total always mean better performance?
No. A higher total can reflect a larger denominator rather than improved results. In the pilot illustration, purchases rose 50 percent while leads also rose 50 percent, leaving the observed rate unchanged. Compare rates with their denominators before drawing a conclusion.

References

- Correll, M., & Gleicher, M. (2014). Error bars considered harmful: Exploring alternate encodings for mean and error. IEEE Transactions on Visualization and Computer Graphics, 20(12), 2142-2151.

- Heer, J., & Bostock, M. (2010). Crowdsourcing graphical perception: Using Mechanical Turk to assess visualization design. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 203-212.

- Hullman, J. (2020). Why authors don't visualize uncertainty. IEEE Transactions on Visualization and Computer Graphics, 26(1), 130-139.

This article is for informational and educational purposes only and does not constitute financial, legal, tax, medical, or professional advice. Individual results vary.

Work with Mherie

Building something that deserves to last?

Work with Mherie →
Newsletter

Perspective, occasionally.

A considered note on leadership, building meaningful companies, and the road less travelled. A few times a month, never noise.

Your details and consent will be sent securely and stored for Mherie's office.