Statistics Every Consultant Should Not Get Wrong

Statistics Every Consultant Should Not Get Wrong

Can a perfectly correct average still give you a completely wrong recommendation? Yes - and that is exactly how bad store closures, misleading cost cuts and false growth stories get dressed up as “data-driven” decisions.

  • Always define the denominator: revenue per customer, order, store, visit and active user can tell different stories.
  • Do not trust a naked average: check median, range, outliers and segment mix before concluding.
  • Weighted average beats simple average when groups are different sizes - a classic case-math trap.
  • Correlation is not causation: ask for mechanism, time order and possible confounders.
  • Base rate first: a “high accuracy” model or claim is useless without knowing how common the event is.
  • Variance matters: two businesses with the same average margin may need very different strategies if one is volatile.
  • Consulting statistics are decision tools: the goal is not statistical ornamentation, but a better recommendation.

Big Picture - Statistics Is Compression, Not Truth

A statistic compresses messy reality into one number. That number becomes useful only when the business question is clear and the data is trustworthy. If either is weak, more calculation only creates false confidence - which is why good consultants start with defining the problem before solving it, then choose the statistic.

Statistics help most when the business question and the underlying data are both strong.Statistics help most when the business question and the underlying data are both strong.False precisionClear ask, bad dataDecision insightClear ask, good dataNoiseBad ask, bad dataData dumpGood data, bad askData qualityQuestion clarity
Statistics help most when the business question and the underlying data are both strong.

The Core Explanation - The Six Checks That Prevent Bad Case Math

In consulting cases, statistics rarely appear as textbook theory. They appear as a line in a chart, a ratio in a prompt, a market-sizing assumption, or a client claim: “average cost is up”, “conversion improved”, “customers are churning”, “this channel is more profitable.” Your job is to check whether the number deserves to drive the recommendation.

Use this sequence before accepting any statistic:

A statistic becomes case-ready only after it is tied to a decision, a population, a metric and a segment.A statistic becomes case-ready only after it is tied to a decision, a population, a metric and a segment.QuestionWhatdecision?PopulationWho iscounted?MetricNumeratorover…SegmentMix andoutliersActionSo whatnow?
A statistic becomes case-ready only after it is tied to a decision, a population, a metric and a segment.

1. Denominator - the First Thing to Say Out Loud

Most bad statistical answers begin with an undefined denominator. “Sales are up” sounds good; “sales per store are down because store count doubled” sounds like a different problem. “Cost per order is up” may be driven by small baskets, longer delivery distance, failed deliveries, or discounting - each needs a different fix.

In a case, say the denominator explicitly: “I would define customer acquisition cost as marketing spend divided by new customers acquired in the period.” This protects you from mixing totals, per-unit metrics and percentages in the same argument.

2. Average vs Median - When the Middle Tells a Cleaner Story

The mean is pulled by extreme values; the median is the middle observation. In income, order value, delivery time, claims, customer complaints and employee performance, the mean can be distorted by a small number of unusually large observations.

Use the mean for totals and planning capacity; use the median when you want the typical customer, store or transaction.Use the mean for totals and planning capacity; use the median when you want the typical customer, store or transaction.MeanSensitive to outliersMedianShows typical case
Use the mean for totals and planning capacity; use the median when you want the typical customer, store or transaction.

3. Weighted Average - the Trap That Looks Too Easy

If groups have different sizes, a simple average is usually wrong. You must weight each group by its relevant volume - customers, orders, revenue, stores, hours, or units.

Worked example: A company has two lead sources.

  • Source A: 100 leads, 40 conversions - conversion rate = 40%
  • Source B: 900 leads, 90 conversions - conversion rate = 10%

The simple average conversion rate is (40% + 10%) / 2 = 25%. That is wrong for the total business. The weighted conversion rate is total conversions / total leads = (40 + 90) / (100 + 900) = 130 / 1000 = 13%.

The insight changes completely: the high-conversion source is small, while the low-conversion source dominates volume. The recommendation is not “conversion is healthy at 25%”; it is “fix Source B or rebalance spend.”

4. Base Rate - The Background Number That Changes the Meaning

The base rate is how common something is before you apply a test, model or filter. If fraud is rare, even a model with impressive accuracy can generate many false alarms. If churn is already high in one customer cohort, a campaign’s “high churn” group may simply reflect that cohort mix.

Consulting translation: before reacting to a percentage, ask, “Compared with what baseline?”

5. Correlation vs Causation - Relationship Is Not Proof

Correlation means two variables move together. Causation means one variable produces a change in the other. Ice-cream sales and drowning incidents may rise together in summer; ice cream is not the cause. The hidden driver is temperature and seasonality.

To move from correlation toward causation, check three things:

6. Variance and Confidence - How Much Should You Trust the Number?

Averages hide spread. If two regions have the same average sales but one swings wildly month to month, the second region needs risk controls, not the same plan. A confidence interval asks: given the sample, what range of values is plausible for the true population metric?

In cases, you do not need advanced hypothesis testing. You do need to say: “I would check whether the difference is large enough versus normal variation and sample size before treating it as real.”

The Consultant’s Minimum Statistics Toolkit

Use this table as your case-math checklist. The “good” column is deliberately decision-oriented because business statistics have no universal magic number.

In an Indian quick-commerce profitability case, “average order value” alone is not enough. You would segment by city, dark-store maturity, delivery distance, SKU mix, discount intensity and repeat-user share. The strategic so what: profitability is usually a cohort and density question, not a single average-order-value question.

Definitions - Say These Cleanly

  • Mean: the arithmetic average, calculated as total value divided by number of observations.
  • Median: the middle value when observations are arranged in order.
  • Percentile: the value below which a given percentage of observations falls.
  • Standard deviation: a measure of how spread out observations are around the mean.
  • Base rate: the underlying frequency of an event before applying new evidence.
  • Correlation: the degree to which two variables move together.
  • Confidence interval: a range of plausible values for a population parameter based on sample data.
  • p-value: the probability of results at least this extreme, assuming the null hypothesis is true.

Razorpay Optimizer: Statistics in One Payment Decision

Razorpay’s payment-routing product shows why segment-level success rates matter more than one overall average.

Payment reliability is a statistical problem hiding inside a customer experience moment.
Payment reliability is a statistical problem hiding inside a customer experience moment.

Consider an online merchant accepting payments through multiple routes - cards, UPI, net banking, wallets and different payment gateways. A weak consultant might look only at the overall payment success rate and conclude that the system is “fine” or “not fine.” That average hides the real issue: success can vary by payment method, bank, issuer, device, time of day and gateway route.

Razorpay positions Razorpay Optimizer as a product that helps businesses route payments across providers to improve payment performance. The statistical lesson is simple: one blended rate is less useful than a segmented, continuously monitored rate that can inform routing decisions.

The primary driver of the solution is segmented routing based on observed payment performance. Supporting drivers include multiple available routes, real-time monitoring, retry logic and merchant integration. The outcome is not just “better analytics”; it is a better operational decision under uncertainty.

How AI Changes Statistics Every Consultant Should Not Get Wrong

AI is making statistical analysis faster, but it is also making false confidence easier. In 2026, the consultant’s edge is not merely calculating quickly - it is knowing which calculation is valid.

Load your case prompt, assumptions and calculations into ChatGPT or Claude and ask: “Check the denominator, weighted average, base-rate risk, correlation-vs-causation issue and any arithmetic inconsistency. Do not solve the case again - audit my statistics.” For live practice, pair this with practising cases with AI as a mock interviewer.

Interview Relevance

“The client says average revenue per customer has increased by 12%, but profit has declined. How would you investigate?”

When profitability enters the discussion, connect the statistic to unit economics. If the case requires break-even or margin logic, revise contribution margin and break-even analysis in cases.

Common Mistake

The mistake: accepting an average without checking the denominator, segment mix and outliers. It costs candidates because the recommendation sounds quantitative but rests on the wrong interpretation. One-line fix: before using any statistic, say, “What exactly is the numerator, what is the denominator, and which segment could reverse this conclusion?”

Mark Lesson Complete (Statistics Every Consultant Should Not Get Wrong)