1. Skip to navigation
  2. Skip to content
  3. Skip to sidebar

Scott Maxwell sums up 10 ways to lie with metrics. This is great advice for the political strivers and schemey backstabbers and a great antipattern for the readership of this blog. To summarize, here are his ten ways to lie when presenting data:

  1. Only present metrics that are positive. That’s why you collect all those metrics.
  2. Only present metrics that are easy to manage.
  3. Use many metrics.
  4. Be extremely precise with your numbers.
  5. Present quickly, drown ’em with data.
  6. Say “you don’t break down metrics” if they aren’t flattering to you.
  7. Put lipstick on that pig—apply lots of gloss to your charts. Hello, Crystal XCelsius!
  8. Show off your bona fides by sharing some metrics “off the cuff”.
  9. Prep your team by feeding them lines.
  10. Your job isn’t to educate your audience about your metrics. If people don’t know what you’re talking about, it’s because they’re stupid.

This is a great list, and it’s hard to avoid committing some of this sins from time-to-time. I think the best tool to improve your honesty when presenting numbers is to respect the intelligence and good judgment of your audience.

This isn’t easy; we all have people who can drive us crazy, who can derail a presentation with niggling questions or who ask for information they’ll never use.

There is no magic bullet when presenting numbers. Your job is not merely to show a few columns of numbers, but to teach your colleagues what those numbers mean.

[Editors note: Read the comments! David has some timely additions to this list.]

Topics:
  • http://bizviz.jorgecamoes.com Jorge Camoes

    Let me focus on a specific set of those “feel good” metrics. Since the classic study by Beattie and Jones “The use and abuse of graphs in annual reports”, back in 1992, I don’t see much improvement, quite the opposite. Annual reports became marketing communication tools and you must dig deep to find useful information. They are the best source for bad examples (I know I can always trust them for that…).

  • http://blog.immeria.net S.Hamel

    You know, when you read dozens of blogs trough RSS feeeds, sometimes you scan a post very fast… That’s initially what I did with yours, my eyes stumbling on “top 10″ “web analytics” and “truth”… So I read the first 3 recommendations, ready to jump in! Some studies in marketing revealed that a negative tone actually have more impact than a positive one. You got me! :)

  • David

    Thanks for finding the good article: I’ve already shared it with some peers.

    What a list! It is painfully easy to think of a few more:

    * vary the size, shape, and scale of the graph to make trends look as steep (or flat) as you want.

    * If you can break a company-wide graph out into 5-15 divisions, they’ll all jumble up and down together, looking remarkably steady in the spaghetti bowl. (This is the flip side of #6 above)

    * the more you change your metrics and their definitions, the less you’ll have to put up with pesky apples-to-apples comparisons across time periods (and the more you can adjust the targets to meet your performance).

    * The longer it takes to prepare metrics, the more impressive your work is. Never respond quickly to ad-hoc requests. Never give people the tools to pull their own data.

  • http://philiptiongson.typepad.com/my_weblog/2007/04/agile_analytics.html Organized Chaos

    Agile Analytics…

    As I venture more deeply into the field of analytics – and perhaps consider a change in personal directions, I came across this page from Juice Analytics’ blog about their adherence towards Agile Analytics. Agile Analytics diverges from traditional bu…