Memorable or Actionable or Both.

Recently, I saw the largest concentration of iPad users in the world, controlled a computer screen with my eyes, and learned about our looming robotic future. No, Apple doesn't have a technology lab on the moon, but I did attend CHI 2010 (short for Computer Human Interaction - the entire program along with papers and authors are referenced here). I left with a bit bigger toolkit and plenty of research to consider further. One such effort investigating chart junk has been reviewed by EagerEyes' Robert Kosara. I share his enthusiasm for research in visualization, but let's look more closely at some issues the paper raises and consider how these findings fit into the goals of visualization.

Nothing gets information visualization designers' feathers more ruffled than the thought of junky charts being more desirable than "Tufte-compliant" charts. I was skeptical, to say the least, in attending a presentation by Scott Bateman for a paper entitled, Useful Junk? The Effects of Visual Embellishment on Comprehension and Memorability of Charts. (The title is a bit misleading in that the paper is really about embellishments and illustration - not so much traditionally poor structural graphics often considered common "chart junk.")

(Example of embellished vs. plain chart with same data, from the paper) Embellished vs. Plain chart

The aesthetic treatment of data presentation is a long-time debate, and Scott came all the way from Canada to answer the question: Should we use chart junk? The answer is an emphatic "maybe." The goal of the study was to look at interpretation accuracy and long-term recall, and the papers says,

our results question some of the premises of the minimalist approach to chart design.

Make charts Memorable.

Skipping the gritty details of the study, here are the findings of a provoking illustration with data embedded compared to an boring, "plain" chart:

  • more memorable over the long-term;
  • perceived as having more value and sense of chart bias; and
  • most enjoyable and easiest to remember.

More memorable is better, right? The question we should be asking is, better than what. Of course, more memorable is better than less memorable, but at what cost? And what do we really want people to remember? It's doubtful the best way to drum up interest in data is by making it light up and do a dance to feed the public's already marketing heavy information diet.

Your data as is mostly marketing if it looks like this: GOOD.is | The Richest and Poorest NeighborhoodsGOOD.is | The Richest and Poorest Neighborhoods

Fully embellished charts Pros Cons
Graphics and illustration heavy Draws attention, memorable imagery It looks and feels glossy so people will treat it with the bias of a magazine or commercial TV ad
Little data depth Little analytical thinking needed, wider audience Non conclusive, likely not actionable
Endless diversity Creative exploration Few standards, wild chart organization
Production costs Little research, relatively cheap Illustration / Graphic artist talent required

Perhaps one's attention is more likely to be drawn to these embellished charts if they are engaged in an entertaining or passive ritual, like watching TV, browsing the web, or shuffling through a newspaper. Perhaps they get the same personal impact as the funny pages. We should consider a greater sense of bias or value message is introduced through this style of data presentation (as confirmed by the study), and that can be detrimental to a viewer's trust. It isn't that imagery doesn't have a place in the same conversation with data, but there are better ways to go about drawing attention than applying illustrations to data points.

In the data presentation arena, we definitely want data to be memorable, but even more so we want data to be actionable; therefore, valuable data remains the attraction.

Make charts Actionable.

0% Would you say this graphic is more or less plain than the example "plain" chart taken from the research paper earlier in the post? Would you say its more or less actionable? 

A chart is actionable if it answers enough questions of its viewer to instigate a meaningful decision or reaction to information presented. Therefore, charts are only actionable when the right information is presented to the right people with the right visual communication. 

Edward Tufte describes the use of this graphic by the New York Times that accompanied a data dense table along with a news column on the subject. It's a simple point: in order to present meaningful, compelling, or personally motivating information, there either needs to be exactly the right data presented, given the context of the data and person, or enough dimensions and slices of data to be meaningful to a broader range of questions and needs. Supporting textual content always helps to tell the story, which builds the viewers mental model - thereby, making the data more understandable.

Non-embellished charts Pros Cons
No non-data graphics Minimized distractions from data focus, no graphics or imagery suggesting bias, Teachable, fundamental guidelines little visual appeal unless the data density is high (which can feel overwhelming)
Sufficient data-depth emphasis Actionable information Requires more patience or experience from viewer.
Production costs No illustration talent required Research time and resources required, relatively expensive

The problem with embellishments as a primary style for getting the public engaged with data is that it continues to suggest that truly understanding how data impacts their world is beyond common thought or interest. The dimensions are minimal and value statements dominate.

But value statements aren't always bad. Sometimes when you're saying so little with an information-starved chart, its better to come out and say the point you're trying to make with a single data point. Like this beautiful example from goingtorain.com

goingtorain.com

Its Communications 101: say what you're going to say, say it, and say what you said. When the information is somewhat clearly target and not exploratory in nature, this frank approach is often more effective. Embellished charts commonly stand alone with no supporting, meaningful story or conclusion. If the information is valid and valuable enough to be published, there should at least be enough effort to find and integrate a reliable source with more info to answer questions where the chart data left the viewer wondering.

Make charts Both.

When it comes to complicated information, stop treating it as if it can be polished nicely into a single chart and that will be sufficient to create understanding, motivation, and action. Charts make data visible and play off our innate human need to create a mental image of the information story we're presented with. We need both visual attraction / definition and concrete factual data.

Illustration, graphics, and photography trigger emotion and interest in our right brain. They give us a chance to associate ideas and create mental connections to make sense of the world. Our right brain needs "embellishment" thinking to make connections.

Meanwhile, our left brain needs values, raw facts, and the ability to measure worth. Our left brain needs "plain chart" thinking to determine the cause and effect of connections; its interested in thinking about what really matters and impacts things at this moment.

There are few visualizations that even begin to approach the balance between imagery and data.

Example 1. The Tweet Tracker visualization is at least on the right track. One may say here that illustration is used as data points, but I would suggest the technique is appropriate here because the imagery is uniquely matched, within context, as another dimension to its data category.

Winter Olympics Tweet Tracker by Stamen. Winter Olympics Tweet Tracker by Stamen.

Example 2. Embellishments come in diverse forms. You may have seen this presentation Al Gore gave on global warming. Notice what happens at 9:08 in the video as Al continues his commentary while riding a lift on stage up the side of the chart. Do you hear the background laughter? This kind of laughter is good. You know you're audience is engaged. Duarte Design designed an embellished visual here to grab people's attention and make the point memorable - alongside the data chart. This engaging visual device makes the data more memorable because the data is still the center of attention.

Visualization is simply the best language to create meaningful connections between data, thereby making it valuable. All charts are related to visualization, whether its good design or not. The conversation of whether embellishments are good or bad depends on many things, but the real question we should be asking is whether they are making your data more or less valuable. It is a fine thing to attract interest to data, but not when that is a device to overlook the real care needed in preparing sufficient information. Plain charts are fine also, but likely only for quick personal projects in excel where a mental model of the data connections are already well understood.

I'm thankful for Scott's work with his colleagues on this research, and for people like Robert who also promote appreciation for the much needed research in visualization. The theme of graphical embellishment is thrown around so much in the visualization community that it rarely receives careful deliberation, and this paper starts a purposeful conversation. However, there is a long way in working towards conclusive goals.

Other visualization related papers presented at CHI 2010:

  • Useful Junk? The Effects of Visual Embellsihment on Comprehension and Memorability of Charts.
  • ManyNets: An Interface for Multiple Network Analysis and Visualization
  • Individual Models of Color Differentiation to Improve Interpretability of Information Visualization
  • High-Precision Magnification Lenses
  • Crowdsourcing Graphical Perception: Using Mechanical Turk to Assess Visualization Design
  • Integrating Text with Video and 3D Graphics: The Effects of Text Drawing Styles on Text Readability
  • Animated UI Transitions and Perception of Time – a User Study on Animated Effects on a Mobile Screen
This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License. All source code is released under a BSD License unless otherwise specified.

0 comments | Add a comment

Your name

Email (optional, will not be shared)

Type the word "juice" (required to confuse the spammers)

Your comment






The Colbert Bump is Real, Colbert’s Nation Not What He Thinks it is

Stephen Colbert has mentioned that he’s having trouble getting guests during the writer’s stike. We find this puzzling, given the supposed benefits of the Colbert Bump. Does being on the Colbert Show really provide a bump—a critical leap that vaults a writer, or a politician to superstardom?

We know that Colbert isn’t a big fan of “facts,” and only needs his gut to tell him the Colbert Bump is real. At Juice, we let the data decide what’s real or not, so our apologies to Stephen for not taking his word for it. Intrigued, Juice Analytics set out to find out the truth. We gathered data about Amazon sales rank for 20 authors that appeared on his show in recent months. How did those ranks change in the days immediately before and after the authors’ appearance on the show?

Amazon Sales Rank of Colbert Guests

Hmmm, there might be something there but those sales ranks don’t tell us much. Fortunately for Stephen, some “eggheads” have worked out roughly how Amazon sales rank corresponds to actual book sales. We calculated the sales, and normalized the data so that the week prior to appearing on the Colbert Report was equal to 1.0. Here’s a picture.

Projected Sales of Colbert Guests

That looks like a bump, Conan. In fact, being on the Colbert Report increases sales by 10 times on average. That bump doesn't last forever, but, let's face it, what does?

We also wanted to know, what kinds of books are Colbert’s audience going crazy for? After all, Colbert is well known as a rock-solid conservative. He’s tight with the Bush Administration. Even though he debates a few liberal (“pinko”) authors now and then, most of his guests are writers of pop-intellectual studies of the Gladwellian persuasion.

Here are the authors and how we categorized them:

Pinkos: Jessica Valenti, Full Frontal Feminism: A Young Woman’s Guide to Why Feminism Matters, Wesley K. Clark, A Time to Lead: For Duty, Honor and Country, Robert Shrum, No Excuses: Concessions of a Serial Campaigner

‘Publicans: Tom DeLay, No Retreat, No Surrender: One American’s Fight

Pop Essayists: Daniel Gilbert, Stumbling on Happiness, Daniel B. Smith, Muses, Madmen, and Prophets: Rethinking the History, Science, and Meaning of Auditory Hallucination, Michael Gershon, The Second Brain: A Groundbreaking New Understanding of Nervous Disorders of the Stomach and Intestine, John J. Mearsheimer, The Israel Lobby and U.S. Foreign Policy, Thomas L. Friedman, The World Is Flat: A Brief History of the Twenty-first Century, Frank J. Sulloway, Born to Rebel: Birth Order, Family Dynamics, and Creative Lives, Jared Diamond, Guns, Germs, and Steel: The Fates of Human Societies, Nassim Nicholas Taleb, The Black Swan: The Impact of the Highly Improbable, Richard Preston, The Wild Trees: A Story of Passion and Daring, Malcolm Gladwell, Blink: The Power of Thinking Without Thinking, Bjorn Lomberg, Cool It: The Skeptical Environmentalist’s Guide to Global Warming, Andrew Keen, The Cult of the Amateur: How Today’s Internet is Killing Our Culture, Michael Wallis, The Lincoln Highway: Coast to Coast from Times Square to the Golden Gate

Popular: Stephen Colbert, I Am America (And So Can You!), John Grisham, Playing For Pizza: A Novel, Tina Brown, The Diana Chronicles

How much of a bump did each of these groups receive?

Colbert Bump by Category of Guests

It’s a shock! Liberals and high-minded eggheads do better than popular or conservative books. I’m not sure if Colbert knows this, but his audience isn’t who he thinks they are.

Here are all the authors and their normalized sales around the time of their appearance on the Colbert Report.

Valenti Clark Shrum DeLay Gilbert Smith Gershon Mearsheimer Friedman Sulloway Diamond Taleb Preston Gladwell Lomberg Keen Wallis Colbert Grisham Brown

This post was a collaborative effort of the entire Juice team. Pete Skomoroch concocted the idea, wrote copy, and found the study linking Amazon Sales Rank to actual sales. Zach data mined. David May whipped up elegant, instant visualizations. Sal Uryasev munged data.

This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License. All source code is released under a BSD License unless otherwise specified.

28 comments | Show all comments only the last 5 are shown


April 28, 2008
mike said:

oops already mentioned, perhaps the suggestion of a control group would be best, comparing a media blitz without Colbert Report to those that appear on the show. it would be difficult to separate out the other factors though, like maybe someone that chooses to go on the CR is also more effective in their other promotions. possibly if there were enough data points, then other effects would be insignificant?? ;)
or maybe find someone that ONLY goes on the Colbert Report, a clean sample sort of :D


May 30, 2008
Aaron Deyfer said:

great article!
one question: how did you manage to get the historical sales rank data? Did you gather the data "manually" using AWS over time or do you use another service?


March 4, 2009
Pete Skomoroch said:

Aaron,

I described the data gathering process in a post at the Data Wrangling blog: http://www.datawrangling.com/the-colbert-bump-in-amazon-data I used a python script and http://www.titlez.com/welcome.aspx

-Pete


March 12, 2009
John said:

Seems very truthy


August 22, 2009
kw said:

colbert's audience are those who are liberal minded, and a lot of college/uni students... I believe it's quite similar to the left leaning crowd who watches jon stewart's "the daily show." colbert is very much aware of this, hence his choosing of guests that not only please the audience (even notice how often the studio audience cheers the guest) but allow his conservative pundit character (the conservative colbert is only a tv persona) to verbally spar with the guests. if the guests know to play along, the results are usually comical... if they aren't aware of colbert's character, sometimes the interviews just turn awkward.

Your name

Email (optional, will not be shared)

Type the word "juice" (required to confuse the spammers)

Your comment


Add a comment





Measure the Internet, Map the Internet

One area we’ve been paying particular attention to recently has been the internet traffic for different web site categories. Our friends over at comScore Inc. collect a wealth of information for “measurement of the myriad ways in which the Internet is used and the wide variety of activities that are occurring online.” Nice alliteration, guys.

Using some of the data they’ve allowed us to share with you, we had the bright idea to stuff it into our most favoritest charting type, the treemap. And what’s better than a chart? Answer: an interactive chart with a toggle button.

You’ll need to know a few things to really Juice the data:

  • The map is based on unique visitors by site for August 2007 and November 2007.
  • Red means a decrease in unique visitors over that three month time period and green means an increase. Black means there is no change.
  • You can click on the category headers to zoom into each category. Click on the category header again to zoom back out.
  • We provide two views of the data: the default shows just the top ten sites in each category. However, for nearly all categories, sites outside the top 10 account for over 50% of the visitation in the category (the exceptions were Search, Portals, and Auctions where the top players dominate traffic). A checkbox adds “All Others” and gives you a better sense of the size of each category. You can toggle these two views using the checkbox just below the map.
  • Due to some confidentiality restrictions that we’re under regarding the raw data, we couldn’t show other metrics that would really make this visualization sing—but I bet if you contacted comScore, they’d be glad to discuss with you.
  • A few tech notes. The treemap is adapted from Josh Tynjala’s capable open-source Flex Treemap component. Site images are provided by Amazon.com’s Alexa site thumbnail service.

So, without further ado, take a gander at our latest liberated data:

http://internetmap.juiceanalytics.com/

There’s so much information here, you won’t have any trouble drawing your own conclusions, but here are a few conversation starters:

  • Notice that there was a distinct increase in retail web visitors leading up to the holiday seasons.
  • Surprise! eBay owns auctions
  • Not too good of a showing for those online gambling sites; travel either.
  • Sports traffic is up… but not for the MLB.com site. Oh yeah, baseball season is over.

Enjoy.

Disclosure: comScore is a client of Juice Inc.

This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License. All source code is released under a BSD License unless otherwise specified.

9 comments | Show all comments only the last 5 are shown


January 28, 2008
Friedbeef said:

Hi - does the app work in Firefox? Because I'm having problems loading it up with the FF and Flock browser. Works OK on IE7 tho....


January 29, 2008
derek said:

What's the history of the use of black in treemaps? It seems to run counter to the normal tendency for info visualisation to have white as the background.


January 30, 2008
Brian Timoney said:

Very interesting use of Flex components; quite sticky indeed.

I guess it's cold comfort to the newly laid off, but I was struck how prevalent Yahoo was across a number of different categories...

Brian


January 31, 2008
Fubiz said:

Excelent title!


February 12, 2008
Fin said:

Interesting google doesn't come up in the portal rankings. I use my google homepage about 60 times a day. It is as much a portal as Windows live.

Your name

Email (optional, will not be shared)

Type the word "juice" (required to confuse the spammers)

Your comment


Add a comment





Analytics Roundup: Square Pie of Death

NY Times: % of Americans who believe that after death...
Astonishingly awful square pie from the NYT, who are normally infographic innovators.

raganwald: Beware of the Turing Tar-Pit
Know the difference between general and specific in building tools.

This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License. All source code is released under a BSD License unless otherwise specified.

0 comments | Add a comment

Your name

Email (optional, will not be shared)

Type the word "juice" (required to confuse the spammers)

Your comment






Squaring the Pie Solutions Screencast

This work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License. All source code is released under a BSD License unless otherwise specified.

1 comment


November 17, 2007
Brett said:

Is there a reason that the navigation to the next and previous posts etc has not been included on this page. It makes this page a bit of a dead end and having to navigate around it seems a bit clumsy. Really great site guys!!

Your name

Email (optional, will not be shared)

Type the word "juice" (required to confuse the spammers)

Your comment


Add a comment