Your data is meant for action.
The Juice Analytics team will be in Nashville July 9 – 11, 2012 and while we can’t carry a tune, we’ll have with us an interactive demo of our hosted reporting platform to share. Of course, we’ll also share the latest around dashboard and interface design, as well as data visualization, in general, along with other stuff that interests you.
Reach out if you’d like to meet up while we’re in town.
(P.S. If other cities have pent up demand for Juice, reach out and we’ll consider a visit.)
Cheers!
Is the Score or the Rainbow More Memorable?
A cool afternoon rain was the only thing damper than the spirits of the 12-year-olds who shuffled off the field. With the score still lit up on the wooden scoreboard, the coaches yelled to the boys as they struggled to lift their heads so they might catch a glimpse of a rainbow as it rose from the fence in front of them.
The players of both the winning and losing teams stood there on the wet, steamy grass, frozen in place, in awe of the sight of a rainbow that mystically appeared as if painted on the sky just for them to see. For them, it was an atta boy, pat on the back, a perfect way to wrap up a hard fought double header in which the score had not quite represented the effort that the losing team had given, where the stats failed to tell the tale that brought these two teams together on the hallowed Cooperstown soil.
That’s the thing about numbers. When left to their own devices, they can feel as cold as digits on a lonely scoreboard. They say nothing of the teams who trained for months, played together game after game, relinquished their Saturdays and played nearly perfect seasons just to get to the tournament.
Numbers alone tell us nothing of context. When we have something particularly meaningful to say, images help us share it best. Dashboards and data visualizations bring to life presentations in which we can engage in two-way conversations with our audience making the story around our data more memorable, impactful and effective than any spreadsheet or table of numbers we can put in front of them.
What will your audience remember? The numbers, the final score? Share visually, and they will remember the rainbow and the sunshine that most certainly will follow.
Special thanks to Peter Bielan, my significant other, for inspiring this blog by sharing this photo that he shot during his son’s baseball team pilgrimage to Cooperstown, NY this week.
I grew up in a bilingual household where we spoke French and English. Many of us who’ve been exposed to other languages realize that there are some words that just don’t translate well into English.
One of the words that got used often in our family was the French word gourmand. Its closest translation in English is gluttony, but how often does anybody ever say that word? Probably the simplest way to think of it is the antithesis of gourmet, or even better, someone who prefers quantity over quality.
While there can sometimes be a negative connotation with the phrase, “Il est gourmand,” (“He is gourmand”), it can also be just a recognition of someone’s preferences.
To this day, even though my French has gotten pretty bad, I still occasionally refer to people as gourmet or gourmand. It could be when I’m sitting in a restaurant, standing behind them in line at Costco or even hearing about their current data initiative.
Just like a food gourmet, a data gourmet is someone interested in something distinctive, visually appealing and inspired by results or action taken. It isn’t about hordes of numbers or metrics. It’s about getting the right metrics in place, putting them in the right context and letting them stand out.
Think of the chef who prepares the meal like the one in the picture. He or she not only wants to stimulate your taste buds, but also hopes that their use of color, plating and white space will appeal to you and your visual senses, as well.
So, as I alluded to earlier, not everyone is a gourmet. Many people value quantity over quality. As it relates to data, someone who is a gourmand is probably unsure of what they really want to do with all the data they are requesting. They figure it best to get as much as they can while they can, especially if they aren’t sure what they will do with it.
Unfortunately, they probably have never been exposed to a really useful dashboard or visualization. Ultimately, what they think will satiate them and potentially their users is as much data as possible. However, the volume of data would net a number of metrics, charts and gauges, etc. that would be more than they could ever consume.
When you find yourself in a situation where you are working with a data gourmand (and you will – it’s just a matter of time), don’t look down your well-trained visualization palate at them. Instead, gently guide them along a path of visual-epicurean transformation.
Most likely, they’re going to want to load up their dashboard plate with every bit of data junk they can find. Start by getting them to see their dashboard as a blank palette to meet specific goals vs. an empty pallet to load up everything they don’t need.
As they select different metrics, invest the extra time to train them to carefully select just the right information that provides the balance their data diet needs for a healthy body. As they make their selections, help them to see that it’s okay to have favorite metrics. As Amanda Cox of the New York Times says, “Data isn’t like your kids. You don’t have to pretend to love them equally.”
Finally, if you need some help, refresh your skills with the Juice white paper, “A Guide to Creating Dashboards People Love to Use“.
Once you’ve finished, ask yourself these questions. Does everything in front of your gourmand now have a reason to be there? Did they pause in appreciation or comment that they can’t wait to use it? If so, you may be well on your way to executive data-chef status.
Have a data gourmand/gourmet story of your own? We’d love to hear about it in the comments below.
Choosing the right chart for data presentation isn’t easy — even if you do it for a living. For those with less practice, it may resembles the flash of confusion I experience when my wife asks “Which of these outfits looks best on me?”
“…uhhhhhhh, both?”
And like that answer, there isn’t any safety in sitting on the fence.
Wouldn’t it be nice if there was a formula for choosing the right chart? The fact that there isn’t suggests it is a mix of art and science. There are plenty of examples of people who have taken a crack at this problem:
(If you know of any others, put them in the comments and I’ll add to this list.)
While these are all great resources, I thought it could be instructive to walk through a sample chart selection process, starting simple then gradually adding more complex requirements. The focus of this post is on ’wireframing’ the correct presentation techniques; in a follow-up we’ll replicate these same charts noting best practices with refined aesthetics and layout.
I typically ask four questions in choosing how to present data:
1. What data is important to show? Specifically, which dimensions and metrics need to be shown at the same time.
2. What do I want to emphasize in the data? For example, do I want to compare different values, show relationships, or present changes over time? What story am I trying to tell?
3. What options do I have for displaying this data? Your Excel chart menu is a start, but don’t forget options such as tables, sparklines, small multiples, and advanced visualizations like treemaps. Many Eyes’ list of visualizations can spark additional ideas.
4. Which option is most effective at communicating the data? Which chart or visualization emphasizes what’s important in the most direct and readable way?
Imagine a sales organization where two metrics matter most: activity (as measured by call volume) and sales (as measured by dollars sold). The simplest place to start with this data is to present aggregate performance for those two measures. Even with this most basic situation, you have a few options:
Conclusion:Data doesn’t always need visualizing. The common and dreadful example of this mistake is when people use a speedometer-style gauge to show a single number (option 3). It is a lot of work, pixels, and distraction for no user value. In this example, we have just a single data point for each measure and no comparisons (e.g. to goals, to last year’s performance, the values against each other), so it’s best to keep things clean with option 1.
Next, let’s look at options for showing activity and sales data by product. In this case, the emphasis should be on the relative performance of each product.
Conclusion: Option 1 is the winner. We prefer a vertical layout of labels (bar chart) to a horizontal (i.e. column chart – not shown) because the labels are more readable and the horizontal layout can suggests a time element in the graph. As has been thoroughly documented, a pie chart doesn’t allow you to see differences in values as effectively as a bar chart.
What if we wanted to understand these two metrics by time?
Time needs to be displayed horizontally. We’ve seen ambitious examples from Trend.ly and Axiis that attempt to break this mold, but they more often confuse than enlighten.
Conclusion:I’ve backed away from using dual axis charts after experiencing too many situations where people are confused by which line goes with which axis, no matter how clearly labeled. Because the emphasis for the data needs to be the trend over time, I would recommend option 2 over option 3’s sparklines.
Now it gets interesting: What if we wanted to understand these two metrics by product and by time?
Conclusion: The best option for this case depends on the importance of clearly communicating the detailed trend for each product. In most cases, the “essence” of the trend is good enough, i.e. Is the trend up? Down? Erratic? Smooth? Under that assumption, option 3 provides a nice comparison of the relative product performance and trend.
I’ve developed a bit of a penchant (obsession?) for decomposing the pieces of analytical applications and framing the good and the bad characteristics. So far I’ve taken on treemaps, real-time dashboards, alerts, composite measures, success metrics.
Next up the poor, neglected, and taken-for-granted filter. For such a common and essential component, it seems rare that designers take a moment to consider how to make the best possible filtering mechanism. Here are the five elements I consider critical to a good filter selector along with examples from exemplary interface designs.
Good filters make it obvious to users what has been selected. That might seem like an obvious necessity but consider what happens when you filter in an Excel list. The filter section, even if it is a single item, is immediately hidden from view.
Jonathan Harris’ frequently referenced We Feel Fine visualization offers one of my favorite filtering examples. Notice how the selected items are highlighted and the non-selected items are de-emphasized. The bar at the top clearly shows what has been selected, even after the filter selector is “put away.”
The best filtering mechanisms also give instant feedback about the impact of your filters. This can be as simple as a subtle indicator that the filters are being applied. Even better, as demonstrated in the The New York Times’ Rent or Buy site, the graph animates in real-time as filters are applied. This creates a very tangible connection that helps the user understand the impact of the filtering choices.
Filters should provide information around the items being selected. What does it look like? How many are there? Take the simple font selector in Office applications: Isn’t it a no brainer that the names of the options are shown in the actual typeface? Here are a couple other fine examples of context:
Click shirt is Bret Victor’s brilliant t-shirt design interface. In it, he offers an elegant filter implementation where all the selections show images of what you are about to select.
Elastic lists is one of the most innovative approaches to filtering. The height of individual blocks in the selectable stack shows the frequency of the items, an embedded sparkline shows the trend, and brightness indicates “weight of the metadata value compared to the overall distribution” (a bit too ambitious/confusing, in my view).
Given the importance of filters to most information applications, it is surprising how often the interface makes them hard to find. As I mentioned in an earlier post, the failure of many analytical and reporting applications is that “they assume users know precisely what they need before they’ve begun the analysis.” Filtering shouldn’t be a one shot deal; the functionality should always be accessible.
Kayak, a travel site, integrated the selection filters into the results so users can easily change their trip criteria without having to start a new search.
Finally, filters should make it easy to apply common selections (All, None) or complex sets (My Saved Filters, Northwest Region).
Moodstream by Getty Images recognizes that users aren’t always going to want to configure a bunch of filters individually. The presets wheel solves this problem by offering a series of pre-defined “filter sets.”
Finally, I’d be remiss if I didn’t mention the sophisticated and powerful filtering functionality delivered in Tableau. In addition to providing filtering by selecting graphs (i.e. in context filtering), the application allows for multiple selector types, wild-carding, conditional filters, top/bottom filters, and on and on. If you want a comprehensive catalog of potential ways to offer filtering, watch the Filter Data video here.
Many analytical applications fail for a simple reason: they assume users know precisely what they need before they’ve begun the analysis. There are cases where this assumption holds and the user has a specific end-point in mind. But more often, users depend on the tool to track down an answer with only a vague idea of where to start. The exploratory analysis that follows can feel like swimming upstream when the application isn’t designed to facilitate the journey.
The source of this mismatch is partly rooted in the technical perspective of database developers. The simplest path to providing data access is to let users fill out a form to define a SQL query. It is a linear mindset that isn’t well-suited to ambiguous problems.
I’d like to offer a couple examples that illustrates the difference between the common, form-based approach and a more dynamic, interactive approach. Then I’ll explain the implicit assumptions behind the different models and why it matters.
At its heart, Travelocity is a travel analysis tool intended to help you find the best flight (or hotel, car rental, package, etc.) given a complex set of parameters. The relative importance of each of these parameters (departure day/time, return day/time, airports, connections, preferred airlines, price, etc.) is a personal preference… but not one that is explicitly or fully known even to the user. For example, it would be hard for me to say exactly how much more I would pay for a non-stop flight or what is the relative value of a more convenient airport versus a more reliable airline. These preferences are hard to understand prior to seeing specific trade-offs.
Travelocity approaches this complex problem in the way that so many analytical problems do: it asks for all your preferences first then offers a static list results for the specified query.
A few things to note about this search results page:
I’ve been a loyal Travelocity user for years, and I don’t want to imply that this site is poorly designed or difficult to use. The problem is more subtle than that.
By way of comparison, let’s take a look at a more recent entrant to the online travel business, Kayak. This site is designed with a different usage model in mind. Kayak starts by asking for the same information as Travelocity, but the results pages is designed to support further analysis:
The biggest difference is the prominent filtering functionality on the left side of the page. The filters allow users to narrow down their original search without leaving the results page (it takes less than a second to view refreshed results after changing a filter—no “run report” button required). In addition, Kayak places more emphasis on the start-over option. The designers of this site did not assume your first search would be enough to get you to the perfect flight option. Finally, notice the different “views” of the data that are available for a given result set. The views help support different types of decisions based on the same search parameters.
Analytical applications for business have similar underlying structures and usage models. The analysis process in Omniture SiteCatalyst, the leading web analytics platform for large sites, offers a typical example:
This application offers lots of functionality, and it feels like featuring functionality is the primary purpose of the start page. If you want to get to useful data rather than view an advertisement for Omniture products and events, you can start by selecting the “Report Builder:”
Now, it is form-filling time. Like Travelocity, the user is expected to choose the precise parameters before they get to see anything. The resulting report requires a 10 second wait, and the result is static. Any additional filtering will require you to run a new report
Now let’s look at how Google Analytics chooses to structure the user experience:
In contrast to SiteCatalyst, Google Analytics shows you results immediately—no defining or configuring a report before you can get started. Similar to Kayak, the application offers a bunch of options on the report results page to refine parameters (e.g. data ranges, metrics, comparisons).
Travelocity and Omniture make a few assumptions common to analytical applications:
More effective analytical applications like Kayak and Google Analytics make different assumptions:
0.1 second is about the limit for having the user feel that the system is reacting instantaneously, meaning that no special feedback is necessary except to display the result.
1.0 second is about the limit for the user’s flow of thought to stay uninterrupted, even though the user will notice the delay. Normally, no special feedback is necessary during delays of more than 0.1 but less than 1.0 second, but the user does lose the feeling of operating directly on the data.
10 seconds is about the limit for keeping the user’s attention focused on the dialogue. For longer delays, users will want to perform other tasks while waiting for the computer to finish, so they should be given feedback indicating when the computer expects to be done. Feedback during the delay is especially important if the response time is likely to be highly variable, since users will then not know what to expect.
In my experience, making the right assumptions about user behavior makes all the difference between an application people enjoy and depend on and an application people dread using.
Organizations have a personality, and it bleeds into everything from executive reporting to product offerings. A recent Fortune article entitled Microsoft without Gates offers this wonderful tidbit about Steve Ballmer, CEO of Microsoft:
Even though he never was a serious computer programmer, by all accounts Ballmer is just as good at math as Gates is. He lives and breathes data. “Steve has a computer in his head,” says Bob Muglia, a 20-year company man who heads the Server and Tools division. Ballmer expects his subordinates to be adept in math as well. He distributes 11-by-17 sheets filled with numbers detailing the progress of various operations. The numerals are so small that executives use transparent magnifier rulers to see them. But there are never any columns showing percentage changes. Ballmer believes people ought to do that in their heads. It saves space on the paper for more numbers.
Wow. If it is as bad as the author describes, Ballmer has designed the anti-dashboard.
The Presentation Zen blog offers another great example of organization culture as displayed in business artifacts:
Gates here explaining the Live strategy. A lot of images and a lot of text…Good graphic design guides the viewer and has a clear hierarchy or order so that she knows where to look first, second, and so on. What is the communication priority of this visual? It must be the circle of clip art, but that does not help me much.
Does it get more “Zen” than this? “Visual-Zen Master,” Steve Jobs, allows the screen to fade completely empty at appropriate, short moments while he tells his story.
A couple months ago, we put together a Greasemonkey tool that sucked data out of Google Analytics, and after mining it for trend information, integrated it back into the GA interface. This week’s tool combines and extends Google Analytics with data from an outside source.
Here is a quick alpha of our Greasemonkey integration of external data reporting into Google Analytics for Kampyle, a “feedback analytics service.” Click on the images to zoom in.
Clicking on the ’Kampylize’ tab queries the Kampyle site in real-time to populate the standard GA data table.
Our friends at Kampyle run a service that allows website owners to put a feedback button on individual pages of their website. All information submitted by the user is uploaded to a central Kampyle database that compiles the user feedback with web page url and standard internet statistics such as the name of the browser. Website owners can access a server-end service that consists of a reporting site complete with summary data tables, graphs, and charts.
Since both sites are web-based reporting suites segmented in a similar fashion (individual website, date, web browser, etc.), they integrate together naturally. There is a lot of value in placing related data side by side, allowing users to get a more holistic picture of web site performance. If you have other ideas of data sources that would fit neatly with Google Analytics, let us know and we’ll consider building the integration.
If you’re interested in technical details, continue to Open Juice to see how this is all accomplished…
The tendency with reporting, and information dashboard design in particular, is to cram as much information on the page as possible. It is a problem that Avinash describes with typical candor:
“This one of the core reasons why most dashboards are ’crappy’, i.e. they are data pukes that provide little in terms of context and even less in terms of actionable value.”
In the past, we have offered tools to make data presentation as clear as possible (chart chooser, Excel chart cleaner). Sometimes clean isn’t enough; a more dramatic approach is needed.
One alternative is to shift the focus from the full data to changes in the most critical data points. By pulling out the important exceptions, you can make it easier for your audience to digest what matters and take action.
Stephen Few says in his book Information Dashboard Design:
“The best way to condense a broad spectrum of information to fit onto a dashboard is in the form of summaries and exceptions…given the purpose of a dashboard to help people monitor what’s going on, much of the information it presents is necessary only when something unusual is happening; something that falls outside the realm of normality, into the realm of problems and opportunities. Why make someone wade through hundreds of values when only one or two require attention? We call these critical values exceptions.”
Alerts are one mechanism to turn the focus to the exceptions, outliers and data highlights. Whether embedded in the dashboard or presented separately, alerts can be the extra layer of abstraction that make a dashboard useful. Unfortunately, they are hard to get right. I’ve arrived at four C’s for effective alerts—context, cogency, communication, control. Here’s a checklist to consider as you build alerts into a dashboard or report:
(It appears that a 5% increase in brand attribute performance isn’t good enough to get you out of the yellow.)
Here’s a little predictive analytics:
About a year ago, I took a swipe at the “$80 million supercomputer to analyze NYC student achievement.” It smelled more like a super sales job than a super useful analytical tool.
At the time I had said:
Teachers are underpaid, hardly appreciated, and overworked. I can only wonder what the half-life is of a system that asks teachers to log on to get information delivered by the “chief accountability officer.”
Well, it appears that things haven’t gone that smoothly with the supercomputer. Today, I received a link from Leonie Haimson, a NYC education advocate, to a story entitled SCHOOLS COMPUTER AN $80M ‘DISASTER’.
Not only has the supercomputer struggled to gain much traction with users (“The school system’s new $80 million computer super system to track student performance has been a super debacle, teachers and principals say”), it has coincided with severe budget cuts.
We see these data warehousing problems all the time with our clients, and the NYC supercomputer displays all the hallmarks:
It does offer one thing that I haven’t seen before: a Chief Accountability Officer.
We're in the process of preparing just that. Email us if you'd like to be included in the early access video at info [at] juiceanalytics.com ...
Missed both of these. Will they be available to review after the fact? ...
Amitp, That's a great point. It makes it clear that visualization is a toolkit that has to be properly applied by a data storytelling practitioner. Which raises the question: What other tools should a ...
This is werid there is not 100 ideas on here ..... LAME!! ...
Listening to Hans Rosling talk vs using his gapminder tools to explore the data is a great example showing how important the storytelling is compared to the visualization alone. ...
Show comments