Designing a Better 'Federal IT Dashboard'
By Zach Gemignani
July 29, 2010
Find more about:
dashboard
We were thrilled when we first found out that the Federal IT Dashboard had incorporated our JuiceKit treemap. A year later, the dashboard has been relaunched:
U.S. CIO Vivek Kundra relaunched a IT Dashboard today, and, well, the thing almost makes navigating federal tech spending data fun. Kundra told Politico's Morning Tech that the inspiration for the redesign are online tools people might use to navigate their stock portfolios. The new dashboard offers up more data on spending on more than 7,000 federal IT projects
The first time around, it was awesome to see transparency and visualization brought to the federal government. This time, some of the excitement has worn off and we're going to use it as a case study for "opportunities" to design a better dashboard. There are five areas where it can be significantly improved:
- Message
- Flow
- Charts
- Context
- Design fundamentals
(Not coincidentally, these are the types of areas we cover in our Viva Visualization Tour. Next up, Boston August 25th.)
Part 1: Message
The information designer is responsible for presenting the data in a way that the message is delivered in a clear and understandable way. If the data is left to speak for itself, users can be left confused or frustrated. And in all likelihood they won't to see the full value of the data. That's particularly tough for this Federal IT Dashboard where a huge amount of effort has been put into gathering consistent data across agencies.
The goal of this dashboard is clearly stated on the landing page:
“The purpose of the Dashboard is to provide information on the effectiveness of government IT programs and to support decisions regarding the investment and management of resources.”
They want to answer a couple fundamental questions: Where is money being spent on IT projects? How effective are those projects being managed? Unfortunately the data isn't presented in a way that novice users can quickly answer those questions. Instead the dashboard raises more questions than it answers. For example:

A giant chunk of overall spending goes to the Department of Defense. But how big are these numbers? How are they changing?

Pie charts show that something is mostly green--but not entirely. What does this represent? How should I feel about mostly-green performance?

The three ratings lines are converging around 7.5. What are these numbers and what is driving the trends?
We took the liberty of sketching up a revised dashboard that would more effectively talk to the message of IT program cost and performance. Our dashboard has two primary views, spending and performance.
IT Spending. Where is the money going? Here we have highlighted the top spending agencies and those that are seeing the greatest increases in spending. The line chart on the right shows the trend in spending for any selected Agency. In this way, a user can click on items that they are interested in and immediately see what has happened over time. Labeling also matters. We included titles that would be easy for the first-time user to understand.

Performance. How effectively are the projects being delivered? In this view, we have included something we call a "Spike Chart"; it is a specialized version of a Parallel Coordinates Chart. The Spike Chart allows you to track the performance of the same entities (i.e. Agencies) across multiple performance criteria. The chart will quickly reveal which Agencies bubble to the top (or the bottom) and how they perform across different evaluation criteria.

Within each view, we would let people see the data either by Agency or Investment. In both cases, the resulting visuals are focused on showing which entities are spending/performing the best/worst--and how are the values changing.
There is a ton more functionality embedded in the Kundra's IT Dashboard, but we'd argue for hiding that away until the user has understood the most important and/or interesting information. Then they can drill down into the specifics of a project or organization.
If you're interested in learning more about how to design better dashboards, check out our white paper Designing Dashboards People Love to Use.
30 Great Visualization Resources in 30 Days
By Ken Hilburn
July 6, 2010
Find more about:
visualization,
tufte,
tools,
charts,
infoviz
A lot of the applications that Juice creates are designed to make information more accessible to people who wouldn't consider themselves to be data experts. They realize the value in the data that they have, and in many cases they have some sort of analytics solution in place, but they know they're not getting as much value from their data as they should.
One of the hurdles we frequently come up against is that people who aren't actively participating in the visualization discussion don't know what's possible. All they've ever seen, in many cases, are the confusing dashboards, charts, and graphs that are all too prevalent from the vendors in our space. You know the ones: a thick layer of technology slathered with some gloss and wiggle, between two slices of "do it yourself".
In many cases, we find ourselves closing this gap by referring to some of the best examples of work out there. As we were thinking about this, the idea to provide a simple walk through of these examples came into being. The result: a 30 day calendar chocked full of some of the best samples of skills enhancing examples we could find.

Each day is a bite sized chunk and takes only a few minutes to watch, read, do, or play. Some of the days are comprised of Juice content, but most days are from other sources that we've found useful.
You can download it to use yourself, or to share with your friends who need to expand their info-viz horizons. Either way, we think it'll get your creative juices flowing.
7 comments | Show all comments only the last 5 are shown
oli said:
I'd love to learn more on this subject but I am having trouble. None of the URLs work. Is it just me?
Thx
Oli
Jack Lucky said:
Thanks for making this lesson. lvu it.
Week 1 day 4: is paid content (can you please have a look in to it)
Ken said:
@Jack Lucky: Bummer. This is new... and annoying. You can (as I'm sure you've already considered) register for a free 14 day trial to see the article (no credit card required), but I can certainly understand the hesitation to do so.
To help you better decide if it's worth enduring the registration process, here is a summary of the article:
It starts with a discussion of factors driving Martin Wattenburg's 1998 creation of the treemap (one of our favorite visualizations - in Zach's mind, there's a treemap hidden in _every_ data set... somewhere). It then continues on by discussing other advanced visualizations such as presidential word clouds, Wikipedia change timelines (the only image shown), and infographics. It concludes with a discussion of how the brain is better at processing visual information.
It's a who's who list of information visualizations ground breakers such as Wattenburg, Viegas, Tufte, NYT, and Tableau. It's one report in a nine report series including "Data, data everywhere", "Needle in a haystack", and "Handling the cornucopia." Keep in mind however, that it shows only one image of the many examples that it discussions - sort of ironic, huh?
We apologize for the required registration reference, but hopefully this will help.
Chris said:
Thanks for putting this together, nicely done. Just curious, do you have any other examples of guides that use a similar format? I posted the link and wrote a couple of paragraphs about it on my blog at http://freshspectrum.com
paresh said:
Apart from spreading this to people who are already initiated into the world of data visualization, guys reading the data visualization blogs, we should also spread it to others who may only be peripherally aware of this field. Doing my bit - spreading it among finance and accounting professionals [Linkedin Group].
Ken said:
@Paresh - Yes! Thanks for helping others "see."
Nemo said:
Thanks, but why are you giving URLs in a PDF document and not a simple web page ? (pdf viewers are not web browsers, and your links in Acrobat reader on my Mac are not clikables !).
Add a comment
Come Have Breakfast with Juice on July 15th
By Ken Hilburn
July 1, 2010
Find more about:
juice
Listen up, all you Juice fans who live in Atlanta. We've finally nailed down all the details for the get together we announced a few weeks ago. We're calling it the Viva Visualization Tour.
What you'll have when you leave:
- visualization best practices training around information layout and workflow, information visualization, chart selection, and styling
- networking within the Atlanta visualization community
- a full breakfast buffet like only Magianno's can put on
- opportunity to pick the Juice collective for tidbits of vizo-knowledge
- a few pieces of custom designed Juice schwag
What Juice gets out of this:
- socializing with the people in our virtual and physical community who love making visual sense of data
- opportunity to talk about the stuff we're excited about with people who are actually willing to listen (besides our moms)
- a big ol' food bill
- the joy of seeing some of the most respected members of the Atlanta visualization community all in one room
So, if this sounds like great fun to you (and who wouldn't think so), register. We do have limited space, so don't wait.
And, for those of you who aren't in the Atlanta area, we're also planning an August meeting in D.C. and a September meeting in Boston, so keep your eyes open for those (as well as other potential cities).
7 comments | Show all comments only the last 5 are shown
Jeff said:
Hope you can make it to Vegas, there are a lot of Juice fans here and I'll bet you guys wouldn't mind the locale :)
Elizabeth said:
Hope you all are coming through NYC!
Martin said:
Hey, how about coming over to London? : )
plethaurus said:
And Melbourne!
ilya said:
do you have any events or experts in New York? On separate note, Juice insights are often brilliant and I'd like to speak to one of your experts in-person.
Ken said:
Wow guys, so many locations, so little time. We're flattered.
@Jeff: if you have a specific group of people in mind who would be interested in getting together, we're always interested in chatting. We recently did this session as a private event for a client who was able to pull together about 50 people (although, we'd do it for less). Drop us a note at info at juiceanalytics dot com if you think you have a seed group.
@ilya: email us at info at juiceanalytics dot com and we'll touch base about your question.
@Elizabeth: unfortunately, NYC isn't on the list for 2010. However, we do have a number of fans there and are making plans for 2011. Stay tuned.
@Martin & @plethaurus: Hmm... London is a long way and Melbourne is even farther. However, you might be surprised at what the promise of a pint will get you ;-)
Tony said:
This was an awesome event this morning. Thanks for running it!
Add a comment
Measures and Averages and Indexes, Oh My!
By Ken Hilburn
June 25, 2010
Find more about:

Ah... Summer in Atlanta. Sunshine, green trees, Peachtree Road Race... and pollution. I love living in Atlanta, I really do, but one thing that most non-Atlantans don't know is that we have a real problem with poor air quality. As someone who really enjoys biking, hiking, and running, I pay a lot of attention to the Georgia Department of Natural Resources Air Quality Index. So far this year we've had a handful of "orange" days, but no "red" or "purple" ones - which sounds anticlimactic, but is a real improvement over a few years ago (we haven't registered a "code purple" day since 2002).
Anyway, as I was checking the air quality forecast this week, it occurred to me that the green/yellow/orange/red/purple/maroon categorization is based on an index. This started some thinking about measures, averages and indexes.
If you've never thought much about indexes, they are calculated by dividing the measured value by a base or expected value and then (usually) multiplying by 100. The result is that the target value is "100".
The great thing about indexes is... they are super easy for casual users to interpret. This is the case because they remove the dependency on the user to understand and keep absolute values in their head. In the case of the Air Quality Index, it's based on the national air quality standard for the pollutant measured. Since air quality in Georgia is primarily composed of 7 measures, it can get pretty confusing if you want to know what's going on. To demonstrate, here's a table of the national air quality standards that the Georgia Department of Natural Resources monitors:

Get the point? As an environmental layperson, it's much easier for me to interpret current measurements if they are expressed with respect to the national index (100) as opposed to ppb, ug/m^3, etc. Most people don't have a clue (nor do they care) about what a mg/m^3 or a ppb is, but they do care about their respiratory health. So, providing a common, simplified measure makes complex data oh so much more accessible to the populous. This is the power of indexes over absolute measures and average values. In Atlanta the use of indexes has unified nearly every Atlantan's practical understanding of air quality.
What it means for you
So, when it comes to creating information applications and dashboards, if you're presenting complex values, consider using indexes to reduce the barriers to entry for non-domain-expert users. Here are a few tips to keep in mind:
- Just as with any new metric, it needs to follow certain guidelines for good metrics.
- Get buy-in with your user group so they don't feel like you're pushing yet another meaningless value down their throat.
- Don't fall into the temptation to swap indexes with historical average values. Averages represent historical measures; indexes represent performance compared to a group.
Oh yeah, lest I forget, there's always a tradeoff. As with most things, when you simplify, you lose some resolution. The draw back is that for those who want to delve deeper into the meaning of the measure, they now have to do some researching (just as I did) to understand how the actual metrics are measured and how the index is calculated. Take this into consideration in your information design and make the absolute measures readily available through alternate views, mouse overs, or similar.
3 comments
John B. said:
And please don't sum or average your index, I see people doing this so often it's saddening. Aggregate and recalculate.
Dave Marcus said:
I think that two additional steps are important.
The first is to make sure that all deviations from the standard that are bad move in the same direction (greater or less than 100). For all the measures above, a value >100 is bad. But what if there was a measure called "clarity of air" with a standard of 1 mile visibility = 100. For that measure a value of 200 is very good. For ozone, a value of 200 is very bad. For most of us, that would be confusing.
The second step is scaling. Is a value of 200 for ozone as bad as a value of 200 for small particulate matter? Assume first that "bad" can be defined, perhaps in terms of millions of dollars of additional healthcare costs. The next step then is weight the deviation for each measure so that a deviation of X points in any measure means that the same amount of added healthcare spend is likely.
Ken Hilburn said:
@John and @Dave, great and insightful comments. Thanks for contributing. Certainly this topic would probably warrant effort in kind to a mathematics graduate thesis, but in lieu of that, thanks for raising the bar.
Add a comment
Can familiarity trump usability?
By Zach Gemignani
June 1, 2010
Find more about:
dashboard
Grocery shopping at a new store is a drag, no matter how thoughtful the supermarket layout or how clear the signage or how wide the aisles. I have a mental model of my local supermarket that makes my trip efficient and helps me avoid that frustrating "double back" to search for the peanut butter.
This thought made me wonder about the importance of familiarity in dashboards. We spend a lot of time at Juice designing intuitive, simple-to-use dashboards. We want to create a logic and cohesiveness that ensures the right things are placed in the right proximity and order; sales leads should connect to prospects in the same way as the peanut butter and jelly is shelved near the bread.
If you are starting from scratch, this internal logic and consistency is paramount. But how about a dashboard that is already familiar to the target audience? Does it makes sense to redesign a dashboard for usability if it is already heavily used and understood?
For many dashboards, the purpose is simply to convey a few key nuggets of information. Without a series of interactions or tasks, the user's only need is to locate and absorb data. In these cases, the measure of success is whether the user can find what they are looking for quickly.
I can appreciate the value of familiarity over usability. When the new Microsoft Office "menu ribbon" was introduced, it was described as a convenience to new users because it displays the most relevant features for any given context. For power-users it broke the experience; all the effort I'd put into memorizing static menus was lost.

For all our concerns about poorly-designed dashboards, it may be familiarity that explains why it can makes sense to keep the status quo.
9 comments | Show all comments only the last 5 are shown
Clint said:
Zach, what's with the apologist post? A poorly constructed product is a poorly constructed product - no matter how many people use it.
brad said:
Take a look at any three or four good field guides to the birds, and you'll see that they're all organized the same way: evolutionarily, with the "oldest" birds like loons at the beginning and the "newest" birds like sparrows at the end. That may not be intuitive, but because that's the way Roger Tory Peterson organized his original Field Guide to the Birds, every bird guide that tried to break that organizational model met with howls of protest from birders who attempted to use it.
As an aside, one of the reasons Peterson's book was so popular was because he deliberately left out all but the most important details in his paintings of the birds; when the Audubon Society came out with their guide, which used photographs, birders found it less useful because the photographs contained too much information and you couldn't hone in on the key features that distinguish one species from another.
Clint said:
Brad,
Not being a birder I lack a relevant context. However, based only on your description, it sounds like Peterson hit the right usability factors for his field guide right out of the gate (paintings that highlighted distinguishing features instead of reproducing exacting and confusing detail). Rather than an argument for the status quo (regardless of quality) it reads like an argument for usability because readers revolted against less usable versions of the information.
In the specific case of Audubon that you highlight, more information doesn't necessarily equal better usability or even more useful. In fact, dashboards - more often than not - are about distilling a large amount of detailed information down to those features that can be used to most easily identify the current state of a business.
brad said:
@Clint: the bit about detail was an aside; the "status quo" argument is in my first paragraph. There are probably much more "usable" approaches to organizing a bird guide; for example: put all red birds together, all black birds together, all shorebirds together, etc., but he didn't do that. He used a taxonomic/evolutionary approach, which isn't really intuitive to anyone but an ornithologist. But because his guide became the standard, subsequent guides that deviated from his approach were less useable to experienced birders because they didn't know where to find anything.
I have the same problem with Mark Bittman's "How to Cook Everything" book. He completely revised and reorganized it a year or two ago, and he had the bright idea of putting all the "essential" recipes together at the beginning of each section. Makes sense on paper, but in practice it's frustrating because now some of the recipes for roasted chicken are in one place (at the beginning of the Poultry chapter) and others are in another place (deeper in the chapter in the section on roasted chicken). I find this separation a bit maddening as it takes more effort to review the related recipes and figure out which one I want to cook from. The old approach was actually more useable.
Jon Peltier said:
"Familiarity" is the rationale for using chart types that according to first principles are not effective. Charts like Marimekkos, cascade charts, stacked and clustered columns, and tornado charts are familiar to people in certain fields.
It might not make sense to completely change the existing reports, so keep some of the familiar while cleaning up the most glaring problems. You can revisit the argument if/when Phase II is discussed.
Joe Mako said:
I agree there are pitfalls to redesigning an in use dashboard, and I think the key is understanding the audience, and the questions they are using it to answer. If you had to redesign a dashboard that was previously good enough, but needed the colors changed to enable color blind users, many other users would have issues adjusting to the new colors, because they stopped using the legend to see what a color stands for, and changing the colors on them would disrupt their understanding of the data presented because they would need to relearn the colors.
I agree with Clint, changing something like a speedometer gauge to a bullet graph, is always a good choice, but a good enough dashboard can harder to redesign than a bad dashboard.
Mark said:
This reminds me of something I happened to read today at http://www.jnd.org/dn.mss/affordances_and.html: "Convention severely constrains creativity. ... On the whole, however, unless we follow the major conventions, we are doomed to fail. Those who violate conventions, even when they are convinced that their new method is superior, are doomed to fail. (You cannot successfully introduce a non-qwerty keyboard today, or reverse the window scroll bar convention, or suddenly require double-clicking on web links. For better or for worse, human culture changes slowly, if at all.)"
brad said:
@Mark: I actually think convention fosters creativity: constraints effectively force you to be creative in coming up with fresh approaches and solutions. Take a look through any compilation of the haiku masters Basho or Issa and you'll see how creative they could be within the tight confines of the rules of haiku -- not just the length of each line but also the requirement for a seasonal reference, etc.
When there are no rules or conventions it's too easy to be lured into creativity for creativity's sake, which too often leads to marvelous but useless results.
James said:
As to the point about the Ribbon in Office 2007, it wasn't just that the menus had been rearranged, wasting the learned effort we'd had before. It was actually harder for an experienced user to get things done: if I wanted to sort a list, apply formatting to it and then create a graph, that meant at least 3 more mouse clicks than under Office 2003. The Ribbon still seems more about putting more eye candy onto the screen than actually improving usability for anyone other than somebody who doesn't know what a spreadsheet is for.
Add a comment
Earlier writing






0 comments | Add a comment
said: