Diaper Genies for analysts (i.e. simple tools and tricks to help you work better)
By Zach Gemignani
April 28, 2006
Find more about:
excel
productivity
tools
With a new baby, you come to appreciate the small inventions that make a big difference. The Baby Bjorn, the Diaper Genie, the baby monitor: these are simple, well-designed technologies that can save your sanity.
Which got me to thinking: What are the Diaper Genies for data analysts? What are the little tools that solve nagging problems in a light, simple, intuitive way? I put together a starter list below of a few of my favorites. The thing that's amazing about these tools and tricks is that they have changed my usage behaviors. By simply eliminating a few clicks or keystrokes, I work differently and more efficiently.
- MWSnap is a bit of freeware by Mirek Wojtowicz that lets you easily capture images on your screen. Pre-MWSnap, I often found myself using the Windows Ctrl-PrtSc function when making presentations. Then I would have to chop down the full screen capture in an image editing program. This application lets you grab just the part of the screen you need, then copy and paste it right into PowerPoint.
- Keyboard shortcuts in Excel. Keyboarding both saves you time and expands your ability to work effectively with large data sets. There are two kinds of keyboarding that we teach: 1) using the Alt key with letters to navigate the menu structure (e.g. Alt-i-r to insert rows, Alt-e-s-v to paste special). 2) using the Ctrl and Shift keys with the arrows to move around and grab blocks of data. See Chris' keyboarding game. Everyone rolls their eyes when we harp on keyboarding as an essential element to being effective with Excel; I've seen too much value from the skill to care.
- Excel Pivot Tables."What's easy about PivotTables?!," you say. Admittedly, this tool doesn't exactly fall under the category of simple and quick to learn. In fact, we are still looking for an intuitive way to teach Pivot Tables. Here are a few good tutorials I've come across. In my experience, you have to put up with a short and mildly painful learning curve; it's worth the trip. I've seen many analysts who still rely on vlookup functions when a simple Pivot Table would let them manipulate their data far more quickly. We are developing a post that offers our tips and tricks on working with Pivot Tables.
- Voice IM (e.g. Google Talk, Skype). There is a form of conversation that requires less focused discussion than a phone call but more verbal interaction than instant messaging. This is where the voice talk features on many IM clients become valuable. Often Chris and I will open a Google Talk call while we work on something together. Long silences suddenly feel acceptable since it's free.
- Windows Alt-Tab. This key combination gives you the ability to flip between applications and can be a huge time saver. I've found it especially useful when I'm pulling data from application and dropping it into another.
- Faster web browsing with Firefox. Mozilla's Firefox browser touts its security, pop-up blocking, and extensions as differentiators. The features I care about are those that help me manage the information better. Ctrl-f gives a 'find' box in the bottom of your browser where you can start typing instantly. It jumps you right to the part of the page with your word/phrase. Tabbed browsing and the ability to jump between tabs (Ctrl-PgUp or -PgDn), close tabs (Ctrl-w), or open a new tabs (Ctrl-t) lets me work with half a dozen web sites at the same time.
- Google Desktop. The new version has a feature where you can press Ctrl twice and it pops a search box. Not only is this a better tool for finding files than Windows offers, but it can quickly find applications. You may never have to go to that Windows Start button again!
We don't claim to be productivity gurus like Merlin Mann of 43 folders or the folks at Lifehack, but I think you'll appreciate how these tools seem to scratch an itch then mercifully leave you alone. They give you a sense of control that is about the opposite of MS Word deciding how your bullets should look.
Correcting a small oversight
By Chris Gemignani
April 27, 2006
Find more about:
excel
A reader wrote to point out a small oversight in last week's introduction of the Excel Chart Cleaner tool.
Installed your chart fixer upper tool...and it seems to have been installed because it shows up checked in my add-ins list. But how do I actually USE it? If I have a sheet of data and make a line chart out of it...where is the button to press to clean it up with your add-in? Maybe I'm too much of a neophyte to be reading your blog and trying this stuff...but maybe you could let people know how to actually use this excellent tool you've provided instead of just installing it.
Thanks so much for putting this stuff out there. I learned more about Excel reading your blog than in several paid training sessions. Worth the price of getting out of bed today!
So, you're one of those sneaky people that actually wants to USE the tool. Hmmm.
Well, here's the secret: the add-in puts a menu item in the Format menu. If you have a chart already selected it will say "Clean this chart..." otherwise, it says, "Clean all charts...". Select the option and you'll get a number of ways to clean and simplify the chart.
Thanks for the kind words. There's a screencast coming on how and why to use the Chart Cleaner tool.
3 comments
Josh said:
Thanks for posting my question. I continue to LOVE chart cleaner. So simple yet so powerful. My charts are so much more elegant now. Thanks again for this little gadget. -jk
Joe said:
I like your chart cleaner concept, but I don't care for the "mil" for million. I've never seen mil used in business charts.
Chris said:
Thanks Joe. I'm not _crazy_ about "mil" either, but I do think most people would understand what it means in context.
The terminology I've seen most for annotating business charts is "M" for thousand and "MM" for million. Personally, I don't think this is very clear either. Why "M"?
Do you have a suggestion?
Add a comment
Best of Juice blog
By Zach Gemignani
April 21, 2006
Find more about:
Welcome to the Juice Analytics blog. We've gotten quite a few new visitors from Chris' podcast discussion with Jon Udell. If you are new, thanks for stopping by. Our blog covers a range of topics, from data visualization to Excel and PowerPoint tips and tricks to our business analytics approach. Here's a brief "best of" list to help you get acquainted:
- Excel tools and tips: Fixing Excel charts; Excel as a BI tool; Problems with Excel charts
- Fun with mapping: Google Earth census heatmaps; geo-coding tools in Excel and Python; and our compilation of resources for using Google Earth
- Better presentations: PowerPoint pile o' ideas; presentation checklist; an approach to developing well-structured presentations
- Visualizing data: Dynamic data; Sparklines; Lessons from Tufte
- Analytics in theory: Misguided BI theories; Success metrics; Common data issues; What is analytics?
- Analytics in practice: Jiffy Lube; Zillow; Budget Rent A Car; Top blogs for data analysis types
- Juice Analytics: If you want to learn more about us, check out our consulting approach and case studies.
Thanks for visiting; we love to hear from our readers so send us an e-mail or leave a comment.
A data warehouse problem...And, cuddling up with Bill Gates
By Chris Gemignani
April 21, 2006
Find more about:
analytics
Andy Hayler from Kalido is a great read for a no-nonsense perspective on business intelligence. He wrote recently.
"Meanwhile, a survey of 1,000 UK business managers at companies with over 250 staff, published by ICS, indicates a widespread need for better BI systems. The study found that over three quarters of respondents were forced to make decisions 'blind' due to late or insufficient business information". By contrast, this is entirely believable, though not for the reason that the article gave. The critical issue is that you can have as many pretty reporting tools and dashboards as you like, but you need accurate and timely information to feed those systems coming from a data warehouse (unless you are one of the few brave souls using EII). The problem is that most data warehouses are entirely unable to keep up with the pace of business change (reorganisations, acquisitions etc) and so are constantly out of date. Consider a data warehouse with just ten source systems. A major change in one of its sources will impact the warehouse schema, and may take three months to fix the schema, the load routines and the reports that are impacted by the change (this is a pretty typical figure in my experience at Shell).
A major change of this type does not happen every day, but is almost certain to happen once a year to each of these source systems, maybe twice. There are then ten sets of separate changes, each taking three months worth of changes needed to the warehouse every year. Even assuming that the changes are neatly spread over the year and that you have plenty of programming resources to fix the changes, so you can do these in parallel, you still have 15 months of change to fit into 12 months; basically the warehouse can never catch up. You may well have more than 10 sources for your data warehouse, so the problem could be even worse than this. This is indeed what happens in reality: the data warehouse is usually out of date, so armies of Excel jockeys in finance get the answers via email and have to manually number-crunch for anything really critical while the warehouse lumbers on with out of date information. This situation is not the fault of the BI tools—it is the fault of the data warehouses that feed the BI tools. Until companies admit that the status quo is failing and start abandoning custom-build warehouses this problem will persist. It is like with treating alcoholism: the first step is admitting that there is a problem.
We've long been skeptical of top-down analytics that try to centralize a businesses information and knowledge. Andy's post highlights one problem with this approach - change happens. Here's another problem - you don't know what you don't know when you build a warehouse.
In other news, I've cut my six degrees of separation to Bill Gates down to two. More later.
Fixing Excel charts...Or, why cast stones when you can pick up a hammer
By Chris Gemignani
April 19, 2006
Find more about:
analytics
excel
tools
visualization
It's always better to suggest a solution than criticise. Recently, we've slung stones at Excel's default charts. The default colors are bad, and some of the built-in charts are "what were the smoking?" ugly.
Edward Tufte and others provide principles for making good infographics, but beating Excel's rusty butterknife into an explanatory sword is hard. People who want to make nice looking charts waste time fixing them up. People who don't care about making nice looking charts inflict those charts on others.
We have a solution. The "Clean Charts" tool turns hard-to-read Excel default charts into Tufte-compliant wonderwerks in a single click. Here's what it does:
- Removes "chart-junk" (the contrast-reducing light grey background on most Excel charts, extraneous lines)
- Formats the axes with easy to read numeric formats (22000 becomes "22k")
- Changes series colors to an optimally chosen set that are designed for maximum contrast and readability
- Removes 3D from the chart. 3D charts introduce distortions that make it hard for people to understand your numbers.
- Fixes axis scaling problems.
- Fixes font and marker sizes to make them readable if you have resized your chart
To try Clean Charts and install it, download both these files into the same directory. Then open the Clean Charts Installer.xls file with macros turned on. Follow the instructions inside the installer.
To turn macros on, go to Tools, Macro, Security. Select Medium security level. Close the workbook and re-open it. On re-opening, when Excel gives the security warning that asks if you want to enable macros, choose "Enable Macros".
The add-in puts a menu item in the Format menu. If you have a chart already selected it will say “Clean this chart…” otherwise, it says, “Clean all charts…”. Select the option and you’ll get a number of ways to clean and simplify the chart.
This project is offered under the MIT License.
23 comments | Show all comments only the last 5 are shown
Slide design vs Noise - Rena slides och diagram Moustache Analytics said:
[...] Se även Juice Analytics exempel på hur excel-grafer kan tvättas för att bli lättare för ögat. Tyvärr så är ju default-funktionen i Excel vad gäller diagram och grafer att fylla dem med linjer och färger som inte känns 100%. Därför är rådet att skapa dina egna standardgrafer som du kan använda (Customized graphs) det bästa du kan göra. Utan linjer på staplarna, 3D-effekter, gridlines bakom och med naturtrogna färger blir graferna mycket mera lättförståeliga. Jämför graferna nedan som har samma data men där den vänstra är default med Excels färger och den andra är gjord med mina val. [...]
Slide design vs Noise -Moustache Analytics said:
[...] Se även Juice Analytics exempel på hur excel-grafer kan tvättas för att bli lättare för ögat. Tyvärr så är ju default-funktionen i Excel vad gäller diagram och grafer att fylla dem med linjer och färger som inte känns 100%. Därför är rådet att skapa dina egna standardgrafer som du kan använda (Customized graphs) det bästa du kan göra. Utan linjer på staplarna, 3D-effekter, gridlines bakom och med naturtrogna färger blir graferna mycket mera lättförståeliga. Jämför graferna nedan som har samma data men där den vänstra är default med Excels färger och den andra är gjord med mina val. [...]
» Knocking Excel 2007 down a peg or two » Jon Plummer said:
[...] Excel 2007 makes some flashy charts. Charts that are maybe too flashy, and requiring of much clicking and prodding to simplify. But why cast stones when you can pick up a hammer? [...]
David Mudge said:
Very nice. Simple to install, simple to use. Just one issue: when I used the "Remove 3D" option, my nice line charts are converted into column charts, which is not wanted.
Peter Basch said:
So, I follow instructions, turn security (in Excel 2003) to Medium, open the workbook, and get this:
This workbook has lost its VBA project, ActiveX controls and any other programmability-related features.
What am I doing wrong?
Thanks, P B
techcommdood said:
This is quite impressive. I'm really liking it!
Aaron said:
Looks appealing, but I couldn't make it work on Mac, Excel 2004... Any hints?
Chris Gemignani said:
Aaron, We don't have a copy of Mac Excel 2004 to test it on.
If you're a code jockey or you know someone who is, the Visual Basic code is available and it is open source.
Another post you may be interested in that should work on the Mac: http://www.juiceanalytics.com/writing/2006/08/tufte-charts-in-excel/
tim said:
I like it - if only your idea of 'nice colours' and my idea where the same... ;o)
Andreas said:
Clean Charts.xla
The xla file does not download at all rather it appears to open in my Firefox browser.
Please advise.
Also, will Clean Charts work with Excel 2000?
thx.
A
andrew said:
Brilliant - I use it often. Thank you for sharing it.
Andreas said:
Sorry, I accidentally submitted this in another thread,it belongs here. I hope someone can help...
I've tried downloading the two files:
Clean Charts Installer.xls
Clean Charts.xla
The xla file does not download at all rather it appears to open in my Firefox browser.
Please advise.
Also, will Clean Charts work with Excel 2000?
thx.
A
Oliver Hofmann said:
Same problem with the Mac Excel version -- getting a runtime error 53 (file not found: user32) which seems to indicate it's looking for a particular window? Did any Mac user get this to work yet?
Chris Gemignani said:
Oliver: I don't think it works on Mac. The code is available if any Mac Excel expert wants to take a shot.
Andreas: I believe it will work in Excel 2000. Sorry to hear about your downloading troubles. I'll take a look at the server side and see if I can figure anything out.
Tim: Hey, they were "scientifically chosen". You might like the colors in our Chart Chooser (http://juiceanalytics.com/writing/2007/11/introducing-chart-chooser/) better. I do.
Chris Gemignani said:
I've joined the two Excel downloads into a zip file. This should solve the downloading woes some have experienced. Thanks for your patience.
Andreas said:
Chris -- Just got around to downloading the zip file and trying to install the add-in as per the directions. When I open the .xls file and select "Enable macros" I then get an error message stating "File error: data may have been lost".
Please advise.
Thx,
Andreas
Andreas said:
Chris -- I also just realized that after I close the above described error message window and look at the Clean Charts Installer.xls file, sheet 1, it has no buttons. Also, after making a chart and selecting "Clean this chart form the format menu, it cleans the chart but leaves with no way to select the chart again.
Please advise,
Andreas
Chris said:
I have the same problem as comment 16. I also don't get buttons like 17. I'm running Office 2000.
Simon said:
This was an excellent find on Google. Thanks a lot. One issue is that it maxes out at 6 series. I have a stacked area chart with 7 series and it made the seventh white. I only just spotted it as I proof read my report!
Andreas said:
Chris -- Just wondered if the problem I had in my December 7 post got addressed. Please advise.
Rgds,
A
Ole said:
Thanks for the cleaner. However, I couldn't make it work in Excel 2003. It did say install, and the macros are on and the menu item is there - but nothing happens when I select a chart and press. Any ideas?
James said:
Ole, I also had that issue in Excel 2003, but only on charts that aren't located in a sheet. Change the location of the chart to inside another sheet and see if that fixes it for you
Vadim said:
Installs and works great on Excel 2k, except that it mangles charts with multiple scale bars (e.g. Amount on Left Y-scale and Date on right Y-scale). But turns out if you turn of the "fix 3d" options, then it leaves the graph in tact.
Also, for a scatter chart type (useful when dealing with dates) it removes the connecting lines, but leaves them for a line chart type. Can this be fixed? Thanks.
Add a comment
A new member of the family
By Chris Gemignani
April 19, 2006
Find more about:
innovation
I attribute my intolerance for graphics ugliness (see our post on Excel colors) to being the son of an artist/photographer. Growing up, this meant kitchen sinks full of oil paint brushes and new works slowly taking shape in the studio.
His works are figurative and whimsical at times. Or in his words: "The iconography I use centers around people because that's my greatest interest: how people think and feel as individuals, how we interact with each other intimately and as a society." An original mash-up artist.
My dad has just launched Potato Hill Artworks, an online store to sell fine-art limited edition prints of his oil paintings. Check it out if you're looking for something unique. A few of my favorites:
Excel Geocoding Tool v2
By Chris Gemignani
April 18, 2006
Find more about:
excel
geocoding
googleearth
tools
I'm happy to announce a few small revisions to our Excel geocoding tool. The tool takes a list of addresses and will look up the latitude and longitude of those addresses. The addresses can then be exported as a Google Earth map.
A user pointed out that the tool wasn't looking up zip+4 codes properly in Yahoo and this problem is fixed along. Also, I'm sorry to report that Yahoo has lowered their limit of free geocodes to 5,000 per day from 50,000 per day.
32 comments | Show all comments only the last 5 are shown
Alan said:
I've been working with data that only has ZIP and ZIP+4 info so this new version is a huge help and works great! Much faster than batchgeocode.com.
Any way to add batch processing of data to get travel time and distace?? I would bow at your feet if this was possible in a similar fashion!!!!
Clayton said:
Is there a way to support Canadian Postal codes? Yahoo can process them, but is there a way to change the tool to allow this?
Thanks!
Landmine_Mapper said:
Just the macro that spits out the kml from the spreadsheet is awesome.
Have you seen anything that could do the same thing from an MSaccess database?
For some reason the kml file is not opening automatically when excel spits it out.
I checked paths. Running GEbeta4. Output.kml will open fine when double clicked.
I guess placing the export button on the toolbar and then allowing user to select
ranges for the X,Y,label,and multiple attributes would make it all 100% perfect
Many many thanks!
exceltool.info » Blog Archive » said:
[...] Excel Geocoding Tool v2 - Juice AnalyticsI m happy to announce a few small revisions to our Excel geocoding tool. The tool takes a list of addresses and will look up the latitude and longitude of those addresses. [...]
Underdetermined said:
I keep getting an error saying:
Compile Error:
Can't find project or library
Do you have any advice?
Thanks. UD
dave said:
hi
can this be used for other countries other than the USA , if it could be developed to do so it would be great
seth said:
For some reason, this tool no longer works. That's a shame. I loved this tool. So fast and easy.
Marc said:
Great macros! Thanks.
What would need to be changed to make it possible to change the icon based on other data. For example, you could make republicans red and democrats blue.
Ujval Gandhi said:
Chris,
The http.send is preventing me from running the file. Could you tell me which Tools--> References to click to make this wor


3 comments
Fred said:
I fully agree with your comment on Excel keyboard shortcuts... I feel like I'm missing an arm and a half if I can't use these shortcuts.
So here's my question: I'm switching to Mac, and Excel 2004 doesn't appear to have support for this type of navigation. Is there any way around this, or to get it to work with the shortcuts as in Windows?
Thanks
Zach said:
You question could hardly be more timely for us. We are also looking at switching to the new MacBooks. As you know, we are obsessive about Excel keyboarding (it can feel like a superpower) and the fear is that we will be reduced to the typing equivalent of hunt-and-peck people.
Here's a good article I found about keyboarding on Macs:
http://www.macworld.com/2004/09/secrets/septworkingmac/index.php/
hjmm said:
perfect information!enjoyed!Thank You!
<a href="lalal.ru" rel="nofollow">click</a>
said:
Add a comment