An $80 Million Super-Mugging
By Zach Gemignani
March 14, 2007
Find more about:
bi
Ah, the sweet smell of a swindle. Don't you just hate it when consulting companies cajole deals with hand-wringing about technology and, especially, preying on clients' lack of expertise?
I've seen some of these situations up close but nothing so ugly as this story.
$80 million supercomputer to analyze NYC student achievement
March 6, 2007, 7:58 AM EST NEW YORK (AP) — To understand student performance, the city will spend $80 million on a massive supercomputer that will crunch huge amounts of data and offer up-to-the-minute reports to teachers, principals and eventually parents, the Daily News reported Tuesday.
One million students and no high-volume transactional data? That might be huge to Dr. Evil but even by late 90's standards that's not huge. You want to talk huge? Now these are huge. The system that was sold to New York is more along the lines of a CRM system for a medium-sized insurance company.
The "super" reference here is pure drive-through mentality. In the same way that we are a nation that's overfed and undernourished, this is about a super-sized services contract that sits atop something that could be handled by a regular-sized computer.
The information fed into the IBM-designed system called Aris, or "Achievement Reporting and Innovation System" could include existing data on students—such as gender, race and any disabilities—along with new data from incremental testing.
Some aren't so pleased with the system's price tag.
"You can lower a lot of class sizes with that money—or buy a lot of supplies," teachers union President Randi Weingarten said in a statement obtained by the Daily News.
Mayor Michael Bloomberg told the tabloid the cost was worth it.
"Every child in this city deserves a quality education and we will spare no expense," he said.
This is where the sweet smell of swindle comes in. There is a difference between being willing to make the investment and having a no-bid contract.
Jim Liebman, the Education Department's chief accountability officer, also lauded the system.
"Aris will bring together every bit of learning information that we have on every one of our 1.1 million students," Liebman said. "Now, school professionals will be able to slice and dice that data to see what's wrong."
Teachers are underpaid, hardly appreciated, and overworked. I can only wonder what the half-life is of a system that asks teachers to log on to get information delivered by the "chief accountability officer."
And from an article in InformationWeek, we're enthralled by a description of the system capabilities:
"Think of a teacher trying to help a student struggling with geometry," says Michael Littlejohn, VP of public sector for IBM global services. "The teacher could tap into the system and search for best practices on geometry instruction, and get contact information for teachers identified as having strong skills in that area."
Sometimes it's good to reinvent the wheel - usually when you're trying to learn about wheels. But not when you're drawing away cash from an entity that doesn't have it to spare. Something like this could be built with off-the-shelf, mature products for a fraction of this wasted time and effort.
Sure, a fully-integrated, one-stop solution is going to run up the price but the functionality doesn't sound particularly whiz-bang. Best practices for teaching geometry can be found at Curriki or Edutopia or Wikiversity or Openplanner.
The real shame is not allowing such a system to connect more than just the overworked NYC school system teachers. But what would we call such a thing? An inter-net, perhaps?
Nah, that would never catch on.
Related articles





18 comments | Show all comments only the last 5 are shown
Tony said:
Great article and I love the subtle humor along with the reference to Dr. Evil! The last paragraph made me lol.
It amazes me the price tag on this "super" computer. I mean, this could probably be done with MS Access...
On Deal or No Deal the other night, there was a teacher who made the comment that $40k was way more than what she made in a year. $80 million could be spent on underpaid teachers who we rely on to teach our kids who are the next generation's leaders!
Ian said:
Great Post!
This reminds me of an article I read a few years back on how the University I attended was spending millions on an anti-spam email system when most of the best products out there for this are free.
At a time when you can buy a dual processor (with dual cores) machine with 4+ Gigs of RAM and over a terabyte of disk for less than $10K, I wonder what the other $79,990,000 is being spent on. Licensing and Installation?
Brian Timoney said:
A couple of observations:
1) For that kind of money I would've demanded a much hipper acronym--Aris? At least military contractors tend to give very cool names to theWhite Elephant projects they fob off to the gov't.
2) And as usual, no one thinks through the anthropology. So I'm the geometry teacher who has my sh*t together and a solid track record that's now in the 'system'. How will I react when every other teacher in NYC makes their students struggling with geometry my problem????
BT
Gary Babad said:
One more related article of interest : "ARIS Critics: IBM Responds"
http://nycpublicschoolparents.blogspot.com/2007/03/aris-critics-ibm-responds-march-7-2007.html
Robin said:
hmm 80.000.000 dollar for a database with one million students.
"Will crunch huge amounts of data and offer up-to-the-minute reports"
What, do those boys and girls get grades every minute or so?
With one million students there must be a student with a talent for MS access that can build it for 100 bucks. Shoot, you can almost vlookup it together in excel 2007! (not that you would want that of course).
Someone over there must really like IBM.
Rob said:
There seems to be a trend of education companies/districts being overcharged for data ware house and analytics. I wonder if NYC is being charged by the record.
Sorry, if you only had a million records that would have been $40 million. However, those extra 100k records are going to double the cost. You know... servers and processing costs are expensive!
bee said:
This measurement and reporting system addresses a non issue in education.
The fundamental problem with education is that it fails to adopt what we have learned about quality control. Namely, you cannot inspect quality into a product. The emphasis on testing fails the to address that education is not simply a measured outcome, it is a process. I would suggest spending the money to address the questions of what the inputs (students) look like and a real focus on teaching (the process) and less on testing (measurement and reporting).
Toyota does not inspect quality into each car. Rather, they focus on ensuring the parts are at spec and that the process is rigorously followed (and continuously improved). In education we have hundreds of curriculum that are not really validated to produce the specified outcome. At best they are benchmarked against some control which itself is not linked to the targeted outcomes. We further aggregate the process by not taking care to know who we are really teaching. No, in the name of inclusiveness, we often seek a wide range of skills among students to make process management impossible. When will we learn?
HS said:
Very interesting blog. I like bee's comments--sometimes we get too much savvy about technology instead of focusing on the core of the problem. The Toyota example is apt--we need to build quality into the process (of education), and not spend too many $$ on measuring (inspecting) the product (student).
Bill Gates, in front of the committee of education, labor, etc. emphasized upon merit-based pay for teachers--we need to spend money there. If there was more money in teaching a lot of smart people would enroll in the teaching profession (I would!).
bb said:
Where did the idea that this was a no-bid contract come from? It was a multi-month open bidding process in which much of the education industry and enterprise technology industry competed. McKinsey (hardly a naive client and with their bill paid by a foundaiton) supported NYC in evaluating the bids. A supercomputer is not involved in any way.
Pete said:
I don't want to say anything I would regret on the Juiceblog, so I'll just say that its probably worse than you think, take a look at these powerpoint/pdfs I downloaded from http://schools.nyc.gov :
http://www.datawrangling.com/media/AchievementReportingandInnovationSystemARISPanelPP.ppt
http://www.datawrangling.com/media/001_092706OnlineDeck1.pdf
"ARIS COMBINES OLD SYSTEMS AND NEW CAPABILITIES"
"Stoplight" charts...oh boy.
Pete said:
Look at slide 18, "Overview of Required Functionality". They don't even ask for built-in data visualization (they will export to Excel), this is just an $80M content-management system. Everything they list as a requirement is 5 year old technology, which you could do with Drupal, Plone, or SugarCRM today out of the box. I get most of this with MoinMoin right now, or you could use Django if you want to make something really slick.
*Library of templates/idea bank for school-created tests
*Test creation and upload
*Assessment content upload into online testing, reporting and analysis
*Online testing and scoring
*Score data upload into reporting and analysis
*Canned and customized reports
*Drill-down, roll-up, filtering
*Ad-hoc queries
*User-generated databases
*Adding new data to central repository
*Data viewing in 3rd party tools (e.g., Excel)
Advanced analysis
(for selected users)
*Advanced statistics
*Pattern detection for target setting
*Library of templates for different document types (e.g., lesson plans, curriculums, )
*Document creation and upload to repository
*Document tagging
*Collaborative document creation
*Publishing approval
*Document linking to reporting (surveys)
*Searching documents in the repositories
*Document viewing and download
*Pattern analysis across text documents
*Posting announcements; setting alerts
*Online discussions; online messaging
*Custom workspaces, integration w/email
*Pre-defined home page based on user role
*Personalization of home page (HP) by user
*Adding new tools to HP from a tool catalog
Henk said:
Could it be the $80 Million should read $80 Thousand? Maybe it was reported as 80,000 and the reporter thought the figures were in x'000?
Pete said:
The Information Week article has the $80M number as well (keep in mind that amount is over 5 years):
"New York City's public school system -- the largest in the nation, and one wrought with problems common to intercity school districts -- will pay IBM $80 million over the next five years to develop a business intelligence system that tracks and analyzes student and school performance."
I hope IBM takes the scrutiny into account and does a good job on this, even with the hokey requirements...as a company they are relatively open-source friendly and produce some good R&D work.
The question I have is whether the people who work on innovative projects are involved, or just the bread & butter enterprise consulting division....I suspect this was originally planned as a "turn the crank" style project using existing IBM software. Still, no matter how you cut it 80 million is a lot given the requirements.
Here are some platforms they might be using (Sakai, rSmart, IBM Content Producer):
http://www-03.ibm.com/industries/education/doc/content/landingdtw/1601142110.html?g_type=pspot
Some related links:
http://www-03.ibm.com/industries/education/doc/content/landingdtw/1584488110.html?P_Campaign=6N2CAS47
http://www-03.ibm.com/industries/education/doc/content/news/pressrelease/1832371110.html
http://www-03.ibm.com/industries/education/doc/content/news/pressrelease/1748306110.html
john macinnes said:
I am a teacher in England and find it hard that there are fools still in high places. The demands for education over here are just as high as over there. We tried the QCA online test, a test that was to stay with the pupil and adapt to their learning style, for example, it would make questions easier for the less able. As the months rolled by the system failed to emerge until the multi billion pound project is now to be scrapped. Could it be suggested or rumoured that there is a golden hand shake or a deal in the back ground. Over here all of the ICT is talk, and talk is cheap.
What really winds me up is the government officials who tell us these stories and don't want/ expect to hear a comment like, 'well what about the last 2 times you have tried and failed. Shouldn't you be learning from mistakes instead of spending money, ' (on a company which a relative of his probably owns.)
I grumble but will it ever change?
john macinnes said:
I am a teacher in England and find it hard that there are fools still in high places. The demands for education over here are just as high as over there. We tried the QCA online test, a test that was to stay with the pupil and adapt to their learning style, for example, it would make questions easier for the less able. As the months rolled by the system failed to emerge until the multi billion pound project is now to be scrapped. Could it be suggested or rumoured that there is a golden hand shake or a deal in the back ground. Over here all of the ICT is talk, and talk is cheap.
What really winds me up is the government officials who tell us these stories and don't want/ expect to hear a comment like, 'well what about the last 2 times you have tried and failed. Shouldn't you be learning from mistakes instead of spending money, ' (on a company which a relative of his probably owns.)
I grumble but will it ever change?
Mary said:
Zach, Your thoughts on this subject make me think you know something about education. Hmmm... After 30 years in the field of education, I could give you another dozen examples of how educators (or, anyway, administrators) have been sold a bill of goods by big business. I agree with bee. There is no need for this. Good teachers already have this information about their students or know where to get it. The list of things that really would be useful for students and teachers for that amount of money is endless. Oh, well, just another example of a way to leave children behind.
David Andersen said:
<em>"Think of a teacher trying to help a student struggling with geometry," says Michael Littlejohn, VP of public sector for IBM global services. "The teacher could tap into the system and search for best practices on geometry instruction, and get contact information for teachers identified as having strong skills in that area."</em>
Incredible b*llsh*t. This will never be implemented in any useful or novel manner, if at all.
greedcontrol said:
We need Greed Control in NYC not Mayoral Control. This mayoral thing has turned out to be the best business (kick back or otherwise) that he has ever done. Children are being marginalized (to put it kindly) by this mayor while he robs the city $60 billion budget. Oops there goes another billion!
said:
Add a comment