A National Data Agency?

Over at Eager Eyes, Robert Kosara has a suggestion for the Obama Administration. He points out that making the government's raw data available to the public could enhance governmental transparency* and lead to some new ways of looking at the country's problems.

The challenge is not only data availability. A lot of data is, in fact, available. The US is the most transparent nation in the world – to an extent that can be frightening to an outsider (think pay data for state employees, property tax data, etc.).

The challenge is that a lot of data is published in a format that is human-readable, not machine-readable. This might sound like a good thing, but it's not. Machine-readable data can be processed and transformed into any number of human-readable forms, that direction is trivial. Making human-readable data accessible to a machine is much more difficult, error-prone, and expensive.

What we need is a National Data Agency (NDA). This agency would be tasked with collecting data that all other agencies collect and produce, and making it available in a central place and in electronic, machine-readable form. There could and should be a reasonable data presentation on its website, perhaps even a National Data Dashboard (showing data of interest like debt, spending, jobless rate, etc.). But the bulk of data analysis would be left to third parties: analysts, journalists, citizens (and also aliens like me). Easily available data would make for more insightful reporting, more informed decisions, and endless business opportunities.

He even has a seal for the NDA already made up. Where do I apply?

* Frankly, I have a feeling we'll all be very upset once we actually see what's going on.

Comments

I want to be Jorge Camoes when I grow up.

Portuguese infoviz enthusiast Jorge Camoes has spent the last year and a half writing informed, insightful blog posts on the field, complete with examples and citations. To his credit, he approaches everything -- even the revered work of Edward Tufte and Stephen Few -- with loving skepticism. I'm gratified, too, that he seems to agree with me on one central point: Snazzy tools alone don't get you good data visualization. It all comes down to putting serious thought into the project before you plot the first data point. In future posts we'll discuss more of Jorge's ideas. Bem feito, o Sr. Camoes!

Everybody loves visual information — especially Abraham Lincoln.

Infographics are clearly having a cultural moment. They have become pervasive in newspapers, magazines, blog posts, and viral tweets; they appear on television and in advertising, in political campaigns and at art openings. As a Google search term, “infographic” has increased nearly twenty-fold in the last five years. Yet infographics have been popular, in one form or another, for centuries. The source of their power isn’t computers or the Internet, but the brain’s natural visual intelligence. Gareth Cook , the editor of Best American Infographics 2013 , has put together a short but true summary of the history of information graphics. (Many of you who see this blog may know most of it already.) His striking lede recounts how much Abraham Lincoln valued his "slave map," shown above. Lincoln's reliance on the shades of gray throughout the Confederacy made an enormous difference in his Civil War decision-making. Fortunately it's rare that most people have to make l

Hype and backlash:
visualizing pop culture trends

Back in 2005, the astute pop-culture chronicler Adam Sternbergh pointed out that a person's opinion of any given entertainment product depends largely on how long they've been aware of it — that is, where the product sits on the sine-wave timeline of public expectations (aka buzz). His findings, in chart form: "Welcome to the undulating curve of shifting expectations—the Heisenbergian principle by which hype determines how much you enjoy a given pop-culture phenomenon. The first-wave audience is pleasantly surprised, but the second-wavers feel let down; then the third wave finds it’s not as bad as they’ve heard—and they’re all watching the exact same show." Almost five years later, this pattern describes just about all our collective experiences. Sports fans, how much sweeter was it to watch the New Orleans Saints come out of nowhere to win the NFC championship than to have seen the Minnesota Vikings do it for the umpteenth time? As for politics, consider the poll

I See What You Mean

Search This Blog