Skip to main content

A National Data Agency?

Over at Eager Eyes, Robert Kosara has a suggestion for the Obama Administration. He points out that making the government's raw data available to the public could enhance governmental transparency* and lead to some new ways of looking at the country's problems.
The challenge is not only data availability. A lot of data is, in fact, available. The US is the most transparent nation in the world – to an extent that can be frightening to an outsider (think pay data for state employees, property tax data, etc.).

The challenge is that a lot of data is published in a format that is human-readable, not machine-readable. This might sound like a good thing, but it's not. Machine-readable data can be processed and transformed into any number of human-readable forms, that direction is trivial. Making human-readable data accessible to a machine is much more difficult, error-prone, and expensive.

What we need is a National Data Agency (NDA). This agency would be tasked with collecting data that all other agencies collect and produce, and making it available in a central place and in electronic, machine-readable form. There could and should be a reasonable data presentation on its website, perhaps even a National Data Dashboard (showing data of interest like debt, spending, jobless rate, etc.). But the bulk of data analysis would be left to third parties: analysts, journalists, citizens (and also aliens like me). Easily available data would make for more insightful reporting, more informed decisions, and endless business opportunities.
He even has a seal for the NDA already made up. Where do I apply?

* Frankly, I have a feeling we'll all be very upset once we actually see what's going on.

Comments

Popular posts from this blog

Cool Map: Emissions worldwide

From the Center for Public Integrity comes this interactive map showing greenhouse gas emissions from many of the world's largest economies.

Lots of data is packed into this simple interface, and the map itself is blessedly clear.

Note, though, that when it comes to infoviz issues, even these pros needed a do-over. Check out the message in the lower left corner. In an earlier version they made the common mistake of comparing circles based on radius, instead of by area. It's to their credit that not only did they fix the mistake, but they also owned up to it and made the change. The larger problem, though, is that distinguishing the relative size of circles is not easy for the average viewer; rectangles are clearer, and would probably have made this cool map even stronger.

Note also that stats are from 2005. Since then there's been substantial economic growth in China (for example), so the current numbers are likely to be even higher than what's shown here.

Differing Vie…

Quality dataviz about quality-of-life issues

To accompany its Better Life Initiative, OECD (the Organization for Economic Co-operation and Development) has put up a handsome, carefully constructed set of interactive data graphics called the Better Life Index:
There is more to life than the cold numbers of GDP and economic statistics – this Index allows you to compare well-being across countries, based on 11 topics the OECD has identified as essential, in the areas of material living conditions and quality of life. Each country is represented by a multicolored flower with 11 petals (OK, yes, potentially cheesy). The length of each petal represents the country's score in a given area; the width of the petal indicates the importance the user has assigned to that particular aspect. Drilling down into the details is easy to do; in fact, if you've a mind to do your own visualizations of this info, the underlying index data can be downloaded in spreadsheet format.

Kudos to Moritz Stefaner, Jonas Leist and Timm Kekeritz (for Raure…

Hans Rosling and Gapminder

As part of his larger mission of promoting "fact-based" public health policy, Swedish physician Hans Rosling founded Gapminder.org, which aims to make world health data available and understandable to everyone. Back in 2006, Rosling gave a well-received TED presentation on the principles of Gapminder, showing, among other things, relative historical changes in life expectancy and GDP. (He spoke again in 2007.)

Rosling acknowledges that there are some small flaws and inconsistencies with data derived from all these different sources, but believes that the comparative results are far more significant. Check out the vast difference between Mauritius and Congo in income per person and life expectancy (shown on the Gapminder site and in the '06 presentation); consequently, says Rosling, using the term "sub-Saharan Africa" to describe both of these countries is vague to the point of uselessness.

His point: The more easily data and details can be visualized and compared…