All in Data

Recommendations for Collaborative Management of Government Data Standardization Projects

Standardizing how the U.S. government collects, manages, and publishes budget and expenditure data, as required by the DATA Act currently before the U.S. Congress, is an example of a long-term and complex project. It will be require careful planning, management, and sufficient resources to be successful.

How Important Is ‘Total Cost of Standardization’ to the DATA Act?

Last week I attended a meeting in DC sponsored by the Data Transparency Coalition, PwC, and Intel. Representatives of the Federal agencies likely to manage implementation of the evolving DATA Act presented their thoughts on implementing the Act’s requirements for standardizing and reporting on Federal financial data.

When Does a Public Data Good Become a Private Data Resource?

It may be that the greatest challenge facing private entrepreneurs in developing new and valuable information products and services based at least partially on public data will be public resistance to paying for information, no matter how new, innovative, or unique these producrts or services are.

Perspectives on the NSA and PRISM: What Dyson Missed

In NSA: The Decision Problem George Dyson lays out a credible historical view on why he thinks what Snowden revealed about the NSA and PRISM was inevitable. While it’s certainly a pleasure to read a discussion of these issues that is so thoughtful, I think he misses one major theme that helps us understand our current predicament over what to do about Snowden.

Learning from the World Bank’s “Big Data” Exploration Weekend

If you’re serious about data analysis there’s probably no substitute for getting “down and dirty” with real, live, messy data. Sometimes you just have to sift through the numbers with your “bare hands” if you really want to extract meaning from descriptive statistics, predictive models, and fancy visualizations.

Transparently Speaking, Are Bad Data Better than No Data At All?

I’ve been researching government program transparency and the hype surrounding “big data.” Given OMB’s recent statement of support for improving access to accurate Federal spending data I’ve also been giving some thought to what improved access might actually mean, based on my own experience with data conversion and consolidation projects.
Our ability to store and provide access to vast amounts of information is growing. We need to focus on how such information is to be used most efficiently and most effectively. At the same time, through careful planning and design we must avoid the expense of developing and supporting systems and websites that people do not or cannot use. In these times of fiscal austerity such an outcome would be inexcusable.