All in Big Data

Needed: Better Integration of Project Management and Data Management

These days, still, when you read about big data or if you attend conferences or webinars you’re much more likely to read about products and tools. You don’t hear as much about “back room” management issues you need to address to make sure all the members of the project team are sharing information and marching in the same direction.

Is Loss of Government Economic Survey Data Inevitable?

While it may be inevitable that all government data collection efforts have to tighten their belts, hopefully the process of making tough prioritization decisions will be done in light of rational factors such as the value of the data to users, the cost of collecting it, the availability of alternatives, and the manner in which data management processes are governed.

The Commerce Data Advisory Council's 2nd Meeting: Storytelling, Staff Recruiting, and Complex Processes

There’s an understanding represented by this group that the data resources being stewarded by Commerce programs both reflect and are critical inputs to U.S. technical and industrial competitiveness. Hopefully this group will be able to facilitate an exchange of useful “lessons learned” and resources across the varied Commerce programs.

Risk, Uncertainty, and Managing Big Data Projects

Anyone who practices project management for a living will recognize this list. It’s certainly not unique to big data analytics project. It is however reasonable to ask whether “big data” projects are unique in some way that exacerbates the probability of failure.

Do People Really Understand What “Open Data” Means?

Ultimately the most important issue has to come down to deciding what level of data literacy citizens need. As the production and consumption of goods and services become more data-dependent in both developed and developing countries, it is reasonable to ask how much understanding of data and data related decisions people really need. I’ve referred to this elsewhere as data management literacy. Maybe we also need to consider data consumption literacy. After all, if people don’t understand or appreciate the services we’re providing, no amount of standardization, interoperability, or transparency is going to make any difference.

NOAA’s Big Data Project Comes Into Focus

What’s different about this newly announced NOAA program is not just the potential “big data” scope of the program but the way in which private sector cloud vendors are involved as intermediaries not only to the public but also to potential data vendors and resellers.
Still, knowing that data exist – which is what the inventories will tell us — is not the same as accessing and interpreting the data. Even assuming the public eventually gains access to the inventoried data, we’ll still need contextual information about the programs described by the data and measurement of the impacts these programs have.