Public Datasets - Open Data -
9.2K views | +7 today
Follow
Public Datasets - Open Data -
Your new post is loading...
Your new post is loading...
Rescooped by luiy from Personal data and technology
Scoop.it!

Beware the Big Errors of #Big Data | #controverses

Beware the Big Errors of #Big Data | #controverses | Public Datasets - Open Data - | Scoop.it
We’re more fooled by noise than ever before, and it’s because of a nasty phenomenon called “big data”. Big data may mean more information, but it also means more false information.

Via C.I.L. CONSULTING
luiy's insight:

Big-data researchers have the option to stop doing their research once they have the right result. In options language: The researcher gets the “upside” and truth gets the “downside.” It makes him antifragile, that is, capable of benefiting from complexity and uncertainty — and at the expense of others.

 

But beyond that, big data means anyone can find fake statistical relationships, since the spurious rises to the surface. This is because in large data sets, large deviations are vastly more attributable to variance (or noise) than to information (or signal). It’s a property of sampling: In real life there is no cherry-picking, but on the researcher’s computer, there is. Large deviations are likely to be bogus.

more...
No comment yet.
Rescooped by luiy from The New Global Open Public Sphere
Scoop.it!

The #open society and its enemies

The #open society and its enemies | Public Datasets - Open Data - | Scoop.it
How open-data compares against other national metricsTHIS week sees a cornucopia of open-data celebrations. Britain’s Open Data Institute is announcing numerous...

Via Pierre Levy
more...
No comment yet.