Decision Intelligence News
35.4K views | +31 today
 
Scooped by Decision Intelligence
onto Decision Intelligence News
January 3, 2014 9:17 PM
Scoop.it!

Beyond Big Data: Identifying Important Information for Real World Challenges | NECSI

Beyond Big Data: Identifying Important Information for Real World Challenges | NECSI | Decision Intelligence News | Scoop.it
Decision Intelligence's insight:

A landmark paper and the most accessible treatment I've seen on why more data does not produce better decisions.


"Consider a block sliding down an inclined plane. To address the micro scale—the molecules—we average over them and, using thermodynamics, describe their temperature and pressure. To address the macro scale—the block and the inclined plane—we use Newtonian physics to talk about their large scale motion (see Fig. 2). In this case, the pieces can be considered to be acting either independently (the random relative motion on the micro scale) or coherently (the average motion on the macro scale) and since the scales ares ufficiently distinct we do not encounter a problem in describing them separately.


But many systems, especially those we are interested in understanding and influencing, are not well described by two separate levels. Consider a flock of birds as it leaves a tree in response to a crack of thunder. If all of the birds flew independently in different directions, we would need to describe each one separately. If they instead all went in the same direction, we could simply describe their average motion. On the other hand, if we were interested in how the birds move from the initial mostly independent directions of movement, into groups and then came together as a flock, describing each bird’s motion would be too much information and describing the average would be too little information."


This is the press release. The paper is here: http://www.necsi.edu/projects/yaneer/information/infoimportance.pdf

Dr. Joe Boutte's comment, January 4, 2014 10:23 AM
Absolutely thought-provoking, applicable article for understanding the power and limitations of datas and analytics. Rips through the hype of "big data" to provide a focus on understanding universality. I particularly find the idea of selecting the relevant variables and understanding the same number of states as the system being evaluated, which enables the states to be mapped to the states of the system. As the authors posit, “If a model has fewer states than the system, then it can’t represent everything that is happening in the system. If a model has more states, then it is representing things that can’t happen in the system.” Thanks for sharing this important paper and research.
Dr. Joe Boutte's comment, January 4, 2014 10:33 AM
This statement cut to the heart of the issue: "as an effort to objectively determine what is important and unimportant rather than collecting as much information as possible is a means for advancing our understanding and addressing many practical biological and social challenges." Thanks again!
Dr. Joe Boutte's curator insight, January 4, 2014 10:36 AM

This important paper which cuts through the hype of big data and focuses on complex systems, universality, and behaviors if helpful for understanding complex organizations and insightful for forming leadership strategies.

Decision Intelligence News
Decision Intelligence (DI) is the discipline concerned with how organizations and individuals design, support, and improve decision making at scale. It connects actions to outcomes in context by integrating human judgment, data, models, text, and AI into coherent decision systems. Decision Intelligence News curates developments across DI and related fields, including AI, machine learning, governance, enterprise architecture, orchestration, measurement, and decision modeling. Learn more at www.opendi.org and www.learn-di.com.
Curated by Decision Intelligence