Big Data Analysis...
Follow
Find
30.8K views | +0 today
Big Data Analysis in the Clouds
Scientific, economic, social, political and cultural issues
Curated by Pierre Levy
Your new post is loading...
Your new post is loading...
Scooped by Pierre Levy
Scoop.it!

For your eyes only: How the personalized Web is transforming our relationship with technology

For your eyes only: How the personalized Web is transforming our relationship with technology | Big Data Analysis in the Clouds | Scoop.it
Social media already adds a personal layer to our online experience, but next-generation Web services are tapping the power of the cloud and massive data sets to bring us a new level ...
more...
No comment yet.
Scooped by Pierre Levy
Scoop.it!

Advancing Genomics Through Big Data Studies

Advancing Genomics Through Big Data Studies | Big Data Analysis in the Clouds | Scoop.it
Genomics is a critically important discipline in contemporary biomedical research that takes a comprehensive approach to determining and understanding the structure and function of DNA to advance our understanding of life and our ability to make...
more...
No comment yet.
Rescooped by Pierre Levy from Big Data
Scoop.it!

Welcome to the Datascience@Berkeley Blog

Welcome to the Datascience@Berkeley Blog | Big Data Analysis in the Clouds | Scoop.it

This blog is not just about our program, nor is it about us. This blog is about data science as a whole, a field that encompasses…everything. What do we mean by that? Every interaction – health care, education, e-commerce — produces data. We have information about traffic jams, graduation rates, poverty levels, and more. And, in order to make sense of this massive amount of data, we need people who can identify the relevant pieces and use them to make smart decisions that will truly make an impact.


Via Ed Stenson
more...
No comment yet.
Scooped by Pierre Levy
Scoop.it!

Privacy as the next green movement? Study says companies will compete on data practices

Privacy as the next green movement? Study says companies will compete on data practices | Big Data Analysis in the Clouds | Scoop.it
Remember the 1990′s when companies rushed to brand their products as “enviro-friendly” to attract green-conscious consumers?
more...
Edward S Gilbert Jr's curator insight, July 31, 2013 8:37 AM

Privacy needs to be addressed in actual real-time terms rather then being used as another marketing tool or ploy to appear they are addressing the issue of peoples privacy being violated.

Scooped by Pierre Levy
Scoop.it!

At Netflix, big data can affect even the littlest things

At Netflix, big data can affect even the littlest things | Big Data Analysis in the Clouds | Scoop.it
There has been a lot of talk about data after the success of “Orange is the New Black” on Netflix, but as the content competition picks up in streaming TV, it might be the little things where big data has the biggest impact.
more...
No comment yet.
Scooped by Pierre Levy
Scoop.it!

It appears big data can make us better artists, too

It appears big data can make us better artists, too | Big Data Analysis in the Clouds | Scoop.it
Two separate research projects from Carnegie Mellon University and Disney Research have analyzed digital sketches in order to detect patterns in people’s drawings.
more...
No comment yet.
Scooped by Pierre Levy
Scoop.it!

Why you should never trust a data scientist

Why you should never trust a data scientist | Big Data Analysis in the Clouds | Scoop.it
Photo by Jesse Means The wonderful thing about being a data scientist is that I get all of the credibility of genuine science, with none of the irritating peer review or reproducibility worries. My...
more...
No comment yet.
Scooped by Pierre Levy
Scoop.it!

Microsoft now has one million servers – less than Google, but more than Amazon, says Ballmer | ExtremeTech

Microsoft now has one million servers – less than Google, but more than Amazon, says Ballmer | ExtremeTech | Big Data Analysis in the Clouds | Scoop.it
At Microsoft's 2013 Worldwide Partner Conference, CEO Steve Ballmer gave us a very interesting tidbit about the scale of Microsoft's server operations.
more...
No comment yet.
Rescooped by Pierre Levy from Big Data, IoT and other stuffs
Scoop.it!

El complejo militar-empresarial israelí ya tiene big data - MIT Technology Review

El complejo militar-empresarial israelí ya tiene big data - MIT Technology Review | Big Data Analysis in the Clouds | Scoop.it
Una tecnología para rastrear el movimiento de enemigos sirve de base para que Israel entre en el campo del software de predicción comercial.

Via Toni Sánchez
more...
No comment yet.
Rescooped by Pierre Levy from e-Xploration
Scoop.it!

Analyzing the Analyzers - "The variety of data scientist". O'Reilly Media | #datascience #dataviz

Analyzing the Analyzers - "The variety of data scientist". O'Reilly Media | #datascience #dataviz | Big Data Analysis in the Clouds | Scoop.it

There has been intense excitement in recent years around activities labeled data science, big data, and analytics....


Via luiy
more...
luiy's curator insight, July 9, 2013 8:55 AM

However, the lack of clarity around these terms and, particularly, around the skill sets and capabilities of their practitioners has led to inefficient communication between "data scientists" and the organizations requiring their services. This lack of clarity has frequently led to missed opportunities. To address this issue, we surveyed several hundred practitioners via the Web to explore the varieties of skills, experiences, and viewpoints in the emerging data science community.

 

We used dimensionality reduction techniques to divide potential data scientists into five categories based on their self-ranked skill sets (Statistics, Math/Operations Research, Business, Programming, and Machine Learning/Big Data), and four categories based on their self-identification (Data Researchers, Data Businesspeople, Data Engineers, and Data Creatives). Further examining the respondents based on their division into these categories provided additional insights into the types of professional activities, educational background, and even scale of data used by different types of Data Scientists.

 

In this report, we combine our results with insights and data from others to provide a better understanding of the diversity of practitioners, and to argue for the value of clearer communication around roles, teams, and careers.

Rescooped by Pierre Levy from Homo Numericus Bis
Scoop.it!

What Kind Of Data Scientist Are You?

What Kind Of Data Scientist Are You? | Big Data Analysis in the Clouds | Scoop.it
OReilly just surveyed 250 data scientists about their skills and came up with the four types of data scientistand one shocking outside finding.

Via Mlik Sahib
more...
No comment yet.
Scooped by Pierre Levy
Scoop.it!

Big Data Analysis Drives Revolution In Travel

Big Data Analysis Drives Revolution In Travel | Big Data Analysis in the Clouds | Scoop.it
Airlines, hotels and reservation sites are making the most of data to improve booking ratios, boost revenue yield and improve customer satisfaction.
more...
No comment yet.
Scooped by Pierre Levy
Scoop.it!

What happens when the world turns into one giant brain

What happens when the world turns into one giant brain | Big Data Analysis in the Clouds | Scoop.it
Currently much of the big data being churned out is merely exhaust. But imagine the possibilities once we figure out how to produce and process better data on the fly on a global scale. Call it Big Inference.
more...
luiy's curator insight, July 1, 2013 11:47 AM
Key problems in the way

To get there though we’ll have to confront a number of hurdles:

We need to gather the data. Emerging, massively distributed and networked sensors will be the equivalent of human sensory transducers like rods and cones. The rise of the Internet of Things also means that every device will be able to contribute its own data stream to a collective understanding of the current state of the world.

 

Much of the content of big data these days is exhaust – data originally collected for transactional or other purposes, for which mining and analysis are afterthoughts, and whose characteristics are often ill-suited to further analysis. This will certainly change, as data collection matures into a process explicitly designed to improve our peceptual and decision-making capabilities.

 

We need the processing power to interpret the data While it has become fashionable to note how cheap compute cycles have become, it’s certainly not the case that we can process billions or trillions of input streams in real time –especially when we need to find patterns that are distributed across many noisy and possibly contradictory sensor inputs (i.e., we can’t just process each stream in isolation). We may need to develop new processor technologies to handle these kind of astronomically parallel and heterogeneous inputs.

 

We need the algorithms. To actually make sense of the data and decide what actions and responses to take, we have to figure out how to extract high-level patterns and concepts from the raw inputs. There is an ongoing debate over the right approach: Most researchers will say that we need something more “brain-like” than current systems, but there are many different (and opposing) theories about which aspects of our brain’s computational architecture are actually important. My own bet is on probabilistic programming methods, which are closely aligned with an emerging body of theory that views the brain as a Bayesian inference and decision engine.

Scooped by Pierre Levy
Scoop.it!

How Data Science Is Transforming Health Care - O'Reilly Media

In the early days of the 20th century, department store magnate John Wanamaker famously said, I know that half of my advertising doesn't work. The problem is that I don't know which half. That remained...
Pierre Levy's insight:

Interesting, but to be taken cautiously

more...
No comment yet.
Rescooped by Pierre Levy from Big Data
Scoop.it!

Statistical Thinking: The Bedrock of Data Science

Statistical Thinking: The Bedrock of Data Science | Big Data Analysis in the Clouds | Scoop.it
It is true that the tactics for managing and analyzing Big Data are changing and improving, but the strategies for working with Big Data, as well as small data, are still based on a rock-solid foundation of good statistical thinking.

Via Ed Stenson
more...
No comment yet.
Rescooped by Pierre Levy from Big Data, IoT and other stuffs
Scoop.it!

Big data en la vanguardia

Big data en la vanguardia | Big Data Analysis in the Clouds | Scoop.it
Los datos son las materias primas de esta era de información, ya sea en formas estructuradas como las transacciones en cajeros automáticos o no estructurados como tweets o videos de YouTube.Mucha de la información que está aprovechando es no...

Via Toni Sánchez
more...
No comment yet.
Rescooped by Pierre Levy from Digital Data
Scoop.it!

Why you should never trust a data visualisation

Why you should never trust a data visualisation | Big Data Analysis in the Clouds | Scoop.it
Pete Warden is spot on about being sceptical of data, but it is data visualisation, not data science, where caution is most crucial

Via Pierre Tran
more...
Pierre Tran's curator insight, July 24, 2013 5:34 PM

Une mise en garde contre l'acceptation aveugle des datavisualisations

Rescooped by Pierre Levy from Big Data
Scoop.it!

Five Roles You Need on Your Big Data Team

Quant skills are necessary but not sufficient.

Via Ed Stenson
more...
No comment yet.
Scooped by Pierre Levy
Scoop.it!

The week in big data on Twitter, visualized

The week in big data on Twitter, visualized | Big Data Analysis in the Clouds | Scoop.it
Here’s a look at the most popular topics, news and posts on Twitter over the past week — at least based on my analysis using a collection of free tools.
more...
Marcelo Santos's curator insight, July 21, 2013 2:52 PM

Cómo usar varias herramientas para analizar la agenda de twitter

Scooped by Pierre Levy
Scoop.it!

MBAs: Schools answer call for big data experts - FT.com

MBAs: Schools answer call for big data experts - FT.com | Big Data Analysis in the Clouds | Scoop.it
Consumer industries are amassing huge data sets, highlighting the importance of choosing the right analytical models to help make commercial decisions.
more...
No comment yet.
Scooped by Pierre Levy
Scoop.it!

Finding harmony with big data - MIT News Office

Finding harmony with big data - MIT News Office | Big Data Analysis in the Clouds | Scoop.it
Technology developed by two MIT alumni entrepreneurs is helping developers create smarter online music-streaming services.
more...
Intriguing Networks's curator insight, July 16, 2013 12:37 PM

Big Data helping onlie Music streaming service improve itself...

Rescooped by Pierre Levy from Big Data, IoT and other stuffs
Scoop.it!

Un proyecto científico utilizará Big Data para explorar el universo

Un proyecto científico utilizará Big Data para explorar el universo | Big Data Analysis in the Clouds | Scoop.it
Se abordarán cuestiones como el Big Bang a través del reconocimiento de ciertos patrones de los datos obtenidos por los astrónomos con la construcción del mayor telescopio hasta ahora.

Via Toni Sánchez
more...
No comment yet.
Scooped by Pierre Levy
Scoop.it!

Trust Is Not An Algorithm: Big Data Are Hot, But They Also Miss A Lot

Trust Is Not An Algorithm: Big Data Are Hot, But They Also Miss A Lot | Big Data Analysis in the Clouds | Scoop.it
more...
No comment yet.
Rescooped by Pierre Levy from Exploration de données
Scoop.it!

Four Big Data Trends That Change Everything

Four Big Data Trends That Change Everything | Big Data Analysis in the Clouds | Scoop.it

1. The rise of easy access to cheap analytic tools will require you to rethink your business model.
2. Marketing is transforming from control to collaboration.
3. Evolution from “ask” to “listen” market research.
4. Your product is your research moving forward.

 

 


Via cyberlabe
more...
No comment yet.