Bits 'n Pieces on...
Follow
Find
917 views | +2 today
 
Scooped by onur savas
onto Bits 'n Pieces on Big Data R&D
Scoop.it!

FAQ: All About The New Google "Hummingbird" Algorithm

FAQ: All About The New Google "Hummingbird" Algorithm | Bits 'n Pieces on Big Data R&D | Scoop.it
Google has a new search algorithm, the system it uses to sort through all the information it has when you search and come back with answers. It’s called “Hummingbird” and below, what we know about it so far.
onur savas's insight:

More details in Google's blog: http://insidesearch.blogspot.com/2013/09/fifteen-years-onand-were-just-getting.html

 

more...
No comment yet.

From around the web

Bits 'n Pieces on Big Data R&D
Information and insight into Big Data R&D
Curated by onur savas
Your new post is loading...
Your new post is loading...
Scooped by onur savas
Scoop.it!

Graph Processing Inside an Analytic DBMS

Graph Processing Inside an Analytic DBMS | Bits 'n Pieces on Big Data R&D | Scoop.it
Although the Bulk Synchronous Parallel (BSP) model for scalable parallel processing was invented by Leslie Valiant in the 1980s (and was cited as part of the reason for Valiant’s recent Turing award
more...
No comment yet.
Scooped by onur savas
Scoop.it!

Where The Cloud Meets The Grid

Where The Cloud Meets The Grid | Bits 'n Pieces on Big Data R&D | Scoop.it
Companies build or rent grid machines when data length doesn't fit into HDFS, or the latency of parallel interconnects is too slow in the cloud. This review ex…
more...
No comment yet.
Scooped by onur savas
Scoop.it!

How the Department of Defense is using big data to combat sex trafficking

How the Department of Defense is using big data to combat sex trafficking | Bits 'n Pieces on Big Data R&D | Scoop.it
The Defense Advanced Research Projects Agency (DARPA) shows its humanitarian side.
more...
No comment yet.
Scooped by onur savas
Scoop.it!

LabHack

LabHack | Bits 'n Pieces on Big Data R&D | Scoop.it

LabHack is the first Air Force hackathon aimted at building solutions to real-world challenges that AFRL researchers encounter every day.

more...
No comment yet.
Scooped by onur savas
Scoop.it!

The LinkedIn Economic Graph Challenge

The LinkedIn Economic Graph Challenge | Bits 'n Pieces on Big Data R&D | Scoop.it
How would you use data from LinkedIn to solve the world's economic challenges and create economic opportunities for people? Submit your proposals to the LinkedIn Economic Graph Challenge.
more...
No comment yet.
Scooped by onur savas
Scoop.it!

Mirador

Mirador | Bits 'n Pieces on Big Data R&D | Scoop.it
Mirador is a tool for visual exploration of complex datasets. It enables users to discover correlation patterns and derive new hypotheses from the data.
more...
No comment yet.
Scooped by onur savas
Scoop.it!

Assessing the international spreading risk associated with the 2014 West African Ebola outbreak

Assessing the international spreading risk associated with the 2014 West African Ebola outbreak | Bits 'n Pieces on Big Data R&D | Scoop.it
The 2014 West African Ebola Outbreak is so far the largest and deadliest recorded in history. The affected countries, Sierra Leone, Guinea, Liberia, Nigeria, and recently Senegal have been struggling...
more...
No comment yet.
Scooped by onur savas
Scoop.it!

Course: Tackling the Challenges of Big Data (November 4, 2014 - December 16, 2014)

Course: Tackling the Challenges of Big Data (November 4, 2014 - December 16, 2014) | Bits 'n Pieces on Big Data R&D | Scoop.it
Survey state-of-the-art topics in Big Data: data collection, data storage and processing, extracting structured data from unstructured data, systems issues, analytics and visualization.
more...
No comment yet.
Scooped by onur savas
Scoop.it!

Privacy, Anonymity, and Big Data in the Social Sciences

Privacy, Anonymity, and Big Data in the Social Sciences | Bits 'n Pieces on Big Data R&D | Scoop.it
Quality social science research and the privacy of human subjects require trust.
more...
No comment yet.
Scooped by onur savas
Scoop.it!

On Facebook when the earth shakes...

On Facebook when the earth shakes... | Bits 'n Pieces on Big Data R&D | Scoop.it

On Sunday August 24th, 3:20 a.m Pacific time, an earthquake of magnitude 6.0 occurred in the Bay Area, 3.7 miles (6.0 km) northwest of American Canyon near the West Napa Fault. It was the largest earthquake in the Bay Area since the 1989 Loma Prieta earthquake.

During a crisis, people turn to Facebook (FB) to stay connected to their friends and family. They use it to receive social support and keep the people they care about informed on how they are doing.

Data scientists at FB used aggregate, anonymized Facebook activity data from cities located within 300 kilometers (around 200 miles) from the epicenter and analyzed how their Facebook activity following the earthquake differed from usual activity. A recent post from Jawbone (https://jawbone.com/blog/napa-earthquake-effect-on-sleep/) showed the effect of the earthquake on people's sleep. 

more...
No comment yet.
Scooped by onur savas
Scoop.it!

Why the 'Data Lake' is Really a 'Data Swamp'

Why the 'Data Lake' is Really a 'Data Swamp' | Bits 'n Pieces on Big Data R&D | Scoop.it
The notion of putting all one's data into a "data lake" to encourage employees to run analytics has a serious flaw.
more...
No comment yet.
Scooped by onur savas
Scoop.it!

Engineering the public: Big data, surveillance and computational politics | Tufekci | First Monday

Engineering the public: Big data, surveillance and computational politics | Tufekci | First Monday | Bits 'n Pieces on Big Data R&D | Scoop.it

Digital technologies have given rise to a new combination of big data and computational practices which allow for massive, latent data collection and sophisticated computational modeling, increasing the capacity of those with resources and access to use these tools to carry out highly effective, opaque and unaccountable campaigns of persuasion and social engineering in political, civic and commercial spheres. I examine six intertwined dynamics that pertain to the rise of computational politics: the rise of big data, the shift away from demographics to individualized targeting, the opacity and power of computational modeling, the use of persuasive behavioral science, digital media enabling dynamic real-time experimentation, and the growth of new power brokers who own the data or social media environments. I then examine the consequences of these new mechanisms on the public sphere and political campaigns.

more...
No comment yet.
Scooped by onur savas
Scoop.it!

Facebook Gives Lessons In Network-Datacenter Design

Facebook Gives Lessons In Network-Datacenter Design | Bits 'n Pieces on Big Data R&D | Scoop.it
Every now and again, the hyperscale datacenter operators tell the world about some new tricks they have come up with to solve a particular set of pesky pro
more...
Scooped by onur savas
Scoop.it!

Studying the Big Data Forest While Ignoring Its Trees

Studying the Big Data Forest While Ignoring Its Trees | Bits 'n Pieces on Big Data R&D | Scoop.it

Google recently announced a promising new tool that might help researchers benefit from big data analysis, while at the same time protecting individuals’ privacy. This concept might seem sound counterintuitive at first, but it’s based on a solid mathematical foundation called “differential privacy.”

onur savas's insight:

The project is called RAPPOR: https://github.com/google/rappor

 

more...
No comment yet.
Scooped by onur savas
Scoop.it!

#HBRLive: The Internet of Things, Privacy, and The New Deal on Data

#HBRLive: The Internet of Things, Privacy, and The New Deal on Data | Bits 'n Pieces on Big Data R&D | Scoop.it

HBR senior editor Scott Berinato speaks with MIT's Alex "Sandy” Pentland, who has pioneered the use of sensor technology to collect deeply detailed, big data about people and their interactions.

more...
No comment yet.
Scooped by onur savas
Scoop.it!

Chicago uses big data to save itself from urban ills

Chicago uses big data to save itself from urban ills | Bits 'n Pieces on Big Data R&D | Scoop.it
The Windy City is using sophisticated predictive models to pinpoint risk areas and help it reduce everything from rat problems to cases of lead poisoning
more...
No comment yet.
Scooped by onur savas
Scoop.it!

The Socialist Origins of Big Data

The Socialist Origins of Big Data | Bits 'n Pieces on Big Data R&D | Scoop.it
Evgeny Morozov on how the ideas behind Project Cybersyn, a futuristic experiment in cybernetics from nineteen-seventies Chile, still shapes technology.
more...
No comment yet.
Scooped by onur savas
Scoop.it!

1001 Datasets and Data Repositories

1001 Datasets and Data Repositories | Bits 'n Pieces on Big Data R&D | Scoop.it

1001 Datasets and Data repositories ( List of lists of lists ) - rough list to compile - a rough lists of listsClick here to edit the title

more...
No comment yet.
Scooped by onur savas
Scoop.it!

All-pairs similarity via DIMSUM | Twitter Blogs

All-pairs similarity via DIMSUM | Twitter Blogs | Bits 'n Pieces on Big Data R&D | Scoop.it
Given a dataset of sparse vector data, we solve the problem of finding all similar vector pairs according to a similarity function.
onur savas's insight:

Twitter uses this algorithm to find users, hashtags and ads that are very similar to one another, so they may be recommended and shown to users and advertisers. Sources codes are also provided:


Scalding github pull-request: https://github.com/twitter/scalding/pull/833
Spark github pull-request: https://github.com/apache/spark/pull/336

more...
No comment yet.
Scooped by onur savas
Scoop.it!

The Ultimate Challenge For Recommendation Engines | MIT Technology Review

The Ultimate Challenge For Recommendation Engines | MIT Technology Review | Bits 'n Pieces on Big Data R&D | Scoop.it
If you share an on-line move account with other people in your household, you probably receive some inappropriate recommendations. That may soon change.
more...
No comment yet.