Bits 'n Pieces on...
Follow
Find
1.2K views | +1 today
 
Bits 'n Pieces on Big Data
Innovative information and insight into Big Data (if you like the content, please consider donating to my bitcoin address #1MhtqfDaAsy4TpYwjS2Kq2DMKrecupbx8c)
Curated by onur savas
Your new post is loading...
Your new post is loading...
Scooped by onur savas
Scoop.it!

The Netflix Tech Blog: RAD - Outlier Detection on Big Data

The Netflix Tech Blog: RAD - Outlier Detection on Big Data | Bits 'n Pieces on Big Data | Scoop.it

"Outlier detection can be a pain point for all data driven companies, especially as data volumes grow. At Netflix we have multiple datasets growing by 10B+ record/day and so there’s a need for automated anomaly detection tools ensuring data quality and identifying suspicious anomalies. Today we are open-sourcing our outlier detection function, called Robust Anomaly Detection (RAD), as part of our Surus project."

more...
No comment yet.
Scooped by onur savas
Scoop.it!

How Do Big Data Analytics Enhance Network Security?

How Do Big Data Analytics Enhance Network Security? | Bits 'n Pieces on Big Data | Scoop.it
Big Data and Big Data analytics have become hot topics in recent years. Unlike traditional methods of cause and effect deduction, Big Data analytics generate predictions based on such enormous volumes of data, that only the tools of association and inference are useful for finding relevance or meaning. An interesting case [...]
more...
No comment yet.
Scooped by onur savas
Scoop.it!

Big Data Analytics, Mobile Technologies And Robotics Defining The Future Of Digital Factories

Big Data Analytics, Mobile Technologies And Robotics Defining The Future Of Digital Factories | Bits 'n Pieces on Big Data | Scoop.it
47% of manufacturers expect big data analytics to have a major impact on company performance making it core to the future of digital factories. 36% expect mobile technologies and applications to improve their company’s financial performance today and in the future. 49% expect advanced analytics to reduce operational costs and utilize assets [...]
more...
No comment yet.
Scooped by onur savas
Scoop.it!

The Face Detection Algorithm Set to Revolutionize Image Search | MIT Technology Review

The Face Detection Algorithm Set to Revolutionize Image Search | MIT Technology Review | Bits 'n Pieces on Big Data | Scoop.it
The ability to spot faces from any angle, and even when partially occluded, has always been a uniquely human capability. Not anymore.
onur savas's insight:

Ref: arxiv.org/abs/1502.02766  Multi-view Face Detection Using Deep Convolutional Neural Networks

more...
No comment yet.
Scooped by onur savas
Scoop.it!

What Makes Images Go Viral? There's a Science to It

What Makes Images Go Viral? There's a Science to It | Bits 'n Pieces on Big Data | Scoop.it
A number of surprising factors could make images go viral on different social media platforms.
more...
No comment yet.
Scooped by onur savas
Scoop.it!

Google open sources a MapReduce framework for C/C++

Google open sources a MapReduce framework for C/C++ | Bits 'n Pieces on Big Data | Scoop.it
Google announced on Wednesday that the company is open sourcing a MapReduce framework that will let users run native C and C++ code in their Hadoop environments. Depending on how much traction MapReduce for C, or MR4C, gets and by whom, it could turn out to be a pretty big deal. Hadoop is famously, or…
more...
No comment yet.
Scooped by onur savas
Scoop.it!

Launching Answers by Crashlytics | Crashlytics Blog

Launching Answers by Crashlytics | Crashlytics Blog | Bits 'n Pieces on Big Data | Scoop.it

Built by a hardcore team, Crashlytics is an elegant solution to a big data problem. The most powerful, yet lightest weight crash reporting solution, we find the needle in the haystack, even the exact line of code that your app crashed on.

more...
No comment yet.
Scooped by onur savas
Scoop.it!

Making Use of Imperfect Big Data: NASA Perspective

Making Use of Imperfect Big Data: NASA Perspective | Bits 'n Pieces on Big Data | Scoop.it
Big data can be messy and sometimes lives on different servers. Dr. Amy Braverman the Principal Statistician, Jet Propulsion Laboratory talks about using disparate data sets to form meaningful conclusions. She speaks with WSJ’s Senior Deputy Technology Editor Scott Thurm at the CIO Network in San Diego, Calif.
more...
No comment yet.
Scooped by onur savas
Scoop.it!

Big Data and Health Analytics: Using Data to Improve Health Care Decisions (Book Review)

Big Data and Health Analytics: Using Data to Improve Health Care Decisions (Book Review) | Bits 'n Pieces on Big Data | Scoop.it
While mountains of raw health care data continue to grow, the challenge of turning that data into usable, actionable information is largely being unmet. There ...
more...
No comment yet.
Scooped by onur savas
Scoop.it!

The end of privacy [Science]

The end of privacy [Science] | Bits 'n Pieces on Big Data | Scoop.it

At birth, your data trail began. You were given a name, your height and weight were recorded, and probably a few pictures were taken. A few years later, you were enrolled in day care, you received your first birthday party invitation, and you were recorded in a census. Today, you have a Social Security or national ID number, bank accounts and credit cards, and a smart phone that always knows where you are. Perhaps you post family pictures on Facebook; tweet about politics; and reveal your changing interests, worries, and desires in thousands of Google searches. Sometimes you share data intentionally, with friends, strangers, companies, and governments. But vast amounts of information about you are collected with only perfunctory consent—or none at all. Soon, your entire genome may be sequenced and shared by researchers around the world along with your medical records, flying cameras may hover over your neighborhood, and sophisticated software may recognize your face as you enter a store or an airport.

more...
No comment yet.
Scooped by onur savas
Scoop.it!

Project Maelstrom: The Internet We Build Next

Project Maelstrom: The Internet We Build Next | Bits 'n Pieces on Big Data | Scoop.it
An invite-only Alpha to help build the distributed web. It started with a simple question. What if more of the web worked the way BitTorrent does? Project Maelstrom begins to answer that question w...
onur savas's insight:

http://www.technologyreview.com/news/534501/bittorrent-tests-websites-hosted-in-the-crowd-not-the-cloud/

more...
No comment yet.
Scooped by onur savas
Scoop.it!

Why the 'Data Lake' is Really a 'Data Swamp'

Why the 'Data Lake' is Really a 'Data Swamp' | Bits 'n Pieces on Big Data | Scoop.it
The notion of putting all one's data into a "data lake" to encourage employees to run analytics has a serious flaw.
more...
No comment yet.
Scooped by onur savas
Scoop.it!

Engineering the public: Big data, surveillance and computational politics | Tufekci | First Monday

Engineering the public: Big data, surveillance and computational politics | Tufekci | First Monday | Bits 'n Pieces on Big Data | Scoop.it

Digital technologies have given rise to a new combination of big data and computational practices which allow for massive, latent data collection and sophisticated computational modeling, increasing the capacity of those with resources and access to use these tools to carry out highly effective, opaque and unaccountable campaigns of persuasion and social engineering in political, civic and commercial spheres. I examine six intertwined dynamics that pertain to the rise of computational politics: the rise of big data, the shift away from demographics to individualized targeting, the opacity and power of computational modeling, the use of persuasive behavioral science, digital media enabling dynamic real-time experimentation, and the growth of new power brokers who own the data or social media environments. I then examine the consequences of these new mechanisms on the public sphere and political campaigns.

more...
No comment yet.
Scooped by onur savas
Scoop.it!

Study Uses Big Data To Track Link Between Social Activity And Urban Movement

Study Uses Big Data To Track Link Between Social Activity And Urban Movement | Bits 'n Pieces on Big Data | Scoop.it
Cities may appear to be fueled by industrial activity but urban movement, it turns out, is also largely influenced by social interactions, as determined by a study.
more...
No comment yet.
Scooped by onur savas
Scoop.it!

Microsoft embraces Python, Linux in new big data tools

Microsoft embraces Python, Linux in new big data tools | Bits 'n Pieces on Big Data | Scoop.it
Continuing its quest to make Microsoft Azure comfy for the non-Windows world, Microsoft just launched a preview of its Hadoop-based cloud tool (HDInsight) that runs on Linux. It’s also making its Azure ML machine learning service widely available now with new support for Python as well as the already-planned support for the popular R language. Microsoft bought Revolution Analytics, the company…
more...
No comment yet.
Scooped by onur savas
Scoop.it!

"Data Science: Where are We Going?" - Dr. DJ Patil (Strata + Hadoop 2015) - YouTube

Data Science, where are we going? What impact can we expect? With a special introduction from President Barack Obama. Watch more from Strata + Hadoop San Jos...
onur savas's insight:

This is the most interesting presentation but many more material in this year's Strata: http://strataconf.com/big-data-conference-ca-2015/public/content/home

more...
No comment yet.
Scooped by onur savas
Scoop.it!

Big data and Hadoop predictions for 2015 - Hortonworks

Big data and Hadoop predictions for 2015 - Hortonworks | Bits 'n Pieces on Big Data | Scoop.it
According to recent estimates by IDC, the global market for big data and predictive analytics services will likely grow to $125 billion in 2015. Use of advanced analytics platforms is also expected to accelerate dramatically in the coming year. Enterprises are utilizing big data tools like Hadoop more frequently as new uses emerge on an almost daily basis. …
more...
No comment yet.
Scooped by onur savas
Scoop.it!

OpenStack comes up huge for Walmart

OpenStack comes up huge for Walmart | Bits 'n Pieces on Big Data | Scoop.it
For those skeptics who still think OpenStack isn’t ready for prime time, here’s a tidbit: @WalmartLabs is now running in excess of 100,000 cores of OpenStack on its compute layer. And that’s growing by the day. It’s also the technology that ran parent company Walmart’s prodigious Cyber Monday and holiday season sales operations. If that’s not production, I’m not sure what is. San…
more...
No comment yet.
Scooped by onur savas
Scoop.it!

A Google-Backed Research Project Aims to Automate Data Analysis | MIT Technology Review

A Google-Backed Research Project Aims to Automate Data Analysis | MIT Technology Review | Bits 'n Pieces on Big Data | Scoop.it
Software that can discover patterns in data and write a report on its findings could make it easier for companies to analyze it.
more...
No comment yet.
Scooped by onur savas
Scoop.it!

Clarifai’s Machine-Learning Software Can Understand What’s in Your Videos

Clarifai’s Machine-Learning Software Can Understand What’s in Your Videos | Bits 'n Pieces on Big Data | Scoop.it
Software that understands what it sees in video could lead to new forms of advertising, or make video editing easier.
more...
No comment yet.
Scooped by onur savas
Scoop.it!

Big Data: How Geo-information Helped Shape the Future of Data Engineering

Big Data: How Geo-information Helped Shape the Future of Data Engineering | Bits 'n Pieces on Big Data | Scoop.it

Very large data sets are the common rule in automated mapping, GIS, remote sensing, and what we can name geo-information. Indeed, in 1983 Landsat was already delivering gigabytes of data, and other sensors were in orbit or ready for launch, and a tantamount of cartographic data was being digitized. The retrospective paper revisits several issues that geo-information sciences had to face from the early stages on, including: structure ( to bring some structure to the data registered from a sampled signal, metadata); processing (huge amounts of data for big computers and fast algorithms); uncertainty (the kinds of errors, their quantification); consistency (when merging different sources of data is logically allowed, and meaningful); ontologies (clear and agreed shared definitions, if any kind of decision should be based upon them). All these issues are the background of Internet queries, and the underlying technology has been shaped during those years when geo-information engineering emerged.

more...
No comment yet.
Scooped by onur savas
Scoop.it!

Build an IoT analytics solution with big data tools

Build an IoT analytics solution with big data tools | Bits 'n Pieces on Big Data | Scoop.it
The Internet of things seems futuristic, but real systems are delivering real analytics value today. Here's some real-world IoT advice from the field
more...
No comment yet.
Scooped by onur savas
Scoop.it!

Graph Processing Inside an Analytic DBMS

Graph Processing Inside an Analytic DBMS | Bits 'n Pieces on Big Data | Scoop.it
Although the Bulk Synchronous Parallel (BSP) model for scalable parallel processing was invented by Leslie Valiant in the 1980s (and was cited as part of the reason for Valiant’s recent Turing award
more...
No comment yet.