Big Data Analysis in the Clouds
33.2K views | +0 today
Follow
Big Data Analysis in the Clouds
Scientific, economic, social, political and cultural issues
Curated by Pierre Levy
Your new post is loading...
Your new post is loading...

Explore by Tags

Current selected tag: 'NSA'. Clear.
Scooped by Pierre Levy
Scoop.it!

The Not-So-Secret Technology Behind The NSA Spying Scandal

The Not-So-Secret Technology Behind The NSA Spying Scandal | Big Data Analysis in the Clouds | Scoop.it
Even within the infrastructure of the American surveillance apparatus, the National Security Agency is notoriously secretive.
more...
No comment yet.
Rescooped by Pierre Levy from Exploration de données
Scoop.it!

What the NSA can do with “big data”

What the NSA can do with “big data” | Big Data Analysis in the Clouds | Scoop.it

A single Narus ITA is capable of processing the full contents of 1.5 gigabytes worth of packet data per second. That's 5400 gigabytes per hour, or 129.6 terabytes per day, for each 10-gigabit network tap. All that data gets shoveled off to a set of logic servers using a proprietary messaging protocol, which process and reassemble the contents of the packets, turning petabytes per day into gigabytes of tabular data about traffic—the metadata of the packets passing through the box— and captured application data.

NSA operates many of these network tap operations both in the US and around the world. But that's a massive fire-hose of data to try to digest in any meaningful way and in the early days of packet capture, NSA faced a few major problems with that vast stream of data. Storing it, indexing it, and analyzing it in volume required technology beyond what was generally available commercially. Considering that, according to Cisco, the total world Internet traffic for 2012 was 1.1 exabytes per day is physically impossible, let alone practical, for the NSA to capture and retain even a fraction of the world's Internet traffic on a daily basis.

 

 


Via cyberlabe
more...
No comment yet.