Bits 'n Pieces on Big Data
1.2K views | +0 today
Follow
Bits 'n Pieces on Big Data
Innovative information and insight into Big Data (if you like the content, please consider donating to my bitcoin address #3Pjof6N9xRAYXXSPZ4EAFLfHGn51ZdPcxi)
Curated by onur savas
Your new post is loading...
Your new post is loading...
Scooped by onur savas
Scoop.it!

OpenStack comes up huge for Walmart

OpenStack comes up huge for Walmart | Bits 'n Pieces on Big Data | Scoop.it
For those skeptics who still think OpenStack isn’t ready for prime time, here’s a tidbit: @WalmartLabs is now running in excess of 100,000 cores of OpenStack on its compute layer. And that’s growing by the day. It’s also the technology that ran parent company Walmart’s prodigious Cyber Monday and holiday season sales operations. If that’s not production, I’m not sure what is. San…
more...
No comment yet.
Scooped by onur savas
Scoop.it!

Where The Cloud Meets The Grid

Where The Cloud Meets The Grid | Bits 'n Pieces on Big Data | Scoop.it
Companies build or rent grid machines when data length doesn't fit into HDFS, or the latency of parallel interconnects is too slow in the cloud. This review ex…
more...
No comment yet.
Scooped by onur savas
Scoop.it!

The Cloud, Visualizations and Apps: Wikibon’s Big Data Predictions for 2014 | The Big Data Hub

The Cloud, Visualizations and Apps: Wikibon’s Big Data Predictions for 2014 | The Big Data Hub | Bits 'n Pieces on Big Data | Scoop.it
The Cloud, Visualizations and Apps: Wikibon’s Big Data Predictions for 2014
more...
No comment yet.
Scooped by onur savas
Scoop.it!

NASA brings Earth science 'big data' to the cloud with Amazon web services

NASA brings Earth science 'big data' to the cloud with Amazon web services | Bits 'n Pieces on Big Data | Scoop.it
(Phys.org) —NASA and Amazon Web Services Inc. (AWS) of Seattle, Wash., are making a large collection of NASA climate and Earth science satellite data available to research and educational users through the AWS cloud.
more...
No comment yet.
Scooped by onur savas
Scoop.it!

Cycle Computing use case: Amazon's high-performance computing potential

Cycle Computing use case: Amazon's high-performance computing potential | Bits 'n Pieces on Big Data | Scoop.it

Cycle Computing and Schrödinger have broken their own record for running a massive HPC cluster on Amazon Web Services. Last year, the two software companies spun up a 50,000-node Amazon Web Services cluster for a complex computational drug design application.

more...
No comment yet.
Scooped by onur savas
Scoop.it!

Analyzing Your Data on the AWS Cloud (with R)

Analyzing Your Data on the AWS Cloud (with R) | Bits 'n Pieces on Big Data | Scoop.it

I have recently had the delight to participate in a “Brain Hackathon” organized as part of the OHBM2013 conference. Being supported by Amazon, the hackathon participants were provided with Amazon credit in order to promote the analysis using Amazon’s Web Services (AWS). We badly needed this computing power, as we had 14*10^9 p-values to compute in order to localize genetic associations in the brain leading to Figure 1.

more...
No comment yet.
Scooped by onur savas
Scoop.it!

Deploy and Manage Hadoop on OpenStack: Savanna

Deploy and Manage Hadoop on OpenStack: Savanna | Bits 'n Pieces on Big Data | Scoop.it

Savanna aims to provide users with simple means to provision a Hadoop cluster by specifying several parameters like Hadoop version, cluster topology, nodes hardware details and a few more. After user fills in all the parameters, Savanna deploys the cluster in a few minutes. Also provides means to scale already provisioned cluster by adding/removing worker nodes on demand.

onur savas's insight:

Savanna is going to be part of OpenStack. It was presented a frew days ago at "Unconference track" on April 15th, 2013 during OpenStack Summit in Portland. A great feature: Both deployment and monitoring tools will be installed on stand-alone VMs, thus allowing a single instance to manage/monitor several clusters at once.

more...
No comment yet.
Scooped by onur savas
Scoop.it!

Project Maelstrom: The Internet We Build Next

Project Maelstrom: The Internet We Build Next | Bits 'n Pieces on Big Data | Scoop.it
An invite-only Alpha to help build the distributed web. It started with a simple question. What if more of the web worked the way BitTorrent does? Project Maelstrom begins to answer that question w...
onur savas's insight:

http://www.technologyreview.com/news/534501/bittorrent-tests-websites-hosted-in-the-crowd-not-the-cloud/

more...
No comment yet.
Scooped by onur savas
Scoop.it!

Enabling a new future for cloud computing - US National Science Foundation (NSF)

Enabling a new future for cloud computing - US National Science Foundation (NSF) | Bits 'n Pieces on Big Data | Scoop.it

The National Science Foundation (NSF) today announced two $10 million projects to create cloud computing testbeds--to be called "Chameleon" and "CloudLab"--that will enable the academic research community to develop and experiment with novel cloud architectures and pursue new, architecturally-enabled applications of cloud computing.

 

onur savas's insight:

Chameleon: http://www.chameleoncloud.org/

 

CloudLab: http://www.cloudlab.us/

 

more...
No comment yet.
Scooped by onur savas
Scoop.it!

Massachusetts Open Cloud » Rafik Hariri Institute for Computing and Computational Science & Engineering | Boston University

Massachusetts Open Cloud » Rafik Hariri Institute for Computing and Computational Science & Engineering | Boston University | Bits 'n Pieces on Big Data | Scoop.it

With the governor of Massachusetts pledging $3 million in state support, BU leaders Friday announced plans for development of a pathbreaking computing cloud that could spur economic growth and technology innovation.

more...
No comment yet.
Scooped by onur savas
Scoop.it!

Amazon wades into big data streams with Kinesis

Amazon wades into big data streams with Kinesis | Bits 'n Pieces on Big Data | Scoop.it
Service is designed to take on data firehoses like Twitter's in AWS' cloud.
more...
No comment yet.
Scooped by onur savas
Scoop.it!

OpenStack Operations Guide (free e-book)

OpenStack Operations Guide (free e-book) | Bits 'n Pieces on Big Data | Scoop.it

This book offers hard-earned experience from OpenStack operators who have run OpenStack in production for six months or longer. 

more...
No comment yet.
Scooped by onur savas
Scoop.it!

Predictive Analytics in the Cloud 2013 - Opportunities, Trends and the Impact of Big Data

Predictive Analytics in the Cloud 2013 - Opportunities, Trends and the Impact of Big Data | Bits 'n Pieces on Big Data | Scoop.it
The intersection of these two technologies is creating new opportunities for value and new ways to exploit Big Data
more...
No comment yet.
Scooped by onur savas
Scoop.it!

Running a Multi-Node Storm Cluster

Running a Multi-Node Storm Cluster | Bits 'n Pieces on Big Data | Scoop.it
Setting up a distributed Storm cluster on RHEL 6 with process supervision
onur savas's insight:

Storm is a promising technology to run real-time distributed analytical processes. This tutorial covers how one can run a Storm cluster on multiple nodes.

more...
No comment yet.
Scooped by onur savas
Scoop.it!

OpenStack Grizzly Architecture (revisited)

OpenStack Grizzly Architecture (revisited) | Bits 'n Pieces on Big Data | Scoop.it
As OpenStack has continued to mature, it has become more complicated in some ways but radically simplified in others. From a deployers view, each service has become easier to deploy with more sensi...
more...
No comment yet.
Scooped by onur savas
Scoop.it!

OpenStack Summit 2013 Session Videos

OpenStack Summit 2013 Session Videos | Bits 'n Pieces on Big Data | Scoop.it

The OpenStack Summit 2013 is a four-day conference (April 15-18, 2013) for developers, users, and administrators of OpenStack Cloud Software.

more...
No comment yet.
Scooped by onur savas
Scoop.it!

Designing Big Data That Works - New York Times (blog)

Designing Big Data That Works - New York Times (blog) | Bits 'n Pieces on Big Data | Scoop.it
New York Times (blog) Designing Big Data That Works New York Times (blog) Whether the move is from mainframes to minicomputers, or from there to personal computers and servers, and now to mobile devices and cloud computing, we are witnessing one...
more...
No comment yet.