EEDSP
18.8K views | +2 today
Follow
EEDSP
Digital Signal Processing, Data Analytics, Big Data, HPC, Deep Learning, GPGPU, Distributed and Parallel Computing
Curated by Shiwon Cho
Your new post is loading...
Your new post is loading...
Scooped by Shiwon Cho
Scoop.it!

Apache Spark Resource Management and YARN App Models

Apache Spark Resource Management and YARN App Models | EEDSP | Scoop.it

A concise look at the differences between how Spark and MapReduce manage cluster resources under YARN

The most popular Apache YARN application after MapReduce itself is Apache Spark. At Cloudera, we have worked hard to stabilize Spark-on-YARN (SPARK-1101), and CDH 5.0.0 added support for Spark on YARN clusters.

In this post, you’ll learn about the differences between the Spark and MapReduce architectures, why you should care, and how they run on the YARN cluster ResourceManager.

more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

The Flaw Lurking In Every Deep Neural Net

The Flaw Lurking In Every Deep Neural Net | EEDSP | Scoop.it

A recent paper with an innocent sounding title is probably the biggest news in neural networks since the invention of the backpropagation algorithm. But what exactly does it all mean?

A recent paper "Intriguing properties of neural networks" by Christian Szegedy, Wojciech Zaremba, Ilya Sutskever, Joan Bruna, Dumitru Erhan, Ian Goodfellow and Rob Fergus, a team that includes authors from Google's deep learning research project outlines two pieces of news about the way neural networks behave that run counter to what we believed - and one of them is frankly astonishing.

more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

R beats Python! R beats Julia! Anyone else wanna challenge R?

R beats Python!  R beats Julia!  Anyone else wanna challenge R? | EEDSP | Scoop.it
Before I left for China a few weeks ago, I said my next post would be on our Rth parallel R package. It's not quite ready yet, so today I'll post one of the topics I spoke on last night at the Berk...
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Updated PostgreSQL targets NoSQL market - Big Data Analytics News

Updated PostgreSQL targets NoSQL market - Big Data Analytics News | EEDSP | Scoop.it
Embracing the widely used JSON data-exchange format, the new version of the PostgreSQL open-source database takes aim at the growing NoSQL market of nonrelational data stores, notably the popular MongoDB. The first beta version of PostgreSQL 9.4, released Thursday, includes a number of new features that address the rapidly growing...Read more »
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

OpenBTS open-source project

OpenBTS open-source project | EEDSP | Scoop.it

OpenBTS is a Unix application that uses a software radio to present a GSM air interface to standard 2G GSM handset and uses a SIP softswitch or PBX to connect calls. (You might even say that OpenBTS is a simplified form of IMS that works with 2G feature-phone handsets.) The combination of the global-standard GSM air interface with low-cost VoIP backhaul forms the basis of a new type of cellular network that can be deployed and operated at substantially lower cost than existing technologies in many applications, including rural cellular deployments and private cellular networks in remote areas.

more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Grafana - The Graphite dashboard frontend, editor and graph composer

Grafana - The Graphite dashboard frontend, editor and graph composer | EEDSP | Scoop.it
A unique graphite dashboard aimed to be a general purpose dashboard that looks nice and makes it easy to construct and edit dashboards through the UI. It also contains an advanced and unique graph editor and graphite target expression / function editor. Other notible features are fast client side rendering, select to zoom in, multiple y-axes and graph templating.
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

The Best of Both Worlds: Low Cost and Large Scale OpenMP and MPI | Cluster Design | Features

The Best of Both Worlds: Low Cost and Large Scale OpenMP and MPI | Cluster Design | Features | EEDSP | Scoop.it
Cluster Monkey is an exclusive content based site that speaks directly to the high performance computing (HPC) cluster market and community. We focus on benchmarks, tutorials, case studies, and how-to information that is useful to cluster users, administrators, purchasers, and designers.
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Deep learning with COTS HPC systems

Deep learning with COTS HPC systems | EEDSP | Scoop.it
Scaling up deep learning algorithms has been shown to lead to increased performance in benchmark tasks and to enable discovery of complex high-level features. Recent efforts to train extremely larg...
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

The CUDA Thrust API Now Supports Streams and Concurrent Tasks

The CUDA Thrust API Now Supports Streams and Concurrent Tasks | EEDSP | Scoop.it
The CUDA Thrust API now supports streams and concurrent kernels through the use of a new API called Bulk created by Jared Hoberock at NVIDIA. The design of Bulk is intended to extend the parallel e...
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Neo4j 2.0.1 Community Released on Windows Azure VM Depot - Neo4j Graph Database

Neo4j 2.0.1 Community Released on Windows Azure VM Depot - Neo4j Graph Database | EEDSP | Scoop.it

We have released a Linux distribution of Neo4j 2.0.1 community on Windows Azure’s VM Depot website. Users of Windows Azure are now able to copy a platform image of Neo4j 2.0.1 directly from the VM Depot. Once provisioned, a fresh …

more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Introducing Pinterest Secor

Introducing Pinterest Secor | EEDSP | Scoop.it

As we build products to eventually power Promoted Pins, it’s vital to maintain a no-fail reliable data infrastructure. Today we’re open sourcing Secor, a zero data loss log persistence service whose initial use case was to save logs produced by our monetization pipeline.

more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

DARPA is working on its own deep-learning project for natural-language processing

DARPA is working on its own deep-learning project for natural-language processing | EEDSP | Scoop.it
The Defense Advanced Research Projects Agency, or DARPA, is building a set of technologies to help it better understand human language so it can analyze speech and text sources and alert analysts of potentially useful information.
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Facebook Open Sources Animation Engine Pop That Powers Paper

Facebook Open Sources Animation Engine Pop That Powers Paper | EEDSP | Scoop.it
Facebook today open sourced Pop, the engine behind Paper's smooth animations and transitions, over on GitHub. Pop uses dynamic instead of traditional stati
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

The Triumph Of Deep Learning

The Triumph Of Deep Learning | EEDSP | Scoop.it

Deep Neural Networks are succeeding at AI tasks in a way that can only be described as spectacular. What is the secret behind their success?

more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

CUDA Spotlight: GPU-Accelerated Deep Learning

CUDA Spotlight: GPU-Accelerated Deep Learning | EEDSP | Scoop.it

Our Spotlight is on Dr. Ren Wu, a distinguished scientist at Baidu's Institute of Deep Learning (IDL). He is known for his pioneering research in using GPUs to accelerate big data analytics and his...

more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

The Higgs Machine Learning Challenge

The Higgs Machine Learning Challenge | EEDSP | Scoop.it

High Energy Physics (HEP) has been using Machine Learning (ML) techniques such as boosted decision trees (paper) and neural nets since the 90s. These techniques are now routinely used for difficult tasks such as the Higgs boson search. Nevertheless, formal connections between the two research fields are rather scarce, with some exceptions such as the AppStat group at LAL, founded in 2006. In collaboration with INRIA, AppStat  promotes interdisciplinary research on machine learning, computational statistics, and high-energy particle and astroparticle physics.

more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

I've Got A Secret: The Real Big Data Opportunity

I've Got A Secret: The Real Big Data Opportunity | EEDSP | Scoop.it
When I was younger I enjoyed watching a television show called I’ve Got a Secret. The premise of the show was to have celebrity panel members guess the identity, occupation or accomplishment of a guest by asking a series of questions. The guests would oftentimes attempt to mislead or confuse [...]
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Paper: SwiftCloud: Fault-Tolerant Geo-Replication Integrated all the Way to the Client Machine - High Scalability -

Paper: SwiftCloud: Fault-Tolerant Geo-Replication Integrated all the Way to the Client Machine - High Scalability - | EEDSP | Scoop.it
So how do you knit multiple datacenters and many thousands of phones and other clients into a s...
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

d3Network Plays Nice with Shiny Web Apps

d3Network Plays Nice with Shiny Web Apps | EEDSP | Scoop.it
After some delay (and because of helpful prompting by Giles Heywood and code contributions by John Harrison) d3Network now plays nicely with Shiny web apps. This means you can fully integrate R/D3.js network graphs into your web apps. Here is what one ...
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

As Big Data Grows, a New Role Emerges: the Chief Data Officer

As Big Data Grows, a New Role Emerges: the Chief Data Officer | EEDSP | Scoop.it
Adding this new position to the C-Suite will help companies utilize Big Data to gain a competitive advantage.
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Scientific computing’s future: Can any coding language top a 1950s behemoth?

Cutting-edge research still universally involves Fortran; a trio of challengers wants in.
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Spark for Data Science: A Case Study - Hortonworks

Spark for Data Science: A Case Study - Hortonworks | EEDSP | Scoop.it
I’m a pretty heavy Unix user and I tend to prefer doing things the Unix Way™, which is to say, composing many small command line oriented utilities. With composability comes power and with specialization comes simplicity. Although, sometimes if two utilities are used all the time, sometimes it makes sense for either:

A utility that specializes in a very common use-case
One utility to provide basic functionality from another utility

For example, one thing that I find myself doing a lot of is searching a directory recursively for files that contain an expression:
Despite the fact that you can do this, specialized utilities, such as ack have come up to simplify this style of querying. Turns out, there’s also power in not having to consult the man pages all the time. Another example, is the interaction between uniq and sort. uniq presumes sorted data.…
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Paper: Can Programming Be Liberated From The Von Neumann Style?  - High Scalability -

Paper: Can Programming Be Liberated From The Von Neumann Style?  - High Scalability - | EEDSP | Scoop.it
Famous computer scientist John Backus , he's the B in BNF(Backus-Naur form) and the creator of...
more...
No comment yet.