EEDSP
Follow
Find
14.6K views | +0 today
EEDSP
Digital Signal Processing, Data Analytics, Big Data, HPC, Deep Learning, GPGPU, Distributed and Parallel Computing
Curated by Shiwon Cho
Your new post is loading...
Your new post is loading...
Scooped by Shiwon Cho
Scoop.it!

Google, Microsoft, Mozilla And Others Team Up To Launch WebAssembly, A New Binary Format For The Web

Google, Microsoft, Mozilla And Others Team Up To Launch WebAssembly, A New Binary Format For The Web | EEDSP | Scoop.it

Google, Microsoft, Mozilla and some of the engineers on the WebKit project today announced that they have teamed up to launch WebAssembly, a new binary format..

more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

The Unicode Blog: Announcing The Unicode® Standard, Version 8.0

The Unicode Blog: Announcing The Unicode® Standard, Version 8.0 | EEDSP | Scoop.it

Version 8.0 of the Unicode Standard is now available. It includes 41 new emoji characters (including five modifiers for diversity), 5,771 new ideographs for Chinese, Japanese, and Korean, the new Georgian lari currency symbol, and 86 lowercase Cherokee syllables. It also adds letters to existing scripts to support Arwi (the Tamil language written in the Arabic script), the Ik language in Uganda, Kulango in the Côte d’Ivoire, and other languages of Africa. In total, this version adds 7,716 new characters and six new scripts.

more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Application of PageRank algorithm to analyze packages in R

Application of PageRank algorithm to analyze packages in R | EEDSP | Scoop.it
This article explains practical application of PageRank algorithm used by search engines to analyze packages in R with few commands on R like miniCran, pkgdep.
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Machine Vision Algorithm Chooses the Most Creative Paintings in History | MIT Technology Review

Machine Vision Algorithm Chooses the Most Creative Paintings in History | MIT Technology Review | EEDSP | Scoop.it
Picking the most creative paintings is a network problem akin to finding super spreaders of disease. That’s allowed a machine to pick out the most creative paintings in history.
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Announcing Apache Spark 1.4

Announcing Apache Spark 1.4 | EEDSP | Scoop.it
Today I’m excited to announce the general availability of Spark 1.4! Spark 1.4 introduces SparkR, an R API targeted towards data scientists. It also evolves Spark’s DataFrame API with a large number of new features. Spark’s ML pipelines API first introduced in Spark 1.3 graduates from an alpha component. Finally, Spark Streaming and Core add visualization and monitoring to aid in production debugging.  We’ll be publishing in-depth posts covering Spark’s new features over the coming weeks. Here I’ll briefly outline some of the major themes and features in this release.
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Announcing SparkR: R on Spark

Announcing SparkR: R on Spark | EEDSP | Scoop.it
[Cross-posted at the Databricks blog]I am excited to announce that the upcoming Apache Spark 1.4 release will include SparkR, an R…
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

The Untold Story of Microsoft's Surface Hub

The Untold Story of Microsoft's Surface Hub | EEDSP | Scoop.it
A man with a dream. A company in flux. A secret factory outside Portland. And a hyper-ambitious gambit to reimagine how meetings happen.
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Distributed Systems Are a UX Problem | Javalobby

Distributed systems are not strictly an engineering problem. It’s far too easy to assume a “backend” development concern, but the reality is there are implications at every point in the stack. Often the trade-offs we make lower in the stack in order to buy responsiveness bubble up to the top—so much, in fact, that it rarely doesn’t impact the application in some way. Distributed systems affect the user. We need to shift the focus from system properties and guarantees to business rules and application behavior. We need to understand the limitations and trade-offs at each level in the stack and why they exist. We need to assume failure and plan for recovery. We need to start thinking of distributed systems as a UX problem.

more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Tuning Java Garbage Collection for Spark Applications

Tuning Java Garbage Collection for Spark Applications | EEDSP | Scoop.it
Spark is gaining wide industry adoption due to its superior performance, simple interfaces, and a rich library for analysis and calculation. Like many projects in the big data ecosystem, Spark runs on the Java Virtual Machine (JVM). Because Spark can store large amounts of data in memory, it has a major reliance on Java’s memory management and garbage collection (GC). New initiatives like Project Tungsten will simplify and optimize memory management in future Spark versions. But today, users who understand Java’s GC options and parameters can tune them to eek out the best the performance of their Spark applications. This article describes how to configure the JVM’s garbage collector for Spark, and gives actual use cases that explain how to tune GC in order to improve Spark’s performance. We look at key considerations when tuning GC, such as collection throughput and latency.
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Aerosolve: Machine learning for humans - Airbnb Engineering

Aerosolve: Machine learning for humans - Airbnb Engineering | EEDSP | Scoop.it
Have you ever wondered how Airbnb’s price tips for hosts works? In this dynamic pricing feature, we show hosts the probability of getting a booking (green for a higher chance, red for a lower chance), or predicted demand, and allow them to easily price their listings dynamically with a click of a button. Many features …
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Baidu caught gaming recent supercomputer performance test

Baidu caught gaming recent supercomputer performance test | EEDSP | Scoop.it

Chinese search engine giant Baidu recently made headlines when its supercomputer reportedly beat out challengers from both Google and Microsoft on the Im

more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Analyzing Large Amounts of Security Data With Spark, Mesos, Zeppelin, and HDFS « LINE Engineers' Blog

Analyzing Large Amounts of Security Data With Spark, Mesos, Zeppelin, and HDFS «  LINE Engineers' Blog | EEDSP | Scoop.it
Hello, we are WJ and KH and we are in charge of game security development at LINE.A massive number of players play LINE Games at any given time, and t...
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Real-time Analytics at Massive Scale with Pinot | LinkedIn Engineering

Real-time Analytics at Massive Scale with Pinot | LinkedIn Engineering | EEDSP | Scoop.it

Pinot is the infrastructure that powers 18 member facing analytics products and more than 15 internal analytics products.

more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Inceptionism: Going Deeper into Neural Networks

Inceptionism: Going Deeper into Neural Networks | EEDSP | Scoop.it

Artificial Neural Networks have spurred remarkable recent progress in image classification and speech recognition. But even though these are very useful tools based on well-known mathematical methods, we actually understand surprisingly little of why certain models work and others don’t. So let’s take a look at some simple techniques for peeking inside these networks.

more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

分散システム処理モデルに関する動向について(MapReduceからBorgまで)

分散システム処理モデルに関する動向について(MapReduceからBorgまで) | EEDSP | Scoop.it
今回は、Googleから公開されたBorgなる論文を大規模分散システムの処理モデル的な観点から考察してみたいと思います。端的に言えば、Borgも含めた最近のクラウド環境の分散システムには重要なパラダイムシフト的な潮流があります。
大規模分散システムの処理モデル的な観点で、最初に近年のクラウド環境の分散システム動向を整理しつつ、最後にBorgから直近の分散システムの潮流を考察してみます。
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Planarian regeneration model discovered by artificial intelligence

Planarian regeneration model discovered by artificial intelligence | EEDSP | Scoop.it
An artificial intelligence system has for the first time reverse-engineered the regeneration mechanism of planaria—the small worms whose extraordinary power to regrow body parts has made them a research model in human regenerative medicine.
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Why has R, despite quirks, been so successful?

By David Smith I was on a panel back in 2009 where Bow Cowgill said, "The best thing about R is that it was written by statisticians. The worst thing about R is that it was written by statisticians." R is undeniably quirky — especially to computer scientists — and yet it has attracted a huge following for a domain-specific language, with more than two million users wordwide. So why has R become so successful, despite being outside the mainstream of programming languages? John Cook adeptly tackles that question in a 2013 lecture, "The R Language: The Good The Bad...
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

You’re Not a Data Scientist

You’re Not a Data Scientist | EEDSP | Scoop.it
Many of my friends, colleagues and contacts have started calling themselves Data Scientists. A number of resumes have cr…
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Microsoft acquires BlueStripe to help customers improve application visibility and management across the datacenter and cloud - The Official Microsoft Blog

Microsoft acquires BlueStripe to help customers improve application visibility and management across the datacenter and cloud - The Official Microsoft Blog | EEDSP | Scoop.it
I’m pleased to announce that Microsoft has completed the acquisition of BlueStripe Software, a leading provider of application management technology. BlueStripe’s solution helps map, monitor and troubleshoot distributed applications across heterogeneous operating systems and multiple datacenter and cloud environments. BlueStripe is commonly used today by customers to extend the value of Microsoft System Center by adding application-aware infrastructure performance monitoring. More and more, busi
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Torch vs Theano - FastML

Torch vs Theano - FastML | EEDSP | Scoop.it
Recently we took a look at Torch 7 and found its data ingestion facilities less than impressive. Torch’s biggest competitor seems to be Theano …
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Why Companies That Use Open Source Need a Compliance Program | Linux.com

Why Companies That Use Open Source Need a Compliance Program | Linux.com | EEDSP | Scoop.it
Corporate use of open source software is now the norm with more than 60 percent of companies saying that they build their products with open source software, according to the 2015 Future of Open
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

New package for image processing in R

New package for image processing in R | EEDSP | Scoop.it
I’ve written a package for image processing in R, with the goal of providing a fast API in R that lets you do things in C++ if you need to. The package is called imager, and it’ on Github. The whole thing is based on CImg, a very nice C++ library for image processing by […]
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Computing with GPUs in R

Computing with GPUs in R | EEDSP | Scoop.it
On Monday, we compared the performance of several different ways of calculating a distance matrix in R. Now there's another method to add to the list: using GPU acceleration in R. A GPU is a dedicated, high-performance chip available on many computers today. Unlike the CPU, it's not used for general computations, but rather for specialized tasks that benefit from a massively multi-threaded architecture. Video-game graphics is the usual target for GPUs, but in recent years they've been used for certain high-performance computing tasks as well. The problem is that GPUs require specialized programming, and because they have limited access...
more...
No comment yet.