EEDSP
21.0K views | +0 today
Follow
EEDSP
Digital Signal Processing, Data Analytics, Big Data, HPC, Deep Learning, GPGPU, Distributed and Parallel Computing
Curated by Shiwon Cho
Your new post is loading...
Your new post is loading...
Scooped by Shiwon Cho
Scoop.it!

Distributed ID generation with Redis and Lua - Intent HQ Engineering blog

Distributed ID generation with Redis and Lua - Intent HQ Engineering blog | EEDSP | Scoop.it
Introducing Icicle: a distributed, k-sortable unique ID generation system using Redis and Lua.
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Collect & visualize your logs with Logstash, Elasticsearch & Redis

Collect & visualize your logs with Logstash, Elasticsearch & Redis | EEDSP | Scoop.it
Update of December 6th : although Logstash does the job as a log shipper, you might consider replacing it with Lumberjack / Logstash Forwarder,...
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Redis 3.0.0 beta release

Redis 3.0.0 beta release | EEDSP | Scoop.it

This is the first beta of Redis 3.0.0. Redis 3.0 features support for Redis Cluster and important speed improvements under certain workloads.

more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

How to build simple caching with Redis - It's all about music discovery!

How to build simple caching with Redis - It's all about music discovery! | EEDSP | Scoop.it
How we've implemented simple caching with Redis and Python, replacing memcached and optimizing the query layer of our music platform.
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Using Redis at Pinterest for Billions of Relationships | Pivotal P.O.V.

Using Redis at Pinterest for Billions of Relationships | Pivotal P.O.V. | EEDSP | Scoop.it

Adam Bloom recently wrote a really interesting case study on the Pivotal blog that explains how Pinterest was able to handle its extreme (1000%+ / year) increases in traffic and keep scaling up its following functionality.


http://architects.dzone.com/articles/pinterest-uses-redis-do

more...
No comment yet.
Rescooped by Shiwon Cho from BIG data, Data Mining, Predictive Modeling, Visualization
Scoop.it!

Real-Time Visualization with Kafka, Storm, Redis, node.js & d3.js

LivePerson Developers host Byron Ellis, Chief Data Scientist, LivePerson (@fdaapproved) In this meetup, Byron will demonstrate a realtime dashboard for strea...

Via AnalyticsInnovations
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Feature Extraction with Redis

Feature Extraction with Redis | EEDSP | Scoop.it

One great thing about applying machine learning at Preact is working with fresh data. In the world of academic research, data is stale: learning algorithms are tested against monolithic reference datasets and each new algorithm picks up the same old sledgehammer and tries send the same old weight up to the same old bell. However, when algorithms are applied to new data it needs to be massaged into a form suitable for analysis in a process called feature extraction.

more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Compressing large data sets in Redis with Gzip – Ruby test case | Running with Rails - Dev Blog not only for Rails fanatics!

Compressing large data sets in Redis with Gzip – Ruby test case | Running with Rails - Dev Blog not only for Rails fanatics! | EEDSP | Scoop.it
Content Introduction Approach Hardware Memory gain due to compression The read-only test case Empty file Small file Medium file Big
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Scaling Real-time Apps on Cloud Foundry Using Node.js and Redis

Scaling Real-time Apps on Cloud Foundry Using Node.js and Redis | EEDSP | Scoop.it
Common applications being built on Node.js like social networking and chat require real-time scaling capabilities across multiple instances. Developers need to deal with sticky sessions, scale-up, ...
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Thredis

Thredis is Threaded Redis. Thredis is a fork of Redis that allows for complex operations to be processed in parallel threads for better performance on multi-core systems. See thredis.org

more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

「カジュアル」な規模のデータクラスター上でのデータ解析処理 « NAVER Engineers' Blog

「カジュアル」な規模のデータクラスター上でのデータ解析処理 «  NAVER Engineers' Blog | EEDSP | Scoop.it
今年はさだまさしさんのデビュー40周年ということで、記念コンサート「さだまつり」も絶賛開催中の折も折、残暑も厳しい中皆様いかがお過ごしでしょうか。大平です。

さだまさし氏は経験の豊富な方ですので彼の歌や発言から学ぶことは大変多いのですが、個人的に非常に感銘を受けているのは「歌はコンサートで成長する...
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Spreecast & Redis Failover | Spreecast

Spreecast & Redis Failover | Spreecast | EEDSP | Scoop.it

Until Redis Sentil becomes generally available, Spreecast’s Ruby library using Apache ZooKeeper might be the solution for high availability Redis clusters:

more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

How Twitter Uses Redis to Scale - 105TB RAM, 39MM QPS, 10,000+ Instances  - High Scalability -

Yao Yue has worked on Twitter’s Cache team since 2010. She recently gave a really great talk: Scaling Redis at Twitter. It’s about Redis of course, but it's not just about Redis.

more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Data&storage » Largest Redis Clusters Ever

Data&storage » Largest Redis Clusters Ever | EEDSP | Scoop.it

Tape is Dead,Disk is Tape,Flash is Disk,RAM Locality is King.       — Jim Gray

Redis不是比较成熟的Memcache或者Mysql的替代品,是对于大型互联网类应用在架构上很好的补充。现在有越来越多的应用也在纷纷基于Redis做架构的改造。

可以简单公布一下Redis平台实际情况

2200+亿 commands/day   5000亿Read/day   500亿Write/day

18TB+ Memory

500+ Servers in 6 IDC    2000+instances

应该是国内外比较大的Redis使用平台,今天主要从应用角度谈谈Redis服务平台。

more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Redis Benchmark & Rackspace Performance VMs

This is quite interesting: using the benchmark of a NoSQL database (Redis), and not the one you already own and offer hosting for, to brag about the performance of your hosting servers:
“ I...
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

recommendationRaccoon

recommendationRaccoon | EEDSP | Scoop.it
recommendationRaccoon - A collaborative filtering based recommendation engine and NPM module built on top of Node.js and Redis.
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

High Scalability - High Scalability - The Architecture Twitter Uses to Deal with 150M Active Users, 300K QPS, a 22 MB/S Firehose, and Send Tweets in Under 5 Seconds

High Scalability - High Scalability - The Architecture Twitter Uses to Deal with 150M Active Users, 300K QPS, a 22 MB/S Firehose, and Send Tweets in Under 5 Seconds | EEDSP | Scoop.it
Toy solutions solving Twitter’s “problems” are a favorite scalabi...
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Redis on Windows – stable and reliable - Interoperability @ Microsoft - Site Home - MSDN Blogs

Redis on Windows – stable and reliable - Interoperability @ Microsoft - Site Home - MSDN Blogs | EEDSP | Scoop.it

The MS Open Tech team has been spending quite a bit of time testing the latest build of Redis for Windows (available for download from the MS Open Tech Github repo). As we approach completion of our test plan, we thought we’d share some very promising results.

more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Making Hadoop MapReduce Work with a Redis Cluster | Datastream

Making Hadoop MapReduce Work with a Redis Cluster | Datastream | EEDSP | Scoop.it

Redis is a very cool open-source key-value store that can add instant value to your Hadoop installation. Since keys can contain strings, hashes, lists, sets and sorted sets, Redis can be used as a front end to serve data out of Hadoop, caching your ‘hot’ pieces of data in-memory for fast access when they are needed again. By using a Java client called Jedis, you can ingest and retrieve data with Redis. Combining this simple client with the power of MapReduce will let you write and read data to and from Redis in parallel.

more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Redis 201

Redis 201 Posted by Brian P O'Rourke on Feb 18th, 2013 This is a quick overview of some of the big-picture lessons we’ve helped our
customers with …
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Redis-Stat: Redis Monitoring With Netflix's Hystrix Flavor

Redis-Stat: Redis Monitoring With Netflix's Hystrix Flavor | EEDSP | Scoop.it
A very early stage of a Redis monitoring tool using hiredis1and express2 on Node.js presenting a dashboard inspired by Netflix’s Hystrix3:
The project is on GitHub so you can send some pull requests...
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Solving monitoring state storage problems using Redis | R.I.Pienaar

There’s some monitoring related events coming up like MonitoringLove in Antwerp and Monitorama in Boston – I will be attending both and I hope a few members in the community will create similar background posts on various interesting areas before these events.

 
more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

[Redis] New gem: Automatic Redis Failover for Ruby - Grokbase

Redis Failover is a ZooKeeper-based automatic master/slave failover solution for Ruby 

more...
No comment yet.
Scooped by Shiwon Cho
Scoop.it!

Real time dashboard for redis

Real time dashboard for redis | EEDSP | Scoop.it

Redis Live is a dashboard application with a number of useful widgets. At it's heart is a monitoring script that periodically issues INFO and MONITOR command to the redis instances and stores the data for analytics.

more...
No comment yet.