The MS Open Tech team has been spending quite a bit of time testing the latest build of Redis for Windows (available for download from the MS Open Tech Github repo). As we approach completion of our test plan, we thought we’d share some very promising results.
Redis is a very cool open-source key-value store that can add instant value to your Hadoop installation. Since keys can contain strings, hashes, lists, sets and sorted sets, Redis can be used as a front end to serve data out of Hadoop, caching your ‘hot’ pieces of data in-memory for fast access when they are needed again. By using a Java client called Jedis, you can ingest and retrieve data with Redis. Combining this simple client with the power of MapReduce will let you write and read data to and from Redis in parallel.
A very early stage of a Redis monitoring tool using hiredis1and express2 on Node.js presenting a dashboard inspired by Netflix’s Hystrix3: The project is on GitHub so you can send some pull requests...
There’s some monitoring related events coming up like MonitoringLove in Antwerp and Monitorama in Boston – I will be attending both and I hope a few members in the community will create similar background posts on various interesting areas before these events.
Redis Live is a dashboard application with a number of useful widgets. At it's heart is a monitoring script that periodically issues INFO and MONITOR command to the redis instances and stores the data for analytics.
One great thing about applying machine learning at Preact is working with fresh data. In the world of academic research, data is stale: learning algorithms are tested against monolithic reference datasets and each new algorithm picks up the same old sledgehammer and tries send the same old weight up to the same old bell. However, when algorithms are applied to new data it needs to be massaged into a form suitable for analysis in a process called feature extraction.