JavaScript for Li...
Follow
Find tag "elasticsearch"
241.9K views | +760 today
JavaScript for Line of Business Applications
Keeping track of current JavaScript Frameworks that help design your clientside Business Logic Layers.
Curated by Jan Hesse
Beam to my Inbox:
Your new post is loading...
Your new post is loading...
Scoop.it!

Running ElasticSearch in a cluster on Azure

Running ElasticSearch in a cluster on Azure | JavaScript for Line of Business Applications | Scoop.it

 I have been brewing on this post for some days now and the excitement of the presentation to come motivated me to finish it. We use ElasticSearch at my day job at eBay and the product is also a key ingredient in my ELMAH in the cloud project elmah.io. In this post I will share my experiences setting up ElasticSearch in a clustered setup of virtual machines, running on Windows Azure. Disclamer: this is in no way an official guide on how to setup ElasticSearch in a cluster. My experience with replication in ElasticSearch is pretty limited, and I only just now found out how virtual networks work in Windows Azure. Use this guide for inspiration and I would love to get some feedback on the approach used.

If you don’t have access to Azure, there’s a free trial available from the frontpage: http://www.windowsazure.com/en-us/pricing/free-trial/. You will get 30 days of Azure with a maximum of $200 worth of services. Pricing on Azure has always been a nightmare, but $200 should do just fine in order to play around with a couple of VMs. When signed up and in, start by creating a new virtual network:


Via William delmas
more...
No comment yet.
Scoop.it!

Announcing Elasticsearch.js For Node.js And The Browser

Announcing Elasticsearch.js For Node.js And The Browser | JavaScript for Line of Business Applications | Scoop.it

A few months ago we released client libraries for PHP, Ruby, Python, and Perl and today we add another to the family, JavaScript! This new client runs in Node.js and modern browsers, and aims to solve the same problems that the others do:

* provide access to the entire Elasticsearch REST API
* play nice with clusters
* automatically discover nodes when desired
* intelligently handle node failure
* be easily extendable, so that you can really have it behave just the way you want

more...
No comment yet.
Scoop.it!

SoundCloud : Architecture behind our new Search and Explore experience

SoundCloud : Architecture behind our new Search and Explore experience | JavaScript for Line of Business Applications | Scoop.it

Search is front-and-center in the new SoundCloud, key to the consumer experience. We’ve made the search box one of the first things you see, and beefed it up with suggestions that allow you to jump directly to people, sounds, groups, and sets of interest. We’ve also added a brand-new Explore section that guides you through the huge and dynamic landscape of sounds on SoundCloud. We’ve also completely overhauled our search infrastructure, which helps us provide more relevant results, scale with ease, and experiment quickly with new features and models.

 

 

more...
No comment yet.
Scoop.it!

elastic.js - Getting Started with elasticsearch Query DSL and AngularJS: Part1 - Searching

Elasticsearch and AngularJS are two great technologies with a lot of momentum. This post will explore how they can be combined to create data driven Web applications that provide a responsive and fluid user experience.
more...
No comment yet.
Scoop.it!

Scaling Elasticsearch Part 1: Overview

We recently launched Related Posts across WordPress.com, so its time to pop the hood and take a look at what ended up in our engine.

There’s a lot of good information spread across the web on how to use Elasticsearch, but I haven’t seen too many detailed discussions of what it looks like to scale an ES cluster for a large application. Being an open source company means we get to talk about these details. Keep in mind though that scaling is very dependent on the end application so not all of our methods will be applicable for you.

I’m only going to focus on the related posts queries (searches within a single blog) and the global queries (searches across all blogs). They illustrate some really nice features of ES.

Currently every day we average:

* 23m queries for related posts within a single shard

* 2m global queries across all shards

* 13m docs indexed

* 10m docs updated

* 2.5m docs deleted

* 250k delete by query operations

Our index has about 600 million documents in it, with 1.5 million added every day. Including replication there is about 9 TB of data.

more...
No comment yet.
Scoop.it!

Introduction to ElasticSearch

Introduction to ElasticSearch | JavaScript for Line of Business Applications | Scoop.it

This blog post is an introduction to some of the basic concepts of using ElasticSearch in a web application. It uses examples and lessons learned from working on the social media tool Engagor over the course of the last two years. 
ElasticSearch is marketed as a flexible and powerful open source, distributed real-time search and analytics engine for the cloud.
The application we’ve developed is mainly built in php, but since this post will detail the HTTP REST interface of ElasticSearch, implementation language is irrelevant. We’ll also touch briefly on a few other, related technologies.
I’m presenting a real use case that showcases most of the main features of ElasticSearch, so please bear with me while I explain a few things about our product and our company.

Jan Hesse's insight:

http://www.slideshare.net/oemebamo/introduction-to-elasticsearch-damndata

http://www.youtube.com/watch?v=jk9QFvT1Gok

more...
No comment yet.
Scoop.it!

Reactive, real-time log search with Play, Akka, AngularJS and Elasticsearch

Reactive, real-time log search with Play, Akka, AngularJS and Elasticsearch | JavaScript for Line of Business Applications | Scoop.it

So, I’ve decided to contribute an Activator Template to TypeSafe (will submit soon, promise!). Having recently become more and more involved in Elasticsearch, I saw a great opportunity to put together a neat “reactive” application combining Play & Akka with the “bonsai cool” percolation feature of Elasticsearch. Then, to put a cherry on top, use AngularJS on the client-side to create a dynamically updating UI.

What I came up with is slightly contrived – a very basic real-time log entry search tool – but I think it provides a really nice base for apps that want to integrate this bunch of technologies.

more...
No comment yet.