Apache Flume Cookbook
248 views | +0 today
Follow
Your new post is loading...
Your new post is loading...
Scooped by Ashish Paliwal
Scoop.it!

[Flume Cookbook] Zookeeper based Configuration - Thread.currentThread().join()

[Flume Cookbook] Zookeeper based Configuration - Thread.currentThread().join() | Apache Flume Cookbook | Scoop.it
Zookeeper based configuration is not officially available as part of Flume distribution. If you want to enable it, need to apply the patch from FLUME-1491 Applying the patch Download the patch file with highest ending number, i.e.
more...
No comment yet.
Scooped by Ashish Paliwal
Scoop.it!

[Flume Cookbook] Sinks

[Flume Cookbook] Sinks | Apache Flume Cookbook | Scoop.it
Flume Sinks are implementation of Sink interface, that are responsible for sending the Events to next Source or write it to a persistant store like File System or HDFS or even a DB. A Sink can be a...
more...
No comment yet.
Scooped by Ashish Paliwal
Scoop.it!

[Flume Cookbook] Interceptors

[Flume Cookbook] Interceptors | Apache Flume Cookbook | Scoop.it
Interceptor is the mechanism through which Flume provides ability to manipulate an Event entering Flume Agent. Using Interceptors one can modify Events, add Events or even drop the Events. All Flum...
more...
No comment yet.
Scooped by Ashish Paliwal
Scoop.it!

[Flume Cookbook] Flume Terminology

[Flume Cookbook] Flume Terminology | Apache Flume Cookbook | Scoop.it
In the 2 post in the series, lets examine some of the key Flume terms. In part 1 of the series, we worked on setting up a single node cluster. Before we dive deeper into Flume, lets look at some ba...
more...
No comment yet.
Scooped by Ashish Paliwal
Scoop.it!

Apache Flume Cookbook - Thread.currentThread().join()

Apache Flume Cookbook - Thread.currentThread().join() | Apache Flume Cookbook | Scoop.it
Work in Progress This book is based on Flume version 1.4.0 and Flume trunk Chapter 1: Introduction 1.1 What is Apache Flume 1.2 Installing Apache Flume 1.3 Common Terminology 1.4 Quick Start 1.5 Anatomy of Event Chapter 2: Configuration 2.1 Configuration...
more...
No comment yet.
Scooped by Ashish Paliwal
Scoop.it!

[Flume Cookbook] Implementing Custom Interceptors

[Flume Cookbook] Implementing Custom Interceptors | Apache Flume Cookbook | Scoop.it
Flumes ships with some inbuilt interceptors, which are sufficient for most of the real world use cases. Following are the available interceptors Timestamp Interceptor Host Interceptor Static Interc...
more...
No comment yet.
Scooped by Ashish Paliwal
Scoop.it!

[Flume Cookbook] Understanding Config file format

[Flume Cookbook] Understanding Config file format | Apache Flume Cookbook | Scoop.it
In this post we shall take a look at Flume's configuration file. Flume configuration tells an Agent how to configure Sources, Sinks, Channels and related components. Flume's configuration can be vi...
more...
No comment yet.
Scooped by Ashish Paliwal
Scoop.it!

[Flume Cookbook] Playing with Apache Flume

[Flume Cookbook] Playing with Apache Flume | Apache Flume Cookbook | Scoop.it
This is multipart blog series on Apache Flume to share what I learn playing with it. In this post we shall look at a quick single node setup. This is a modified version of single node setup from Fl...
more...
No comment yet.