Realtime Streaming Big Data Analysis
88 views | +0 today
Follow
Your new post is loading...
Your new post is loading...
Scooped by Nakku Kim
Scoop.it!

Big Data Building Blocks with AWS Cloud

The Presentation Talks about how Cloud Computing is Big Data's Best Friend and How AWS Cloud Components Fit in to complete your Big Data Life Cycle. Agenda:...
more...
No comment yet.
Scooped by Nakku Kim
Scoop.it!

The Log: What every software engineer should know about real-time data's unifying abstraction | LinkedIn Engineering

We're seeking intelligent problem solvers who are inspired and motivated to change the world.
more...
No comment yet.
Scooped by Nakku Kim
Scoop.it!

gworley3's weblog: Amazon Kinesis compared to Storm

Nakku Kim's insight:

Kinesis를 Storm에 비교하여 장단점을 나열한 개인블로그

 

장점
  1. elastic
  2. autoscale
  3. 단순하고 간단한 디자인

 

단점
  1. 복잡한 스트리밍 데이터 처리가 어렵다
  즉, 복잡한 스트리밍 데이터 처리시 Kinesis 애플리케이션간의 커뮤니케이션 오버헤드로 인하여 latency가 높아질 것이다.
  2. 실행중 오류시, 롤백을 지원하지 않는다.
  3. 애플리케이션간의 연계가 제한적이다.

more...
No comment yet.
Scooped by Nakku Kim
Scoop.it!

Setting the Stage to Design a Kinesis Application on AWS Cloud - The High Level Architecture

Setting the Stage to Design a Kinesis Application on AWS Cloud - The High Level Architecture | Realtime Streaming Big Data Analysis | Scoop.it
This Blog talks in Detail of all the Components, Producers, Consumers, KCL i.e the Kinesis Client Library & how all of them work to Set up a Kinesis Application
Nakku Kim's insight:

Kinesis에 대한 정리가 잘 된 블로그,

 

3.13일 현재 3개의 포스트로 등록되어 있는데 링크를 따라가보면 나머지 2포스트의 링크도 있다.

more...
No comment yet.
Scooped by Nakku Kim
Scoop.it!

Amazon Kinesis: Real-time Streaming Big data Processing Applications (BDT311) | AWS re:Invent 2013 - YouTube

"This presentation will introduce Kinesis, the new AWS service for real-time streaming big data ingestion and processing. We'll provide an overview of the ke...
Nakku Kim's insight:

2013.11.15 re:Invent에서 발표된 Kinesis 사용 소개.

동작방식에 대한 조금더 깊은 설명과 KCL을 사용한 애플리케이션 개발방법을 간단히 소개한다.

more...
No comment yet.
Scooped by Nakku Kim
Scoop.it!

Google Launches BigQuery Streaming For Real-Time, Big-Data Analytics | TechCrunch

Google Launches BigQuery Streaming For Real-Time, Big-Data Analytics | TechCrunch | Realtime Streaming Big Data Analysis | Scoop.it
BigQuery, Google's cloud-based tool for quickly analyzing very large datasets, is getting a massive price cut today (up to 85 percent). But Google is also.. (Google BigQuery for real-time, Big-Data analytics targets Amazon Kinesis.
more...
No comment yet.
Scooped by Nakku Kim
Scoop.it!

What can you do with Amazon Kinesis?

What can you do with Amazon Kinesis? | Realtime Streaming Big Data Analysis | Scoop.it
Answer (1 of 4): It is basically a SaaS version of Apache Kafka, a high-throughput, distributed message queue/PubSub system developed and open-sourced by LinkedIn.

Kinesis seems to be Amazon's solution to refactor data import onto AWS. As AWS builds out a whole family of storage/database SaaSs, ...
Nakku Kim's insight:

Kinesis product manager 가 등록한 내용을 보면 타게팅 하는 용도가 나와 있다.

 

1. AWS로 손쉬운 데이터 전송

2. 실시간 metric/KPI 추출

3. 실시간 스트리밍 데이터 분석

4. 다른 복잡한 분석 시스템과 연계

more...
No comment yet.
Scooped by Nakku Kim
Scoop.it!

Kinesis: Amazon's cloud opens to the Internet of things

Kinesis: Amazon's cloud opens to the Internet of things | Realtime Streaming Big Data Analysis | Scoop.it
Service for real-time data processing could be cloud giant's first steps toward Internet of things domination
more...
No comment yet.
Scooped by Nakku Kim
Scoop.it!

Introducing Amazon Kinesis: Real-time Processing of Streaming Big Data (BDT103) | AWS re:Invent 2013 - YouTube

"This presentation will introduce Kinesis, the new AWS service for real-time streaming big data ingestion and processing. We'll provide an overview of the ke...
Nakku Kim's insight:

2013.11.13 re:Invent 에 소개된 kinesis 소개 동영상

more...
No comment yet.