Innovation
13 views | +0 today
Follow
Your new post is loading...
Your new post is loading...
Scooped by Jörn Franke
Scoop.it!

Using Apache Spark to Analyze the Bitcoin Blockchain

Using Apache Spark to Analyze the Bitcoin Blockchain | Innovation | Scoop.it
The hadoopcryptoledger library provides now a simple example how you can analyze the Bitcoin Blockchain with Apache Spark. Previously, I described how you can use Hadoop MR or any other Hadoop ecosystem-compatible application to analyze it. Basically, it leverages the HadoopRDD API to read the Hadoop File Format of the hadoopcryptoledger library. Afterwards you can…
more...
No comment yet.
Scooped by Jörn Franke
Scoop.it!

Spark+Scala+Graphx: Analyzing the Bitcoin Transaction Graph

Spark+Scala+Graphx: Analyzing the Bitcoin Transaction Graph | Innovation | Scoop.it
The hadoopcryptoledger library provides now an example how you can generate a Bitcoin Transaction Graph using the Big Data graph analysis technologies Spark+Scala+Graphx. Basically it demonstrates how to read the Bitcoin Blockchain from HDFS, transform it into a graph with Bitcoin addresses as vertices and transactions between them as edges. The example returns the 5…
more...
No comment yet.
Scooped by Jörn Franke
Scoop.it!

Lambda, Kappa, Microservice and Enterprise Architecture for Big Data

Lambda, Kappa, Microservice and Enterprise Architecture for Big Data | Innovation | Scoop.it
A few years after the emergence of the Lambda-Architecture several new architectures for Big Data have emerged. I will present and illustrate their use case scenarios. These architectures describe IT architectures, but I will describe towards the end of this blog the corresponding Enterprise Architecture artefacts, which are sometimes referred to as Zeta architecture. Lambda…
more...
No comment yet.
Scooped by Jörn Franke
Scoop.it!

Hive Optimizations with Indexes, Bloom-Filters and Statistics

Hive Optimizations with Indexes, Bloom-Filters and Statistics | Innovation | Scoop.it
This blog post describes how Storage Indexes, Bitmap Indexes, Compact Indexes, Aggregate Indexes, Covering Indexes/Materialized Views, Bloom-Filters and statistics can increase performance with Apa...
Jörn Franke's insight:

Improve performance of your Big Data warehouse in Hive on hadoop

more...
No comment yet.
Scooped by Jörn Franke
Scoop.it!

Instead of Fighting Bitcoin, the US Could Make Its Own Digital Currency - Wired

Instead of Fighting Bitcoin, the US Could Make Its Own Digital Currency - Wired | Innovation | Scoop.it
A Georgetown University professor thinks that the US Government should issue its own crypto currency.
Jörn Franke's insight:

this should be done in Europe by the European Central Bank as well

more...
No comment yet.
Scooped by Jörn Franke
Scoop.it!

Enabling WebRTC in modern Java Enterprise Web Applications

Enabling WebRTC in modern Java Enterprise Web Applications | Innovation | Scoop.it
I recently started a small project to create a sample enterprise Big Data web application using Spring. You can find the source code here and a demonstration here. One feature in this application W...
Jörn Franke's insight:

Create your own Java Enterprise Applications leveraging W3C WebRTC video/voice and data functionality in the browser without plugins

more...
No comment yet.
Scooped by Jörn Franke
Scoop.it!

clouddatalab2.pdf - Google Drive

Jörn Franke's insight:

create a #bigdata #lab in the #cloud on #Amazon #emr for your #datascientists #using a browser for R, Hadoop, SparkR

more...
No comment yet.
Scooped by Jörn Franke
Scoop.it!

Bitcoin could pose threat to financial stability of UK, warns Bank of England - The Guardian

Bitcoin could pose threat to financial stability of UK, warns Bank of England - The Guardian | Innovation | Scoop.it
Wall Street Journal (blog) Bitcoin could pose threat to financial stability of UK, warns Bank of England The Guardian Bitcoin, which is the best known of several digital currencies in circulation, has come to prominence in recent months after a...
more...
No comment yet.
Scooped by Jörn Franke
Scoop.it!

AWS Webcast - Open Data on AWS -- An Introduction

Governments around the globe are working to make data easy for the public to discover, access and use. This is fueling entrepreneurship and economic growth, ...
more...
No comment yet.
Scooped by Jörn Franke
Scoop.it!

Using Analytics to build A Big Data Workforce

Synopsis: Many innovative businesses and IT organizations appreciate the competitive advantage analytics capabilities can provide and have ambitions to reach...
more...
No comment yet.
Scooped by Jörn Franke
Scoop.it!

Big Data at Google | SmartData Collective

Big Data at Google | SmartData Collective | Innovation | Scoop.it
Many people, particularly those that didn't get online until this century had started, will have had their first direct experience of manipulating big data through Google. Although these days Google's big data innovation goes well ...
more...
No comment yet.
Scooped by Jörn Franke
Scoop.it!

The Lambda Architecture for Big Data in your Enterprise

The Lambda Architecture for Big Data in your Enterprise | Innovation | Scoop.it
I will present in this blog post the Lambda architecture for Big Data. This architecture is about integrating historical Big Data with “live” streaming Big Data. Afterwards, the concept of a large ...
more...
No comment yet.
Scooped by Jörn Franke
Scoop.it!

IDC Report: Technology Predictions for 2014 - Customer Think

IDC Report: Technology Predictions for 2014
Customer Think
Investment on big data technologies and services will grow by 30% in 2014. IDC is also predicting that big data analytics services 2014 spending will exceed $4.5B, growing 21% over 2013.
more...
No comment yet.
Scooped by Jörn Franke
Scoop.it!

Hive & Bitcoin: Analytics on Blockchain data with SQL

Hive & Bitcoin: Analytics on Blockchain data with SQL | Innovation | Scoop.it
You can now analyze the Bitcoin Blockchain using Hive and the hadoopcryptoledger library with the new HiveSerde plugin. Basically you can link any data that you loaded in Hive with Bitcoin Blockchain data. For example, you can link Blockchain data with important events in history to determine what causes Bitcoin exchange rates to increase or…
more...
No comment yet.
Scooped by Jörn Franke
Scoop.it!

Sneak Preview – HadoopOffice: Processing Office documents using the Hadoop Ecosystem – The example of Excel files

Sneak Preview – HadoopOffice: Processing Office documents using the Hadoop Ecosystem – The example of Excel files | Innovation | Scoop.it
I present in this blog post the sneak preview of the hadoopoffice library that will enable you to process Office files, such as MS Excel, using the Hadoop Ecosystem including Hive/Spark. It currently contains only an ExcelInputFormat, which is based on Apache POI. Additionally, it contains an example that demonstrates how an Excel input file…
more...
No comment yet.
Scooped by Jörn Franke
Scoop.it!

Batch-processing & Interactive Analytics for Big Data – the Role of in-Memory

In this blog post I will discuss various aspects of in-memory technologies and describe how various Big Data technologies fit into this context. Especially, I will focus on the difference between in-memory batch analytics and interactive in-memory analytics. Additionally, I will illustrate when in-memory technology is really beneficial. In-memory technology leverages the fast main memory…
more...
No comment yet.
Scooped by Jörn Franke
Scoop.it!

Big Data – What is next? OLTP, OLAP, Predictive Analytics, Sampling and Probabilistic Databases

Big Data – What is next? OLTP, OLAP, Predictive Analytics, Sampling and Probabilistic Databases | Innovation | Scoop.it
Big Data has matured over the last years and is becoming more and more a standard technology used in various industries. Coming from established concepts, such as OLAP or OLTP, in context of Big Da...
Jörn Franke's insight:

Thinking about near-term, medium-term and long-term future of Big Data analytics

more...
No comment yet.
Scooped by Jörn Franke
Scoop.it!

Master Data Management and the Internet of Things

Master Data Management and the Internet of Things | Innovation | Scoop.it
Master Data Management (MDM) has matured and grown significantly over the last years. The main motivation for master data management is to have a complete and accurate view on master data objects i...
Jörn Franke's insight:

Use NoSQL / Big Data technologies for next generation Master Data Management systems enabled by the Internet of Things

 

more...
No comment yet.
Scooped by Jörn Franke
Scoop.it!

clouddatalab2.pdf

clouddatalab2.pdf | Innovation | Scoop.it
Jörn Franke's insight:

create your own big data lab on Amazon EMR / Hadoop using Spark in-memory big data technology and R (SparkR / RMR)

more...
No comment yet.
Rescooped by Jörn Franke from COINBOARD
Scoop.it!

Peter Thiel: Bitcoin Payment System "Badly Lacking" | CoinDesk

Peter Thiel: Bitcoin Payment System "Badly Lacking" | CoinDesk | Innovation | Scoop.it

Investor and PayPal co-founder Peter Thiel has again expressed lukewarm views on bitcoin, saying it lacks a payment system.


Via Coinboard
Jörn Franke's insight:

payment systems still have a lot of potential for breakthrough innovation

more...
No comment yet.
Scooped by Jörn Franke
Scoop.it!

Workshop Cafe Launches San Francisco's First Bitcoin Teller Machine - Bitcoin Magazine

Workshop Cafe Launches San Francisco's First Bitcoin Teller Machine - Bitcoin Magazine | Innovation | Scoop.it
Last night, Workshop Cafe proudly hosted the grand opening of San Francisco's first Bitcoin Teller Machine (BTM). This particular machine is made by BitAcc...
Jörn Franke's insight:

Cool, but there are already plenty of them in Europe!

more...
No comment yet.
Scooped by Jörn Franke
Scoop.it!

Why SAP's Cloud strategy will capture cloud space - Market Realist

Why SAP's Cloud strategy will capture cloud space - Market Realist | Innovation | Scoop.it
Why SAP's Cloud strategy will capture cloud space
Market Realist
“Cloud” is growing very fast. Cloud based systems are expected to be more agile and responsive to the changing business environment.
Jörn Franke's insight:

An interesting Big Data platform...

 

more...
No comment yet.
Scooped by Jörn Franke
Scoop.it!

How An Earthquake Will Mess Up Your Sleep: A Jawbone Chart

How An Earthquake Will Mess Up Your Sleep: A Jawbone Chart | Innovation | Scoop.it
Northern California's worst earthquake in 25 years led to hundreds of injuries, plenty of property damage, and ... more than a million hours of lost sleep? That's what a fascinating new Jawbone graphic suggests. Sunday morning's 6.0 magnitude earthquake had a measurable effect on Northern California residents' sleep — but there was [...]
Jörn Franke's insight:

Big Data/Internet of Things for Disaster Management

more...
No comment yet.
Scooped by Jörn Franke
Scoop.it!

How Amazon Uses Big Data to Boost Its Performance - Smart Data Collective

How Amazon Uses Big Data to Boost Its Performance - Smart Data Collective | Innovation | Scoop.it
How Amazon Uses Big Data to Boost Its Performance Smart Data Collective We all know that Amazon pioneered e-commerce in many ways, but possibly one of its greatest innovations was the personalized recommendation system – which, of course, is built...
more...
No comment yet.
Scooped by Jörn Franke
Scoop.it!

Example projects for using various NoSQL and Big Data technologies

Example projects for using various NoSQL and Big Data technologies | Innovation | Scoop.it
Recently, I published on github.com several example Java projects for using various NoSQL technologies:cassandra-tutorial : Apache Cassandra tutorial (Column-oriented database)mongodb-tutorial : Mo...
more...
No comment yet.