Big Data In Business Today
736 views | +0 today
Follow
Big Data In Business Today
What impact is "Big Data" having on REAL Enterprises today ?
Curated by Adrian Carr
Your new post is loading...
Your new post is loading...
Scooped by Adrian Carr
Scoop.it!

Hortonworks announces new alliances and releases; Hadoop comes to fork in road | ZDNet

Hortonworks announces new alliances and releases; Hadoop comes to fork in road | ZDNet | Big Data In Business Today | Scoop.it
As its Hadoop Summit Europe event ramps up in Dublin, Hortonworks makes several announcements. Much of the news furthers the schism in the Hadoop space, between Hortonworks' technology and Cloudera's.
Adrian Carr's insight:
A greta picture of two elephants bottoms - nice !
But, Pachydermal poopers aside, this is an interesting article about the evolving hadoop market.
The author summarises with a belief that the market is becoming a duopoly with Cloudera v Hortonworks whilst recognising MapR is still active.
And this is creating vendor lock in - "It wasn't supposed to be that way."
more...
No comment yet.
Scooped by Adrian Carr
Scoop.it!

The Joys and Hype of Software Called Hadoop

The Joys and Hype of Software Called Hadoop | Big Data In Business Today | Scoop.it
Big data is hot in Silicon Valley, and Hadoop is underpinning the craze.
Adrian Carr's insight:

The Gartner Hype Cycle is all about normal Human behaviour.

The excessive optimism which drives the wave of a new technology followed by the plunging tough of despondency when unrealistic goals fail to be met.  Eventually, expectations find a realistic level.

 

Hadoop has been hailed as a great panacea but it is just a distributed storage and processing platform...


The database vendors - both RDBMS and NoSQL, will have seen this moment coming.

Hadoop has great strengths but unless you want to build and support a Google-sized development team, you need an Enterprise class database on top of it.

This provides the data management, security and data consistency of an Enterprise db but adds the scale, parallelisation and commodity hardware benefits of Hadoop.


Perhaps this article signals that the market is now ready for more realistic expectations for Hadoop.  That can only be good news.



 

more...
No comment yet.
Scooped by Adrian Carr
Scoop.it!

DB-Engines Ranking - popularity ranking of RDF stores

DB-Engines Ranking - popularity ranking of RDF stores | Big Data In Business Today | Scoop.it
Adrian Carr's insight:

Top ranked Triple/RDF stores on DB-Engines.com

more...
No comment yet.
Scooped by Adrian Carr
Scoop.it!

Healthcare.gov Case Study | MarkLogic

Healthcare.gov Case Study | MarkLogic | Big Data In Business Today | Scoop.it
MarkLogic was the only platform able to process massive amounts of poly-schematic information while simultaneously offering ACID-compliant transactions.
Adrian Carr's insight:

MarkLogic have published a Case Study for the Centers for medicare and Medicaid aka the US Affordable Care Act aka Obama care.

This has been one of the most transformational, largest and most challenging IT projects anywhere in the world.

Big Data, big integration, big politics and huge usage.

And an Enterprise NoSQL database at the heart of it all.

Download the PDF to read more.

more...
No comment yet.
Scooped by Adrian Carr
Scoop.it!

Financial Execs Worry About Data Lineage; Triple Stores Can Calm Fears - Semanticweb.com

Financial Execs Worry About Data Lineage; Triple Stores Can Calm Fears - Semanticweb.com | Big Data In Business Today | Scoop.it
Adrian Carr's insight:

Joining multiple data feeds can be a problem unless a common internal taxonomy exists.  Simply, merging or analysing across, two relational data feeds where their is no common key - such as a customer number, is problematic.

And this is just a simple use case - in real life things are much more complex - more sources, unstructured data etc

An RDF Triple Store can help solve this.

 

more...
No comment yet.
Rescooped by Adrian Carr from MarkLogic - Enterprise NoSQL Database
Scoop.it!

Financial Execs Worry About Data Lineage; Triple Stores Can Calm Fears.

Financial Execs Worry About Data Lineage; Triple Stores Can Calm Fears. | Big Data In Business Today | Scoop.it

Via Dominic Spitz
more...
Dominic Spitz's curator insight, June 18, 2014 6:36 AM

The Aite Group, which provides research and consulting services to the international financial services market, spends its fair share of time exploring the data and analytics challenges the industry faces. Senior analyst Virginie O’Shea commented on many of them during a webinar this week sponsored by enterprise NoSQL vendor MarkLogic.

 

Dealing with multiple data feeds from a variety of systems; feeding information to hundreds of end users with different priorities about what they need to see and how they need to see it; a lack of a common internal taxonomy across the organization that would enable a single identifier for particular data items; the toll ETL, cleansing, and reconciliation can take on agile data delivery; the limitations in cross-referencing and linking instruments and data to other data that exact a price on data governance and quality – they all factor into the picture she sketched out.

 

Things aren’t going to get any easier, either, both as electronic data and regulatory requirements around financials data increases in Europe and the States. “We are looking at much more data to get a handle around, and as part of shadow bank regulations we’ll see more data reporting in particular areas,” she said. “The profile of data management is being raised but it’s proving challenging.”

In addition to improving processes around data aggregation, and being better able to slice and dice that data as necessary, the basic accuracy and reliability of data is a concern. Among the issues that financial services data management executives are worrying about, she noted, is data lineage. Being able to pinpoint the source of data and its path through systems can help with audit trails that will enable risk managers to know they are making the right decisions based on the right data, as well as help meet regulatory requirements.

 

In fact, financial services firms may be able to lower risk management demands if they can prove they have a better handle on their own data with more accurate risk calculations.

 

The MarkLogic NoSQL document database has capabilities that can help with such challenges, according to Amir Halfon, MarkLogic CTO, Financial Services, who participated in the webinar. “Those familiar with RDF and some other semantic standards, we now support those as well, so you can look at it as a cross between a document store and a semantic triple store,” he said. “In fact, this is one way that data lineage and provenance can be supported.” Triple stores help users to connect the dots of data lineage and data journeys with joins across relationships on objects – where the data comes from, who was the last person to touch it, and what was the latest transformation it went through, for example.

 

Halfon also noted that triples can be added easily as data is ingested.  “That is one way to handle data provenance – as part of ingestion as well as when data changes through the system,” he said.

Scooped by Adrian Carr
Scoop.it!

The Hyperscale Lessons Of Healthcare.gov

The Hyperscale Lessons Of Healthcare.gov | Big Data In Business Today | Scoop.it
The last six months have been a hair-graying experience for everybody involved in the Healthcare.gov rollout. While it ultimately managed to meet its goals
Adrian Carr's insight:

The old adage of 'the truth will out' applies to Obamacare / Healthcare.gov.

This article provides insight into the early bumps on one of the worlds largest IT projects.  

After taking some of the negative press early on, MarkLogic focused on one thing - project success.  A hugely determined and talented team worked day and night, every day, for months, under huge pressure.

Even the CEO was on call as an escalation point on Christmas Day.

It was worth it and this article is great reading not just for MarkLogic supporters but most importantly, for those who believe that Relational is not the only database in town anymore !

more...
No comment yet.
Scooped by Adrian Carr
Scoop.it!

NoSQL Vendor MarkLogic Announces Record Year

NoSQL Vendor MarkLogic Announces Record Year | Big Data In Business Today | Scoop.it
MarkLogic, the US-based developer of NoSQL database software, has announced its most profitable year to date, although it didn’t offer any numbers
Adrian Carr's insight:

MarkLogic announces a record year after two record quarters.

The market is awakening to what NoSQL is and the use cases which it can be used to address better than relational technology...

The year also saw a new release including Semantic/Triple Store capabilities, tiered Storage (based on HDFS) and Cloud elasticity functionality.  A great year indeed.

more...
No comment yet.
Scooped by Adrian Carr
Scoop.it!

Police Events

Police Events | Big Data In Business Today | Scoop.it
Adrian Carr's insight:

Fairfax County (one of the largest and richest Counties in USA) has put its fifth application built on MarkLogic into production! 

 

The Fairfax County Police Events Application allows the County and the public to search for calls for police service received by the Department of Public Safety Communications (911 call center).  The police events data is provided to the application via the Fairfax County GIS Network API Platform which MarkLogic Consulting delivered last year and went live in April 2013. 

 

This is a great example of a customer just getting on with applying Big Data - in this case, local government improving the services and information provided to residents.

Note that this is the FIFTH live application and at least one of them has an app for mobile devices.

Very cool - nice work Fairfax County!

more...
No comment yet.
Scooped by Adrian Carr
Scoop.it!

MarkLogic Pricing | MarkLogic

MarkLogic Pricing | MarkLogic | Big Data In Business Today | Scoop.it
Visit MarkLogic.com to read MarkLogic Pricing.
Adrian Carr's insight:

Check out the new pricing for MarkLogic.

Full transparency, a free developer version and a substantial price reduction on the Essential Enterprise version.

more...
No comment yet.
Scooped by Adrian Carr
Scoop.it!

Making Sense of Big Data in Insurance - MarkLogic

Making Sense of Big Data in Insurance - MarkLogic | Big Data In Business Today | Scoop.it
The insurance industry is data-dependent. In this paper, ACORD and MarkLogic demystify some of the hype around Big Data and provide a pragmatic review of the technologies available and their strengths and weaknesses.
Adrian Carr's insight:

The insurance industry is data-dependent. Today, carriers and intermediaries are engaged in improving data capture to help them to better manage their business, manage their risk and know their customers. Business and regulatory drivers are pushing the industry to manage its data better. For the past 40 years, ACORD has been defining data standards to help with this.

Recently, though, one of the most talked about trends in IT is Big Data. Some commentators and vendors have attached great promise to the capabilities of Big Data, even arguing that other data types are no longer necessary. According to Gartner, Big Data has reached the peak of its Hype Cycle this year. “Hype” connotes an over-selling of potential and leads to inflated expectations. 

more...
No comment yet.
Scooped by Adrian Carr
Scoop.it!

Don't Have A Big Data Strategy Yet? Good. | Forrester Blogs

Don't Have A Big Data Strategy Yet? Good. | Forrester Blogs | Big Data In Business Today | Scoop.it
Adrian Carr's insight:

This is a great article and deals with some of the misunderstandings people have with Big data.

Of course, the IT industry is at fault for once again over-burdening the new band-wagon so completely.

We had only just congratulated ourselves on successfully diluting 'Cloud'as a term and here we are again with 'Big data'.

One point that resonates from Brian's article with my dealings with CIOs in Europe is the belief that Big data is about social media - Blogs, Tweets and Facebook pages.

In reality, most of our customers are using Big Data technologies to combine and/or leverage/monetise internal data and content.

Whilst this is no where near as sexy, it is what makes the savings and generates the revenues of Enterprises across all industries.

 

This (edited) statement from Brian sums it up..

The point is that high-performance firms are opportunistically finding ways to exploit new technology and analytic techniques to get past limitations, lower cost, and create greater agility; and they are focusing on the data they have while looking opportunistically toward the potential for adding newer internal and external data sets into the mix.

more...
No comment yet.
Scooped by Adrian Carr
Scoop.it!

DataStax, Graph, and the Move to a Multi-Model Database Platform | DataStax

DataStax, Graph, and the Move to a Multi-Model Database Platform | DataStax | Big Data In Business Today | Scoop.it
DataStax - Software, support, and training for Apache Cassandra
Adrian Carr's insight:

A Big Bank recently called our London office with a sales enquiry.

They had visited db-engines.com and had selected a small number of databases with the right attributes to solve their business problem.

These short-listed companies all claimed to be MULTI-MODEL and included RDF/Graph/Semantic/Triple-Store capability.

 

This call and subsequent discussions were an interesting data point for me in the NoSQL market evolution for the following reasons:

Here was a very well informed prospective customer had already confirmed that No-SQL was the required technology; they had completed an initial market analysis without meeting a sales team; they had identified that the sub-groupings which hide under the NoSQL banner (Column store, document, graph etc) each have there uses and they had concluded that they needed a blend of approaches.

 

The Datastax acquisition of Aurelius is further evidence of a market moving towards consolidation.  These forces are partly financial - some smaller companies are struggling to raise much needed funding, and partly technology driven with vendors trying to build their 'stack'.

 

MarkLogic launched the Semantic/Triple-Store functionality in Version 7, 15 months ago.  The decision was taken over two years ago to build the functionality rather than acquire and integrate.  Version 8, due within days, adds SPARQL 1.1 amongst many other features.   Fully integrated with the database and search engine.  As a consequence, a single MarkLogic search will cover text and database search with semantic enrichment included.


This has received a great reception from MarkLogic clients whose concerns about expensive integration projects leading to flaky systems and inconsistent search results across the Enterprise, ranks up there with concerns about a vendors financial stability and longevity....

more...
Dominic Spitz's curator insight, February 5, 2015 8:45 AM
Adrian Carr's (@Adrian Carr) insight:

 

A Big Bank recently called our London office with a sales enquiry.

They had visited db-engines.com and had selected a small number of databases with the right attributes to solve their business problem.

These short-listed companies all claimed to be MULTI-MODEL and included RDF/Graph/Semantic/Triple-Store capability.

 

This call and subsequent discussions were an interesting data point for me in the NoSQL market evolution for the following reasons:

Here was a very well informed prospective customer had already confirmed that No-SQL was the required technology; they had completed an initial market analysis without meeting a sales team; they had identified that the sub-groupings which hide under the NoSQL banner (Column store, document, graph etc) each have there uses and they had concluded that they needed a blend of approaches.

 

The Datastax acquisition of Aurelius is further evidence of a market moving towards consolidation.  These forces are partly financial - some smaller companies are struggling to raise much needed funding, and partly technology driven with vendors trying to build their 'stack'.

 

MarkLogic launched the Semantic/Triple-Store functionality in Version 7, 15 months ago.  The decision was taken over two years ago to build the functionality rather than acquire and integrate.  Version 8, due within days, adds SPARQL 1.1 amongst many other features.   Fully integrated with the database and search engine.  As a consequence, a single MarkLogic search will cover text and database search with semantic enrichment included.

 

This has received a great reception from MarkLogic clients whose concerns about expensive integration projects leading to flaky systems and inconsistent search results across the Enterprise, ranks up there with concerns about a vendors financial stability and longevity....

Scooped by Adrian Carr
Scoop.it!

Why Hortonworks can’t sustain a billion-dollar unicorn valuation

Why Hortonworks can’t sustain a billion-dollar unicorn valuation | Big Data In Business Today | Scoop.it
Hortonworks wants its software to be 100 percent free. Wall Street? Not so much
Adrian Carr's insight:

What to make of the Hortonworks IPO?

This is a great analysis of the IPO and also the business models which exist in the Hadoop and NoSQL markets.

Great insight from Matt Assay with quotes from Gartner (Merv Adrian) and Hadoop founder (Doug Cutting).

more...
No comment yet.
Scooped by Adrian Carr
Scoop.it!

Data Is Good, 'Bidirectionalized Bitemporal' Data Is Better

Data Is Good, 'Bidirectionalized Bitemporal' Data Is Better | Big Data In Business Today | Scoop.it
Different database types do different jobs depending on their data structure and design. Some need to be built for scaling and some need fine grain controls, exceptional availability or a document or graph-aligned bias. Still others will be structured around their ability to retrieve key-value requests (data is stored in [...]
Adrian Carr's insight:

"MarkLogic finishing up on Oracle projects" is a great summary.

Oracle is everybody's first port of call for data issues.

But in the new world, the big data world, a more diverse tool set is required.

Many of the references which Forbes cites were projects where Oracle failed and in each case an enlightened or courageous project team took a leap into what used to be the unknown realm on NoSQL technology.

This is of course no longer an unknown technology, it is close to 'Mainstream'

more...
No comment yet.
Scooped by Adrian Carr
Scoop.it!

Klopotek to Develop Publishing Applications with MarkLogic

Klopotek to Develop Publishing Applications with MarkLogic | Big Data In Business Today | Scoop.it
Klopotek has traditionally built applications using a relational database but is now developing upcoming industry applications using MarkLogic.
Adrian Carr's insight:

 Klopotek, the leading provider of software solutions for the publishing industry, and MarkLogic Corporation today announced that they are collaborating to develop future Klopotek publishing industry applications using MarkLogic® software. The first application, slated for general availability in Q1 2015, is a web-based Rights, Licenses and Permissions Manager. Klopotek will demonstrate a prototype of this application at Frankfurt Book Fair, 8th – 12th October 2014, Hall 4 stand E9.

 

 

po.st/agojCs

more...
No comment yet.
Scooped by Adrian Carr
Scoop.it!

▶ Combining Semantic with Document search and migrating RDBMS data to the MarkLogic NoSQL DB - YouTube

This is a video of a demo myself and two colleagues at MarkLogic, Ken Tune and Jochen Joerg, put together for an internal demo comp - So You Think You Can De...
Adrian Carr's insight:

A great fun short video showing the power of Triples / Semantics / NoSQL Databases in joining disparate data - even structured data...quickly

more...
No comment yet.
Scooped by Adrian Carr
Scoop.it!

UBS opens up business intelligence opportunities with NoSQL database

UBS opens up business intelligence opportunities with NoSQL database | Big Data In Business Today | Scoop.it
UBS has improved its ability to query its regulatory data using a NoSQL database, opening up the potential for using the information for business intelligence purposes.
Adrian Carr's insight:

Another article from Computerworld emanating from the Forrester Forum for Technology Management Leaders.  This time covering the UBS use of NoSQL in their regulation and compliance department.

This shows a great implementation of Tiered storage across a 300TB (and growing) database

more...
No comment yet.
Scooped by Adrian Carr
Scoop.it!

Big-data turf fight: Companies debate which department should control this vital asset.

Big-data turf fight: Companies debate which department should control this vital asset. | Big Data In Business Today | Scoop.it
Companies are debating which department is best set up to oversee the collection, use and protection of this increasingly vital—and potentially dangerous—asset.
Adrian Carr's insight:

Who is responsible for Big data within an Enterprise?

An interesting article in the Wall Street Journal regarding internal turf wars on ownership.

Also survey feedback on which departments are making progress on using EXTERNAL Big data to help make decisions.

Quotes from Avalon Consulting and SAS

more...
No comment yet.
Scooped by Adrian Carr
Scoop.it!

Media Innovation Awards 2014 shortlist: MarkLogic indexes unstructured content for publishers

Media Innovation Awards 2014 shortlist: MarkLogic indexes unstructured content for publishers | Big Data In Business Today | Scoop.it
Adrian Carr's insight:

MarkLogic is announced on the shortlist for the Software & Information Industry Media Innovation Awards for work with The Royal Society of Chemistry, the Press Association, Wiley, Elsevier and the BBC

more...
No comment yet.
Scooped by Adrian Carr
Scoop.it!

Big Data in 2014 – The trends behind the predictions

Big Data in 2014 – The trends behind the predictions | Big Data In Business Today | Scoop.it
Analytics Thought Leader Nenshad Bardoliwalla analyzes the top trends for Big Data in 2014 including Hadoop 2.0, Data Preparation, and Semantic Techniques
Adrian Carr's insight:

An interesting view on Big Data in 2014.

There is a lot of sense in this list although I think it will take longer than the next 12 months to achieve many of these goals.

The evolution of where Hadoop is positioned - coming off the top of the Hype Cycle will provide clarity.  Getting data into a format and then out again through analytics will continue to consume mush energy and $$

Point 3 makes a lot of sense - the use of Semantics to accelerate or automate the 'making sense of Big Data'.

 

more...
No comment yet.
Scooped by Adrian Carr
Scoop.it!

It's Not Just for Scientists: Making Chemistry Accessible by Leveraging MarkLogic

David Leeming of the Royal Society of Chemistry discusses how building a platform on MarkLogic has helped his organization deliver content to a non-scientifi...
Adrian Carr's insight:

David Leeming of the Royal Society of Chemistry discusses how building a platform on MarkLogic has helped his organization deliver content to a non-scientific audience and increase content

more...
No comment yet.
Scooped by Adrian Carr
Scoop.it!

10 big data realities that you should know

10 big data realities that you should know | Big Data In Business Today | Scoop.it
What are the most important aspects of big data that your organisation should start to focus on when developing a big data strategy?
Adrian Carr's insight:

Mark hits another home run with this comprehensive list of Big data realities.  I especially like the debunking of the Hadoop myths - don't get me wrong, their is nothing wrong with hadoop it is just way up the Hype curve right now, ready for some more relaistic expectations...

more...
No comment yet.
Scooped by Adrian Carr
Scoop.it!

Event of Frankfurter Buchmesse - Discoverability & Metadata

11/10/2013 10:00 - Forum Production in Publishing, 4.0 A34, Exhibition site | With Dr.
Adrian Carr's insight:

What looks like it will be a facsinating roundtable at the Frankfurt Bookfair.

Walter de Gruyter, Macmillan and Wiley on the same tickwet, hosted by Outsell's MC extraordinaire - David Worlock

more...
No comment yet.