Build engaged audiences through publishing by curation.
Sign up with Facebook
Sign up with Twitter
I don't have a Facebook or a Twitter account
Start a free trial of Scoop.it Business
A breakthrough like big data comes around only once in a blue moon. Here are some basic business rules on what executives need to do to capitalize on it.
Doug Laney of Gartner continues to drive out the ghosts of "Big Data" and pin it's feet firmly to the ground (mixing metaphors ? - maybe).
A pragmatic approach to grounding objectives in business necessity, starting with internal data sources (not all Big Data projects start with collecting Tweets and blogs..) and then evolve.
I am turning into a big fan of Doug's.
Are you sure you want to delete this scoop?
Excellent insights from Gartner.
Big announcements at MarkLogic World this week.
The real news is somewhat larger.
Customers asked for Semantic/Triple Store capabilities - these were delivered in November
Customers asked for a free developer license and lower entry cost production licenses for smaller organisations - these were both delivered in November too.
Is your software supplier listening to your needs ?
(by Adrian Carr, EMEA VP)
NoSQL turf war in full swing as MarkLogic lobs grenades at Cloudant, Cloudera and MongoDB
Computing (Magazine) article on the rapidly changing landscape of the NoSQL database market. Cloudant have been purchased by IBM, MongoDB, Cloudera and Hortonworks have just raised huge tranches of cash. Things are developing rapidly, what will happen next?
What we do know is that whilst each technology is different, the game is the same. We have seen many technology cycles and we know how they end. In this article Gary Bloom shares his views on some of the moves and their meaning.
The last companies standing are not necessarily those with the best technology (VHS v BetaMax), the most hype nor those that raise the most money. The simple economic principles of winning deals and turning a profit outweigh all of the above.
The last companies standing are those that have a practical and profitable business model, can land and expand within the Enterprise, meet or exceed customer expectations, make the right technology decisions and do it all relentlessly on a global scale.
A small ask then...
Open source software powers the world’s technology. In the past decade, there has been an inexorable adoption of open source in most aspects of computing...
The challenges of building a business on top of an Open Source technology are explained brilliantly here by a experienced practitioner.
The question not dealt with in this article is "What are the risks to an Enterprise Customer of committing to a vendor trying to progress along this path which is littered with the corpses of companies who have failed?"
One the one hand, according to this article, the odds are stacked against the Open Source vendor establishing a sustainable business model, on the other hand, those vendors which stand the best chance get dominated by large customers who start to dominate product direction decisions at the expense of the wider installed base.
For many Open Source vendors, the goal may not be as ambitious as to create a sustainable, long lasting business but cashing out in a few years with a high return.
Where does that leave the Enterprise customer ?
Great update to the Wikibon review of the 'Big data' market.
NoSQL accounts for just $290m of the $18bn market with services, compute and storage taking the lions share.
Many of the smaller companies are private and hence do not release their revenue figures - the impact on the total picture is minimal but the rankings of the smaller players are estimated.
The top five companies who are Big data pure plays are Palantir, Pivotal, Splunk, Mu Sigma and Opera Solutions with MarkLogic hot on their heels.
If you look at the bottom of the vendor table there is a host of niche specialist Big data companies still on the launchpad at $20m or less.
This sector is still small but will accelerate into a attrition and acquisition phase as the market starts to get the attention of the 'industry whales'. With some of the larger companies trading or valued at >20 times earnings at the top end, the smaller players have everything to play for.
The key challenge remains - turning investment dollars into revenue dollars. Profitability is something to worry about in the future.
One of the most important features for managing unstructured data is the ability to quickly search the data and get back relevant results. Marklogic provides support for full text searches as well as complex searches on Unstructured data.
Nice demo of Tableau visualising unstructured data managed by MarkLogic.
John Wiley & Sons, Inc., is pleased to learn that Wiley colleagues are the recipients of the IT Project Team of the Year Award in the Organisational Excellence
Existing MarkLogic customer AGU became a partner of Wiley's in Sept. 2012, and Freddie and his team were tasked with migrating all of the AGU content and functionality (21 journals-160K articles; 33 virtual journals, 743 special sections, customer information, alerts and 60 new enhancements) to the Wiley Online Library by January 1, 2013. For them it was like pushing out 2 major releases in the time it takes them to do 1 aggressive release. And of course, we know how the story ends, Wiley successfully launched the content on Jan. 2, 2013 by leveraging Wiley's previous investment and expertise in MarkLogic.
FoundationDB is a database that combines NoSQL scalability with true multikey ACID transactions.
Who has ACID transactions ?
Here is a decent list.
Note, many of those who do not have ACID transactions will mention Brewers CAP Theorem and use it as proof that ACID is unnecessary...
The past decades organisations have been working with relational databases to store their structured data. In the big data era however, these types of databases are not sufficient anymore.
MarkLogic, the largest pure play vendor with 13% of the market.
What it does: MarkLogic’s database was designed for unstructured data, like documents, video or any data that doesn’t fit nicely into rows and columns, so customers can build applications without knowing exactly what the data might look like or how they will be formatted.
How it’s been used: JPMorgan Chase & Co. uses MarkLogic at the heart of its derivatives processing. Derivatives have more complexity than a ticker symbol and a price, so don’t play well with databases designed for structured data.
Before bringing in MarkLogic, the bank modeled a dozen or so databases—a separate one to serve each of the functions, such as settlement, affirmations, matching and accounting, that it uses the data for. It also had to make the same number of copies of the data to service each database.
It is hard to believe this is from nearly 2 years ago...Ahead of their time ? maybe.
Here are the top uses for MarkLogic in the financial services industry:
Risk Management and Post Trade Processing including
risk aggregation, reference data management and portfolio analysis.
Regulatory Compliance for Dodd-Frank Swap Reporting, FATCA Compliance, Know-Your Customer and Anti-Money Laudnering.
Customer On Boarding including Institutional Customer Onboarding
and Retail & Private Bank Customer Onboarding
Pre-Trade Analytics - Commodity Futures & Historical Tick Data Analysis
Customer Insight & Product Targeting in the Credit Card business lines, retail and private banks and corporate finance.
Research Management for both broker-dealer research and vendor research
Extending this futher into the insruance industry, Insurance Claims Management for P&C Claims and fraud analysis are both excellent applications for this technology.
If big data is a big party, Hadoop would be at the center and be surrounded by Hive, Giraph, YARN, NoSQL, and the other exotic technologies that generate so much excitement.
This a very detailed review of MarkLogic's positioning within the NoSQL and broader Db market place.
It covers the funding, the technology and the positioning versus Hadoop and the NoSQL start-ups.
Whilst MarkLogic is not today seen as such a 'sexy' proposition for a developer's Resume/CV, they are getting the job done in large enterprises, doing the 'grown-up, dull sorts of things but also cool things that other NoSQL players aren't able to .. because they're playing catch up on the enterprise stuff'
More comment on the Wikibon report
Sept 8, 2013Fari PayandehAlthough Mainframe Hierarchical Databases are very much alive today, The Relational Databases (RDBMS) (SQL) have dominated the Database market, and they have done a lot of ...
This comparson of hadoop versue the 'new-age' DBs is useful but incomplete. It provides a good beginning to the debate but then stops short of a complete view of the solutions. There are more complete comparisons further down this ScoopIt page.
For instance, not all NoSQL is open-source and some are ACID compliant....
Why did Intel pay so much to invest in Cloudera? FORTUNE -- Intel Corp. last week announced a large strategic partnership with Cloudera, a Hadoop-focused enterprise data management company that just weeks earlier had raised $160 million in late-stage venture capital
An interesting PoV on the recent Cloudera fundraising including $760m from Intel. Does this kind of valuation signal the top of the market ? Interesting times in the NoSQL & Hadoop market
Visit MarkLogic.com to read Schema-on-Read vs Schema-on-Write.
For decades now the database world has been oriented towards the schema-on-write approach. First you define your schema, then you write your data, then you read your data and it comes back in the schema you defined up-front. This approach is so deeply ingrained in our thinking that many people would ask, “how else would you do it?” The answer is schema-on-read.
Joe Pasqua challenges 'Relational Thinking' in his blog post.
Why transform data just to store it pending a further transformation when you want to extract/use the data ? Other than to boost the profits of ETL companies, is there another reason ?
The new Intel Data Platform features the latest version of its Hadoop distribution
Hadoop is growing up !
Intel is hardening the 'Enterprise' features in Hadoop by focusing on reliability and security.
This is great news for those many businesses who are struggling with deployment due to Enterprise unreadiness.
As Hadoop heads towards the 'Trough of Disillusionment' on Gartner's Hype Cycle (like a mono-cycle but with less wheels) the Enterprise capabilities could provide the vehicle to mount the 'Slope of Enlightenment'...
(with thanks to Gartner for the colourful names)
I nearly forgot to mention that MarkLogic ships with the Intel Distribution of Hadoop - the reason being that MarkLogic is entirely focused on the Enterprise....
Publisher Walter de Gruyter deployed a content management solution to consolidate the legacy platforms in one customer facing application.
Walter de Gruyter was founded in 1749 and has a back catalogue strectching back to those times. The customers however, all want services and products to match todays environment. This is a short video of how de Gruyter . Maintenance has gone down, application changes are faster, partnership and the integration of acquisitions are faster....
Secure Big Data available in the cloud through MarkLogic 7.
Blog Post from Evan Quin of EMA
If there was a NoSQL storm brewing earlier this decade, Hummer Winblad’s Mitchell Kertzman thinks it has all but died down.
MongoDB is easy to make fun of. The global write lock (now just a database-level write lock, woo). The non-durable un-verifiable writes. The posts …
MongoDB (formerly 10Gen) are suddenly coming in for some flak (also see the link below).
This is a new development as for quite some time they have been able to do no wrong.
Is this because they are moving across from 'The Rebels' to 'The Federation' with their $1.2 bn valuation ?
MongoDB mocked after posting “100GB Scaling Checklist”
Once again Wikibon provide a really valuable and insightful report on the dynamic NoSQL software space. Starting from why NoSQL emerged and where from and eb=nding with where it is headed.
they have singled out 21 companies that they expect to continue to drive innovation in the database market. If you want Transactional Consistency (ACID) then there is only one on the list....
Isn't it time your search worked for you?
As data explodes in Enterprises, precise search and discovery of information is critical. With sub-second search capabilities over billions of records and the ability for millions of simultaneous targeted searches, MarkLogic provides the most advanced Big Data search out there. Don’t get stuck migrating to replacement software, when a simple switch to MarkLogic could take your business further, faster
Nice win for MarkLogic!
And here it is.
The (not quite perfect but the best we have given many of the companies are private) update Wikibon view of the NoSQL and Hadoop world.
The market reached $542m and is growing at 45% CAGR.
Very interesting comparisons of funding versus revenues at the foot of the arcticle.
Fudning creates media interest and market froth but unless you can turn it into revenue quickly, the future remains uncertain...