Big Data Technology, Semantics and Analytics
12.0K views | +5 today
Follow
Big Data Technology, Semantics and Analytics
Trends, success and applications for big data including the use of semantic technology
Curated by Tony Agresta
Your new post is loading...
Your new post is loading...
Scooped by Tony Agresta
Scoop.it!

US patent office embraces big data

US patent office embraces big data | Big Data Technology, Semantics and Analytics | Scoop.it
For inventors and companies getting a patent or trademark the process can be long and difficult. Patent applications have their own language, and both users and application reviewers alike have to ...
Tony Agresta's insight:

A quote from the article:  “The patent office is trying to make patents more accessible, there is a large backlog of people applying, and a lot of that is because of the process,” explains Rick Miller, Director Federal, State & Local for MarkLogic in an interview with CivSource. “The key benefit to putting manuals online for patent applicants, is so they can learn if their application is patentable before going through the whole process.”

more...
No comment yet.
Rescooped by Tony Agresta from NoSQL Databases
Scoop.it!

Land Registry provides linked data - Land Registry for England and Wales

UK Government Agency responsible for the House Price Index, Property Prices, Property Ownership, Title Deeds, Title Plans, Title Registers.

Via Adrian Carr
more...
Adrian Carr's curator insight, April 25, 2013 8:52 AM

England & Wales Land registry make their data available to the public.

The Open data revolution continues a pace and this is clear evidence that there is substantial amounts of open data available which does not contain sensitive information.

 

The next stpe of the revoution is for companies to leverage this data, combine it with their own ip and make money from it.

 

When people ask what is "Big Data" all about...it is this. 

Adam Fowler's curator insight, May 3, 2013 7:20 AM

More UK Linked Data innovation!

Rescooped by Tony Agresta from NoSQL Databases
Scoop.it!

Gartner's basic business rules for capitalizing on big data

Gartner's basic business rules for capitalizing on big data | Big Data Technology, Semantics and Analytics | Scoop.it
A breakthrough like big data comes around only once in a blue moon. Here are some basic business rules on what executives need to do to capitalize on it.

Via Adrian Carr
more...
Adrian Carr's curator insight, April 25, 2013 10:00 AM

Doug Laney of Gartner continues to drive out the ghosts of "Big Data" and pin it's feet firmly to the ground (mixing metaphors ? - maybe).

A pragmatic approach to grounding objectives in business necessity, starting with internal data sources (not all Big Data projects start with collecting Tweets and blogs..) and then evolve.

 

I am turning into a big fan of Doug's.

Bryan Borda's curator insight, April 26, 2013 9:29 AM

Excellent insights from Gartner.

Scooped by Tony Agresta
Scoop.it!

Big Data: The New Natural Resource | The Big Data Hub

Big Data: The New Natural Resource | The Big Data Hub | Big Data Technology, Semantics and Analytics | Scoop.it
Infographic: Big data is the digital convergence of structured data found inside databases, and unstructured data flowing from new sources like social networks, mobile devices, sensors, RFID, smart meters and financial systems.
Tony Agresta's insight:

Interesting metrics on how fast Big Data is growing.

more...
Adrian Carr's curator insight, April 23, 2013 7:51 AM

Intresting infographic regarding the growth in Big Data

Scooped by Tony Agresta
Scoop.it!

It's the Shape, Not the Size - of the Data - that Matters

It's the Shape, Not the Size - of the Data - that Matters | Big Data Technology, Semantics and Analytics | Scoop.it
Community Blogs, comments and opinions by industry professionals
Tony Agresta's insight:

Great insights from Amir Halfon on Enterprise NoSQL and some of the challenges organizations face today with respect to relational databases.   Here's a quote from the blog post


"The answer lies within a different category of technology called Enterprise NoSQL, which has been designed and built with transactions and enterprise features from the ground up, just like relational databases. But unlike those, an Enterprise NoSQL database models the data as hierarchical trees rather than rows and columns. These trees are aggressively indexed in-memory as soon as the data is ingested, and then used for both element retrieval and full text search, unifying two concepts that have traditionally been separate - the database and the search engine."

more...
No comment yet.
Scooped by Tony Agresta
Scoop.it!

Sequoia, Tenaya lead $25M funding of Big Data platform provider MarkLogic - Silicon Valley Business Journal

Sequoia, Tenaya lead $25M funding of Big Data platform provider MarkLogic - Silicon Valley Business Journal | Big Data Technology, Semantics and Analytics | Scoop.it
Big Data platform provider MarkLogic Corp. said on Wednesday it has raised $25 million...
Tony Agresta's insight:

Good news here for MarkLogic!

more...
Adam Fowler's curator insight, May 3, 2013 7:19 AM

Great news! Especially as were using some of it to expand the sales and pre-sales organisation that I'm part of!

Scooped by Tony Agresta
Scoop.it!

Gartner's Technology Trends for Information Infrastructure: Big Data, NoSQL and In-Memory Computing

Gartner's Technology Trends for Information Infrastructure: Big Data, NoSQL and In-Memory Computing | Big Data Technology, Semantics and Analytics | Scoop.it
Big Data, NoSQL databases and In-Memory computing are some of the technologies that will play key role in modernizing information management in 2013 and beyond, according to Gartner.
Tony Agresta's insight:
  • Spend time building value, not building schemas and infrastructure. From rich indexes (including text and geospatial), analytic functions, and In-database MapReduce to visualization widgets and Application Builder, MarkLogic provides the infrastructure you need to deliver applications rapidly.
  • Leverage your existing skills and multiply them. Text, XML or JSON; Java, REST, XQuery or SQL; Point + Click application authoring or traditional IDE. You can use the languages and tools you already know and love to start building quickly.
  • Proven track record. In the last decade, we’ve deployed more customer-facing, mission critical Big Data applications in large enterprises than all the other NoSQL databases combined.

You can learn more about what distinguishes an Enterprise NoSQL database approach from Open Source here:


http://www.marklogic.com/what-is-marklogic/enterprise-nosql/




more...
No comment yet.
Rescooped by Tony Agresta from Big Data, IoT and other stuffs
Scoop.it!

Grow Revenue With Big Data: Get Sales and Marketing on the Same Page [Infographic]

Grow Revenue With Big Data: Get Sales and Marketing on the Same Page [Infographic] | Big Data Technology, Semantics and Analytics | Scoop.it
Sales - To meet revenue goals, Sales and Marketing should work together. Unfortunately, they often don't. Why is that? Check out this infographic to learn about reasons for the clash and some ...

Via Toni Sánchez
Tony Agresta's insight:

This infographic captures some of the reasons why sales and marketing are not on the same page.   Here's what you need to do to create alignment and exceed revenue targets.

 

  • Great messaging that describes your value proposition with training for sales so everyone pushes the same messages to market.
  • Marketing plans and go to market strategies that capture obvious targets through an outbound approach.
  • PR and social media designed to ramp up the lead volume on the inbound side.   Educational content typically stands a much better chance of attracting interested, engaged prospects.
  • A sales methodology to qualify sales ready leads and systematically move them through the pipeline.
  • CRM systems with lead scoring allowing sales and marketing to track the digital behavior of prospects and optimize event triggered marketing, multi-stage campaigns and targeted conversations.
  • Content libraries allowing sales easy access to marketing approved content, delivery to prospects and tracking.
  • Measurement to assess campaign effectiveness, ROI, lead production and conversion to opportunities.

 

Professional sales and marketing organizations that track all the details about leads, contacts and opportunities in the form of notes can create medium sized data sets that combine call notes, meeting summaries, web page activity, activity history and clicks.   When combined with social media used to build out the profile of prospects, the data can get much larger.   It still doesn't rank with the massive data collected in other industries but the need to ingest and analyze this data exists today and few organizations are doing a good job at this.



more...
No comment yet.
Scooped by Tony Agresta
Scoop.it!

U.S. Patent and Trademark Office Launches New Big Data Application on MarkLogic(R)

U.S. Patent and Trademark Office Launches New Big Data Application on MarkLogic(R) | Big Data Technology, Semantics and Analytics | Scoop.it
SAN CARLOS, CA--(Marketwire - Mar 26, 2013) - MarkLogic Corporation, the provider of the MarkLogic® Enterprise NoSQL database, today announced that the U.S.
more...
No comment yet.
Scooped by Tony Agresta
Scoop.it!

Zero Friction Analytics | MarkLogic

Visit MarkLogic.com to read Zero Friction Analytics.
Tony Agresta's insight:

Ken Krupa makes great points in this recent blog post - Here's an excerpt:   "We have again hit an inflection point where the pace of data creation has far surpassed our ability to process it using only relational tools. As with the file-based era, we were also not idle during the relational era with respect to our propensity for new data creation. Accelerated greatly by the World Wide Web, we are now deluged with a myriad of applications not only at our desktops but also on our phones and anywhere the web and/or technology has reach (cars, homes, etc.). And while many of these web-enabled applications are powered by relational technologies, the subsequent data emitted by them (in the form of tweets, blog posts, FaceBook “likes”, etc.) is inherently unstructured."    


Learn more about how unstructured data can be managed using an Enterprise NoSQL approach by reading the full post.

more...
Adrian Carr's curator insight, March 25, 2013 5:50 AM

Ken makes a strong caswe for the need for zero friction analytics - there is too much data moving too quickly for every use case to be modelled.

"... we are at the 3rd era of data processing and it’s very big and quite unstructured".."where the technology itself discovers relationships that are otherwise not apparent. And things are moving beyond that as well, with advances in semantics (i.e. inferring meaning and context from data) progressing into the mainstream...

 

A great article!

Scooped by Tony Agresta
Scoop.it!

Seeing the future at MIT’s Sloan Sports Conference | Digital Trends

Seeing the future at MIT’s Sloan Sports Conference | Digital Trends | Big Data Technology, Semantics and Analytics | Scoop.it
Now in its seventh year, MIT’s Sloan Sports Conference is no longer about jocks versus nerds; it’s about the future of training, competition, and winning.
Tony Agresta's insight:

Big data analysis has extended into sports.  This article shows how NBA teams are using big data to analyze the geospatial position of players on the court including where they position themsleves, run the court and shoot.  The data visualizations at the end of the article should not be missed.

more...
No comment yet.
Scooped by Tony Agresta
Scoop.it!

Unreported Side Effects of Drugs Are Found Using Internet Search Data, Study Finds

Unreported Side Effects of Drugs Are Found Using Internet Search Data, Study Finds | Big Data Technology, Semantics and Analytics | Scoop.it
Scientists have detected evidence of unreported prescription drug side effects before they were found by the Food and Drug Administration’s warning system.
Tony Agresta's insight:

Big data analytics including data analysis from the open web holds great promise to improve patient outcomes.    There was another article posted just this week on a similar subject.  It's entitled "Data Analytics Deep is the New Big" and can be found on my Scoopit page with comments.


http://www.scoop.it/t/big-data-technology-applications-and-analytics


more...
No comment yet.
Scooped by Tony Agresta
Scoop.it!

Get Your Facts Straight: We've Had Enterprise-Grade Security Longer

Visit MarkLogic.com to read Get Your Facts Straight: We've Had Enterprise-Grade Security Longer.
Tony Agresta's insight:

This blog post says it all about enterprise-grade security for MarkLogic's Enterprise NoSQL database.   It includes a clear definition of enterprise-grade security including the points referenced below.  The fact is, MarkLogic has had this for over 10 years.  


  • Internal Authentication
  • Permission Management
  • Data Auditing
  • Client to Node Encryption
  • External Security Firm Validation
  • Transparant Data Encryption
  • Compartment Security


One of the primary reasons government agencies have used MarkLogic for years is because of this fact.   They would never trust mission critical operations and data to any technology that wasn't enterprise hardened.


Read more here:


http://www.marklogic.com/blog/get-your-facts-straight-weve-had-enterprise-grade-security-longer/





more...
No comment yet.
Scooped by Tony Agresta
Scoop.it!

Visa Says Big Data Identifies Billions of Dollars in Fraud

Visa Says Big Data Identifies Billions of Dollars in Fraud | Big Data Technology, Semantics and Analytics | Scoop.it
Visa’s chief enterprise risk officer, Ellen Richey, says “you see the criminal capability evolving on the technology side.” She gives CIO Journal an inside look at how the company has used Big Data to make its network more secure...
Tony Agresta's insight:



The approach Visa takes in identifying fraud is grounded in 16 different predictive models and allows for new independent variables to be added to the model.  This improves accuracy while alowing the models to be kept up to date.  Here's an excerpt from the WJS Article:

 

"The new analytic engine can study as many as 500 aspects of a transaction at once. That’s a sharp improvement from 2005, when the company’s previous analytic engine could study only 40 aspects at once. And instead of using just one analytic model, as it did in 2005, Visa now operates 16 models, covering different segments of its market, such as geographic regions."

 

The article also states that the analytics engine has the card number and not the personal information about the transaction - likley stored in a different system.  I wonder if Visa, at some point in the process, also takes the fraud transactions and analyzes them visually to identify connections and linkages based on address, other geographic identifiers, 3rd party data, employer data and more?  Are two or more of the fraud cases in some way connected?  Does this represent a ring of activity presening higher risk to merchants, customers and Visa?

 

The tools on the market to do this work are expanding.   The data used to analyze this activity (including unstructured data) is being stored in databases that allow for the visual analysis of big data.  Graph databases replete with underlying intelligence extracted from text that identify people, places and events can be used to extend the type of analysis that Visa is doing and prioritize investigations.   Through more efficient allocation of investigation resources, fraud prevention can jump to a higher level.


more...
luiy's curator insight, April 27, 2013 2:37 PM

“From the strategic point of view, we are achieving an amazing improvement, year over year, in our ability to detect fraud,” says Richey. “It’s not just our ability to analyze our transactions, but our ability to add new kinds of data, such as geo-location, to that analysis. With every new type of data, we increase the accuracy of our models. And from a strategic point of view we can think about taking and additional step change of fraud out of our system.”

In the future, Big Data will play a bigger role in authenticating users, reducing the need for the system to ask users for multiple proofs of their identify, according to Richey, and 90% or more of transactions will be processed without asking customers those extra questions, because algorithms that analyze their behavior and the context of the transaction will dispel doubts. “Data and authentication will come together,” Richey said.

The data-driven improvement in security accomplishes two strategic goals at once, according to Richey. It improves security itself, and it increases trust in the brand, which is critical for the growth and well-being of the business, because consumers won’t put up with a lot of credit-card fraud. “To my mind, that is the importance of the security improvements we are seeing,” she said. “Our investments in data and analysis are baseline to our ability to thrive and grow as a company.”

Rescooped by Tony Agresta from NoSQL Databases
Scoop.it!

Welcome to the Age of Big Drone Data | Danger Room | Wired.com

Welcome to the Age of Big Drone Data | Danger Room | Wired.com | Big Data Technology, Semantics and Analytics | Scoop.it
The Air Force can't deal with all of the footage its flying spy 'bots take. And with the fancy new cameras the drones are getting, the problem is about to get way, way worse.

Via Adrian Carr
more...
Adrian Carr's curator insight, April 25, 2013 9:53 AM

You are being watched !

and downloaded, indexed, sorted, serached, reported on and...hopefully exlcuded.

Big Drone Data will drive infrastructure upgrades for the USAF and doubtless many nations will follow suit.

This represents huge volumes of data, at speed - a challenge for the network but even more of a challenge for the analyst.

Scooped by Tony Agresta
Scoop.it!

Data Analysis and Unstructured Data: Expanding Business Intelligence (BI) by Thinking Outside of the Box - Zunia.org

Data Analysis and Unstructured Data: Expanding Business Intelligence (BI) by Thinking Outside of the Box - Zunia.org | Big Data Technology, Semantics and Analytics | Scoop.it
Tony Agresta's insight:

New forms of business intelligence incorporate both structured and unstructured data into your analysis.   Where does this apply today?  Customer service, intelligence analysis in government, fraud analysis in financial services, healthcare, consumer packaged goods, retail and other markets can benefit from this approach.  The open web provides organizations with limitless data containing valuable information on sentiment, people, events, employers, relationships and more.   The ability to extract meaning from unstructured sources combined with structured data yields new insights that can be used to improve decisions. 

 

Let's take a look at healthcare, for example.

 

In an article by Dennis Amorosano entitled "Unstructured data a common hurdle to achieving guidelines", Mr. Amorosano writes "... of the 1.2 billion clinical documents produced in the United States each year, approximately 60 percent contain valuable information trapped in unstructured documents that are unavailable for clinical use, quality measurement and data mining. These paper documents have until now been the natural byproduct of most hospital workflows, as healthcare is one of the most document-intensive industries."

 

Forbes published an article last year entitled "The Next Revolution in Healthcare"  (http://www.forbes.com/sites/singularity/2012/10/01/the-next-revolution-in-healthcare/) in which the author points out that the best healthcare institutions in the world still rely heavily on calculating risk to patients using clinical data.  At the same time "the real tragedy is that the information needed to properly assess the patient’s risk and determine treatment is available in the clinician’s notes, but without the proper tools the knowledge remains unavailable and hence, unused."

 

The good news is that new analytic solutions are available that leverage both forms of data.   BI connectivity brings the power of familiar Business tools to your applications that include unstructured data. Some of the benefits to this approach include:

 

  • Combining BI and NoSQL provides capabilities not available using relational stores and EDWs - real-time analysis and extended query features.
  • BI tools layer on top of NoSQL databases that use sophisticated security models to protect sensitive data. Users see only the information for which they have permissions.
  • Analysts can learn faster using data discovery tools that allow for rapid investigation of both unstructured and structured data within the same application.  A more complete view of your analysis offers tremendous advantages in patient diagnosis, claims analysis and personalized care.

 

To learn more about how analytics technology is working with Enterprise NoSQL Databases ideally suited to ingest, store, search and analyze all types of data, you can visit this page:

 

http://www.marklogic.com/what-is-marklogic/analytics-business-intelligence/

 

more...
No comment yet.
Scooped by Tony Agresta
Scoop.it!

ACID Transactions...Check! | MarkLogic

Visit MarkLogic.com to read ACID Transactions...Check!.
more...
No comment yet.
Scooped by Tony Agresta
Scoop.it!

Google Uses Big Data to Fight Human Trafficking | CIO Today

Google Uses Big Data to Fight Human Trafficking | CIO Today | Big Data Technology, Semantics and Analytics | Scoop.it
Big Data is being used to obtain intelligence on virtually every transaction conceivable. Now, Google is taking Big Data analytics into a new arena -- the fight against human trafficking.
more...
No comment yet.
Scooped by Tony Agresta
Scoop.it!

Big Data is Just the Beginning: Cisco Connected World Technology Report

Big Data is Just the Beginning: Cisco Connected World Technology Report | Big Data Technology, Semantics and Analytics | Scoop.it
This week, the third and final chapter of the most recent Cisco Connected World Technology Report was released. This global survey asked 1,800 IT professionals
Tony Agresta's insight:

As this article states, security around Big Data is essential.   Enterprise approaches to big data are secure to handle mission critical applications in government sectors.     This should be an important evaluation criteria when evaluating big data technology.   A quote from the Cisco report: 


"More than one in four respondents globally said that data security and risk management are a major concern. Protecting Big Data is a big challenge. Data resides everywhere; it is in the cloud, in mobile devices, and in social networks. Data comes from disparate sources in different shapes and forms. Multi-perimeter protection is key but securing data and protecting users’ privacy goes beyond the traditional IT view."


To learn more about MarkLogic, you can go here:

http://www.marklogic.com/what-is-marklogic/inside-marklogic/



more...
No comment yet.
Scooped by Tony Agresta
Scoop.it!

MongoDB 2.4 addresses search concerns - SD Times: Software Development News

MongoDB 2.4 addresses search concerns - SD Times: Software Development News | Big Data Technology, Semantics and Analytics | Scoop.it
New release brings tools to help scale the NoSQL poster child, as well as default settings that will prevent newbie mistakes
Tony Agresta's insight:

We agree with key points made in this article including: 


"Stirman said that the search capabilities added to MongoDB 2.4 are not a panacea. It does not have 'everything you could ever need in search, but we think that for a lot of people, the feature will be good enough. There will still be users who have more sophisticated needs for search, and they will integrate with a separate search technology,' he said.


Integrating with other search technology is never easy.  Maintaining two technologies always presents challenges. 


I would highly suggest you read this blog post written by the Bloor Group on MarkLogic:


http://www.bloorresearch.com/blog/IM-Blog/2013/2/haven-heard-nosql.html


You will find a great list of search capabilities in MarkLogic here:


http://www.marklogic.com/what-is-marklogic/big-data-search/





more...
No comment yet.
Scooped by Tony Agresta
Scoop.it!

Springer Selects Compuware APM to Optimize Online Library Applications

Springer Selects Compuware APM to Optimize Online Library Applications | Big Data Technology, Semantics and Analytics | Scoop.it
NASDAQ News: Springer Selects Compuware APM to Optimize Online Library Applications
more...
No comment yet.
Scooped by Tony Agresta
Scoop.it!

Big Data Can Bring Patients to Water But It Can’t Make Them Think - The CIO Report - WSJ

Aetna is using predictive analytics to help members reduce the likelihood of heart disease, but getting them to adhere to best health practices remains “a challenge.” (RT @bighealthidea: Aetna Innovation Labs in WSJ.
more...
Scooped by Tony Agresta
Scoop.it!

Backs Against the Wall | MarkLogic

Visit MarkLogic.com to read Backs Against the Wall .
Tony Agresta's insight:

MarkLogic World is fast approaching.  Don't miss this opportunity to hear from the largest set of Enterprise NoSQL customers assemled in one location.    Wiley and ALM are two of many and will be talking about "Gearing up the Content Factory.    A recent blog post from MarkLogic stated "Both Quek and Bishop’s companies had been using MarkLogic and were strong believers in the power of an Enterprise NoSQL database and used these “impossible missions” as a chance to create content factories — with MarkLogic as the core. At ALM, MarkLogic was the finished goods repository that powered their new workflow solution, SmartLitigator. But MarkLogic was the final stop after a byzantine print-based workflow. Bishop needed to change up all that and make MarkLogic the central platform in the factory.


See the full agenda here:

http://www.marklogic.com/events/marklogic-world-2013/

more...
No comment yet.
Scooped by Tony Agresta
Scoop.it!

Hadoop 2013 – Part Four: Players

Tony Agresta's insight:

This is from the Gartner Blog by Merv Adrian:  "A deal with MarkLogic Enterprise NoSQL to incorporate and support Intel’s distribution, seeing Intel’s chip-based encryption as a good complement to MarkLogic’s role-based NIAP and CCEVS-compliant security system. And of course to expand the reach of the MarkLogic engine to HDFS."

more...
No comment yet.
Scooped by Tony Agresta
Scoop.it!

Resources - MarkLogic

Tony Agresta's insight:


There is a wealth of information now fully available in the resources section of MarkLogic.com.  This includes analyst perspectives, case studies, customer videos and more.  If you're interested in how the new generation of database technology (Enterprise NoSQL) has been put into production across media, financial services, healthcare, public sector, oil & gas and other industries, this educational library is the single best resource on the internet.   This represents over 10 years of success in enterprise grade production environments and clearly distinguishes MarkLogic from anyone else.


By the way, many of these customers will be live, on stage at MarkLogic World 2013 in Las Vegas starting April 8.   The insights they will present are remarkable and should not be missed.   For interested parties, you can register here:


http://www.marklogic.com/events/



more...
No comment yet.