Two key members of the Facebook team that created the Hadoop query language Hive are launching their own big data startup called Qubole on Thursday. Co-founders Ashish Thusoo and Joydeep Sen Sarma are taking that experience to provide a managed version of Hive that’s hosted on the Amazon Web Services cloud computing infrastructure.
The founders know from whence they speak when it comes to Hadoop and Hive, which is a framework and associated query language that sits above Hadoop and turns into something resembling a traditional SQL-based data warehouse. Both worked at Facebook from 2007 through 2011 and held senior positions on the data infrastructure team, where they played major roles in creating Hive and scaling Facebook’s Hadoop cluster to 25 petabytes of compressed data (it’s now up past 30 petabytes). Thusoo also spent a year as the project lead for Hive with the Apache Software Foundation.