You don't need a desktop website, according to Google's John Mueller.
In a Hangout on Friday, Mueller, a webmaster trends analyst for the search giant, said that having a mobile site should suffice. He added that going mobile-first or mobile-only wouldn't hurt a page's rank, even in desktop search results.
There you have it. Google says a desktop site is no longer needed if your mobile site works well.