Domestication of crop plants had effects on human lifestyle and agriculture. However, little is known about the underlying molecular mechanisms accompanying the changes in fruit appearance as a consequence of selection by early farmers. We report the fine mapping and cloning of a tomato (Solanum lycopersicum) fruit mass gene encoding the ortholog of KLUH, SlKLUH, a P450 enzyme of the CYP78A subfamily. The increase in fruit mass is predominantly the result of enlarged pericarp and septum tissues caused by increased cell number in the large fruited lines. SlKLUH also modulates plant architecture by regulating number and length of the side shoots, and ripening time, and these effects are particularly strong in plants that transgenically down-regulate SlKLUH expression carrying fruits of a dramatically reduced mass. Association mapping followed by segregation analyses revealed that a single nucleotide polymorphism in the promoter of the gene is highly associated with fruit mass. This single polymorphism may potentially underlie a regulatory mutation resulting in increased SlKLUH expression concomitant with increased fruit mass. Our findings suggest that the allele giving rise to large fruit arose in the early domesticates of tomato and becoming progressively more abundant upon further selections. We also detected association of fruit weight with CaKLUH in chile pepper (Capsicum annuum) suggesting that selection of the orthologous gene may have occurred independently in a separate domestication event. Altogether, our findings shed light on the molecular basis of fruit mass, a key domestication trait in tomato and other fruit and vegetable crops.