An increasing number of organizations or communities today are harnessing the power of collective intelligence to tackle problems that are too big to be solved by themselves. While several prior studies have shown that collective intelligence can lead to high-quality output in the context of uncontroversial and verifiable information, it is unclear whether a production model based on collective intelligence will produce any desirable outcome when information is controversial, subjective, and unverifiable.