How does DO best mark quality? Do we let everything in? Gate keep? Community review?

Question:
How does DO best mark quality? Do we let everything in? Gate keep? Community review?

First DO must define what we mean by quality, and then decide how to mark quality. As a group, we decided that validity is the most important aspect of quality, and that popularity is the best criterion of quality. We also decided that there are three levels of quality that DO needs to address, which are broken down by a hierarchy of communities. The three levels/communities are: the general public, the synthesized community (such as magazines), and the scientific community, with the general public having the least stringent “quality” thresholds and the scientific community having the most stringent. Each of these communities have their own standards/feedbacks mechanisms. For the general public, we can develop a set of criteria by which general public users judge quality, and the public will also have a quality feedback tool to give DO feedback about how to judge quality (turning this process on its head). The feedback tool would ask the general public for markers on validity, popularity/entertainment value, aesthetics, clarity, novelty. For the synthesized community, there is generally a preset group of standards, decided by those venues. For the scientific community, we need to have the most rigorous standards.