Zetor
What would your solution be to that? It seems to me like the only obvious one is just for Cryptic to have more people whose job it is to comb through all the shit to find the diamonds, but admittedly that isn't so much of a solution to the problem as coping with it, and a F2P model doesn't exactly suggest they want to invest lots of money on something so trivial. I suppose you could invent some sort of basic system that makes an itemized list of things that tend to correspond with quality mods (non-error-spitting dialogue with lots of conditionals, and/or a certain threshold of editing beyond basic templates) and have the system automatically vote said mods up under the hood, but all of that is about as exploitable and prone to abuse as search engine metrics.
There are a few solutions, and I've actually prepared a megapost on this subject which I'll drop in the NW Foundry forums when they open. First step is accepting that:
- The system is symmetric instead of asymmetric (like a mod community, book reviews, whatever) -- low barrier-of-entry tools and F2P means a lot of people will mess around with the system.
- 90%+ of the content in the system will be crap. See also: Sturgeon's Law.
- The overwhelming majority of players isn't interested in story-heavy content, they want hack-and-slash or farming, mostly farming. Farming in this context means max reward with min effort.
- There's too much content in the system for a simple 5-star system to cover effectively. Anything not in the first 10 pages may as well not exist.
- There's WAY too much content in the system for hand-picked "dev choice" and player review solutions to work as anything other than highlighting a tiny slice of the entire thing. It doesn't matter whether cryptic has 4 people or 40 people doing this, or even if there are 50 trustworthy community members wasting 2 hours at a time to review / vet content (in COH, by month 4 there were 300000 player-created campaigns with 1-5 missions each; there were a little more than 500 reviews of these campaigns total. This was during the 'golden age' and the reviewer community shrunk quickly after that, fwiw.)
- Players have different tastes, and these tastes are often directly opposed (someone who wants farm missions will downvote stories; someone who likes fighting will downvote stories with lots of text; someone who wants challenging missions will downvote mystery and 'talky' missions).
- lots of other issues that I don't want to detail here: voting cliques, upkeep problems, disappearing authors, ratings momentum, insignificance of forums and other community sites, blah blah blah.
Conclusion: the ingame browse tool needs to be enhanced to allow players to find content they'd like (or probably like). I'd go as far as to say that a 5-star rating system doesn't work at all, but since it's not going to be changed at this point, it may be better to just improve it instead.
Some early solution ideas based on the COH MA community's 3+ years of efforts (again, not too many details here):
- A complex tagging system that can be used to identify missions based on playstyle (farm, story, combat-heavy, solo-friendly, etc), types of enemies, location, length, etc. Needs to support boolean operators and it should also allow players to tell what THEY think a particular content can be tagged for (ie. creator thinks the quest is solo-friendly, but it turns out it isn't at all)
- The ability to create and share favorites lists of content, and automatically see friends'/guildies' lists when browsing.
- Generating recommendations ("if you liked this, you may also like" / "you might want to try") for the player based on tags/keywords and their past preferences (if you vote 5 on a lot of drow-related quests, you'll see more drow-related quests pop up). This system should prioritize lesser-played but high-quality content for generating recommendations, too.
- Various improvements to the rating system such as vote weighting / normalization, vote accountability, ability to vote on votes ("x of y people found this useful"), etc. Plenty of examples on Amazon and similar websites that work.