Eliciting Informative Feedback: The Peer-Prediction Method

Many recommendation and decision processes depend on eliciting evaluations of opportunities, products, and vendors. A scoring system is devised that induces honest reporting of feedback. Each rater merely reports a signal, and the system applies proper scoring rules to the implied posterior beliefs about another rater’s report. Honest reporting proves to be a Nash equilibrium. The scoring schemes can be scaled to induce appropriate effort by raters and can be extended to handle sequential interaction and continuous signals. We also address a number of practical implementation issues that arise in settings such as academic reviewing and online recommender and reputation systems.

• 저널Management Science · 51(9) · 1359–1373
• 토픽Auction Theory and Applications · Management Science and Operations Research
• DOI10.1287/mnsc.1050.0379
• 저자Nolan Miller, Paul Resnick, Richard Zeckhauser