FORECASTING ACCURACY: COMPARING PREDICTION MARKETS AND SURVEYS – AN EXPERIMENTAL STUDY

Article Sidebar

Requires Subscription or Fee PDF (GBP 25)
Published: Dec 18, 2012
DOI: https://doi.org/10.5750/jpm.v4i3.478
Keywords:
Forecasting accuracy experiment method comparison information aggregation prediction markets survey

Main Article Content

Robert Reig
Accounting and Control Aalen University
Ramona Schoder
Diplom-Kauffrau Research Assistant Aalen University

Abstract

Prediction markets are viewed as the most accurate instrument for collective forecasts. However, empirical studies, mostly based on political elections, deliver mixed results. An experimental study was conducted to avoid certain biases and problems and to better control conditions of eliciting information from individuals. One typical problem is for example comparing prediction markets that focus on judging the public opinion in the future with polls asking for individual election preferences at a certain point of time. Therefore, our study compared forecast accuracy between prediction markets and a simple survey for the same forecasting item.The results showed roughly the same accuracy for all employed methods with the survey delivering slightly better results at lower costs, which was surprising. The experiments demonstrated also that it is possible to gain highly accurate forecasts with a relatively small number of participants (6-17) taking part continuously.

Article Details

Issue
Vol. 4 No. 3 (2010)
Section
Articles

References

Annonymous. (2010). Public Opinion Poll: Polling Organizations Retrieved August 30th, 2010, from http://www.servinghistory.com/topics/public_opinion_poll::sub::Polling_Organizations

Berg, J., Forsythe, R., Nelson, F., & Rietz, T. (2008). Results form a Dozen Years of Election Futures Markets Research. In C. R. Plott & V. L. Smith (Eds.), Handbook of Experimental Exonomics Results (Vol. 1, pp. 742-751). Amsterdam, New York, Oxford, Tokyo: North Holland.

Bortz, J. (2005). Statistik für Human- und Sozialwissenschaftler (6. ed.). Heidelberg: Springer.

Bradburn, N., Sudman, S., & Wansink, B. (2004). Asking Questions (revised ed.). San Francisco: Jossey-Blass.

Brosius, F. (2008). SPSS 16 (1. ed.). Heidelberg: Redline GmbH.

Bühl, A. (2010). PASW 18 (12. ed.). München, Boston, San Francisco, Harlow, Don Mills, Sydney, Mexico City, Madrid, Amsterdam: Pearson Studium.

Erikson, R. S., & Wlezien, C. (2008). Are Political Markets Really Superior To Polls As Election Predictors? Public Opinion Quarterly, 0(0), 1-24. doi: 10.1093/poq/nfn010

Erikson, R. S., & Wlezien, C. (2009). Markets vs. Polls as Election Predictors. 1-18. Retrieved from http://www.temple.edu/polsci/wlezien/documents/MarketsandPollsIIFinalForDistribution.pdf

Forsythe, R., Nelson, F., Neumann, G. R., & Wright, J. (1992). Anatomy of an Experimental Political Stock Market. American Economic Review, 82(5), 1142-1161.

Gomme, P. (2003). Iowa Electronic Markets. Retrieved from http://www.clevelandfed.org/research/commentary/2003/0415.pdf

Green, K. C., Armstrong, J. S., & Graefe, A. (2007). Method to Elicit Forecasts form Groups: Delphi and Prediction Markets compared. Retrieved from http://www.forecastingprinciples.com/paperpdf/Delphi-WPv33.pdf

Hartman, J. M., Forsen, J. W., Wallace, M. S., & Neely, J. G. (2002). Tutorials in Clinical Research: Part IV: Recognizing and Controlling Bias. The Lanryngoscope, 112, 23-31.

Ivanov, A. (2009). Using Prediction Markets to Harness Collective Wisdom for Forecasting. The Journal of Business Forecasting, 28(3), 9-14.

Kou, S. G., & Sobel, M. E. (2004). Forecasting the Vote: A Theoretical Comparison of Election Markets and Public Opinion Polls. Political Analysis, 12(3), 277-295. doi: 10.1093/pan/mph019

Leigh, A., & Wolfers, J. (2005). Competing Approaches to Forecasting Elections: Economic Models, Opinion Polling and Prediction Markets. 34. Retrieved from http://finance.wharton.upenn.edu/~rlwctr/papers/0606.pdf

Manski, C. F. (2005). Interpreting the Predictions of Prediction Markets. 1-7. Retrieved from http://www.aeaweb.org/annual_mtg_papers/2006/0106_1015_0703.pdf

Mentzer, J. T., & Kahn, K. B. (1995). Forecasting Technique Familiarity, Satisfaction, Usage, and Application. [report of survey results]. Journal of Forecasting, 14, 465-476. doi: 95i050465-12

Newport, F., Saad, L., & Moore, D. (1997). How are polls conducted? Retrieved from http://media.gallup.com/PDF/FAQ/HowArePolls.pdf

Page, L. (2008). Comparing Prediction Market Prices and Opinion Polls in Political Elections. The Journal of Prediction Markets, 2(1), 91-97.

Rothschild, D. (2009). Forecastind Elections. Public Opinion Quarterly, 73(5), 895-916. doi: 10.1093/poq/nfp082

Servan-Schreiber, E., Wolfers, J., Pennock, D. M., & Galebach, B. (2004). Prediction Markets : Does Money Matter? Electronic Markets, 14(3), 243-251. doi: 10.1080/1019678042000245254

Stix, G. (2008). Super Tuesday: Markets Predict Outcomes Better Than Polls. Scientific American Magazine. Retrieved from http://www.northwestern.edu/ipr/news/predictionmarkets.pdf

Surowiecki, J. (2004). The Wisdom of Crowds. New York: Anchor Books.

Wolfers, J., & Leigh, A. (2002). Three Tools for Forecasting Federal Elections: Lessons from 2001. Australian Journal of Political Science, 37(2), 223-240. doi: 10.1080/1036114022014811 5

Wolfers, J., & Zitzewitz, E. (2004). Prediction Markets. Journal of Economic Perspectives, 18(2), 107-126.

Wolfers, J., & Zitzewitz, E. (2007). Interpreting Prediction Market Prices as Probabilities. Retrieved from http://bpp.wharton.upenn.edu/jwolfers/Papers/InterpretingPredictionMarketPrices.pdf

Zarnowitz, V. (1984). The Accuracy of Individual and Group Forecasts from Business Outlook Surveys. Journal of Forecasting, 3, 11-26. doi: 010011-16