LONG-TERM FORECASTING WITH PREDICTION MARKETS – A FIELD EXPERIMENT ON APPLICABILITY AND EXPERT CONFIDENCE

Main Article Content

Andreas Graefe
Christof Weinhardt

Abstract

While prediction markets have become increasingly popular to forecast the near-term future, the literature provides little evidence on how they perform for long-term problems. For assessing the long-term, decision-makers traditionally rely on experts, although empirical research disputes the value of expert advice. Reporting on findings from a field experiment in which we implemented two prediction markets in parallel to a Delphi study, this paper addresses two questions. First, we analyze the applicability of prediction markets for long-term problems whose outcome cannot be judged for a long time. Second, by comparing trading behavior of an expert and a student market, we analyze whether there is evidence that supports the assumption that experts possess superior knowledge. Our results show that prediction markets provide similar results as the well-established Delphi method. We conclude that prediction markets appear to be applicable for long-term forecasting. Furthermore, we observe differences in the confidence of experts and non-experts. Our findings indicate that, in contrast to students, experts reveal their information well-considered based on what they think they know. Finally, we discuss how such analyses of market participants’ confidence provide valuable information to decision-makers and may be used to improve on traditional forecasting methods.

Article Details

Section
Articles

References

Armstrong, JS, "The Seer-Sucker Theory: The Value of Experts in Forecasting" [1980] Technology Review, 83 at p16.

Armstrong, JS, "Combining Forecasts" in Principles of Forecasting. A Handbook for Researchers and Practitioners (eds. J. S. Armstrong) (Norwell, Kluwer Academic Publishers, 2001) at pp 417-439.

Armstrong, JS, "Significance tests harm progress in forecasting" [2007] International Journal of Forecasting, 23 at p321.

Camerer, C, "Can Asset Markets be Manipulated? A Field Experiment with Racetrack Betting" [1998] Journal of Political Economy, 106 at p457.

Chen, K-Y, Fine, LR & Huberman, BA, "Eliminating Public Knowledge Biases in Information-Aggregation Mechanisms" [2004] Management Science, 50 at p983.

Christiansen, JD, "Prediction Markets: Practical Experiments in Small Markets and Behaviours Observed " [2007] Journal of Prediction Markets, 1 at

Einhorn, HJ & Hogarth, RM, "Confidence in judgment: Persistence of the illusion of validity" [1978] Psychological Review, 85 at p395.

Forsythe, R, Rietz, TA & Ross, TW, "Wishes, Expectations and Actions: A Survey on Price Formation in Election Stock Markets " [1999] Journal of Economic Behavior & Organization, 39 at p83.

Friedewald, M, von Oertzen, J & Cuhls, K (2007). European Perspectives on the Information Society (EPIS). Delphi Report. In: ETEPS - European Techno-Economic Policy Support Network, Fraunhofer ISI, Karlsruhe. Available at http://epis.jrc.es/documents/Deliverables/EPIS%202-3-1%20Delphi%20Report.pdf.

Glaser, M & Weber, M, "Overconfidence and Trading Volume" [2007] Geneva Risk and Insurance Review, 32 at p1.

Gordon, T & Pease, A, "RT Delphi: An Efficient, “Round-Less” Almost Real Time Delphi Method" [2006] Technological Forecasting and Social Change, 73 at

Green, KC, Armstrong, JS & Graefe, A, "Methods to Elicit Forecasts From Groups: Delphi and Prediction Markets Compared" [2007] Foresight - The International Journal of Applied Forecasting, 2007 (Fall) at p17.

Hanson, R, "Combinatorial Information Market Design" [2003] Information Systems Frontiers, 5 at p107.

Hanson, R, "Designing Real Terrorism Futures" [2006] Public Choice, 128 at p1.

Hanson, R, Oprea, R & Porter, D, "Information Aggregation and Manipulation in an Experimental Market" [2006] Journal of Economic Behavior & Organization, 60 at p449.

Koehler, DJ, Brenner, L & Griffin, D, "The calibration of expert judgment: Heuristics and biases beyond the laboratory" in Heuristics and Biases: The Psychology of Intuitive Judgment (eds. T. Gilovich et al.) Cambridge University Press, 2002) at pp 489–509.

Larreche, JC & Moinpour, R, "Managerial Judgment in Marketing: The Concept of Expertise" [1983] Journal of Marketing Research, 20 at p110.

Luckner, S, Schröder, J & Slamka, C, "On the Forecast Accuracy of Sports Prediction Markets " in Negotiation, Auctions & Market Engineering, Lecture Notes in Business Information Processing (LNBIP) (eds. H. Gimpel et al.) Springer-Verlag, 2008) at pp 227-234.

Luckner, S & Weinhardt, C, "How to Pay Traders in Information Markets? Results from a Field Experiment" [2007] Journal of Prediction Markets, 1 at

Murphy, MK, Black, NA, Lamping, DL, McKee, CM, Sanderson, CFB, Askham, J & Marteau, T, "Consensus Development Methods, and Their Use in Clinical Guideline Development" [1998] Health Technology Assessment, 2 at p1.

Pennock, DM, "The Real Power of Artificial Markets" [2001] Science, 291 at p987.

Rhode, PW & Strumpf, KS, "Historical Presidential Betting Markets" [2004] Journal of Economic Perspectives, 18 at p127.

Rietz, TA (2005). Behavioral Mis-pricing and Arbitrage in Experimental Asset Markets, University of Iowa. Available at http://www.biz.uiowa.edu/faculty/trietz/papers/market.pdf.

Rowe, G & Wright, G, "The Delphi Technique as a Forecasting Tool: Issues and Analysis" [1999] International Journal of Forecasting, 15 at

Snowberg, E & Wolfers, J (2007). Explaining the Favorite-Longshot Bias: Is it Risk-Love, or Misperceptions?, Available at http://bpp.wharton.upenn.edu/jwolfers/Papers/Favorite_Longshot_Bias.pdf.

Soukhoroukova, A, Spann, M & Skiera, B (2007). Creating and Evaluating New Product Ideas with Idea Markets, Available at http://marketing.wharton.upenn.edu/news/colloquia/PDF/Spring2007/Bernd%20Skiera.pdf.

Surowiecki, J, The Wisdom of Crowds: Why the Many Are Smarter Than the Few and How Collective Wisdom Shapes Business, Economies, Societies and Nations B&T, 2004).

Tetlock, PE, Expert Political Judgment: How good is it? How can we know? Princeton University Press, 2006).

Thaler, RH & Ziemba, WT, "Anomalies: Parimutuel Betting Markets: Racetracks and Lotteries" [1988] The Journal of Economic Perspectives, 2 at p161.

Wiesand, A & Söndermann, M (2005). The "Creative Sector" - An Engine for Diversity, Growth, and Jobs in Europe. In: European Cultural Foundation, Amsterdam. Available at http://www.eurocult.org/uploads/docs/114.pdf.

Woudenberg, F, "An Evaluation of Delphi" [1991] Technological Forecasting and Social Change, 40 at p131.