Evidencing the Forecasting Performance of Predication Markets: An Empirical Comparative Study

Article Sidebar

Requires Subscription or Fee PDF (GBP 25)
Published: Jan 19, 2018
DOI: https://doi.org/10.5750/jpm.v11i2.1383
Keywords:
Prediction Markets Field Experiments Business Forecasting Group Decision Making

Main Article Content

Patrick Buckley
University of Limerick

Abstract

Accurately forecasting uncertain outcomes to inform planning processes and aid decision making is a perennial organisational challenge, and the focus of a substantial body of research in management science, information systems and related disciplines. Academic research suggests that prediction markets may be of significant benefit to organisations in meeting this challenge. However most of the empirical studies assessing prediction market performance are laboratory based and suffer from limits to their generalizability. Recent literature has called for research which analyses the performance of prediction markets in ecologically valid settings in order to evidence their effectiveness to potential organisational users. This paper answers these calls by designing a prediction market to forecast an uncertain real world event. The study then compares the forecasting performance of the prediction market with a number of more traditional forecasting approaches regularly used by organisations. The study is contextually situated in a low information heterogeneity problem space, where relevant information is freely available. The results suggest that in this context prediction markets outperform the other forecasting methods studied.

Article Details

Issue
Vol. 11 No. 2 (2017)
Section
Articles

References

Anderson, L. R., & Holt, C. A. (1997). Information Cascades in the Laboratory. American Economic Review, 87(5), 847–62.

Armstrong, J. (2001). Principles of forecasting a handbook for researchers and practitioners (1st ed.). Boston MA: Kluwer Academic.

Berg, J. E., & Rietz, T. A. (2003). Prediction Markets as Decision Support Systems. Information Systems Frontiers, 5(1), 79–93.

Boulu-Reshef, B., Comeig, I., Donze, R., & Weiss, G. D. (2016). Risk aversion in prediction markets: A framed-field experiment. Journal of Business Research. https://doi.org/10.1016/j.jbusres.2016.04.082

Buckley, P., & O’Brien, F. (2015). The effect of malicious manipulations on prediction market accuracy. Information Systems Frontiers, 1–13. https://doi.org/10.1007/s10796-015-9617-7

Chen, K.-Y., Fine, L. R., & Huberman, B. A. (2003). Predicting the Future. Information Systems Frontiers, 5(1), 47–61.

Chen, Y., Chu, C.-H., Mullen, T., & Pennock, D. M. (2005). Information Markets vs. Opinion Pools: An Empirical Comparison. In Proceedings of the 6th ACM Conference on Electronic Commerce (pp. 58–67). New York, NY, USA: ACM. https://doi.org/10.1145/1064009.1064016

Chugh, D., & Bazerman, M. H. (2007). Bounded awareness: what you fail to see can hurt you. Mind & Society, 6(1), 1–18. https://doi.org/10.1007/s11299-006-0020-4

Deck, C., Lin, S., & Porter, D. (2013). Affecting policy by manipulating prediction markets: Experimental evidence. Journal of Economic Behavior & Organization, 85, 48–62. https://doi.org/10.1016/j.jebo.2012.10.017

Einbinder, M. (2006). Information Markets: Using Market Predictions to Make Administrative Decisions. Virginia Law Review, 92, 149.

Ellis, D. G., & Fisher, B. A. (1994). Small Group Decision Making: Communication and the Group Process (4th ed.). New York: McGraw-Hill Book Company.

Garvey, J., & Buckley, P. (2010). Teaching the Concept of Risk: Blended Learning Using a Custom-Built Prediction Market. Journal of Teaching in International Business, 21(4), 346–357.

https://doi.org/10.1080/08975930.2010.526032

Geifman, D., Raban, D. R., & Sheizaf, R. (2011). P-MART: Towards a classification of online prediction markets. First Monday; Volume 16, Number 7 - 4 July 2011. Retrieved from http://firstmonday.org/ojs/index.php/fm/article/view/3203/3019

Graefe, A., & Armstrong, J. S. (2011). Comparing face-to-face meetings, nominal groups, Delphi and prediction markets on an estimation task. International Journal of Forecasting, 27(1), 183–195. https://doi.org/10.1016/j.ijforecast.2010.05.004

Graefe, A., & Weinhardt, C. (2008). Long-Term Forecasting with Prediction Markets A Field Experiment on Applicability and Expert Confidence. The Journal of Prediction Markets, 2(2), 71–91.

Gruca, T. S., Berg, J. E., & Cipriano, M. (2008). Incentive and Accuracy Issues in Movie Prediction Markets. The Journal of Prediction Markets, 2(1), 29–43.

Haase, H., & Franco, M. (2011). Information sources for environmental scanning: do industry and firm size matter? Management Decision, 49(10), 1642–1657. https://doi.org/10.1108/00251741111183807

Hahn, R. W., & Tetlock, P. C. (2006a). A New Tool for Promoting Economic Development. In R. W. Hahn & P. C. Tetlock (Eds.), Information Markets: A New Way of Making Decisions (pp. 170–194). Washington D.C: AEI-Brookings Joint Center for Regulatory Studies.

Hahn, R. W., & Tetlock, P. C. (2006b). Introduction to Information Markets. In Information Markets: A New Way of Making Decisions (pp. 1–12). Washington D.C: AEI-Brookings Joint Center for Regulatory Studies.

Hall, C. (2010). Prediction Markets: Issues and Applications. The Journal of Prediction Markets, 4(1), 27–58.

Hayek, F. A. (1945). The Use of Knowledge In Society. American Economic Review, 35(4), 519–530.

Hitt, M., Black, S., & Porter, L. W. (2005). Management (2nd Revised US ed). Prentice Hall.

Horn, C. F., & Ivens, B. S. (2015). Corporate Prediction Markets for Innovation Management. In A. Brem & É. Viardot (Eds.), Adoption of Innovation (pp. 11–23). Springer International Publishing. Retrieved from http://link.springer.com/chapter/10.1007/978-3-319-14523-5_2

Isenberg, D. J. (1986). Group polarization: A critical review and meta-analysis. Journal of Personality and Social Psychology, 50(6), 1141–1151.

https://doi.org/10.1037/0022-3514.50.6.1141

Janis, I. L. (1972). Victims of Groupthink: A psychological study of foreign-policy decisions and fiascoes. Houghton Mifflin Company.

Jian, L., & Sami, R. (2012). Aggregation and Manipulation in Prediction Markets: Effects of Trading Mechanism and Information Distribution. Management Science, 58(1), 123–140. https://doi.org/10.1287/mnsc.1110.1404

LaComb, C. A., Barnett, J. A., & Pan, Q. (2007). The imagination market. Information Systems Frontiers, 9(2–3), 245–256. https://doi.org/10.1007/s10796-007-9024-9

Laughlin, P. R., Bonner, B. L., & Miner, A. G. (2002). Groups perform better than the best individuals on Letters-to-Numbers problems. Organizational Behavior and Human Decision Processes, 88(2), 605–620. https://doi.org/10.1016/S0749-5978(02)00003-1

Ledyard, J. (2006). Designing Information Markets for Policy Analysis. In Information Markets: A New Way of Making Decisions (pp. 37–66). Washington D.C: AEI-Brookings Joint Center for Regulatory Studies.

March, J. G. (1999). The Pursuit of Organizational Intelligence: Decisions and Learning in Organizations. Wiley-Blackwell.

Plott, C. R. (2000). Markets as Information Gathering Tools. Southern Economic Journal, 67(1), 2–15. https://doi.org/10.2307/1061610

Remidez, H., & Joslin, C. (2007). Using Prediction Markets to Support IT Project Management - Research in Progress. In International Research Workshop on IT Project Management 2007. Montreal, Quebec, Canada: Association for Information Systems.

Servan-Schreiber, E., Wolfers, J., Pennock, D. M., & Galebach, B. (2004). Prediction Markets: Does Money Matter? Electronic Markets, 14(3), 243–251. https://doi.org/10.1080/1019678042000245254

Simon, H. A. (1997). Administrative Behavior, 4th Edition (4th ed.). Free Press.

Slamka, C., Skiera, B., & Spann, M. (2013). Prediction Market Performance and Market Liquidity: A Comparison of Automated Market Makers. IEEE Transactions on Engineering Management, 60(1), 169–185. https://doi.org/10.1109/TEM.2012.2191618

Spann, M., & Skiera, B. (2003). Internet-Based Virtual Stock Markets for Business Forecasting. Management Science, 49(10), 1310–1326.

Sprenger, T., Bolster, P., & Venkateswaran, A. (2007). Conditional Prediction Markets as Corporate Decision Support Systems An Experimental Comparison with Group Deliberations. The Journal of Prediction Markets, 1(3), 189–208.

Tziralis, G., & Tatsiopoulos, I. (2007). Prediction Markets: An Extended Literature Review. The Journal of Prediction Markets, 1(1), 75–91.

Van Bruggen, G. H., Spann, M., Lilien, G. L., & Skiera, B. (2010). Prediction Markets as institutional forecasting support systems. Decision Support Systems, 49(4), 404–416. https://doi.org/10.1016/j.dss.2010.05.002

Wolfers, J., & Zitzewitz, E. (2006). Five Open Questions About Prediction Markets. In Information Markets: A New Way of Making Decisions (pp. 13–36). Washington D.C: AEI-Brookings Joint Center for Regulatory Studies.