IMPROVING THE IDEA SCREENING PROCESS WITHIN ORGANIZATIONS USING PREDICTION MARKETS: A THEORETICAL PERSPECTIVE

Main Article Content

Gerrit Kamp
Peter A Koen

Abstract

 Prediction markets have been identified as a valuable mechanism to evaluate and select ideas in the corporate innovation processes, because these markets leverage the collective wisdom of the entire organization. However, initial studies report low prediction accuracies and their usefulness is being challenged. A better theoretical understanding of idea markets is needed. Based on economic theory, experimental economics, and existing prediction market research, we present such a theory for the accuracy of idea markets. The theory is used to explain why current markets may have low prediction accuracy, and also why idea markets have great potential for improving idea screening.

Article Details

Section
Articles

References

Michael Abramowicz, "The hidden beauty of the quadratic market scoring rule: a uniform liquidity market maker, with variations" [2007], The Journal of Prediction Markets, 1-2 111-125

Teresa M. Amabile, "Motivating Creativity in Organizations: on doing what you love and loving what you do." [1997], California Management Review, 40-1 39-58

Robert Axelrod and Leigh Tesfatsion, "A guide for newcomers to agent-based modeling in the social sciences" in Handbook of Computational Economics (eds. K. Judd, Tesfatsion, L.)(Amsterdam, North-Holland, 2006)

George Beardsley and Edwin Mansfield, "A Note on the Accuracy of Industrial Forecasts of the Profitability of New Products and Processes" [1978], Journal of Business, 51-1 127-135

Tom W Bell, "Gambling for the Good, Trading for the Future: The Legality of Markets in Science Claims" [2002], Chapman Law Review, 5-159

JE Berg, R Forsythe, FD Nelson and TA Rietz 2001 Results from a dozen years of election futures markets research. Working Paper,

JE Berg, FD Nelson and TA. Rietz 2003 Accuracy and Forecast Standard Error of Prediction Markets

Sushil Bikhchandani, David Hirshleifer and Ivo Welch, "A theory of fads, fashion, custom, and cultural change as informational cascades" [1992], Journal of Political Economy, 100-5 992

E. Bothos, D. Apostolou and G. Mentzas 2008 Idea selection and Information Aggregation Markets

Gerrit H. Van Bruggen, Martin Spann, Gary L. Lilien and Bernd Skiera 2006 Institutional Forecasting: The Performance of Thin Virtual Stock Markets

David V. Budescu and Boris Maciejovsky, "The Effect of Payoff Feedback and Information Pooling on Reasoning Errors: Evidence from Experimental Markets." [2005], Management Science, 51-12 1829-1843

Colin Camerer, Behavioral game theory : experiments in strategic interaction (New York, N.Y., Princeton, N.J., Russell Sage Foundation ; Princeton University Press, 2003)

Nicholas Chan, Ely Dahan, Adlar Kim, Andrew Lo and Tomaso Poggio 2002 Securities Trading of Concepts (STOC)

Nicholas T. Chan, Ely Dahan, Andrew W. Lo and Tomaso Poggio 2001 Experimental Markets for Product Concepts

Kay-Yut Chen, Leslie R. Fine and Bernardo A. Huberman, "Predicting the Future" [2003], Information Systems Frontiers, 5-1 47

Kay-Yut Chen, Leslie R. Fine and Bernardo A. Huberman, "Eliminating Public Knowledge Biases in Information-Aggregation Mechanisms" [2004], Management Science, 50-7 983-994

Jed Christiansen, 2008, http://blog.mercury-rac.com/2008/05/05/prediction-markets-using-them-for-innovation-and-ideas/ Last visisted on 2 Feb 2009.

Jed D. Christiansen, "Prediction markets: practical experiments in small markets and behaviours observed" [2007], The Journal of Prediction Markets, 1-1 17-41

Robert G. Cooper, "Overhauling the new product process" [1996], Industrial Marketing Management, 25-6 465-482

Ely Dahan and John R. Hauser, "The virtual customer" [2002], Journal of Product Innovation Management, 19-5 332-353

Fred D. Davis, Richard P. Bagozzi and Paul R. Warshaw, "Extrinsic and Intrinsic Motivation to Use Computers in the Workplace" [1992], Journal of Applied Social Psychology, 22-14 1111-1132

Charles de los Reyes and Lawrence J. Raifman, "Forgone Interest and Contract Mispricing in Predictive Markets" [2008], The Journal of Prediction Markets, 2-1-13

Alan R. Dennis, Jay E. Aronson, William G. Heninger and Edward D. Walker Ii, "Structuring time and task in electronic brainstorming" [1999], MIS Quarterly, 23-1 95-108

Eugene F. Fama, "Efficient capital markets: a review of theory and empirical work." [1970], Journal of Finance, 25-2 383-417

Robert Forsythe and Russell Lundholm, "Information aggregation in an experimental market" [1990], Econometrica, 58-2 309

Robert Forsythe, Forrest Nelson, George R. Neumann and Jack Wright, "Anatomy of an Experimental Political Stock Market" [1992], The American Economic Review, 82-5 1142

Robert Forsythe, Thomas A. Rietz and Thomas W. Ross, "Wishes, expectations and actions: a survey on price formation in election stock markets" [1999], Journal of Economic Behavior & Organization, 39-1 83-110

D. Gigone and R. Hastie, "The common knowledge effect : information sharing and group judgment" [1993], Journal of personality and social psychology, 65-5 959-973

Herbert Gintis, Game theory evolving : a problem-centered introduction to modeling strategic behavior (Princeton, N.J., Princeton University Press, 2000)

Jacob Goldenberg, Donald R. Lehmann and David Mazursky, "The Idea Itself and the Circumstances of Its Emergence as Predictors of New Product Success" [2001], Management Science, 47-1 69

Andreas Graefe and Christof Weinhardt, "Long-Term Forecasting with Prediction Markets A Field Experiment on Applicability and Expert Confidence" [2008], The Journal of Prediction Markets, 2-71-91

Tobias Greitemeyer and Stefan Schulz-Hardt, "Preference-Consistent Evaluation of Information in the Hidden Profile Paradigm: Beyond Group-Level Explanations for the Dominance of Shared Information in Group Decisions" [2003], Journal of Personality and Social Psychology, 84-2 322-339

Thomas Gruca, Joyce Berg and Michael Cipriano, "Consensus and Differences of Opinion in Electronic Prediction Markets" [2005], Electronic Markets, 15-1 13-22

Thomas S. Gruca, Joyce Berg and Michael Cipriano, "The Effect of Electronic Markets on Forecasts of New Product Success" [2003], Information Systems Frontiers, 5-1 95

Thomas S. Gruca and Joyce E. Berg, "Public information bias and prediction market accuracy" [2007], The Journal of Prediction Markets, 1-3 219-231

Thomas S. Gruca, Joyce E. Berg and Michael Cipriano, "Incentive and accuracy issues in movie prediction markets" [2008], The Journal of Prediction Markets, 2-1 29-43

Robert William Hahn and Paul C. Tetlock, Information markets : a new way of making decisions (Washington, DC, AEI Press, 2006)

Robin Hanson, "Combinatorial Information Market Design" [2003], Information Systems Frontiers, 5-1 107

Robin Hanson, "Foul Play in Information Markets" in Information Markets (eds. R. W. Hahn and P. C. Tetlock)(Washington, AEI-Brookings Joint Center for Regulatory Studies, 2006)

Robin Hanson, "Logarithmic market scoring rules for modular combinatorial information aggregation" [2007], The Journal of Prediction Markets, 1-1 3-15

Larry Harris, Trading and exchanges : market microstructure for practitioners (Oxford ; New York, Oxford University Press, 2003)

F. A. Hayek, "The Use of Knowledge in Society" [1945], The American Economic Review, 35-4 519-530

Teck-Hua Ho and Kay-Yut Chen, "New Product Blockbusters: The magic and science of prediction markets" [2007], California Management Review, 50-1 144-158

T. Hogg and B.A. Huberman 2002 Avoiding moral hazards in organizational forecasting

David Hoyt 2006 Rite-solutions: mavericks unleashing the quiet genius of employees

Daniel J. Isenberg, "Group Polarization: A Critical Review and Meta-Analysis" [1986], Journal of Personally and Social Psychology, 50-6 1141-1151

Peter Koen, Greg Ajamian, Robert Burkart, Allen Clamen, Jeffrey Davidson, Robb D'Amore, Claudia Elkins, Kathy Herald, Michael Incorvia, Albert Johnson, Robin Karol, Rebecca Seibert, Aleksandar Slavejkov and Klaus Wagner, "Providing Clarity and a Common Language to the "Fuzzy Front End"" [2001], Research-Technology Management, 44-46-55

Christina Ann LaComb, Janet Arlie Barnett and Qimei Pan, "The imagination market" [2007], Information Systems Frontiers, 9-2-3 245-256

John Ledyard, Robin Hanson and Takashi Ishikida 2005 An experimental test of combinatorial information markets

Robert Litchfield, "Brainstorming Reconsidered: A Goal-based view" [2008], Academy of Management Review, 33-3 649-668

Stefan Luckner and Christof Weinhardt, "How to pay traders in information markets: results from a field experiment" [2007], The Journal of Prediction Markets, 1-2 147-156

Russell J. Lundholm, "What affects the efficiency of a market? Some answers from the laboratory." [1991], Accounting Review, 66-3 486

Burton G. Malkiel, "The Efficient Market Hypothesis and Its Critics" [2003], Journal of Economic Perspectives, 17-1 59-82

Rodney McAdam and John McClelland, "Individual and team-based idea generation within innovation management: Organisational and research agendas" [2002], European Journal of Innovation Management, 5-2 86

John F. Muth, "Rational Expectations and the Theory of Price Movements" [1961], Econometrica, 29-3 315-335

Francis Narin and Anthony Breitzman, "Inventive productivity" [1995], Research Policy, 24-4 507-519

John O'Brien and Sanjay Srivastava, "Dynamic Stock Markets with Multiple Assets: An Experimental Analysis." [1991], Journal of Finance, 46-5 1811-1838

Kenneth Oliven and Thomas A. Rietz, "Suckers Are Born but Markets Are Made: Individual Rationality, Arbitrage, and Market Efficiency on an Electronic Futures Market." [2004], Management Science, 50-3 336-351

Alex F. Osborn, Applied imagination; principles and procedures of creative thinking (New York,, Scribner, 1953)

Muammer Ozer, "Managing the Selection Process for New Product Ideas" [2004], Research Technology Management, 47-4 10

Muammer Ozer, "Factors which influence decision making in new product evaluation" [2005], European Journal of Operational Research, 163-3 784-801

Paul B. Paulus and Huei-Chuan Yang, "Idea Generation in Groups: A Basis for Creativity in Organizations" [2000], Organizational Behavior and Human Decision Processes, 82-1 76-87

David M. Pennock, Steve Lawrence, C. Lee Giles and Finn Arup Nielsen 2000 The power of play: Efficiency and forecast accuracy in web market games

Joao Pissarra and Jorge C. Jesuino, "Idea generation through computer-mediated communication: The effects of anonymity" [2005], Journal of Managerial Psychology, 20-275-291

Charles R. Plott and Kay-Yut Chen 2002 Information Aggregation Mechanisms: Concept, Design and Implementation for a Sales Forecasting Problem

Charles R. Plott and Shyman Sunder, "Efficiency of Experimental Security Markets with Insider Information: An Application of Rational-Expectations Models." [1982], Journal of Political Economy, 90-4 663-698

Charles Plott and Shyam Sunder, "Rational expectations and the aggregation of diverse information in laboratory security markets" [1988], Econometrica, 56-5 1085

Russ Ray, "Prediction Markets and the Financial "Wisdom of Crowds"." [2006], Journal of Behavioral Finance, 7-1 2-4

Eric F. Rietzschel, Bernard A. Nijstad and Wolfgang Stroebe, "Productivity is not enough: A comparison of interactive and nominal brainstorming groups on idea generation and selection" [2006], Journal of Experimental Social Psychology, 42-2 244-251

E. S. Rosenbloom and William Notz, "Statistical Tests of Real-Money versus Play-Money Prediction Markets." [2006], Electronic Markets, 16-1 63-69

Emile Servan-Schreiber, Justin Wolfers, David M. Pennock and Brian Galebach, "Prediction Markets: Does Money Matter?" [2004], Electronic Markets, 14-3 243-251

Robert J. Shiller, "From Efficient Markets Theory to Behavioral Finance" [2003], Journal of Economic Perspectives, 17-1 83-104

Christian Slamka, Arina Soukhoroukova and Martin Spann, "Event Studies in Real- and Play-Money Prediction Markets" [2008], The Journal of Prediction Markets, 2-53-70

Janet A. Sniezek and Rebecca A. Henry, "Accuracy and confidence in group judgment" [1989], Organizational Behavior and Human Decision Processes, 43-1 1-28

Arina Soukhoroukova, Martin Spann and Bernd Skiera 2007 Creating New Product Ideas with Idea Markets

Martin Spann, Holger Ernst, Bernd Skiera and Jan Henrik Soll, "Identification of Lead Users for Consumer Products via Virtual Stock Markets" [2007], Journal of Product Innovation Management,

Martin Spann and Bernd Skiera, "Internet-Based Virtual Stock Markets for Business Forecasting" [2003], Management Science, 49-10 1310-1326

Timm Sprenger, Paul Bolster and Anand Venkateswaran, "Conditional prediction markets as corporate decision support systems – an experimental comparison with group deliberations" [2007], The Journal of Prediction Markets, 1-3 189-208

Dagmar Stahlberg, Frank Eller, Anne Maass and Dieter Frey, "We Knew It All Along: Hindsight Bias in Groups" [1995], Organizational Behavior and Human Decision Processes, 63-1 46-58

Cass R. Sunstein 2004 Group Judgments: Deliberation, Statistical Means, and Information Markets

Cass R. Sunstein, Infotopia : how many minds produce knowledge (New York, Oxford University Press, 2006)

James Surowiecki, The wisdom of crowds : why the many are smarter than the few and how collective wisdom shapes business, economies, societies, and nations (New York, Doubleday :, 2004)

Georgios Tziralis and Ilias Tatsiopoulos, "Prediction markets: an extended literature review" [2007], The Journal of Prediction Markets, 1-1 75-91

Andrew H. van de Ven, "Central Problems in the Management of Innovation" [1986], Management Science, 32-5 590-607

Viswanath Venkatesh, Michael G. Morris, Gordon B. Davis and Fred D. Davis, "User acceptance of information technology: toward a unified view." [2003], MIS Quarterly, 27-3 425-478

Justin Wolfers and Eric Zitzewitz, "Prediction Markets" [2004], Journal of Economic Perspectives, 18-2 107-126