Bibtex
Cite as text
@Select Types{,
Journal = "Band-1",
Title= "Can Gamification lead to Increase Paid Crowdworkers Output?",
Author= "Sascha Lichtenberg, Tim-Benjamin Lembcke, Mattheus Brening, Alfred Benedikt Brendel and Simon Trang",
Doi= "https://doi.org/10.30844/wi_2020_k4-lichtenberg",
Abstract= "Gamifying serious work environments, such as paid crowdsourcing platforms, potentially increases crowdworkers’ task motivation, engagement and enjoyment. This, in turn, can lead to a higher willingness to contribute, higher quality of work and long-term engagement. However, it remains unclear how crowdworkers behave, when gamification is applied to motivate them to do more tasks than being paid for. In this study, we conducted an experiment on Amazon Mechanical Turk to investigate this context in a controlled setting, enabling the isolation of gamification effects. With 320 crowdworkers, we study the effect of different gamification affordances (progressbars, badges and leaderboards) on autonomous motivation and task performed. We find that some gamification affordances (namely badges and leaderboard) can lead crowdworkers to do more work than they are paid for. However, this is not necessarily linked to autonomous motivation because we did not consistently observe an increase in autonomous motivate together with more performed tasks.",
Keywords= "Crowdworking, Gamfication, Motivation, Autonomous Motivation",
}
Sascha Lichtenberg, Tim-Benjamin Lembcke, Mattheus Brening, Alfred Benedikt Brendel and Simon Trang: Can Gamification lead to Increase Paid Crowdworkers Output?. Online: https://doi.org/10.30844/wi_2020_k4-lichtenberg (Abgerufen 23.11.24)
Open Access
Gamifying serious work environments, such as paid crowdsourcing platforms, potentially increases crowdworkers’ task motivation, engagement and enjoyment. This, in turn, can lead to a higher willingness to contribute, higher quality of work and long-term engagement. However, it remains unclear how crowdworkers behave, when gamification is applied to motivate them to do more tasks than being paid for. In this study, we conducted an experiment on Amazon Mechanical Turk to investigate this context in a controlled setting, enabling the isolation of gamification effects. With 320 crowdworkers, we study the effect of different gamification affordances (progressbars, badges and leaderboards) on autonomous motivation and task performed. We find that some gamification affordances (namely badges and leaderboard) can lead crowdworkers to do more work than they are paid for. However, this is not necessarily linked to autonomous motivation because we did not consistently observe an increase in autonomous motivate together with more performed tasks.
Crowdworking, Gamfication, Motivation, Autonomous Motivation
1. Koivisto, J., Hamari, J.: The rise of motivational information systems : A review of gamification. Int. J. Inf. Manage. 45, 191–210 (2019).
2. Liu, D., Santhanam, R., Webster, J.: Toward Meaningful Engagement: A Framework for Design and Research of Gamified Information Systems. MIS Q. 41, 1011–1034 (2017).
3. Hamari, J., Koivisto, J., Sarsa, H.: Does Gamification Work? — A Literature Review of Empirical Studies on Gamification. In: 2014 47th Hawaii International Conference on System Sciences. pp. 3025–3034. IEEE (2014). https://doi.org/10.1109/HICSS.2014.377.
4. Csikszentmihalyi, M., Csikszentmihalyi, I.: Beyond boredom and anxiety. Jossey-Bass San Francisco (1975).
5. Majuri, J., Koivisto, J., Hamari, J.: Gamification of education and learning: A review of empirical literature. In: 2nd International GamiFIN Conference. pp. 21–23. , Pori, Finland (2018).
6. Alahäivälä, T., Oinas-Kukkonen, H.: Understanding persuasion contexts in health gamification: A systematic analysis of gamified health behavior change support systems literature. Int. J. Med. Inform. 96, 62–70 (2016).
7. Warmelink, H., Koivisto, J., Mayer, I., Vesa, M., Hamari, J.: Gamification of production and logistics operations: Status quo and future directions. J. Bus. Res. (2018).
8. Ebermann, C., Brauer, B., Brendel, A.B., Kolbe, L.M.: Decoding the Motivational Black Box – The Case of Ranking, Self-Efficacy, and Subliminal Priming. In: Proceedings of the European Conference on Information Systems (ECIS). pp. 80–97. , Guimarães, Portugal (2017). https://doi.org/10.1080/00207721.2014.951523.
9. Morschheuser, B., Hamari, J., Koivisto, J., Maedche, A.: Gamified crowdsourcing: Conceptualization, literature review, and future agenda. Int. J. Hum. Comput. Stud. 106, 26–43 (2017). https://doi.org/10.1016/J.IJHCS.2017.04.005.
10. Hamari, J.: Transforming homo economicus into homo ludens: A field experiment on gamification in a utilitarian peer-to-peer trading service. Electron. Commer. Res. Appl. 12, 236–245 (2013).
11. Deci, E.L.: Effects of externally mediated rewards on intrinsic motivation. J. Pers. Soc. Psychol. 18, 105 (1971).
12. Deci, E.L., Koestner, R., Ryan, R.M.: A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychol. Bull. 125, 627 (1999).
13. Difallah, D.E., Catasta, M., Demartini, G., Ipeirotis, P.G., Cudré-Mauroux, P.: The Dynamics of Micro-Task Crowdsourcing: The Case of Amazon MTurk. In: Proceedings of the 24th International Conference on World Wide Web. pp. 238–247. International World Wide Web Conferences Steering Committee (2015).
14. Deci, E.L., Ryan, R.M.: Intrinsic motivation and self-determination in human behavior. Springer Science & Business Media (1985).
15. Ryan, R.M., Deci, E.L.: Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am. Psychol. 55, 68 (2000).
16. Wiley, C.: What motivates employees according to over 40 years of motivation surveys. Int. J. Manpow. 18, 263–280 (1997).
17. Kaufmann, N., Schulze, T., Veit, D.: More than fun and money. Worker Motivation in Crowdsourcing – A Study on Mechanical Turk. In: AMCIS. pp. 1–11. Detroit, Michigan, USA (2011).
18. Seaborn, K., Fels, D.I.: Gamification in theory and action: A survey. Int. J. Hum. Comput. Stud. 74, 14–31 (2015).
19. Huizinga, J.: Homo Ludens: International Library of Sociology G: The Sociology of Culture. (2003).
20. Caillois, R.: Les jeux et les homines [Man, play and games]. (1961).
21. Huotari, K., Hamari, J.: Defining gamification: a service marketing perspective. In: Proceeding of the 16th international academic MindTrek conference. pp. 17–22. ACM (2012).
22. Howe, J.: The Rise of Crowdsourcing. Wired Mag. 14, 1–5 (2006).
23. Geiger, D., Seedorf, S., Nickerson, R., Schader, M.: Managing the Crowd : Towards a Taxonomy of Crowdsourcing Processes. Proc. Seventeenth Am. Conf. Inf. Syst. (2011).
24. Prpic, J., Shukla, P.P., Kietzmann, J.H., Mccarthy, I.P.: How to work a crowd : Developing crowd capital through crowdsourcing. Bus. Horiz. 58, 77–85 (2015). https://doi.org/10.1016/j.bushor.2014.09.005.
25. Gino, F., Staats, B.: The Microwork Solution. Harv. Bus. Rev. 90, 92–96 (2012).
26. Majchrzak, A., Malhotra, A.: Towards an information systems perspective and research agenda on crowdsourcing for innovation. J. Strateg. Inf. Syst. 22, 257–268 (2013). https://doi.org/10.1016/j.jsis.2013.07.004.
27. Brabham, D.C.: Crowdsourcing as a Model for Problem Solving: An Introduction and Cases. Converg. Int. J. Res. into New Media Technol. 14, 75–90 (2008). https://doi.org/10.1177/1354856507084420.
28. Schöbel, S., Ernst, S.J., Söllner, M., Leimeister, J.M.: More than the Sum of its Parts – Towards Identifying Preferred Game Design Element Combinations in Learning Management Systems. ICIS 2017 Transform. Soc. with Digit. Innov. (2018).
29. Bunchball, I.: Gamification 101: An Introduction to the Use of Game Dynamics to Influence Behavior. (2010).
30. Christy, K.R., Fox, J.: Leaderboards in a virtual classroom: A test of stereotype threat and social comparison explanations for women’s math performance. Comput. Educ. 78, 66–77 (2014). https://doi.org/10.1016/j.compedu.2014.05.005.
31. Hamari, J., Koivisto, J.: Why do people use gamification services? Int. J. Inf. Manage. 35, 419–431 (2015). https://doi.org/10.1016/j.ijinfomgt.2015.04.006.
32. Boudreau, M.C., Gefen, D., Straub, D.W.: Validation in information systems research: A state-of-the-art assessment. MIS Q. Manag. Inf. Syst. 25, 1–16 (2001).
33. Gill, D., Prowse, V.L.: A Novel Computerized Real Effort Task Based on Sliders. , Rochester, NY (2011).
34. Gill, D., Prowse, V.: A Structural Analysis of Disappointment Aversion in a Real Effort Competition. Am. Econ. Rev. 102, 469–503 (2012).
35. Ryan, R.M.: Control and information in the intrapersonal sphere: An extension of cognitive evaluation theory. J. Pers. Soc. Psychol. 43, 450–461 (1982).
36. Deci, E.L., Eghrari, H., Patrick, B.C., Leone, D.R.: Facilitating Internalization: The Self-Determination Theory Perspective. J. Pers. 62, 119– 142 (1994).
37. Gefen, D., Straub, D.: A Practical Guide To Factorial Validity Using PLSGraph: Tutorial And Annotated Example. Commun. Assoc. Inf. Syst. 16, 91– 109 (2005). https://doi.org/10.17705/1cais.01605.
38. Urbach N., & A.F.: Structural Equation Modeling in Information Systems Research Using Partial Least Squares. J. Inf. Technol. Theory Appl. JITTA. 11, 2 (2010).
39. Lazear, E.P.: Performance pay and productivity. Am. Econ. Rev. 90, 1346– 1361 (2000). https://doi.org/10.1257/aer.90.5.1346.
40. Ryan, R.M., Deci, E.L.: Intrinsic and Extrinsic Motivations: Classic Definitions and New Directions. Contemp. Educ. Psychol. 25, 54–67 (2000). https://doi.org/10.1006/ceps.1999.1020.
41. Wolf, T., Weiger, W.H., Hammerschmidt, M.: Gamified digital services: How gameful experiences drive continued service usage. In: Proceedings of the 51st Hawaii Iternational Conference on System Sciences (HICSS) (2018).
42. Whetten, D.A.: What Constitutes a Theoretical Contribution ? 14, 490–495 (1989).
43. Tuunanen, J., Hamari, J.: Meta-synthesis of player typologies. In: Proceedings of Nordic Digra 2012 Conference: Games in Culture and Society, Tampere, Finland (2012).
44. Diamond, L., Tondello, G.F., Marczewski, A., Nacke, L.E., Tscheligi, M.: The HEXAD Gamification User Types Questionnaire: Background and Development Process. In: Workshop on Personalization in Serious and Persuasive Games and Gamified Interactions (2015).
45. Tondello, G.F., Wehbe, R.R., Diamond, L., Busch, M., Marczewski, A., Nacke, L.E.: The Gamification User Types Hexad Scale. Proc. 2016 Annu. Symp. Comput. Interact. Play. 229–243 (2016).
46. Soldz, S., Vaillant, G.E.: The Big Five Personality Traits and the Life Course: A 45-Year Longitudinal Study. (1999).