Bibtex
Cite as text
@Select Types{,
Journal = "Band-1",
Title= "Hybrid Teamwork: Consideration of Teamwork Concepts to Reach",
Author= "Mathis Poser, Eva A. C. Bittner",
Doi= "https://doi.org/10.30844/wi_2020_a6-poser",
Abstract= "Hybrid teamwork between humans and conversational agents (CA) is a promising approach to augment humans’ thinking and problem solving during task work. To realize a natural interaction, it is inevitable to consider research insights from human-centric disciplines for the design of CAs, as human team members have underlying assumptions regarding team work that need to be addressed to achieve valuable outcomes in hybrid teamwork settings. In this paper, we conducted a systematic literature review to consolidate past research on considered teamwork-specific psychological concepts for the design of CAs. The in-depth analysis of 19 publications demonstrates that, both, studies with a conceptual focus and CA instantiations, are primarily concerned with taskrelated teamwork concepts, while mostly disregarding relationship-related concepts. The results are discussed and implications for future research are identified.
",
Keywords= "Hybrid teamwork, conversational agent, interaction design, team research, literature review.
",
}
Mathis Poser, Eva A. C. Bittner: Hybrid Teamwork: Consideration of Teamwork Concepts to Reach. Online: https://doi.org/10.30844/wi_2020_a6-poser (Abgerufen 23.11.24)
Open Access
Hybrid teamwork between humans and conversational agents (CA) is a promising approach to augment humans’ thinking and problem solving during task work. To realize a natural interaction, it is inevitable to consider research insights from human-centric disciplines for the design of CAs, as human team members have underlying assumptions regarding team work that need to be addressed to achieve valuable outcomes in hybrid teamwork settings. In this paper, we conducted a systematic literature review to consolidate past research on considered teamwork-specific psychological concepts for the design of CAs. The in-depth analysis of 19 publications demonstrates that, both, studies with a conceptual focus and CA instantiations, are primarily concerned with taskrelated teamwork concepts, while mostly disregarding relationship-related concepts. The results are discussed and implications for future research are identified.
Hybrid teamwork, conversational agent, interaction design, team research, literature review.
Naturalistic Interaction between Humans and Conversational Agents
1. Seeber, I., Bittner, E.A.C., Briggs, R.O., Vreede, G.-J. de, Vreede, T. de, Druckenmiller, D., Maier, R., Merz, A.B., Oeste-Reiß, S., Randrup, N., et al.: Machines as Teammates: A Collaboration Research Agenda. In: 51st Hawaii International Conference on System Sciences (HICSS). Waikoloa Village, USA (2018)
2. Vom Brocke, J., Maaß, W., Buxmann, P., Maedche, A., Leimeister, J.M., Pecht, G.: Future Work and Enterprise Systems. Business & Information Systems Engineering 60, 357–366 (2018)
3. Licklider, J.C.R.: Man-Computer Symbiosis. IRE Trans. Hum. Factors Electron. HFE-1, 4–11 (1960)
4. Kahnemann, D., Rosenfield, A.M., Gandhi, L., Blaser, T.: Noise: How to Overcome the High, Hidden Cost of Inconsistent Decision Making. Havard Business Review 94, 36–43 (2016)
5. Abbass, H.A.: Social Integration of Artificial Intelligence: Functions, Automation Allocation Logic and Human-Autonomy Trust. Cogn Comput 11, 159–171 (2019)
6. Traumer, F., Oeste-Reiß, S., Leimeister, J.M.: Towards a Future Reallocation of Work between Humans and Machines – Taxonomy of Tasks and Interaction Types in the Context of Machine Learning. In: 38th International Conference on Information Systems (ICIS). Seoul, South Korea (2017)
7. Bittner, E.A.C., Oeste-Reiß, S., Leimeister, J.M.: Where is the Bot in our Team? Toward a Taxonomy of Design Option Combinations for Conversational Agents in Collaborative Work. In: 52nd Hawaii International Conference on System Sciences (HICSS). Grand Wailea, USA (2019)
8. Diederich, S., Brendel, A.B.: On Conversational Agents in Information Systems Research: Analyzing the Past to Guide Future Work. In: 14th International Conference on Wirtschaftsinformatik. Siegen, Germany (2019)
9. Seeber, I., Bittner, E.A.C., Briggs, R.O., Vreede, T. de, Vreede, G.-J. de, Elkins, A., Maier, R., Merz, A.B., Oeste-Reiß, S., Randrup, N., et al.: Machines as Teammates: A Research Agenda on AI in Team Collaboration. Information & Management, in press (2019)
10. McTear, M., Callejas, Z., Griol, D.: The Conversational Interface. Talking to Smart Devices. Springer, Cham (2016)
11. Kozlowski, S.W.J., Bell, B.S.: Work Groups and Teams in Organizations. In: Weiner, I.B. (ed.) Handbook of Psychology. Wiley, Hoboken, NJ (2006)
12. Leavitt, H.J.: Some Effects of Certain Communication Patterns on Group Performance. The Journal of Abnormal and Social Psychology 46, 38–50 (1951)
13. Vreede, G.-J. de, Briggs, R.O.: Collaboration Engineering: Designing Repeatable Processes for High-Value Collaborative Tasks. In: 38th Hawaii International Conference on System Sciences (HICSS). Big Island, USA (2005)
14. Feine, J., Gnewuch, U., Morana, S., Maedche, A.: A Taxonomy of Social Cues for Conversational Agents. International Journal of Human-Computer Studies, 138-161 (2019)
15. Seeger, A.-M., Pfeiffer, J., Heinzl, A.: Designing Anthropomorphic Conversational Agents: Development and Empirical Evaluation of a Design Framework. In: 39th International Conference on Information Systems (ICIS). San Francisco, USA (2018)
16. Kim, Y., Sundar, S.S.: Anthropomorphism of Computers: Is it Mindful or Mindless? Computers in Human Behavior 28, 241–250 (2012)
17. Klein, G., Woods, D.D., Bradshaw, J.M., Hoffman, R.R., Feltovich, P.J.: Ten Challenges for Making Automation a “Team Player” in Joint Human-Agent Activity. IEEE Intell. Syst. 19, 91–95 (2004)
18. Epstein, S.L.: Wanted: Collaborative Intelligence. Artificial Intelligence 221, 36–45 (2015)
19. Kamar, E.: Directions in Hybrid Intelligence: Complementing AI Systems with Human Intelligence. In: 25th International Joint Conference on Artificial Intelligence. Palo Alto, USA (2016)
20. Knijnenburg, B.P., Willemsen, M.C.: Inferring Capabilities of Intelligent Agents from Their External Traits. ACM Transactions on Interactive Intelligent Systems 6, 1–25 (2016)
21. Jain, H., Padmanabhan, B., Pavlou, P.A., Santanam, R.T.: Call for Papers—Special Issue of Information Systems Research —Humans, Algorithms, and Augmented Intelligence: The Future of Work, Organizations, and Society. Information Systems Research 29, 250– 251 (2018)
22. Kuijer, L., Giaccardi, E.: Co-performance: Conceptualizing the Role of Artificial Agency in the Design of Everyday Life. In: Conference on Human Factors in Computing Systems – CHI ’18. Montreal, Canada (2018)
23. Norman, D.: Design, Business Models, and Human-Technology Teamwork. Research- Technology Management 60, 26–30 (2017)
24. Wiese, E., Shaw, T., Lofaro, D., Baldwin, C.: Designing Artificial Agents as Social Companions. Proceedings of the Human Factors and Ergonomics Society Annual Meeting 61, 1604–1608 (2017)
25. Courtright, S.H., Thurgood, G.R., Stewart, G.L., Pierotti, A.J.: Structural Interdependence in Teams: An Integrative Framework and Meta-Analysis. The Journal of applied psychology 100, 1825–1846 (2015)
26. Mathieu, J.E., Maynard, M.T., Rapp, T., Gilson, L.: Team Effectiveness 1997-2007: A Review of Recent Advancements and a Glimpse into the Future. Journal of Management 34, 410–476 (2008)
27. Mathieu, J.E., Hollenbeck, J.R., van Knippenberg, D., Ilgen, D.R.: A Century of Work Teams in the Journal of Applied Psychology. The Journal of Applied psychology 102, 452–467 (2017)
28. LePine, J.A., Piccolo, R.F., Jackson, C.L., Mathieu, J.E., Saul, J.R.: A Meta-Analysis of Teamwork Processes: Tests of a Multidimensional Model and Relationships with Team Effectiveness Criteria. Personnel Psychology 61, 273–307 (2008)
29. Marks, M.A., Mathieu, J.E., Zaccaro, S.J.: A Temporally Based Framework and Taxonomy of Team Processes. The Academy of Management Review 26, 356–376 (2001)
30. Grossman, R., Friedman, S.B., Kalra, S.: Teamwork Processes and Emergent States. In: Salas, E., Rico, R., Passmore, J. (eds.) The Wiley Blackwell Handbook of the Psychology of Team Working and Collaborative Processes, 42, pp. 243–269
31. Rousseau, V., Aubé, C., Savoie, A.: Teamwork Behaviors: A Review and an Integration of Frameworks. Small Group Research 37, 540–570 (2006)
32. Marks, M.A., Sabella, M.J., Burke, C.S., Zaccaro, S.J.: The Impact of Cross-training on Team Effectiveness. Journal of Applied Psychology 87, 3–13 (2002)
33. Mathieu, J.E., Heffner, T.S., Goodwin, G.F., Salas, E., Cannon-Bowers, J.A.: The Influence of Shared Mental Models on Team Process and Performance. Journal of Applied Psychology 85, 273–283 (2000)
34. Hirschfeld, R.R., Bernerth, J.B.: Mental Efficacy and Physical Efficacy at the Team Level: Inputs and Outcomes among Newly Formed Action Teams. Journal of Applied Psychology 93, 1429–1437 (2008)
35. Fulmer, C.A., Gelfand, M.J.: At What Level (and in Whom) We Trust. Journal of Management 38, 1167–1230 (2012)
36. George, J.M.: Personality, Affect, and Behavior in Groups. Journal of Applied Psychology 75, 107–116 (1990)
37. Nass, C., Steuer, J., Tauber, E.R.: Computers are Social Actors. In: Conference on Human Factors in Computing Systems CHI ’94. New York, USA (1994)
38. Nass, C., Moon, Y.: Machines and Mindlessness: Social Responses to Computers. J Social Isssues 56, 81–103 (2000)
39. Krämer, N.C., Rosenthal-von der Pütten, A.M., Hoffmann, L.: Social Effects of Virtual and Robot Companions. In: Sundar, S.S. (ed.) The Handbook of the Psychology of Communication Technology, 2012, pp. 137–159. Wiley Blackwell, Chichester, UK (2015)
40. Vom Brocke, J., Simons, A., Niehaves, B., Riemer, K., Plattfaut, R., Cleven, A.: Reconstructing the Giant: On the Importance of Rigour in Documenting the Literature Search Process. In: 17th European Conference on Information Systems (ECIS). Verona, Italy (2009)
41. Webster, J., Watson, R.T.: Analyzing the Past to Prepare for the Future: Writing a Literature Review. MIS Quarterly 26, xiii–xxiii (2002)
42. Cooper, H.M.: Organizing Knowledge Syntheses: A Taxonomy of Literature Reviews. Knowledge in Society 1, 104–126 (1988)
43. Kitchenham, B.: Procedures for Performing Systematic Reviews. Technical Report Software Engineering Group (2004)
44. Bernard, D.: Cognitive Interaction. Towards “Cognitivity” Requirements for the Design of Virtual Assistants. In: IEEE International Conference on Systems, Man, and Cybernetics (SMC). Banff, Canada (2017)
45. Castelfranchi, C.: Modelling Social Action for AI Agents. Artificial Intelligence 103, 157– 182 (1998)
46. Azevedo, C.R.B., Raizer, K., Souza, R.: A Vision for Human-Machine Mutual Understanding, Trust Establishment, and Collaboration. In: IEEE Conference on Cognitive and Computational Aspects of Situation Management (CogSIMA). Savannah, USA (2017)
47. Kumar, R., Rosé, C.P.: Engaging Learning Groups Using Social Interaction Strategies. In: HLT ’10 Human Language Technologies. Los Angeles, USA (2010)
48. Kumar, R., Rosé, C.P.: Triggering Effective Social Support for Online Groups. ACM Transactions on Interactive Intelligent Systems 3, 1–32 (2014)
49. Kumar, R., Ai, H., Beuth, J.L., Rosé, C.P.: Socially Capable Conversational Tutors Can Be Effective in Collaborative Learning Situations. In: 10th International Conference on Intelligent Tutoring Systems. Pittsburgh, USA (2010)
50. Trinh, H., Edge, D., Ring, L., Bickmore, T.: Thinking Outside the Box: Co-planning Scientific Presentations with Virtual Agents. In: Traum, D., Swartout, W., Khooshabeh, P., Kopp, S., Scherer, S., Leuski, A. (eds.) Intelligent Virtual Agents, pp. 306–316. Springer, Cham (2016)
51. Meo, T.J., Kim, C., Raghavan, A., Tozzo, A., Salter, D.A., Tamrakar, A., Amer, M.R.: Aesop: A Visual Storytelling Platform for Conversational AI and Common Sense Grounding. AIC 32, 59–76 (2019)
52. Lopez, T., Chevaillier, P., Gouranton, V., Evrard, P., Nouviale, F., Barange, M., Bouville, R., Arnaldi, B.: Collaborative Virtual Training with Physical and Communicative Autonomous Agents. Comp. Anim. Virtual Worlds 25, 485–493 (2014)
53. Traum, D., Rickel, J., Gratch, J., Marsella, S.: Negotiation over Tasks in Hybrid Humanagent Teams for Simulation-based Training. In: 2nd International Joint Conference on Autonomous Agents and Multiagent Systems. Melbourne, Australia (2003)
54. Kuramoto, I., Baba, J., Ogawa, K., Yoshikawa, Y., Kawabata, T., Ishiguro, H.: Conversational Agents to Suppress Customer Anger in Text-based Customer-support Conversations. In: Proceedings of the 6th International Conference on Human-Agent Interaction – HAI ’18. Southampton, United Kingdom (2018)
55. Hanna, N., Richards, D.: The Influence of Users’ Personality on the Perception of Intelligent Virtual Agents’ Personality and the Trust Within a Collaborative Context. In: Proceedings of the 14th International Conference on Autonomous Agents and Multiagent Systems. Istanbul, Turkey (2015)
56. Fan, X., Yen, J.: Modeling Cognitive Loads for Evolving Shared Mental Models in Human-agent Collaboration. IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society 41, 354– 367 (2011)
57. Harbers, M., Neerincx, M.A.: Value Sensitive Design of a Virtual Assistant for Workload Harmonization in Teams. Cogn Tech Work 19, 329–343 (2017)
58. Toxtli, C., Monroy-Hernández, A., Cranshaw, J.: Understanding Chatbot-mediated Task Management. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Montreal, Canada (2018)
59. Portela, M., Granell-Canut, C.: A New Friend in our Smartphone? Observing Interactions with Chatbots in the Search of Emotional Engagement. In: Proceedings of the XVIII International Conference on Human Computer Interaction. Cancun, Mexico (2017)
60. Avula, S., Chadwick, G., Arguello, J., Capra, R.: SearchBots: User Engagement with ChatBots during Collaborative Search. In: Proceedings of the 2018 Conference on Human Information Interaction&Retrieval – (CHIIR). New Brunswick, USA (2018)
61. Paikari, E., Choi, J., Kim, S., Baek, S., Kim, M., Lee, S., Han, C., Kim, Y., Ahn, K., Cheong, C., et al.: A Chatbot for Conflict Detection and Resolution. In: 1st International Workshop on Bots in Software Engineering (BotSE). Montreal, Canada (2019)