A COGNITIVE LOAD VIEW AND EMPIRICAL TEST OF COLLABORATION NETWORK STRUCTURE VERSUS LEARNING RATES IN NEW SOFTWARE DEVELOPMENT
Abstract
This study explores whether characteristics of the collaboration structure in software development teams affect development learning rates, with a secondary goal of testing product complexity as a moderator. We develop suitable hypotheses under the theoretical lens of cognitive load theory. The empirical study uses archival data on an ordinary least squares model to find significant associations between collaboration structure, product complexity and the learning rates exhibited by 230 development teams producing open source software. Results show two distinct subgroups of projects: The first subgroup exhibits an average 78% learning rate, and the other subgroup “unlearned”, i.e., productivity deteriorated over time instead of improved. In the learning subgroup, collaboration network density negatively impacted learning, while product complexity interacted with collaboration network centralisation and boundary spanning activity. In the unlearning subgroup, only network density impacted learning rates and no moderating effects were found. Practical implications and future opportunities for research are discussed.
References
- [2005] A quantitative learning model for software test process Proc. 38th Annual Hawaii Int. Conf. System Sciences, 2005, HICSS’05, New York: IEEE. p. 786. Google Scholar
- [1999] Network structure in virtual organizations. Organization Science 10 (6), 741–757. Crossref, ISI, Google Scholar
- [2003] Individual centrality and performance in virtual R&D groups: An empirical study. Management Science 49 (1), 21–38. Crossref, ISI, Google Scholar
- [2007] New product development in turbulent environments: Impact of improvisation and unlearning on new product performance. Journal of Engineering and Technology Management 24 (3), 203–230. Crossref, ISI, Google Scholar
- [2006] Antecedents and consequences of unlearning in new product development teams. Journal of Product Innovation Management 23 (1), 73–88. Crossref, ISI, Google Scholar
- [1970] Communications networks in R&D laboratories. R&D Management 1 (1), 14–21. Crossref, ISI, Google Scholar
- [1969] Information flow in R&D labs. Administrative Science Quarterly 14 (1), 12–19. Crossref, ISI, Google Scholar
- , Organizational Learning: Creating, Retaining and Transferring Knowledge (Berlin: Springer, 2012) Google Scholar
- [1990] Learning curves in manufacturing. Science 247 (4945), 920–924. Crossref, ISI, Google Scholar
- [2003] Managing knowledge in organizations: An integrative framework and review of emerging themes. Management Science 49 (4), 571–582. Crossref, ISI, Google Scholar
- [1990] The persistence and transfer of learning in industrial settings. Management Science 36 (2), 140–154. Crossref, ISI, Google Scholar
- [1995] Group learning curves: The effects of turnover and task complexity on group performance. Journal of Applied Social Psychology 25 (6), 512–529. Crossref, ISI, Google Scholar
- [2013] A decade of Conway’s law: A literature review from 2003–2012 3rd Int. Workshop on Replication in Empirical Software Engineering Research (RESER), New York: IEEE. Google Scholar
- [2006a] Ties, leaders and time in teams: Strong inference about network structure’s effects on team viability and performance. Academy of Management Journal 49 (1), 49–68. Crossref, ISI, Google Scholar
- [2006b] The ties that lead: A social network approach to leadership. The Leadership Quarterly 17 (4), 419–439. Crossref, Google Scholar
- [1983] An empirical study of a syntactic complexity family IEEE Transactions on Software Engineering, SE 9 (6), 664–672. Crossref, ISI, Google Scholar
- [2007] Learning from experience in software development: A multilevel analysis. Management Science 53 (8), 1315–1331. Crossref, ISI, Google Scholar
- [2004] Taking stock of networks and organizations: A multilevel perspective. Academy of Management Journal 47 (6), 795–817. Crossref, ISI, Google Scholar
- [2009] Struture and learning in self-managed teams: Why “bureaucratic” teams can be better learners. Organization Science 21 (3), 609–624. Crossref, ISI, Google Scholar
- [2011] Design team perception of development team composition: Implications for Conway’s law 2nd Int. Workshop on Replication in Empirical Software Engineering Research (RESER), New York: IEEE. 52–60. Google Scholar
- [2010] I’m Working While they’re Sleep: Time Zone Separation Challenges and Solutions. USA: Nedder Stream Press. Google Scholar
- [1991] Cognitive load theory and the format of instruction. Cognition and Instruction 8 (4), 293–332. Crossref, ISI, Google Scholar
- [2003] Multimarket competition, consumer search, and the organizational structure of multiunit firms. Management Science 49 (4), 541–552. Crossref, ISI, Google Scholar
- [2005] Is out of sight, out of mind? An empirical study of social loafing in technology-supported groups. Information Systems Research 16 (2), 149–168. Crossref, ISI, Google Scholar
- [1991] Product Development Performance. Boston: Harvard Business School Press. Google Scholar
- [2010] Collaboration structure and performance in new software development: Findings from the study of open source projects. International Journal of Innovation Management 14 (5), 735–758. Link, Google Scholar
- [2014] Performance implications of stage-wise lead user participation in software development problem solving. Decision Support Systems 67, 100–108. Crossref, ISI, Google Scholar
- [2009] Impact of license choice of open source software development activity. Journal of the American Society for Information Science and Technology 60 (5), 997–1011. Crossref, ISI, Google Scholar
- [2010] Following the sun: Temporal dispersion and performance in open source software project teams. Journal of the Association for Information Systems 11 (11), 684–707. Crossref, ISI, Google Scholar
- [1968] How do committees invent. Datamation 14 (4), 28–31. Google Scholar
- [1987] Effects of schema acquisition and rule automation on mathematical problem-solving transfer. Journal of Educational Psychology 79 (4), 347. Crossref, ISI, Google Scholar
- [2001] Portfolio Management for New Products. Cambridge, MA: Perseus Books. Google Scholar
- [2003] The social structure of free and open source software development First Monday 10 (2). Crossref, Google Scholar
- [2007] Self-organization of teams for free/libre opensource software development. Information and Software Technology 49 (6), 564–575. Crossref, ISI, Google Scholar
- [2007]
Different bug fixing regimes? A preliminary case for superbugs , Open Source Development, Adoption and Innovation. Berlin: Springer, pp. 247–252. Crossref, Google Scholar - [2005] The structural complexity of software: An experimental test. IEEE Transactions on Software Engineering 31, 11. Crossref, ISI, Google Scholar
- [2012] Cognition matters: Enduring questions in cognitive IS research. Journal of the Association for Information Systems 13 (4), 273–314. Crossref, ISI, Google Scholar
- [2013] Relationships between communication structure and software architecture: An empirical investigation of the Conway’s law at the Federal University of Pernambuco. 23rd Int. Workshop on Replication in Empirical Software Engineering Research (RESER), 2013. New York: IEEE. Google Scholar
- [1984] Environmental boundary spanning and information processing effects on organizational performance. The Academy of Management Journal 27 (2), 351–368. Crossref, ISI, Google Scholar
- [2014] Research on information systems failures and successes: Status update and future directions. Information Systems Frontiers 17, 1–15. Google Scholar
- [2003] The impact of time separation on coordination in global software teams: A conceptual foundation. Software Process Improvement and Practice 8, 249–266. Crossref, Google Scholar
- [1977] A set of measures of centrality based on betweenness. Sociometry 40 (1), 35–41. Crossref, Google Scholar
- [2005] IT failure rates: 70% or 10–15%? IEEE Software, May-June 112–114 Crossref, ISI, Google Scholar
- [2008] Emergence of new project teams from open source software developer networks: Impact of prior collaboration ties. Information Systems Research 19 (3), 369–391. Crossref, ISI, Google Scholar
- [1964] Profit from the learning-curve. Harvard Business Review 42 (1), 125–139. ISI, Google Scholar
- [1998] Product complexity, innovation and industrial organisation. Research Policy 26 (6), 689–710. Crossref, ISI, Google Scholar
- [1972] Victims of Groupthink. Boston, MA: Houghton Mifflin. Google Scholar
- [1986] Programming Productivity. New York: McGraw-Hill. Google Scholar
- [1998] Levels of expertise and instructional design. Human Factors: The Journal of the Human Factors and Ergonomics Society 40 (1), 1–17. Crossref, ISI, Google Scholar
- [2003] The expertise reversal effect. Educational Psychologist 38 (1), 23–31. Crossref, ISI, Google Scholar
- [1992] The strength of strong ties: The importance of philos in organizations. Networks and organizations: Structure, Form, and Action 216, 239. Google Scholar
- [2002] Cave or community? An empirical examination of 100 mature open source projects First Monday 7 (16). Google Scholar
- [2012] Conway’s law revisited: The evidence for a task-based perspective. Software, IEEE 29 (1), 90–93. Crossref, ISI, Google Scholar
- [1992] Core capabilities and core rigidities: A paradox in managing new product development Strategic Management Journal 13, 111–125 Special Issue: Strategy Process: Managing Corporate Self-Renewal. Crossref, ISI, Google Scholar
- [2005] Collaborating on multiparty information systems development projects: A collective reflection-in-action view. Information Systems Research 16 (2), 109–130. Crossref, ISI, Google Scholar
- [1988] Organizational learning. Annual Review of Sociology 14 (8), 319–340. Crossref, ISI, Google Scholar
- [1999] Learning failure in information systems development. Information Systems Journal 9 (2), 85–101. Crossref, ISI, Google Scholar
- [2005] An integrated framework for measuring product development performance in high technology industries. Production and Operations Management 14 (2), 142. Crossref, ISI, Google Scholar
- [1976] A software complexity measure IEEE Transactions on Software Engineering, SE 2 (4), 308–320. Crossref, Google Scholar
- [1999] Managing radical product development in large manufacturing firms: A longitudinal study. Journal of Operations Management 17 (6), 631–644. Crossref, Google Scholar
- [2003] Valuing internal vs. external knowledge: Explaining the preference for outsiders. Management Science 49 (4), 497–513. Crossref, ISI, Google Scholar
- [1953] What is information measurement? American Psychologist 8 (1), 3. Crossref, ISI, Google Scholar
- [1956a] Human memory and the storage of information. Information Theory, IRE Transactions on 2 (3), 129–137. Crossref, ISI, Google Scholar
- [1956b] The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological review 63 (2), 81. Crossref, ISI, Google Scholar
- [1950] Verbal context and the recall of meaningful material The American Journal of Psychology 176–185. Crossref, ISI, Google Scholar
- [2002] Two case studies of open source software development: Apache and Mozilla. ACM Transactions on Software Engineering and Methodology 11 (3), 309–346. Crossref, ISI, Google Scholar
- [1982] Explaining Organizational Behavior. San Francisco: Jossey-Bass. Google Scholar
- [1994] Dependence and risk: Transforming and structure of social research. Social Psychology Quarterly 57 (3), 163–176. Crossref, ISI, Google Scholar
- [2003] Learning negotiation skills: Four models of knowledge creation and transfer. Management Science 49 (4), 529–540. Crossref, ISI, Google Scholar
- [2004] Group social capital and group effectiveness: The role of informal socializing ties. Academy of Management Journal 47 (6), 860–875. Crossref, ISI, Google Scholar
- [2000] Distance matters. Human-Computer Interaction 15 (2), 139–178. Crossref, ISI, Google Scholar
- [2004] Cognitive load theory: Instructional implications of the interaction between information structures and cognitive architecture. Instructional science 32 (1), 1–8. Crossref, ISI, Google Scholar
- [2007] An empirical study of ICASE learning curves and probability bounds for software development effort. European Journal of Operational Research 183 (3), 1086–1096. Crossref, ISI, Google Scholar
- R Development Team, The R Project for Statistical Computing: R V 3.1.1.2014. Google Scholar
- [1996] A learning curve primer for software engineers. ACM SIGSOFT Software Engineering Notes 21 (1), 77–86. Crossref, Google Scholar
- [2001] Networks, diversity and productivity: The social capital of corporate R&D teams. Organization Science 12 (4), 502–517. Crossref, ISI, Google Scholar
- [2005] Individual experience and experience working together: Predicting learning rates from knowing who knows what and knowing how to work together. Management Science 51 (6), 869–891. Crossref, ISI, Google Scholar
- [2001] Task complexity, task difficulty, and task production: Exploring interactions in a componential framework. Applied Linguistics 22 (1), 27–57. Crossref, ISI, Google Scholar
- [2000] Distribution of knowledge, group network structure, and group performance. Management Science 46 (5), 612–625. Crossref, ISI, Google Scholar
- [1993] Adapting to complexity. Scientific American 268 (1), 130–140. Crossref, ISI, Google Scholar
- [1985] The uses and abuses of experience curves. Long Range Planning 18 (1), 64–72. Crossref, ISI, Google Scholar
- [2011] A hidden Markov model of developer learning dynamics in open source software projects. Information Systems Research 22 (4), 790–807. Crossref, ISI, Google Scholar
- [2003] Learning-by-hiring: When is mobility more likely to facilitate interfirm knowledge transfer? Management Science 49 (4), 351–365. Crossref, ISI, Google Scholar
- [2011] Programming Secrets: Why Software Projects Fail. New York: Apress. Google Scholar
- [1988] Cognitive load during problem solving: Effects on learning. Cognitive Science 12 (2), 257–285. Crossref, ISI, Google Scholar
- [1994] Cognitive load theory, learning difficulty, and instructional design. Learning and instruction 4 (4), 295–312. Crossref, Google Scholar
- [2007] Why minimally guided teaching techniques do not work: A reply to commentaries. Educational Psychologist 42 (2), 115–121. Crossref, ISI, Google Scholar
- [1998] Cognitive architecture and instructional design. Educational Psychology Review 10 (3), 251–296. Crossref, ISI, Google Scholar
- [2003] Integrating knowledge through information trading: Examining the relationship between boundary spanning communication and individual performance. Decision Sciences 34 (2), 261–286. Crossref, ISI, Google Scholar
- [2003] Relational embeddedness and learning: The case of bank loan managers and their clients. Management Science 49 (4), 383–399. Crossref, ISI, Google Scholar
- [2005] Cognitive load theory and complex learning: Recent developments and future directions. Educational Psychology Review 17 (2), 147–177. Crossref, ISI, Google Scholar
- [1994] Social Network Analysis: Methods and Applications. Cambridge, UK: Cambridge University Press. Crossref, Google Scholar
- [1936] Factors affecting the cost of airplanes. Journal of Aeronautical Sciences 3 (4), 122–128. Crossref, Google Scholar
- [1979] The learning curve: Historical review and comprehensive survey. Decision Sciences 10 (2), 302–328. Crossref, Google Scholar
- [1995] Knowledge and the speed of the transfer and imitation of organizational capabilities: An empirical test. Organization Science 6 (1), 76–92. Crossref, ISI, Google Scholar
- Zorgios, Y, O Vlismas and G Venieris (2009). The SECI model and the learning curve phenomenon. In European Conference on Intellectual Capital, Academic Conferences & Publishing International Ltd., Haarlem, The Netherlands, 589–599. Google Scholar
| Remember to check out the Most Cited Articles! |
|---|
|
Be inspired by these New Titles in Business and Management |


