World Scientific
  • Search
    Quick Search in Journals
    Access type:
    Quick Search anywhere
    Access type:
    Advanced Search
  • My Cart
  •   
Skip main navigation

Cookies Notification

We use cookies on this site to enhance your user experience. By continuing to browse the site, you consent to the use of our cookies. Learn More
×
Featured Topic Issue: Advances in Software Management; Guest Editor: Alain AbranNo Access

AN EMPIRICAL STUDY INTO THE ACCURACY OF IT ESTIMATIONS AND ITS INFLUENCING FACTORS

    https://doi.org/10.1142/S0218194013400081Cited by:7 (Source: Crossref)
    Previous
    Next

    Abstract

    This paper is the result of two related studies done on the estimation of IT projects at a large Dutch multinational company. The first one is a study about the accuracy of different dimensions of IT project estimating: schedule, budget and effort. [Note: This paper is an extension of the paper published by the authors as "An analysis of accuracy and learning in software project estimating" [28].] This study is based on a dataset of 171 projects collected at the IT department of the company. We analyzed the estimation error of budget, effort and schedule. Also, we analyzed whether there is any learning (improvement) effect over time. With the results of the first study we proceeded to research what is causing the current estimation error (inaccuracy). The results of our first study show that there is no relation between accuracy of budget, schedule and effort in the company analyzed. Besides, they show that over time there is no change in the inaccuracy (effectiveness and efficiency of the estimates). In our second study we discovered that the sources of this inaccuracy are: (IT estimation) process complexity, misuse of estimates, technical complexity, requirements redefinition and business domain instability. This paper reflects and provides recommendations on how to improve the learning from historical estimates and how to manage the diverse sources of inaccuracy inside this particular company and also in other organizations.

    References

    • T. K. Abdel-Hamid and S. E. Madnick, Information & Management 13(1), 1 (1987). Crossref, Web of Science, Google Scholar
    • B. Boehm, C. Abts and S. Chulani, Annals of Software Engineering 10(1), 177 (2000). Crossref, Google Scholar
    • B. W. Boehm et al. , Software Cost Estimation with Cocomo II with Cdrom ( Prentice Hall PTR , 2000 ) . Google Scholar
    • S. D.   Conte , H. E.   Dunsmore and Y. E.   Shen , Software Engineering Metrics and Models ( Benjamin-Cummings , 1986 ) . Google Scholar
    • R. J. Costello and D. B. Liu, Journal of Systems and Software 29(1), 39 (1995). Crossref, Web of Science, Google Scholar
    • J. Eveleens and C. Verhoef, IEEE Software 27(1), 30 (2010). Crossref, Web of Science, Google Scholar
    • J. L. Eveleens and C. Verhoef, Science of Computer Programming 74(12), 934 (2009). Crossref, Web of Science, Google Scholar
    • S. Ferreiraet al., Journal of Systems and Software 82(10), 1568 (2009). Crossref, Web of Science, Google Scholar
    • A.   Fink , The Survey Kit: How to Manage, Analyze, and Interpret Survey Data ( Sage , 2003 ) . Crossref, Google Scholar
    • S. Grimstad, M. Jorgensen and K. Molokken-Ostvold, Information and Software Technology 48(4), 302 (2006). Crossref, Web of Science, Google Scholar
    • Talha Javed, Manzile Maqsood and Qaiser S. Durrani, SIGSOFT Softw. Eng. Notes 29(7), (2004). Google Scholar
    • M. Joergensen and D. I. K. Sjoeberg, Information and Software Technology 45(3), 123 (2003). Crossref, Web of Science, Google Scholar
    • M. Jorgensen, IEEE Software 22(3), 57 (2005). Crossref, Web of Science, Google Scholar
    • M. Jørgensen, International Journal of Forecasting 23(3), 449 (2007). Crossref, Web of Science, Google Scholar
    • M. Jørgensen and K. Moløkken, How large are software cost overruns? Critical comments on the standish group's chaos reports, Simula Research Laboratories, 2004 . Google Scholar
    • M. Jorgensen and K. Molokken-Ostvold, IEEE Transactions on Software Engineering 30(12), 993 (2004). Crossref, Web of Science, Google Scholar
    • M. Jørgensen and D. I. K. Sjøberg, International Journal of Project Management 22(4), 317 (2004). Crossref, Google Scholar
    • L. A. Laranjeira, IEEE Transactions on Software Engineering 16(5), 510 (1990). Crossref, Web of Science, Google Scholar
    • S. G. MacDonell and M. J. Shepperd, Journal of Systems and Software 66(2), 91 (2003). Crossref, Web of Science, Google Scholar
    • S.   McConnell , Software Estimation: Demystifying the Black Art ( O'Reilly Media , 2009 ) . Google Scholar
    • K. Molokken-Ostvold and M. Jorgensen, IEEE Transactions on Software Engineering 31(9), 754 (2005). Crossref, Web of Science, Google Scholar
    • K. Moløkken-Østvoldet al., A survey on software estimation in the Norwegian industry, Software Metrics, 2004. Proceedings. 10th International Symposium on (IEEE, 2004) pp. 208–219. Google Scholar
    • Survey Monkey, Smart Survey Design, July 2012 . Google Scholar
    • R.   Valerdi , A theory of objective sizing , 28th Conference of the International Society of Parametric Analysts ( 2006 ) . Google Scholar
    • R. Valerdi, Cognitive limits of software cost estimation, Empirical Software Engineering and Measurement, 2007 (ESEM 2007) First International Symposium on (IEEE, 2007) pp. 117–125. Google Scholar
    • M. Van Genuchten, IEEE Transactions on Software Engineering 17(6), 582 (1991). Crossref, Web of Science, Google Scholar
    • R. K.   Yin , Case Study Research: Design and Methods ( Sage , 2009 ) . Google Scholar
    • A. H. Zapata and M. R. V. Chaudron, An analysis of accuracy and learning in softwareproject estimating, 38th EUROMICRO Conference on Software Engineering and Advanced Applications (IEEE, 2012) pp. 414–421. Google Scholar