International Journal of Innovation and Economic Development
Volume 4, Issue 6, Februaury 2019, Pages 23-31
Towards Critical Realism in Cost Overrun Research
DOI: 10.18775/ijied.1849-7551-7020.2015.46.2002
URL: http://dx.doi.org/10.18775/ijied.1849-7551-7020.2015.46.2002![]()
Amadi Alolote
School of the Built Environment University of Salford, UK
Abstract: Construction management, as an emergent field of research, is yet to have a recognized methodological orientation, characteristic of other more established domains, and therefore builds on the traditional philosophical assumptions of related natural and social science research. The term “Methodological pluralism,” has thus been used to describe the use of a multiplicity of philosophies and methods, compatible with the study of construction phenomena. This study narrows down the philosophical argument in construction management to within the specific domain of cost overrun research, to systematically articulate the shortcomings in the methodological/philosophical tradition embraced by previous studies. Empirical profiling of cost overrun research reveals the predominance of mono-method studies based on questionnaire survey methods, correlative analysis, and archival data modeling techniques, all of which are underlain by positivism. The study argues that such positivist philosophies, although methodologically valid, cannot adequately explain and provide an in-depth understanding of the contextual drivers in construction organizations, that trigger the more tangible technical constructs, leading to the phenomena of cost growth in projects. Joining in the chorus call for methodological pluralism in construction industry research, this study makes a case for critical realism specifically in the context of cost overrun research.
Keywords: Cost overrun, Critical realism, Methods, Research philosophy
Towards Critical Realism in Cost Overrun Research
1. Introduction
Construction management research, as a form of social research, is confronted with the fundamental issue of determining a core philosophical orientation, to be considered as adequate and best suited to inquire about construction phenomena (Dainty, 2008; Fellows and Lui, 2015). Dainty (2008) stated that construction management, as an emergent field of research, is yet to have a recognized methodological orientation, characteristic of other more established domains, and therefore builds on the traditional philosophical assumptions of related natural and social science research. The term “Methodological pluralism,” was thus used to describe the use of a multiplicity of philosophies and methods, compatible with the study of construction phenomena (Dainty, 2008). The underpinning argument being that, the differences in worldviews, will yield marked differences in the type of knowledge generated. As Bryman’s (1988:34) espouses “different research paradigms will inevitably result in the generation of different kinds of knowledge about the industry and its organizations.”
1.1 Aim of the Research
This study narrows down the philosophical argument in construction management to within the specific domain of cost overrun research, to systematically articulate the shortcomings in the methodological/philosophical tradition embraced by previous studies.
2. Literature Review
The cost performance of construction projects is often identified as a fundamental measure of success for project sponsors. On the contrary, many construction projects documented in the public domain, have been censured for notoriously running over their original budget estimate. Cost overrun in construction projects remains a topical issue, with the media, technical press, and scholarly literature, rife with publications analyzing cost overrun trends, identifying their primary causes, and offering broader explanations for this pervasive trend. A myriad of empirical studies has thus sought to understand and elucidate on the fundamental reasons why projects consistently run over budgeted cost. This study questions the veracity of the explanations provided in the literature based on empirical data, by taking a closer look at their methodological and philosophical underpinnings. The study reviews the nomenclature of the empirical literature on the problem of cost overruns in construction projects.
2.1 Studies Analysing Structured Responses
An analysis of the literature on cost overruns reveals a predominant leaning towards the use of survey researches, mostly based on analysis of questionnaire surveys which sample the opinions of construction professionals. See for example Mansfield et al., 1994; Chang 2002; Aibinu and Odeyinka, 2006; Kaliba et al., 2008; Memon et al., 2011; Ubani, 2015. These studies often generate a long list of factors, which are sometimes subsequently ranked. Aibinu and Odeyinka, (2006) identified 44 factors, prioritizing the 39 factors on a ranked profile, as a source of useful information for construction industry stakeholders, in curbing delays and cost overruns. Some authors including Cantarelli et al. (2010); Allahahium and Lui (2011) and Brunes and Lind, (2014) have taken the evidence one step further, by seeking to categorize and classify the myriad of causative variables identified, into a typology of causes, on the grounds that generating a long list of factors, without tracing their fundamental defining characteristics, was insufficient. For example, Allahahium and Liu (2011), analyzed 90 causes of cost overruns, identifying five main triggers for cost overruns including: (1) Market volatility principally due to micro and macroeconomic variations; (2) novelty/unpredictable events such as unexpected ground conditions; (3) estimate distortion; (4) time pressures and finally (5) project complexity.
The methodology of listing factors, ranking, and categorizing causative variables, based on impersonal questionnaire surveys, which is the most rudimental and simplistic approach to explaining cost overruns, appears to have flooded the literature. Although this adds to the body of scholarly literature on cost overruns, and are methodologically valid, the study believes that these forms of empirical analysis cannot be used as a basis for inferring specific cause-effect relationship. With Ahiagu Dugbai et al. (2014:868), describing the bulk of cost overrun research, as replicative, stating: “It is argued that questionnaires alone may not be suitable for investigating complex and systemic problems like cost overrun on construction projects… It is no surprise that the same factors seem to come top of the list most of the time …”.
This characteristic feature of questionnaire-based studies, limits the usefulness of the output of such research, in generating context specific explanations that can be relied on in practice. However, a limited number of studies based on questionnaire surveys, are methodologically more robust (Memon and Rahman, 2013; Sharma and Goyal, 2014). These studies have gone a step further to develop explanatory relationships amongst the identified cost overrun factors. For instance, Memon and Rahman (2013) investigated the effect of cost overrun factors based on survey responses of a client, contractor, and consultant representative involved in handling small-scale projects in Malaysia. A total of 54 survey responses were analysed using the Partial Least Square Structural Equation Modelling, a form of factor analysis, to model the relationship amongst various factors. The outcome of the analysis revealed underlying factors which triggered the highest variance: contractor’s site management related factors had the most significant effect on small-scale projects. Sharma and Goyal (2014) developed a fuzzy logic model for assessing cost overrun, based on a preliminary questionnaire survey, conducted to judge the level of importance of the identified factors. A fuzzy logic model was then developed and used in mapping out decision trees on an input and output basis, complemented by a graphical representation of the variation induced by different combinations of cost overrun factors, to understand their combined effect. Sharma and Goyal (2014) fuzzy model showed that the most considerable hypothetical variation in cost overrun will be primarily due to inadequate planning and scheduling, followed by variation due to short bid preparation time and experience of the contractor.
Nevertheless, an obvious shortcoming of the models developed by both Memon and Rahman (2013) and Sharma and Goyal (2014) is that the data used in their analysis was not sourced on specific projects or based of any form of project information. These studies relied solely on the general opinions of construction professionals, to infer abstract statistical inferences about the generality of factors that lead to cost overruns. It is thus probable that these models can explain the relationships amongst the cost overrun factors but may have little explanatory power to account for recorded cost overruns on a project-specific basis. This can be rationalized on the grounds that projects are unique, which is in stark contrast to the underlying assumptions of the findings of these studies. Furthermore, matters of sensitive dependence arise, in the generalizability of the study by Memon and Rahman (2013) concerning small-scale projects in Malaysia, as the study assumes that projects of a similar size will experience similar issues.
2.2 Studies Advancing Spurious Correlations
In addition to the aforementioned groups of cost overrun studies, few others provide and analyse cost overrun data, to test specific project variables in accounting for the trend in the data, as explanations for the cost overruns. Typically, Hinze and Gregory (1991), empirically tested for the effects of project size, location, and complexity on the level of cost overruns experienced on projects executed by the Washington State Department of Transport. Flyvbjerg et al. (2002, 2004), conducted a similar study, from a sample of 254 transportation infrastructure projects drawn from countries in different regions, mostly located in the northern hemisphere. Akoa (2011) conducted a similar study on highway projects in Cameroun. These studies concluded that the bigger sizes and complexity of infrastructure projects are correspondingly reflected in the increased levels of cost overrun. Hinze and Gregory (1991), further inferred, that the simultaneous nature of projects execution by highway agencies, invariably implied lesser amounts of pre-and post-contract engineering hours available to each, thus accounting for the higher levels of cost overruns often induced in highway projects. Additional engineering was thus stated as requisite, to overcome risks occasioned by the complex and simultaneous nature of highway project execution, which often creates a propensity for such projects to run over budget. Whereas, Flyvbjerg et al. (2004), asserted that the average length of the implementation phase of transportation projects significantly impacted on the level of cost overruns recorded. This was inferred based on an analysis of cost overruns experienced on bridges, tunnels, and roads, which showed that cost overruns varied relative to project duration. Bridges and tunnels, with an average duration of 6.6 years recorded higher cost overruns than rail and road projects with an average duration of 6.3 and 4.3 years. Flyvbjerg et al. (2004:15) thus concluded, sluggish planning and implementation of transportation projects had direct financial repercussions, stating: “Sluggishness may, quite simply, be extremely expensive.”
However, other studies, such as those by Odeck (2004) in Norway, revealed that more massive cost overruns were experienced in smaller projects. Morris (1990) also arrived at a similar conclusion, as Odeck (2004), for 290 Indian projects analysed. Yet, contrary to the findings of these studies, both Love (2002) and Love et al. (2013) revealed that cost overruns do not vary by project type or size. The conflicting results, from various studies, further reinforces the discernible shortcoming of these studies, that conclusive inference is mostly drawn based on exploratory statistical analysis. Typically, the use of correlation analysis, which by virtue of reporting a significant association between bivariate groups of variables, cannot be used to infer causality conclusively. These studies thus assume that the dependent variable (Cost overrun) changes solely because the independent variables (project size, project type complexity etc., change). Citing the popularly used phrase in statistics: ‘Correlation does not necessarily imply causation’.
2.3 Studies Analysing Causation Based on Project Data
Quantitative analytical techniques, which analyse cause-effect relationships, are generally grouped as Mathematical models (An et al., 2007). Models are reductions of reality replicating an intricate system using variables within those systems (Ahiagu Dugbai, et al., 2014). Mathematical models have however been scantly used in the literature to infer causality concerning project cost overruns. The techniques which have being used to analyse cost overrun in a limited number of older and more contemporary studies include: Linear modelling techniques such as regression modelling, Networking and data mining techniques such as Artificial Neural Networks, Heuristics based models such as Case-Based Reasoning /Reference Class Forecasting, Stochastic techniques such as Monte-Carlo simulations; and Logic-based methods such as Binary Logistic modelling and Fuzzy Logic (Love 2002; Trost and Oberlender 2003; Attala and Hegazy 2003; Ahiagu Dugbai et al., 2014; Lee and Kim 2015 and El-Kholy 2015):
Typically, older studies such as Trost and Oberlender (2003) as well as Attala and Hegazy (2003) have used linear modeling techniques, based on regression analysis, to analyse cause-effect relationships in explaining recorded cost overruns in projects, and further tested the validity of these models with respect to their use in decision making for future projects, at specified levels of confidence. A more recent study by El-Kholy (2015) generated a regression-based model while comparing its predictive capacity to a Case-Based Reasoning (CBR) model for similar datasets derived from 30 projects. The outcome of the study showed that the regression modeling had higher levels of accuracy to predict potential cost overrun in projects. El-Kholy (2015) further applied a CBR model to predict the likely cost overrun given the degree of similarity of the project characteristics. El-Kholy (2015) used this method to analyse cost overrun factors, whose presence as part of a future project, is indicative of a potential to result in a similar degree of cost overrun, useful in reference class forecasting and decision making to minimize cost overruns for future projects. Ahiagu Dugbai et al. (2014) used data mining techniques based on artificial neural networks, to analyse the complexity of non-linear interactions amongst quantitative project variables such as compensation events, project duration, as well as qualitative information on tendering method, location, project type, fluctuation measure and project’s delivery partner. Lee and Kim (2015) used Monte-Carlo simulations to analyse the statistical distribution of change orders issued during the construction period, which lead to significant cost overruns. Love et al. (2013) developed a probabilistic Log-Logistic distribution of cost overruns for 49 road projects (new roads including upgrades and elevated highways) in relation to rework occasioned by errors and omissions in contract documentation, leading to cost overruns. Although this class of technical studies on cost overruns which rely on modeling to understand cause-effect relationships have a robust and methodologically valid underpinning, rooted in the specifics of project data, with direct applicability useful in monitoring and reassessing future projects, there is an obvious lack of context.
3. Discussions
It is often argued that the selection of a research philosophy by the research community is mostly an intuitive decision, often in line with the researcher’s ontological and epistemological stance and preference, which may not necessarily ensure the rigor and robustness of the research effort (Holden and Lynch, 2004). This argument reflects a discernible shortcoming in the bulk of cost overrun research, which is the sole reliance of positivists philosophy to explain the poor financial performance of construction projects. This trend equally reflects the bigger picture in construction management research, which has been shown to exhibit a continuing adherence to positivism (Dainty, 2009). Such methods strip the context narrative, which is necessary to elucidate the role of social action from the standpoint of project actors. This is despite the vast array of research philosophies which can be compatible with the study of construction phenomena, by being technical as well as social constructs. As Dainty (2009:6) asserts: “Researchers use the real-world context of the construction industry as sites for developing research questions … It could be reasonably expected that their methodological positions and the methods adopted may have broadened and diversified to reflect the multiple traditions from which it draws.”
It is thus the researcher’s conviction that methodological pluralism, applied to cost overrun research, would yield less artificialized and more methodologically valid explanations for cost overruns, which describe the context and show causality. Using a practical analogy Mingers (1997:9), illustrated the need for methodological adventure: “Adopting a particular paradigm is like viewing the world through a particular instrument such as a telescope, an X-ray machine, or an electron microscope. Each reveals certain aspects but is completely blind to other… Thus, in adopting only one paradigm, one is inevitably gaining only a limited view of a particular intervention or research situation … it is always wise to utilize a variety of approaches”.
Various opinions have thus been expressed on the criteria for choosing a research philosophy (Grix, (2001; Holden and Lynch, 2004; Rooke and Kaguoglo; 2007; Gajendran, 2011). Holden and Lynch (2004) argued: “Research should not be methodologically led, rather than methodological choice should be consequential to the research philosophical stance and the social science phenomenon to be investigated.” Grix (2001:23) asserts “methods themselves should be seen as free from ontological and epistemological assumptions, and the research questions should guide the choice of which to use.” Some other researchers, for example, Panas and Pantouvakis (2010:77), have predicted the selection of an appropriate methodology, by identifying those typically deployed in similar studies, with the ultimate objective of “Preserving research validity and establishing of a seamless methodology that could be repeatedly applied.”
The study builds on the argument of Holden and lynch (2004) and are of the view that the most appropriate philosophical orientation for cost overrun research should be objectively defined, devoid of personal, discipline or paradigm-based preferences, centered on their merits for achieving the research aims and objectives. The study posits stereotyping or basing methodological decisions on existing philosophical traditions or trends in previous studies, would amount to methodological stagnation, which will ultimately stifle innovation and creativity in research. Rooke and Kagioglou (2007), further reinforce the study’s stance, asserting that a fundamental requirement in research is its ‘Unique Adequacy’. Unique Adequacy, a criterion for adjudging reliability and validity in qualitative research, means that: “the methods of analysis used to report, should be derived from that setting.” The implication of this logic for cost overrun research and academic inquiry in the construction industry is that the method of analysis should not necessarily be determined a priori, being ‘transplanted in-situ’ from similar studies in the knowledge domain but should rather emerge from the peculiarities of the problem and context under investigation.
Given the significant gap in the cost overrun literature, the study posits that critical realism presents itself as a valid philosophical position, relevant to carry out rigorous and methodologically robust research on construction phenomena, which can withstand the critique plaguing the use of mono methods in construction management research. In conducting cost overrun research, the study espouses the adoption of the philosophical stance of the critical realist, via the retention of ontological positivism, which rejects the view of multiple realities, with epistemological interpretivism/constructivism, which acknowledges the role that values, and societal ideology play in the derivation of empirical knowledge.
However, in advocating for critical realism, the study is not unaware of its criticism, mostly accused of being ‘logically contradictory’ (Nune, 2013). From the physical and social sciences, proponents and advocates of the critical realist philosophy have erected categorical philosophical defences in readiness for such criticism, (Frazer and Lacey, 1993; Campbell, 2002). To the constructivists, such justification was provided by Frazer and Lacey (1993:182): “Even if one is a realist at the ontological level, one could be an epistemological interpretivist . . . Our knowledge of the real world is inevitably interpretive and provisional rather than straightforwardly representational”. Critical realism was thus further conceived by Lawson (2003) as a methodologically valid lens for the social sciences, on the issues of ontology, as it relates to the nature of the study phenomena (sensory abstractions or real/tangible?). To the positivist, it was contended: “all scientists are epistemological constructivists and relativists in the construction of scientific knowledge” (Campbell, 2002: 29). More specifically in the engineering sciences, Panas, and Pantouvakis (2010) noted that quantitative experimental frameworks and models require scientific data, which are primarily sought through human subjects, whom are inherently subjective in their representations.
Philosophical flexibility in cost overrun research is thus warranted. Ontologically the reality of cost overruns is a tangible construct that can be measured precisely. However, epistemologically, factors leading to cost growth has a wide range of differing explanatory perspectives and has been established in the literature to be closely linked to the subjectivity of project players in organizations. To understand the phenomena of cost growth, therefore, requires that an interpretivist epistemology is necessary while retaining the singular ontology of the reality of cost overruns in highway projects, typical of critical realism (Figure 1).
Figure 1: Philosophical Position of the Critical Realist in Cost Overrun Research
The philosophical appropriateness of relying more heavily on the interpretative world-view as opposed to the positivist view at an epistemological level, is defined by the need to gain knowledge on the propagation of cost overruns through human subjects, who are the executors of projects, as well as the need to factor in the organizational dynamics surrounding construction projects. The ability of the critical realist to infer causality within a predominantly interpretative epistemology further defines its appropriateness to provide contextual explanations for the propagation of cost overruns in projects, which is fundamentally driven by actions/inactions of the human actors in construction organizations. According to Huberman and Miles (1985:21), critical realism is an “an approach designed to yield verifiable knowledge of human group life and human conduct”. This is predicated on the critical realist assumption that there are ‘reasonably stable law-like links of causality’ amongst social constructs, whereby human actors in the social and historical setting have always exhibited ‘sequences and regularities that link phenomena together’ (Miles and Huberman,1994:429). This unique feature of critical realism, its terms its ability to retain objectivity, while incorporating multiple perspectives derived from the interpretative understanding of the human factors in organizational practice, that drive the more technical concerns, is thus a core requirement, necessary to infer causality in cost overrun research.
4. Conclusion and Recommendations
The study has examined the methodological and philosophical leaning of cost overrun research, highlighting the predominance of mono-method studies, which are mostly based on questionnaire survey methods, correlative analysis and archival data modelling techniques, all of which are underlain by positivism. The study argues that such positivist philosophies, although methodologically valid, cannot adequately explain and provide an in-depth understanding of the contextual drivers in construction organizations, that trigger the more tangible technical constructs, leading to the phenomena of cost growth in projects. The study thus advocates for critical realism, which affords the use of multi-methodologies, and as well as maintain both objective and subjective realities of the constructs associated with cost overruns in projects. The study posits that critical realism lends itself as potential lenses to study construction phenomena.
References
- Ahiaga-Dagbui, D. D., and S.D. (2014). Rethinking construction cost overruns: Cognition, learning and estimation. Journal of Financial Management of Property and Construction, 19(1),38–54. Crossref
- Aibinu, A.A., and Odeyinka, A. (2006). Construction delays and their causative factors in Nigeria. Journal of Construction Engineering Management, ASCE, (132) 7,667-677. Crossref
- Akoa, B.B. (2011). Cost Overruns and Time Delays in Highway and Bridge Projects – Experiences from Cameroon. An unpublished Master’s thesis submitted to Michigan State University.
- Allahaim, F. D., and Liu, L. (2013). Understanding Major Causes Cost Overrun for Infrastructure Projects; A Typology Approach. Annual Conference of the Australasian Universities Building Educators Association (AUBEA)The University of New South Wales, Australia
- An, S., Kim, G., and Kang, K. (2007). A case-based reasoning cost estimating model using experience by analytic hierarchy process. Journal of Building and Environment. 42(7), 2573–2579. Crossref
- Attala, M., and Hegazy, T. (2003). Predicting Cost Deviation in Reconstruction Projects: Artificial Neural Networks Versus Regression. Journal of Construction Engineering and Management, 129 (4), 405-411. Crossref
- Brunes, F., and Lind, H. (2014). Explaining cost overruns in infrastructural projects: A new framework with applications to Sweden. Working Paper 01 Section for Building and Real Estate Economics, School of Architecture and the Built Environment, Royal Institute of Technology.
- Bryman, A. (1988). Research Methods and Organization Studies. Contemporary Social Research. Uwin Hyman Ltd
- Campbell, R. (2002). A Hundred Years of Phenomenology: Perspectives on a philosophical tradition, Ashgate Publishing Ltd, England, 73-87.
- Cantarelli, C.C., Flyvbjerg, B., Molin, E.J.E and Van Wee, B. (2010). Cost Overruns in Large-scale Transportation Infrastructure Projects: Explanations and Their Theoretical Embeddedness. EJTIR 10(1), March 5-18.
- Chang, A. Shing-Tao. (2002). Reasons for cost and schedule increase for engineering design projects. Journal of Management Engineering, ASCE, 18(1), 29-36. Crossref
- Dainty, A.R.J. (2008) Methodological pluralism in construction management research. In Advanced methods in the Built Environment, A. Knight and L. Ruddock Eds, West Sussex, Wiley-Blackwell: 75-84
- El-Kholy, A. M. (2015). Predicting Cost Overrun in Construction Projects. International Journal of Construction Engineering and Management. 4(4), 95-105.
- Fellows, R. F., and Liu, A. (2015). Research Methods for Construction, 4th Edition. Wiley.
- Flyvbjerg, B., Skamris Holm, M.K. and Buhl, S.L. (2002). Underestimating cost in public works. Error or Lie? Journal of the American Planning Association, 68(3), 279–295. Crossref
- Flyvbjerg, B., Skamris Holm, M.K., and Buhl, S.L. (2004). What Causes Cost Overrun in Transport. Fourth Transportation Specialty Conference of the Canadian Society for Civil Engineering Montréal, Québec, Canada
- Frazer, E and Lacey, N. (1993). The Politics of Community: A Feminist Critique of the Liberal-Communitarian Debate. The Cambridge Law Journal, 53(3), 619-621.
- Gajendran, T. (2011). Investigating informality in construction: philosophy, paradigm and practice’, Australasian Journal of Construction Economics and Building, 11 (2), 84-98. Crossref
- Grix, J. (2001). Demystifying Postgraduate Research: University of Birmingham Press, Birmingham.
- Hinze, J and Gregory, S. (1991). Analysis of WSDOT Construction Cost Overruns. United States Department of Transportation, Federal Highway Administration. Report No. WA-RD 218.1.
- Holden, M.T and Lynch, P. (2004). Choosing the Appropriate Methodology: Understanding Research. Marketing Review. 4(4), 397- 406. Crossref
- Huberman, A. M and Miles, M.B. (1985). Assessing Local Causality in qualitative research. In D.N. Berg and K.K. Smith Eds. Exploring Clinical Methods for Social Research. pp 351-381. New York: Sage.
- Kaliba, C., Muya, M. and Mumba, K. (2008). Cost escalation and schedule delays in road construction in Zambia. International Journal of Project Management, 27(5), 522-531. Crossref
- Lawson, C. (2003). Critical Issues in ‘Economics as Realist Social Theory’. Critical Realism in Economics: Discussion and Debate. S. Fleetwood, ed. London and NY, Routledge: 209-258. Crossref
- Lee, K and Kim, K. (2015). Collar Option Model for Managing the Cost Overrun Caused by Change Orders. [online]. Available at mdpi.com/journal/sustainability accessed 13/01/2016. Crossref
- Love P. E. D. (2002). Influence of Project Type and Procurement Method on Rework Costs in Building Construction Projects. Journal of Construction Engineering and Management, 128(1), 18-29. Crossref
- Love P. E. D. (2013). Determining the Probability of Cost Overruns in Australian Construction and Engineering Projects. Journal of Construction Engineering and Management 139(3): 321-330 Crossref
- Mansfield, N.R., Ugwu, O.O. and Doranl, T. (1994). Causes of delay and cost overruns in Nigerian construction projects. International Journal of Project Management, 12(4), 254-260. Crossref
- Memon, A. H and Rahman, I. A. (2013). Analysis of Cost Overrun Factors for Small Scale Construction Projects in Malaysia Using PLS-SEM Method. Modern Applied Science; 7(8), 74-88. Crossref
- Memon, A., Abdul Rahman, I., and Abdul Aziz, A. (2011), Preliminary Study on Causative Factors Leading to construction Cost Overrun. International journal of Sustainable Construction Engineering and Technology, 2 (1), 57-71.
- Miles, M.B and Huberman, M. A (1994). Qualitative Data Analysis: A Methods Sourcebook. SAGE
- Mingers, J. (1997). Multi-paradigm methodology, in Mingers, J. and Gill, A. (eds) Multimethodology: The Theory and Practice of Combining Management Science Methodologies, Wiley, Chichester, 1–20.
- Morris, S. (1990). “Cost and Time Overruns in Public Sector Projects”. Economic and Political Weekly, 47,154 to 168. Indian Institute of Management, Ahmedabad
- Nune, I. (2013). Critical Realist Activity Theory: An Engagement with Critical Realism and Cultural-historical Activity Theory. Routledge Crossref
- Odeck, J. (2004). Cost overruns in road construction: What are their sizes and determinants? Journal of Transport Policy (11)43–53.
- Panas, A. and Pantouvakis, J. P. (2010). Evaluating Research Methodology in Construction Productivity Studies. The Built and Human Environment Review, 3(1), 63-85.
- Rooke, J. and Kagioglou, M. (2007). Criteria for evaluating research: the unique adequacy requirement of methods. Construction Management and Economics, 25(9):979-987. Crossref
- Sharma, S and Goyal, P, D. (2014). Cost Overrun Assessment Model in Fuzzy Environment. American Journal of Engineering Research, 3(7), 44-53.
- Trost, S., M., and Oberlender, G., D. (2003). Predicting the Accuracy of Early Cost Estimates Using Factor Analysis and multivariate Regression. Journal of construction Engineering and Management, 129 (2), 198-204. Crossref
- Ubani, E.C. (2015). Analysis of Factors Responsible for Project Cost Underestimation in Nigeria. International Journal of Economics, Commerce and Management. 3(2), 1-12.