Information Systems Review (경영정보학연구)

The Korea Society of Management Information Systems (한국경영정보학회)
권호 표지

Establishing the Importance Weight Model of IT Investment Evaluation Criteria through AHP Analysis

AHP 기법을 적용한 IT프로젝트 사전타당성 평가항목의 가중치 산출

  • Published : 2006.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

The purpose of this research is to identify the major evaluation criteria of IT investment projects and establish the importance weights of criteria through AHP analysis. Seven evaluation criteria which have been drawn from prior studies and industry practices are direct costs, indirect costs, financial benefits, strategic value, risk, technical necessity, and political considerations. Data have been collected from 95 IT projects in 40 public organizations and private firms in Korea. After having applied the data reliability test, 79 projects have been selected. The results of AHP analysis show the importance weights and priorities of seven evaluation criteria as follows: financial benefits 25.2%, strategic value 22.36%, direct costs 14.34%, risk 12.10%, technical necessity 11.55%, political considerations 8.3%, and indirect costs 6.48%. And the weights of seven criteria shows considerable differences among three different IT project types such as transactional, informational, and infrastructural.

본 연구는 IT프로젝트 사전타당성 평가항목을 도출하고, 각 평가항목의 가중치를 AHP 기법에 의하여 산출하였으며, 3개 IT프로젝트 유형에 따른 평가항목별 가중치 차이를 통계적으로 검증하였다. 국내 민간기업 및 공공조직에서 제안된 79개 IT프로젝트에 대한 AHP 조사에서 7개 평가항목의 가중치는 재무적 효과 25.14%, 전략적 가치 22.34%, 직접비용 14.44%, 리스크 12.05%, 기술적 필요성 11.50%, 정치적 고려 8.26%, 간접비용 6.41%로 나타났다. 예상대로 재무적 효과, 전략적 가치, 직접비용의 가중치가 높게 나타난 반면, 최근의 TCO 모델이나 이론적 연구에서 중시되고 있는 간접비용이 실무현장에서는 그다지 중요하게 고려되지 않는 것으로 나타났다. 특히 대부분 신규 IT투자에서 실질적으로 가장 민감하게 영향을 미치고 있다고 간주되는 CEO 관심, 현업부서장의 추진의지 등과 같은 정치적 고려항목이 낮게 나타난 것은 의외의 현상이며, 그 원인에 대한 체계적 분석을 향후 연구과제로 제안한다. 그리고 ANOVA 분석 결과 거래처리형, 정보제공형, 인프라형 3개 프로젝트 유형별로 평가항목 가중치가 다른 것으로 분석되었다.

Keywords

References

  1. 이국희 , 'Balanced Scorecard 모형에 의한 정보화 투자효과 분류 및 측정', 데이터베이스 저널, 제5권, 제1호, 1998, pp.69-84
  2. 이국희, 'IT프로젝트 규모와 유형에 따른 IT투자 의사결정기준의 차이', Journal of Information Technology Applications & Management, 2005
  3. 이국희, 구본재, 'IT프로젝트 유형과 오우너쉽이 IT 가치평가에 미치는 영향', Journal of Information Technology Applications & Management, 제9권, 제3호, 2002, pp. 79-95
  4. 이석준, '정보화 비용/이익 분석요인에 대한 인식도 연구', 경영정보학연구, 제13권, 제2호, 2003, pp. 67-84
  5. Au, Y.A. and R.J. Kauffman, 'What do you know? Rational Expectations in Information Technology Adoption and Investment', Journal of Management Information Systems, Vol.20, No. 2, 2003, pp. 49-76 https://doi.org/10.1201/1078/43204.20.2.20030301/41470.8
  6. Bacon, C.J., 'The use of Decision Criteria in Selecting Information Systems/Technology Investments', MIS Quarterly, Vol.16, No.3, 1992, pp. 335-353 https://doi.org/10.2307/249532
  7. Bannister, F. and D. Remenyi, 'Value Proposition in IT Investment Decisions', The Electronic Journal of Information Systems Evaluation, Vol.4, No.1, 1999
  8. Bannister, F. and D. Remenyi, 'Acts of Faith: Instinct, Value and IT Investment Decisions', Journal of Information Technology, Vol.15, 2000, pp. 231-241 https://doi.org/10.1080/02683960050153183
  9. Barua, A., C.H. Kriebel, and T. Mukhopadhyay, 'Information Technologies and Business Value: An Analytic and Empirical Investigation', Information Systems Research, Vol.6, No.1, 1995, pp. 3-23 https://doi.org/10.1287/isre.6.1.3
  10. Barua, A., P. Konana, A. Whinston, and F. Yin, 'An Empirical Investigation of Net-enabled Business Value', MIS Quarterly, Vol.28, No.4, 2004, pp. 585-620 https://doi.org/10.2307/25148656
  11. Benaroch, M., 'Managing Information Technology Investment Risk: A Real Option Perspective', Journal of Management Information Systems, Vol.19, No.2, 2002, pp. 43-84 https://doi.org/10.1201/1078/43202.19.4.20020901/38833.5
  12. Brynjolfsson, E. and Hitt, L., 'Beyond the Productivity Paradox: Computers are the Catalyst for Bigger Changes', Communications of the ACM, Vol.41, 1998, pp. 49-55
  13. Chan, Y.E., 'IT Value: The Great Divide between Qualitative and Quantitative and Individual and Organizational Measures', Journal of Management Information Systems, Vol.16, No. 4, 2000, pp. 225-261 https://doi.org/10.1080/07421222.2000.11518272
  14. Clemons, E.K. and B. Gu, 'Justifying Contingent Information Technology Investments: Balancing the Need for Speed of Action with Certainty before Action', Journal of Management Information Systems, Vol.20, No.2, 2003, pp. 11-48 https://doi.org/10.1080/07421222.2003.11045763
  15. Davern, M.J. and R.J. Kauffman, 'Discovering Potential and Realizing Value from Information Technology Investments', Journal of Management Information Systems, Vol.16, No. 4, 2000, pp. 121-143 https://doi.org/10.1080/07421222.2000.11518268
  16. Dehning, B., V. Richardson, and R. Zmud, 'The Value Relevance of Announcements of Transformational Information Technology Investments', MIS Quarterly, Vol.27, No.4, 2003, pp. 637-656 https://doi.org/10.2307/30036551
  17. DeLone, W. and E. McLean, 'Information Systems Success: The Quest for the Dependent Variable', Information Systems Research, Vol.3, No.1, 1992, pp. 60-95 https://doi.org/10.1287/isre.3.1.60
  18. DeLone, W. and E. McLean, 'The DeLone and McLean Model of Information Systems Success: A Ten Year Upgrade', Journal of Management Information Systems, Vol.19, No.4, 2003, pp. 9-30 https://doi.org/10.1080/07421222.2003.11045748
  19. Devaraj, S. and R. Kohli, 'Information Technology Payoff in the Health-care Industry: A Longitudinal Study', Journal of Management Information Systems, Vol.16, No.4, 2000, pp. 41-68 https://doi.org/10.1080/07421222.2000.11518265
  20. Erickson, J., 'The Total Economic Impacts of Network Appliance's Solution Relating to Business Continuance', Giga Information Group Whitepaper, 2002
  21. Escobar, P.B., 'Information Systems Investment Decisions in Business Practice: The Spanish case', European Journal of Information Systems, Vol.7, 1998, pp. 202-209 https://doi.org/10.1057/palgrave.ejis.3000303
  22. Ezingeard, J.-N., Z. Irani, and P. Race, 'Assessing the Value and Cost Implications of Manufacturing Information and Data Systems: An Empirical Study', Europeon Journal of Information Systems, Vol.7, 1998, pp. 252-260 https://doi.org/10.1057/palgrave.ejis.3000309
  23. GAO, A Framework for Assessing and Improving Process Maturity, U.S.A. GAO, 2000
  24. Gerald, V., K. Albert, and N. Kin, 'A Modeling Approach to Evaluating Strategic Uses of Information Technology', Journal of Management Information Systems, Vol.12, No.2, 1995, pp. 161-187 https://doi.org/10.1080/07421222.1995.11518085
  25. Griffiths, G. and P. Finlay, 'IS-enabled Sustainable Competitive Advantage in Financial Services, Retailing and Manufacturing', Strategic Information Systems, Vol.13, No.1, 2004, pp. 29-59 https://doi.org/10.1016/j.jsis.2004.03.002
  26. Gurbaxani, G.V. and K. Kraemer, 'A Process Oriented Framework for Assessing the Business Value of Information Technology', The DATA BASE for Advances in Information Systems, Vol.27, No.2, 1996, pp. 68-81 https://doi.org/10.1145/243350.243363
  27. Hitt, L. and E. Brynjolfsson, 'Productivity, Business Profitability, and Consumer Surplus: Three Different Measures of Information Technology Value', Journal of Management Information Systems, Vol.20, No.2, 1996, pp. 121-142 https://doi.org/10.2307/249475
  28. Hitt, L., D. Wu, and X. Zhou, 'Investment in Enterprise Resource Planning: business impact and Productivity Measures', Journal of Management Information Systems, Vol.19, No.1, 2002, pp. 71-98 https://doi.org/10.1201/1078/43199.19.1.20020101/31479.10
  29. Hubbard, D., 'The IT Measurement Inversion: Are your IT Investment Decisions based on the Right Information-', CIO Magazine, April 1999
  30. Johnson, J., 'Chaos: The Dollar Drain of IT Project Failures', Application Development Trends, Vol.2, No.1, 1995, pp. 41-47
  31. Johnson, V., 'Intuition in Decision Making', Successful Meeting, 1993, pp. 148-151
  32. Jones, S. and J. Hughes, 'Understanding IS Evaluation as a Complex Social Process: A Case Study of a UK Local Authority', European Journal of Information Systems, Vol.10, 2001, pp. 189-203 https://doi.org/10.1057/palgrave.ejis.3000405
  33. Karahanna, E., D. Straub, and N. Chervany, 'Information Technology Adoption Across Time: A Cross-sectional Comparison of Pre-adoption and Post-adoption Beliefs', MIS Quarterly, Vol.23, No.2, 1999, pp. 183-213 https://doi.org/10.2307/249751
  34. Kohli, R. and S. Devaraj, 'Measuring Information Technology Payoff: A Meta-analysis of Structural Variables in Firm-level Empirical Research', Information Systems Research, Vol.14, No.2, 2003, pp. 127-145 https://doi.org/10.1287/isre.14.2.127.16019
  35. Kowtha, N. and T. Choon, 'Determinants of Web-site Developments: A Study of Electronic Commerce on Singapore', Information & Management, Vol.39, No.3, 2001, pp. 227-242 https://doi.org/10.1016/S0378-7206(01)00092-1
  36. Kuan, K. and P. Chau, 'A Perception-based Model for EDI Adoption in Small Business using a Technology-Organization-Environment Framework', Information & Management, Vol.38, No.8, 2001, pp. 507-512 https://doi.org/10.1016/S0378-7206(01)00073-8
  37. Lincoln, T., Managing Information Systems for Profit, London: John Wiley and Sons, 1990
  38. Lucas, H., Information Technology and the Productivity Paradox, New York: Oxford University Press, 1999
  39. McFarlan, F., D. Robert, and L. Applegate, Corporate Information Strategy and Management, McGraw Hill, 2002
  40. Melville, N., K. Kraemer, and V. Gurbaxani, 'Review: Information Technology and Organizational Performance: An Integrative Model of IT Business Value', MIS Quarterly, Vol.28, No.2, 2004, pp. 283-322 https://doi.org/10.2307/25148636
  41. Menon, N., B. Lee, and L. Eldenburg, 'Productivity of Information Systems in the Healthcare Industry', Information System Research, Vol.11, No.1, 2000, pp. 83-92 https://doi.org/10.1287/isre.11.1.83.11784
  42. Motilevi, P., R. Kleindorfer, and D. Wu, 'Codifiability, Relationship-Specific Information Technology Investment, and Optimal Contracting', Journal of Management Information Systems, Vol.20, No.2, 2003, pp. 77-98 https://doi.org/10.1201/1078/43647.20.4.20030901/77296.11
  43. Murphy, T., Achieving Business Value From Technology, NY: John Wiley & Sons, 2003
  44. Niven, P.R., 정부와 공공부문 BSC: 성과관리체계 구축방법론, 삼일 PwC컨설팅, 2005
  45. Parker, M. and R. Benson, Information Economics: Linking Business Performance to Information Technology, Englewood Cliffs, NJ: Prentice-Hall, 1988
  46. Post, G., A. Kagan, and K. Lau, 'A Modeling Approach to Evaluating Strategic Uses of Information Technology', Journal of Management Information Systems, Vol.12, No.2, 1995, pp. 161-187 https://doi.org/10.1080/07421222.1995.11518085
  47. Remenyi, D., 'Ten Common Information Systems Mistakes', Journal of General Management, Vol.21, No.4, 1996, pp. 78-91 https://doi.org/10.1177/030630709602100406
  48. Remenyi, D., A. Money, and M. Sherwood-Smith, Effective Measurement & Management of IT Costs & Benefits (Second Edition), Oxford: Butterworth-Heinemann, 2000
  49. Remenyi, D., A. Money, and A. Twite, The Effective Measurement and Management of IT Costs and Benefits, Oxford: Jordan Hill, 1995
  50. Riemenschneider, C., D. Harrison, and P. Mykytyn, 'Understanding IT Adoption Decisions in Small Business: Integrating Current Theories', Information & Management, Vol.40, 2002, pp. 269-285 https://doi.org/10.1016/S0378-7206(02)00010-1
  51. Ryan, S. and D. Harrison, 'Considering Social Subsystem Costs and Benefits in Information Technology Investment Decisions: A View from the Field on Anticipated Payoffs', Journal of Management Information Systems, Vol.16, No.4, 2000, pp. 11-40 https://doi.org/10.1080/07421222.2000.11518264
  52. Ryan, S., D. Harrison, and L. Schkade, 'Information Technology Investment Decisions: when do Costs and Benefits in the Social Subsystem Matter?', Journal of Management Information Systems, Vol.19, No.2, 2002, pp. 85-127 https://doi.org/10.1201/1078/43200.19.2.20020228/35142.8
  53. Sabherwal, R. and W. King, 'Towards a Theory of Strategic Use of Information Resource', Information & Management, Vol.20, No.3, 1991, pp. 191-212 https://doi.org/10.1016/0378-7206(91)90055-7
  54. Saaty, T.L., The Analytic Hierarchy Process, New York: McGraw Hill, 1980
  55. Saaty, T.L., 'How to Make a Decision: The Analytic Hierarchy Process', European Journal of Operation Research, Vol.48, 1990, pp. 9-26 https://doi.org/10.1016/0377-2217(90)90057-I
  56. Segars, A. and V. Grover, 'Strategic Information Systems Planning Success: An Investigation of the Construct and Measurement', MIS Quarterly, Vol.22, No.2, 1996, pp. 139-163 https://doi.org/10.2307/249393
  57. Serafeimidis, V. and S. Smithson, 'Information Systems Evaluation in Practice: A Case Study of Organizational Change', Journal of Information Technology, Vol.15, 2000, pp. 93-105 https://doi.org/10.1080/026839600344294
  58. Sircar, S., J. Turnbow, and B. Bordoloi, 'A Frame-work for Assessing the Relationship between Information Investments and Firm Performance', Journal of Management Information Systems, Vol.16, No.4, 2000, pp. 69-97 https://doi.org/10.1080/07421222.2000.11518266
  59. Smithson, S. and R. Hirschheim, 'Analyzing Information Systems Evaluation: Another Look at an Old Problem', European Journal of Information Systems, Vol.7, 1998, pp. 158-174 https://doi.org/10.1057/palgrave.ejis.3000304
  60. Street, C. and D. Meister, 'Small Business Growth and Internal Transparency: The Role of Information Systems', MIS Quarterly, Vol. 28, No. 4, 2004, pp. 473-506 https://doi.org/10.2307/25148647
  61. Tallon, P., K. Kraemer, and V. Gurbaxani, 'Executives Perceptions of the Business Value of Information Technology: A Process-oriented Approach', Journal of Management Information Systems, Vol.16, No.4, 2000, pp. 145-173 https://doi.org/10.1080/07421222.2000.11518269
  62. Thatcher, M. and D. Pingry, 'An Economic Model of Product Quality and IT value', Information Systems Research, Vol.15, No.3, 2004, pp. 268-286 https://doi.org/10.1287/isre.1040.0029
  63. Tingling, P. and M. Parent, 'An Exploration of Enterprise Technology Selection and Evaluation', The Journal of Strategic Information Systems, Vol.13, No.4, 2004, pp. 329-354 https://doi.org/10.1016/j.jsis.2004.11.003
  64. Weill, P. and S. Aral, 'Managing the IT Portfolio', CISR Research Report, 2003
  65. Weill, P. and M. Broadbent, Leveraging the New Infrastructure: how Market Leaders Capitalize on Information Technology, Boston: Harvard Business School Press, 1998
  66. Weill, P. and M. Olson, 'Managing Investment in Information Technology: Mini Case Examples and Implications', MIS Quarterly, Vol.13, No.1, 1989, pp. 2-16
  67. Wheeler, B., 'Nebic: A Dynamic Capabilities Theory for Assessing Net-Enablernent', Information Systems Research, Vol.13, No.2, 2002, pp. 125-146 https://doi.org/10.1287/isre.13.2.125.89
  68. Wilson, M. and D. Howcroft, 'Power, Politics, and Persuasion in IS Evaluation: A Focus on 'Relevant Social Groups', The Journal of Strategic Information Systems, Vol.14, No.1, 2005, pp. 17-43 https://doi.org/10.1016/j.jsis.2004.11.007
  69. Willcocks, L. and S. Lester, 'Information Systems Investments: Evaluation at the Feasibility Stage of the Projects', Technovation, Vol.11, No.5, 1991, pp. 283-302 https://doi.org/10.1016/0166-4972(91)90027-2
  70. Zhu, K., 'The Complementary of IT Infrastructure and e-Commerce Capability: A Resource-based Assessment of Their Business Value', Journal of Management Information Systems, Vol.21, No.1, 2004, pp. 167-202 https://doi.org/10.1080/07421222.2004.11045794
  71. Zhu, K., K. Kraemer, S. Xu, and J. Dedrick, 'Information Technology Payoff in E-Business Environments: an International perspective on value Creation of E-Business in the Financial Service Industry', Journal of Management Information Systems, Vol.21, No.1, 2001, pp. 17-54