Journal of the Korean society of supply chain management (한국SCM학회지)

Korean Society for Supply Chain Manamement (한국SCM학회)
권호 표지

Development of Performance Evaluation Model for SCM Systems and AHP Analysis of Evaluation Items

SCM 시스템 성과 평가모형 개발 및 평가항목별 AHP 분석

  • Park, Il-Kyu (Department of Management Information Systems, The Graduate School of Kwangwoon University) ;
  • Kim, Sang-Hoon (Department of Management Information Systems, The Graduate School of Kwangwoon University)
  • 박일규 (광운대학교 대학원 경영정보학과) ;
  • 김상훈 (광운대학교 대학원 경영정보학과)
  • Published : 2011.05.31
⟨ Previous Next ⟩

Abstract

The objective of this research is to develop performance evaluation model for SCM(Supply Chain Management) systems aiming at optimizing internal and external logistics systems, production, flow of resources and finances, and to establish weight values for performance evaluation items. Through reviewing and interrelating a vast range of related theoretical studies the integrative evaluation model for SCM systems performance was derived, and then the weight value as relative importance to SCM systems performance was determined for each evaluation area and item by means of AHP(Analytic Hierarchy Process) analysis. The data for AHP analysis were collected by surveying 15 SCM systems experts from academic and corporate sectors. The performance evaluation model for SCM systems could be reasoned to consist of three evaluation areas(technological quality, task efficiency and organizational outcome) and nine evaluation items(system quality, information quality, service quality, contributiveness to task efficiency, users' satisfaction and four BSC items). The results of AHP analysis shows that each evaluation area and item have significantly different weight value. By applying the integrative evaluation model suggested in this study and the weight values of evaluation areas and items identified via AHP analysis, the performance evaluation of SCM systems will be able to be done more correctly and meaningfully. Also, the development and application of this rational performance evaluation methodology will lead to effective management of SCM systems.

Keywords

References

  1. 강동석, 유시형(2009), "공공정보시스템 효과성 측정지표의 타당성 검증에 관한 연구 -행정정보DB구축사업을 중심으로-", 정보처리학회 논문지D, 제16권, 제3호, pp.417-422.
  2. 강성배, 문태수, 정윤(2010), "참여자관점에서 공급사슬관리 시스템의 성공에 영향을 미치는 요인에 관한 실증연구", Asia Pacific Journal of Information Systems, 제20권, 제3호, pp.139-166.
  3. 김창봉, 배영진(2010), "국내 제조기업의 SCM구축 성과에 관한 실증 연구", e-비즈니스연구, 제11권, 제1호, pp.25-44.
  4. 나승화(2006), "SCM 시스템 특성이 마케팅 성과에 미치는 영향", 한국유통과학회.중국청도과기대학 2006년 공동국제학술대회 논문집, pp.315-337.
  5. 문태수, 강성배, 정주익(2006), "SCOR 모델을 활용한 자동차부품산업의 공급망관리(SCM) 시스템 설계 및 구현", 인터넷전자상거래연구, 제6권, 제1호, pp.261-285.
  6. 박기남(2006), "사례기반추론을 이용한 정보시스템 가치평가 모형개발에 관한 연구", 정보시스템연구, 제15권, 제2호, pp.95-123.
  7. 박성순, 유은정(2004), "기업정보화 핵심업무 활동 선정을 위한 IT의존도 결정 모델에 관한 연구", 대한산업공학회 2004년 추계학술대회 논문집, pp.1-8.
  8. 박연우, 이정희(2004), "SCM 성과측정과 성공요인에 관한 연구", 한국유통학회 2004년 동계학술대회 논문집, pp.123-152.
  9. 서울특별시(2003), Intelligent City Seoul 2006: 서울정보화 마스터플랜, pp.1-166.
  10. 이판수(2007), "ERP시스템의 도입특성이 공기업 성과에 미치는 영향에 관한 연구", 경영교육저널, 제11권, pp.163-179.
  11. 장형욱, 이상식(2006a)," 공급사슬내IT 활동과SCM 활동이 경영성과에 미치는 영향에 관한 연구", 한국경영정보학회 2006년 춘계학술대회 논문집, pp.743-750.
  12. 장형욱, 이상식(2006b)," SCM의핵심성공요인(CSF)이경영 성과에 미치는 영향에 관한 연구", 대한경영학회지, 제19권, 제6호, pp.2561-2584.
  13. 정해용, 김상훈(2003)," 정보시스템 평가지표개발에 관한 실증적 연구: 공공부문을 중심으로", 한국경영과학회지, 제28권, 제4호, pp.155 -189.
  14. 최경현, 남지영(2005), "정보기술 성과 평가 모델에 관한 연구", Journal of the Society of Korea Industrial and Systems Engineering, 제28권, 제3호, pp.121-132.
  15. 한국정보사회진흥원(2008), 범정부 성과참조 모델 1.1.
  16. Adams, Dennis A., Nelson, R. Ryan and Todd, Peter A.(1993), "A comparative evaluation of the impact of electronic and voice mail on organizational communication", Information & management, Vol.24, No.1, pp.9-21. https://doi.org/10.1016/0378-7206(93)90043-S
  17. Agarwal, R. and Karahanna, E.(2000), "Time Flies When You're Having Fun : Cognitive Absorption and Beliefs about Information Technology Usage", MIS Quarterly, Vol.24, No.4, pp.665-694. https://doi.org/10.2307/3250951
  18. Borovits, I. and Ein-Dor, P.(1977), "Cost/Utilization: A Measure of System Performance", Communications of the ACM, Vol.20, No.3, pp.185-191. https://doi.org/10.1145/359436.359452
  19. Chandler, J. S.(1982), "A Multiple Criteria Approach for Evaluating Information Systems", MIS Quarterly, Vol.6, No.1, pp.61-74. https://doi.org/10.2307/248755
  20. Davis, F. D.(1989), "Perceived usefulness, perceived ease of use, and user acceptance of information technology", MIS Quarterly, Vol.13, No.3, pp.319-340. https://doi.org/10.2307/249008
  21. DeLone, W. H. and McLean, E. R.(1992)," Information Systems Success: The Quest for the Dependent Variable", Information Systems Research, Vol.3, No.1, pp.60-95. https://doi.org/10.1287/isre.3.1.60
  22. DeLone, W. H. and McLean, E. R.(2002)," Information Systems Success Revisited", Proceedings of the 35th Annual Hawaii International Conference System Sciences on 2002, pp.3057-3067.
  23. DeLone, W. H., and McLean, E. R.(2003)," The DeLone and McLean Model of Information Systems Success: A Ten-Year Update", Journal of Management Information Systems, Vol.19, No.4, pp.9-30. https://doi.org/10.1080/07421222.2003.11045748
  24. Doll, W. J. and Torkzadeh, G.(1991), " The Measurement of End-User Computing Satisfaction", MIS Quarterly, Vol.12, No.2, pp.259-274.
  25. Edberg, S. C.(1997), "Are there human indicators of emerging public health threat?", In Under the Microscope-Examining Microbes in Ground Water Awwa Research Foundation Conference, Boston, Lincoln, Nebraska.
  26. Eickelmann, N.(2001)," A Comparative analysis of the Balanced Scorecard as Applied in Government and Industry Organizations", Information Technology Evaluation Methods & Management, In Grembergen, W. V.(Org.) Hershey: Idea Group Publishing.
  27. Franz, C. R. and Robey, D.(1986), "Organizational Contexts, User Involvement and the Usefulness of Information Systems", Decision Sciences, Vol.17, No.3, pp.329-356. https://doi.org/10.1111/j.1540-5915.1986.tb00230.x
  28. Hamilton, S. and Chervany, N. L.(1981a)," Evaluating Information System Effectiveness. PartI. Comparing Evaluation Approaches", MIS Quarterly, Vol.5, No.3, pp.55-69. https://doi.org/10.2307/249291
  29. Hamilton, S. and Chervany, N. L.(1981b)," Evaluating Information system Effectiveness. Part II. Comparing Evaluator Viewpoints", MIS Quarterly, Vol.5, No.4, pp.79-86.
  30. Hitt, L. and Brynjolfsson, E.(1996), "Productivity, Business Profitability, and Consumer Surplus: Three Different Measures of Information Technology Value", MIS Quarterly, Vol.20. No.2, pp.121-136. https://doi.org/10.2307/249475
  31. Hurtado, C. D(1978), "EDP Effectiveness Evaluation", Journals of Systems Management, pp.18-21.
  32. Ives, B. and Olson, M. H.(1983)," The Measurement of User Information Satisfaction", Communications of the ACM, Vol.26, No.10, pp.785-793. https://doi.org/10.1145/358413.358430
  33. Kaplan, R. S. and Norton, D. P.(1992)," The Balanced Scorecard-Measures That Drive Performance", Harvard Business Review, Vol.70, No.1, pp.71-79.
  34. Kaplan, R. S. and Norton, D. P.(1996), "Linking the Balanced Scorecard to Strategy", California Management Review, Vol.39, No.1, pp.53-79. https://doi.org/10.2307/41165876
  35. Kaplan, R. S. and Norton, D. P.(2005)," The Balanced Scorecard: Measures That Drive Performance", Harvard Business Review, Vol.83, No.7, pp.172-180.
  36. Kettinger, William J. and Lee, Choong C.(1994), "Perceived Service Quality and User Satisfaction with the Information Services Function", Decision Sciences, Vol.25, No.5, pp.737-766. https://doi.org/10.1111/j.1540-5915.1994.tb01868.x
  37. Legris, P., Ingham, J. and Collerette, P.(2003)," Why do people use information technology? A critical review of the Technology Acceptance Model", Information and Management, Vol.40, No.3, pp.191-204. https://doi.org/10.1016/S0378-7206(01)00143-4
  38. Lucas, Robert C.(1972), "Expectations and the Neutrality of Money", Journal of Economic Theory, Vol.4, pp.103-124. https://doi.org/10.1016/0022-0531(72)90142-1
  39. Lucas, Robert C.(1978)," Asset Prices in an Exchange Economy", Econometrica, Vol.46, No.6, pp.1429-1445. https://doi.org/10.2307/1913837
  40. Mason, R. O.(1978)," Measuring Information Output : A Communication Systems Approach", Information & Management, Vol.1, No.5, pp.219-234.
  41. Mentzer, J., DeWitt, W., Keebler, J., Min, S., Nix, N., Smith, C. and Zacharia, Z.(2001), "Defining Supply Chain Management", Journal of Business Logistics, Vol.22, No.2, pp.1-25. https://doi.org/10.1002/j.2158-1592.2001.tb00001.x
  42. Meyerson, A.(2001), Online facility location. In Proc. FOCS.
  43. Myers, B. L., Kappelman, L. A. and Prybutok, V. R.(1997), "A Comprehensive Model for Assessing the Quality and Productivity of the Information Systems Function : Toward a Theory for Information Systems Assessment", Information Resource Management Journal, Vol.10, No.1, pp.6-25. https://doi.org/10.4018/irmj.1997010101
  44. Pitt, L. F. and R. T. Watson(1995)," Service Quality: A Measure of Information Systems Effectiveness", MIS Quarterly, Vol.19, No.2, pp.173-187. https://doi.org/10.2307/249687
  45. Pitt, Leyland, Watson, Richard, and Kavan, C.(1997), "Measuring Information Systems Service Quality: Concerns for a Complete Canvas", MIS Quarterly, Vol.21, No.2, pp.167-182.
  46. Porter, M. E. and Millar, V. E.(1985)," Technology and Competitive Advantage", Harvard Business Review, Vol.63, No.4, pp.149-160.
  47. Rai, A. and Lang, S. S.(2002)," Assessing the Validity of IS Success Models: An Empirical Test and Theoretical Analysis", Information Systems Research, Vol.13, No.1, pp.50-69. https://doi.org/10.1287/isre.13.1.50.96
  48. Saaty, T. L.(1980), The AHP : Planning, Priority Setting, Resource Allocation, McGraw-Hill, New York.
  49. Saunders, C. S. and Jones, J. W.(1992), "Measuring Performance of the Information Systems Function", Journal of MIS, Vol.8, No.4, pp.63-82.
  50. Seddon, P. B. and Kiew, M. Y.(1994)," A Partial Test and Development of the DeLone and McLean Model of IS Success", Proceedings of the Fifteenth International Conference on Information Systems, pp.99-110.
  51. Seddon, P. B.(1997), "A Respecification and Extension of the DeLone and McLean Model of IS Success", Information Systems Research, Vol.8, No.3, pp.240-253. https://doi.org/10.1287/isre.8.3.240
  52. Shannon, C. E. and Weaver, W.(1949), The mathematical theory of information, Urbana: University of Illinois Press.
  53. Singleton, C. E., McLean, E. R. and Altman, E. R. (1988), "Measuring Information Systems Performance : Experience with the Management by Results System at Security Pacific Bank", MIS Quarterly, Vol.12, No.2, pp.325-337. https://doi.org/10.2307/248857
  54. Supply Chain Council(2008), Supply Chain Operations Reference Model Version 9.0, Pittsburgh, PA.
  55. Sutton, R. H. and Mathis, R. L.(1979), "Performance Appraisal - Part1", Journal of Systems Management, Vol.30, No.6, pp.16-18.
  56. Swanson, E. Burton(1974), "Management Information Systems: Appreciation and Involvement", Management Science, Vol.21, No.2, pp.178-188. https://doi.org/10.1287/mnsc.21.2.178
  57. Van Grembergen, W. and Saull, R.(2001), "Aligning business and information technology through the balanced scorecard at a major Canadian financial group: its status measured with an IT BSC maturity model", Proceedings of Hawaii International Conference on System Sciences, Maui, Hawaii, pp.1-10.
  58. Watson, R. T., Pitt, L. F. and Kavan, C. B.(1998), "Measuring information systems service quality: Lessons from two longitudinal case studies", MIS Quarterly, Vol.22, No.1, pp.61-79. https://doi.org/10.2307/249678