Journal of the Korean Society for information Management (정보관리학회지)

Korean Society for Information Management (한국정보관리학회)
권호 표지

A Comparative Study of Evaluation Factors on Information Systems between the User and the Developer

정보시스템 개발자와 이용자 간의 평가요소에 대한 비교 연구

  • Published : 1996.06.01
Download PDF
⟨ Previous Next ⟩

Abstract

The purpose of the study is to set up factors for evaluating information systems which can meet both users' and developers' needs. These factors can be used as a framework in developing successful information systems. To achieve this purpose factors are selected first from the literature review by the previous studies. Then two different questionnaires based on selected factors were made up and distributed to two separate groups; users and developers. It appeared that there are significant differences on ranking and weighting for evaluation factors of information systems between the user and the developer. 185 factors for evaluating information systems are divided into 9 criteria based on their roles. There are significant differences on ranking under 6 out of 9 evaluation criteria between two groups. These are 'effectiveness', 'usability', 'user friendliness', 'documentation', 'output', 'maintenance'. However, there are no significant differences on factors in 'performance', 'developer', and 'user satisfaction' criteria. As a result of the study 185 factors for evaluating information systems were presented with rank.

본 연구는 정보시스템 개발자와 이용자의 요구를 충족시킬 수 있는 정보시스템의 평가요소를 정립하기 위하여 수행되었다. 평가요소들은 선행연구에서 우선적으로 추출되고 추출된 요소는 성능, 효율성을 비롯한 9개집단으로 구분되었다. 각 기준별 평가요소를 중심으로 문항을 작성하여 개발자 집단과 이용자 집단에게 배포되어 개발자 및 이용자가 중요시하는 요소들에 있어서 차이를 밝히고 우선순위를 부여하였다. 순위부여결과 185개 시스템 평가요소에 대한 우선순위의 부여에 있어서 이용집단과 개발자집단 사이에 명확한 차이가 나타났다.

Keywords

References

  1. 한국경영과학회지 v.19 no.2 소프트웨어 도입을 위한 기술성 평가모형 김병록;이주헌
  2. 도서관학·정보학용어 사전 사공철(등편)
  3. 산업과 경영 v.29 no.1 정보시스템평가에 있어서 개념의 변화 박창래
  4. 소프트웨어 자동생산기술에 관한연구 : 소프트웨어 개발 및 관리체계 개발에 관한 연구 이단형(외)
  5. Comp. Surv. v.14 no.2 Validation,verification, and testing of computer software Adrion,W.R.(et al.)
  6. American National Standard for Information System : data communication systems and services : measurement method for user-oriented performance parameters(ANSI X3. 102-1992) American National Standard Institute
  7. Datamation Software quality measurement Arthur,Jay
  8. Structured analysis and design of information systems Atkas,A.Ziya
  9. Comm. of the ACM v.29 no.3 an Empirical study of the impact of user involvement on system usage and information satisfaction Baroudi,J.(et al.)
  10. IEEE Computer v.24 no.9 the Future engineering of software : a Management perspective Basili,V.R.;J.D.Musa
  11. Ann. Rev. of Info. Sci. and Technol. v.25 Information models and modelong techiques for IS Burt,P.V.;Mark,T.Kinnucan
  12. Info. & Mgmt v.22 Factors that affect user friendliness in interactive computer programs Carr,H.H.
  13. Omega v.22 no.5 Experience with a structure, process and outcome framework for evaluating an information system Conford,T.(et al.)
  14. Comm. of the ACM v.34 no.9 On building systems that will fail Corbato,F.
  15. Info. & Mgmt v.23 Diagnosis of an IS failure : Framework and interpretive process Davis(et al.)
  16. J. of Sys. Mgmt v.34 no.6 Management user expectations Doll,W.J.;M.J.Ahmed
  17. Mgmt Sci. v.27 no.4 Early diagnosis of MIS implementation failure : Promising results and unanswered question Ginzberg,M.J.
  18. Comm. of the ACM v.27 no.10 Building a user-derived interface Good M.D.(et al.)
  19. MIS Quarterly v.5 no.4 Evaluation information system effectiveness, part Ⅱ: Comparing evaluator view-points Hamilton,S.;N.L.Chervany
  20. Ann. Rev. of Info. Sci. and Techol. v.20 Online Public Access Catalogs Hidreth,C.
  21. ISO/IEC CD 12119(E/F) Information Technology : software Packages, Quality Requirements and Testing, 1993
  22. Comm. of the ACM v.26 no.10 the Measurement of user information satisfaction Ives,B.(et al)
  23. IBM Syst. J. v.33 no.1 Software quality : an Overview from the perspective of total quality management Kan,S.H.(et al.)
  24. Mgmt Sci. v.27 no.6 Participative design of strategic decision support systems : An empirical assessment King,W.R.;J.I.Rodriguez
  25. Comm. of the ACM v.33 no.2 Post implementation evaluation of computer-based information systems: Current practices Kumar,K.
  26. MIS Quarterly v.14 no.2 IS cost estimating : a Management perspective Lederer,A.L.(et al.)
  27. Managing Information Services Lucas,H.C., Jr.
  28. Info. Technol. and Lib. v.7 no.2 Response time measurement and performance analysis in public access IR systems Lynch,Clifford A.
  29. Info. & Mgmt v.14 no.1 Expectation failure concept and systems analyst's view of information system failures: Results of an exploratory study Lyytinen,K.
  30. MIS Quarterly v.3 no.1 A user's behavior toward his MIS Maish,A.M.
  31. Info. & Mgmt v.25 Reducing bias in user's evaluation of information systems Mathieson,K.
  32. Info. & Mgmt v.24 Variation in users definitions of an information system Mathieson,K.
  33. Comm. of the ACM v.33 no.3 Improving human-computer dialog Molich,R.;J.Nielsen
  34. Public Administration Review v.51 no.5 Evaluating public sector information systems : More than meets the eye Newcomer,K.E.(et al.)
  35. Comm. of the ACM v.33 no.6 Evaluation of safety-critical software Parnas,D.L.(et al.)
  36. Info. Technol. and Lib. v.7 no.2 Framework for the development of performance measurement standards Peters,Paul E.
  37. Comm. of the ACM v.31 no.5 Factors of success for end-user computing Rivard,S.;S.L.Huff
  38. Comm. of the ACM v.29 no.7 What makes users happy? Rushinek,A.;Sara F.Rushinek
  39. Acad. of Mgmt J. v.19 no.3 the Management information systems users: an Exploratory behavioral analysis Schewe,D.D.
  40. Info. Technol. and Lib. v.7 no.2 Capacity modeling at RLG Schmidt,J.;M.Pobuda
  41. MIS Quarterly v.2 no.2 Management's role in information system development failures: a Case study Schmitt,J.W.;K.A.Kozar
  42. Info. & Mgmt v.20 Productivity measures for information systems Scudder,R.A.;Ronard Kucic
  43. MIS Quarterly v.9 no.3 Alternative measures of system effectiveness : Associations and implications Srinivasan,A.
  44. Human-computer interface design Sutcliffe,Alitair
  45. MIS Quarterly v.17 no.4 the Effects of information system user expectations on their performance and perceptions Szajna,B.;R.W.Scamell
  46. Info. & Mgmt v.24 The place and value of documentaion in end-user computing Torkzadeh,G.;W.J.Doll
  47. JASIS v.31 Information systems design methodology Wasserman,Anthony I.
  48. Webster's New world dictionary of computer terms
  49. Journal of Marketing Research v.10 no.2 Consumer dissatisfaction : the Effect of disconfirmed expectancy on perceived product performance Anderson,R.E.