Journal of the Korean Society for information Management (정보관리학회지)

Korean Society for Information Management (한국정보관리학회)
권호 표지
DOI QR코드

DOI QR Code

User Participation Evaluation of A Scholarly Information Site

학술정보사이트의 이용자 참여형 평가

  • Park, Min-Soo (Knowledge Information Center, Korea Institute of Science and Technology Information)
  • Received : 2011.11.13
  • Accepted : 2011.12.06
  • Published : 2011.12.30
Download PDF
⟨ Previous Next ⟩

Abstract

The purpose of this study was to develop a methodology of user participation evaluation of a scholarly information site in the field of science and technology and to enhance the site by applying a set of testing protocols. Experiments were conducted in a laboratory setting. Data from multiple sources, including eyetracking, search logs and post surveys, were collected and analyzed quantitatively. Based on the results of eyetracking, the contents and images were reorganized after removing unessential elements in the site. The resulting data from the search logs showed that the users were able to finish the tasks more quickly with the revised user interface. The results of the data analysis of post surveys indicated an overall improvement in the revised website compared to the original one.

본 연구의 목적은 과학기술분야 학술정보사이트의 이용자 참여형 평가 방법론을 개발 및 적용시킴으로써 평가사이트를 개선시키는 데 있다. 실험은 통제된 환경에서 이루어졌다. 아이트랙킹, 검색로그, 설문지를 통해 수집한 데이터는 정량적으로 분석하였다. 아이트랙킹 데이터 분석 결과를 토대로, 평가사이트상에서 불필요한 항목을 제거하였고 콘텐츠와 이미지들을 재배열하였다. 검색로그 데이터는 시스템의 효율성이 증가하였음을 보여주고 있다. 설문지 데이터 분석 결과 또한 시스템이 전반적으로 개선하였음을 보여준다.

Keywords

References

  1. Agerfalk, P.J., J. Sjostrom, E. Eliasson, S. Cronholm and G. Goldkuhl. 2002. "Setting the Scene for Actability Evaluation: Understanding Information Systems in Context." Proceedings of ECITE Conference, 2002: 15-16.
  2. Barnes, S.J. and R.T. Vidgen. 2002. "An interactive approach to the assessment of e-commerce Quality." Journal of Electronic Commerce Research, 3(3): 114-127.
  3. Beyer, H. and K. Holtzblatt. 1998. Contextual Design: Defining Customer-Centered Systems. San Diego: Academic Press.
  4. Cronholm, S. and G. Goldhuhl. 2002. "Actable Information Systems-Quality Ideals Put into Practice." Proceedings of the Eleventh Conference on Information Systems IST, 2002: 12-14.
  5. DeLone, W. H. and R.E. Mclean. 1992. "Information Systems Success: The Quest for the Dependent Variable." Information Systems Research, 3(1): 60-95. https://doi.org/10.1287/isre.3.1.60
  6. The International Organization for Standardization. 2002. ISO/TR 16982: Ergonomics of Human-System Interaction-Usability Methods Supporting Human-Centred Design. 1st ed. Geneva, Switzerland
  7. Krug, S. 2000. Don't Make Me Think: A Common Sense Approach to Web Usability. Indianapolis: New Riders.
  8. Lowgren, J. 1993. Human-Computer Interaction - What Every System Developer Should Know. Lund, Sweden, Studentlitteratur.
  9. Monk, A., P. Wright, J. Haber and L. Davenport. 1993. Improving Your Human-Computer Interface: A Practical Technique. New York: Prentice Hall.
  10. Nielsen, J. 1993. Usability Engineering. San Diego: Academic Press.
  11. Nielsen, J. 1994. "How to Conduct A Heuristic Evaluation." Jakob Nielsen's Alertbox. (12 October 2011).
  12. Nielsen, J. 1999. Designing Web Usability: The Practice of Simplicity. Indianapolis: New Riders.
  13. Nielsen, J. 2010. "Scrolling and Attention." Jakob Nielsen's Alertbox. (12 October 2011).
  14. Nielsen, J. and K. Pernice. 2009. Eyetracking Web Usability. Berkeley: New Riders Press.
  15. Preece, J., R. Yvonne, H. Sharp, D. Benyon, S. Holland and T. Carey. 1994. Human-Computer Interaction. London: Addison-Wesley.
  16. Shneiderman, B. and C. Plaisant. 2009. Designing the User Interface: Strategies for Effective User Interface Interaction. 5th ed. Reading, Mass.: Addison-Wesley.
  17. Yarbus, A. L. 1967. Eye Movements and Vision. New York: Plenum Press.

Cited by

  1. A longitudinal study of information needs and search behaviors in science and technology vol.34, pp.1, 2016, https://doi.org/10.1108/EL-04-2014-0058