Journal of Digital Convergence (디지털융복합연구)

The Society of Digital Policy and Management (한국디지털정책학회)
권호 표지
DOI QR코드

DOI QR Code

Investigation on Methods to Improve the Reliability of Education Satisfaction Surveys: Focused on the S University Case

교육수요자 만족도조사의 신뢰성 제고방안 탐색: S대학교 사례를 중심으로

  • Ahn, Su-Hyun (Dept. of General Education, Semyung University) ;
  • Lee, Sang-Jun (Dept. of Information & Communication System, Semyung University)
  • 안수현 (세명대학교 교양대학) ;
  • 이상준 (세명대학교 정보통신학부)
  • Received : 2017.10.19
  • Accepted : 2017.12.20
  • Published : 2017.12.28
Download PDF
⟨ Previous Next ⟩

Abstract

In order for the consumers of education and university to be mutually communicating well, satisfaction surveys with a correct system are essential. This study points out the causes for insincere responses found in the process of education satisfaction surveys while discussing possible methods to elicit sincere responses from the students. As a result of analyzing S University, it was observed that enforced online evaluation methods did have a high response rate but also monotonously insincere responses showed to have a high ration among them. A second study was carried out in order to improve the research method after confirming the reliability of the research. Study results sowed that through a representative sample survey, monotonous response patterns decreased and the data distribution satisfied normal distribution. Moreover, a focus group interview was carried out in order to understand the root causes and possible solutions to the problem. Lastly, this study revealed the need of diversified attempts and research in order to secure reliability in education satisfaction surveys while proposing methods of improvement.

교육수요자와 대학 간의 원활한 양방향 소통을 위해서는 올바른 시스템을 갖춘 만족도조사가 병행되어야 한다. 본 연구는 교육수요자 만족도조사의 실시과정에서 기인하는 불성실응답의 원인을 지적하면서 학생들의 성실한 응답을 유도할 수 있는 신뢰성 제고방안에 대해 논의한다. S대학교의 사례를 분석한 결과 강제적인 온라인 평가방식으로 인해 높은 응답률은 얻었지만, 불성실한 일관적 응답의 비율이 높게 나타났다. 이에 조사의 신뢰도를 확인하고 조사방법의 개선을 위해 재조사를 진행하였다. 연구결과 대표성 있는 표본조사를 통해 일관적 응답패턴은 감소하였고 자료의 분포는 정규분포를 충족하는 것으로 나타났다. 그리고 이러한 심층적인 원인과 해결방안을 파악하고자 포커스 그룹 인터뷰를 진행하였다. 마지막으로 교육수요자 만족도조사의 신뢰성을 확보하기 위한 다각적인 시도 및 연구가 필요하다는 점을 밝히면서 신뢰성 제고방안에 대해 제언한다.

Keywords

References

  1. Kerlinger, F. N., "Foundations of Behavioral Science", New York: Holt, Renehard and Winston, 1973.
  2. S. I. Chaiy, "Social Science Research Methodology", B&M Books, 2005.
  3. Sumaedi, S., Bakit, I. G. M. Y., & Metasari, N., "The Effect of Students' Perceived Service Quality and Perceived Price on Student Satisfaction", Management Science and Engineering, Vol. 5, No. 1, pp. 88-97, 2011.
  4. M. H. Kim, "Validity and Reliability of Lecture Evaluation", Asian Journal of Education, Vol. 6, No. 3. pp. 1-24, 2005.
  5. I. W. Park, "A Study on Effects of Student Ratings of Their Learning on Consistent Responses in Student Ratings of College Teaching", The Korean Journal of Educational Methodology Studies, Vol. 24, No. 1. pp. 257-281, 2012.
  6. K. S. Hong, "An Analysis of Students' Response to Course Evaluation", The Journal of Educational Information and Media, Vol. 12, No. 2, pp. 97-127, 2006.
  7. K. S. Yang, "A Study on the Students' Consistent Responses to Course Evaluation at Universities", Journal of Educational Evaluation, Vol. 27, No. 2, pp. 255-278, 2014.
  8. S. Y. Shin, J. H. Kwon, "A Study on the Improvement of the Reliability of the Course Evaluation: Focused on the Management of Course Evaluation System", Soonchunhyang Journal of Humanities, Vol. 35, No. 4, pp. 115-145, 2016.
  9. K. H. Lee, "A Study on Validity and Reliability of Students; Evaluation", Journal of the Korean Data & Information Science Society, Vol. 21, No. 1, pp. 87-98, 2010.
  10. O. S. Ha, M. H. Jung, "A Study on the Improvement of a Student Evaluation Tool Through the Analysis of Response of Student Evaluation", The Journal of Yeolin Education, Vol. 22, No. 3, pp. 273-294, 2014.
  11. O. Y. Kwon, Y. T. Park, I. K. Hwang, T. W. Ahn, K. S. Kim, "A Study on the Reliability Improvement for the Course Evaluation System", Journal of Engineering Education Research, Vol. 17, No. 2, pp. 35-41, 2014. https://doi.org/10.18108/jeer.2014.17.2.35
  12. W. S. Lee, H. W. Lee, Y. K. Tschong, "A Study on Effects of Course Evaluation Methods on Consistent Responses in Student Ratings of College Teaching", The Korean Journal of Educational Methodology Studies, Vol. 24, No. 3, pp. 547-561, 2012.
  13. K. S. Han, S. H. Choi, J. C. Park, "Problems in Mandatory Course Evaluations", Communications for Statistical Applications and Methods, Vol. 18, No. 1, pp. 35-45, 2011. https://doi.org/10.5351/CKSS.2011.18.1.035
  14. Cooper, D. R., & Schindler, P. S., "Business Research Methods", New York: McGraw-Hill Irwin.
  15. J. W. Choi, D. K. An, "A Study on the Data Analysis of the Written Comments in Lecture Evaluation", Journal of Digital Convergence, Vol. 14, No. 11, pp. 101-106, 2016. https://doi.org/10.14400/JDC.2016.14.11.101
  16. Shrout, P. E., & Fleiss, J. L., "Intraclass Correlations: Uses in Assessing Rater Reliability", Psychological Bulletin, Vol. 86, No. 2, pp. 420-428, 1979. https://doi.org/10.1037/0033-2909.86.2.420