Journal of the Korean Data and Information Science Society

The Korean Data and Information Science Society (한국데이터정보과학회)
권호 표지
DOI QR코드

DOI QR Code

Determinants of student course evaluation using hierarchical linear model

위계적 선형모형을 이용한 강의평가 결정요인 분석

  • Cho, Jang Sik (Department of Informational Statistics, Kyungsung University)
  • 조장식 (경성대학교 정보통계학과)
  • Received : 2013.08.27
  • Accepted : 2013.10.10
  • Published : 2013.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

The fundamental concerns of this paper are to analyze the effects of student course evaluation using subject characteristic and student characteristic variables. We use a 2-level hierarchical linear model since the data structure of subject characteristic and student characteristic variables is multilevel. Four models we consider are as follows; (1) null model, (2) random coefficient model, (3) mean as outcomes model, (4) intercepts and slopes as outcomes model. The results of the analysis were given as follows. First, the result of null model was that subject characteristics effects on course evaluation had much larger than student characteristics. Second, the result of conditional model specifying subject and student level predictors revealed that class size, grade, tenure, mean GPA of the class, native class for level-1, and sex, department category, admission method, mean GPA of the student for level-2 had statistically significant effects on course evaluation. The explained variance was 13% in subject level, 13% in student level.

강의평가 결과에 영향을 미치는 특성변수로는 교과목 수준의 다양한 강좌특성 변수들과 수강생 수준의 다양한 인적특성 변수들이 있다. 특정 수강생은 다수의 교과목을 이수하기 때문에 다수의 교과목들은 동일한 수강생 안에 속하게 됨으로써 공유되는 특성이 있게 된다. 즉 강의평가 결과는 교과목 수준의 강좌특성 (1-수준)과 수강생 수준의 인적특성 (2-수준)에 의해 영향을 받는 다층구조 (multilevel)를 가지게 되며, 위계적 자료 특성을 가지는 복수의 분석단위의 구조가 된다. 따라서 전통적인 회귀분석에서와 같이 개별 교과목들이 독립이라는 가정을 할 수 없게 된다. 본 논문에서는 강의평가결과에 영향을 미치는 다층구조의 특성을 가진 변수들의 영향력을 보다 타당하게 분석하기 위한 방법으로 위계선형모형 (HLM; hierarchical linear model)을 이용하였다. 분석결과는 다음과 같다. 먼저 교과목 수준의 특성변수들 중에 강좌규모, 개설학년, 담당교수의 전임여부, 해당 교과목의 총 평균평점, 원어강좌 여부가 통계적으로 유의하게 강의평가 결과에 영향을 미친 것으로 나타났다. 또한 수강생 수준의 인적특성 변수들 중에는 성별, 학과계열, 대입당시 전형방법, 평균평점 등이 유의하게 강의평가 결과에 영향을 미친 것으로 나타났다.

Keywords

References

  1. Baek, S. G. and Shin, H. J. (2008). Multilevel analysis of the effects of student and course characteristics on student course evaluation - Focused on the undergraduate liberal education program. Journal of Educational Evaluation, 21, 1-24. https://doi.org/10.2167/erie1.0
  2. Breiman, L., Friedman, J. H., Olshen, R. A. and Stone, C. J. (1984). Classification and regression trees, Chapman and Hall Press, Washington, D.C.
  3. Cho, J. S., Kang, C. W, Choi, S. B. (2009). Comparison on equating methods for course evaluation. Journal of the Korean Data Information & Science Society, 20, 65-75.
  4. Cho, J. S. (2010). A study on equating method based on regression analysis. Journal of the Korean Data Information & Science Society, 21, 513-521.
  5. Cho, J. S. (2012). Study on the effectiveness of english-medium class. Journal of the Korean Data & Information Science Society, 23, 1137-1144. https://doi.org/10.7465/jkdi.2012.23.6.1137
  6. Cho, K. H. and Park, H. C. (2012). A study on decision tree creation using marginally conditional variables. Journal of the Korean Data Information & Science Society, 23, 299-307. https://doi.org/10.7465/jkdi.2012.23.2.299
  7. Ethington, C. A. (1997). A hierarchical linear modeling approach to studying college effects. Higher Education:Handbook of Theory and Research, 12, Agathon Press, NY, 165-194.
  8. Han, S. I. (2001). Research on student ratings of university teaching: Analysis of determinants related to professor, student, and class. The Journal of Educational Administration, 19, 247-266.
  9. Han, S. I., Kim, H. J. and Lee, J. Y. (2005). A comprehensive study of Korean students' evaluations of university teaching. The Journal of Educational Administration, 23, 379-403.
  10. Im, S. H. (2002). Multilevel models for cross-sectional approach to the developmental research. Journal of Educational Evaluation, 15, 295-315.
  11. Jeon, M. J. and Kang, S. J. (2005). A comparison of multilevel models in their parameter estimation - The comparison of 2-level HLM, 3-level HLM, and CMM. Journal of Education Evaluation, 18, 123-147.
  12. Jung, H. J. and Min, D. K. (2013). The study of foreign exchange trading revenue model using decision tree and gradient boosting. Journal of the Korean Data Information & Science Society, 24, 161-170. https://doi.org/10.7465/jkdi.2013.24.1.161
  13. Kang, S. J. (1998). Analytical comparisons between classical linear models and multilevel models as educational and social research methods. Journal of Educational Evaluation, 11, 207-258.
  14. Nasser, F. and Hagtvet, K. A. (2006). Multilevel analysis of the effects of studentand instructor/course characteristics on student ratings. Research in Higher Education, 47, 559-590. https://doi.org/10.1007/s11162-005-9007-y
  15. Newman, F, Couturier, L. and Scurry, J. (2004). The future of higher education: Rhetoric, reality, and the risks of the market, Jossey-Bass, San Francisco.
  16. Raudenbush, S. W. and Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods, SAGE publication, San Francisco.
  17. Ryu, C. H., Lee, J. H. (2003). A study on student factors associated with the student evaluation of teaching at universities. Korean Management Review, 33, 89-807.
  18. Son, C. K. and Kim, Y. T. (2007). A study on the difference of result to variables related to students' evaluation of teaching in university. Journal of Educational Evaluation, 20, 1-24. https://doi.org/10.2167/eri431.0

Cited by

  1. 공학 교과목의 강의평점에 영향을 미치는 요인: CTL 프로그램 참여와 CQI 작성을 중심으로 vol.22, pp.3, 2013, https://doi.org/10.18108/jeer.2019.22.3.59