Journal of the Korea Society of Computer and Information (한국컴퓨터정보학회논문지)

Korean Society of Computer Information (한국컴퓨터정보학회)
권호 표지
DOI QR코드

DOI QR Code

A Meta-Analysis on the Effects of Software Education on Computational Thinking

  • Kim, Dong-Man (Dept. of Computer Education, Korea National University of Education) ;
  • Lee, Tae-Wuk (Dept. of Computer Education, Korea National University of Education)
  • Received : 2018.10.17
  • Accepted : 2018.11.21
  • Published : 2018.11.30
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we propose to investigate the existing SW education related studies and to collect the total effect size for the improvement of computational thinking(CT) through meta-analysis and to confirm the effect size according to various variables. So, we have objectively identified and generalized the practical effects of SW education on the various variable. The results of the meta-analysis showed that 1) the overall effect of SW educational activities on CT improvement was 'Hedges' g=0.643', so SW educational activity can get a CT improvement of about 24% over other educational activities. 2) EPL is a SW teaching-learning method that greatly improves students' CT. 3) Since SW education can be guaranteed to improve CT among elementary school students and university students, essential SW education for these should be further promoted. And it was found that SW education activity were more effective for CT improvement in small cities & rural areas than big cities, but the cause was not identified, so further study will be required.

Keywords

CPTSCQ_2018_v23n11_239_f0001.png 이미지

Fig. 1. The checking process of papers

CPTSCQ_2018_v23n11_239_f0002.png 이미지

Fig. 2. Model of meta-analysis

CPTSCQ_2018_v23n11_239_f0003.png 이미지

Fig. 3. Funnel plot

CPTSCQ_2018_v23n11_239_f0004.png 이미지

Fig. 4. Adjusted funnel plot

CPTSCQ_2018_v23n11_239_f0005.png 이미지

Fig. 5. Forest plot

CPTSCQ_2018_v23n11_239_f0006.png 이미지

Fig. 6. U3 - percentiles of nonoverlap

Table 1. Hedges' g computing formula

CPTSCQ_2018_v23n11_239_t0001.png 이미지

Table 2. Cases of effect sizes

CPTSCQ_2018_v23n11_239_t0002.png 이미지

Table 3. Process of statistical analysis of meta-analysis

CPTSCQ_2018_v23n11_239_t0003.png 이미지

Table 4. Result of between-study heterogeneity

CPTSCQ_2018_v23n11_239_t0004.png 이미지

Table 5. Effect size of SW Education

CPTSCQ_2018_v23n11_239_t0005.png 이미지

Table 6. Differences in effect size by SW education method

CPTSCQ_2018_v23n11_239_t0006.png 이미지

Table 7. Differences in effect size by target

CPTSCQ_2018_v23n11_239_t0007.png 이미지

Table 8. Differences in effect size by area

CPTSCQ_2018_v23n11_239_t0008.png 이미지

References

  1. Ministry of Education, "2015 Revised Practical-arts and Informatics curriculum" 2015 Revised National Curriculum, Sep. 2015.
  2. Wing, J. M., Computational Thinking. Communication of the ACM, Vol. 49, No. 3, pp. 33-35, Mar. 2006. https://doi.org/10.1145/1118178.1118215
  3. Jeong-Won Choi, Young-Jun Lee, "The Design of Method for Evaluating Computational Thinking," Proceedings of the Korean Society of Computer Information Conference, Vol. 22, No. 2, pp. 177-178, Jul. 2014.
  4. BCS, "Call for evidence-UK Digital Skills Taskforce" Retrieved from: http://policy.bcs.org, May. 2014.
  5. Hyun Kang, "Statistical Considerations in Meta-Analysis Department of Anesthesiology and Pain Medicine," Hanyang Med Rev, Published online https://doi.org/10.75 99/hmr.2015.35.1.23, Feb. 2015. https://doi.org/10.7599/hmr.2015.35.1.23
  6. Glass, G. V., "Primary, secondary and meta-analysis of research," Educational Researcher, Vol. 5, No. 10, pp. 3-8. 1976. https://doi.org/10.2307/1174772
  7. Cooper, Harris, M., "Research synthesis and meta-analysis: A step-by-step approach" Thousand Oaks, CA: Sage, 2016.
  8. Yeonhee Yun, "A Meta-analysis of the relationship between principals' transformational leadership and job satisfaction, organizational effectiveness," Doctoral dissertation, Graduate School of Ewha Womens University, Feb. 2008.
  9. Seongsam Oh, "Theory and Practice of Meta-Analysis" Seoul, Korea: Konkuk University Press, 2002.
  10. Hedges, H., Olkin, I., "Statistical methods for meta-analysis" Orlando, FL: Academic Press, 1985.
  11. Egger M., Smith GD, Phillips AN, "Meta-analysis: principles and procedures" BMJ, Dec. 1997.
  12. Dong-Man Kim, Tae-Wuk Lee, "A Meta-Analysis on the Effects of Educational Programming Language on High-level Thinking," Journal of the Korea Society of Computer and Information, Vol. 23, No. 6, pp. 81-89, Jun. 2018. https://doi.org/10.9708/JKSCI.2018.23.06.081
  13. SeongKyun Jeon, YoungJun Lee, "Meta-analysis of the programming learning effectiveness depending on the teaching and learning method," Journal of the Korea Society of Computer and Information, Vol. 22, No. 11, pp. 125-133, Nov. 2017. https://doi.org/10.9708/JKSCI.2017.22.11.125
  14. SungDong Hwang, Understanding meta-analysis. Seoul: Hakjisa, 2014.
  15. Higgins JP, Thompson SG, Deeks JJ, Altman DG., " Measuring inconsistency in meta-analyses," BMJ, Sep. 2003.
  16. Duval S, Tweedie R, "Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis" Biometrics, Jun. 2000.
  17. Younah Jin, "Meta-analysis using Stata," Seoul, Korea: Korea University Press, pp. 102-103, 2015.
  18. Cohen, J., "Statistical power analyst for the behavior science" NY: Academic Press, 1988.
  19. Younghak Jin, Youngsik Kim, "A Meta-Analysis on the Effects of Educational Programming Language," The Journal of Korean association of computer education, Vol. 14, No. 3, pp. 25-36, May. 2011.
  20. Borenstein M, Hedges LV, Higgins J, Rothstein HR., "A basic introduction to fixed‐effect and random‐effects models for meta‐analysis," Research Synthesis Methods, Vol. 1, No. 2, pp. 97-111, Apr. 2010. https://doi.org/10.1002/jrsm.12

Cited by

  1. 토픽 모델링을 이용한 컴퓨팅 사고력 관련 연구 동향 분석 vol.23, pp.6, 2019, https://doi.org/10.14352/jkaie.2019.23.6.607
  2. Research on the Content to Develop Instructor's Certification for Software Education vol.25, pp.12, 2020, https://doi.org/10.9708/jksci.2020.25.12.341