The Journal of Korean Academy of Prosthodontics (대한치과보철학회지)

The Korean Academy of Prosthodonitics (대한치과보철학회)
권호 표지
DOI QR코드

DOI QR Code

An assessment of statistical errors of articles in the Journal of Korean Academy of Prosthodontics: Comparison between Korean version and English version

대한치과보철학회지에 게재된 논문의 통계적 오류: 국문논문과 영문논문의 비교

  • Park, Dong-Gyu (Department of Advanced Prosthodontics, Graduate School of Clinical Dentistry, Korea University) ;
  • Choi, Yong-Geun (Department of Advanced Prosthodontics, Graduate School of Clinical Dentistry, Korea University) ;
  • Kim, Young-Su (Department of Advanced Prosthodontics, Graduate School of Clinical Dentistry, Korea University) ;
  • Shin, Sang-Wan (Department of Advanced Prosthodontics, Graduate School of Clinical Dentistry, Korea University)
  • 박동규 (고려대학교 임상치의학대학원 고급치과보철학과) ;
  • 최용근 (고려대학교 임상치의학대학원 고급치과보철학과) ;
  • 김영수 (고려대학교 임상치의학대학원 고급치과보철학과) ;
  • 신상완 (고려대학교 임상치의학대학원 고급치과보철학과)
  • Published : 2009.07.31
Download PDF
⟨ Previous Next ⟩

Abstract

Statement of problem: The aim of dental research is to advance scientific knowledge and leads to improvement in the treatment and prevention of dental disease. Utilizing an effective research design and adequate statistical methods are essential procedures ensuring that the results of researches are based on evidences. A research should utilize proper statistical methods without statistical errors; Otherwise, it could adversely affect clinical practice and future research. Purpose: This study was made to investigate the statistical methods used in the Journal of Korean Academy of Prosthodontics (JKAP) and then to assess them for the statistical errors. Material and methods: Among the total of 399 articles in the JKAP published from 2000 to 2006, 292 articles using statistics were reviewed. The validity of the statistical methods used in them were assessed using a checklist based on the guideline for statistical reporting in the uniform requirements for manuscripts submitted to biomedical journals by International Committee of Medical Journal Editors. The checklist consisted of three categories of statistical errors: 1) Unspecified computer statistical packages, 2) Inadequate description of statistical methods, 3) Misuse of statistical terms. Then, the results were compared between the Korean version and the English version in the JKAP. Results: Among the 212 articles using statistics in the Korean version, 115 articles (54%) and among the 80 articles using statistics in the English version, 47 articles (59%) were shown to have unspecified computer statistical packages without statistically significant difference (P = .66). Likewise, 101 articles (48%) in the Korean version and 25 articles (31%) in the English version were shown to have the inadequate description of statistical methods without statistically significant difference (P = .09). However, 114 articles (54%) in the Korean version and 19 articles (24%) in the English version were shown to have the misuse of statistical terms with statistically significant difference (P = .01). Conclusion: Some of the articles in the JKAP had inadequate statistical validity, given the statistical errors identified in this assessment. Hence, dental researchers should be more careful when it comes to describing and applying statistical methods.

연구목적: 대한치과보철학회지에 사용된 통계적 방법의 통계적 오류현황을 파악하여 통계적 방법의 잘못된 활용으로 인한 치의학 연구논문에서의 문제를 검토하고, 또한 통계적 오류의 유형과 빈도를 파악하여 동일문제의 재발 방지 및 효율적 대처의 기회로 삼고자 함이다. 연구 재료 및 방법: 2000년부터 2006년까지의 대한치과보철학회지에 게재된 총 399편의 논문 중 통계적 방법이 사용된 292편의 논문을 조사했고, 이를 위해 1997년 국제의학학술지 편집위원회의 "생의학 학술지에 투고하는 원고의 통일양식의 통계학적 방법론에 관한 서술지침" 15개항을 기초로 하여 1) 통계 프로그램의 불명시, 2) 통계 방법의 부적절한 기술, 3) 통계용어의 오용 등으로 크게 3가지 범주로 구성된 점검표를 사용하여 통계적 방법의 종류 및 통계적 오류부분을 확인하고 이를 한글판과 영문판으로 비교해 보았다. 그 결과는 다음과 같다. 결과 및 결론: 1. 통계 프로그램 명시 오류는 한글판에선 54%가, 영문판에선 59%가 있었으나 통계적으로 유의한 차이를 보이진 않았다 (P = .66). 2. 통계 방법의 부적절한 기술에 관한 오류는 한글판에선 49%가, 영문판에선 33%가 있었으나 통계적으로 유의한 차이를 보이진 않았다 (P = .09). 3. 통계용어의 오용오류는 한글판에선 54%가, 영문판에선 24%가 있었으며 통계적으로도 유의한 차이가 있었다 (P = .01). 상기 결과로 볼 때 통계용어의 오용 오류 이외엔 통계적 유의성을 보이진 않아서 한글판과 영문판의 통계적 오류의 비율은 유사하게 나타난 걸로 추정되며, 전체적으로 대한치과보철학회지의 통계적 타당성은 다소 부족하게 나타났다. 따라서 향후 치의학 연구자는 통계적 방법을 기술하고 적용할 때 통계적 오류를 피하기 위해 주의를 기울여야 할 것이며, 아울러 치의학 논문에서의 통계학적 방법론에 대한 인식의 제고가 필요하다고 보인다.

Keywords

References

  1. Choi JH, Lee JC. Scholarly Monographs and Statistical Methods. Seoul: Freedom Academy Pub. Co.; 1990
  2. Lee HJ, Kim DH. Research Methodology Topics in Statistics. Seoul:Korea Medical Book Publisher; 2002
  3. Altman DG. Statistical Reviewing for Medical Journals. Stat Med 1998;17:2661-74 https://doi.org/10.1002/(SICI)1097-0258(19981215)17:23<2661::AID-SIM33>3.0.CO;2-B
  4. Lee HJ. Medical Research and the Use of Statistical Methods. Seoul: Korea Medical Book Publisher; 2000
  5. Choi JH, Kim HG. Scientific Methodology and the Use of Statistical Methods. Seoul: Freedom Academy Pub. Co.; 1994
  6. White SJ. Statistical Errors in Papers in the British Journal of Psychiatry. Br J Psychiatry 1979;135:336-42 https://doi.org/10.1192/bjp.135.4.336
  7. ICMJE(International Committee of Medical Journal Editors). Uniform Requirements for Manuscripts submitted to Biomedical Journals. J Am Osteopath Assoc 2003;103:137-49
  8. Ko UR, Ahn YO. Statistical Resumption for Health Articles in One Series of Medical Journals. Korean J Prev Med 1973;6:81-6
  9. Ko H. Statistical Methods in the Articles of the Journal of the Korean Society of Anesthesiologists from 1981 to 1990. Korean J Anesthesiol 1993;26:22-7
  10. Kim YY, Lee EI, Jung HR. Research Designs, Research Methods, and Statistical Techniques in Korean Ophthalmic Articles. J Korean Ophthalmol Soc 1994;35:460-73
  11. Hwang KH, Lee HJ, Kim YJ, Lee SI. Statistical Errors in Papers in the Journal of Korean Society of Plastic and Reconstructive Surgeons. J Korean Soc Plast Reconstr Surg 2001;28:302-9
  12. Publication Committee of Korean Academy of Family Medicine. Statistics for Family Medicine. Seoul: J Korean Acad Fam Med; 2001
  13. Koh WJ, Lee SJ, Kang MJ, Lee HJ. An Evaluation of the Use of Statistical Methods in the Journal of Tuberculosis and Respiratory Diseases. Korean Tuberc Respir Dis 2004;57:168-79
  14. Pak SI. An Assessment of Statistical Errors in Articles in the Korean Journal of Veterinary Research. Korean J Vet Res 1999;39:1187-96
  15. Lee SD. An Assessment of Statistical Validity of Articles Published in the Journal of Korean Acupuncture and Moxibustion Society from 1984 to 2002. Korean J Acupunct Mox 2004;21;176-88
  16. Park YG. The Most Common Statistical Errors in the Articles. J Korean Acad Fam Med 1998;19:137-43
  17. Gore SM, Jones JG, Rytter EC. Misuse of Statistical Methods: Critical Assessment of Articles in BMJ from January to March 1976. Br Med J 1977;1:85-7 https://doi.org/10.1136/bmj.1.6053.85
  18. Ahn YO, Lee HK. Development of a Checklist for Assessing the Methodological andStatistical Validity of Medical Articles. Korean J Med Educ 1991;3:19-35
  19. Park YG. Statistical Application of the Articles in the Journal of the Korean Academy of Family Medicine. J Korean Acad Fam Med 1998;19:137-43
  20. Lee HK, Huh BY, Ahn YO. An Assessment of Methodological and Statistical Validity of Medical Articles Published in Korea, from 1980 to 1989. J Korean Acad Fam Med 1991;12:46-67
  21. Petrie A, Sabin C. Medical Statistics at a Glance, 2nd edition. London: Blackwell publishing Ltd; 2005
  22. Ahn YO, Yoo KY, Park BJ. Applied Medical Statistics, Revised edition. Seoul : Seoul National University Press; 2005
  23. Altman M, McDonald MP. Choosing Reliable Statistical Software. Political Science and Politics 2001;34:681-7 https://doi.org/10.1017/S1049096501001093
  24. Bailar JC 3rd, Frederick M. Guidelines for Statistical Reporting in Articles for Medical Journals: Amplifications and Explanations. Ann Intern Med 1988;108:266-73 https://doi.org/10.7326/0003-4819-108-2-266
  25. Browner WS. Publishing and Presenting Clinical Research. Philadelphia: Lippincott Williams & Wilkins Ltd; 1998
  26. Song MS, Park CS. Introduction to Nonparametric Statistics. Seoul: Freedom Academy Pub. Co.; 1997
  27. Hahn SK. Development of Program for Statistical Education in Design and Analysis of Clinical Trials and Training Medical Statisticians. The Annual Report of KFDA No. GOVP1200608585, Seoul: Korea Food and Drug Administration; 2005
  28. Altman DG, Schultz KF, Moher D, Egger M, Davidoff F, Elboume D, Lang T, et al. The Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration. Ann Intern Med 2001;134:663-94 https://doi.org/10.1001/archinte.134.4.663
  29. Park YG. Statistical Errors of the Articles in December 1999. J Korean Acad Fam Med 2000a;21:107-10
  30. Park YG. Statistical Errors of the Articles in January 2000. J Korean Acad Fam Med 2000b;21:289-93
  31. Lee YJ. Understanding the Analysis of Variance. Seoul: SukJung publisher; 2000
  32. Park GB. A Study of Statistical Analysis Methods in Domestic Journal related to Oral and Maxillofacial Surgery. MSD. Graduate School of Chosun University; 1999
  33. Lee SM, Lee SW. An Assessment of Statistical Validity of Nursing Researches Published in Korea from 1986 to 1995. J Korean Soc Health Statistics 1998;23:42-64
  34. Park IK, Kang JO, Kim TY, Keum DG. An Evaluation of the Statistical Techniques Used in the 1995-1996 Editions of the Korean Journal of Clinical Pathology. Korean J Clin Pathol 1999;19:460-4

Cited by

  1. Assessment of statistical errors of articles published in the Journal of the Korean Academy of Prosthodontics: 2006 - 2010 vol.50, pp.4, 2012, https://doi.org/10.4047/jkap.2012.50.4.258
  2. Statistical Errors in a Research of Clothing and Textiles vol.12, pp.4, 2014, https://doi.org/10.14400/JDC.2014.12.4.485
  3. Evaluation of Statistical Analysis of Radiologist's Journal: Focus on Journal of Korean Society of Computer Tomographic Technology vol.12, pp.9, 2014, https://doi.org/10.14400/JDC.2014.12.9.275
  4. vol.44, pp.6, 2014, https://doi.org/10.5051/jpis.2014.44.6.288