Korean journal of medical education

The Korean Society of Medical Education (한국의학교육학회)
권호 표지

Comparison of the Evaluation Results of Faculty with Those of Standardized Patients in a Clinical Performance Examination Experience

표준화 환자를 이용한 임상수행능력평가시험 (CPX)에서 교수와 표준화 환자의 평가 결과 비교

Kwon, Ivo;Kim, Na-Jin;Lee, Soon-Nam;Eo, Eun-Kyung;Park, Hye-Sook;Lee, Dong-Hyeon;Park, Mi-Hae;Oh, Jee-Young;Han, Jae-Jin;Huh, Jung-Won;Ryu, Kyung-Ha
권복규;김나진;이순남;어은경;박혜숙;이동현;박미혜;오지영;한재진;허정원;유경하

  • Published : 2005.08.31
⟨ Previous Next ⟩

Abstract

Purpose: To compare the evaluation results of faculties to those of Standardized Patients (SP) participating in a Clinical Performance Examination (CPX) administered at Ewha Womans University College of Medicine. Methods: The CPX was taken by 77 fourth year medical students. Cases and checklist were developed by the medical school consortium in capital area. Six cases were used and 24 SPs participated and evaluated the students’ performances. The whole session was recorded on videotapes so that 6 medical school faculties could analyze and evaluate the students´ performances as well. The results were compared and analyzed by SPSS package. Results: The agreement between the faculties and the SPs was relatively good (r=0.79), but not good enough. In every case, SPs gave higher marks than did the faculties. Clear disease entity cases like 'hepatitis' and 'anemia' showed better agreement than obscure clinical contexts such as 'bad news delivery'. Better agreement was seen in the items of physical exam category (r=0.91), but the agreement was very poor in the items of doctor-patient (Dr-Pt) relationship category (r=0.54). The construction of checklist and the character of each evaluation item should influence the differences. Conclusion: More detailed guidelines and clear/specific evaluating items are necessary to improve the agreement rate. In certain categories like physical exam and brief history taking, the SP´s evaluation can replace the faculties´, but for complex contexts like Dr-Pt relationship.

Keywords

References

  1. 김병수, 이영미, 안덕선, 박정률(2001). 임상의학입 문 평가를 위한 객관적임상실기시험 경험. 한국의학교육, 13(2), 289-298
  2. 김주자, 이경재, 최규연, 이동환(2004). 일개 의과대 학에서 실시한 표준화 환자(SP)를 이용한 임상수 행능력평가시험(CPX)분석. 한국의학교육, 16(1), 51-61
  3. 박훈기, 이정권, 황환식, 이재웅, 최윤영, 김혁, 안동 현(2003). 객관구조화진료시험(OSCE)에서 교수 와 표준화 환자 사이의 점검표 채점의 일치도. 한국의학교육, 15(2), 141-150
  4. 서보양, 이두진, 권굉보, 강복수(1998). 객관적으로 구조화된 임상시험의 시행 경험. 한국의학교육, 10(2), 363-381
  5. Abrahamson S(1998). 임상실기능력을 어떻게 평가 할 것인가? 한국의학교육, 10(1), 153-164
  6. Heine N, Garman K, Wallace P, Bartos R, Richards A(2003). An analysis of standardized patient checklist errors and effect on student scores. Med Edu, 37(2), 99-104 https://doi.org/10.1046/j.1365-2923.2003.01416.x
  7. Hodges B, Turnbull J, Cohen R, Bienenstock A, Norman G(1996). Evaluating communication skills in the objective structured clinical examination format: reliability and generalizability. Med Edu, 30, 38-43 https://doi.org/10.1111/j.1365-2923.1996.tb00715.x
  8. Yelland M(1998). Standardized patients in the assessment of general practice consulting skills. Med Edu, 32, 8-13 https://doi.org/10.1046/j.1365-2923.1998.00694.x
  9. Wind L(2004). Assessing simulated patients in an educational setting: the MaSP (Maastricht Assessment of Simulated Patients). Med Edu, 38, 39-44 https://doi.org/10.1111/j.1365-2923.2004.01686.x