Korean journal of medical education

The Korean Society of Medical Education (한국의학교육학회)
권호 표지

Sharing of Information among Students and Its Effect on the Scores of Clinical Performance Examination (CPX)

진료수행시험 (CPX: Clinical Performance Examination)에서 정보공유가 시험성적에 미치는 영향

Park, Hoon-Ki;Kwon, Oh-Jung
박훈기;권오정

  • Published : 2005.08.31
⟨ Previous Next ⟩

Abstract

Purpose: During the high-stake examinations such as OSCE (Objective structured clinical examination) or CPX (clinical performance exam), test security is generally accepted as a major concern for test validity. This study was conducted to investigate the effect on examinee´s scores of repeated, serial administrations of essentially the same standardized patient (SP)-based performance exam. Methods: A performance-based examination using eight SP cases was administered to 123 senior medical students at Hanyang University School of Medicine. Students were randomly assigned to one of 16 groups of 8 students each. Three groups were tested serially each day, requiring 5 days for the complete administration of the examination. We compared the mean scores of the five groups of the examinees tested on different days with ANOVA and linear trends with multiple regression analyses. Results: For both checklist scores and written scores during the interstation work, the mean scores of the first day groups were significantly lower compared to subsequent groups. And, there were slight linear trends in the scores over the five days. Scores related to case-specific history taking, information sharing, and clinical courtesy were significantly affected by the sharing of information between students. Scores related to patient satisfaction, physical exam, and physician-patient interaction were not influenced by the same pattern of behaviour. Conclusion: Test security may be violated during SP-based performance exams even though the checklists are not accessible to the examinees. It would be desirable for the test-givers to prepare alternative forms of cases for maintaining the validity of SP-based performance exams.

Keywords

References

  1. 박훈기, 이정권, 김승룡, 김경태, 박해영(1999). 시험 장 복제(Duplication)가 객관적 구조적 임상 시험 (OSCE)의 신뢰도에 미치는 영향. 한국의학교육, 11, 37-52
  2. Barrows HS(1993). An overview of the uses of standardized patients for teaching and evaluating clinical skills. AAMC. Acad Med, 68:443-451; discussion 451-453 https://doi.org/10.1097/00001888-199306000-00002
  3. Chatenay M, Maguire T, Skakun E, Chang G, Cook D, Warnock GL(1996). Does volume of clinical experience affect performance of clinical clerks on surgery exit examinations? Am J Surg, 172, 366- 372 https://doi.org/10.1016/S0002-9610(96)00184-5
  4. Cohen R, Rothman AI, Ross J, Poldre P(1993). Impact of repeated use of objective structured clinical examination stations. Acad Med, 68(10 Suppl), s73-s75 https://doi.org/10.1097/00001888-199310000-00051
  5. Colliver JA, Barrows HS, Vu NV, Verhulst SJ, Mast TA, Travis T(1991). Test security in examinations that use standardized-patient cases at one medical school. Acad Med, 66, 279-282 https://doi.org/10.1097/00001888-199105000-00011
  6. Furman GE, Colliver JA, Galofre A, Reaka MA, Robbs RS, King A(1997). The effect of formal feedback sessions on test security for a clinical practice examination using standardized patients. Adv Health Sci Edu, 2(1), 3-7
  7. Gledhill RF, Capatos D(1985). Factors affecting the reliability of an objective structured clinical examination (OSCE) test in neurology. S Afr Med J, 23;67(12), 463-467 https://doi.org/10.1017/S0022278X00057189
  8. Harden RM, Stevenson M, Downie WW, Wilson GM(1975). Assessment of clinical competence using objective structured examination. Br Med J, 22, 447-451
  9. Jolly BC, Jones A, Dacre JE, Elzubeir M, Kopelman P, Hitman G(1996). Relationships between students' clinical experiences in introductory clinical courses and their performances on an objective structured clinical examination(OSCE). Acad Med, 71, 909-916 https://doi.org/10.1097/00001888-199608000-00021
  10. Ker JS, Dowie A, Dowell J, Dewar G, Dent JA, Ramsay J, et al(2005). Twelve tips for developing and maintaining a simulated patient bank. Medical Teacher, 27(1), 4-9 https://doi.org/10.1080/01421590400004882
  11. Mavis BE(2000). Does studying for an objective structured clinical examination make a difference? Med Educ, 34, 808-812 https://doi.org/10.1046/j.1365-2923.2000.00687.x
  12. Niehaus AH, DaRosa DA, Markwell SJ, Folse R(1996). Is test security a concern when OSCE stations are repeated across clerkship rotations? Acad Med, 71(3), 287-289 https://doi.org/10.1097/00001888-199603000-00023
  13. Rulata PJ, Witzke DB, Leko EO, Fulginiti JV, Taylor PJ(1991). Sharing of information by students in an objective structured clinical examination. Arch Intern Med, 151, 541-544 https://doi.org/10.1001/archinte.151.3.541
  14. Stillman PL, Haley HL, Sutnick AI, Philbin MM, Smith SR, O'Donnell J, Pohl H(1991). Is test security an issue in a multistation clinical assessment? A preliminary study. Acad Med, 66(9 Suppl), S25-7 https://doi.org/10.1097/00001888-199109000-00030
  15. Swartz MH, Colliver JA, Cohen DS, Barrows HS(1993). The effect of deliberate, excessive violations of test security on performance on a standardized-patient examination. Acad Med, 68 (10 Suppl):S76-8 https://doi.org/10.1097/00001888-199310000-00052
  16. Thomas PA, Shatzer JH(2000). Standardized patient assessment of ambulatory clerks: effect of timing and order of the clerkship. Teach Learn Med, 12(4), 183-188 https://doi.org/10.1207/S15328015TLM1204_4
  17. Vu NV, Barrows HS, Marcy ML, Verhulst SJ, Colliver JA, Travis T(1992). Six years of comprehensive, clinical, performance-based assessment using standardized patients at the Southern Illinois University School of Medicine. Acad Med, 67, 42-50 https://doi.org/10.1097/00001888-199201000-00009
  18. Williams RG, Lloyd JS, Simonton DK(1992). Sources of OSCE examination information and perceived helpfulness: a study of the grafevine. In: Hart IR, Harden RM, and Marchais JD. (eds.), Current developments in assessing clinical competence, pp. 363-370. Montreal: Can-Heal Publications