Objective structured clinical examination
Find sources: "Objective structured clinical examination" – news · newspapers · books · scholar · JSTOR (March 2022) (Learn how and when to remove this message)
An objective structured clinical examination (OSCE) is a practical examination format used to assess clinical competence, especially in medicine and other health care disciplines. In an OSCE, candidates rotate through a series of timed stations and complete predefined clinical tasks, such as history taking, physical examination, communication, interpretation of investigations, clinical reasoning, or practical procedures.[1] [2]
The format was developed in the 1970s by Ronald Harden and colleagues as a response to limitations of traditional clinical examinations, including variation in the patients and examiners assigned to candidates. OSCEs are structured through planned stations, standardised instructions, checklists or rating scales, and, in many cases, real or simulated patients.[3] [4]
OSCEs are used in undergraduate, postgraduate, licensing, certification and formative assessment contexts. Although the format is intended to improve standardisation and sampling of clinical skills, its reliability and validity depend on how stations, examiners, scoring criteria and standard-setting procedures are implemented.[3] [4]
History and purpose
[edit ]The development of OSCE is credited to Ronald Harden. Since the publication of the first paper in the British Medical Journal in 1975, OSCE has been widely adopted in many medical schools and professional bodies. The format of OSCE is continuously evolving and may include real or simulated patients, clinical specimens, and other clinical materials. OSCE is primarily used to assess focused clinical skills such as history taking, physical examination, diagnosis, communication, and counseling.[5] [page needed ]
In the last three decades the OSCE has seen a steady exponential growth and usage in both undergraduate and postgraduate examinations around the globe. OSCEs are also used for licensure examinations and as a feedback tool in formative settings. Common uses of the OSCE include:[2]
- as a performance based assessment tool for testing the minimum accepted standards of students or trainees as barrier (exit) examinations during the undergraduate years in most of the medical schools
- as a postgraduate high stakes assessment tool in Royal College examinations
- as a formative assessment tool in undergraduate medical education
- as a tool for the assessment of graduates seeking highstakes licensure and certification to practise medicine
- as an educational tool to provide immediate feedback
Objective structured clinical examinations evaluate learners "showing how" to perform complex clinical tasks including those infrequently observed and those core to practice.[6]
Design
[edit ]An OSCE usually consists of a circuit of short stations, usually 5–10 minutes, though some use up to 15 minutes. In each station, the candidate is examined on a one-to-one basis with one or two examiner(s) and either real or simulated (actors or electronic patient simulators) patients. Each station has a different examiner, as opposed to the traditional method of clinical examinations where a candidate would be assigned to one examiner for the entire examination. Candidates rotate through the stations, completing all the stations on their circuit. In this way, all candidates take the same stations. The format was introduced to reduce some limitations of traditional clinical examinations, particularly variation in the patients and examiners assigned to candidates. By using multiple stations, predetermined tasks, checklists and standardised content, OSCEs can sample a wider range of clinical skills and reduce some sources of examiner and case variability.[1] [4]
OSCEs are designed to assess candidates' clinical skills more objectively. This is done by giving all candidates the same stations (though signs of real patients may vary slightly), where they are assessed with the same marking scheme and awarded marks for each step performed correctly. If theoretical knowledge is examined, such as with the examiner asking questions at the end of the station, the questions will also be standardised. The candidate will only be asked questions on the marking scheme, and will not be awarded marks for any other questions asked.
OSCEs are also designed to be structured, with instructions carefully written to ensure that the candidate has a very specific task to complete in each station. Where simulated patients are used, detailed scripts are provided to ensure that the information provided is the same for all candidates, even including the emotions displayed by the patient. The examination is carefully structured to include parts from all elements of the curriculum as well as a wide range of skills.
Variation
[edit ]There are several variations of OSCE, those are:[2]
- Objective Structured Practical Examination (OSPE), which assess practical skills, knowledge and/or interpretation of data in non clinical settings.
- Objective Structured Assessment of Technical Skills (OSATS), which designed for objective skills assessment, consisting of a global rating scale and a procedure specific checklist. It is primarily used for feedback or measuring progress of training in surgical specialities.
- Objective Structured Video Examinations (OSVE). The variation consists of videotaped recordings of patient-doctor encounters are shown to students simultaneously and questions related to the video clip are asked. Written answers are marked in a standardised manner.
- Team Objective Structured Clinical Examination (TOSCE). Formative assessment covering common consultations in general practice. A team of students visits each station in a group, performing one task each in a sequence. The candidates are marked for their performance and feedback is provided. The team approach improves efficiency and encourages learning from peers.
Video recording has also been applied within standard OSCEs for post-hoc scoring, re-assessment, and quality assurance. A video-based rating approach has been shown to achieve comparable inter-rater reliability to live assessment.[7] Video-assisted debriefing following simulation stations has been studied as an alternative to verbal debriefing in interprofessional settings.[8] Systematic reviews of peer video feedback in health professions education report generally improved learner reactions, with implementation quality identified as a key variable.[9]
Advantages and limitations
[edit ]Compared with traditional long-case or oral clinical examinations, OSCEs can test several components of clinical competence across multiple stations. Harden and Gleeson identified advantages including advance specification of content, wider sampling of skills, reduced dependence on a single patient or examiner, checklist-based scoring, predefined pass criteria, and feedback to students and staff.[1] : 48
The format also has limitations. Station-based assessment can divide clinical competence into separate tasks and may not assess how a candidate manages a whole patient encounter. OSCEs can also be demanding for examiners and patients, and they require more preparation than traditional clinical examinations, including station design, examiner instructions, checklists and, where used, simulated-patient preparation.[1] : 48
Later commentary has emphasized that OSCEs are not automatically objective; their reliability and validity depend on implementation, including station design, examiner training and scoring methods.[3]
Marking
[edit ]Marking in OSCEs is done by the examiner. Occasionally written stations, for example, writing a prescription chart, are used and these are marked like written examinations, again usually using a standardized mark sheet. One of the ways an OSCE is made objective is by having a detailed mark scheme and standard set of questions. For example, a station concerning the demonstration to a simulated patient on how to use a metered dose inhaler (MDI) would award points for specific actions which are performed safely and accurately. The examiner can often vary the marks depending on how well the candidate performed the step. At the end of the mark sheet, the examiner often has a small number of marks that they can use to weight the station depending on performance and if a simulated patient is used, then they are often asked to add marks depending on the candidates approach. At the end, the examiner is often asked to give a "global score". This is usually used as a subjective score based on the candidates overall performance, not taking into account how many marks the candidate scored. The examiner is usually asked to rate the candidate as pass/borderline/fail or sometimes as excellent/good/pass/borderline/fail. This is then used to determine the individual pass mark for the station.
Many centres allocate each station an individual pass mark. The sum of the pass marks of all the stations determines the overall pass mark for the OSCE. Many centres also impose a minimum number of stations required to pass which ensures that a consistently poor performance is not compensated by a good performance on a small number of stations.
There are, however, criticisms that the OSCE stations can never be truly standardized and objective in the same way as a written exam. It has been known for different patients / actors to afford more assistance, and for different marking criteria to be applied. Finally, it is not uncommon at certain institutions for members of teaching staff be known to students (and vice versa) as the examiner. This familiarity does not necessarily affect the integrity of the examination process, although there is a deviation from anonymous marking. However, in OSCEs that use several circuits of the same stations the marking is repeatedly shown to be very consistent which supports the validity that the OSCE is a fair clinical examination. There are arguments for and against quarantining OSCE examinees to prevent sharing of exam information.[10] Although the data tend to show no improvement in the overall scores in a later OSCE session, the research methodology is flawed and validity of the claim is questionable.[11] A study suggested that marks do not give a sound inference of student collusion in an OSCE.[12]
Preparation
[edit ]Preparing for OSCEs is very different from preparing for an examination on theory. In an OSCE, clinical skills are tested rather than pure theoretical knowledge.[importance? ] It is essential to learn correct clinical methods, and then practice repeatedly until one perfects the methods whilst simultaneously developing an understanding of the underlying theory behind the methods used.[importance? ] Marks are awarded for each step in the method; hence, it is essential to dissect the method into its individual steps, learn the steps, and then learn to perform the steps in a sequence.
Most hospitals and universities have clinical skills labs where students have the opportunity to practice clinical skills such as taking blood or mobilizing patients in a safe and controlled environment. It is often very helpful to practise in small groups with colleagues, setting a typical OSCE scenario and timing it with one person role playing a patient, one person doing the task and if possible, one person either observing and commenting on technique or even role playing the examiner using a sample mark sheet. Many OSCE textbooks have sample OSCE stations and mark sheets that can be helpful when studying in the manner. In doing this the candidate is able to get a feel of running to time and working under pressure.
In many OSCEs the stations are extended using data interpretation. For example, the candidate may have to take a brief history of chest pain and then interpret an electrocardiogram. It is also common to be asked for a differential diagnosis, to suggest which medical investigations the candidate would like to do or to suggest a management plan for the patient.
The peer-assisted mock OSCE improved tutee confidence, reduced the anxieties associated with OSCEs, and improved candidate confidence for OSCE.[13] [14]
See also
[edit ]References
[edit ]- ^ a b c d Harden, R. M.; Gleeson, F. A. (1979). "Assessment of clinical competence using an objective structured clinical examination (OSCE)". Medical Education. 13 (1): 41–54. doi:10.1111/j.1365-2923.1979.tb00918.x.
- ^ a b c Khan, Kamran Z.; Ramachandran, Sankaranarayanan; Gaunt, Kathryn; Pushkar, Piyush (2013). "The Objective Structured Clinical Examination (OSCE): AMEE Guide No. 81. Part I: An historical and theoretical perspective". Medical Teacher. 35 (9): e1437–e1446. doi:10.3109/0142159X.2013.818634 . ISSN 0142-159X. PMID 23968323. S2CID 28150274.
- ^ a b c Harden, Ronald M. (2016). "Revisiting 'Assessment of clinical competence using an objective structured clinical examination (OSCE)'". Medical Education. 50 (4): 376–379. doi:10.1111/medu.12801.
- ^ a b c Hodges, Brian (2003). "OSCE! Variations on a theme by Harden". Medical Education. 37 (12): 1134–1140. doi:10.1046/j.1365-2923.2003.01717.x.
- ^ Amin, Zubair; Eng, Khoo Hoon (2009). Basics in Medical Education (2 ed.). WORLD SCIENTIFIC. doi:10.1142/7044. ISBN 978-981-283-538-3.
- ^ Criscione-Schreiber, Lisa (2020). "Turning Objective Structured Clinical Examinations into Reality" . Rheumatic Disease Clinics of North America. 46 (1): 21–35. doi:10.1016/j.rdc.2019年09月01日0. PMID 31757285. S2CID 208234190.
- ^ Yu Fu et al., Medical Education Online, 2023, doi:10.1080/10872981.2023.2187949
- ^ Rueda-Medina et al., Nurse Education in Practice, 2024, doi:10.1016/j.nepr.2024.103971
- ^ Zhang et al., Nurse Education Today, 2021, doi:10.1016/j.nedt.2021.104603
- ^ "Calls to ensure end-of-year exam fairness". BMA - Connecting doctors. Retrieved 2017年04月13日.
- ^ Yeung, E (April 2, 2017). "Sharing of information in objective structured clinical examinations -- does no evidence of difference mean evidence of no difference?". BMJ Open. 6 (10) e012541. doi:10.1136/bmjopen-2016-012541 . PMC 5073653 . PMID 27729351.
- ^ Parks, R; Warren, P M; Boyd, K M; Cameron, H; Cumming, A; Lloyd-Jones, G (2006). "The Objective Structured Clinical Examination and student collusion: Marks do not tell the whole truth". Journal of Medical Ethics. 32 (12): 734–738. doi:10.1136/jme.2005.015446. PMC 2563344 . PMID 17145916.
- ^ Young, Ian; Montgomery, Kieran; Kearns, Patrick; Hayward, Samantha; Mellanby, Ed (7 May 2014). "The benefits of a peer-assisted mock OSCE" . The Clinical Teacher. 11 (3): 214–218. doi:10.1111/tct.12112. PMID 24802924. S2CID 12122898.
- ^ Braier-Lorimer, Darryl Alexander; Warren-Miell, Hannah (2021年11月25日). "A peer-led mock OSCE improves student confidence for summative OSCE assessments in a traditional medical course". Medical Teacher. 44 (5): 535–540. doi:10.1080/0142159X.2021.2004306 . ISSN 0142-159X. PMID 34822315. S2CID 244660969.