Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE)--A Systematic Review of Rating Scales.

PubMed

Cömert, Musa; Zill, Jördis Maria; Christalle, Eva; Dirmaier, Jörg; Härter, Martin; Scholl, Isabelle

2016-01-01

Teaching and assessment of communication skills have become essential in medical education. The Objective Structured Clinical Examination (OSCE) has been found as an appropriate means to assess communication skills within medical education. Studies have demonstrated the importance of a valid assessment of medical students' communication skills. Yet, the validity of the performance scores depends fundamentally on the quality of the rating scales used in an OSCE. Thus, this systematic review aimed at providing an overview of existing rating scales, describing their underlying definition of communication skills, determining the methodological quality of psychometric studies and the quality of psychometric properties of the identified rating scales. We conducted a systematic review to identify psychometrically tested rating scales, which have been applied in OSCE settings to assess communication skills of medical students. Our search strategy comprised three databases (EMBASE, PsycINFO, and PubMed), reference tracking and consultation of experts. We included studies that reported psychometric properties of communication skills assessment rating scales used in OSCEs by examiners only. The methodological quality of included studies was assessed using the COnsensus based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. The quality of psychometric properties was evaluated using the quality criteria of Terwee and colleagues. Data of twelve studies reporting on eight rating scales on communication skills assessment in OSCEs were included. Five of eight rating scales were explicitly developed based on a specific definition of communication skills. The methodological quality of studies was mainly poor. The psychometric quality of the eight rating scales was mainly intermediate. Our results reveal that future psychometric evaluation studies focusing on improving the methodological quality are needed in order to yield psychometrically

Exploration of Nursing Faculty Members' Lived Experiences of Objective Structured Clinical Examination (OSCE) in Undergraduate Nursing Education

ERIC Educational Resources Information Center

Obizoba, Cordelia O.

2014-01-01

The purpose of this phenomenological study was to gain an understanding of nursing faculty members' lived experiences of Objective Structured Clinical Examination (OSCE) in undergraduate nursing education. As owners of their programs' curriculum, nursing faculties are charged with the responsibility of providing needed knowledge, skills, and…

The dialysis orders objective structured clinical examination (OSCE): a formative assessment for nephrology fellows.

PubMed

Prince, Lisa K; Campbell, Ruth C; Gao, Sam W; Kendrick, Jessica; Lebrun, Christopher J; Little, Dustin J; Mahoney, David L; Maursetter, Laura A; Nee, Robert; Saddler, Mark; Watson, Maura A; Yuan, Christina M

2018-04-01

Few quantitative nephrology-specific simulations assess fellow competency. We describe the development and initial validation of a formative objective structured clinical examination (OSCE) assessing fellow competence in ordering acute dialysis. The three test scenarios were acute continuous renal replacement therapy, chronic dialysis initiation in moderate uremia and acute dialysis in end-stage renal disease-associated hyperkalemia. The test committee included five academic nephrologists and four clinically practicing nephrologists outside of academia. There were 49 test items (58 points). A passing score was 46/58 points. No item had median relevance less than 'important'. The content validity index was 0.91. Ninety-five percent of positive-point items were easy-medium difficulty. Preliminary validation was by 10 board-certified volunteers, not test committee members, a median of 3.5 years from graduation. The mean score was 49 [95% confidence interval (CI) 46-51], κ = 0.68 (95% CI 0.59-0.77), Cronbach's α = 0.84. We subsequently administered the test to 25 fellows. The mean score was 44 (95% CI 43-45); 36% passed the test. Fellows scored significantly less than validators (P < 0.001). Of evidence-based questions, 72% were answered correctly by validators and 54% by fellows (P = 0.018). Fellows and validators scored least well on the acute hyperkalemia question. In self-assessing proficiency, 71% of fellows surveyed agreed or strongly agreed that the OSCE was useful. The OSCE may be used to formatively assess fellow proficiency in three common areas of acute dialysis practice. Further validation studies are in progress.

Assessing Communication Skills of Medical Students in Objective Structured Clinical Examinations (OSCE) - A Systematic Review of Rating Scales

PubMed Central

Cömert, Musa; Zill, Jördis Maria; Christalle, Eva; Dirmaier, Jörg; Härter, Martin; Scholl, Isabelle

2016-01-01

Background Teaching and assessment of communication skills have become essential in medical education. The Objective Structured Clinical Examination (OSCE) has been found as an appropriate means to assess communication skills within medical education. Studies have demonstrated the importance of a valid assessment of medical students’ communication skills. Yet, the validity of the performance scores depends fundamentally on the quality of the rating scales used in an OSCE. Thus, this systematic review aimed at providing an overview of existing rating scales, describing their underlying definition of communication skills, determining the methodological quality of psychometric studies and the quality of psychometric properties of the identified rating scales. Methods We conducted a systematic review to identify psychometrically tested rating scales, which have been applied in OSCE settings to assess communication skills of medical students. Our search strategy comprised three databases (EMBASE, PsycINFO, and PubMed), reference tracking and consultation of experts. We included studies that reported psychometric properties of communication skills assessment rating scales used in OSCEs by examiners only. The methodological quality of included studies was assessed using the COnsensus based Standards for the selection of health status Measurement INstruments (COSMIN) checklist. The quality of psychometric properties was evaluated using the quality criteria of Terwee and colleagues. Results Data of twelve studies reporting on eight rating scales on communication skills assessment in OSCEs were included. Five of eight rating scales were explicitly developed based on a specific definition of communication skills. The methodological quality of studies was mainly poor. The psychometric quality of the eight rating scales was mainly intermediate. Discussion Our results reveal that future psychometric evaluation studies focusing on improving the methodological quality are needed

The dialysis orders objective structured clinical examination (OSCE): a formative assessment for nephrology fellows

PubMed Central

Prince, Lisa K; Campbell, Ruth C; Gao, Sam W; Kendrick, Jessica; Lebrun, Christopher J; Little, Dustin J; Mahoney, David L; Maursetter, Laura A; Nee, Robert; Saddler, Mark; Watson, Maura A

2018-01-01

Abstract Background Few quantitative nephrology-specific simulations assess fellow competency. We describe the development and initial validation of a formative objective structured clinical examination (OSCE) assessing fellow competence in ordering acute dialysis. Methods The three test scenarios were acute continuous renal replacement therapy, chronic dialysis initiation in moderate uremia and acute dialysis in end-stage renal disease-associated hyperkalemia. The test committee included five academic nephrologists and four clinically practicing nephrologists outside of academia. There were 49 test items (58 points). A passing score was 46/58 points. No item had median relevance less than ‘important’. The content validity index was 0.91. Ninety-five percent of positive-point items were easy–medium difficulty. Preliminary validation was by 10 board-certified volunteers, not test committee members, a median of 3.5 years from graduation. The mean score was 49 [95% confidence interval (CI) 46–51], κ = 0.68 (95% CI 0.59–0.77), Cronbach’s α = 0.84. Results We subsequently administered the test to 25 fellows. The mean score was 44 (95% CI 43–45); 36% passed the test. Fellows scored significantly less than validators (P < 0.001). Of evidence-based questions, 72% were answered correctly by validators and 54% by fellows (P = 0.018). Fellows and validators scored least well on the acute hyperkalemia question. In self-assessing proficiency, 71% of fellows surveyed agreed or strongly agreed that the OSCE was useful. Conclusions The OSCE may be used to formatively assess fellow proficiency in three common areas of acute dialysis practice. Further validation studies are in progress. PMID:29644053

Back to the future: An online OSCE Management Information System for nursing OSCEs.

PubMed

Meskell, Pauline; Burke, Eimear; Kropmans, Thomas J B; Byrne, Evelyn; Setyonugroho, Winny; Kennedy, Kieran M

2015-11-01

The Objective Structured Clinical Examination (OSCE) is an established tool in the repertoire of clinical assessment methods in nurse education. The use of OSCEs facilitates the assessment of psychomotor skills as well as knowledge and attitudes. Identified benefits of OSCE assessment include development of students' confidence in their clinical skills and preparation for clinical practice. However, a number of challenges exist with the traditional paper methodology, including documentation errors and inadequate student feedback. To explore electronic OSCE delivery and evaluate the benefits of using an electronic OSCE management system. To explore assessors' perceptions of and attitudes to the computer based package. This study was conducted using electronic software in the management of a four station OSCE assessment with a cohort of first year undergraduate nursing students delivered over two consecutive years (n=203) in one higher education institution in Ireland. A quantitative descriptive survey methodology was used to obtain the views of the assessors on the process and outcome of using the software. OSCE documentation was converted to electronic format. Assessors were trained in the use of the OSCE management software package and laptops were procured to facilitate electronic management of the OSCE assessment. Following the OSCE assessment, assessors were invited to evaluate the experience. Electronic software facilitated the storage and analysis of overall group and individual results thereby offering considerable time savings. Submission of electronic forms was allowed only when fully completed thus removing the potential for missing data. The feedback facility allowed the student to receive timely evaluation on their performance and to benchmark their performance against the class. Assessors' satisfaction with the software was high. Analysis of assessment results can highlight issues around internal consistency being moderate and examiners variability

Peer-assisted teaching student tutors as examiners in an orthopedic surgery OSCE station – pros and cons

PubMed Central

Melcher, Peter; Zajonz, Dirk; Roth, Andreas; Heyde, Christoph-E.; Ghanem, Mohamed

2016-01-01

Background: The OSCE (objective structured clinical examination) is composed of oral and practical examination in order to examine students’ abilities to imply clinical examination techniques and to interact with patients. The examiners for this procedure can be either lecturers or peers. The aim of this work is to evaluate the peer-assisted teaching student tutors as examiners in an orthopedic surgery OSCE station. Methods: We analyzed the OSCE data from 2013 to 2015. During this period over 300 medical students were examined each year. An evaluation was conducted at an orthopedic station and examined by peer students to assess the advantages and disadvantages of peer-assisted teaching student tutors as examiners. Results: We have noticed that student peers are more flexible regarding their schedule and they have been well trained for OSCE. Concerning the economic aspects, student peers are clearly of major economic advantage. Disadvantages were not reported in our study probably because peers were well trained and the checklists are monitored regularly. Conclusion: Student peers in OSCE are of major advantage due to their flexible time schedule and relatively low costs. They must be well trained and the checklists are to be monitored regularly. Our study shows that peer tutor examiners conducted the examination as competent as lecture examiners. However, legal restrictions on the employment of students should be considered. PMID:27500078

Computer assisted Objective structured clinical examination versus Objective structured clinical examination in assessment of Dermatology undergraduate students.

PubMed

Chaudhary, Richa; Grover, Chander; Bhattacharya, S N; Sharma, Arun

2017-01-01

The assessment of dermatology undergraduates is being done through computer assisted objective structured clinical examination at our institution for the last 4 years. We attempted to compare objective structured clinical examination (OSCE) and computer assisted objective structured clinical examination (CA-OSCE) as assessment tools. To assess the relative effectiveness of CA-OSCE and OSCE as assessment tools for undergraduate dermatology trainees. Students underwent CA-OSCE as well as OSCE-based evaluation of equal weightage as an end of posting assessment. The attendance as well as the marks in both the examination formats were meticulously recorded and statistically analyzed using SPSS version 20.0. Intercooled Stata V9.0 was used to assess the reliability and internal consistency of the examinations conducted. Feedback from both students and examiners was also recorded. The mean attendance for the study group was 77% ± 12.0%. The average score on CA- OSCE and OSCE was 47.4% ± 19.8% and 53.5% ± 18%, respectively. These scores showed a mutually positive correlation, with Spearman's coefficient being 0.593. Spearman's rank correlation coefficient between attendance scores and assessment score was 0.485 for OSCE and 0.451 for CA-OSCE. The Cronbach's alpha coefficient for all the tests ranged from 0.76 to 0.87 indicating high reliability. The comparison was based on a single batch of 139 students. Such an evaluation on more students in larger number of batches over successive years could help throw more light on the subject. Computer assisted objective structured clinical examination was found to be a valid, reliable and effective format for dermatology assessment, being rated as the preferred format by examiners.

In the Minds of OSCE Examiners: Uncovering Hidden Assumptions

ERIC Educational Resources Information Center

Chahine, Saad; Holmes, Bruce; Kowalewski, Zbigniew

2016-01-01

The Objective Structured Clinical Exam (OSCE) is a widely used method of assessment in medical education. Rater cognition has become an important area of inquiry in the medical education assessment literature generally, and in the OSCE literature specifically, because of concerns about potential compromises of validity. In this study, a novel…

Development, implementation, and evaluation of an integrated multidisciplinary Objective Structured Clinical Examination (OSCE) in primary health care settings within limited resources.

PubMed

Abdelaziz, Adel; Hany, Mohamed; Atwa, Hani; Talaat, Wagdy; Hosny, Somaya

2016-01-01

In ordinary circumstances, objective structured clinical examination (OSCE) is a resource-intensive assessment method. In case of developing and implementing multidisciplinary OSCE, there is no doubt that the cost will be greater. Through this study a research project was conducted to develop, implement and evaluate a multidisciplinary OSCE model within limited resources. This research project went through the steps of blueprinting, station writing, resources reallocation, implementation and finally evaluation. The developed model was implemented in the Primary Health Care (PHC) program which is one of the pillars of the Community-Based undergraduate curriculum of the Faculty of Medicine, Suez Canal University (FOM-SCU). Data for evaluation of the implemented OSCE model were derived from two resources. First, feedback of the students and assessors through self-administered questionnaires was obtained. Second, evaluation of the OSCE psychometrics was done. The deliverables of this research project included a set of validated integrated multi-disciplinary and low cost OSCE stations with an estimated reliability index of 0.6. After having this experience, we have a critical mass of faculty members trained on blueprinting and station writing and a group of trained assessors, facilitators and role players. Also there is a state of awareness among students on how to proceed in this type of OSCE which renders future implementation more feasible.

Assessment of percutaneous renal access skills during Urology Objective Structured Clinical Examinations (OSCE)

PubMed Central

Noureldin, Yasser A.; Elkoushy, Mohamed A.; Andonian, Sero

2015-01-01

Introduction: The first objective was to assess percutaneous renal access (PCA) skills of urology postgraduate trainees (PGTs) during the Objective Structured Clinical Examinations (OSCEs). The second objective was to determine whether previous experience with percutaneous nephrolithotomy (PCNL) improved performance. Methods: After obtaining ethics approval, we recruited PGTs from two urology programs in Quebec between postgraduate years (PGY-3 to PGY-5). Each trainee was asked to answer a short questionnaire regarding previous experience in endourologic procedures. After a 3-minute orientation on the PERC Mentor simulator (Simbionix, Cleveland, OH), each trainee was asked to perform task 4, where they had to correctly access all of the renal calyces and pop the balloons in a normal left kidney model. We collected and analyzed data from the questionnaire and the performance report generated by the simulator. Results: In total, 13 PGTs participated in this study. PGTs had performed a median of 200 (range: 50–1000) cystoscopies, 50 (range: 10–125) TURBTs, 30 (range: 0–100) TURPs, 5 (range: 0–50) laser prostatectomies, and 50 (range: 2–125) ureteroscopies prior to this OSCE. PGTs with previous PCNL experience (8/13) had performed a mean of 18.6 ± 6.3 PCNLs. PGTs with previous PCNL experience performed significantly better in terms of shorter fluoroscopy time (10 ± 1.5 vs. 5.1 ± 0.7 min; p = 0.04), fewer attempts required for successful puncture of the pelvi-calyceal system (PCS) (21 ± 2.3 vs. 13 ± 1.8; p = 0.02), and had significantly lower complications in terms of fewer infundibular injury (7.4 ± 1.5 vs. 2 ± 0.4; p = 0.004) and fewer PCS perforations (11 ± 1.7 vs. 4.5 ± 1.2; p = 0.01). Conclusion: It is feasible to use the PERC Mentor simulator during OSCEs to assess PCA skills of urology PGTs. PGTs who had previous PCNL experience performed significantly better with fewer complications. PMID:25844094

Effect of Clinically Discriminating, Evidence-Based Checklist Items on the Reliability of Scores from an Internal Medicine Residency OSCE

ERIC Educational Resources Information Center

Daniels, Vijay J.; Bordage, Georges; Gierl, Mark J.; Yudkowsky, Rachel

2014-01-01

Objective structured clinical examinations (OSCEs) are used worldwide for summative examinations but often lack acceptable reliability. Research has shown that reliability of scores increases if OSCE checklists for medical students include only clinically relevant items. Also, checklists are often missing evidence-based items that high-achieving…

Rasch analysis on OSCE data : An illustrative example.

PubMed

Tor, E; Steketee, C

2011-01-01

The Objective Structured Clinical Examination (OSCE) is a widely used tool for the assessment of clinical competence in health professional education. The goal of the OSCE is to make reproducible decisions on pass/fail status as well as students' levels of clinical competence according to their demonstrated abilities based on the scores. This paper explores the use of the polytomous Rasch model in evaluating the psychometric properties of OSCE scores through a case study. The authors analysed an OSCE data set (comprised of 11 stations) for 80 fourth year medical students based on the polytomous Rasch model in an effort to answer two research questions: (1) Do the clinical tasks assessed in the 11 OSCE stations map on to a common underlying construct, namely clinical competence? (2) What other insights can Rasch analysis offer in terms of scaling, item analysis and instrument validation over and above the conventional analysis based on classical test theory? The OSCE data set has demonstrated a sufficient degree of fit to the Rasch model (Χ(2) = 17.060, DF=22, p=0.76) indicating that the 11 OSCE station scores have sufficient psychometric properties to form a measure for a common underlying construct, i.e. clinical competence. Individual OSCE station scores with good fit to the Rasch model (p > 0.1 for all Χ(2) statistics) further corroborated the characteristic of unidimensionality of the OSCE scale for clinical competence. A Person Separation Index (PSI) of 0.704 indicates sufficient level of reliability for the OSCE scores. Other useful findings from the Rasch analysis that provide insights, over and above the analysis based on classical test theory, are also exemplified using the data set. The polytomous Rasch model provides a useful and supplementary approach to the calibration and analysis of OSCE examination data.

'Hello, my name is Gabriel, I am the house officer, may I examine you?' or the Objective Santa Christmas Examination (OSCE).

PubMed

Wood, D; Roberts, T; Bradley, P; Lloyd, D; O'Neill, P

1999-12-01

To design a clinical examination of high content validity suitable for use as a formative assessment tool with pre-registration house officers (PRHO'S) towards the end of their first house officer post. A multicentre collaboration between four UK medical schools who offer undergraduate curricula which are problem-based, systems-based, patient-orientated, student-centred, jargon-laden and utterly staff-bewildering. An objective structured clinical examination (OSCE) which is suitable for use with graduates of UK medical schools. It assesses the knowledge, skills and attitudes essential for future careers in a hierarchical system where protecting the senior staff from all forms of irritation is paramount. PRHO'S who excel in this examination get better references. The OSCE format can be used to provide 'real-life' scenarios appropriate to the season.

Item Analysis to Improve Reliability for an Internal Medicine Undergraduate OSCE

ERIC Educational Resources Information Center

Auewarakul, Chirayu; Downing, Steven M.; Praditsuwan, Rungnirand; Jaturatamrong, Uapong

2005-01-01

Utilization of objective structured clinical examinations (OSCEs) for final assessment of medical students in Internal Medicine requires a representative sample of OSCE stations. The reliability and generalizability of OSCE scores provides validity evidence for OSCE scores and supports its contribution to the final clinical grade of medical…

Clinical examiners, simulated patients, and student self-assessed empathy in medical students during a psychiatry objective structured clinical examination.

PubMed

O'Connor, Karen; King, Romaine; Malone, Kevin M; Guerandel, Allys

2014-08-01

This study aims to assess and compare objective and subjective scores of empathy in final-year medical students by using firstly a validated student self-assessment just prior to the psychiatry objective structured clinical examination (OSCE), and then comparing this to clinical examiner's and simulated patient's (SP's) assessments of empathy of students using a Global Rating of Empathy scale (GRE) during a psychiatry OSCE. In 2011, all final-year medical students in the University College Dublin were invited to complete a subjective, self-assessed empathy questionnaire (The Jefferson scale of physician empathy-student version (JSPE-S)). They were also assessed for empathy in four OSCEs by the clinical examiner and the SP acting in that OSCE scenario. Included in the analysis were 163 of 184 final-year students JSPE-S (88.6%) questionnaires. The female students scores on the JSPE-S were significantly higher than those of their male peers (t=3.34, p=0.001). Concurrent validity was greater between the SPs' assessments of empathy in the OSCE and the JSPE-S score than between the clinical examiners assessments of empathy and the JSPE-S score (r=0.23, p<0.005; r=0.14, p<0.08). Inter-rater reliability of SP's and clinical examiner's using the GRE was found to be high (F=0.868 (df=171, 171), p value<0.001). SPs may be valid assessors of empathy in medical students during an OSCE.

Undesired variance due to examiner stringency/leniency effect in communication skill scores assessed in OSCEs.

PubMed

Harasym, Peter H; Woloschuk, Wayne; Cunning, Leslie

2008-12-01

Physician-patient communication is a clinical skill that can be learned and has a positive impact on patient satisfaction and health outcomes. A concerted effort at all medical schools is now directed at teaching and evaluating this core skill. Student communication skills are often assessed by an Objective Structure Clinical Examination (OSCE). However, it is unknown what sources of error variance are introduced into examinee communication scores by various OSCE components. This study primarily examined the effect different examiners had on the evaluation of students' communication skills assessed at the end of a family medicine clerkship rotation. The communication performance of clinical clerks from Classes 2005 and 2006 were assessed using six OSCE stations. Performance was rated at each station using the 28-item Calgary-Cambridge guide. Item Response Theory analysis using a Multifaceted Rasch model was used to partition the various sources of error variance and generate a "true" communication score where the effects of examiner, case, and items are removed. Variance and reliability of scores were as follows: communication scores (.20 and .87), examiner stringency/leniency (.86 and .91), case (.03 and .96), and item (.86 and .99), respectively. All facet scores were reliable (.87-.99). Examiner variance (.86) was more than four times the examinee variance (.20). About 11% of the clerks' outcome status shifted using "true" rather than observed/raw scores. There was large variability in examinee scores due to variation in examiner stringency/leniency behaviors that may impact pass-fail decisions. Exploring the benefits of examiner training and employing "true" scores generated using Item Response Theory analyses prior to making pass/fail decisions are recommended.

The OSCE Has Landed: One Small Step for British Psychiatry?

ERIC Educational Resources Information Center

Sauer, Justin; Hodges, Brian; Santhouse, Alastair; Blackwood, Nigel

2005-01-01

Objective: In the United Kingdom (UK), an objective structured clinical examination (OSCE) has replaced the individual patient assessment (IPA) for part 1 of the membership examination of the Royal College of Psychiatrists (MRCPsych). The authors' assessment of the OSCE was conducted. Method: Residents completed and evaluated an OSCE designed…

Undesired Variance Due to Examiner Stringency/Leniency Effect in Communication Skill Scores Assessed in OSCEs

ERIC Educational Resources Information Center

Harasym, Peter H.; Woloschuk, Wayne; Cunning, Leslie

2008-01-01

Physician-patient communication is a clinical skill that can be learned and has a positive impact on patient satisfaction and health outcomes. A concerted effort at all medical schools is now directed at teaching and evaluating this core skill. Student communication skills are often assessed by an Objective Structure Clinical Examination (OSCE).…

Reliability of the OSCE for Physical and Occupational Therapists

PubMed Central

Sakurai, Hiroaki; Kanada, Yoshikiyo; Sugiura, Yoshito; Motoya, Ikuo; Wada, Yosuke; Yamada, Masayuki; Tomita, Masao; Tanabe, Shigeo; Teranishi, Toshio; Tsujimura, Toru; Sawa, Syunji; Okanishi, Tetsuo

2014-01-01

[Purpose] To examine agreement rates between faculty members and clinical supervisors as OSCE examiners. [Subjects] The study subjects were involved physical and occupational therapists working in clinical environments for 1 to 5 years after graduating from training schools as OSCE examinees, and a physical or occupational therapy faculty member and a clinical supervisor as examiners. Another clinical supervisor acted as a simulated patient. [Methods] The agreement rate between the examiners for each OSCE item was calculated based on Cohen’s kappa coefficient to confirm inter-rater reliability. [Results] The agreement rates for the behavioral aspects of the items were higher in the second than in the first examination. Similar increases were also observed in the agreement rates for the technical aspects until the initiation of each activity; however, the rates decreased during the middle to terminal stages of continuous movements. [Conclusion] The results may reflect the recent implementation of measures for the integration of therapist education in training schools and clinical training facilities. PMID:25202170

How to assess communication, professionalism, collaboration and the other intrinsic CanMEDS roles in orthopedic residents: use of an objective structured clinical examination (OSCE)

PubMed Central

Dwyer, Tim; Takahashi, Susan Glover; Hynes, Melissa Kennedy; Herold, Jodi; Wasserstein, David; Nousiainen, Markku; Ferguson, Peter; Wadey, Veronica; Murnaghan, M. Lucas; Leroux, Tim; Semple, John; Hodges, Brian; Ogilvie-Harris, Darrell

2014-01-01

Background Assessing residents’ understanding and application of the 6 intrinsic CanMEDS roles (communicator, professional, manager, collaborator, health advocate, scholar) is challenging for postgraduate medical educators. We hypothesized that an objective structured clinical examination (OSCE) designed to assess multiple intrinsic CanMEDS roles would be sufficiently reliable and valid. Methods The OSCE comprised 6 10-minute stations, each testing 2 intrinsic roles using case-based scenarios (with or without the use of standardized patients). Residents were evaluated using 5-point scales and an overall performance rating at each station. Concurrent validity was sought by correlation with in-training evaluation reports (ITERs) from the last 12 months and an ordinal ranking created by program directors (PDs). Results Twenty-five residents from postgraduate years (PGY) 0, 3 and 5 participated. The interstation reliability for total test scores (percent) was 0.87, while reliability for each of the communicator, collaborator, manager and professional roles was greater than 0.8. Total test scores, individual station scores and individual CanMEDS role scores all showed a significant effect by PGY level. Analysis of the PD rankings of intrinsic roles demonstrated a high correlation with the OSCE role scores. A correlation was seen between ITER and OSCE for the communicator role, while the ITER medical expert and total scores highly correlated with the communicator, manager and professional OSCE scores. Conclusion An OSCE designed to assess the intrinsic CanMEDS roles was sufficiently valid and reliable for regular use in an orthopedic residency program. PMID:25078926

Effect of clinically discriminating, evidence-based checklist items on the reliability of scores from an Internal Medicine residency OSCE.

PubMed

Daniels, Vijay J; Bordage, Georges; Gierl, Mark J; Yudkowsky, Rachel

2014-10-01

Objective structured clinical examinations (OSCEs) are used worldwide for summative examinations but often lack acceptable reliability. Research has shown that reliability of scores increases if OSCE checklists for medical students include only clinically relevant items. Also, checklists are often missing evidence-based items that high-achieving learners are more likely to use. The purpose of this study was to determine if limiting checklist items to clinically discriminating items and/or adding missing evidence-based items improved score reliability in an Internal Medicine residency OSCE. Six internists reviewed the traditional checklists of four OSCE stations classifying items as clinically discriminating or non-discriminating. Two independent reviewers augmented checklists with missing evidence-based items. We used generalizability theory to calculate overall reliability of faculty observer checklist scores from 45 first and second-year residents and predict how many 10-item stations would be required to reach a Phi coefficient of 0.8. Removing clinically non-discriminating items from the traditional checklist did not affect the number of stations (15) required to reach a Phi of 0.8 with 10 items. Focusing the checklist on only evidence-based clinically discriminating items increased test score reliability, needing 11 stations instead of 15 to reach 0.8; adding missing evidence-based clinically discriminating items to the traditional checklist modestly improved reliability (needing 14 instead of 15 stations). Checklists composed of evidence-based clinically discriminating items improved the reliability of checklist scores and reduced the number of stations needed for acceptable reliability. Educators should give preference to evidence-based items over non-evidence-based items when developing OSCE checklists.

Evaluation of Clinical and Communication Skills of Pharmacy Students and Pharmacists with an Objective Structured Clinical Examination.

PubMed

Urteaga, Elizabeth M; Attridge, Rebecca L; Tovar, John M; Witte, Amy P

2015-10-25

Objective. To evaluate how effectively pharmacy students and practicing pharmacists communicate and apply knowledge to simulations of commonly encountered patient scenarios using an objective structured clinical examination (OSCE). Design. Second-, third-, and fourth-year pharmacy students completed an OSCE as part of their required courses in 2012 and 2013. All students in both years completed identical OSCE cases. Licensed pharmacists were recruited to complete the OSCE and serve as controls in 2012. A survey assessed student perception and acceptance of the OSCE as well as student confidence in performance. Assessment. Licensed pharmacists had significantly higher clinical and communication skills scores than did pharmacy students. Student progression in communication and clinical skills improved significantly over time. Survey results indicated that students felt the OSCE was well-structured and assessed clinical skills taught in pharmacy school; 86% of students felt confident they could provide these skills. Conclusion. Objective structured clinical examinations can evaluate clinical competence and communication skills among professional students. Implementation of OSCEs may be an effective tool for assessment of the Center for the Advancement of Pharmacy Education domains.

Item Dependency in an Objective Structured Clinical Examination

ERIC Educational Resources Information Center

Iramaneerat, Cherdsak; Myford, Carol M.; Yudkowsky, Rachel

2006-01-01

An Objective Structured Clinical Examination (OSCE) is an assessment approach employed in medical education, in which residents rotate through multiple stations of standardized clinical tasks to evaluate their clinical competence. Because items used to evaluate residents' performance in each OSCE station are linked to the same task and are rated…

Association of the pre-internship objective structured clinical examination in final year medical students with comprehensive written examinations.

PubMed

Eftekhar, Hasan; Labaf, Ali; Anvari, Pasha; Jamali, Arsia; Sheybaee-Moghaddam, Farshad

2012-01-01

The purpose of this study is to evaluate the association of the pre-internship Objective Structured Clinical Examination (OSCE) in final year medical students with comprehensive written examinations. SUBJECTS AND MATERIAL: All medical students of October 2004 admission who took part in the October 2010 National Comprehensive Pre-internship Examination (NCPE) and pre-internship OSCE were included in the study (n = 130). OSCE and NCPE scores and medical grade point average (GPA) were collected. GPA was highly correlated with NCPE (r = 0.76 and P<0.001) and moderately with OSCE (r = 0.68 and P < 0.001). Similarly a moderate correlation was observed between NCPE and OSCE scores(r = 0.6 and P < 0.001).Linear stepwise regression shows r(2) of a model applying GPA as predictor of OSCE score is 0.46 (β = 0.68 and P < 0.001), while addition of gender to the model increases r(2) to 0.59 (β = 0.61 and 0.36, for GPA and male gender, respectively and P < 0.001). Logistic forward regression models shows male gender and GPA are the only dependent predictors of high score in OSCE. OR of GPA and male gender for high OSCE score are 4.89 (95% CI = 2.37-10.06) and 6.95 (95% CI = 2.00-24.21), respectively (P < 0.001). Our findings indicate OSCE and examination which mainly evaluate knowledge, judged by GPA and NCPE are moderately to highly correlated. Our results illustrate the interwoven nature of knowledge and clinical skills. In other words, certain level of knowledge is crucial for appropriate clinical performance. Our findings suggest neither OSCE nor written forms of assessments can replace each other. They are complimentary and should also be combined by other evaluations to cover all attributes of clinical competence efficiently.

Association of the pre-internship objective structured clinical examination in final year medical students with comprehensive written examinations

PubMed Central

Eftekhar, Hasan; Labaf, Ali; Anvari, Pasha; Jamali, Arsia; Sheybaee-Moghaddam, Farshad

2012-01-01

Aim The purpose of this study is to evaluate the association of the pre-internship Objective Structured Clinical Examination (OSCE) in final year medical students with comprehensive written examinations. Subjects and material All medical students of October 2004 admission who took part in the October 2010 National Comprehensive Pre-internship Examination (NCPE) and pre-internship OSCE were included in the study (n=130). OSCE and NCPE scores and medical grade point average (GPA) were collected. Results GPA was highly correlated with NCPE (r=0.76 and P<0.001) and moderately with OSCE (r=0.68 and P<0.001). Similarly a moderate correlation was observed between NCPE and OSCE scores(r=0.6 and P<0.001).Linear stepwise regression shows r 2 of a model applying GPA as predictor of OSCE score is 0.46 (β=0.68 and P<0.001), while addition of gender to the model increases r 2 to 0.59 (β=0.61 and 0.36, for GPA and male gender, respectively and P<0.001). Logistic forward regression models shows male gender and GPA are the only dependent predictors of high score in OSCE. OR of GPA and male gender for high OSCE score are 4.89 (95% CI=2.37–10.06) and 6.95 (95% CI=2.00–24.21), respectively (P<0.001). Discussion Our findings indicate OSCE and examination which mainly evaluate knowledge, judged by GPA and NCPE are moderately to highly correlated. Our results illustrate the interwoven nature of knowledge and clinical skills. In other words, certain level of knowledge is crucial for appropriate clinical performance. Our findings suggest neither OSCE nor written forms of assessments can replace each other. They are complimentary and should also be combined by other evaluations to cover all attributes of clinical competence efficiently. PMID:22547924

Competency-Based Training: Objective Structured Clinical Exercises (OSCE) in Marriage and Family Therapy

ERIC Educational Resources Information Center

Miller, John K.

2010-01-01

The field of marriage and family therapy (MFT) has recently engaged in the process of defining core competencies for the profession. Many MFT training programs are adapting their curriculum to develop more competency-based training strategies. The Objective Structured Clinical "Examination" (OSCE) is widely used in the medical profession to assess…

Does studying for an objective structured clinical examination make a difference?

PubMed

Mavis, B E

2000-10-01

This study examines the extent to which second-year medical students studied for an objective structured clinical examination (OSCE), how they studied, and the impact of self-reported studying on OSCE performance. One class of 113 medical students completed an end-of-second-year OSCE, held on two consecutive evenings. The OSCE was comprised of eight stations, each of which was of 20 minutes' duration. The OSCE was formative: students received performance feedback but were not graded. Prior to the OSCE, students completed a brief survey regarding their preparation for the OSCE and their perceptions of confidence, anxiety and preparedness. Only 78 students returned surveys with names, comprising the data for these analyses. Mean studying time was 3.3 h, ranging from 0 to 19 h. Studying time was positively associated with age and negatively associated with basic science examination scores. The most study time was dedicated to reviewing the physical examination textbook, class notes and supplemental course readings. The breadth of study strategies increased as more time was spent in OSCE preparation. OSCE performance was related to study time and to achievement on pre-clinical basic science examinations. The students whose performance was above average seemed to be the talented students whose records indicated a history of academic success. The amount of time they reported for OSCE preparation was comparable to that reported by students with below average performance. It appears that prior academic performance rather than preparatory studying time is a better predictor of OSCE outcomes.

Can teaching hospitals use serial formative OSCEs to improve student performance?

PubMed

Lien, Heng-Hui; Hsu, Sang-Feng; Chen, Shu-Chen; Yeh, Jiann-Horng

2016-10-14

We report on interns' clinical competence and experiences of an objective structured clinical examination (OSCE) training program over 3 years. We aimed to determine whether repeated formative OSCEs allow teaching hospitals to improve the effectiveness of clinical training and help interns to achieve high scores in the national summative OSCE. This study included 207 participants, among whom 82 were interns who had completed four mock OSCEs and a national OSCE at the clinical center of Cathay General Hospital (CGH). The other 125 participants were final-year medical students from Fu-Jen University who had completed the national OSCE between 2013 and 2015 at one of four teaching hospitals (including CGH). CGH interns were categorized into three groups according to the medical school attended and Fu-Jen University students were grouped according to their training hospitals. CGH held four mock OSCEs (30 stations), whereas each of the four training hospitals for Fu-Jen students each held one or two OSCEs (6-12 stations) annually. Differences in the mean OSCE scores among groups were analyzed. The medical school attended, pre-internship OSCE experience and the frequency of mock OSCEs held by training hospitals were independent factors in this study. The cumulative mean scores for five OSCEs among three groups of students trained at CGH tended to increase from the first OSCE (OSCE1) to the fifth (OSCE5). The mean score of the students who attended Fu-Jen Medical School was higher than that of students who graduated from foreign medical schools in all five OSCEs; however, the differences were significant only for OSCE2 (P = 0.022) and OSCE3 (P = 0.027). The mean national OSCE scores of FJU students showed no statistically significant differences among the four training hospitals for 2013; however, students training at CGH had significantly higher mean scores in the 2014 (P = 0.001) and 2015 (P = 0.005) OSCEs compared with students training at the other three

Testing clinical competencies in undergraduate nursing education using Objective Structured Clinical Examination (OSCE) – a literature review of international practice

PubMed

Beyer, Angelika; Dreier, Adina; Kirschner, Stefanie; Hoffmann, Wolfgang

2016-07-01

Background: In response to demographic trends in Germany nursing competencies are currently reevaluated. Since these have to be taught and trained in nursing education programs, efficient verification of the success is necessary. OSCEs are internationally well-recognized as a comprehensive tool for that. Aim: In this analysis we identified competencies worldwide, which are tested by OSCEs in undergraduate nursing education programs. Method: An international literature research was conducted. The selection criterion for an article was the specification of at least one verifiable competency. Afterwards the competencies were categorized into knowledge, skills and attitudes according to the German “Fachqualifikationsrahmen Pflege für die hochschulische Bildung”. Results: A total of 36 publications fulfilled all inclusion criteria. Relevant studies were predominantly initiated in the UK, Canada and Australia. Within all categories a total of n = 166 different competencies are mentioned. OSCEs are developed and performed in a broad range of methods. Most frequently skills were verified. The most common topic was sure handling of medication. Other important themes were communicative competencies in relation to patients and the ability of self-evaluation. Discussion/Conclusions: A variation in examination methods is appropriate as different competencies are acquired in preparation of the test. Evaluation took place on an individual or institutional level. Further research is needed.

Enhancing OSCE preparedness with video exemplars in undergraduate nursing students. A mixed method study.

PubMed

Massey, D; Byrne, J; Higgins, N; Weeks, B; Shuker, M-A; Coyne, E; Mitchell, M; Johnston, A N B

2017-07-01

Objective structured clinical examinations (OSCEs) are designed to assess clinical skill performance and competency of students in preparation for 'real world' clinical responsibilities. OSCEs are commonly used in health professional education and are typically associated with high levels of student anxiety, which may present a significant barrier to performance. Students, including nursing students, have identified that flexible access to exemplar OSCEs might reduce their anxiety and enable them to better prepare for such examinations. To implement and evaluate an innovative approach to preparing students for OSCEs in an undergraduate (registration) acute care nursing course. A set of digitized OSCE exemplars were prepared and embedded in the University-based course website as part of usual course learning activities. Use of the exemplars was monitored, pre and post OSCE surveys were conducted, and qualitative data were collected to evaluate the approach. OSCE grades were also examined. The online OSCE exemplars increased self-rated student confidence, knowledge, and capacity to prepare and provided clarity around assessment expectations. OSCE exemplars were accessed frequently and positively received; but did not impact on performance. Video exemplars aid student preparation for OSCEs, providing a flexible, innovative and clear example of the assessment process. Video exemplars improved self-rated student confidence and understanding of performance expectations, leading to increased engagement and reduced anxiety when preparing for the OSCE, but not overall OSCE performance. Such OSCE exemplars could be used to increase staff capacity and improve the quality of the student learning experience. Crown Copyright © 2017. Published by Elsevier Ltd. All rights reserved.

An exploration of student nurses' thoughts and experiences of using a video-recording to assess their performance of cardiopulmonary resuscitation (CPR) during a mock objective structured clinical examination (OSCE).

PubMed

Paul, Fiona

2010-09-01

Cardiopulmonary resuscitation (CPR) is an essential skill taught within undergraduate nursing programmes. At the author's institution, students must pass the CPR objective structured clinical examination (OSCE) before progressing to second year. However, some students have difficulties developing competence in CPR and evidence suggests that resuscitation skills may only be retained for several months. This has implications for practice as nurses are required to be competent in CPR. Therefore, further opportunities for students to develop these skills are necessary. An action research project was conducted with six students who were assessed by an examiner at a video-recorded mock OSCE. Students self-assessed their skills using the video and a checklist. Semi-structured interviews were conducted to compare checklist scores, and explore students' thoughts and experiences of the OSCE. The findings indicate that students may need to repeat this exercise by comparing their previous and current performances to develop both their self-assessment and CPR skills. Although there were some differences between the examiner's and student's checklist scores, all students reported the benefits of participating in this project, e.g. discussion and identification of knowledge and skills deficits, thus emphasising the benefits of formative assessments to prepare students for summative assessments and ultimately clinical practice. (c) 2010 Elsevier Ltd. All rights reserved.

Use of an Objective Structured Clinical Examination in Clinical Nurse Specialist Education.

PubMed

Cuevas, Heather E; Timmerman, Gayle M

2016-01-01

Helping patients maximize their potential using expert coaching to facilitate lifestyle change is an important practice area for clinical nurse specialists (CNSs). The purpose is to determine the usefulness of objective structured clinical examinations (OSCEs) for evaluating CNS students' coaching competencies in the context of facilitating lifestyle change. Despite the use of OSCEs to assess competencies in clinical skills (eg, performance of procedures, decision making), its potential for evaluating coaching competencies for lifestyle change has not been demonstrated. We developed 4 OSCEs dealing with coaching patients in exercise, weight loss, stress reduction, or nonpharmacologic management of hyperlipidemia. Evaluation criteria included (1) approach to the patient, (2) information gathering, (3) motivational interviewing, and (4) management (medical and behavioral strategies). Student performance ranged from highly organized with proficient coaching skills to disorganized and focused solely on clinical management and prescriptive communication. Student responses were positive. Objective structured clinical examinations were highly useful for evaluating CNS students' coaching competencies for lifestyle change. Using OSCEs early in the semester to provide students feedback on their performance and again at the end to determine improvement optimizes use of this teaching strategy.

Feedback in the OSCE: What Do Residents Remember?

PubMed

Humphrey-Murto, Susan; Mihok, Marika; Pugh, Debra; Touchie, Claire; Halman, Samantha; Wood, Timothy J

2016-01-01

The move to competency-based education has heightened the importance of direct observation of clinical skills and effective feedback. The Objective Structured Clinical Examination (OSCE) is widely used for assessment and affords an opportunity for both direct observation and feedback to occur simultaneously. For feedback to be effective, it should include direct observation, assessment of performance, provision of feedback, reflection, decision making, and use of feedback for learning and change. If one of the goals of feedback is to engage students to think about their performance (i.e., reflection), it would seem imperative that they can recall this feedback both immediately and into the future. This study explores recall of feedback in the context of an OSCE. Specifically, the purpose of this study was to (a) determine the amount and the accuracy of feedback that trainees remember immediately after an OSCE, as well as 1 month later, and (b) assess whether prompting immediate recall improved delayed recall. Internal medicine residents received 2 minutes of verbal feedback from physician examiners in the context of an OSCE. The feedback was audio-recorded and later transcribed. Residents were randomly allocated to the immediate recall group (immediate-RG; n = 10) or the delayed recall group (delayed-RG; n = 8). The immediate-RG completed a questionnaire prompting recall of feedback received immediately after the OSCE, and then again 1 month later. The delayed-RG completed a questionnaire only 1 month after the OSCE. The total number and accuracy of feedback points provided by examiners were compared to the points recalled by residents. Results comparing recall at 1 month between the immediate-RG and the delayed-RG were also studied. Physician examiners provided considerably more feedback points (M = 16.3) than the residents recalled immediately after the OSCE (M = 2.61, p < .001). There was no significant difference between the number of feedback points recalled

Cheating in OSCEs: The Impact of Simulated Security Breaches on OSCE Performance.

PubMed

Gotzmann, Andrea; De Champlain, André; Homayra, Fahmida; Fotheringham, Alexa; de Vries, Ingrid; Forgie, Melissa; Pugh, Debra

2017-01-01

Construct: Valid score interpretation is important for constructs in performance assessments such as objective structured clinical examinations (OSCEs). An OSCE is a type of performance assessment in which a series of standardized patients interact with the student or candidate who is scored by either the standardized patient or a physician examiner. In high-stakes examinations, test security is an important issue. Students accessing unauthorized test materials can create an unfair advantage and lead to examination scores that do not reflect students' true ability level. The purpose of this study was to assess the impact of various simulated security breaches on OSCE scores. Seventy-six 3rd-year medical students participated in an 8-station OSCE and were randomized to either a control group or to 1 of 2 experimental conditions simulating test security breaches: station topic (i.e., providing a list of station topics prior to the examination) or egregious security breach (i.e., providing detailed content information prior to the examination). Overall total scores were compared for the 3 groups using both a one-way between-subjects analysis of variance and a repeated measure analysis of variance to compare the checklist, rating scales, and oral question subscores across the three conditions. Overall total scores were highest for the egregious security breach condition (81.8%), followed by the station topic condition (73.6%), and they were lowest for the control group (67.4%). This trend was also found with checklist subscores only (79.1%, 64.9%, and 60.3%, respectively for the security breach, station topic, and control conditions). Rating scale subscores were higher for both the station topic and egregious security breach conditions compared to the control group (82.6%, 83.1%, and 77.6%, respectively). Oral question subscores were significantly higher for the egregious security breach condition (88.8%) followed by the station topic condition (64.3%), and they were

The use of the OSCE in postgraduate education.

PubMed

Arnold, R C; Walmsley, A D

2008-08-01

The Objective Structured Clinical Examination (OSCE) is a method of assessing the clinical skills of undergraduates in medicine, dentistry and other health sciences and is employed increasingly in postgraduate education. To describe the application of the OSCE to the development of Lifelong Learning and Continuing Professional Development (CPD) for General Dental Practitioners (GDPs). A postgraduate course was designed as an OSCE for GDPs. The OSCE comprised 12 stations covering different aspects of general dentistry. After an introductory seminar outlining the aim of the course, the participants spent 7 min at each station. Each question or task required 10 answers and was designed to highlight areas of weakness or interest and to stimulate further study of the presenting topic. Solutions and answers were provided at each station for self-assessment along with a list of locally presented courses related to that subject. Participants were invited to leave contact details and to make suggestions for future postgraduate courses. The final session consisted of a group discussion and participants were invited to complete an evaluation form to express opinions on the course. The evaluation demonstrated that most candidates found participation in the OSCE stimulated their interest in CPD. The OSCE also highlighted areas of weakness in knowledge of certain clinical procedures. Group discussion confirmed that practitioners found the hands-on component valuable and that they were likely to participate in further OSCEs to enhance their CPD. Suggestions received during the discussion were used to modify the course. The OSCE course fulfilled its aim of assisting practitioners to organise their CPD. The reflective nature of the course was helpful in evaluating clinical knowledge and the unique multidisciplinary style fulfilled its objective in promoting thoughts regarding future study.

Significance of Objective Structured Clinical Examinations to Plastic Surgery Residency Training.

PubMed

Simmons, Brian J; Zoghbi, Yasmina; Askari, Morad; Birnbach, David J; Shekhter, Ilya; Thaller, Seth R

2017-09-01

Objective structured clinical examinations (OSCEs) have proven to be a powerful tool. They possess more than a 30-year track record in assessing the competency of medical students, residents, and fellows. Objective structured clinical examinations have been used successfully in a variety of medical specialties, including surgery. They have recently found their way into the subspecialty of plastic surgery. This article uses a systematic review of the available literature on OSCEs and their recent use in plastic surgery. It incorporates survey results assessing program directors' views on the use of OSCEs. Approximately 40% of programs surveyed use OSCEs to assess the Accreditation Council for Graduate Medical Education core competencies. We found that 40% use OSCEs to evaluate specific plastic surgery milestones. Objective structured clinical examinations are usually performed annually. They cost anywhere between $100 and more than $1000 per resident. Four milestones giving residents the most difficulties on OSCEs were congenital anomalies, noncancer breast surgery, breast reconstruction, and practice-based learning and improvement. It was determined that challenges with milestones were due to lack of adequate general knowledge and surgical ward patient care, as well as deficits in professionalism and system-based problems. Programs were able to remediate weakness found by OSCEs using a variety of methods. Objective structured clinical examinations offer a unique tool to objectively assess the proficiency of residents in key areas of the Accreditation Council for Graduate Medical Education core competencies. In addition, they can be used to assess the specific milestones that plastic surgery residents must meet. This allows programs to identify and improve identified areas of weakness.

Electronic acquisition of OSCE performance using tablets

PubMed Central

Hochlehnert, Achim; Schultz, Jobst-Hendrik; Möltner, Andreas; Tımbıl, Sevgi; Brass, Konstantin; Jünger, Jana

2015-01-01

Background: Objective Structured Clinical Examinations (OSCEs) often involve a considerable amount of resources in terms of materials and organization since the scores are often recorded on paper. Computer-assisted administration is an alternative with which the need for material resources can be reduced. In particular, the use of tablets seems sensible because these are easy to transport and flexible to use. Aim: User acceptance concerning the use of tablets during OSCEs has not yet been extensively investigated. The aim of this study was to evaluate tablet-based OSCEs from the perspective of the user (examiner) and the student examinee. Method: For two OSCEs in Internal Medicine at the University of Heidelberg, user acceptance was analyzed regarding tablet-based administration (satisfaction with functionality) and the subjective amount of effort as perceived by the examiners. Standardized questionnaires and semi-standardized interviews were conducted (complete survey of all participating examiners). In addition, for one OSCE, the subjective evaluation of this mode of assessment was gathered from a random sample of participating students in semi-standardized interviews. Results: Overall, the examiners were very satisfied with using tablets during the assessment. The subjective amount of effort to use the tablet was found on average to be “hardly difficult”. The examiners identified the advantages of this mode of administration as being in particular the ease of use and low rate of error. During the interviews of the examinees, acceptance for the use of tablets during the assessment was also detected. Discussion: Overall, it was found that the use of tablets during OSCEs was well accepted by both examiners and examinees. We expect that this mode of assessment also offers advantages regarding assessment documentation, use of resources, and rate of error in comparison with paper-based assessments; all of these aspects should be followed up on in further studies

Electronic acquisition of OSCE performance using tablets.

PubMed

Hochlehnert, Achim; Schultz, Jobst-Hendrik; Möltner, Andreas; Tımbıl, Sevgi; Brass, Konstantin; Jünger, Jana

2015-01-01

Objective Structured Clinical Examinations (OSCEs) often involve a considerable amount of resources in terms of materials and organization since the scores are often recorded on paper. Computer-assisted administration is an alternative with which the need for material resources can be reduced. In particular, the use of tablets seems sensible because these are easy to transport and flexible to use. User acceptance concerning the use of tablets during OSCEs has not yet been extensively investigated. The aim of this study was to evaluate tablet-based OSCEs from the perspective of the user (examiner) and the student examinee. For two OSCEs in Internal Medicine at the University of Heidelberg, user acceptance was analyzed regarding tablet-based administration (satisfaction with functionality) and the subjective amount of effort as perceived by the examiners. Standardized questionnaires and semi-standardized interviews were conducted (complete survey of all participating examiners). In addition, for one OSCE, the subjective evaluation of this mode of assessment was gathered from a random sample of participating students in semi-standardized interviews. Overall, the examiners were very satisfied with using tablets during the assessment. The subjective amount of effort to use the tablet was found on average to be "hardly difficult". The examiners identified the advantages of this mode of administration as being in particular the ease of use and low rate of error. During the interviews of the examinees, acceptance for the use of tablets during the assessment was also detected. Overall, it was found that the use of tablets during OSCEs was well accepted by both examiners and examinees. We expect that this mode of assessment also offers advantages regarding assessment documentation, use of resources, and rate of error in comparison with paper-based assessments; all of these aspects should be followed up on in further studies.

Student reflections on learning cross-cultural skills through a 'cultural competence' OSCE.

PubMed

Miller, Elizabeth; Green, Alexander R

2007-05-01

Medical schools use OSCEs (objective structured clinical examinations) to assess students' clinical knowledge and skills, but the use of OSCEs in the teaching and assessment of cross-cultural care has not been well described. To examine medical students' reflections on a cultural competence OSCE station as an educational experience. Students at Harvard Medical School in Boston completed a 'cultural competence' OSCE station (about a patient with uncontrolled hypertension and medication non-adherence). Individual semi-structured interviews were conducted with a convenience sample of twenty-two second year medical students, which were recorded, transcribed, and analysed. Students' reflections on what they learned as the essence of the case encompassed three categories: (1) eliciting the patient's perspective on their illness; (2) examining how and why patients take their medications and inquiring about alternative therapies; and (3) exploring the range of social and cultural factors associated with medication non-adherence. A cultural competence OSCE station that focuses on eliciting patients' perspectives and exploring medication non-adherence can serve as a unique and valuable teaching tool. The cultural competence OSCE station may be one pedagogic method for incorporating cross-cultural care into medical school curricula.

OSCE as a Summative Assessment Tool for Undergraduate Students of Surgery-Our Experience.

PubMed

Joshi, M K; Srivastava, A K; Ranjan, P; Singhal, M; Dhar, A; Chumber, S; Parshad, R; Seenu, V

2017-12-01

Traditional examination has inherent deficiencies. Objective Structured Clinical Examination (OSCE) is considered as a method of assessment that may overcome many such deficits. OSCE is being increasingly used worldwide in various medical specialities for formative and summative assessment. Although it is being used in various disciplines in our country as well, its use in the stream of general surgery is scarce. We report our experience of assessment of undergraduate students appearing in their pre-professional examination in the subject of general surgery by conducting OSCE. In our experience, OSCE was considered a better assessment tool as compared to the traditional method of examination by both faculty and students and is acceptable to students and faculty alike. Conducting OSCE is feasible for assessment of students of general surgery.

[Implementation of bedside training and advanced objective structured clinical examination (OSCE) trial to learn and confirm about pharmacy clinical skills].

PubMed

Tokunaga, Jin; Takamura, Norito; Ogata, Kenji; Setoguchi, Nao; Sato, Keizo

2013-01-01

Bedside training for fourth-year students, as well as seminars in hospital pharmacy (vital sign seminars) for fifth-year students at the Department of Pharmacy of Kyushu University of Health and Welfare have been implemented using patient training models and various patient simulators. The introduction of simulation-based pharmaceutical education, where no patients are present, promotes visually, aurally, and tactilely simulated learning regarding the evaluation of vital signs and implementation of physical assessment when disease symptoms are present or adverse effects occur. A patient simulator also promotes the creation of training programs for emergency and critical care, with which basic as well as advanced life support can be practiced. In addition, an advanced objective structured clinical examination (OSCE) trial has been implemented to evaluate skills regarding vital signs and physical assessments. Pharmacists are required to examine vital signs and conduct physical assessment from a pharmaceutical point of view. The introduction of these pharmacy clinical skills will improve the efficacy of drugs, work for the prevention or early detection of adverse effects, and promote the appropriate use of drugs. It is considered that simulation-based pharmaceutical education is essential to understand physical assessment, and such education will ideally be applied and developed according to on-site practices.

Application of best practice guidelines for OSCEs-An Australian evaluation of their feasibility and value.

PubMed

Mitchell, Marion L; Henderson, Amanda; Jeffrey, Carol; Nulty, Duncan; Groves, Michele; Kelly, Michelle; Knight, Sabina; Glover, Pauline

2015-05-01

Objective Structured Clinical Examinations (OSCEs) are widely used in health professional education and should be based on sound pedagogical foundations. The aim of this study is to evaluate the feasibility and utility of using Best Practice Guidelines (BPGs) within an OSCE format in a broad range of tertiary education settings with under-graduate and post-graduate nursing and midwifery students. We evaluated how feasible it was to apply the BPGs to modify OSCEs in a course; students' perspective of the OSCE; and finally, if the BPG-revised OSCEs better prepared students for clinical practice when compared with the original OSCEs. A mixed method with surveys, focus groups and semi-structured interviews evaluated the BPGs within an OSCE. Four maximally different contexts across four sites in Australia were used. Participants included lecturers and undergraduate nursing students in high and low fidelity simulation settings; under-graduate midwifery students; and post-graduate rural and remote area nursing students. 691 students participated in revised OSCEs. Surveys were completed by 557 students; 91 students gave further feedback through focus groups and 14 lecturers participated in interviews. At all sites the BPGs were successfully used to modify and implement OSCEs. Students valued the realistic nature of the modified OSCEs which contributed to students' confidence and preparation for clinical practice. The lecturers considered the revised OSCEs enhanced student preparedness for their clinical placements. The BPGs have a broad applicability to OSCEs in a wide range of educational contexts with improved student outcomes. Students and lecturers identified the revised OSCEs enhanced student preparation for clinical practice. Subsequent examination of the BPGs saw further refinement to a set of eight BPGs that provide a sequential guide to their application in a way that is consistent with best practice curriculum design principles. Copyright © 2015 Elsevier Ltd

A Comparative Analysis of the Costs of Administration of an OSCE.

ERIC Educational Resources Information Center

Cusimano, Michael D.; And Others

1994-01-01

A study compared the costs of a six-station structured oral examination and an objective structured clinical examination (OSCE) for a surgery clerkship, assessing both faculty and materials costs. The OSCE was found to be more time consuming and expensive. Cost-cutting measures and guidelines to assist medical schools in selecting test type are…

A collaborative comparison of objective structured clinical examination (OSCE) standard setting methods at Australian medical schools.

PubMed

Malau-Aduli, Bunmi Sherifat; Teague, Peta-Ann; D'Souza, Karen; Heal, Clare; Turner, Richard; Garne, David L; van der Vleuten, Cees

2017-12-01

A key issue underpinning the usefulness of the OSCE assessment to medical education is standard setting, but the majority of standard-setting methods remain challenging for performance assessment because they produce varying passing marks. Several studies have compared standard-setting methods; however, most of these studies are limited by their experimental scope, or use data on examinee performance at a single OSCE station or from a single medical school. This collaborative study between 10 Australian medical schools investigated the effect of standard-setting methods on OSCE cut scores and failure rates. This research used 5256 examinee scores from seven shared OSCE stations to calculate cut scores and failure rates using two different compromise standard-setting methods, namely the Borderline Regression and Cohen's methods. The results of this study indicate that Cohen's method yields similar outcomes to the Borderline Regression method, particularly for large examinee cohort sizes. However, with lower examinee numbers on a station, the Borderline Regression method resulted in higher cut scores and larger difference margins in the failure rates. Cohen's method yields similar outcomes as the Borderline Regression method and its application for benchmarking purposes and in resource-limited settings is justifiable, particularly with large examinee numbers.

Increased Authenticity in Practical Assessment Using Emergency Case OSCE Stations

ERIC Educational Resources Information Center

Ruesseler, Miriam; Weinlich, Michael; Byhahn, Christian; Muller, Michael P.; Junger, Jana; Marzi, Ingo; Walcher, Felix

2010-01-01

In case of an emergency, a fast and structured patient management is crucial for patient's outcome. The competencies needed should be acquired and assessed during medical education. The objective structured clinical examination (OSCE) is a valid and reliable assessment format to evaluate practical skills. However, traditional OSCE stations examine…

The Psychiatry OSCE: a 20-year retrospective.

PubMed

Hodges, Brian D; Hollenberg, Elisa; McNaughton, Nancy; Hanson, Mark D; Regehr, Glenn

2014-02-01

Twenty years ago researchers at the University of Toronto launched the Psychiatry Skills Assessment Project (PSAP), a research program exploring Objective Structured Clinical Examinations (OSCEs) in psychiatry. Between 1994 and 2005 PSAP produced publications on the feasibility, reliability, validity, ethics, and practical concerns of OSCEs in psychiatry. The current review has two parts: a review of the state of the art of OSCEs in psychiatry 20 years after they were introduced and documentation of the impact of the PSAP research program. A literature search identified all publications on OSCEs and psychiatry. Articles were coded thematically, and locations of agreement and controversies were identified. Bibliometric analysis identified citations of PSAP research papers, which were analyzed thematically. As of May 2013, there were 250 publications related to OSCEs in psychiatry (not including 10 PSAP papers), published in 29 different countries and ten languages. Prominent topics were the validity and acceptability of OSCEs and SPs, systems issues in adopting OSCEs in psychiatry, and the effects on learning. Eighty-eight percent of all publications cited PSAP work (300 citations). Citations were employed for four purposes: as evidence/justification (54 %); to frame replication research (14 %); to support adaptation of OSCEs in other countries and professions (15 %); and for debate (18 %). Over the past 20 years, use of OSCEs has grown steadily in psychiatry, and several national certification organizations have adopted OSCEs. PSAP work, introduced two decades ago, continues to provide a scholarly foundation for psychometric, practical, and ethical issues of interest to this field.

Surgery Clerkship Evaluations Are Insufficient for Clinical Skills Appraisal: The Value of a Medical Student Surgical Objective Structured Clinical Examination.

PubMed

Butler, Kathryn L; Hirsh, David A; Petrusa, Emil R; Yeh, D Dante; Stearns, Dana; Sloane, David E; Linder, Jeffrey A; Basu, Gaurab; Thompson, Lisa A; de Moya, Marc A

Optimal methods for medical student assessment in surgery remain elusive. Faculty- and housestaff-written evaluations constitute the chief means of student assessment in medical education. However, numerous studies show that this approach has poor specificity and a high degree of subjectivity. We hypothesized that an objective structured clinical examination (OSCE) in the surgery clerkship would provide additional data on student performance that would confirm or augment other measures of assessment. We retrospectively reviewed data from OSCEs, National Board of Medical Examiners shelf examinations, oral presentations, and written evaluations for 51 third-year Harvard Medical School students rotating in surgery at Massachusetts General Hospital from 2014 to 2015. We expressed correlations between numeric variables in Pearson coefficients, stratified differences between rater groups by one-way analysis of variance, and compared percentages with 2-sample t-tests. We examined commentary from both OSCE and clinical written evaluations through textual analysis and summarized these results in percentages. OSCE scores and clinical evaluation scores correlated poorly with each other, as well as with shelf examination scores and oral presentation grades. Textual analysis of clinical evaluation comments revealed a heavy emphasis on motivational factors and praise, whereas OSCE written comments focused on cognitive processes, patient management, and methods to improve performance. In this single-center study, an OSCE provided clinical skills data that were not captured elsewhere in the surgery clerkship. Textual analysis of faculty evaluations reflected an emphasis on interpersonal skills, rather than appraisal of clinical acumen. These findings suggest complementary roles of faculty evaluations and OSCEs in medical student assessment. Copyright © 2017 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Psychometric Structure of a Comprehensive Objective Structured Clinical Examination: A Factor Analytic Approach

ERIC Educational Resources Information Center

Volkan, Kevin; Simon, Steven R.; Baker, Harley; Todres, I. David

2004-01-01

Problem Statement and Background: While the psychometric properties of Objective Structured Clinical Examinations (OSCEs) have been studied, their latent structures have not been well characterized. This study examines a factor analytic model of a comprehensive OSCE and addresses implications for measurement of clinical performance. Methods: An…

Task Demands in OSCEs Influence Learning Strategies.

PubMed

Lafleur, Alexandre; Laflamme, Jonathan; Leppink, Jimmie; Côté, Luc

2017-01-01

Models on pre-assessment learning effects confirmed that task demands stand out among the factors assessors can modify in an assessment to influence learning. However, little is known about which tasks in objective structured clinical examinations (OSCEs) improve students' cognitive and metacognitive processes. Research is needed to support OSCE designs that benefit students' metacognitive strategies when they are studying, reinforcing a hypothesis-driven approach. With that intent, hypothesis-driven physical examination (HDPE) assessments ask students to elicit and interpret findings of the physical exam to reach a diagnosis ("Examine this patient with a painful shoulder to reach a diagnosis"). When studying for HDPE, students will dedicate more time to hypothesis-driven discussions and practice than when studying for a part-task OSCE ("Perform the shoulder exam"). It is expected that the whole-task nature of HDPE will lead to a hypothesis-oriented use of the learning resources, a frequent use of adjustment strategies, and persistence with learning. In a mixed-methods study, 40 medical students were randomly paired and filmed while studying together for two hypothetical OSCE stations. Each 25-min study period began with video cues asking to study for either a part-task OSCE or an HDPE. In a crossover design, sequences were randomized for OSCEs and contents (shoulder or spine). Time-on-task for discussions or practice were categorized as "hypothesis-driven" or "sequence of signs and maneuvers." Content analysis of focus group interviews summarized students' perception of learning resources, adjustment strategies, and persistence with learning. When studying for HDPE, students allocate significantly more time for hypothesis-driven discussions and practice. Students use resources contrasting diagnoses and report persistence with learning. When studying for part-task OSCEs, time-on-task is reversed, spent on rehearsing a sequence of signs and maneuvers. OSCEs with

Does student performance on preclinical OSCEs relate to clerkship grades?

PubMed

Chima, Margot; Dallaghan, Gary Beck

2016-01-01

Objective structured clinical examinations (OSCEs) have been used to assess the clinical competence and interpersonal skills of healthcare professional students for decades. However, the relationship between preclinical (second year or M2) OSCE grades and clerkship performance had never been evaluated, until it was explored to provide information to educators at the University of Nebraska Medical Center (UNMC). In addition, the relationship between M2 OSCE communication scores (which is a portion of the total score) and third-year (M3) Internal Medicine (IM) clerkship OSCE scores was also explored. Lastly, conflicting evidence exists about the relationship between the amount of previous clinical experience and OSCE performance. Therefore, the relationship between M3 IM clerkship OSCE scores and the timing of the clerkship in the academic year was explored. Data from UNMC M2 OSCEs and M3 IM clerkship OSCEs were obtained for graduates of the 2013 and 2014 classes. Specifically, the following data points were collected: M2 fall OSCE total, M2 fall OSCE communication; M2 spring OSCE total, M2 spring OSCE communication; and M3 IM clerkship OSCE total percentages. Data were organized by class, M3 IM clerkship OSCE performance, and timing of the clerkship. Microsoft Excel and SPSS were used for data organization and analysis. Of the 245 records, 229 (93.5%) had data points for all metrics of interest. Significant differences between the classes of 2013 and 2014 existed for average M2 spring total, M2 spring communication, and M3 IM clerkship OSCEs. Retrospectively, there were no differences in M2 OSCE performances based on how students scored on the M3 IM clerkship OSCE. M3 IM clerkship OSCE performance improved for those students who completed the clerkship last in the academic year. There were inconsistencies in OSCE performances between the classes of 2013 and 2014, but more information is needed to determine if this is because of testing variability or heterogeneity

Does student performance on preclinical OSCEs relate to clerkship grades?

PubMed Central

Chima, Margot; Dallaghan, Gary Beck

2016-01-01

Background Objective structured clinical examinations (OSCEs) have been used to assess the clinical competence and interpersonal skills of healthcare professional students for decades. However, the relationship between preclinical (second year or M2) OSCE grades and clerkship performance had never been evaluated, until it was explored to provide information to educators at the University of Nebraska Medical Center (UNMC). In addition, the relationship between M2 OSCE communication scores (which is a portion of the total score) and third-year (M3) Internal Medicine (IM) clerkship OSCE scores was also explored. Lastly, conflicting evidence exists about the relationship between the amount of previous clinical experience and OSCE performance. Therefore, the relationship between M3 IM clerkship OSCE scores and the timing of the clerkship in the academic year was explored. Methods Data from UNMC M2 OSCEs and M3 IM clerkship OSCEs were obtained for graduates of the 2013 and 2014 classes. Specifically, the following data points were collected: M2 fall OSCE total, M2 fall OSCE communication; M2 spring OSCE total, M2 spring OSCE communication; and M3 IM clerkship OSCE total percentages. Data were organized by class, M3 IM clerkship OSCE performance, and timing of the clerkship. Microsoft Excel and SPSS were used for data organization and analysis. Results Of the 245 records, 229 (93.5%) had data points for all metrics of interest. Significant differences between the classes of 2013 and 2014 existed for average M2 spring total, M2 spring communication, and M3 IM clerkship OSCEs. Retrospectively, there were no differences in M2 OSCE performances based on how students scored on the M3 IM clerkship OSCE. M3 IM clerkship OSCE performance improved for those students who completed the clerkship last in the academic year. Conclusions There were inconsistencies in OSCE performances between the classes of 2013 and 2014, but more information is needed to determine if this is because of

Do primary health centres and hospitals contribute equally towards achievement of the transversal clinical competencies of medical students? Performance on the Objective Structured Clinical Examination (OSCE) in competency acquisition.

PubMed

Soler-González, Jorge; Buti, Miquel; Boada, Jordi; Ayala, Victoria; Peñascal, Eduard; Rodriguez, Toni

2016-01-01

The adaptation of the educational programmes of European faculties of medicine to the European Higher Education Area guidelines has focused curricula design on competence acquisition. Competencies are defined as the achievements of a predetermined level of efficacy in real-world scenarios. Our objective was to assess whether performance on a common competence evaluation test, the Objective Structured Clinical Examination (OSCE), resulted in different scores for second-year students after a practical medical training course took place in a primary health centre (PHC) or in a hospital. A descriptive study was conducted during the 2010-2014 academic year of the OSCE test scores obtained by all second-year students. Faculty of Medicine at the University of Lleida (Catalonia, Spain). We performed a correlation analysis between students who completed their practical medical training at the PHC and hospitals utilising Student's t-test for comparison of means. 423 students who completed internships at the PHC and at hospitals obtained OSCE mean scores of 7.32 (SD; IC) (0.82; 7.18-7.47) points and 7.17 (0.83; 6.07-7.26) points, respectively (p=0.07). Second-year medical students acquired similar competency levels in the two analysed training scenarios. The two areas both serve their teaching purpose. Copyright © 2014 Elsevier España, S.L.U. All rights reserved.

Effects of basic clinical skills training on objective structured clinical examination performance.

PubMed

Jünger, Jana; Schäfer, Sybille; Roth, Christiane; Schellberg, Dieter; Friedman Ben-David, Miriam; Nikendei, Christoph

2005-10-01

The aim of curriculum reform in medical education is to improve students' clinical and communication skills. However, there are contradicting results regarding the effectiveness of such reforms. A study of internal medicine students was carried out using a static group design. The experimental group consisted of 77 students participating in 7 sessions of communication training, 7 sessions of skills-laboratory training and 7 sessions of bedside-teaching, each lasting 1.5 hours. The control group of 66 students from the traditional curriculum participated in equally as many sessions but was offered only bedside teaching. Students' cognitive and practical skills performance was assessed using Multiple Choice Question (MCQ) testing and an objective structured clinical examination (OSCE), delivered by examiners blind to group membership. The experimental group performed significantly better on the OSCE than did the control group (P < 0.01), whereas the groups did not differ on the MCQ test (P < 0.15). This indicates that specific training in communication and basic clinical skills enabled students to perform better in an OSCE, whereas its effects on knowledge did not differ from those of the traditional curriculum. Curriculum reform promoting communication and basic clinical skills are effective and lead to an improved performance in history taking and physical examination skills.

Flipping the Objective Structured Clinical Examination: A Teaching Innovation in Graduate Nursing Education.

PubMed

Day, Cristi; Barker, Connie; Bell, Eva; Sefcik, Elizabeth; Flournoy, Deborah

Objective evaluation of distance-based family nurse practitioner (FNP) students can be challenging. One FNP program piloted a teaching innovation, the video-enhanced objective structured clinical examination (VE-OSCE) or "flip" of the traditional face-to-face OSCE, to assess student clinical performance in a controlled online environment using a teleconferencing platform. This project sought to assess the VE-OSCE design, implementation, and ability to identify FNP student learning needs.

Implementing the objective structured clinical examination in a geriatrics fellowship program-a 3-year experience.

PubMed

Avelino-Silva, Thiago J; Gil, Luiz A; Suemoto, Claudia K; Kikuchi, Elina L; Lin, Sumika M; Farias, Luciana L; Jacob-Filho, Wilson

2012-07-01

The Objective Structured Clinical Examination (OSCE) appears to be an effective alternative for assessing not only medical knowledge, but also clinical skills, including effective communication and physical examination skills. The purpose of the current study was to implement an OSCE model in a geriatrics fellowship program and to compare the instrument with traditional essay examination. Seventy first- and second-year geriatric fellows were initially submitted to a traditional essay examination and scored from 0 to 10 by a faculty member. The same fellows subsequently underwent an OSCE with eight 10-minute stations covering a wide range of essential aspects of geriatric knowledge. Each OSCE station had an examiner responsible for its evaluation according to a predefined checklist. Checklist items were classified for analysis purposes as clinical knowledge items (CKI) and communication skills items (CSI); fellow responses were scored from 0 to 10.Although essay examinations took from 30 to 45 minutes to complete, 180-200 minutes were required to evaluate fellows using the proposed OSCE method. Fellows scored an average of 6.2 ± 1.2 on the traditional essay examination and 6.6 ± 1.0 on the OSCE (P < .001). Subanalyses of OSCE scores indicated that average performance on CKI was lower than the average on CSI (6.4 ± 1.1 vs. 8.4 ± 1.1; P < .001). Fellow performance on the essay examination was similar to their performance on CKI (P = .13). Second-year fellows performed better than first-year fellows on the essay examination (P < .001) and CKI (P = .05), but not on CSI (P = .25).The OSCE was successfully implemented as an educational strategy during a geriatrics fellowship program. Combining different testing modalities may provide the best assessment of competence for various domains of knowledge, skills, and behavior. © 2012, Copyright the Authors Journal compilation © 2012, The American Geriatrics Society.

How we give personalised audio feedback after summative OSCEs.

PubMed

Harrison, Christopher J; Molyneux, Adrian J; Blackwell, Sara; Wass, Valerie J

2015-04-01

Students often receive little feedback after summative objective structured clinical examinations (OSCEs) to enable them to improve their performance. Electronic audio feedback has shown promise in other educational areas. We investigated the feasibility of electronic audio feedback in OSCEs. An electronic OSCE system was designed, comprising (1) an application for iPads allowing examiners to mark in the key consultation skill domains, provide "tick-box" feedback identifying strengths and difficulties, and record voice feedback; (2) a feedback website giving students the opportunity to view/listen in multiple ways to the feedback. Acceptability of the audio feedback was investigated, using focus groups with students and questionnaires with both examiners and students. 87 (95%) students accessed the examiners' audio comments; 83 (90%) found the comments useful and 63 (68%) reported changing the way they perform a skill as a result of the audio feedback. They valued its highly personalised, relevant nature and found it much more useful than written feedback. Eighty-nine per cent of examiners gave audio feedback to all students on their stations. Although many found the method easy, lack of time was a factor. Electronic audio feedback provides timely, personalised feedback to students after a summative OSCE provided enough time is allocated to the process.

Influences of OSCE design on students' diagnostic reasoning.

PubMed

Lafleur, Alexandre; Côté, Luc; Leppink, Jimmie

2015-02-01

Some characteristics of assessments exert a strong influence on how students study. Understanding these pre-assessment learning effects is of key importance to the designing of medical assessments that foster students' reasoning abilities. Perceptions of the task demands of an assessment significantly influence students' cognitive processes. However, why and how certain tasks positively 'drive' learning remain unknown. Medical tasks can be assessed as coherent meaningful whole tasks (e.g. examining a patient based on his complaint to find the diagnosis) or can be divided into simpler part tasks (e.g. demonstrating the physical examination of a pre-specified disease). Comparing the benefits of whole-task and part-task assessments in a randomised controlled experiment could guide the design of 'assessments for learning'. The purpose of this study was to determine whether the knowledge that an objective structured clinical examination (OSCE) will contain whole tasks, as opposed to part tasks, increases the use of diagnostic reasoning by medical students when they study for this assessment. In this randomised, controlled, mixed-methods experiment, 40 medical students were randomly paired and filmed while studying together for two imminent physical examination OSCE stations. Each 25-minute study period began with video cues and ended with a questionnaire on cognitive loads. Cues disclosed either a part-task OSCE station (examination of a healthy patient) or a whole-task OSCE station (hypothesis-driven physical examination [HDPE]). In a crossover design, sequences were randomised for both task and content (shoulder or spine). Two blinded and independent authors scored all 40 videos in distinct randomised orders, listening to participants studying freely. Mentioning a diagnosis in association with a sign was scored as a backward association, and the opposite was scored as a forward association; both revealed the use of diagnostic reasoning. Qualitative data were obtained

Situational awareness within objective structured clinical examination stations in undergraduate medical training - a literature search.

PubMed

Fischer, Markus A; Kennedy, Kieran M; Durning, Steven; Schijven, Marlies P; Ker, Jean; O'Connor, Paul; Doherty, Eva; Kropmans, Thomas J B

2017-12-21

Medical students may not be able to identify the essential elements of situational awareness (SA) necessary for clinical reasoning. Recent studies suggest that students have little insight into cognitive processing and SA in clinical scenarios. Objective Structured Clinical Examinations (OSCEs) could be used to assess certain elements of situational awareness. The purpose of this paper is to review the literature with a view to identifying whether levels of SA based on Endsley's model can be assessed utilising OSCEs during undergraduate medical training. A systematic search was performed pertaining to SA and OSCEs, to identify studies published between January 1975 (first paper describing an OSCE) and February 2017, in peer reviewed international journals published in English. PUBMED, EMBASE, PsycINFO Ovid and SCOPUS were searched for papers that described the assessment of SA using OSCEs among undergraduate medical students. Key search terms included "objective structured clinical examination", "objective structured clinical assessment" or "OSCE" and "non-technical skills", "sense-making", "clinical reasoning", "perception", "comprehension", "projection", "situation awareness", "situational awareness" and "situation assessment". Boolean operators (AND, OR) were used as conjunctions to narrow the search strategy, resulting in the limitation of papers relevant to the research interest. Areas of interest were elements of SA that can be assessed by these examinations. The initial search of the literature retrieved 1127 publications. Upon removal of duplicates and papers relating to nursing, paramedical disciplines, pharmacy and veterinary education by title, abstract or full text, 11 articles were eligible for inclusion as related to the assessment of elements of SA in undergraduate medical students. Review of the literature suggests that whole-task OSCEs enable the evaluation of SA associated with clinical reasoning skills. If they address the levels of SA, these

Quality Control of an OSCE Using Generalizability Theory and Many-Faceted Rasch Measurement

ERIC Educational Resources Information Center

Iramaneerat, Cherdsak; Yudkowsky, Rachel; Myford, Carol M.; Downing, Steven M.

2008-01-01

An Objective Structured Clinical Examination (OSCE) is an effective method for evaluating competencies. However, scores obtained from an OSCE are vulnerable to many potential measurement errors that cases, items, or standardized patients (SPs) can introduce. Monitoring these sources of errors is an important quality control mechanism to ensure…

Neurology objective structured clinical examination reliability using generalizability theory

PubMed Central

Park, Yoon Soo; Lukas, Rimas V.; Brorson, James R.

2015-01-01

Objectives: This study examines factors affecting reliability, or consistency of assessment scores, from an objective structured clinical examination (OSCE) in neurology through generalizability theory (G theory). Methods: Data include assessments from a multistation OSCE taken by 194 medical students at the completion of a neurology clerkship. Facets evaluated in this study include cases, domains, and items. Domains refer to areas of skill (or constructs) that the OSCE measures. G theory is used to estimate variance components associated with each facet, derive reliability, and project the number of cases required to obtain a reliable (consistent, precise) score. Results: Reliability using G theory is moderate (Φ coefficient = 0.61, G coefficient = 0.64). Performance is similar across cases but differs by the particular domain, such that the majority of variance is attributed to the domain. Projections in reliability estimates reveal that students need to participate in 3 OSCE cases in order to increase reliability beyond the 0.70 threshold. Conclusions: This novel use of G theory in evaluating an OSCE in neurology provides meaningful measurement characteristics of the assessment. Differing from prior work in other medical specialties, the cases students were randomly assigned did not influence their OSCE score; rather, scores varied in expected fashion by domain assessed. PMID:26432851

Neurology objective structured clinical examination reliability using generalizability theory.

PubMed

Blood, Angela D; Park, Yoon Soo; Lukas, Rimas V; Brorson, James R

2015-11-03

This study examines factors affecting reliability, or consistency of assessment scores, from an objective structured clinical examination (OSCE) in neurology through generalizability theory (G theory). Data include assessments from a multistation OSCE taken by 194 medical students at the completion of a neurology clerkship. Facets evaluated in this study include cases, domains, and items. Domains refer to areas of skill (or constructs) that the OSCE measures. G theory is used to estimate variance components associated with each facet, derive reliability, and project the number of cases required to obtain a reliable (consistent, precise) score. Reliability using G theory is moderate (Φ coefficient = 0.61, G coefficient = 0.64). Performance is similar across cases but differs by the particular domain, such that the majority of variance is attributed to the domain. Projections in reliability estimates reveal that students need to participate in 3 OSCE cases in order to increase reliability beyond the 0.70 threshold. This novel use of G theory in evaluating an OSCE in neurology provides meaningful measurement characteristics of the assessment. Differing from prior work in other medical specialties, the cases students were randomly assigned did not influence their OSCE score; rather, scores varied in expected fashion by domain assessed. © 2015 American Academy of Neurology.

Evaluation of perceived and actual competency in a family medicine objective structured clinical examination

PubMed Central

Graves, Lisa; Lalla, Leonora; Young, Meredith

2017-01-01

Abstract Objective To examine the relationship between objective assessment of performance and self-rated competence immediately before and after participation in a required summative family medicine clerkship objective structured clinical examination (OSCE). Design Learners rated their competence (on a 7-point Likert scale) before and after an OSCE along 3 dimensions: general, specific, and professional competencies relevant to family medicine. Setting McGill University in Montreal, Que. Participants All 168 third-year clinical clerks completing their mandatory family medicine rotation in 2010 to 2011 were invited to participate. Main outcome measures Self-ratings of competence and objective performance scores were compared, and were examined to determine if OSCEs could be a “corrective” tool for self-rating perceived competence (ie, if the experience of undergoing an assessment might assist learners in recalibrating their understanding of their own performance). Results A total of 140 (83%) of the third-year clinical clerks participated. Participating in an OSCE decreased learners’ ratings of perceived competence (pre-OSCE score = 4.9, post-OSCE score = 4.7; F1,3192 = 4.2; P < .05). Learners’ mean self-rated competence for all categories of behaviour (before and after) showed no relationship to OSCE performance (r < 0.12 and P > .08 for all), nor did ratings of station-relevant competence (before and after) (r < 0.19 and P > .09 for all). Ratings of competence before and after the OSCE were correlated for individual students (r > 0.40 and P < .001 for all). Conclusion After the OSCE, students’ self-ratings of perceived competence had decreased, and these ratings had little relationship to actual performance, regardless of the specificity of the rated competency. Discordance between perceived and actual competence is neither novel nor unique to family medicine. However, this discordance is an important consideration for the development of competency

Evaluation of perceived and actual competency in a family medicine objective structured clinical examination.

PubMed

Graves, Lisa; Lalla, Leonora; Young, Meredith

2017-04-01

To examine the relationship between objective assessment of performance and self-rated competence immediately before and after participation in a required summative family medicine clerkship objective structured clinical examination (OSCE). Learners rated their competence (on a 7-point Likert scale) before and after an OSCE along 3 dimensions: general, specific, and professional competencies relevant to family medicine. McGill University in Montreal, Que. All 168 third-year clinical clerks completing their mandatory family medicine rotation in 2010 to 2011 were invited to participate. Self-ratings of competence and objective performance scores were compared, and were examined to determine if OSCEs could be a "corrective" tool for self-rating perceived competence (ie, if the experience of undergoing an assessment might assist learners in recalibrating their understanding of their own performance). A total of 140 (83%) of the third-year clinical clerks participated. Participating in an OSCE decreased learners' ratings of perceived competence (pre-OSCE score = 4.9, post-OSCE score = 4.7; F 1,3192 = 4.2; P  < .05). Learners' mean self-rated competence for all categories of behaviour (before and after) showed no relationship to OSCE performance ( r < 0.12 and P > .08 for all), nor did ratings of station-relevant competence (before and after) ( r < 0.19 and P > .09 for all). Ratings of competence before and after the OSCE were correlated for individual students ( r > 0.40 and P < .001 for all). After the OSCE, students' self-ratings of perceived competence had decreased, and these ratings had little relationship to actual performance, regardless of the specificity of the rated competency. Discordance between perceived and actual competence is neither novel nor unique to family medicine. However, this discordance is an important consideration for the development of competency-based curricula. Copyright© the College of Family Physicians of Canada.

The Dental School Interview As a Predictor of Dental Students' OSCE Performance.

PubMed

Park, Sang E; Price, Mirissa D; Karimbux, Nadeem Y

2018-03-01

The aim of this study was to evaluate the use of the dental school admissions interview score as a noncognitive indicator of performance in predoctoral dental education, with specific attention to whether a correlation existed between the admissions interview scores and performance on the objective structured clinical examination (OSCE). The study population consisted of all 175 students in the Harvard School of Dental Medicine (HSDM) DMD Classes of 2012 through 2016. Data on students' gender and age on entering dental school were self-reported using their applications for admission to the HSDM DMD program. Data on students' OSCE scores for three examination sessions were collected from the Office of Dental Education. The results showed that the students' interview scores did not significantly correlate with OSCE performance on any of the three exams. Performance on the first and second OSCEs did, however, correlate with performance on the third OSCE (p<0.05). Age on entering dental school was not significantly associated with performance on any of the three OSCEs; however, among male students, there was a significant negative correlation (p<0.05) between entering age and performance on the second and third OSCEs. There was no significant association between gender and OSCE or interview score. These results suggest that although the admissions interview scores can serve as an important resource in student selection, with the lack of association between interview and OSCE scores, it is possible that the communication skills required for the interview do not directly overlap with those required for OSCE success.

Final year MBBS students' perception for observed structured clinical examination.

PubMed

Siddiqui, Faisal Ghani

2013-01-01

To determine perceptions of final year students about observed structured clinical examination (OSCE) and to determine its acceptance among these students. Sequential mixed method design using survey questionnair and in-depth interviews. The study constituted a one-time survey and in-depth interviews conducted over a period of three consecutive days during final year MBBS annual examination at OSCE centre, from April 04, 2010 to April 06, 2010. Three hundred and fifty final year MBBS students, selected through non-probability convenience sampling, were asked to fill the 12-item questionnaire. Three hundred and thirty one students returned the forms. In-depth, structured interviews with 22 students, selected by non-probability purposive sampling, were conducted. The interviews were tape recorded for subsequent transcription. The statistical analysis was done using SPSS 17. The qualitative data was analyzed through content analysis techniques. Three hundred and thirty one final year MBBS students (50.6% females) filled the questionnaire (response rate 94.6%). Fifty three percent respondents agreed that the OSCE tasks were taught during clinical rotations. The experience was stressful for 67.9% respondents. Inadequate prior guidelines, inadequate time for stations, newness of the assessment format and vague instructions were the main causes for stress. Over 70% of the students felt that OSCE helped them identify areas of weakness in their practical and clinical skills; 56.5% felt that the stations dealt with practical skills. Seventy nine percent students were happy with the attitude of the examiners while 19% students felt that the facilitators were uncooperative; failure of the examiners to observe the students during performance of the tasks was the major cause for dissatisfaction. Nearly thirty percent (29.9%) respondent felt that the stations were difficult to understand. Over forty nine percent (49.7%) complained that adequate guidelines were not given prior to

Reliability analysis of the objective structured clinical examination using generalizability theory.

PubMed

Trejo-Mejía, Juan Andrés; Sánchez-Mendiola, Melchor; Méndez-Ramírez, Ignacio; Martínez-González, Adrián

2016-01-01

The objective structured clinical examination (OSCE) is a widely used method for assessing clinical competence in health sciences education. Studies using this method have shown evidence of validity and reliability. There are no published studies of OSCE reliability measurement with generalizability theory (G-theory) in Latin America. The aims of this study were to assess the reliability of an OSCE in medical students using G-theory and explore its usefulness for quality improvement. An observational cross-sectional study was conducted at National Autonomous University of Mexico (UNAM) Faculty of Medicine in Mexico City. A total of 278 fifth-year medical students were assessed with an 18-station OSCE in a summative end-of-career final examination. There were four exam versions. G-theory with a crossover random effects design was used to identify the main sources of variance. Examiners, standardized patients, and cases were considered as a single facet of analysis. The exam was applied to 278 medical students. The OSCE had a generalizability coefficient of 0.93. The major components of variance were stations, students, and residual error. The sites and the versions of the tests had minimum variance. Our study achieved a G coefficient similar to that found in other reports, which is acceptable for summative tests. G-theory allows the estimation of the magnitude of multiple sources of error and helps decision makers to determine the number of stations, test versions, and examiners needed to obtain reliable measurements.

Reliability analysis of the objective structured clinical examination using generalizability theory.

PubMed

Trejo-Mejía, Juan Andrés; Sánchez-Mendiola, Melchor; Méndez-Ramírez, Ignacio; Martínez-González, Adrián

2016-01-01

Background The objective structured clinical examination (OSCE) is a widely used method for assessing clinical competence in health sciences education. Studies using this method have shown evidence of validity and reliability. There are no published studies of OSCE reliability measurement with generalizability theory (G-theory) in Latin America. The aims of this study were to assess the reliability of an OSCE in medical students using G-theory and explore its usefulness for quality improvement. Methods An observational cross-sectional study was conducted at National Autonomous University of Mexico (UNAM) Faculty of Medicine in Mexico City. A total of 278 fifth-year medical students were assessed with an 18-station OSCE in a summative end-of-career final examination. There were four exam versions. G-theory with a crossover random effects design was used to identify the main sources of variance. Examiners, standardized patients, and cases were considered as a single facet of analysis. Results The exam was applied to 278 medical students. The OSCE had a generalizability coefficient of 0.93. The major components of variance were stations, students, and residual error. The sites and the versions of the tests had minimum variance. Conclusions Our study achieved a G coefficient similar to that found in other reports, which is acceptable for summative tests. G-theory allows the estimation of the magnitude of multiple sources of error and helps decision makers to determine the number of stations, test versions, and examiners needed to obtain reliable measurements.

Objective Structured Clinical Examination as an Assessment Tool for Clinical Skills in Dermatology.

PubMed

Saceda-Corralo, D; Fonda-Pascual, P; Moreno-Arrones, Ó M; Alegre-Sánchez, A; Hermosa-Gelbard, Á; Jiménez-Gómez, N; Vañó-Galván, S; Jaén-Olasolo, P

2017-04-01

Objective Structured Clinical Evaluation (OSCE) is an excellent method to evaluate student's abilities, but there are no previous reports implementing it in dermatology. To determine the feasibility of implementation of a dermatology OSCE in the medical school. Five stations with standardized patients and image-based assessment were designed. A specific checklist was elaborated in each station with different items which evaluated one competency and were classified into five groups (medical history, physical examination, technical skills, case management and prevention). A total of 28 students were tested. Twenty-five of them (83.3%) passed the exam globally. Concerning each group of items tested: medical interrogation had a mean score of 71.0; physical examination had a mean score of 63.0; management had a mean score of 58.0; and prevention had a mean score of 58.0 points. The highest results were obtained in interpersonal skills items with 91.8 points. Testing a small sample of voluntary students may hinder generalization of our study. OSCE is an useful tool for assessing clinical skills in dermatology and it is possible to carry it out. Our experience enhances that medical school curriculum needs to establish OSCE as an assessment tool in dermatology. Copyright © 2016 AEDV. Publicado por Elsevier España, S.L.U. All rights reserved.

How does preclinical laboratory training impact physical examination skills during the first clinical year? A retrospective analysis of routinely collected objective structured clinical examination scores among the first two matriculating classes of a reformed curriculum in one Polish medical school

PubMed Central

Świerszcz, Jolanta; Stalmach-Przygoda, Agata; Kuźma, Marcin; Jabłoński, Konrad; Cegielny, Tomasz; Skrzypek, Agnieszka; Wieczorek-Surdacka, Ewa; Kruszelnicka, Olga; Chmura, Kaja; Chyrchel, Bernadeta; Surdacki, Andrzej; Nowakowski, Michał

2017-01-01

Objective As a result of a curriculum reform launched in 2012 at our institution, preclinical training was shortened to 2 years instead of the traditional 3 years, creating additional incentives to optimise teaching methods. In accordance with the new curriculum, a semester-long preclinical module of clinical skills (CS) laboratory training takes place in the second year of study, while an introductory clinical course (ie, brief introductory clerkships) is scheduled for the Fall semester of the third year. Objective structured clinical examinations (OSCEs) are carried out at the conclusion of both the preclinical module and the introductory clinical course. Our aim was to compare the scores at physical examination stations between the first and second matriculating classes of a newly reformed curriculum on preclinical second-year OSCEs and early clinical third-year OSCEs. Design Analysis of routinely collected data. Setting One Polish medical school. Participants Complete OSCE records for 462 second-year students and 445 third-year students. Outcome measures OSCE scores by matriculation year. Results In comparison to the first class of the newly reformed curriculum, significantly higher (ie, better) OSCE scores were observed for those students who matriculated in 2013, a year after implementing the reformed curriculum. This finding was consistent for both second-year and third-year cohorts. Additionally, the magnitude of the improvement in median third-year OSCE scores was proportional to the corresponding advancement in preceding second-year preclinical OSCE scores for each of two different sets of physical examination tasks. In contrast, no significant difference was noted between the academic years in the ability to interpret laboratory data or ECG — tasks which had not been included in the second-year preclinical training. Conclusion Our results suggest the importance of preclinical training in a CS laboratory to improve students’ competence in

How does preclinical laboratory training impact physical examination skills during the first clinical year? A retrospective analysis of routinely collected objective structured clinical examination scores among the first two matriculating classes of a reformed curriculum in one Polish medical school.

PubMed

Świerszcz, Jolanta; Stalmach-Przygoda, Agata; Kuźma, Marcin; Jabłoński, Konrad; Cegielny, Tomasz; Skrzypek, Agnieszka; Wieczorek-Surdacka, Ewa; Kruszelnicka, Olga; Chmura, Kaja; Chyrchel, Bernadeta; Surdacki, Andrzej; Nowakowski, Michał

2017-09-01

As a result of a curriculum reform launched in 2012 at our institution, preclinical training was shortened to 2 years instead of the traditional 3 years, creating additional incentives to optimise teaching methods. In accordance with the new curriculum, a semester-long preclinical module of clinical skills (CS) laboratory training takes place in the second year of study, while an introductory clinical course (ie, brief introductory clerkships) is scheduled for the Fall semester of the third year. Objective structured clinical examinations (OSCEs) are carried out at the conclusion of both the preclinical module and the introductory clinical course. Our aim was to compare the scores at physical examination stations between the first and second matriculating classes of a newly reformed curriculum on preclinical second-year OSCEs and early clinical third-year OSCEs. Analysis of routinely collected data. One Polish medical school. Complete OSCE records for 462 second-year students and 445 third-year students. OSCE scores by matriculation year. In comparison to the first class of the newly reformed curriculum, significantly higher (ie, better) OSCE scores were observed for those students who matriculated in 2013, a year after implementing the reformed curriculum. This finding was consistent for both second-year and third-year cohorts. Additionally, the magnitude of the improvement in median third-year OSCE scores was proportional to the corresponding advancement in preceding second-year preclinical OSCE scores for each of two different sets of physical examination tasks. In contrast, no significant difference was noted between the academic years in the ability to interpret laboratory data or ECG - tasks which had not been included in the second-year preclinical training. Our results suggest the importance of preclinical training in a CS laboratory to improve students' competence in physical examination at the completion of introductory clinical clerkships during

Does Changing Examiner Stations During UK Postgraduate Surgery Objective Structured Clinical Examinations Influence Examination Reliability and Candidates' Scores?

PubMed

Brennan, Peter A; Croke, David T; Reed, Malcolm; Smith, Lee; Munro, Euan; Foulkes, John; Arnett, Richard

2016-01-01

Objective structured clinical examinations (OSCE) are widely used for summative assessment in surgery. Despite standardizing these as much as possible, variation, including examiner scoring, can occur which may affect reliability. In study of a high-stakes UK postgraduate surgical OSCE, we investigated whether examiners changing stations once during a long examining day affected marking, reliability, and overall candidates' scores compared with examiners who examined the same scenario all day. An observational study of 18,262 examiner-candidate interactions from the UK Membership of the Royal College of Surgeons examination was carried at 3 Surgical Colleges across the United Kingdom. Scores between examiners were compared using analysis of variance. Examination reliability was assessed with Cronbach's alpha, and the comparative distribution of total candidates' scores for each day was evaluated using t-tests of unit-weighted z scores. A significant difference was found in absolute scores differences awarded in the morning and afternoon sessions between examiners who changed stations at lunchtime and those who did not (p < 0.001). No significant differences were found for the main effects of either broad content area (p = 0.290) or station content area (p = 0.450). The reliability of each day was not affected by examiner switching (p = 0.280). Overall, no difference was found in z-score distribution of total candidate scores and categories of examiner switching. This large study has found that although the range of marks awarded varied when examiners change OSCE stations, examination reliability and the likely candidate outcome were not affected. These results may have implications for examination design and examiner experience in surgical OSCEs and beyond. Copyright © 2016 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Adding Debriefing to Objective Structured Clinical Examinations to Enhance Disability Cultural Sensitivity in Pharmacy Students

ERIC Educational Resources Information Center

Smith, Mark Joseph

2016-01-01

Debriefing was added to the design of an objective structured clinical examination (OSCE) after second-year pharmacy students performed poorly at considering patient disability in planning for patient care. This mixed-methods study examines secondary data to explore whether and how the addition of a debriefing to an OSCE impacted pharmacy…

Changing Objective Structured Clinical Examinations Stations at Lunchtime During All Day Postgraduate Surgery Examinations Improves Examiner Morale and Stress.

PubMed

Brennan, Peter A; Scrimgeour, Duncan S; Patel, Sheena; Patel, Roshnee; Griffiths, Gareth; Croke, David T; Smith, Lee; Arnett, Richard

Human factors are important causes of error, but little is known about their possible effect during objective structured clinical examinations (OSCE). We have previously identified stress and pressure in OSCE examiners in the postgraduate intercollegiate Membership of the Royal College of Surgeons (MRCS) examination. After modifying examination delivery by changing OSCE stations at lunchtime with no demonstrable effect on candidate outcome, we resurveyed examiners to ascertain whether examiner experience was improved. Examiners (n = 180) from all 4 surgical colleges in the United Kingdom and Ireland were invited to complete the previously validated human factors questionnaire used in 2014. Aggregated scores for each of 4 previously identified factors were compared with the previous data. Unit-weighted z-scores and nonparametric Kruskal-Wallis methods were used to test the hypothesis that there was no difference among the median factor z-scores for each college. Individual Mann-Whitney-Wilcoxon tests (with appropriate Bonferonni corrections) were used to determine any differences between factors and the respective colleges. 141 Completed questionnaires were evaluated (78% response rate) and compared with 108 responses (90%) from the original study. Analysis was based on 26 items common to both studies. In 2014, the college with the highest candidate numbers (England) was significantly different in 1 factor (stress and pressure), compared with Edinburgh (Mann-Whitney-Wilcoxon: W = 1524, p < 0.001) and Glasgow colleges (Mann-Whitney-Wilcoxon: W = 104, p = 0.004). No differences were found among colleges in the same factor in 2016, Kruskall-Wallis: (χ 2 (3) = 1.73, p = 0.63). Analysis of responses found inconsistency among examiners regarding mistakes or omissions made when candidates were performing well. After making changes to OSCE delivery, factor scores relating to examiner stress and pressure are now improved and consistent across the surgical colleges. Stress

Summative Objective Structured Clinical Examination Assessment at the End of Anesthesia Residency for Perioperative Ultrasound.

PubMed

Mitchell, John D; Amir, Rabia; Montealegre-Gallegos, Mario; Mahmood, Feroze; Shnider, Marc; Mashari, Azad; Yeh, Lu; Bose, Ruma; Wong, Vanessa; Hess, Philip; Amador, Yannis; Jeganathan, Jelliffe; Jones, Stephanie B; Matyal, Robina

2018-06-01

While standardized examinations and data from simulators and phantom models can assess knowledge and manual skills for ultrasound, an Objective Structured Clinical Examination (OSCE) could assess workflow understanding. We recruited 8 experts to develop an OSCE to assess workflow understanding in perioperative ultrasound. The experts used a binary grading system to score 19 graduating anesthesia residents at 6 stations. Overall average performance was 86.2%, and 3 stations had an acceptable internal reliability (Kuder-Richardson formula 20 coefficient >0.5). After refinement, this OSCE can be combined with standardized examinations and data from simulators and phantom models to assess proficiency in ultrasound.

Measuring Professional Behaviour in Canadian Physical Therapy Students' Objective Structured Clinical Examinations: An Environmental Scan

PubMed Central

Ellerton, Cindy; Evans, Cathy

2015-01-01

ABSTRACT Purpose: To identify professional behaviours measured in objective structured clinical examinations (OSCEs) by Canadian university physical therapy (PT) programs. Method: A cross-sectional telephone survey was conducted to review current practice and determine which OSCE items Canadian PT programs are using to measure PT students' professional behaviours. Telephone interviews using semi-structured questions were conducted with individual instructors responsible for courses that included an OSCE as part of the assessment component. Results: Nine PT programmes agreed to take part in the study, and all reported conducting at least one OSCE. The number and characteristics of OSCEs varied both within and across programs. Participants identified 31 professional behaviour items for use in an OSCE; these items clustered into four categories: communication (n=14), respect (n=10), patient safety (n=4), and physical therapists' characteristics (n=3). Conclusions: All Canadian entry-level PT programmes surveyed assess professional behaviours in OSCE-type examinations; however, the content and style of assessment is variable. The local environment should be considered when determining what professional behaviours are appropriate to assess in the OSCE context in individual programmes. PMID:25931656

Twelve Tips for Organizing an Objective Structured Clinical Examination (OSCE).

ERIC Educational Resources Information Center

Harden, R. M.

1991-01-01

Suggestions for organizing the objective structured clinical examination for medical students and physicians address selection of competencies to be evaluated, number, type, and duration of examination stations, use of examiners, clarity of instructions, test administration, resource requirements, interstation signals, and recordkeeping. (MSE)

A procedural skills OSCE: assessing technical and non-technical skills of internal medicine residents.

PubMed

Pugh, Debra; Hamstra, Stanley J; Wood, Timothy J; Humphrey-Murto, Susan; Touchie, Claire; Yudkowsky, Rachel; Bordage, Georges

2015-03-01

Internists are required to perform a number of procedures that require mastery of technical and non-technical skills, however, formal assessment of these skills is often lacking. The purpose of this study was to develop, implement, and gather validity evidence for a procedural skills objective structured clinical examination (PS-OSCE) for internal medicine (IM) residents to assess their technical and non-technical skills when performing procedures. Thirty-five first to third-year IM residents participated in a 5-station PS-OSCE, which combined partial task models, standardized patients, and allied health professionals. Formal blueprinting was performed and content experts were used to develop the cases and rating instruments. Examiners underwent a frame-of-reference training session to prepare them for their rater role. Scores were compared by levels of training, experience, and to evaluation data from a non-procedural OSCE (IM-OSCE). Reliability was calculated using Generalizability analyses. Reliabilities for the technical and non-technical scores were 0.68 and 0.76, respectively. Third-year residents scored significantly higher than first-year residents on the technical (73.5 vs. 62.2%) and non-technical (83.2 vs. 75.1%) components of the PS-OSCE (p < 0.05). Residents who had performed the procedures more frequently scored higher on three of the five stations (p < 0.05). There was a moderate disattenuated correlation (r = 0.77) between the IM-OSCE and the technical component of the PS-OSCE scores. The PS-OSCE is a feasible method for assessing multiple competencies related to performing procedures and this study provides validity evidence to support its use as an in-training examination.

Do Clinical Clerks Provide Candidates with Adequate Formative Assessment during Objective Structured Clinical Examinations?

ERIC Educational Resources Information Center

Reiter, Harold I.; Rosenfeld, Jack; Nandagopal, Kiruthiga; Eva, Kevin W.

2004-01-01

Context: Various research studies have examined the question of whether expert or non-expert raters, faculty or students, evaluators or standardized patients, give more reliable and valid summative assessments of performance on Objective Structured Clinical Examinations (OSCEs). Less studied has been the question of whether or not non-faculty…

Use of an objective structured clinical exam (OSCE) for early identification of communication skills deficits in interns.

PubMed

Goldhamer, Mary Ellen J; Cohen, Amy; Brooks, Michelle; Macklin, Eric A; Co, John Patrick T; Weinstein, Debra

2018-01-01

There is limited information about whether OSCE during GME orientation can identify trainee communication deficits before these become evident via clinical performance evaluations. Ninety-seven interns matriculating to eight residency programs in six specialties at four hospitals participated in a nine-station communication skills OSCE. Ratings were based on the "Kalamazoo, adapted" communication skills checklist. Possible association with intern performance evaluations was assessed by repeated-measures logistic regression and ROC curves were generated. The mean OSCE score was 4.08 ± 0.27 with a range of 3.3-4.6. Baseline OSCE scores were associated with subsequent communication concerns recorded by faculty, based on 1591 evaluations. A 0.1-unit decrease in the OSCE communication score was associated with an 18% higher odds of being identified with a communication concern by faculty evaluation (odds ratio 1.18, 95% CI 1.01-1.36, p = 0.034). ROC curves did not demonstrate a "cut-off" score (AUC= 0.558). Non-faculty evaluators were 3-5 times more likely than faculty evaluators to identify communication deficits, based on 1900 evaluations. Lower OSCE performance was associated with faculty communication concerns on performance evaluations; however, a "cut-off" score was not demonstrated that could identify trainees for potential early intervention. Multi-source evaluation also identified trainees with communication skills deficits.

Use of Portable Digital Devices to Analyze Autonomic Stress Response in Psychology Objective Structured Clinical Examination.

PubMed

Beltrán-Velasco, Ana Isabel; Bellido-Esteban, Alberto; Ruisoto-Palomera, Pablo; Clemente-Suárez, Vicente Javier

2018-01-12

The aim of the present study was to explore changes in the autonomic stress response of Psychology students in a Psychology Objective Structured Clinical Examination (OSCE) and their relationship with OSCE performance. Variables of autonomic modulation by the analysis of heart rate variability in temporal, frequency and non-linear domains, subjective perception of distress strait and academic performance were measured before and after the two different evaluations that composed the OSCE. A psychology objective structured clinical examination composed by two different evaluation scenarios produced a large anxiety anticipatory response, a habituation response in the first of the evaluation scenarios and a in the entire evaluation, and a no habituation response in the second evaluation scenario. Autonomic modulation parameters do not correlate with academic performance of students.

Evaluating verbal and non-verbal communication skills, in an ethnogeriatric OSCE.

PubMed

Collins, Lauren G; Schrimmer, Anne; Diamond, James; Burke, Janice

2011-05-01

Communication during medical interviews plays a large role in patient adherence, satisfaction with care, and health outcomes. Both verbal and non-verbal communication (NVC) skills are central to the development of rapport between patients and healthcare professionals. The purpose of this study was to assess the role of non-verbal and verbal communication skills on evaluations by standardized patients during an ethnogeriatric Objective Structured Clinical Examination (OSCE). Interviews from 19 medical students, residents, and fellows in an ethnogeriatric OSCE were analyzed. Each interview was videotaped and evaluated on a 14 item verbal and an 8 item non-verbal communication checklist. The relationship between verbal and non-verbal communication skills on interview evaluations by standardized patients were examined using correlational analyses. Maintaining adequate facial expression (FE), using affirmative gestures (AG), and limiting both unpurposive movements (UM) and hand gestures (HG) had a significant positive effect on perception of interview quality during this OSCE. Non-verbal communication skills played a role in perception of overall interview quality as well as perception of culturally competent communication. Incorporating formative and summative evaluation of both verbal and non-verbal communication skills may be a critical component of curricular innovations in ethnogeriatrics, such as the OSCE. Copyright © 2010 Elsevier Ireland Ltd. All rights reserved.

Sequential Objective Structured Clinical Examination based on item response theory in Iran.

PubMed

Hejri, Sara Mortaz; Jalili, Mohammad

2017-01-01

In a sequential objective structured clinical examination (OSCE), all students initially take a short screening OSCE. Examinees who pass are excused from further testing, but an additional OSCE is administered to the remaining examinees. Previous investigations of sequential OSCE were based on classical test theory. We aimed to design and evaluate screening OSCEs based on item response theory (IRT). We carried out a retrospective observational study. At each station of a 10-station OSCE, the students' performance was graded on a Likert-type scale. Since the data were polytomous, the difficulty parameters, discrimination parameters, and students' ability were calculated using a graded response model. To design several screening OSCEs, we identified the 5 most difficult stations and the 5 most discriminative ones. For each test, 5, 4, or 3 stations were selected. Normal and stringent cut-scores were defined for each test. We compared the results of each of the 12 screening OSCEs to the main OSCE and calculated the positive and negative predictive values (PPV and NPV), as well as the exam cost. A total of 253 students (95.1%) passed the main OSCE, while 72.6% to 94.4% of examinees passed the screening tests. The PPV values ranged from 0.98 to 1.00, and the NPV values ranged from 0.18 to 0.59. Two tests effectively predicted the results of the main exam, resulting in financial savings of 34% to 40%. If stations with the highest IRT-based discrimination values and stringent cut-scores are utilized in the screening test, sequential OSCE can be an efficient and convenient way to conduct an OSCE.

Cost and logistics for implementing the American College of Surgeons objective structured clinical examination.

PubMed

Sudan, Ranjan; Clark, Philip; Henry, Brandon

2015-01-01

The American College of Surgeons has developed a reliable and valid OSCE (objective structured clinical examination) to assess the clinical skills of incoming postgraduate year 1 surgery residents, but the cost and logistics of implementation have not been described. Fixed costs included staff time, medical supplies, facility fee, standardized patient (SP) training time, and one OSCE session. Variable costs were incurred for additional OSCE sessions. Costs per resident were calculated and modeled for increasing the number of test takers. American College of Surgeons OSCE materials and examination facilities were free. Fixed costs included training 11 SPs for 4 hours ($1,540), moulage and simulation material ($469), and administrative effort for 44 hours ($2,200). Variable cost for each session was $1,540 (SP time). Total cost for the first session was $6,649 ($664/resident), decreased to $324/resident for 3 sessions, and projected to further decline to $239/resident for 6 sessions. The cost decreased as the number of residents tested increased. To manage costs, testing more trainees by regional collaboration is recommended. Copyright © 2015 Elsevier Inc. All rights reserved.

A focus group study of the use of video-recorded simulated objective structured clinical examinations in nurse practitioner education.

PubMed

Barratt, Julian

2010-05-01

The objective structured clinical examination (OSCE) is a common method of clinical skills assessment used for advanced nurse practitioner students across the United Kingdom. The purpose of an advanced nursing OSCE is to assess a nurse practitioner student's competence and safety in the performance of commonly used advanced clinical practice skills. Students often feel nervous when preparing for and participating in an OSCE. Consideration of these identified anxieties led to the development of an alternative method of meeting students' OSCE learning and preparation needs; namely video-recorded simulated OSCEs. Video-recording was appealing for the following reasons: it provides a flexible usage of staff resources and time; OSCE performance mistakes can be rectified; it is possible to use the same video-recordings with multiple cohorts of students, and the recordings can be made conveniently available for students with video streaming on internet-based video-sharing sites or virtual learning environments. The aim of the study was to explore the value of using such recordings amongst nurse practitioner students, via online and face-to-face focus groups, to see if they are a suitable OSCE educational preparation technique. The study findings indicate that simulated OSCE video-recordings are an effective method for supporting nurse practitioner educational development. Copyright 2009 Elsevier Ltd. All rights reserved.

M-OSCE as a method to measure dental hygiene students' critical thinking: a pilot study.

PubMed

McComas, Martha J; Wright, Rebecca A; Mann, Nancy K; Cooper, Mary D; Jacks, Mary E

2013-04-01

Educators in all academic disciplines have been encouraged to utilize assessment strategies to evaluate students' critical thinking. The purpose of this study was to assess the viability of the modified objective structured clinical examination (m-OSCE) to evaluate critical thinking in dental hygiene education. This evaluation utilized a convenience sample of senior dental hygiene students. Students participated in the m-OSCE in which portions of a patient case were revealed at four stations. The exam consisted of multiple-choice questions intended to measure students' ability to utilize critical thinking skills. Additionally, there was one fill-in-the-blank question and a treatment plan that was completed at the fifth station. The results of this study revealed that the m-OSCE did not reliably measure dental hygiene students' critical thinking. Statistical analysis found no satisfactory reliability within the multiple-choice questions and moderately reliable results within the treatment planning portion of the examination. In addition, the item analysis found gaps in students' abilities to transfer clinical evidence/data to basic biomedical knowledge as demonstrated through the multiple-choice questioning results. This outcome warrants further investigation of the utility of the m-OSCE, with a focus on modifications to the evaluation questions, grading rubric, and patient case.

Objectivity in subjectivity: do students' self and peer assessments correlate with examiners' subjective and objective assessment in clinical skills? A prospective study.

PubMed

Inayah, A'man Talal; Anwer, Lucman A; Shareef, Mohammad Abrar; Nurhussen, Akram; Alkabbani, Haifa Mazen; Alzahrani, Alhanouf A; Obad, Adam Subait; Zafar, Muhammad; Afsar, Nasir Ali

2017-05-09

The qualitative subjective assessment has been exercised either by self-reflection (self-assessment (SA)) or by an observer (peer assessment (PA)) and is considered to play an important role in students' development. The objectivity of PA and SA by students as well as those by faculty examiners has remained debated. This matters most when it comes to a high-stakes examination. We explored the degree of objectivity in PA, SA, as well as the global rating by examiners being Examiners' Subjective Assessment (ESA) compared with Objective Structured Clinical Examinations (OSCE). Prospective cohort study. Undergraduate medical students at Alfaisal University, Riyadh. All second-year medical students (n=164) of genders, taking a course to learn clinical history taking and general physical examination. A Likert scale questionnaire was distributed among the participants during selected clinical skills sessions. Each student was evaluated randomly by peers (PA) as well as by himself/herself (SA). Two OSCEs were conducted where students were assessed by an examiner objectively as well as subjectively (ESA) for a global rating of confidence and well-preparedness. OSCE-1 had fewer topics and stations, whereas OSCE-2 was terminal and full scale. OSCE-1 (B=0.10) and ESA (B=8.16) predicted OSCE-2 scores. 'No nervousness' in PA (r=0.185, p=0.018) and 'confidence' in SA (r=0.207, p=0.008) correlated with 'confidence' in ESA. In 'well-preparedness', SA correlated with ESA (r=0.234, p=0.003). OSCE-1 and ESA predicted students' performance in the OSCE-2, a high-stakes evaluation, indicating practical 'objectivity' in ESA, whereas SA and PA had minimal predictive role. Certain components of SA and PA correlated with ESA, suggesting partial objectivity given the limited objectiveness of ESA. Such difference in 'qualitative' objectivity probably reflects experience. Thus, subjective assessment can be used with some degree of objectivity for continuous assessment. © Article author(s) (or

Mental health and learning disability nursing students' perceptions of the usefulness of the objective structured clinical examination to assess their competence in medicine administration.

PubMed

Hemingway, Steve; Stephenson, John; Roberts, Bronwyn; McCann, Terence

2014-08-01

The aim of this study was to evaluate mental health and learning disability nursing students' perceptions of the usefulness of the objective structured clinical examination (OSCE) in assessing their administration of medicine competence. Learning disability (n = 24) and mental health (n = 46) students from a single cohort were invited to evaluate their experience of the OSCE. A 10-item survey questionnaire was used, comprising open- and closed-response questions. Twelve (50%) learning disability and 32 (69.6%) mental health nursing students participated. The OSCE was rated highly compared to other theoretical assessments; it was also reported as clinically real and as a motivational learning strategy. However, it did not rate as well as clinical practice. Content analysis of written responses identified four themes: (i) benefits of the OSCE; (ii) suggestions to improve the OSCE; (iii) concern about the lack of clinical reality of the OSCE; and (iv) OSCE-induced stress. The themes, although repeating some of the positive statistical findings, showed that participants were critical of the university setting as a place to conduct clinical assessment, highlighted OSCE-related stress, and questioned the validity of the OSCE as a real-world assessment. The OSCE has an important role in the development of student nurses' administration of medicine skills. However, it might hinder their performance as a result of the stress of being assessed in a simulated environment.

Implementation of an Electronic Objective Structured Clinical Exam for Assessing Practical Skills in Pre-Professional Physiotherapy and Occupational Therapy Programs: Examiner and Course Coordinator Perspectives

ERIC Educational Resources Information Center

Snodgrass, Suzanne J.; Ashby, Samantha E.; Rivett, Darren A.; Russell, Trevor

2014-01-01

Assessment of practical clinical skills is essential in the health fields. Objective Structured Clinical Exams (OSCEs), where examiners assess students performing clinical procedures on simulated patients (actors), are central to the evaluation of practical skills. However, traditional OSCEs require considerable time-investment to administer, and…

Student assessment by objective structured examination in a neurology clerkship

PubMed Central

Adesoye, Taiwo; Smith, Sandy; Blood, Angela; Brorson, James R.

2012-01-01

Objectives: We evaluated the reliability and predictive ability of an objective structured clinical examination (OSCE) in the assessment of medical students at the completion of a neurology clerkship. Methods: We analyzed data from 195 third-year medical students who took the OSCE. For each student, the OSCE consisted of 2 standardized patient encounters. The scores obtained from each encounter were compared. Faculty clinical evaluations of each student for 2 clinical inpatient rotations were also compared. Hierarchical regression analysis was applied to test the ability of the averaged OSCE scores to predict standardized written examination scores and composite clinical scores. Results: Students' OSCE scores from the 2 standardized patient encounters were significantly correlated with each other (r = 0.347, p < 0.001), and the scores for all students were normally distributed. In contrast, students' faculty clinical evaluation scores from 2 different clinical inpatient rotations were uncorrelated, and scores were skewed toward the highest ratings. After accounting for clerkship order, better OSCE scores were predictive of better National Board of Medical Examiners standardized examination scores (R2Δ = 0.131, p < 0.001) and of better faculty clinical scores (R2Δ = 0.078, p < 0.001). Conclusions: Student assessment by an OSCE provides a reliable and predictive objective assessment of clinical performance in a neurology clerkship. PMID:22855865

Objective structured clinical examination "Death Certificate" station - Computer-based versus conventional exam format.

PubMed

Biolik, A; Heide, S; Lessig, R; Hachmann, V; Stoevesandt, D; Kellner, J; Jäschke, C; Watzke, S

2018-04-01

One option for improving the quality of medical post mortem examinations is through intensified training of medical students, especially in countries where such a requirement exists regardless of the area of specialisation. For this reason, new teaching and learning methods on this topic have recently been introduced. These new approaches include e-learning modules or SkillsLab stations; one way to objectify the resultant learning outcomes is by means of the OSCE process. However, despite offering several advantages, this examination format also requires considerable resources, in particular in regards to medical examiners. For this reason, many clinical disciplines have already implemented computer-based OSCE examination formats. This study investigates whether the conventional exam format for the OSCE forensic "Death Certificate" station could be replaced with a computer-based approach in future. For this study, 123 students completed the OSCE "Death Certificate" station, using both a computer-based and conventional format, half starting with the Computer the other starting with the conventional approach in their OSCE rotation. Assignment of examination cases was random. The examination results for the two stations were compared and both overall results and the individual items of the exam checklist were analysed by means of inferential statistics. Following statistical analysis of examination cases of varying difficulty levels and correction of the repeated measures effect, the results of both examination formats appear to be comparable. Thus, in the descriptive item analysis, while there were some significant differences between the computer-based and conventional OSCE stations, these differences were not reflected in the overall results after a correction factor was applied (e.g. point deductions for assistance from the medical examiner was possible only at the conventional station). Thus, we demonstrate that the computer-based OSCE "Death Certificate" station

Use of the OSCE to Evaluate Brief Communication Skills Training for Dental Students

PubMed Central

Cannick, Gabrielle F.; Horowitz, Alice M.; Garr, David R.; Reed, Susan G.; Neville, Brad W.; Day, Terry A.; Woolson, Robert F.; Lackland, Daniel T.

2009-01-01

Although communications competency is recommended by the American Dental Education Association, only a few (n=5) dental schools report evaluating students’ skills using a competency examination for communication. This study used an objective structured clinical examination (OSCE) to evaluate dental students’ competency in interpersonal and tobacco cessation communication skills. All students were evaluated on their interpersonal communication skills at baseline and at six months post-OSCE by standardized patients and on their tobacco cessation communication skills by two independent raters. First- and second-year dental students (n=104) were randomized to a control or intervention group. One month after the baseline OSCE, students in the intervention group participated in a two-hour training session in which faculty members communicated with a standardized patient during a head and neck examination and counseled the patient about tobacco cessation. There were no statistically significant differences from baseline to post-test between the intervention and control group students as measured by the OSCE. However, among first-year students, both the intervention (n=23) and control (n=21) groups significantly increased in tobacco cessation communication scores. Second-year students in both intervention (n=24) and control (n=28) groups declined in interpersonal communication skills from baseline to post-test. Overall, this one-shot intervention was not successful, and results suggest that a comprehensive communication skills training course may be more beneficial than a single, brief training session for improving dental students’ communication skills. PMID:17761627

Assessment of pharmacy students' communication competence using the Roter Interaction Analysis System during objective structured clinical examinations.

PubMed

Kubota, Yoshie; Yano, Yoshitaka; Seki, Susumu; Takada, Kaori; Sakuma, Mio; Morimoto, Takeshi; Akaike, Akinori; Hiraide, Atsushi

2011-04-11

To determine the value of using the Roter Interaction Analysis System during objective structured clinical examinations (OSCEs) to assess pharmacy students' communication competence. As pharmacy students completed a clinical OSCE involving an interview with a simulated patient, 3 experts used a global rating scale to assess students' overall performance in the interview, and both the student's and patient's languages were coded using the Roter Interaction Analysis System (RIAS). The coders recorded the number of utterances (ie, units of spoken language) in each RIAS category. Correlations between the raters' scores and the number and types of utterances were examined. There was a significant correlation between students' global rating scores on the OSCE and the number of utterances in the RIAS socio-emotional category but not the RIAS business category. The RIAS proved to be a useful tool for assessing the socio-emotional aspect of students' interview skills.

Influence of Marital Status on Attitude of Midwives towards OSCE and Their Performance in the Examination in Akwa Ibom and Cross River States, Nigeria

ERIC Educational Resources Information Center

Duke, Emon Umoe; Mgbekem, Mary Achi; Nsemo, Alberta David; Ojong-Alacia, Mary Manyo; Nkwonta, Chigozie A.; Mobolaji-Olajide, O. M.

2015-01-01

This quantitative study investigated the influence of marital status on the midwives' attitude towards OSCE and how this affects their performance in the examination. Two hypotheses guided the study. HO 1 sort to find out if there exist a significant influence of marital status of midwives on their attitude towards OSCE as well as performance in…

The first OSCE; does students' experience of performing in public affect their results?

PubMed

Chan, Michael; Bax, Nigel; Woodley, Caroline; Jennings, Michael; Nicolson, Rod; Chan, Philip

2015-03-26

Personal qualities have been shown to affect students' exam results. We studied the effect of experience, and level, of public performance in music, drama, dance, sport, and debate at the time of admission to medical school as a predictor of student achievement in their first objective structured clinical examination (OSCE). A single medical school cohort (n = 265) sitting their first clinical exam in 2011 as third year students were studied. Pre-admission statements made at the time of application were coded for their stated achievements in the level of public performance; participation in each activity was scored 0-3, where 0 was no record, 1 = leisure time activity, 2 = activity at school or local level, 3 = activity at district, regional or national level. These scores were correlated to OSCE results by linear regression and t-test. Comparison was made between the highest scoring students in each area, and students scoring zero by t-test. There was a bell shaped distribution in public performance score in this cohort. There was no significant linear regression relationship between OSCE results and overall performance score, or between any subgroups. There was a significant difference between students with high scores in theatre, debate and vocal music areas, grouped together as verbal performance, and students scoring zero in these areas. (p < 0.05, t-test) with an effect size of 0.4. We found modest effects from pre-admission experience of verbal performance on students' scores in the OSCE examination. As these data are taken from students' admission statements, we call into question the received wisdom that such statements are unreliable.

PERCEPTION OF FINAL YEAR MEDICAL STUDENTS ABOUT OBJECTIVE STRUCTURED CLINICAL EXAMINATION IN THE DEPARTMENT OF GENERAL SURGERY.

PubMed

Gelan, Engida Abebe; Essayas, Reiye; Gebressilase, Kibrom

2015-10-01

Background -Assessment of clinical skills of medical students has a central role in medical education yet the suit- able evaluation methods have persistently debated by educators and students. To assess perceptions of final year medical students about the Organized Structured Clinical Exam (OSCE) METHODS AND MATERIALS: A cross sectional study was performed to assess views of final year medical students who had taken the OSCE in the Department of Surgery of Mekelle University College of Health Sciences, as well as other traditional exam formats in other departments in the medical school. Of the 154 students who took the final qualifying exam, 127 (82.5%) responded to the survey. Eighty-four (66%) of the respondents were males. The OSCE was considered as the best assessment method of practical exams by 70 (55.1%) of the respondents, with the conventional long exam next in preference, by 47 (37%) students. For questions addressing the advantages of the OSCE, the average favorability score was between 4.2 - 4.6 out of Likert's type 5-point scale rating. Coverage of common and relevant topics, uniform student assessment, and communication skill assessment were items receiving high favorability scores by a particularly high percentage of students, (96.9%, 95.3% and 70.9% of all students, respectively). Most of the students favored the OSCE compared to conventional exam styles. Though the study should be confirmed. and extended in other settings, we recommend OSCE to be the main exam type for clinical year surgery examinations.

A Comparison of Standard-Setting Procedures for an OSCE in Undergraduate Medical Education.

ERIC Educational Resources Information Center

Kaufman, David M.; Mann, Karen V.; Muijtjens, Arno M. M.; van der Vleuten, Cees P. M.

2000-01-01

Compared four standard-setting procedures for an objective structure clinical examination (OSCE) in medical education. Applied Angoff, borderline, relative, and holistic procedures to the data used to establish a cutoff score for a pass/fail decision. The Angoff and borderline procedures gave similar results; however, the relative and holistic…

Assessment of Pharmacy Students' Communication Competence Using the Roter Interaction Analysis System During Objective Structured Clinical Examinations

PubMed Central

Kubota, Yoshie; Seki, Susumu; Takada, Kaori; Sakuma, Mio; Morimoto, Takeshi; Akaike, Akinori; Hiraide, Atsushi

2011-01-01

Objective To determine the value of using the Roter Interaction Analysis System during objective structured clinical examinations (OSCEs) to assess pharmacy students' communication competence. Methods As pharmacy students completed a clinical OSCE involving an interview with a simulated patient, 3 experts used a global rating scale to assess students' overall performance in the interview, and both the student's and patient's languages were coded using the Roter Interaction Analysis System (RIAS). The coders recorded the number of utterances (ie, units of spoken language) in each RIAS category. Correlations between the raters' scores and the number and types of utterances were examined. Results There was a significant correlation between students' global rating scores on the OSCE and the number of utterances in the RIAS socio-emotional category but not the RIAS business category. Conclusions The RIAS proved to be a useful tool for assessing the socio-emotional aspect of students' interview skills. PMID:21655397

The method used to set the pass mark in an objective structured clinical examination defines the performance of candidates for certification as rheumatologists.

PubMed

Pascual-Ramos, Virginia; Guilaisne Bernard-Medina, Ana; Flores-Alvarado, Diana Elsa; Portela-Hernández, Margarita; Maldonado-Velázquez, María Del Rocío; Jara-Quezada, Luis Javier; Amezcua-Guerra, Luis Manuel; Rubio-Judith López-Zepeda, Nadina E; Álvarez-Hernandez, Everardo; Saavedra, Miguel Ángel; Arce-Salinas, César Alejandro

The Mexican Accreditation Council for Rheumatology certifies trainees (TR) on an annual basis using both a multiple-choice question (MCQ) test and an objective structured clinical examination (OSCE). For 2013 and 2014, the OSCE pass mark (PM) was set by criterion referencing as ≥6 (CPM), whereas overall rating of borderline performance method (BPM) was added for 2015 and 2016 accreditations. We compared OSCE TR performance according to CPM and BPM, and examined whether correlations between MCQ and OSCE were affected by PM. Forty-three (2015) and 37 (2016) candidates underwent both tests. Altogether, OSCE were integrated by 15 validated stations; one evaluator per station scored TR performance according to a station-tailored check-list and a Likert scale (fail, borderline, above range) of overall performance. A composite OSCE score was derived for each candidate. Appropriate statistics were used. Mean (±standard derivation [SD]) MCQ test scores were 6.6±0.6 (2015) and 6.4±0.6 (2016) with 5 candidates receiving a failing score each year. Mean (±SD) OSCE scores were 7.4±0.6 (2015) and 7.3±0.6 (2016); no candidate received a failing CPM score in either 2015 or 2016 OSCE, although 21 (49%) and 19 (51%) TR, respectively, received a failing BPM score (calculated as 7.3 and 7.4, respectively). Stations for BPM ranged from 4.5 to 9.5; overall, candidates showed better performance in CPM. In all, MCQ correlated with composite OSCE, r=0.67 (2015) and r=0.53 (2016); P≤.001. Trainees with a passing BPM score in OSCE had higher MCQ scores than those with a failing score. Overall, OSCE-PM selection impacted candidates' performance but had a limited affect on correlation between clinical and practical examinations. Copyright © 2016 Elsevier España, S.L.U. and Sociedad Española de Reumatología y Colegio Mexicano de Reumatología. All rights reserved.

The Reliability, Validity, and Evaluation of the Objective Structured Clinical Examination in Podiatry (Chiropody).

ERIC Educational Resources Information Center

Woodburn, Jim; Sutcliffe, Nick

1996-01-01

The Objective Structured Clinical Examination (OSCE), initially developed for undergraduate medical education, has been adapted for assessment of clinical skills in podiatry students. A 12-month pilot study found the test had relatively low levels of reliability, high construct and criterion validity, and good stability of performance over time.…

Long-term prospective teaching effectivity of practical skills training and a first OSCE in cranio maxillofacial surgery for dental students.

PubMed

Landes, Constantin A; Hoefer, Sebastian; Schuebel, Florian; Ballon, Alexander; Teiler, Anna; Tran, Andreas; Weber, Roxane; Walcher, Felix; Sader, Robert

2014-07-01

Basic skills in oral/CMF surgery should be taught effectively to dental students as surgical skills training is traditionally under-represented in the dental curriculum compared to its later need in daily clinical practice. Rigid curricular time frames and prospectively condensed professional education foster new effective teaching and examination formats. Transmitting and assessing clinical competence objectively (independent of subjective bias), reliably (repeatable, inter-rater consistency) and valid (representative, structured task selection) was intended and evaluated in oral/CMF surgery skills acquisition starting in summer 2009. A small-group practical skills training (PST) day initiated a one-week practical training course, covering previously formulated learning objectives. An objective structured clinical evaluation (OSCE) was held at the end of each semester. Theoretical background knowledge and clinical skills should have to be memorized within a representative number of practical tasks (test stations). A first semester (26 students) used classical practical training alone as controls, the following semesters (171 students) had PST, considered as a study group. All 197 students were assessed with OSCE's over a 3-year period. An instructor held PST based on presentations, videos and practical training, including mannequins, with pairs of students. This included history taking, communication and interpretation of laboratory/image diagnostics, structured clinical facial examination, fracture diagnosis, venipuncture, suturing, biopsy and wire loops on pig jaws for manual and clinical skills, which were later incorporated in OSCE stations. OSCE average results increased from 63.3 ± 9.7% before and to 75.5 ± 10% after the inclusion of PST (p < 0.05). Knowledge diffusion between sittings on the same test date and between consecutive semesters was insignificant. Students and faculty rated their learning/teaching experience "very good" to "good". PST was

Communication Skills in Candidates for Accreditation in Rheumatology Are Correlated With Candidate's Performance in the Objective Structured Clinical Examination.

PubMed

Pascual-Ramos, Virginia; Flores-Alvarado, Diana Elsa; Portela-Hernández, Margarita; Maldonado-Velázquez, María Del Rocío; Amezcua-Guerra, Luis Manuel; López-Zepeda, Judith; Álvarez, Everardo; Rubio, Nadina; Lastra, Olga Vera; Saavedra, Miguel Ángel; Arce-Salinas, César Alejandro

2017-07-26

The Mexican Accreditation Council for Rheumatology annually certifies trainees in Rheumatology using a multiple-choice test and an objective structured clinical examination (OSCE). Since 2015, candidate's communication skills (CS) have been rated by both patients and by physician examiners and correlated with results on the OSCE. This study compared the CS from candidates to annual accreditation in Rheumatology as rated by patients and by physician examiners, and assessed whether these correlated with candidate's performance in the OSCE. From 2015 to 2017, 8areas of CS were evaluated using a Likert scale, in each OSCE station that involved a patient. Both patient and physician evaluators were trained annually and their evaluations were performed blindly. The associations were calculated using the Pearson correlation coefficient. In general, candidates were given high CS scores; the scores from patients of the candidate's CS were better than those of physician examiners; within the majority of the stations, both scores were found to correlate moderately. In addition, the scoring of CS correlated with trainee performance at the corresponding OSCE station. Interestingly, better correlations were found when the skills were rated by the patients compared to physician scores. The average CS score was correlated with the overall OSCE performance for each trainee, but not with the multiple-choice test, except in the 2017 accreditation process, when a weak correlation was found. CS assessed during a national accreditation process correlated with the candidate's performance at the station level and with the overall OSCE. Copyright © 2017 Elsevier España, S.L.U. and Sociedad Española de Reumatología y Colegio Mexicano de Reumatología. All rights reserved.

Mapping Direct Observations From Objective Structured Clinical Examinations to the Milestones Across Specialties.

PubMed

Baker-Genaw, Kimberly; Kokas, Maria S; Ahsan, Syed F; Darnley-Fisch, Deborah; Drake, Sean; Goyal, Nikhil; Inamdar, Kedar; Moutzouros, Vasilios; Prabhakar, Deepak; Rolland, Laurie; Sangha, Roopina; Shreve, Maria; Woodward, Ann

2016-07-01

Little is known about residents' performance on the milestones at the institutional level. Our institution formed a work group to explore this using an institutional-level curriculum and residents' evaluation of the milestones. We assessed whether beginner-level milestones for interpersonal and communication skills (ICS) related to observable behaviors in ICS-focused objective structured clinical examinations (OSCEs) for postgraduate year (PGY) 1 residents across specialties. The work group compared ICS subcompetencies across 12 programs to identify common beginner-level physician-patient communication milestones. The selected ICS milestone sets were compared for common language with the ICS-OSCE assessment tool-the Kalamazoo Essential Elements of Communication Checklist-Adapted (KEECC-A). To assess whether OSCE scores related to ICS milestone scores, all PGY-1 residents from programs that were part of Next Accreditation System Phase 1 were identified; their OSCE scores from July 2013 to June 2014 and ICS subcompetency scores from December 2014 were compared. The milestones for 10 specialties and the transitional year had at least 1 ICS subcompetency that related to physician-patient communication. The language of the ICS beginner-level milestones appears similar to behaviors outlined in the KEECC-A. All 60 residents with complete data received at least a beginner-level ICS subcompetency score and at least a satisfactory score on all 3 OSCEs. The ICS-OSCE scores for PGY-1 residents appear to relate to beginner-level milestones for physician-patient communication across multiple specialties.

Objective structured clinical examination for pharmacy students in Qatar: cultural and contextual barriers to assessment.

PubMed

Wilby, K J; Black, E K; Austin, Z; Mukhalalati, B; Aboulsoud, S; Khalifa, S I

2016-07-10

This study aimed to evaluate the feasibility and psychometric defensibility of implementing a comprehensive objective structured clinical examination (OSCE) on the complete pharmacy programme for pharmacy students in a Middle Eastern context, and to identify facilitators and barriers to implementation within new settings. Eight cases were developed, validated, and had standards set according to a blueprint, and were assessed with graduating pharmacy students. Assessor reliability was evaluated using inter-class coefficients (ICCs). Concurrent validity was evaluated by comparing OSCE results to professional skills course grades. Field notes were maintained to generate recommendations for implementation in other contexts. The examination pass mark was 424 points out of 700 (60.6%). All 23 participants passed. Mean performance was 74.6%. Low to moderate inter-rater reliability was obtained for analytical and global components (average ICC 0.77 and 0.48, respectively). In conclusion, OSCE was feasible in Qatar but context-related validity and reliability concerns must be addressed prior to future iterations in Qatar and elsewhere.

A Procedural Skills OSCE: Assessing Technical and Non-Technical Skills of Internal Medicine Residents

ERIC Educational Resources Information Center

Pugh, Debra; Hamstra, Stanley J.; Wood, Timothy J.; Humphrey-Murto, Susan; Touchie, Claire; Yudkowsky, Rachel; Bordage, Georges

2015-01-01

Internists are required to perform a number of procedures that require mastery of technical and non-technical skills, however, formal assessment of these skills is often lacking. The purpose of this study was to develop, implement, and gather validity evidence for a procedural skills objective structured clinical examination (PS-OSCE) for internal…

Virtual study groups and online Observed Structured Clinical Examinations practices - enabling trainees to enable themselves.

PubMed

Davidson, Dennisa; Evans, Lois

2018-03-01

To explore online study groups as augmentation tools in preparing for the Royal Australian and New Zealand College of Psychiatrists Observed Structured Clinical Examinations (OSCE) for fellowship. An online survey of New Zealand trainees was carried out to assess exam preparedness and openness to virtual study groups and results analysed. Relevant material around virtual study groups for fellowship examinations was reviewed and used to inform a pilot virtual study group. Four New Zealand trainees took part in the pilot project, looking at using a virtual platform to augment OSCE preparation. Of the 50 respondents 36% felt adequately prepared for the OSCE. Sixty-four per cent were interested in using a virtual platform to augment their study. Virtual study groups were noted to be especially important for rural trainees, none of whom felt able to form study groups for themselves. The pilot virtual study group was trialled successfully. All four trainees reported the experience as subjectively beneficial to their examination preparation. Virtual platforms hold promise as an augmentation strategy for exam preparation, especially for rural trainees who are more geographically isolated and less likely to have peers preparing for the same examinations.

Adapting Objective Structured Clinical Examinations to Assess Social Work Students' Performance and Reflections

ERIC Educational Resources Information Center

Bogo, Marion; Regehr, Cheryl; Logie, Carmen; Katz, Ellen; Mylopoulos, Maria; Regehr, Glenn

2011-01-01

The development of standardized, valid, and reliable methods for assessment of students' practice competence continues to be a challenge for social work educators. In this study, the Objective Structured Clinical Examination (OSCE), originally used in medicine to assess performance through simulated interviews, was adapted for social work to…

Effects of Job Burnout and Emotional Labor on Objective Structured Clinical Examination Performance Among Interns and Residents in Taiwan.

PubMed

Wang, Chen-Yu; Chen, Jen-De; Wang, Chih-Hung; Wang, Jong-Yi; Tai, Chih-Jaan; Hsieh, Tsu-Yi; Chen, Der-Yuan

2017-01-01

Medical education faces challenges concerning job burnout and emotional labor among junior physicians, which poses a potential threat to the quality of medical care. Although studies have investigated job burnout and emotional labor among physicians, empirical research on the association between job burnout, emotional labor, and clinical performance is lacking. This study investigated the effects of job burnout and emotional labor on clinical performance by using the objective structured clinical examination (OSCE) scores of interns and residents. Specifically, this cross-sectional study utilized the Maslach Burnout Inventory and the Emotional Labor Questionnaire as measurement instruments. A total of 225 interns and residents in central Taiwan answered structured questionnaires before beginning their OSCE. The major statistical analysis method employed was logistic regression. After adjustment for covariates, first-year residents were less likely than other residents to obtain high OSCE scores. The odds of high OSCE performance among interns and residents with high interaction component scores in emotional labor were significantly higher than those with low interaction scores. A high score in the interaction dimension of emotional labor was associated with strong clinical performance. The findings suggest that interventions which motivate positive attitudes and increase interpersonal interaction skills among physicians should receive higher priority.

Standard setting for OSCEs: trial of borderline approach.

PubMed

Kilminster, Sue; Roberts, Trudie

2004-01-01

OSCE examinations were held in May and June 2002 for all third and fourth year and some fifth year medical students at the University of Leeds. There has been an arbitrary pass mark of 65% for these examinations. However, we recognise that it is important to adopt a systematic approach towards standard setting in all examinations so held a trial of the borderline approach to standard setting for third and fifth year examinations. This paper reports our findings. The results for the year 3 OSCE demonstrated that the borderline approach to standard setting is feasible and offers a method to ensure that the pass standard is both justifiable and credible. It is efficient, requiring much less time than other methods and has the advantage of using the judgements of expert clinicians about actual practice. In addition it offers a way of empowering clinicians because it uses their expertise.

Web-based objective structured clinical examination with remote standardized patients and Skype: resident experience.

PubMed

Langenau, Erik; Kachur, Elizabeth; Horber, Dot

2014-07-01

Using Skype and remote standardized patients (RSPs), investigators sought to evaluate user acceptance of a web-based objective structured clinical examination (OSCE) among resident physicians. After participating in four web-based clinical encounters addressing pain with RSPs, 59 residents from different training programs, disciplines and geographic locations completed a 52-item questionnaire regarding their experience with Skype and RSPs. Open-ended responses were solicited as well. The majority of participants (97%) agreed or strongly agreed the web-based format was convenient and a practical learning exercise, and 90% agreed or strongly agreed the format was effective in teaching communication skills. Although 93% agreed or strongly agreed they could communicate easily with RSPs using Skype, 80% preferred traditional face-to-face clinical encounters, and 58% reported technical difficulties during the encounters. Open-ended written responses supported survey results. Findings from this study expose challenges with technology and human factors, but positive experiences support the continued investigation of web-based OSCEs as a synchronous e-learning initiative for teaching and assessing doctor-patient communication. Such educational programs are valuable but unlikely to replace face-to-face encounters with patients. This web-based OSCE program provides physician learners with additional opportunity to improve doctor-patient communication. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

Qualitative differences between traditional and rural-longitudinal medical student OSCE performance.

PubMed

Zink, Therese; Power, David V; Olson, Kenneth; Harris, Ilene B; Brooks, Kathleen D

2010-01-01

To ensure adequate observation, supervision, and mentoring of trainees, long-term preceptorships or apprenticeships are being reestablished in medical education. Equivalence in academic performance has been demonstrated between longitudinal students in the Rural Physician Associate Program (RPAP), who spend 9 months in a rural community during their third year of medical school, and their peers who complete their clerkships at different hospitals and clinics (traditional). We qualitatively reviewed the end of session Objective Structured Clinical Examination (OSCE) for both groups and compared their performances. The high and low performers on four OSCE scenarios (cough, dysuria in a teen, preventive care in an older male, medication reconciliation) for two cohorts of students: longitudinal (n=47) and traditional primary care clerkship students (n=60) were selected for review. These 16 videotapes were reviewed independently by three researchers. The themes and subthemes were discussed over four meetings. Both high and low scoring longitudinal students demonstrated more consistent use of rapport building skills. Longitudinal students appeared to have an effective pattern in their patient interactions and were more rehearsed at explaining preventive care recommendations such as the pros and cons of the prostate-specific antigen (PSA) test. Traditional students displayed a more complete mastery of the adolescent interview and followed a mnemonic taught during lecture. Qualitative assessment of OSCE data reveals information not captured in the quantitative scores. In this study, longitudinal students demonstrated better mastery of rapport building and content knowledge and had an effective routine to their patient encounters not evident in the traditional students' scenarios.

A Comparison of Assessment Tools: Is Direct Observation an Improvement Over Objective Structured Clinical Examinations for Communications Skills Evaluation?

PubMed

Goch, Abraham M; Karia, Raj; Taormina, David; Kalet, Adina; Zuckerman, Joseph; Egol, Kenneth A; Phillips, Donna

2018-04-01

Evaluation of resident physicians' communications skills is a challenging task and is increasingly accomplished with standardized examinations. There exists a need to identify the effective, efficient methods for assessment of communications skills. We compared objective structured clinical examination (OSCE) and direct observation as approaches for assessing resident communications skills. We conducted a retrospective cohort analysis of orthopaedic surgery resident physicians at a single tertiary care academic institution, using the Institute for Healthcare Communication "4 Es" model for effective communication. Data were collected between 2011 and 2015. A total of 28 residents, each with OSCE and complete direct observation assessment checklists, were included in the analysis. Residents were included if they had 1 OSCE assessment and 2 or more complete direct observation assessments. There were 28 of a possible 59 residents (47%) included. A total of 89% (25 of 28) of residents passed the communications skills OSCE; only 54% (15 of 28) of residents passed the direct observation communications assessment. There was a positive, moderate correlation between OSCE and direct observation scores overall ( r  = 0.415, P  = .028). There was no agreement between OSCE and direct observation in categorizing residents into passing and failing scores (κ = 0.205, P  = .16), after adjusting for chance agreement. Our results suggest that OSCE and direct observation tools provide different insights into resident communications skills (simulation of rare and challenging situations versus real-life daily encounters), and may provide useful perspectives on resident communications skills in different contexts.

A patient safety objective structured clinical examination.

PubMed

Singh, Ranjit; Singh, Ashok; Fish, Reva; McLean, Don; Anderson, Diana R; Singh, Gurdev

2009-06-01

There are international calls for improving education for health care workers around certain core competencies, of which patient safety and quality are integral and transcendent parts. Although relevant teaching programs have been developed, little is known about how best to assess their effectiveness. The objective of this work was to develop and implement an objective structured clinical examination (OSCE) to evaluate the impact of a patient safety curriculum. The curriculum was implemented in a family medicine residency program with 47 trainees. Two years after commencing the curriculum, a patient safety OSCE was developed and administered at this program and, for comparison purposes, to incoming residents at the same program and to residents at a neighboring residency program. All 47 residents exposed to the training, all 16 incoming residents, and 10 of 12 residents at the neighboring program participated in the OSCE. In a standardized patient case, error detection and error disclosure skills were better among trained residents. In a chart-based case, trained residents showed better performance in identifying deficiencies in care and described more appropriate means of addressing them. Third year residents exposed to a "Systems Approach" course performed better at system analysis and identifying system-based solutions after the course than before. Results suggest increased systems thinking and inculcation of a culture of safety among residents exposed to a patient safety curriculum. The main weaknesses of the study are its small size and suboptimal design. Much further investigation is needed into the effectiveness of patient safety curricula.

Formative Assessment of Procedural Skills: Students' Responses to the Objective Structured Clinical Examination and the Integrated Performance Procedural Instrument

ERIC Educational Resources Information Center

Nestel, Debra; Kneebone, Roger; Nolan, Carmel; Akhtar, Kash; Darzi, Ara

2011-01-01

Assessment of clinical skills is a critical element of undergraduate medical education. We compare a traditional approach to procedural skills assessment--the Objective Structured Clinical Examination (OSCE) with the Integrated Performance Procedural Instrument (IPPI). In both approaches, students work through "stations" or…

Standard Setting Methods for Pass/Fail Decisions on High-Stakes Objective Structured Clinical Examinations: A Validity Study.

PubMed

Yousuf, Naveed; Violato, Claudio; Zuberi, Rukhsana W

2015-01-01

CONSTRUCT: Authentic standard setting methods will demonstrate high convergent validity evidence of their outcomes, that is, cutoff scores and pass/fail decisions, with most other methods when compared with each other. The objective structured clinical examination (OSCE) was established for valid, reliable, and objective assessment of clinical skills in health professions education. Various standard setting methods have been proposed to identify objective, reliable, and valid cutoff scores on OSCEs. These methods may identify different cutoff scores for the same examinations. Identification of valid and reliable cutoff scores for OSCEs remains an important issue and a challenge. Thirty OSCE stations administered at least twice in the years 2010-2012 to 393 medical students in Years 2 and 3 at Aga Khan University are included. Psychometric properties of the scores are determined. Cutoff scores and pass/fail decisions of Wijnen, Cohen, Mean-1.5SD, Mean-1SD, Angoff, borderline group and borderline regression (BL-R) methods are compared with each other and with three variants of cluster analysis using repeated measures analysis of variance and Cohen's kappa. The mean psychometric indices on the 30 OSCE stations are reliability coefficient = 0.76 (SD = 0.12); standard error of measurement = 5.66 (SD = 1.38); coefficient of determination = 0.47 (SD = 0.19), and intergrade discrimination = 7.19 (SD = 1.89). BL-R and Wijnen methods show the highest convergent validity evidence among other methods on the defined criteria. Angoff and Mean-1.5SD demonstrated least convergent validity evidence. The three cluster variants showed substantial convergent validity with borderline methods. Although there was a high level of convergent validity of Wijnen method, it lacks the theoretical strength to be used for competency-based assessments. The BL-R method is found to show the highest convergent validity evidences for OSCEs with other standard setting methods used in the present study

Medical students review of formative OSCE scores, checklists, and videos improves with student-faculty debriefing meetings.

PubMed

Bernard, Aaron W; Ceccolini, Gabbriel; Feinn, Richard; Rockfeld, Jennifer; Rosenberg, Ilene; Thomas, Listy; Cassese, Todd

2017-01-01

Performance feedback is considered essential to clinical skills development. Formative objective structured clinical exams (F-OSCEs) often include immediate feedback by standardized patients. Students can also be provided access to performance metrics including scores, checklists, and video recordings after the F-OSCE to supplement this feedback. How often students choose to review this data and how review impacts future performance has not been documented. We suspect student review of F-OSCE performance data is variable. We hypothesize that students who review this data have better performance on subsequent F-OSCEs compared to those who do not. We also suspect that frequency of data review can be improved with faculty involvement in the form of student-faculty debriefing meetings. Simulation recording software tracks and time stamps student review of performance data. We investigated a cohort of first- and second-year medical students from the 2015-16 academic year. Basic descriptive statistics were used to characterize frequency of data review and a linear mixed-model analysis was used to determine relationships between data review and future F-OSCE performance. Students reviewed scores (64%), checklists (42%), and videos (28%) in decreasing frequency. Frequency of review of all metric and modalities improved when student-faculty debriefing meetings were conducted (p<.001). Among 92 first-year students, checklist review was associated with an improved performance on subsequent F-OSCEs (p = 0.038) by 1.07 percentage points on a scale of 0-100. Among 86 second year students, no review modality was associated with improved performance on subsequent F-OSCEs. Medical students review F-OSCE checklists and video recordings less than 50% of the time when not prompted. Student-faculty debriefing meetings increased student data reviews. First-year student's review of checklists on F-OSCEs was associated with increases in performance on subsequent F-OSCEs, however this

Psychiatric OSCE Performance of Students with and without a Previous Core Psychiatry Clerkship

ERIC Educational Resources Information Center

Goisman, Robert M.; Levin, Robert M.; Krupat, Edward; Pelletier, Stephen R.; Alpert, Jonathan E.

2010-01-01

Objective: The OSCE has been demonstrated to be a reliable and valid method by which to assess students' clinical skills. An OSCE station was used to determine whether or not students who had completed a core psychiatry clerkship demonstrated skills that were superior to those who had not taken the clerkship and which areas discriminated between…

Assessing MSW Students' Integrated Behavioral Health Skills Using an Objective Structured Clinical Examination

ERIC Educational Resources Information Center

Sampson, McClain; Parrish, Danielle E.; Washburn, Micki

2018-01-01

Within the last decade, there has been a significant shift in the field of social work toward competency-based education. This article details the use of the Objective Structured Clinical Examination (OSCE) Adapted for Social Work Performance Rating Scale. We used the measure to evaluate specific practice competencies among students (n = 33)…

Education research: case logs in the assessment of medical students in the neurology outpatient clinic.

PubMed

Albert, Dara V; Brorson, James R; Amidei, Christina; Lukas, Rimas V

2014-04-22

Using outpatient neurology clinic case logs completed by medical students on neurology clerkships, we examined the impact of outpatient clinical encounter volume per student on outcomes of knowledge assessed by the National Board of Medical Examiners (NBME) Clinical Neurology Subject Examination and clinical skills assessed by the Objective Structured Clinical Examination (OSCE). Data from 394 medical students from July 2008 to June 2012, representing 9,791 patient encounters, were analyzed retrospectively. Pearson correlations were calculated examining the relationship between numbers of cases logged per student and performance on the NBME examination. Similarly, correlations between cases logged and performance on the OSCE, as well as on components of the OSCE (history, physical examination, clinical formulation), were evaluated. There was a correlation between the total number of cases logged per student and NBME examination scores (r = 0.142; p = 0.005) and OSCE scores (r = 0.136; p = 0.007). Total number of cases correlated with the clinical formulation component of the OSCE (r = 0.172; p = 0.001) but not the performance on history or physical examination components. The volume of cases logged by individual students in the outpatient clinic correlates with performance on measures of knowledge and clinical skill. In measurement of clinical skill, seeing a greater volume of patients in the outpatient clinic is related to improved clinical formulation on the OSCE. These findings may affect methods employed in assessment of medical students, residents, and fellows.

Standard Setting for OSCEs: Trial of Borderline Approach

ERIC Educational Resources Information Center

Kilminster, Sue; Roberts, Trudie

2004-01-01

OSCE examinations were held in May and June 2002 for all third and fourth year and some fifth year medical students at the University of Leeds. There has been an arbitrary pass mark of 65% for these examinations. However, we recognise that it is important to adopt a systematic approach towards standard setting in all examinations so held a trial…

Self-assessment differences between genders in a low-stakes objective structured clinical examination (OSCE).

PubMed

Madrazo, Lorenzo; Lee, Claire B; McConnell, Meghan; Khamisa, Karima

2018-06-15

Physicians and medical students are generally poor-self assessors. Research suggests that this inaccuracy in self-assessment differs by gender among medical students whereby females underestimate their performance compared to their male counterparts. However, whether this gender difference in self-assessment is observable in low-stakes scenarios remains unclear. Our study's objective was to determine whether self-assessment differed between male and female medical students when compared to peer-assessment in a low-stakes objective structured clinical examination. Thirty-three (15 males, 18 females) third-year students participated in a 5-station mock objective structured clinical examination. Trained fourth-year student examiners scored their performance on a 6-point Likert-type global rating scale. Examinees also scored themselves using the same scale. To examine gender differences in medical students' self-assessment abilities, mean self-assessment global rating scores were compared with peer-assessment global rating scores using an independent samples t test. Overall, female students' self-assessment scores were significantly lower compared to peer-assessment (p < 0.001), whereas no significant difference was found between self- and peer-assessment scores for male examinees (p = 0.228). This study provides further evidence that underestimation in self-assessment among females is observable even in a low-stakes formative objective structured clinical examination facilitated by fellow medical students.

Medical students review of formative OSCE scores, checklists, and videos improves with student-faculty debriefing meetings

PubMed Central

Bernard, Aaron W.; Ceccolini, Gabbriel; Feinn, Richard; Rockfeld, Jennifer; Rosenberg, Ilene; Thomas, Listy; Cassese, Todd

2017-01-01

ABSTRACT Background: Performance feedback is considered essential to clinical skills development. Formative objective structured clinical exams (F-OSCEs) often include immediate feedback by standardized patients. Students can also be provided access to performance metrics including scores, checklists, and video recordings after the F-OSCE to supplement this feedback. How often students choose to review this data and how review impacts future performance has not been documented. Objective: We suspect student review of F-OSCE performance data is variable. We hypothesize that students who review this data have better performance on subsequent F-OSCEs compared to those who do not. We also suspect that frequency of data review can be improved with faculty involvement in the form of student-faculty debriefing meetings. Design: Simulation recording software tracks and time stamps student review of performance data. We investigated a cohort of first- and second-year medical students from the 2015-16 academic year. Basic descriptive statistics were used to characterize frequency of data review and a linear mixed-model analysis was used to determine relationships between data review and future F-OSCE performance. Results: Students reviewed scores (64%), checklists (42%), and videos (28%) in decreasing frequency. Frequency of review of all metric and modalities improved when student-faculty debriefing meetings were conducted (p<.001). Among 92 first-year students, checklist review was associated with an improved performance on subsequent F-OSCEs (p = 0.038) by 1.07 percentage points on a scale of 0-100. Among 86 second year students, no review modality was associated with improved performance on subsequent F-OSCEs. Conclusion: Medical students review F-OSCE checklists and video recordings less than 50% of the time when not prompted. Student-faculty debriefing meetings increased student data reviews. First-year student’s review of checklists on F-OSCEs was associated with

Coupled thermal, electrical, and fluid flow analyses of AMTEC converters, with illustrative application to OSC`s cell design

DOE Office of Scientific and Technical Information (OSTI.GOV)

Schock, A.; Noravian, H.; Or, C.

1997-12-31

This paper presents the background and introduction to the OSC AMTEC (Alkali Metal Thermal-to-Electrical Conversion) studies, which were conducted for the Department of energy (DOE) and NASA`s jet Propulsion Laboratory (JPL). After describing the basic principle of AMTEC, the paper describes and explains the operation of multi-tube vapor/vapor cells, which have been under development by AMPS (Advance Modular Power Systems, Inc.) for the Air Force Phillips Laboratory (AFPL) and JPL for possible application to the Europa Orbiter, Pluto Express, and other space missions. It then describes a novel OSC-generated methodology for analyzing the performance of such cells. This methodology consistsmore » of an iterative procedure for the coupled solution of the interdependent thermal, electrical, and fluid flow differential and integral equations governing the performance of AMTEC cells and generators, taking proper account of the non-linear axial variations of temperature, pressure, open-circuit voltage, inter-electrode voltages, current density, axial current, sodium mass flow rate, and power density. The paper illustrates that analytical procedure by applying it to OSC`s latest cell design and by presenting detailed analytical results for that design. The OSC-developed analytic methodology constitutes a unique and powerful tool for accurate parametric analyses and design optimizations of the multi-tube AMTEC cells and of radioisotope power systems. This is illustrated in two companion papers in these proceedings. The first of those papers applies the OSC-derived program to determine the effect of various design parameters on the performance of single AMTEC cells with adiabatic side walls, culminating in an OSC-recommended revised cell design. And the second describes a number of OSC-generated AMTEC generator designs consisting of 2 and 3 GPHS heat source modules, 16 multi-tube converter cells, and a hybrid insulation design, and presents the results of applying the

Health Literacy in Transitions of Care: An Innovative Objective Structured Clinical Examination for Fourth-Year Medical Students in an Internship Preparation Course.

PubMed

Bloom-Feshbach, Kimberly; Casey, Dana; Schulson, Lucy; Gliatto, Peter; Giftos, Jonathan; Karani, Reena

2016-02-01

Low health literacy is associated with adverse health outcomes, especially during transitions of care. Competency-based assessments may improve communication during this time. To develop an Objective Structured Clinical Examination (OSCE) for medical students to demonstrate communication skills to be used during the hospital discharge process with patients of low health literacy. The OSCE was integrated into the curriculum of an internship preparatory clerkship. One hundred and one fourth-year medical students participated. Students received a skills-based health literacy workshop. In the OSCE, learners counseled standardized patients regarding initiation of anticoagulation at discharge and wrote discharge instructions. Fifty-seven students completed the workshop prior to the OSCE, and 44 participated in the workshop after the completing the OSCE. Participants who completed the workshop first outperformed their peers on the checklist (15.1 vs. 13.4, p < 0.0001) and on the reading level of their written instructions (9.9 vs. 10.6, p = 0.01); 82% felt confident communicating with patients of low health literacy after the workshop and OSCE. This OSCE is a tool to train and evaluate future interns' ability to communicate with patients of limited health literacy levels at hospital discharge. Such innovations may make this period of time safer for patients, improving health outcomes.

Associations of medical student empathy with clinical competence.

PubMed

Casas, Rachel S; Xuan, Ziming; Jackson, Angela H; Stanfield, Lorraine E; Harvey, Nanette C; Chen, Daniel C

2017-04-01

Empathy is a crucial skill for medical students that can be difficult to evaluate. We examined if self-reported empathy in medical students was associated with clinical competence. This study combined cross-sectional data from four consecutive years of medical students (N=590) from the Boston University School of Medicine. We used regression analysis to evaluate if self-reported empathy (Jefferson Scale of Physician Empathy (JSPE)) predicted scores in clinical clerkships, United States Medical Licensing Examinations, and OBJECTIVE: Structured Clinical Examinations (OSCEs). We separately analyzed overall and OSCE communication scores based on interpersonal skills reported by standardized patients. We controlled for age, gender, debt, and specialty affinity. JSPE scores of medical students were positively associated with OSCE communication scores, and remained significant when controlling for demographics. We found that JSPE score was also predictive of overall OSCE scores, but this relationship was confounded by gender and age. JSPE scores were associated with performance in the Pediatrics clerkship, but not other clerkships or standardized tests. JSPE scores were positively associated with OSCE communication scores in medical students. This study supports that self-reported empathy may predict OSCE performance, but further research is needed to examine differences by gender and age. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Evaluation of a multi-methods approach to the collection and dissemination of feedback on OSCE performance in dental education.

PubMed

Wardman, M J; Yorke, V C; Hallam, J L

2018-05-01

Feedback is an essential part of the learning process, and students expect their feedback to be personalised, meaningful and timely. Objective Structured Clinical Examination (OSCE) assessments allow examiners to observe students carefully over the course of a number of varied station types, across a number of clinical knowledge and skill domains. They therefore present an ideal opportunity to record detailed feedback which allows students to reflect on and improve their performance. This article outlines two methods by which OSCE feedback was collected and then disseminated to undergraduate dental students across 2-year groups in a UK dental school: (i) Individual written feedback comments made by examiners during the examination, (ii) General audio feedback recorded by groups of examiners immediately following the examination. Evaluation of the feedback was sought from students and staff examiners. A multi-methods approach utilising Likert questionnaire items (quantitative) and open-ended feedback questions (qualitative) was used. Data analysis explored student and staff perceptions of the audio and written feedback. A total of 131 students (response rate 68%) and 52 staff examiners (response rate 83%) completed questionnaires. Quantitative data analysis showed that the written and audio formats were reported as a meaningful source of feedback for learning by both students (93% written, 89% audio) and staff (96% written, 92% audio). Qualitative data revealed the complementary nature of both types of feedback. Written feedback gives specific, individual information whilst audio shares general observations and allows students to learn from others. The advantages, limitations and challenges of the feedback methods are discussed, leading to the development of an informed set of implementation guidelines. Written and audio feedback methods are valued by students and staff. It is proposed that these may be very easily applied to OSCEs running in other dental schools. �

Standardization of Clinical Skill Evaluation in Physical/Occupational Therapist Education –Effects of Introduction of an Education System Using OSCE–

PubMed Central

Sakurai, Hiroaki; Kanada, Yoshikiyo; Sugiura, Yoshito; Motoya, Ikuo; Yamada, Masayuki; Tomita, Masao; Naka, Toru; Teranishi, Toshio; Tanabe, Shigeo; Tsujimura, Toru; Okanishi, Tetsuo

2013-01-01

[Purpose] A major issue in physical/occupational therapist education is the improvement of students' clinical techniques. In this study, we introduced an education system using an Objective Structured Clinical Examination (OSCE), and made an attempt at standardization of its evaluation. [Subjects] The subjects were 227 students in the classes of 2008 to 2010 who enrolled at our university between 2004 and 2006, before the introduction of the education system using OSCE, and 221 students in the classes of 2011 to 2013 who enrolled between 2007 and 2009, after the introduction. [Methods] Performances in attitude and skills (performance in clinical training and OSCE) were compared between before and after the introduction of OSCE. OSCE results were compared between before and after clinical trainings at each OSCE Level; and the correlation of between performances in clinical training and OSCE was examined. [Results] Performances in OSCE and clinical training (attitude, skills) were improved by the introduction of the education system using OSCE, but no significant correlation was observed in the relationship between performances in OSCE and clinical training. [Conclusion] Further studies should be conducted aiming at the standardization of clinical skill evaluation in postgraduate education to establish an education system using OSCE. PMID:24259918

True communication skills assessment in interdepartmental OSCE stations: Standard setting using the MAAS-Global and EduG.

PubMed

Setyonugroho, Winny; Kropmans, Thomas; Murphy, Ruth; Hayes, Peter; van Dalen, Jan; Kennedy, Kieran M

2018-01-01

Comparing outcome of clinical skills assessment is challenging. This study proposes reliable and valid comparison of communication skills (1) assessment as practiced in Objective Structured Clinical Examinations (2). The aim of the present study is to compare CS assessment, as standardized according to the MAAS Global, between stations in a single undergraduate medical year. An OSCE delivered in an Irish undergraduate curriculum was studied. We chose the MAAS-Global as an internationally recognized and validated instrument to calibrate the OSCE station items. The MAAS-Global proportion is the percentage of station checklist items that can be considered as 'true' CS. The reliability of the OSCE was calculated with G-Theory analysis and nested ANOVA was used to compare mean scores of all years. MAAS-Global scores in psychiatry stations were significantly higher than those in other disciplines (p<0.03) and above the initial pass mark of 50%. The higher students' scores in psychiatry stations were related to higher MAAS-Global proportions when compared to the general practice stations. Comparison of outcome measurements, using the MAAS Global as a standardization instrument, between interdisciplinary station checklists was valid and reliable. The MAAS-Global was used as a single validated instrument and is suggested as gold standard. Copyright © 2017. Published by Elsevier B.V.

Impact of a Student-Driven, Virtual Patient Application on Objective Structured Clinical Examination Performance: Observational Study.

PubMed

Bergeron, David; Champagne, Jean-Nicolas; Qi, Wen; Dion, Maxime; Thériault, Julie; Renaud, Jean-Sébastien

2018-02-22

Peer-assisted learning (PAL) refers to a learning activity whereby students of similar academic level teach and learn from one another. Groupe de perfectionnement des habiletés cliniques (Clinical Skills Improvement Group), a student organization at Université Laval, Canada, propelled PAL into the digital era by creating a collaborative virtual patient platform. Medical interviews can be completed in pairs (a student-patient and a student-doctor) through an interactive Web-based application, which generates a score (weighted for key questions) and automated feedback. The aim of the study was to measure the pedagogical impact of the application on the score at medical interview stations at the summative preclerkship Objective Structured Clinical Examination (OSCE). We measured the use of the application (cases completed, mean score) in the 2 months preceding the OSCE. We also accessed the results of medical interview stations at the preclerkship summative OSCE. We analyzed whether using the application was associated with higher scores and/or better passing grades (≥60%) at the OSCE. Finally, we produced an online form where students could comment on their appreciation of the application. Of the 206 students completing the preclerkship summative OSCE, 170 (82.5%) were registered users on the application, completing a total of 3133 cases (18 by active user in average, 7 minutes by case in average). The appreciation questionnaire was answered online by 45 students who mentioned appreciating the intuitive, easy-to-use, and interactive design, the diversity of cases, and the automated feedback. Using the application was associated with reduced reported stress, improved scores (P=.04), and improved passing rates (P=.11) at the preclerkship summative OSCE. This study suggests that PAL can go far beyond small-group teaching, showing students' potential to create helpful pedagogical tools for their peers. ©David Bergeron, Jean-Nicolas Champagne, Wen Qi, Maxime Dion

The effectiveness of immediate feedback during the objective structured clinical examination.

PubMed

Hodder, R V; Rivington, R N; Calcutt, L E; Hart, I R

1989-03-01

Using eight different physical examination or technical stations, 400 examinations were conducted to evaluate the effectiveness of immediate feedback during the Objective Structured Clinical Examination (OSCE). The test group comprised 50 medical students who underwent a standard 4-minute examination followed by 2 minutes of feedback. Immediately following feedback the students repeated an identical 4-minute examination scored by the same examiners. The control group consisted of 50 students from the same class who underwent an identical testing sequence, but instead of receiving feedback, they were instructed to continue their examinations for an additional 2 minutes before repeating the stations. Simple repetition of the task did not significantly improve score (mean increase 2.0%, NS). Extending the testing period from 4 to 6 minutes resulted in a small but significant increase in score (mean 6.7%, P less than 0.001). However, there was a much larger increase in the scores obtained following 2 minutes of immediate feedback compared to pre-feedback performance (mean 26.3%, P less than 0.0001). The majority of students and examiners felt that feedback, as administered in this study, was valuable both as a learning and teaching experience. Short periods of immediate feedback during an OSCE are practical and can improve competency in the performance of criterion-based tasks, at least over the short term. In addition, such feedback provides students with valuable self-assessment that may stimulate further learning.

Does an Advanced Pelvic Simulation Curriculum Improve Resident Performance on a Pediatric and Adolescent Gynecology Focused Objective Structured Clinical Examination? A Cohort Study.

PubMed

Dumont, Tania; Hakim, Julie; Black, Amanda; Fleming, Nathalie

2016-06-01

To determine the effect of an advanced pelvic simulation curriculum on resident performance on a pediatric and adolescent gynecology (PAG) focused objective structured clinical examination (OSCE). Obstetrics and gynecology residents in a single academic Canadian center participated in a PAG simulation curriculum. An OSCE on prepubertal vaginal bleeding was administered at the biannual OSCE examination 2 months before the simulation curriculum and again 3 months after the simulation curriculum. Academic half-day at the University of Ottawa Skills and Simulation Centre. Obstetrics and gynecology residents from the University of Ottawa. Participants completed 4 stations teaching PAG-appropriate history-taking, genital examination, Tanner staging, vaginal sampling and flushing, hymenectomy, vaginoscopy, laparoscopic adnexal detorsion, and approach to the child and/or adolescent. Advanced pelvic models were used for procedure-specific stations. The primary outcome measure was change in mean score on a prepubertal vaginal bleeding OSCE station. Secondary outcome measures were changes in individual component scores. Fourteen residents completed the simulation curriculum and the PAG OSCE at the 2 separate time points (before and after simulation curriculum). The mean OSCE score before the simulation curriculum was 54.6% (20.5 of 37) and mean score after the curriculum was 78.1% (28.9 of 37; P < .001). Significant score increases were found in history-taking, examination, differential diagnosis, identification of organism, surgical procedures, and identification of foreign body (P < .01 for all). This innovative PAG simulation curriculum significantly increased residents' knowledge in PAG history-taking, examination skills, operative procedures, and approach to the child and/or adolescent. Obstetrics and Gynecology Program Directors should consider incorporating PAG simulation training into their curriculum to ensure that residents meet their learning objectives and

Use of online clinical videos for clinical skills training for medical students: benefits and challenges.

PubMed

Jang, Hye Won; Kim, Kyong-Jee

2014-03-21

Multimedia learning has been shown effective in clinical skills training. Yet, use of technology presents both opportunities and challenges to learners. The present study investigated student use and perceptions of online clinical videos for learning clinical skills and in preparing for OSCE (Objective Structured Clinical Examination). This study aims to inform us how to make more effective us of these resources. A mixed-methods study was conducted for this study. A 30-items questionnaire was administered to investigate student use and perceptions of OSCE videos. Year 3 and 4 students from 34 Korean medical schools who had access to OSCE videos participated in the online survey. Additionally, a semi-structured interview of a group of Year 3 medical students was conducted for an in-depth understanding of student experience with OSCE videos. 411 students from 31 medical schools returned the questionnaires; a majority of them found OSCE videos effective for their learning of clinical skills and in preparing for OSCE. The number of OSCE videos that the students viewed was moderately associated with their self-efficacy and preparedness for OSCE (p < 0.05). One-thirds of those surveyed accessed the video clips using mobile devices; they agreed more with the statement that it was convenient to access the video clips than their peers who accessed the videos using computers (p < 0.05). Still, students reported lack of integration into the curriculum and lack of interaction as barriers to more effective use of OSCE videos. The present study confirms the overall positive impact of OSCE videos on student learning of clinical skills. Having faculty integrate these learning resources into their teaching, integrating interactive tools into this e-learning environment to foster interactions, and using mobile devices for convenient access are recommended to help students make more effective use of these resources.

Multiple mini-interview as a predictor of performance in the objective structured clinical examination among Physician Associates in the United Kingdom: a cohort study.

PubMed

Kumar, Narendra; Bhardwaj, Shailaja; Rahman, Eqram

2018-01-01

Patient satisfaction and health care outcomes are directly linked to useful communication skills. Therefore, excellent interpersonal skills are imperative for health care professionals. Multiple mini-interview (MMI) is designed as a selection tool to assess the communication skills of applicants in medical schools during the admission process. However, objective structured clinical examination (OSCE) assesses students' communication and clinical skills at the end of their academic terms. Recently, Anglia Ruskin University, Chelmsford, UK, adopted MMI in the selection process for the first cohort of MSc Physician Associate trainees for the academic year 2015-2016. This study aimed to determine the likelihood of MMI as a predictor of future performance of communication skills in the OSCE. The anonymous data of the average scores of communication skills attained in MMI and OSCE at the end of year 1 were collected for 30 students from the Physician Associate program team. Subsequently, Pearson's correlation was computed to determine the relationship between the average scores of communication skills attained in MMI, and OSCE during trimester 2 and trimester 3 by the Physician Associate trainees. The study showed positive correlation between the scores of communication skills attained in MMI and OSCE during trimester 2 ( r =0.956, n=30, p <0.001) and trimester 3 ( r =0.966, n=30, p <0.001). The study provides empirical evidence for the validity of MMI as a predictor of future performance of Physician Associate trainees' communication skills during subsequent OSCEs.

Using modified information delivery to enhance the traditional pharmacy OSCE program at TMU - a pilot study.

PubMed

Lin, Che-Wei; Chang, Elizabeth H; Clinciu, Daniel L; Peng, Yun-Ting; Huang, Wen-Chen; Wu, Chien-Chih; Wu, Jen-Chieh; Li, Yu-Chuan

2018-05-01

Objective Structured Clinical Examination (OSCE) has been used in many areas of healthcare training over the years. However, it constantly needs to be upgraded and enhanced due to technological and teaching changes. We aim at implementing an integrative OSCE method which employs informatics via the virtual patient within the pharmacy education curriculum at Taipei Medical University to enhance the pharmacy students' competence for using and disseminating information and to also improve critical thinking and clinical reasoning. We propose an integrated pharmacy OSCE which uses standardized patients and virtual patients (DxR Clinician). To evaluate this method, we designed four simulated stations and pilot tested with 19 students in the first year of the Master in Clinical Pharmacy program. Three stations were simulated as the inpatient pharmacy: 1) History and lab data collection; 2) Prescription review; 3) Calling physician to discuss potential prescription problems. The fourth was simulated as the patient ward station to provide patient education. A satisfaction questionnaire was administered at the end of the study. Students rated their ability of 2.84, 2.37, 2.37, and 3.63 of 5 for each of the four stations, with the second and third being the most difficult stations. The method obtained an average rating of 4.32 of 5 for relevance, 4.16 for improving clinical ability, 4.32 for practicality in future healthcare work, and 4.28 for willing to have another similar learning experience. The integration of Virtual Patient in this study reveals that this assessment method is efficient and practical in many aspects. Most importantly, it provides the test taker with a much closer real-life clinical encounter. Although it is in many ways more difficult, it also provides for better "learning from mistakes" opportunities for test-takers. Copyright © 2017. Published by Elsevier B.V.

Measurement of the levels anxiety, self-perception of preparation and expectations for success using an objective structured clinical examination, a written examination, and a preclinical preparation test in Kerman dental students.

PubMed

Kalantari, Mahsa; Zadeh, Nazila Lashkari; Agahi, Raha Habib; Navabi, Nader; Hashemipour, Maryam Alsadat; Nassab, Amir Hossein Gandjalikhan

2017-01-01

Examinations have an important role in evaluating students' learning outcomes and their mastery of a subject. Passing or failing an examination can have far-reaching consequences for the students. Therefore, it is not surprising that international studies consistently show that dental students report examinations and grades among the highest ranking stressors in dental schools. The aim of this research was to measure the levels of anxiety, self-perception of preparation and expectations for success using an objective structured clinical examination (OSCE), a written examination and a preclinical preparation test, and to examine the effects of the three predictive variables on the outcomes of assessments. The present research is a cross-sectional study. The population under consideration was students of Kerman Dental School in 2013. Examination anxiety was measured with Spielberger's state anxiety inventory. Preparation for the assessment (I am fully prepared = 4, I am prepared = 3, I'm not prepared = 2, I'm not fully prepared = 1) and expectation to succeed (I am quite successful = 4, I am successful = 3, I'm not successful = 2, I'm not quite successful = 1) were quantified with Likert scale. The questionnaire was completed during an OSCE, a written examination, a preclinical crown and bridge preparation test and a nonexamination situation. The study population consisted of 138 4 th , 5 th , and 6 th year Kerman dental students (65 males and 73 females). The results showed that all the assessment methods induced a significant increase in state anxiety compared to baseline levels with the highest anxiety levels reported during an OSCE (62.4 ± 8.1, P = 0.04) and a written examination (48.8 ± 9.2, P = 0.04). The preparation levels in females were significantly higher than those in males in OSCE ( P = 0.03) and written ( P = 0.04). State anxiety was high in all the three assessment methods. OSCE induced more anxiety than other assessment formats. However, anxiety was

The value of best-practice guidelines for OSCEs in a postgraduate program in an Australian remote area setting.

PubMed

Jeffrey, Carol A; Mitchell, Marion L; Henderson, Amanda; Lenthall, Sue; Knight, Sabina; Glover, Pauline; Kelly, Michelle; Nulty, Duncan; Groves, Michele

2014-01-01

Nurses in remote areas of Australia are the primary healthcare professionals, who need to be able to deliver comprehensive and culturally sensitive care to clients, many of whom are Indigenous Australians. Adequate and specific preparation for practice is crucial to the quality of care delivered by remote area nurses (RANs). Objective structured clinical examinations (OSCE) provide an excellent opportunity for student practice in a simulated environment that is safe, authentic, fair and valid when well constructed. Seven integrated best practice guidelines (BPGs), previously developed by project team members to inform OSCEs within educational programs, provided guidance in restructuring the OSCE. This paper provides a detailed analysis of the value of BPGs used in the development, teaching and learning, and evaluation of OSCEs in a rural and remote postgraduate course for RANs. A pre-site visit to the Centre for Remote Health, Alice Springs, Northern Territory, was conducted with modification of the course and previous OSCE according to BPGs. Following delivery of the course and OSCE, evaluations occurred via a mixed method approach. Student surveys (n=15) and focus groups (n=13) and staff interviews (n=5) provided an in-depth analysis of their perceptions of the revised OSCE. Descriptive statistics were used to describe the student sample. The narrative data were transcribed verbatim and analysed using content analysis. Triangulation was achieved with the convergence of the separate data sources focusing on themes and patterns within and between students and tutors. All 15 students and five tutors provided feedback. The majority of student participants had limited experience in working in remote area nursing prior to participation and therefore the opportunities that availed themselves were critical in adequately equipping them with the requisite knowledge, skills and abilities. Three themes emerged from the data: (1) value of common and significant events in OSCE

Order effects in high stakes undergraduate examinations: an analysis of 5 years of administrative data in one UK medical school.

PubMed

Burt, Jenni; Abel, Gary; Barclay, Matt; Evans, Robert; Benson, John; Gurnell, Mark

2016-10-11

To investigate the association between student performance in undergraduate objective structured clinical examinations (OSCEs) and the examination schedule to which they were assigned to undertake these examinations. Analysis of routinely collected data. One UK medical school. 2331 OSCEs of 3 different types (obstetrics OSCE, paediatrics OSCE and simulated clinical encounter examination OSCE) between 2009 and 2013. Students were not quarantined between examinations. (1) Pass rates by day examination started, (2) pass rates by day station undertaken and (3) mean scores by day examination started. We found no evidence that pass rates differed according to the day on which the examination was started by a candidate in any of the examinations considered (p>0.1 for all). There was evidence (p=0.013) that students were more likely to pass individual stations on the second day of the paediatrics OSCE (OR 1.27, 95% CI 1.05 to 1.54). In the cases of the simulated clinical encounter examination and the obstetrics and gynaecology OSCEs, there was no (p=0.42) or very weak evidence (p=0.099), respectively, of any such variation in the probability of passing individual stations according to the day they were attempted. There was no evidence that mean scores varied by day apart from the paediatric OSCE, where slightly higher scores were achieved on the second day of the examination. There is little evidence that different examination schedules have a consistent effect on pass rates or mean scores: students starting the examinations later were not consistently more or less likely to pass or score more highly than those starting earlier. The practice of quarantining students to prevent communication with (and subsequent unfair advantage for) subsequent examination cohorts is unlikely to be required. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/.

A fast 4D cone beam CT reconstruction method based on the OSC-TV algorithm.

PubMed

Mascolo-Fortin, Julia; Matenine, Dmitri; Archambault, Louis; Després, Philippe

2018-01-01

Four-dimensional cone beam computed tomography allows for temporally resolved imaging with useful applications in radiotherapy, but raises particular challenges in terms of image quality and computation time. The purpose of this work is to develop a fast and accurate 4D algorithm by adapting a GPU-accelerated ordered subsets convex algorithm (OSC), combined with the total variation minimization regularization technique (TV). Different initialization schemes were studied to adapt the OSC-TV algorithm to 4D reconstruction: each respiratory phase was initialized either with a 3D reconstruction or a blank image. Reconstruction algorithms were tested on a dynamic numerical phantom and on a clinical dataset. 4D iterations were implemented for a cluster of 8 GPUs. All developed methods allowed for an adequate visualization of the respiratory movement and compared favorably to the McKinnon-Bates and adaptive steepest descent projection onto convex sets algorithms, while the 4D reconstructions initialized from a prior 3D reconstruction led to better overall image quality. The most suitable adaptation of OSC-TV to 4D CBCT was found to be a combination of a prior FDK reconstruction and a 4D OSC-TV reconstruction with a reconstruction time of 4.5 minutes. This relatively short reconstruction time could facilitate a clinical use.

Multiple mini-interview as a predictor of performance in the objective structured clinical examination among Physician Associates in the United Kingdom: a cohort study

PubMed Central

Kumar, Narendra; Bhardwaj, Shailaja; Rahman, Eqram

2018-01-01

Introduction Patient satisfaction and health care outcomes are directly linked to useful communication skills. Therefore, excellent interpersonal skills are imperative for health care professionals. Multiple mini-interview (MMI) is designed as a selection tool to assess the communication skills of applicants in medical schools during the admission process. However, objective structured clinical examination (OSCE) assesses students’ communication and clinical skills at the end of their academic terms. Recently, Anglia Ruskin University, Chelmsford, UK, adopted MMI in the selection process for the first cohort of MSc Physician Associate trainees for the academic year 2015–2016. This study aimed to determine the likelihood of MMI as a predictor of future performance of communication skills in the OSCE. Materials and methods The anonymous data of the average scores of communication skills attained in MMI and OSCE at the end of year 1 were collected for 30 students from the Physician Associate program team. Subsequently, Pearson’s correlation was computed to determine the relationship between the average scores of communication skills attained in MMI, and OSCE during trimester 2 and trimester 3 by the Physician Associate trainees. Results The study showed positive correlation between the scores of communication skills attained in MMI and OSCE during trimester 2 (r=0.956, n=30, p<0.001) and trimester 3 (r=0.966, n=30, p<0.001). Conclusion The study provides empirical evidence for the validity of MMI as a predictor of future performance of Physician Associate trainees’ communication skills during subsequent OSCEs. PMID:29695944

Training Family Medicine Residents in Effective Communication Skills While Utilizing Promotoras as Standardized Patients in OSCEs: A Health Literacy Curriculum.

PubMed

Pagels, Patti; Kindratt, Tiffany; Arnold, Danielle; Brandt, Jeffrey; Woodfin, Grant; Gimpel, Nora

2015-01-01

Introduction. Future health care providers need to be trained in the knowledge and skills to effectively communicate with their patients with limited health literacy. The purpose of this study is to develop and evaluate a curriculum designed to increase residents' health literacy knowledge, improve communication skills, and work with an interpreter. Materials and Methods. Family Medicine residents (N = 25) participated in a health literacy training which included didactic lectures and an objective structured clinical examination (OSCE). Community promotoras acted as standardized patients and evaluated the residents' ability to measure their patients' health literacy, communicate effectively using the teach-back and Ask Me 3 methods, and appropriately use an interpreter. Pre- and postknowledge, attitudes, and postdidactic feedback were obtained. We compared OSCE scores from the group that received training (didactic group) and previous graduates. Residents reported the skills they used in practice three months later. Results. Family Medicine residents showed an increase in health literacy knowledge (p = 0.001) and scored in the adequately to expertly performed range in the OSCE. Residents reported using the teach-back method (77.8%) and a translator more effectively (77.8%) three months later. Conclusions. Our innovative health literacy OSCE can be replicated for medical learners at all levels of training.

Training Family Medicine Residents in Effective Communication Skills While Utilizing Promotoras as Standardized Patients in OSCEs: A Health Literacy Curriculum

PubMed Central

Pagels, Patti; Kindratt, Tiffany; Arnold, Danielle; Brandt, Jeffrey; Woodfin, Grant; Gimpel, Nora

2015-01-01

Introduction. Future health care providers need to be trained in the knowledge and skills to effectively communicate with their patients with limited health literacy. The purpose of this study is to develop and evaluate a curriculum designed to increase residents' health literacy knowledge, improve communication skills, and work with an interpreter. Materials and Methods. Family Medicine residents (N = 25) participated in a health literacy training which included didactic lectures and an objective structured clinical examination (OSCE). Community promotoras acted as standardized patients and evaluated the residents' ability to measure their patients' health literacy, communicate effectively using the teach-back and Ask Me 3 methods, and appropriately use an interpreter. Pre- and postknowledge, attitudes, and postdidactic feedback were obtained. We compared OSCE scores from the group that received training (didactic group) and previous graduates. Residents reported the skills they used in practice three months later. Results. Family Medicine residents showed an increase in health literacy knowledge (p = 0.001) and scored in the adequately to expertly performed range in the OSCE. Residents reported using the teach-back method (77.8%) and a translator more effectively (77.8%) three months later. Conclusions. Our innovative health literacy OSCE can be replicated for medical learners at all levels of training. PMID:26491565

Exploring personality dimensions that influence practice and performance of a simulated laparoscopic task in the objective structured clinical examination.

PubMed

Malhotra, Neha; Poolton, Jamie M; Wilson, Mark R; Leung, Gilberto; Zhu, Frank; Fan, Joe K M; Masters, Rich S W

2015-01-01

Surgical educators have encouraged the investigation of individual differences in aptitude and personality in surgical performance. An individual personality difference that has been shown to influence laparoscopic performance under time pressure is movement specific reinvestment. Movement specific reinvestment has 2 dimensions, movement self-consciousness (MS-C) (i.e., the propensity to consciously monitor movements) and conscious motor processing (CMP) (i.e., the propensity to consciously control movements), which have been shown to differentially influence laparoscopic performance in practice but have yet to be investigated in the context of psychological stress (e.g., the objective structured clinical examination [OSCE]). This study investigated the role of individual differences in propensity for MS-C and CMP in practice of a fundamental laparoscopic skill and in laparoscopic performance during the OSCE. Furthermore, this study examined whether individual differences during practice of a fundamental laparoscopic skill were predictive of laparoscopic performance during the OSCE. Overall, 77 final-year undergraduate medical students completed the movement specific reinvestment scale, an assessment tool that quantifies the propensity for MS-C and CMP. Participants were trained to proficiency on a fundamental laparoscopic skill. The number of trials to reach proficiency was measured, and completion times were recorded during early practice, later practice, and the OSCE. There was a trend for CMP to be negatively associated with the number of trials to reach proficiency (p = 0.064). A higher propensity for CMP was associated with fewer trials to reach proficiency (β = -0.70, p = 0.023). CMP and MS-C did not significantly predict completion times in the OSCE (p > 0.05). Completion times in early practice (β = 0.05, p = 0.016) and later practice (β = 0.47, p < 0.001) and number of trials to reach proficiency (β = 0.23, p = 0.003) significantly predicted

Examination to assess the clinical examination and documentation of spine pathology among orthopedic residents.

PubMed

Haglin, Jack M; Zeller, John L; Egol, Kenneth A; Phillips, Donna P

2017-12-01

The Accreditation Council for Graduate Medical Education (ACGME) guidelines requires residency programs to teach and evaluate residents in six overarching "core competencies" and document progress through educational milestones. To assess the progress of orthopedic interns' skills in performing a history, physical examination, and documentation of the encounter for a standardized patient with spinal stenosis, an objective structured clinical examination (OSCE) was conducted for 13 orthopedic intern residents, following a 1-month boot camp that included communications skills and curriculum in history and physical examination. Interns were objectively scored based on their performance of the physical examination, communication skills, completeness and accuracy of their electronic medical record (EMR), and their diagnostic conclusions gleaned from the patient encounter. The purpose of this study was to meaningfully assess the clinical skills of orthopedic post-graduate year (PGY)-1 interns. The findings can be used to develop a standardized curriculum for documenting patient encounters and highlight common areas of weakness among orthopedic interns with regard to the spine history and physical examination and conducting complete and accurate clinical documentation. A major orthopedic specialty hospital and academic medical center. Thirteen PGY-1 orthopedic residents participated in the OSCE with the same standardized patient presenting with symptoms and radiographs consistent with spinal stenosis. Videos of the encounters were independently viewed and objectively evaluated by one investigator in the study. This evaluation focused on the completeness of the history and the performance and completion of the physical examination. The standardized patient evaluated the communication skills of each intern with a separate objective evaluation. Interns completed these same scoring guides to evaluate their own performance in history, physical examination, and communications

E-learning module on chronic low back pain in older adults: evidence of effect on medical student objective structured clinical examination performance.

PubMed

Weiner, Debra K; Morone, Natalia E; Spallek, Heiko; Karp, Jordan F; Schneider, Michael; Washburn, Carol; Dziabiak, Michael P; Hennon, John G; Elnicki, D Michael

2014-06-01

The Institute of Medicine has highlighted the urgent need to close undergraduate and graduate educational gaps in treating pain. Chronic low back pain (CLBP) is one of the most common pain conditions, and older adults are particularly vulnerable to potential morbidities associated with misinformed treatment. An e-learning case-based interactive module was developed at the University of Pittsburgh Center of Excellence in Pain Education, one of 12 National Institutes of Health-designated centers, to teach students important principles for evaluating and managing CLBP in older adults. A team of six experts in education, information technology, pain management, and geriatrics developed the module. Teaching focused on common errors, interactivity, and expert modeling and feedback. The module mimicked a patient encounter using a standardized patient (the older adult with CLBP) and a pain expert (the patient provider). Twenty-eight medical students were not exposed to the module (Group 1) and 27 were exposed (Group 2). Their clinical skills in evaluating CLBP were assessed using an objective structured clinical examination (OSCE). Mean scores were 62.0 ± 8.6 for Group 1 and 79.5 ± 10.4 for Group 2 (P < .001). Using an OSCE pass-fail cutoff score of 60%, 17 of 28 Group 1 students (60.7%) and 26 of 27 Group 2 students (96.3%) passed. The CLBP OSCE was one of 10 OSCE stations in which students were tested at the end of a Combined Ambulatory Medicine and Pediatrics Clerkship. There were no between-group differences in performance on eight of the other nine OSCE stations. This module significantly improved medical student clinical skills in evaluating CLBP. Additional research is needed to ascertain the effect of e-learning modules on more-advanced learners and on improving the care of older adults with CLBP. © 2014, Copyright the Authors Journal compilation © 2014, The American Geriatrics Society.

E-Learning Module on Chronic Low Back Pain in Older Adults: Evidence of Effect on Medical Student Objective Structured Clinical Examination Performance

PubMed Central

Weiner, Debra K.; Morone, Natalia E.; Spallek, Heiko; Karp, Jordan F.; Schneider, Michael; Washburn, Carol; Dziabiak, Michael P.; Hennon, John G.; Elnicki, D. Michael

2015-01-01

The Institute of Medicine has highlighted the urgent need to close undergraduate and graduate educational gaps in treating pain. Chronic low back pain (CLBP) is one of the most common pain conditions, and older adults are particularly vulnerable to potential morbidities associated with misinformed treatment. An e-learning case-based interactive module was developed at the University of Pittsburgh Center of Excellence in Pain Education, one of 12 National Institutes of Health–designated centers, to teach students important principles for evaluating and managing CLBP in older adults. A team of six experts in education, information technology, pain management, and geriatrics developed the module. Teaching focused on common errors, interactivity, and expert modeling and feedback. The module mimicked a patient encounter using a standardized patient (the older adult with CLBP) and a pain expert (the patient provider). Twenty-eight medical students were not exposed to the module (Group 1) and 27 were exposed (Group 2). Their clinical skills in evaluating CLBP were assessed using an objective structured clinical examination (OSCE). Mean scores were 62.0 ± 8.6 for Group 1 and 79.5 ± 10.4 for Group 2 (P < .001). Using an OSCE pass–fail cutoff score of 60%, 17 of 28 Group 1 students (60.7%) and 26 of 27 Group 2 students (96.3%) passed. The CLBP OSCE was one of 10 OSCE stations in which students were tested at the end of a Combined Ambulatory Medicine and Pediatrics Clerkship. There were no between-group differences in performance on eight of the other nine OSCE stations. This module significantly improved medical student clinical skills in evaluating CLBP. Additional research is needed to ascertain the effect of e-learning modules on more-advanced learners and on improving the care of older adults with CLBP. PMID:24833496

Evaluation of the OSC-TV iterative reconstruction algorithm for cone-beam optical CT.

PubMed

Matenine, Dmitri; Mascolo-Fortin, Julia; Goussard, Yves; Després, Philippe

2015-11-01

The present work evaluates an iterative reconstruction approach, namely, the ordered subsets convex (OSC) algorithm with regularization via total variation (TV) minimization in the field of cone-beam optical computed tomography (optical CT). One of the uses of optical CT is gel-based 3D dosimetry for radiation therapy, where it is employed to map dose distributions in radiosensitive gels. Model-based iterative reconstruction may improve optical CT image quality and contribute to a wider use of optical CT in clinical gel dosimetry. This algorithm was evaluated using experimental data acquired by a cone-beam optical CT system, as well as complementary numerical simulations. A fast GPU implementation of OSC-TV was used to achieve reconstruction times comparable to those of conventional filtered backprojection. Images obtained via OSC-TV were compared with the corresponding filtered backprojections. Spatial resolution and uniformity phantoms were scanned and respective reconstructions were subject to evaluation of the modulation transfer function, image uniformity, and accuracy. The artifacts due to refraction and total signal loss from opaque objects were also studied. The cone-beam optical CT data reconstructions showed that OSC-TV outperforms filtered backprojection in terms of image quality, thanks to a model-based simulation of the photon attenuation process. It was shown to significantly improve the image spatial resolution and reduce image noise. The accuracy of the estimation of linear attenuation coefficients remained similar to that obtained via filtered backprojection. Certain image artifacts due to opaque objects were reduced. Nevertheless, the common artifact due to the gel container walls could not be eliminated. The use of iterative reconstruction improves cone-beam optical CT image quality in many ways. The comparisons between OSC-TV and filtered backprojection presented in this paper demonstrate that OSC-TV can potentially improve the rendering of

Standardised clients as assessors in a veterinary communication OSCE: a reliability and validity study.

PubMed

Artemiou, E; Adams, C L; Hecker, K G; Vallevand, A; Violato, C; Coe, J B

2014-11-22

In human medicine, standardised patients (SP) have been shown to reliably and accurately assess learners' communication performance in high-stakes certification Objective Structured Clinical Examinations (OSCE), offering a feasible way to reduce the need for recruitment, time commitment and coordination of faculty assessors. In this study, we evaluated the use of standardised clients (SC) as a viable option for assessing veterinary students' communication performance. We designed a four-station, two-track communication skills OSCE. SC assessors used an adapted nine-item Liverpool Undergraduate Communication Assessment Scale (LUCAS). Faculty used a 21-item checklist derived from the Calgary-Cambridge Guide (CCG) and a five-point global rating scale. Participants were second year veterinary students (n=96). For the four stations, intrastation reliability (α) ranged from 0.63 to 0.82 for the LUCAS, and 0.73 to 0.87 for the CCG. The interstation reliability coefficients were 0.85 for the LUCAS and 0.89 for the CGG. The calculated Generalisability (G) coefficients were 0.62 for the LUCAS and 0.60 for the CGG. Supporting construct validity, SC and faculty assessors showed a significant correlation between the LUCAS and CCG total percent scores (r=0.45, P<0.001), and likewise between the LUCAS and global rating scores (r=0.49, P<0.001).Study results support that SC assessors offer a reliable and valid approach for assessing veterinary communication OSCE. British Veterinary Association.

Interactions of oversulfated chondroitin sulfate (OSCS) from different sources with unfractionated heparin.

PubMed

Gray, Angel; Litinas, Evangelos; Jeske, Walter; Fareed, Jawed; Hoppensteadt, Debra

2012-01-01

In 2008, oversulfated chondroitin sulfate (OSCS) was identified as the main contaminant in recalled heparin. Oversulfated chondroitin sulfate can be prepared from bovine (B), porcine (P), shark (Sh), or skate (S) origin and may produce changes in the antithrombotic, bleeding, and hemodynamic profile of heparins. This study examines the interactions of various OSCSs on heparin in animal models of thrombosis and bleeding, as well as on the anticoagulant and antiprotease effects in in vitro assays. Mixtures of 70% unfractionated heparin (UFH) with 30% OSCS from different sources were tested. In the in vitro activated partial thromboplastin time (aPTT) assay, all contaminant mixtures showed a decrease in clotting times. In addition, a significant increase in bleeding time compared to the control (UFH/saline) was observed. In the thrombosis model, no significant differences were observed. The OSCSs significantly increased anti-Xa activity in ex vivo blood samples. These results indicate that various sources of OSCS affect the hemostatic properties of heparin.

Development and implementation of an objective structured clinical examination to provide formative feedback on communication and interpersonal skills in geriatric training.

PubMed

O'Sullivan, Patricia; Chao, Serena; Russell, Matthew; Levine, Sharon; Fabiny, Anne

2008-09-01

Teaching and assessment of communication and interpersonal skills, one of the American Council for Graduate Medical Education-designated core competencies, is an important but difficult task in the training of physicians. Assessment of trainees offers an opportunity to provide explicit feedback on their skills and encourages learning. This article describes a pilot study in which clinician-educators affiliated with the geriatrics training programs at Beth Israel Deaconess Medical Center and Boston University Medical Center designed and piloted a novel Objective Structured Clinical Examination (OSCE) to assess the communication and interpersonal skills of medical, dental, and geriatric psychiatry fellows. The OSCE consisted of three stations where geriatricians and standardized patients evaluated candidates using specifically designed checklists and an abbreviated version of the Master Interview Rating Scale. Communication skills were assessed through performance of specific "real life" clinical tasks, such as obtaining a medical history, explaining a diagnosis and prognosis, giving therapeutic instructions, and counseling. Interpersonal skills were assessed through the effect of the communication between doctor and standardized patient on fostering trust, relieving anxiety, and establishing a therapeutic relationship. This pilot study demonstrated that the OSCE format of assessment provides a valid means of evaluating the communication and interpersonal skills of interdisciplinary geriatric trainees and provides a valuable forum for formative assessment and feedback. Given that geriatricians and non geriatricians involved in elder care both need communication and interpersonal skills, this novel OSCE can be used for assessment of these skills in trainees in diverse healthcare subspecialties.

The Electronic Health Record Objective Structured Clinical Examination: Assessing Student Competency in Patient Interactions While Using the Electronic Health Record.

PubMed

Biagioli, Frances E; Elliot, Diane L; Palmer, Ryan T; Graichen, Carla C; Rdesinski, Rebecca E; Ashok Kumar, Kaparaboyna; Galper, Ari B; Tysinger, James W

2017-01-01

Because many medical students do not have access to electronic health records (EHRs) in the clinical environment, simulated EHR training is necessary. Explicitly training medical students to use EHRs appropriately during patient encounters equips them to engage patients while also attending to the accuracy of the record and contributing to a culture of information safety. Faculty developed and successfully implemented an EHR objective structured clinical examination (EHR-OSCE) for clerkship students at two institutions. The EHR-OSCE objectives include assessing EHR-related communication and data management skills. The authors collected performance data for students (n = 71) at the first institution during academic years 2011-2013 and for students (n = 211) at the second institution during academic year 2013-2014. EHR-OSCE assessment checklist scores showed that students performed well in EHR-related communication tasks, such as maintaining eye contact and stopping all computer work when the patient expresses worry. Findings indicated student EHR skill deficiencies in the areas of EHR data management including medical history review, medication reconciliation, and allergy reconciliation. Most students' EHR skills failed to improve as the year progressed, suggesting that they did not gain the EHR training and experience they need in clinics and hospitals. Cross-institutional data comparisons will help determine whether differences in curricula affect students' EHR skills. National and institutional policies and faculty development are needed to ensure that students receive adequate EHR education, including hands-on experience in the clinic as well as simulated EHR practice.

Using a teaching OSCE to prompt learners to engage with patients who talk about religion and/or spirituality.

PubMed

Ledford, Christy J W; Seehusen, Dean A; Canzona, Mollie Rose; Cafferty, Lauren A

2014-01-01

The objective structured clinical examination (OSCE) has only occasionally been used as a teaching tool. The authors describe the initial use of an educational innovation consisting of a teaching OSCE used as "sensitizing practice," followed by personal, guided, and group reflection. Staff and resident physicians and one medical student (N = 28) at a community hospital's family medicine residency participated in the innovation during August 2012. The initial use of the educational innovation allowed learners to engage in a potentially challenging conversation with a standardized patient about religion and/or spirituality (R/S). The aim of the innovation was not to equip learners with a particular tactic to introduce or discuss R/S but, rather, to prompt learners to engage in mindful practice with patients who identify R/S as part of their biopsychosocial contexts. Written, dyadic, and group reflection added value to the OSCE by allowing participants to reflect on a difficult learning objective over time. Participants moved along the stages-of-change continuum when engaging in guided reflection compared with personal reflection. Additionally, all participants provided evidence of at least the preparation stage at the time of guided reflection. By following the OSCE's sensitizing practice with three periods of reflection, learners were enabled first, to recognize the need for readiness to address challenging communication topics (in this case, R/S) and, second, to reflect on practiced strategies for those conversations. The educational innovation can help learners become more aware of and skillful in dealing with difficult physician-patient communication topics.

Evaluation of the OSC-TV iterative reconstruction algorithm for cone-beam optical CT

DOE Office of Scientific and Technical Information (OSTI.GOV)

Matenine, Dmitri, E-mail: dmitri.matenine.1@ulaval.ca; Mascolo-Fortin, Julia, E-mail: julia.mascolo-fortin.1@ulaval.ca; Goussard, Yves, E-mail: yves.goussard@polymtl.ca

Purpose: The present work evaluates an iterative reconstruction approach, namely, the ordered subsets convex (OSC) algorithm with regularization via total variation (TV) minimization in the field of cone-beam optical computed tomography (optical CT). One of the uses of optical CT is gel-based 3D dosimetry for radiation therapy, where it is employed to map dose distributions in radiosensitive gels. Model-based iterative reconstruction may improve optical CT image quality and contribute to a wider use of optical CT in clinical gel dosimetry. Methods: This algorithm was evaluated using experimental data acquired by a cone-beam optical CT system, as well as complementary numericalmore » simulations. A fast GPU implementation of OSC-TV was used to achieve reconstruction times comparable to those of conventional filtered backprojection. Images obtained via OSC-TV were compared with the corresponding filtered backprojections. Spatial resolution and uniformity phantoms were scanned and respective reconstructions were subject to evaluation of the modulation transfer function, image uniformity, and accuracy. The artifacts due to refraction and total signal loss from opaque objects were also studied. Results: The cone-beam optical CT data reconstructions showed that OSC-TV outperforms filtered backprojection in terms of image quality, thanks to a model-based simulation of the photon attenuation process. It was shown to significantly improve the image spatial resolution and reduce image noise. The accuracy of the estimation of linear attenuation coefficients remained similar to that obtained via filtered backprojection. Certain image artifacts due to opaque objects were reduced. Nevertheless, the common artifact due to the gel container walls could not be eliminated. Conclusions: The use of iterative reconstruction improves cone-beam optical CT image quality in many ways. The comparisons between OSC-TV and filtered backprojection presented in this paper demonstrate that OSC

Assessment of first-year veterinary students' communication skills using an objective structured clinical examination: the importance of context.

PubMed

Hecker, Kent G; Adams, Cindy L; Coe, Jason B

2012-01-01

Communication skills are considered to be a core clinical skill in veterinary medicine and essential for practice success, including outcomes of care for patients and clients. While veterinary schools include communication skills training in their programs, there is minimal knowledge on how best to assess communication competence throughout the undergraduate program. The purpose of this study was to further our understanding of the reliability, utility, and suitability of a communication skills Objective Structured Clinical Examination (OSCE). Specifically we wanted to (1) identify the greatest source of variability (student, rater, station, and track) within a first-year, four station OSCE using exam scores and scores from videotape review by two trained raters, and (2) determine the effect of different stations on students' communication skills performance. Reliability of the scores from both the exam data and the two expert raters was 0.50 and 0.46 respectively, with the greatest amount of variance attributable to student by station. The percentage of variance due to raters in the exam data was 16.35%, whereas the percentage of variance for the two expert raters was 0%. These results have three important implications. First, the results reinforce the need for communication educators to emphasize that use of communication skills is moderated by the context of the clinical interaction. Second, by increasing rater training the amount of error in the scores due to raters can be reduced and inter-rater reliability increases. Third, the communication assessment method (in this case the OSCE checklist) should be built purposefully, taking into consideration the context of the case.

Generalized Optimal-State-Constraint Extended Kalman Filter (OSC-EKF)

DTIC Science & Technology

2017-02-01

ARL-TR-7948• FEB 2017 US Army Research Laboratory GeneralizedOptimal-State-Constraint ExtendedKalman Filter (OSC-EKF) by James M Maley, Kevin...originator. ARL-TR-7948• FEB 2017 US Army Research Laboratory GeneralizedOptimal-State-Constraint ExtendedKalman Filter (OSC-EKF) by James M Maley Weapons and...

The validity and reliability of the sixth-year internal medical examination administered at the King Abdulaziz University Medical College.

PubMed

Fallatah, Hind I; Tekian, Ara; Park, Yoon Soo; Al Shawa, Lana

2015-02-01

Exams are essential components of medical students' knowledge and skill assessment during their clinical years of study. The paper provides a retrospective analysis of validity evidence for the internal medicine component of the written and clinical exams administered in 2012 and 2013 at King Abdulaziz University's Faculty of Medicine. Students' scores for the clinical and written exams were obtained. Four faculty members (two senior members and two junior members) were asked to rate the exam questions, including MCQs and OSCEs, for evidence of content validity using a rating scale of 1-5 for each item. Cronbach's alpha was used to measure the internal consistency reliability. Correlations were used to examine the associations between different forms of assessment and groups of students. A total of 824 students completed the internal medicine course and took the exam. The numbers of rated questions were 320 and 46 for the MCQ and OSCE, respectively. Significant correlations were found between the MCQ section, the OSCE section, and the continuous assessment marks, which include 20 long-case presentations during the course; participation in daily rounds, clinical sessions and tutorials; the performance of simple procedures, such as IV cannulation and ABG extraction; and the student log book. Although the OSCE exam was reliable for the two groups that had taken the final clinical OSCE, the clinical long- and short-case exams were not reliable across the two groups that had taken the oral clinical exams. The correlation analysis showed a significant linear association between the raters with respect to evidence of content validity for both the MCQ and OSCE, r = .219 P < .001 and r = .678 P < .001, respectively, and r = .241 P < .001 and r = .368 P = .023 for the internal structure validity, respectively. Reliability measured using Cronbach's alpha was greater for assessments administered in 2013. The pattern of relationships between the

Design and performance of radioisotope space power systems based on OSC multitube AMTEC converter designs

DOE Office of Scientific and Technical Information (OSTI.GOV)

Schock, A.; Noravian, H.; Or, C.

1997-12-31

This paper extends the analytical procedure described in another paper in these proceedings to analyze a variety of compact and light-weight OSC-designed radioisotope-heated generators. Those generators employed General Purpose Heat Source (GPHS) modules and a converter containing sixteen AMTEC cells of OSC`s revised five-tube design with enhanced cell wall reflectivity described in a companion paper in these proceedings. OSC found that the performance of the generator is primarily a function of the thermal insulation between the outside of the generator`s 16 cells and the inside of its wall. After examining a variety of insulation options, it was found that themore » generator`s performance is optimized by employing a hybrid insulation system, in which the space between the cells is filled with fibrous Min-K insulation, and the generator walls are lined with tapered (i.e., graded-length) multifoil insulation. The OSC design results in a very compact generator, with eight AMTEC cells on each end of the heat source stack. The choice of the five-tube cells makes it possible to expand the BASE tube diameter without increasing the cell diameter. This is important because the eight cells mate well with the stacked GPHS modules. The OSC generator design includes a compliant heat source support and preload arrangement, to hold the heat source modules together during launch, and to maintain thermal contact conductance at the generator`s interfaces despite creep relaxation of its housing. The BOM and EOM (up to 15 years) performances of the revised generators were analyzed for two and three GPHS modules, both for fresh fuel and for aged fuel left over from a spare RTG (Radioisotope Thermoelectric Generator) fueled in 1982. The resulting power outputs were compared with JPL`s latest EOM power demand goals for the Pluto Express and Europa Orbiter missions, and with the generic goals of DOE`s Advanced Radioisotope Power System (ARPS) study. The OSC AMTEC designs yielded

Self-regulated learning strategies used in surgical clerkship and the relationship with clinical achievement.

PubMed

Turan, Sevgi; Konan, Ali

2012-01-01

Self-regulated learning indicates students' skills in controlling their own learning. Self-regulated learning, which a context-specific process, emphasizes autonomy and control. Students gain more autonomy with respect to learning in the clinical years. Examining the self-regulated learning skills of students in this period will provide important clues about the level at which students are ready to use these skills in real-life conditions. The self-regulated learning strategies used by medical students in surgical clerkship were investigated in this study and their relation with clinical achievement was analyzed. The study was conducted during the surgery clerkship of medical students. The participation rate was 94% (309 students). Motivated Strategies for Learning Questionnaire (MSLQ), a case-based examination, Objective Structured Clinical Examination (OSCE), and tutor evaluations for assessing achievement were used. The relationship between the Motivated Strategies for Learning Questionnaire scores of the students and clinical achievement was analyzed with multilinear regression analysis. The findings showed that students use self-regulated learning skills at medium levels during their surgery clerkship. A relationship between these skills and OSCE scores and tutor evaluations was determined. OSCE scores of the students were observed to increase in conjunction with increased self-efficacy levels. However, as students' beliefs regarding control over learning increased, OSCE scores decreased. No significant relationship was defined between self-regulated learning skills and case-based examination scores. We observed that a greater self-efficacy for learning resulted in higher OSCE scores. Conversely, students who believe that learning is a result of their own effort had lower OSCE scores. Copyright © 2012 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Non-Patient-Based Clinical Licensure Examination for Dentistry in Minnesota: Significance of Decision and Description of Process.

PubMed

Mills, Eric A

2016-06-01

In recent years in the United States, there has been heightened interest in offering clinical licensure examination (CLE) alternatives to the live patient-based method in dentistry. Fueled by ethical concerns of faculty members at the University of Minnesota School of Dentistry, the state of Minnesota's Board of Dentistry approved a motion in 2009 to provide two CLE options to the school's future predoctoral graduates: a patient-based one, administered by the Central Regional Dental Testing Service, and a non-patient-based one administered by the National Dental Examining Board of Canada (NDEB). The validity of the NDEB written exam and objective structured clinical exam (OSCE) has been verified in a multi-year study. Via five-option, one-best-answer, multiple-choice questions in the written exam and extended match questions with up to 15 answer options in the station-based OSCE, competent candidates are distinguished from those who are incompetent in their didactic knowledge and clinical critical thinking and judgment across all dental disciplines. The action had the additional effects of furthering participation of Minnesota Board of Dentistry members in the University of Minnesota School of Dentistry's competency-based curriculum, of involving the school's faculty in NDEB item development workshops, and, beginning in 2018, of no longer permitting the patient-based CLE option on site. The aim of this article is to describe how this change came about and its effects.

Teaching Cardiac Examination Skills

PubMed Central

Smith, Christopher A; Hart, Avery S; Sadowski, Laura S; Riddle, Janet; Evans, Arthur T; Clarke, Peter M; Ganschow, Pamela S; Mason, Ellen; Sequeira, Winston; Wang, Yue

2006-01-01

OBJECTIVE To determine if structured teaching of bedside cardiac examination skills improves medical residents' examination technique and their identification of key clinical findings. DESIGN Firm-based single-blinded controlled trial. SETTING Inpatient service at a university-affiliated public teaching hospital. PARTICIPANTS Eighty Internal Medicine residents. METHODS The study assessed 2 intervention groups that received 3-hour bedside teaching sessions during their 4-week rotation using either: (1) a traditional teaching method, “demonstration and practice” (DP) (n=26) or (2) an innovative method, “collaborative discovery” (CD) (n=24). The control group received their usual ward teaching sessions (n=25). The main outcome measures were scores on examination technique and correct identification of key clinical findings on an objective structured clinical examination (OSCE). RESULTS All 3 groups had similar scores for both their examination technique and identification of key findings in the preintervention OSCE. After teaching, both intervention groups significantly improved their technical examination skills compared with the control group. The increase was 10% (95% confidence interval [CI] 4% to 17%) for CD versus control and 12% (95% CI 6% to 19%) for DP versus control (both P<.005) equivalent to an additional 3 to 4 examination skills being correctly performed. Improvement in key findings was limited to a 5% (95% CI 2% to 9%) increase for the CD teaching method, CD versus control P=.046, equivalent to the identification of an additional 2 key clinical findings. CONCLUSIONS Both programs of bedside teaching increase the technical examination skills of residents but improvements in the identification of key clinical findings were modest and only demonstrated with a new method of teaching. PMID:16423116

The impact of outpatient clinical teaching on students' academic performance in obstetrics and gynecology.

PubMed

Hassan, Bahaeldin A; Elfaki, Omer A; Khan, Muhammed A

2017-01-01

Clinical teaching at outpatient settings is an essential part of undergraduate medical students' training. The increasing number of students in many medical schools and short hospital stays makes inpatient teaching alone insufficient to provide students with the required clinical skills. To make up this shortfall, outpatient clinical teaching has been implemented by our Department of Obstetrics and Gynecology, King Khalid University, KSA, throughout the academic year 2015-2016. The aim of this study was to evaluate the impact of clinical teaching at outpatient settings on the academic performance of our students. In this comparative retrospective study, the effects of outpatient clinical teaching of obstetrics and gynecology on the academic performance of student was assessed through an objective structured clinical examination (OSCE). During their course on obstetrics and gynecology, 58 students had their clinical teaching both at inpatient and outpatient settings and constituted "study group". The remaining 52 students had clinical teaching only at inpatient settings and were considered "control group". Students in both groups sat for OSCE at the end of week 8 of the gynecology course. Students in both groups sat for OSCE at the end of week 8 of the gynecology course. Four stations were used for assessment: obstetric history, gynecological history, obstetric physical examination of pregnant women, and gynecological procedure station. Twenty marks were allocated for each station giving a total score of 80. The OSCE scores for study group were compared with those of the control group using Student's t -test; p < 0.05 was considered statistically significant. The total mean OSCE score was statistically significantly higher in the study group (62.36 vs. 47.94, p < 0.001). The study group participants showed significantly higher scores in the gynecological procedure station (16.74 vs. 11.62, p < 0.0001) and obstetric examination station (16.72 vs. 10.79, p < 0

Detection Learning Style Vark For Out Of School Children (OSC)

NASA Astrophysics Data System (ADS)

Amran, Ali; Desiani, Anita; Hasibuan, MS

2017-04-01

Learning style is different for every learner especially for out of school children or OSC. They are not like formal students, they are learners but they don’t have a teacher as a guide for learning. E-learning is one of the solutions to help OSC to get education. E-learning should have preferred learning styles of learners. Data for identifying the learning style in this study were collected with a VARK questionnaire from 25 OSC in junior high school level from 5 municipalities in Palembang. The validity of the questionnaire was considered on basis of experts’ views and its reliability was calculated by using Cronbach’s alpha coefficients (α=0.68). Overall, 55% preferred to use a single learning style (Uni-modal). Of these, 27,76% preferred Aural, 20,57% preferred Reading Writing, 33,33% preferred Kinaesthetic and 23,13% preferred Visual. 45% of OSC preferred more than one style, 30% chose two-modes (bimodal), and 15% chose three-modes (tri-modal). The Most preferred Learning style of OSC is kinaesthetic learning. Kinaesthetic learning requires body movements, interactivities, and direct contacts with learning materials, these things can be difficult to implement in eLearning, but E-learning should be able to adopt any learning styles which are flexible in terms of time, period, curriculum, pedagogy, location, and language.

The Implementation and Development of an Objective Structured Clinical Examination in the Community Pharmacy Course of a Select Gulf-Region Academic Institution (Ras Al Khaimah College of Pharmaceutical Sciences): A Pilot Study

ERIC Educational Resources Information Center

Al-Azzawi, Amad Mohammed Jamil; Nagavi, B.G.; Hachim, Mahmood Y.; Mossa, Omar H.

2016-01-01

Background: Objective Structured Clinical Examinations (OSCEs) were used to assess translational pharmacotherapeutic skills of a Gulf-region representative academic institution. Aim: The aim of the current study was to assess the clinical skills of students enrolled within the third year Bachelor of Pharmacy (BPharm) programme within Ras Al…

Team OSCE: A Teaching Modality for Promotion of Multidisciplinary Work in Mental Health Settings.

PubMed

Sharma, Manoj Kumar; Chandra, Prabha S; Chaturvedi, Santosh K

2015-01-01

The objective structured clinical examination has been in use both as an assessment and a teaching modality within the mental health profession. It focuses on individual skill enhancement, the inter-professional understanding of role obligation is helpful in promoting competence as a team as well as role of other team members. The Team OSCE (TOSCE) is an effective way in promoting inter-professional learning. The present work assesses the trainee experience with TOSCE and its utility in clinical care. Twenty-two mental health trainees (17 male and 5 female from psychiatry, clinical psychology and psychiatric social work) got exposure to weekly OSCAF training as well as 2-3 Team OSCAFS on various aspects of clinical work as a part of their clinical training for 3 months. Rating from the trainees were taken on TOSCE feedback checklist. TOSCE was helpful in promoting the understanding role of other team members; shared decision-making, problem-solving, handling unexpected events, giving feedback and closure. The TOSCE may be introduced as a way to work on clinical performance, shared decision-making and inter-professional understanding.

The Relationship between Senior Year Examinations at a Medical School and the Korean Medical Licensing Examination.

PubMed

Jung, Ki Hoon; Jung, Ho Keun; Lee, Kwan

2009-03-01

Most medical schools prepare for the Korean medical licensing examination (KMLE) with various tests. By assessing the degree to which these exams and the KMLE are related, students, professors, and institutions can be well prepared and some schools use these exams as predictive tools for KMLE scores. Therefore, we determined the relevance of KMLE results to midterm exams and the objective structured clinical examination (OSCE), administered to senior students at a medical school. From 2002 to 2004, KMLE results were compared with midterm examinations, the KMLE, and the OSCE. The total score, or T-score, of the KMLE was used, as was a pass or nonpass score. Windows SPSS 14.0 and MedCalc 9.0 were used for statistical analysis. The yearly correlation coefficient of the KMLE and school exams was highest for the midterm exams in 2002 and the KMLE in 2003 and 2004. The correlation coefficient of midterm exams and the KMLE were related to a high degree, yet the values were as low as that of the OSCE. Compared with the KMLE results, the sensitivity and specificity of the average midterm exam were 100.0% and 93.8%, and the sensitivity and specificity of the average trial exams were 100.0% and 95.8%, respectively. In conclusion, the KMLE results have a strong relationship with midterm exams, trial exams, and the combination of midterm and trial exams, but not with the OSCE. Thus, we believe that using both midterm exams and trial exams to predict KMLE results is superior to the use of only one type of school exam.

Validity evidence for an OSCE to assess competency in systems-based practice and practice-based learning and improvement: a preliminary investigation.

PubMed

Varkey, Prathibha; Natt, Neena; Lesnick, Timothy; Downing, Steven; Yudkowsky, Rachel

2008-08-01

To determine the psychometric properties and validity of an OSCE to assess the competencies of Practice-Based Learning and Improvement (PBLI) and Systems-Based Practice (SBP) in graduate medical education. An eight-station OSCE was piloted at the end of a three-week Quality Improvement elective for nine preventive medicine and endocrinology fellows at Mayo Clinic. The stations assessed performance in quality measurement, root cause analysis, evidence-based medicine, insurance systems, team collaboration, prescription errors, Nolan's model, and negotiation. Fellows' performance in each of the stations was assessed by three faculty experts using checklists and a five-point global competency scale. A modified Angoff procedure was used to set standards. Evidence for the OSCE's validity, feasibility, and acceptability was gathered. Evidence for content and response process validity was judged as excellent by institutional content experts. Interrater reliability of scores ranged from 0.85 to 1 for most stations. Interstation correlation coefficients ranged from -0.62 to 0.99, reflecting case specificity. Implementation cost was approximately $255 per fellow. All faculty members agreed that the OSCE was realistic and capable of providing accurate assessments. The OSCE provides an opportunity to systematically sample the different subdomains of Quality Improvement. Furthermore, the OSCE provides an opportunity for the demonstration of skills rather than the testing of knowledge alone, thus making it a potentially powerful assessment tool for SBP and PBLI. The study OSCE was well suited to assess SBP and PBLI. The evidence gathered through this study lays the foundation for future validation work.

A Descriptive Survey of Anesthesiology Residency Simulation Programs: How Are Programs Preparing Residents for the New American Board of Anesthesiology APPLIED Certification Examination?

PubMed

Isaak, Robert S; Chen, Fei; Arora, Harendra; Martinelli, Susan M; Zvara, David A; Stiegler, Marjorie P

2017-09-01

Anesthesiology residency programs may need new simulation-based programs to prepare residents for the new Objective Structured Clinical Examination (OSCE) component of the American Board of Anesthesiology (ABA) Primary Certification process. The design of such programs may require significant resources, including faculty time, expertise, and funding, as are currently needed for structured oral examination (SOE) preparation. This survey analyzed the current state of US-based anesthesiology residency programs regarding simulation-based educational programming for SOE and OSCE preparation. An online survey was distributed to every anesthesiology residency program director in the United States. The survey included 15 to 46 questions, depending on each respondent's answers. The survey queried current practices and future plans regarding resident preparation specifically for the ABA APPLIED examination, with emphasis on the OSCE. Descriptive statistics were summarized. χ and Fisher exact tests were used to test the differences in proportions across groups. Spearman rank correlation was used to examine the association between ordinal variables. The responding 66 programs (49%) were a representative sample of all anesthesiology residencies (N = 136) in terms of geographical location (χ P = .58). There was a low response rate from small programs that have 12 or fewer clinical anesthesia residents. Ninety-one percent (95% confidence interval [CI], 84%-95%) of responders agreed that it is the responsibility of the program to specifically prepare residents for primary certification, and most agreed that it is important to practice SOEs (94%; 95% CI, 88%-97%) and OSCEs (89%; 95% CI, 83%-94%). While 100% of respondents reported providing mock SOEs, only 31% (95% CI, 24%-40%) of respondents provided mock OSCE experiences. Of those without an OSCE program, 75% (95% CI, 64%-83%) reported plans to start one. The most common reasons for not having an OSCE program already in place

Can near-peer medical students effectively teach a new curriculum in physical examination?

PubMed Central

2013-01-01

Background Students in German medical schools frequently complain that the subject ‘clinical examination’ is not taught in a satisfying manner due to time constraints and lack of personnel resources. While the effectiveness and efficiency of practice-oriented teaching in small groups using near-peer teaching has been shown, it is rarely used in German medical schools. We investigated whether adding a new near-peer teaching course developed with student input plus patient examination under supervision in small groups improves basic clinical examination skills in third year medical students compared to a traditional clinical examination course alone. Methods Third year medical students registered for the mandatory curricular clinical examination course at the medical faculty of the Technische Universität München were invited to participate in a randomised trial with blinded outcome assessment. Students were randomised to the control group participating in the established curricular physical examination course or to the intervention group, which received additional near-peer teaching for the same content. The learning success was verified by a voluntary objective structured clinical examination (OSCE). Results A total of 84 students were randomised and 53 (63%) participated in the final OSCE. Students in the control group scored a median of 57% (25th percentile 47%, 75th percentile 61%) of the maximum possible total points of the OSCE compared to 77% (73%, 80%; p < 0.001) for students in the intervention group. Only two students in the intervention group received a lower score than the best student in the control group. Conclusion Adding a near-peer teaching course to the routine course significantly improved the clinical examination skills of medical students in an efficient manner in the context of a resource-constrained setting. PMID:24325639

Introducing a Model for Optimal Design of Sequential Objective Structured Clinical Examinations

ERIC Educational Resources Information Center

Mortaz Hejri, Sara; Yazdani, Kamran; Labaf, Ali; Norcini, John J.; Jalili, Mohammad

2016-01-01

In a sequential OSCE which has been suggested to reduce testing costs, candidates take a short screening test and who fail the test, are asked to take the full OSCE. In order to introduce an effective and accurate sequential design, we developed a model for designing and evaluating screening OSCEs. Based on two datasets from a 10-station…

Enhanced Web-Based Otitis Study Case vs Simple Paper-Case: Impact on Medical Student Objective Structured Clinical Exam (OSCE) Performance.

PubMed

Malloy, Michael H

2002-12-01

Distance education methods have taken on greater importance as medical student education has moved off campus into the community. What the best methods are for conveying information to students at distant sites has not been determined. To determine if students at distant community sites who received an otitis media study case by e-mail that was enhanced with a referral to a web-based otitis study case, performed better on otitis OSCE stations than students who received the same case not enhanced with visuals or referrals to a web-based otitis case. Students were randomized by community site to receive either the enhanced (E) or simple otitis study case (S). Students were e-mailed an otitis media study case during the 5th week of the rotation. Those randomized to the E-case received a case that started with a case scenario followed by a "Task" that instructed them to go to this web address: http://www.aap.org/otitismedia/www/vc/ear/index.cfm (American Academy of Pediatrics Otitis Web Site). They were then to select "Case 1" which was a continuation of the case scenario present on their e-mail. A list of learning objectives was also printed on the e-mail. Students receiving the S-case viewed the same case scenario and objectives, but were not instructed to go to the web-page. All students rotated through two OSCE otitis stations. In the first station they interviewed a simulated patient(OSCE-SP) and counseled her on the management of her 12 month old with otitis. Within that station they viewed a video of a pneumoscopic exam of two ears, one ear with otitis and the other ear normal. At the 2 nd otitis station the student presented the case to a faculty and was asked a series of questions about otitis media(OSCE-PR). Scores on the two stations were compared by group. There were 198 students who took the OSCE. 178 (90%) responded to a survey that indicated they had opened and read the e-mailed case. There were 87 students in the E-group and 91 in the S-group. The mean

To what extent does the Health Professions Admission Test-Ireland predict performance in early undergraduate tests of communication and clinical skills? An observational cohort study.

PubMed

Kelly, Maureen E; Regan, Daniel; Dunne, Fidelma; Henn, Patrick; Newell, John; O'Flynn, Siun

2013-05-10

Internationally, tests of general mental ability are used in the selection of medical students. Examples include the Medical College Admission Test, Undergraduate Medicine and Health Sciences Admission Test and the UK Clinical Aptitude Test. The most widely used measure of their efficacy is predictive validity.A new tool, the Health Professions Admission Test- Ireland (HPAT-Ireland), was introduced in 2009. Traditionally, selection to Irish undergraduate medical schools relied on academic achievement. Since 2009, Irish and EU applicants are selected on a combination of their secondary school academic record (measured predominately by the Leaving Certificate Examination) and HPAT-Ireland score. This is the first study to report on the predictive validity of the HPAT-Ireland for early undergraduate assessments of communication and clinical skills. Students enrolled at two Irish medical schools in 2009 were followed up for two years. Data collected were gender, HPAT-Ireland total and subsection scores; Leaving Certificate Examination plus HPAT-Ireland combined score, Year 1 Objective Structured Clinical Examination (OSCE) scores (Total score, communication and clinical subtest scores), Year 1 Multiple Choice Questions and Year 2 OSCE and subset scores. We report descriptive statistics, Pearson correlation coefficients and Multiple linear regression models. Data were available for 312 students. In Year 1 none of the selection criteria were significantly related to student OSCE performance. The Leaving Certificate Examination and Leaving Certificate plus HPAT-Ireland combined scores correlated with MCQ marks.In Year 2 a series of significant correlations emerged between the HPAT-Ireland and subsections thereof with OSCE Communication Z-scores; OSCE Clinical Z-scores; and Total OSCE Z-scores. However on multiple regression only the relationship between Total OSCE Score and the Total HPAT-Ireland score remained significant; albeit the predictive power was modest. We found

To what extent does the Health Professions Admission Test-Ireland predict performance in early undergraduate tests of communication and clinical skills? – An observational cohort study

PubMed Central

2013-01-01

Background Internationally, tests of general mental ability are used in the selection of medical students. Examples include the Medical College Admission Test, Undergraduate Medicine and Health Sciences Admission Test and the UK Clinical Aptitude Test. The most widely used measure of their efficacy is predictive validity. A new tool, the Health Professions Admission Test- Ireland (HPAT-Ireland), was introduced in 2009. Traditionally, selection to Irish undergraduate medical schools relied on academic achievement. Since 2009, Irish and EU applicants are selected on a combination of their secondary school academic record (measured predominately by the Leaving Certificate Examination) and HPAT-Ireland score. This is the first study to report on the predictive validity of the HPAT-Ireland for early undergraduate assessments of communication and clinical skills. Method Students enrolled at two Irish medical schools in 2009 were followed up for two years. Data collected were gender, HPAT-Ireland total and subsection scores; Leaving Certificate Examination plus HPAT-Ireland combined score, Year 1 Objective Structured Clinical Examination (OSCE) scores (Total score, communication and clinical subtest scores), Year 1 Multiple Choice Questions and Year 2 OSCE and subset scores. We report descriptive statistics, Pearson correlation coefficients and Multiple linear regression models. Results Data were available for 312 students. In Year 1 none of the selection criteria were significantly related to student OSCE performance. The Leaving Certificate Examination and Leaving Certificate plus HPAT-Ireland combined scores correlated with MCQ marks. In Year 2 a series of significant correlations emerged between the HPAT-Ireland and subsections thereof with OSCE Communication Z-scores; OSCE Clinical Z-scores; and Total OSCE Z-scores. However on multiple regression only the relationship between Total OSCE Score and the Total HPAT-Ireland score remained significant; albeit the

Curriculum gaps in teaching clinical skills to Iranian undergraduate medical students.

PubMed

Mirzazadeh, Azim; Bavarian, Behrouz; Labaf, Ali; Afshari, Ali; Nikoo, Mohammad; Meshkani, Zahra Sadat; Khashayar, Patricia

2013-04-20

The inefficacy of clinical skill education during the clerkship has been reported in several studies. The present study was conducted to evaluate the competency of medical students in performing several clinical skills through an Objective Structured Clinical Examination (OSCE), aiming to evaluate the quality of the existing curriculum in the clerkship phase. The cross sectional study was conducted at the end of the clerkship period, before the students had entered the internship. The OSCE exam was conducted in the morning (2 different tracts) and in the evening (2 similar tracts) and 86 students participated in the exam. Each tract consisted of seven stations. The students' points in the stations assessing history taking and clinical skills were compared. The students gained the highest points in the history taking stations, whereas the procedure stations accounted for the lowest points; there was a significant difference between these stations (p < 0.001). The female students achieved higher scores in the OSCE exam compared to males (p = 0.004). The OSCE exam revealed the inefficacy of the current medical curriculum in teaching the required clinical skill to undergraduate medical students during the clerkship.

Clinical simulation training improves the clinical performance of Chinese medical students

PubMed Central

Zhang, Ming-ya; Cheng, Xin; Xu, An-ding; Luo, Liang-ping; Yang, Xuesong

2015-01-01

Background Modern medical education promotes medical students’ clinical operating capacity rather than the mastery of theoretical knowledge. To accomplish this objective, clinical skill training using various simulations was introduced into medical education to cultivate creativity and develop the practical ability of students. However, quantitative analysis of the efficiency of clinical skill training with simulations is lacking. Methods In the present study, we compared the mean scores of medical students (Jinan University) who graduated in 2013 and 2014 on 16 stations between traditional training (control) and simulative training groups. In addition, in a clinical skill competition, the objective structured clinical examination (OSCE) scores of participating medical students trained using traditional and simulative training were compared. The data were statistically analyzed and qualitatively described. Results The results revealed that simulative training could significantly enhance the graduate score of medical students compared with the control. The OSCE scores of participating medical students in the clinical skill competition, trained using simulations, were dramatically higher than those of students trained through traditional methods, and we also observed that the OSCE marks were significantly increased for the same participant after simulative training for the clinical skill competition. Conclusions Taken together, these data indicate that clinical skill training with a variety of simulations could substantially promote the clinical performance of medical students and optimize the resources used for medical education, although a precise analysis of each specialization is needed in the future. PMID:26478142

Hybrid Simulation in Teaching Clinical Breast Examination to Medical Students.

PubMed

Nassif, Joseph; Sleiman, Abdul-Karim; Nassar, Anwar H; Naamani, Sima; Sharara-Chami, Rana

2017-10-10

Clinical breast examination (CBE) is traditionally taught to third-year medical students using a lecture and a tabletop breast model. The opportunity to clinically practice CBE depends on patient availability and willingness to be examined by students, especially in culturally sensitive environments. We propose the use of a hybrid simulation model consisting of a standardized patient (SP) wearing a silicone breast simulator jacket and hypothesize that this, compared to traditional teaching methods, would result in improved learning. Consenting third-year medical students (N = 82) at a university-affiliated tertiary care center were cluster-randomized into two groups: hybrid simulation (breast jacket + SP) and control (tabletop breast model). Students received the standard lecture by instructors blinded to the randomization, followed by randomization group-based learning and practice sessions. Two weeks later, participants were assessed in an Objective Structured Clinical Examination (OSCE), which included three stations with SPs blinded to the intervention. The SPs graded the students on CBE completeness, and students completed a self-assessment of their performance and confidence during the examination. CBE completeness scores did not differ between the two groups (p = 0.889). Hybrid simulation improved lesion identification grades (p < 0.001) without increasing false positives. Hybrid simulation relieved the fear of missing a lesion on CBE (p = 0.043) and increased satisfaction with the teaching method among students (p = 0.002). As a novel educational tool, hybrid simulation improves the sensitivity of CBE performed by medical students without affecting its specificity. Hybrid simulation may play a role in increasing the confidence of medical students during CBE.

Effects of participation in a cross year peer tutoring programme in clinical examination skills on volunteer tutors' skills and attitudes towards teachers and teaching.

PubMed

Buckley, Sharon; Zamora, Javier

2007-06-28

Development of students' teaching skills is increasingly recognised as an important component of UK undergraduate medical curricula and, in consequence, there is renewed interest in the potential benefits of cross-year peer tutoring. Whilst several studies have described the use of cross-year peer tutoring in undergraduate medical courses, its use in the clinical setting is less well reported, particularly the effects of peer tutoring on volunteer tutors' views of teachers and teaching. This study explored the effects of participation in a cross-year peer tutoring programme in clinical examination skills ('OSCE tutor') on volunteer tutors' own skills and on their attitudes towards teachers and teaching. Volunteer tutors were final year MBChB students who took part in the programme as part of a Student Selected Component (SSC). Tutees were year 3 MBChB students preparing for their end of year 'OSCE' examination. Pre and post participation questionnaires, including both Likert-type and open response questions, were used. Paired data was compared using the Wilcoxon signed-rank test. All tests were two-tailed with 5% significance level. Tutors reflected their cohort in terms of gender but were drawn from among the more academically successful final year students. Most had previous teaching experience. They were influenced to participate in 'OSCE tutor' by a desire to improve their own teaching and associated generic skills and by contextual factors relating to the organisation or previous experience of the OSCE tutor programme. Issues relating to longer term career aspirations were less important. After the event, tutors felt that participation had enhanced their skills in various areas, including practical teaching skills, confidence in speaking to groups and communication skills; and that as a result of taking part, they were now more likely to undertake further teacher training and to make teaching a major part of their career. However, whilst a number of students

Effects of participation in a cross year peer tutoring programme in clinical examination skills on volunteer tutors' skills and attitudes towards teachers and teaching

PubMed Central

Buckley, Sharon; Zamora, Javier

2007-01-01

Background Development of students' teaching skills is increasingly recognised as an important component of UK undergraduate medical curricula and, in consequence, there is renewed interest in the potential benefits of cross-year peer tutoring. Whilst several studies have described the use of cross-year peer tutoring in undergraduate medical courses, its use in the clinical setting is less well reported, particularly the effects of peer tutoring on volunteer tutors' views of teachers and teaching. This study explored the effects of participation in a cross-year peer tutoring programme in clinical examination skills ('OSCE tutor') on volunteer tutors' own skills and on their attitudes towards teachers and teaching. Methods Volunteer tutors were final year MBChB students who took part in the programme as part of a Student Selected Component (SSC). Tutees were year 3 MBChB students preparing for their end of year 'OSCE' examination. Pre and post participation questionnaires, including both Likert-type and open response questions, were used. Paired data was compared using the Wilcoxon signed-rank test. All tests were two-tailed with 5% significance level. Results Tutors reflected their cohort in terms of gender but were drawn from among the more academically successful final year students. Most had previous teaching experience. They were influenced to participate in 'OSCE tutor' by a desire to improve their own teaching and associated generic skills and by contextual factors relating to the organisation or previous experience of the OSCE tutor programme. Issues relating to longer term career aspirations were less important. After the event, tutors felt that participation had enhanced their skills in various areas, including practical teaching skills, confidence in speaking to groups and communication skills; and that as a result of taking part, they were now more likely to undertake further teacher training and to make teaching a major part of their career. However

Assessment of musculoskeletal physical examination skills and attitudes of orthopaedic residents.

PubMed

Beran, Matthew C; Awan, Hisham; Rowley, David; Samora, Julie Balch; Griesser, Michael J; Bishop, Julie Y

2012-03-21

Although the musculoskeletal physical examination is an essential part of patient encounters, we believe that it is underemphasized in residency education and that residents' physical examination skills may be lacking. We sought to assess attitudes regarding teaching of the physical examination in orthopaedic residencies, to assess physical examination knowledge and skills among residents, and to develop a method to track the skill level of residents in order to improve our physical examination curriculum. We created a thirty-question multiple-choice musculoskeletal physical examination test and administered it to our residents. We created a five-question survey assessing attitudes toward physical examination teaching in orthopaedic residencies and distributed it to U.S. orthopaedic department chairs We developed an Objective Structured Clinical Examination (OSCE), in which standardized patients enact four clinical scenarios, to observe and assess physical examination skills. The mean score on the multiple-choice physical examination test was 76% despite the fact that our residents consistently scored above 90% on the Orthopaedic In-Training Examination. Department chairs and residents agreed that, although learning to perform the physical examination is important, there is not enough time in the clinical setting to observe and critique a resident's patient examination. The overall score of our residents on the OSCE was 66%. We have exposed a deficiency in the physical examination knowledge and skills of our residents. Although the musculoskeletal physical examination is a vital practice component, our data indicate that it is likely underemphasized in training. Clinic time alone is likely insufficient for the teaching and learning of the musculoskeletal physical examination.

Voluntary attendance of small-group brainstorming tutoring courses intensify new clerk's "excellence in clinical care": a pilot study.

PubMed

Yang, Ling-Yu; Huang, Chia-Chang; Hsu, Hui-Chi; Yang, Ying-Ying; Chang, Ching-Chi; Chuang, Chiao-Lin; Lee, Wei-Shin; Liang, Jen-Feng; Cheng, Hao Min; Huang, Chin-Chou; Lee, Fa-Yauh; Ho, Shung-Tai; Kirby, Ralph

2017-01-06

Clerkship provides a unique way of transferring the knowledge and skills gathered during medical school's curriculum into real-ward clinical care environment. The annual program evaluation has indicated that the training of clerks in diagnostic and clinical reasoning skills needed to be enhanced. Recently, "clinical excellence" program have been promoted in our institution to augment the excellence in clinical care of new clerks. Current study aims to evaluate whether this pilot program improve the "clinical excellence" of new clerks. In a pilot study, groups of new clerks in years 2013 and 2014 voluntarily attended either a small-group brainstorming course or a didactic classroom tutoring courses as part of their 3-month internal medicine clinical rotation block. A third group of new clerks did not join either of the above courses and this group served as the control group. Pre-block/post-block self-assessment and post-block 5-station mini-Objective Subjective Clinical Examinations (OSCEs) were used to evaluate the effectiveness of these two additional courses that trained diagnostic and clinical reasoning skills. Overtime, the percentages of new clerks that attended voluntarily either the small-group brainstorming or classroom tutoring courses were increased. Higher post-block self-assessed diagnostic and clinical reasoning skill scores were found among individuals who attended the small-group brainstorming courses compared to either the didactic group or the control group. In a corresponding manner, the small-group brainstorming group obtained higher summary OSCE diag and OSCE reason scores than either the didactic group or control group. For all basic images/laboratory OSCE stations, the individual diagnostic skill (OSCE diag ) scores of the small-group brainstorming group were higher than those of the didactic group. By way of contrast, only the clinical reasoning skill (OSCE reason ) scores of the basic electrocardiogram and complete blood count�

Development of a tool to support holistic generic assessment of clinical procedure skills.

PubMed

McKinley, Robert K; Strand, Janice; Gray, Tracey; Schuwirth, Lambert; Alun-Jones, Tom; Miller, Helen

2008-06-01

The challenges of maintaining comprehensive banks of valid checklists make context-specific checklists for assessment of clinical procedural skills problematic. This paper reports the development of a tool which supports generic holistic assessment of clinical procedural skills. We carried out a literature review, focus groups and non-participant observation of assessments with interview of participants, participant evaluation of a pilot objective structured clinical examination (OSCE), a national modified Delphi study with prior definitions of consensus and an OSCE. Participants were volunteers from a large acute teaching trust, a teaching primary care trust and a national sample of National Health Service staff. Results In total, 86 students, trainees and staff took part in the focus groups, observation of assessments and pilot OSCE, 252 in the Delphi study and 46 candidates and 50 assessors in the final OSCE. We developed a prototype tool with 5 broad categories amongst which were distributed 38 component competencies. There was > 70% agreement (our prior definition of consensus) at the first round of the Delphi study for inclusion of all categories and themes and no consensus for inclusion of additional categories or themes. Generalisability was 0.76. An OSCE based on the instrument has a predicted reliability of 0.79 with 12 stations and 1 assessor per station or 10 stations and 2 assessors per station. This clinical procedural skills assessment tool enables reliable assessment and has content and face validity for the assessment of clinical procedural skills. We have designated it the Leicester Clinical Procedure Assessment Tool (LCAT).

Summative assessment of undergraduates' communication competence in challenging doctor-patient encounters. Evaluation of the Düsseldorf CoMeD-OSCE.

PubMed

Mortsiefer, Achim; Immecke, Janine; Rotthoff, Thomas; Karger, André; Schmelzer, Regine; Raski, Bianca; Schmitten, Jürgen In der; Altiner, Attila; Pentzek, Michael

2014-06-01

To evaluate the summative assessment (OSCE) of a communication training programme for dealing with challenging doctor-patient encounters in the 4th study year. Our OSCE consists of 4 stations (breaking bad news, guilt and shame, aggressive patients, shared decision making), using a 4-item global rating (GR) instrument. We calculated reliability coefficients for different levels, discriminability of single items and interrater reliability. Validity was estimated by gender differences and accordance between GR and a checklist. In a pooled sample of 456 students in 3 OSCEs over 3 terms, total reliability was α=0.64, reliability coefficients for single stations were >0.80, and discriminability in 3 of 4 stations was within the range of 0.4-0.7. Except for one station, interrater reliability was moderate to strong. Reliability on item level was poor and pointed to some problems with the use of the GR. The application of the GR on regular undergraduate medical education shows moderate reliability in need of improvement and some traits of validity. Ongoing development and evaluation is needed with particular regard to the training of the examiners. Our CoMeD-OSCE proved suitable for the summative assessment of communication skills in challenging doctor-patient encounters. Copyright © 2014 Elsevier Ireland Ltd. All rights reserved.

The objective structured clinical examination revisited for postgraduate trainees in general practice.

PubMed

Schoenmakers, Birgitte; Wens, Johan

2014-03-04

To investigate if the psychometric qualities of an OSCE consisting of more complex simulated patient encounters remain valid and reliable in the assessment of postgraduate trainees in general practice. In this intervention study without control group, the traditional OSCE was formally replaced by the new, complex version. The study population was composed by all postgraduate trainees (second and third phase) in general practice during the ongoing academic year. Data were handled and collected as part of the formal assessment program. Univariate analyses, the variance of scores and multivariate analyses were performed to assess the test qualities. A total of 340 students participated. Average final scores were slightly higher for third-phase students (t-test, p =0.05). Overall test scores were equally distributed on station level, circuit level and phase level. A multiple regression analysis revealed that test scores were dependent on the stations and circuits, but not on the master phase. In a changing learning environment, assessment and evaluation strategies require reorientation. The reliability and validity of the OSCE remain subject to discussion. In particular, when it comes to content and design, the traditional OSCE might underestimate the performance level of postgraduate trainees in general practice. A reshaping of this OSCE to a more sophisticated design with more complex patient encounters appears to restore the validity of the test results.

Association Between National Board Dental Examination Part II Scores and Comprehensive Examinations at Harvard School of Dental Medicine.

PubMed

Lee, Min Kyeong; Allareddy, Veerasathpurush; Howell, T Howard; Karimbux, Nadeem Y

2011-01-01

Harvard School of Dental Medicine (HSDM) uses a hybrid problem-based approach to teaching in the predoctoral program. The objective structured clinical examination (OSCE) is a formative examination designed to assess the performance of students in the problem-based learning (PBL) curriculum. At HSDM three comprehensive examinations with OSCE components are administered during the third and fourth years of clinical training. The National Board Dental Examination (NBDE) Part II is taken in the final year of the predoctoral program. This study examines the association between the NBDE Part II and the comprehensive exams held at HSDM. Predoctoral students from the HSDM classes of 2005 and 2006 were included in this study. The outcome variable of interest was the scores obtained by students in the NBDE Part II, and the main independent variable of interest was the performance of students in the comprehensive exams (honors, pass, make-up exam to pass). The Mann-Whitney U-test was used to examine the association between the grades obtained in the each of the three comprehensive exams and the NBDE Part II scores. Multivariable linear regression analysis was also used to examine the association between the NBDE Part II scores and the comprehensive exam grades. The effect of potential confounding factors including age, sex, and race/ethnicity was adjusted. The results suggest that students who performed well in the comprehensive exams performed better on the NBDE Part II, even after adjusting for confounding factors. Future studies will examine the long-term impact of PBL on postdoctoral plans and career choices.

The influence of first impressions on subsequent ratings within an OSCE station.

PubMed

Wood, Timothy J; Chan, James; Humphrey-Murto, Susan; Pugh, Debra; Touchie, Claire

2017-10-01

Competency-based assessment is placing increasing emphasis on the direct observation of learners. For this process to produce valid results, it is important that raters provide quality judgments that are accurate. Unfortunately, the quality of these judgments is variable and the roles of factors that influence the accuracy of those judgments are not clearly understood. One such factor is first impressions: that is, judgments about people we do not know, made quickly and based on very little information. This study explores the influence of first impressions in an OSCE. Specifically, the purpose is to begin to examine the accuracy of a first impression and its influence on subsequent ratings. We created six videotapes of history-taking performance. Each video was scripted from a real performance by six examinee residents within a single OSCE station. Each performance was re-enacted with six different actors playing the role of the examinees and one actor playing the role of the patient and videotaped. A total of 23 raters (i.e., physician examiners) reviewed each video and were asked to make a global judgment of the examinee's clinical abilities after 60 s (First Impression GR) by providing a rating on a six-point global rating scale and then to rate their confidence in the accuracy of that judgment by providing a rating on a five-point rating scale (Confidence GR). After making these ratings, raters then watched the remainder of the examinee's performance and made another global rating of performance (Final GR) before moving on to the next video. First impression ratings of ability varied across examinees and were moderately correlated to expert ratings (r = .59, 95% CI [-.13, .90]). There were significant differences in mean ratings for three examinees. Correlations ranged from .05 to .56 but were only significant for three examinees. Rater confidence in their first impression was not related to the likelihood of a rater changing their rating between the first

A Process for Curricular Improvement Based on Evaluation of Student Performance on Milestone Examinations

PubMed Central

Hylton, Ann C.; Justice, Michael

2016-01-01

Objective. To identify and address areas for curricular improvement by evaluating student achievement of expected learning outcomes and competencies on annual milestone examinations. Design. Students were tested each professional year with a comprehensive milestone examination designed to evaluate student achievement of learning outcomes and professional competencies using a combination of multiple-choice questions, standardized patient assessments (SPAs), and objective structured clinical examination (OSCE) questions. Assessment. Based on student performance on milestone examinations, curricular changes were instituted, including an increased emphasis on graded comprehensive cases, OSCE skills days, and use of patient simulation in lecture and laboratory courses. After making these changes, significant improvements were observed in second and third-year pharmacy students’ grades for the therapeutic case and physician interaction/errors and omissions components of the milestone examinations. Conclusion. Results from milestone examinations can be used to identify specific areas in which curricular improvements are needed to foster student achievement of learning outcomes and professional competencies. PMID:28090108

Assessing the Organizational Social Context (OSC) of Child Welfare Systems: Implications for Research and Practice

ERIC Educational Resources Information Center

Glisson, Charles; Green, Philip; Williams, Nathaniel J.

2012-01-01

Objective: The study: (1) provides the first assessment of the a "priori" measurement model and psychometric properties of the Organizational Social Context (OSC) measurement system in a US nationwide probability sample of child welfare systems; (2) illustrates the use of the OSC in constructing norm-based organizational culture and climate…

Recommended OSC design and analysis of AMTEC power system for outer-planet missions

DOE Office of Scientific and Technical Information (OSTI.GOV)

Schock, A.; Noravian, H.; Or, C.

1999-01-01

The paper describes OSC designs and analyses of AMTEC cells and radioisotope power systems for possible application to NASA{close_quote}s Europa Orbiter and Pluto Kuiper Express missions, and compares their predicted performance with JPL{close_quote}s preliminary mission goals. The latest cell and generator designs presented here were the culmination of studies covering a wide variety of generator configurations and operating parameters. The many steps and rationale leading to OSC{close_quote}s design evolution and materials selection were discussed in earlier publications and will not be repeated here except for a description of OSC{close_quote}s latest design, including a recent heat source support scheme and cellmore » configuration that have not been described in previous publications. As shown, that heat source support scheme eliminates all contact between the heat source and the AMTEC (Alkali Metal Thermal-to-Electrical Conversion) cells, which simplifies the generator{close_quote}s structural design as well as its fabrication and assembly procedure. An additional purpose of the paper is to describe a revised cell design and fabrication procedure which represent a major departure from previous OSC designs. Previous cells had a uniform diameter, but in the revised design the cell wall beyond the BASE tubes has a greatly reduced diameter. The paper presents analytical performance predictions which show that the revised ({open_quotes}chimney{close_quotes}) cell design yields substantially higher efficiencies than the previous (cylindrical) design. This makes it possible to meet and substantially exceed the JPL-stipulated EOM power goal with four instead of six General Purpose Heat Source (GPHS) modules, resulting in a one-third reduction in the heat source mass, cost, and fuel requirements. OSC{close_quote}s performance predictions were based on its techniques for the coupled thermal, electrical, and fluid flow analyses of AMTEC generators. Those analytical

Assessing the Organizational Social Context (OSC) of child welfare systems: implications for research and practice.

PubMed

Glisson, Charles; Green, Philip; Williams, Nathaniel J

2012-09-01

The study: (1) provides the first assessment of the a priori measurement model and psychometric properties of the Organizational Social Context (OSC) measurement system in a US nationwide probability sample of child welfare systems; (2) illustrates the use of the OSC in constructing norm-based organizational culture and climate profiles for child welfare systems; and (3) estimates the association of child welfare system-level organizational culture and climate profiles with individual caseworker-level job satisfaction and organizational commitment. The study applies confirmatory factor analysis (CFA) and hierarchical linear models (HLM) analysis to a US nationwide sample of 1,740 caseworkers from 81 child welfare systems participating in the second National Survey of Child and Adolescent Wellbeing (NSCAW II). The participating child welfare systems were selected using a national probability procedure reflecting the number of children served by child welfare systems nationwide. The a priori OSC measurement model is confirmed in this nationwide sample of child welfare systems. In addition, caseworker responses to the OSC scales generate acceptable to high scale reliabilities, moderate to high within-system agreement, and significant between-system differences. Caseworkers in the child welfare systems with the best organizational culture and climate profiles report higher levels of job satisfaction and organizational commitment. Organizational climates characterized by high engagement and functionality, and organizational cultures characterized by low rigidity are associated with the most positive work attitudes. The OSC is the first valid and reliable measure of organizational culture and climate with US national norms for child welfare systems. The OSC provides a useful measure of Organizational Social Context for child welfare service improvement and implementation research efforts which include a focus on child welfare system culture and climate. Copyright © 2012

Comparison of physical examination performance of medical students trained by musculoskeletal versus non-musculoskeletal specialists.

PubMed

Melo, Luciano; Schrieber, Leslie; Eyles, Jillian; Deveza, Leticia A; Meneses, Sarah R F; Hunter, David J

2017-04-01

To compare the musculoskeletal (MSK) physical examination skills, knowledge acquisition and performance of first-year medical students trained by MSK specialist tutors to students trained by non-MSK specialist tutors, after a 6-week MSK physical examination tutorial program. Twenty-first year medical students took part in the study. They were recruited into two groups, according to their exposure to either an MSK specialist or a non-MSK specialist tutor during their 6-week MSK training block. Knowledge acquisition was measured via a pre- and post-training objective structured clinical examination (OSCE). We assessed students' self-belief and confidence levels regarding their newly acquired skills via a questionnaire. Independent t tests were used to examine mean group differences of OSCE scores and perceived level of confidence. Both groups demonstrated a significant improvement (3.9 and 3.8 points, respectively, on an eight-point scale for shoulder assessment, P < 0.01, 3.3 and 3.5, respectively, on a five-point scale for spine assessment, P < 0.01) in OSCE scores compared to baseline after completing the 6-week MSK physical examination tutorial program. There was no between-group difference in the OSCE scores from pre- to post-training (P = 0.92 for shoulder, P = 0.66 for spine) or for perceived level of confidence in performing a basic MSK examination after training (P = 0.91). Students exposed to MSK specialist tutors did not demonstrate increased skill levels or knowledge in the area of MSK physical examination compared to those receiving the same training under the supervision of non-MSK specialist tutors. Both student groups demonstrated improvement. © 2017 Asia Pacific League of Associations for Rheumatology and John Wiley & Sons Australia, Ltd.

OSC in the 1970s: a springboard for a career in optical engineering

NASA Astrophysics Data System (ADS)

Harvey, James E.

2014-09-01

Anecdotes and recollections from a graduate student at the Optical Sciences Center (OSC) in the late 1960s and early 1970s. The early faculty of the OCS fostered an exciting environment where even graduate students served significant roles on major government research contracts. Teamwork and collaboration between research groups was often required to meet the contract goals. This unique learning experience at the OSC almost 50 years ago served as a springboard for a satisfying and rewarding career in Optical Engineering.

Does medical students’ clinical performance affect their actual performance during medical internship?

PubMed Central

Han, Eui-Ryoung; Chung, Eun-Kyung

2016-01-01

INTRODUCTION This study examines the relationship between the clinical performance of medical students and their performance as doctors during their internships. METHODS This retrospective study involved 63 applicants of a residency programme conducted at Chonnam National University Hospital, South Korea, in November 2012. We compared the performance of the applicants during their internship with their clinical performance during their fourth year of medical school. The performance of the applicants as interns was periodically evaluated by the faculty of each department, while their clinical performance as fourth-year medical students was assessed using the Clinical Performance Examination (CPX) and the Objective Structured Clinical Examination (OSCE). RESULTS The performance of the applicants as interns was positively correlated with their clinical performance as fourth-year medical students, as measured by the CPX and OSCE. The performance of the applicants as interns was moderately correlated with the patient-physician interaction items addressing communication and interpersonal skills in the CPX. CONCLUSION The clinical performance of medical students during their fourth year in medical school was related to their performance as medical interns. Medical students should be trained to develop good clinical skills through actual encounters with patients or simulated encounters using manikins, to enable them to become more competent doctors. PMID:26768172

Does medical students' clinical performance affect their actual performance during medical internship?

PubMed

Han, Eui-Ryoung; Chung, Eun-Kyung

2016-02-01

This study examines the relationship between the clinical performance of medical students and their performance as doctors during their internships. This retrospective study involved 63 applicants to a residency programme conducted at the Chonnam National University Hospital, South Korea, in November 2012. We compared the performance of the applicants during their internship with the clinical performance of the applicants during their fourth year of medical school. The performance of the applicants as interns was periodically evaluated by the faculty of each department, while the clinical performance of the applicants as fourth year medical students was assessed using the Clinical Performance Examination (CPX) and the Objective Structured Clinical Examination (OSCE). The performance of the applicants as interns was positively correlated with their clinical performance as fourth year medical students, as measured by CPX and OSCE. The performance of the applicants as interns was moderately correlated with the patient-physician interactions items addressing communication and interpersonal skills in the CPX. The clinical performance of medical students during their fourth year in medical school was related to their performance as medical interns. Medical students should be trained to develop good clinical skills, through actual encounters with patients or simulated encounters using manikins, so that they are able to become competent doctors. Copyright © Singapore Medical Association.

Communication skills training in surgical residency: a needs assessment and metacognition analysis of a difficult conversation objective structured clinical examination.

PubMed

Falcone, John L; Claxton, René N; Marshall, Gary T

2014-01-01

The objective structured clinical examination (OSCE) can be used to evaluate the Accreditation Council for Graduate Medical Education Core Competencies of Professionalism and Interpersonal and Communication Skills. The aim of this study was to describe general surgery resident performance on a "difficult conversation" OSCE. In this prospective study, junior and senior residents participated in a 2-station OSCE. Junior stations involved discussing operative risks and benefits and breaking bad news. Senior stations involved discussing goals of care and discussing transition to comfort measures only status. Residents completed post-OSCE checklist and Likert-based self-evaluations of experience, comfort, and confidence. Trained standardized patients (SPs) evaluated residents using communication skill-based checklists and Likert-based assessments. Pearson correlation coefficients were determined between self-assessment and SP assessment. Mann-Whitney U tests were conducted between junior and senior resident variables, using α = 0.05. There were 27 junior residents (age 28.1 ± 1.9 years [29.6% female]) and 27 senior residents (age 32.1 ± 2.5 years [26.9% female]). The correlation of self-assessment and SP assessment of overall communication skills by junior residents was -0.32 on the risks and benefits case and 0.07 on the breaking bad news case. The correlation of self-assessment and SP assessment of overall communication skills by senior residents was 0.30 on the goals of care case and 0.26 on the comfort measures only case. SP assessments showed that junior residents had higher overall communication skills than senior residents (p = 0.03). Senior residents perceived that having difficult conversations was more level appropriate (p < 0.001), and they were less nervous having difficult conversations (p < 0.01) than junior residents. We found that residents perform difficult conversations well, that subjective and objective skills are correlated, and that skills

The Impact of Critical Thinking on Clinical Judgment During Simulation With Senior Nursing Students.

PubMed

Cazzell, Mary; Anderson, Mindi

2016-01-01

The study examined the impact of critical thinking (CT) on clinical judgment (CJ) during a pediatric Objective Structured Clinical Evaluation (OSCE) with 160 pre-licensure nursing students. Educators are called to transform teaching strategies to develop CJ but confusion exists over definitions. A descriptive correlational design was used to examine demographics and Tower of Hanoi (TOH) and Health Science Reasoning Test (HSRT) scores. CJ was measured by scores on the Lasater Clinical Judgment Rubric (LCJR) from videotaped OSCEs. Participants were: 86 percent female, 42 percent Caucasian, median 23 years, with 49 percent having health care experience. Students averaged seven moves over minimum on the TOH. Average scores were: HSRT 25/38 and LCJR 31/44. Statistically significant predictors of CJ were gender, ethnicity, HSRT deduction, and analysis; 11 CT variables accounted for 17 percent of LCJR scores. Educators need to utilize/develop innovative teaching strategies addressing CJ predictors.

Standard Setting in a Small Scale OSCE: A Comparison of the Modified Borderline-Group Method and the Borderline Regression Method

ERIC Educational Resources Information Center

Wood, Timothy J.; Humphrey-Murto, Susan M.; Norman, Geoffrey R.

2006-01-01

When setting standards, administrators of small-scale OSCEs often face several challenges, including a lack of resources, a lack of available expertise in statistics, and difficulty in recruiting judges. The Modified Borderline-Group Method is a standard setting procedure that compensates for these challenges by using physician examiners and is…

Are Examiners' Judgments in OSCE-Style Assessments Influenced by Contrast Effects?

PubMed

Yeates, Peter; Moreau, Marc; Eva, Kevin

2015-07-01

Laboratory studies have shown that performance assessment judgments can be biased by "contrast effects." Assessors' scores become more positive, for example, when the assessed performance is preceded by relatively weak candidates. The authors queried whether this effect occurs in real, high-stakes performance assessments despite increased formality and behavioral descriptors. Data were obtained for the 2011 United Kingdom Foundational Programme clinical assessment and the 2008 University of Alberta Multiple Mini Interview. Candidate scores were compared with scores for immediately preceding candidates and progressively distant candidates. In addition, average scores for the preceding three candidates were calculated. Relationships between these variables were examined using linear regression. Negative relationships were observed between index scores and both immediately preceding and recent scores for all exam formats. Relationships were greater between index scores and the average of the three preceding scores. These effects persisted even when examiners had judged several performances, explaining up to 11% of observed variance on some occasions. These findings suggest that contrast effects do influence examiner judgments in high-stakes performance-based assessments. Although the observed effect was smaller than observed in experimentally controlled laboratory studies, this is to be expected given that real-world data lessen the strength of the intervention by virtue of less distinct differences between candidates. Although it is possible that the format of circuital exams reduces examiners' susceptibility to these influences, the finding of a persistent effect after examiners had judged several candidates suggests that the potential influence on candidate scores should not be ignored.

Assessing cardiac physical examination skills using simulation technology and real patients: a comparison study.

PubMed

Hatala, Rose; Issenberg, S Barry; Kassen, Barry; Cole, Gary; Bacchus, C Maria; Scalese, Ross J

2008-06-01

High-stakes assessments of doctors' physical examination skills often employ standardised patients (SPs) who lack physical abnormalities. Simulation technology provides additional opportunities to assess these skills by mimicking physical abnormalities. The current study examined the relationship between internists' cardiac physical examination competence as assessed with simulation technology compared with that assessed with real patients (RPs). The cardiac physical examination skills and bedside diagnostic accuracy of 28 internists were assessed during an objective structured clinical examination (OSCE). The OSCE included 3 modalities of cardiac patients: RPs with cardiac abnormalities; SPs combined with computer-based, audio-video simulations of auscultatory abnormalities, and a cardiac patient simulator (CPS) manikin. Four cardiac diagnoses and their associated cardiac findings were matched across modalities. At each station, 2 examiners independently rated a participant's physical examination technique and global clinical competence. Two investigators separately scored diagnostic accuracy. Inter-rater reliability between examiners for global ratings (GRs) ranged from 0.75-0.78 for the different modalities. Although there was no significant difference between participants' mean GRs for each modality, the correlations between participants' performances on each modality were low to modest: RP versus SP, r = 0.19; RP versus CPS, r = 0.22; SP versus CPS, r = 0.57 (P < 0.01). Methodological limitations included variability between modalities in the components contributing to examiners' GRs, a paucity of objective outcome measures and restricted case sampling. No modality provided a clear 'gold standard' for the assessment of cardiac physical examination competence. These limitations need to be addressed before determining the optimal patient modality for high-stakes assessment purposes.

Acceptability and Impact of a Required Palliative Care Rotation with Prerotation and Postrotation Observed Simulated Clinical Experience during Internal Medicine Residency Training on Primary Palliative Communication Skills.

PubMed

Vergo, Maxwell T; Sachs, Sharona; MacMartin, Meredith A; Kirkland, Kathryn B; Cullinan, Amelia M; Stephens, Lisa A

2017-05-01

Improving communication training for primary palliative care using a required palliative care rotation for internal medicine (IM) residents has not been assessed. To assess skills acquisition and acceptability for IM residents not selecting an elective. A consecutive, single-arm cohort underwent preobjective structured clinical examination (OSCE) with learner-centric feedback, two weeks of clinical experience, and finally a post-OSCE to crystallize learner-centric take home points. IM second year residents from Dartmouth-Hitchcock were exposed to a required experiential palliative care rotation. Pre- and post-OSCE using a standardized score card for behavioral skills, including patient-centered interviewing, discussing goals of care/code status, and responding to emotion, as well as a confidential mixed qualitative and quantitative evaluation of the experience. Twelve residents were included in the educational program (two were excluded because of shortened experiences) and showed statistically significant improvements in overall communication and more specifically in discussing code status and responding to emotions. General patient-centered interviewing skills were not significantly improved, but prerotation scores reflected pre-existing competency in this domain. Residents viewed the observed simulated clinical experience (OSCE) and required rotation as positive experiences, but wished for more opportunities to practice communication skills in real clinical encounters. A required palliative care experiential rotation flanked by OSCEs at our institution improved the acquisition of primary palliative care communication skills similarly to other nonclinical educational platforms, but may better meet the needs of the resident and faculty as well as address all required ACGME milestones.

The weak relationship between anatomy competence and clinical skills in junior medical students.

PubMed

Schoeman, Scarpa; Chandratilake, Madawa

2012-01-01

In modern curricula, the early integration of anatomy and clinical skills education at undergraduate level is seen as important. However, the direct relationship between medical students' competence in anatomy, and their clinical proficiency during early undergraduate years, has scarcely been studied. In this study, the marks for anatomy and clinical skills of three consecutive cohorts of medical students (n = 538 in total) during their first two years were correlated. The anatomy competence was measured using a new marker, the Anatomy Competence Score (ACS) which was calculated with equal contributions from theory knowledge and its practical and clinical application. Proficiency in clinical skills was determined by OSCE performance marks for stations which examined physical examination and practical procedural skills. The possible compounding effect of students' general academic ability was investigated by using the overall performance mark for each student based on their performance in all subjects over the first two years of the medical curriculum. We found that the correlation between anatomy and clinical skills marks was weak to moderate. However, this correlation was virtually nullified once the effect of academic ability was accounted for. Although these findings suggest that anatomy education does not compliment early clinical education, the lack of complexity of clinical problems used in clinical skills assessments (OSCEs) during the early stages may well be the primary contributing factor to this finding. Copyright © 2012 American Association of Anatomists.

Does hearing the patient perspective improve consultation skills in examinations? An exploratory randomized controlled trial in medical undergraduate education.

PubMed

Snow, Rosamund; Crocker, Joanna; Talbot, Katherine; Moore, Jane; Salisbury, Helen

2016-12-01

Medical education increasingly includes patient perspectives, but few studies look at the impact on students' proficiency in standard examinations. We explored students' exam performance after viewing video of patients' experiences. Eighty-eight medical students were randomized to one of two e-learning modules. The experimental group saw video clips of patients describing their colposcopy, while the control group viewed a clinician describing the procedure. Students then completed a Multiple Choice Questionnaire (MCQ) and were assessed by a blinded clinical examiner in an Objective Structured Clinical Examination (OSCE) with a blinded simulated patient (SP). The SP scored students using the Doctors' Interpersonal Skills Questionnaire (DISQ). Students rated the module's effect on their skills and confidence. Regression analyses were used to compare the effect of the two modules on these outcomes, adjusting for gender and graduate entry. The experimental group performed better in the OSCE than the control group (odds ratio 2.7 [95%CI 1.2-6.1]; p = 0.016). They also reported significantly more confidence in key areas, including comfort with patients' emotions (odds ratio 6.4 [95%CI 2.7-14.9]; p < 0.0005). There were no other significant differences. Teaching that included recorded elements of real patient experience significantly improved students' examination performance and confidence.

Clinical competency evaluation of Brazilian chiropractic interns

PubMed Central

Facchinato, Ana Paula A.; Benedicto, Camila C.; Mora, Aline G.; Cabral, Dayane M.C.; Fagundes, Djalma J.

2015-01-01

Objective This study compares the results of an objective structured clinical examination (OSCE) between 2 groups of students before an internship and after 6 months of clinical practice in an internship. Methods Seventy-two students participated, with 36 students in each cohort. The OSCEs were performed in the simulation laboratory before the participants' clinical practice internship and after 6 months of the internship. Students were tested in 9 stations for clinical skills and knowledge. The same procedures were repeated for both cohorts. The t test was used for unpaired parametric samples and Fisher's exact test was used for comparison of proportions. Results There was no difference in the mean final score between the 2 groups (p = .34 for test 1; p = .08 for test 2). The performance of the students in group 1 was not significantly different when performed before and after 6 months of clinical practice, but in group 2 there was a significant decrease in the average score after 6 months of clinical practice. Conclusions There was no difference in the cumulative average score for the 2 groups before and after 6 months of clinical practice in the internship. There were differences within the cohorts, however, with a significant decrease in the average score in group 2. Issues pertaining to test standardization and student motivation for test 2 may have influenced the scores. PMID:25588200

77 FR 28638 - OSC Forms And Survey Renewal for FY 2012-Request for Comment

Federal Register 2010, 2011, 2012, 2013, 2014

2012-05-15

... employees; and (2) the interpretation and enforcement of Hatch Act provisions on political activity in... Possible Prohibited Political Activity (Violation of the Hatch Act)); (4) Office of Special Counsel (OSC...

77 FR 22614 - OSC Forms and Survey Renewal for FY 2012-Request for Comment

Federal Register 2010, 2011, 2012, 2013, 2014

2012-04-16

... employees; and (2) the interpretation and enforcement of Hatch Act provisions on political activity in... Possible Prohibited Political Activity (Violation of the Hatch Act)); (4) Office of Special Counsel (OSC...

Standard Setting for Clinical Competence at Graduation from Medical School: A Comparison of Passing Scores across Five Medical Schools

ERIC Educational Resources Information Center

Boursicot, Katharine A. M.; Roberts, Trudie E.; Pell, Godfrey

2006-01-01

While Objective Structured Clinical Examinations (OSCEs) have become widely used to assess clinical competence at the end of undergraduate medical courses, the method of setting the passing score varies greatly, and there is no agreed best methodology. While there is an assumption that the passing standard at graduation is the same at all medical…

Evaluating the impact of a pre-rotation workshop on student preparation for clinical advanced pharmacy practice experiences.

PubMed

Medina, Melissa S; Stark, Jennifer E; Vesta, Kimi S; Lockhart, Staci M

2008-10-01

This pilot study was designed to evaluate the impact of a pre-rotation workshop (PRW) on pharmacy students' clinical skills and preparation for clinical Advanced Pharmacy Practice Experiences (APPE) involving direct patient care. Randomized controlled trial of an educational intervention with Institutional Review Board approval. PRW activities designed to simulate rotation activities around five competencies, patient charts, medication histories, SOAP notes, patient presentations, and professionalism. Endpoints were evaluated using clinical rotation preceptors' evaluation of performance and students' performance on objective structured clinical exams (OSCE). Eight fourth-year students and eight GPA matched controls (20% of the total class) were selected to voluntarily participate. The PRW demonstrated a positive impact on students' clinical skills and preparation for rotations by improving OSCE performance. However, no significant differences were found between groups when comparing preceptor evaluations of skills on rotations. These results are limited by the small sample size, potential OSCE "test-wiseness" effects, lack of OSCE evaluator blinding to study groups, potential case specificity effects due to the limited number of cases used on the OSCE and possible lack of sensitivity of the rotation evaluation tool to capture true differences among the experimental and control group participants. The PRW was successful at advancing students' clinical skills and preparation for rotations and may be considered as a tool to help bridge didactic to clinical experiences in the Pharm.D. curriculum.

Effects of ultrasound implementation on physical examination learning and teaching during the first year of medical education.

PubMed

Dinh, Vi Am; Frederick, Jon; Bartos, Rebekah; Shankel, Tamara M; Werner, Leonard

2015-01-01

Increasing emphasis has been placed on point-of-care ultrasound in medical school. The overall effects of ultrasound curriculum implementation on the traditional physical examination skills of medical students are still unknown. We studied the effects on the Objective Standardized Clinical Examination (OSCE) scores of year 1 medical students before and after ultrasound curriculum implementation. An ultrasound curriculum was incorporated into the physical diagnosis course for year 1 medical students in the 2012-2013 academic year. We performed a prospective observational study comparing traditional OSCE scores of year 1 medical students exposed to the ultrasound curriculum (post-ultrasound) versus historic year 1 medical student controls (pre-ultrasound) with no ultrasound exposure. Questionnaire data were also obtained from year 1 medical students and physical diagnosis faculty to assess attitudes toward ultrasound implementation. The final overall OSCE scores were graded with a 5-point Likert-type scale from unsatisfactory to outstanding. There was a significant increase in outstanding scores in the post-ultrasound compared to the pre-ultrasound group (27.0% versus 10.9%; P< .001). The post-ultrasound group had significantly (P< .05) increased first-time pass rates on blood pressure measurements, the abdominal examination, and professionalism. Student and physical diagnosis faculty questionnaire data showed an overall positive response, with most agreeing or strongly agreeing that ultrasound should be included in the future year 1 medical student curriculum. Ultrasound implementation into a physical diagnosis curriculum for year 1 medical students is feasible and may improve their overall traditional physical examination skills. © 2015 by the American Institute of Ultrasound in Medicine.

Communication skills of medical students during the OSCE: Gender-specific differences in a longitudinal trend study.

PubMed

Graf, Joachim; Smolka, Robert; Simoes, Elisabeth; Zipfel, Stephan; Junne, Florian; Holderried, Friederike; Wosnik, Annette; Doherty, Anne M; Menzel, Karina; Herrmann-Werner, Anne

2017-05-02

Communication skills are essential in a patient-centred health service and therefore in medical teaching. Although significant differences in communication behaviour of male and female students are known, gender differences in the performance of students are still under-reported. The aim of this study was to analyse gender differences in communication skills of medical students in the context of an OSCE exam (OSCE = Objective Structured Clinical Examination). In a longitudinal trend study based on seven semester-cohorts, it was analysed if there are gender differences in medical students' communication skills. The students (self-perception) and standardized patients (SP) (external perception) were asked to rate the communication skills using uniform questionnaires. Statistical analysis was performed by using frequency analyses and t-tests in SPSS 21. Across all ratings in the self- and the external perception, there was a significant gender difference in favour of female students performing better in the dimensions of empathy, structure, verbal expression and non-verbal expression. The results of male students deteriorated across all dimensions in the external perception between 2011 and 2014. It is important to consider if gender-specific teaching should be developed, considering the reported differences between female and male students.

Undergraduate psychiatry students' attitudes towards teaching methods at an Irish university.

PubMed

Jabbar, F; Casey, P; Kelly, B D

2016-11-01

At University College Dublin, teaching in psychiatry includes clinical electives, lectures, small-group and problem-based teaching, consistent with international trends. To determine final-year psychiatry students' attitudes towards teaching methods. We distributed questionnaires to all final-year medical students in two classes (2008 and 2009), after final psychiatry examination (before results) and all of them participated (n = 111). Students' interest in psychiatry as a career increased during psychiatry teaching. Students rated objective structured clinical examination (OSCE) as the most useful element of teaching and examination. The most common learning style was "reflector"; the least common was "pragmatist". Two thirds believed teaching could be improved (increased patient contact) and 89 % reported that experience of psychiatry changed attitudes towards mental illness (increased understanding). Students' preference for OSCEs may reflect the closeness of OSCE as a form of learning to OSCE as a form of assessment: OSCEs both focus on specific clinical skills and help prepare for examinations. Future research could usefully examine the extent to which these findings are university-specific or instructor-dependent. Information on the consistency of various teaching, examination and modularisation methods would also be useful.

Qualitative analysis of student beliefs and attitudes after an objective structured clinical evaluation: implications for affective domain learning in undergraduate nursing education.

PubMed

Cazzell, Mary; Rodriguez, Amber

2011-12-01

This qualitative study explored the feelings, beliefs, and attitudes of senior-level undergraduate pediatric nursing students upon completion of a medication administration Objective Structured Clinical Evaluation (OSCE). The affective domain is the most neglected domain in higher education, although it is deemed the "gateway to learning." Quantitative assessments of clinical skills performed during OSCEs usually address two of the three domains of learning: cognitive (knowledge) and psychomotor skills. Twenty students volunteered to participate in focus groups (10 per group) and were asked three questions relevant to their feelings, beliefs, and attitudes about their OSCE experiences. Students integrated the attitude of safety first into future practice but felt that anxiety, loss of control, reaction under pressure, and no feedback affected their ability to connect the OSCE performance with future clinical practice. The findings affect future affective domain considerations in the development, modification, and assessment of OSCEs across the undergraduate nursing curriculum.

Undescended testis? How best to teach the physical examination.

PubMed

Zundel, S; Blumenstock, G; Herrmann-Werner, A; Trueck, M; Schmidt, A; Wiechers, S

2016-12-01

Undescended testis in boys is common. Guidelines recommend surgical treatment between the ages of 6 months and 2 years; nevertheless, orchidopexy is frequently performed at later ages. One reason is the belated diagnosis due to a perceived difficulty in the physical examination (PE) and correct localization of the testis. We aimed to find an effective method for teaching the physical examination of the testis in a child. An interdisciplinary team developed teaching sessions, including an educational video and a simulator. Medical students (n = 133) were randomized into three groups: self-study only, video, and video and simulator. The sessions were carried out and quantitative feedback was collected from the teachers and students. The learning achievements of the different groups were assessed with an objective structured clinical examination (OSCE). The differences in mean OSCE results between all three groups were tested using one-way analysis of variance (ANOVA). For multiple pairwise comparisons, a closed testing procedure was performed using unpaired t-tests. The self-study only group acquired the poorest results in the OSCE, with a mean score of 5.1 out of 10. The video-only-group reached a mean of 6.7, and the video-and-simulator group performed best with a mean score of 8.5. The differences between all three groups were found to be statistically significant, with P = 0.007. The attached figure illustrates this data. If analyzed in pairs, this difference was particularly apparent between the groups self-study only vs video and simulator, with P = 0.002. Qualitative feedback revealed doubtful effectiveness for educational videos, but positive reactions to training on a simulator. The poor results of the self-study-only group were in accordance with the literature, where textbook learning was found not to increase OSCE results. The effectiveness of video tutorials remains doubtful; studies focusing on this teaching method are divergent and the present

How Do Examiners and Examinees Think About Role-Playing of Standardized Patients in an OSCE Setting?

ERIC Educational Resources Information Center

Sadeghi, Majid; Taghva, Arsia; Mirsepassi, Gholamreza; Hassanzadeh, Mehdi

2007-01-01

Objective: The use of standardized patients in Objective Structured Clinical Examinations in the assessment of psychiatric residents has increased in recent years. The aim of this study is to investigate the experience of psychiatry residents and examiners with standardized patients in Iran. Method: Final-year residents in psychiatry participated…

A digital peer-to-peer learning platform for clinical skills development.

PubMed

Basnak, Jesse; Ortynski, Jennifer; Chow, Meghan; Nzekwu, Emeka

2017-02-01

Due to constraints in time and resources, medical curricula may not provide adequate opportunities for pre-clerkship students to practice clinical skills. To address this, medical students at the University of Alberta developed a digital peer-to-peer learning initiative. The initiative assessed if students can learn clinical skills from their peers in co-curricular practice objective structured clinical exams (OSCEs). A total of 144 first-year medical students participated. Students wrote case scenarios that were reviewed by physicians. Students enacted the cases in practice OSCEs, acting as the patient, physician, and evaluator. Verbal and electronic evaluations were completed. A digital platform was used to automate the process. Surveys were disseminated to assess student perceptions of their experience. Seventy-five percent of participants said they needed opportunities to practice patient histories and physical exams in addition to those provided in the medical school curriculum. All participants agreed that the co-curricular practice OSCEs met this need. The majority of participants also agreed that the digital platform was efficient and easy to use. Students found the practice OSCEs and digital platform effective for learning clinical skills. Thus, peer-to-peer learning and computer automation can be useful adjuncts to traditional medical curricula.

The use of a virtual patient case in an OSCE-based exam--a pilot study.

PubMed

Courteille, O; Bergin, R; Stockeld, D; Ponzer, S; Fors, U

2008-01-01

This study focuses on a skills test based clinical assessment where 118 fourth-year medical students at the four teaching hospitals of Karolinska Institutet participated in the same 12-module OSCE. The goal of one of the twelve examination modules was to assess the students' skills and ability to solve a virtual patient (VP) case (the ISP system), which included medical history taking, lab tests, physical examinations and suggestion of a preliminary diagnosis. The primary aim of this study was to evaluate the potential of a VP as a possible tool for assessment of clinical reasoning and problem solving ability among medical students. The feeling of realism of the VP and its possible affective impact on the student's confidence were also investigated. We observed and analysed students' reactions, engagement and performance (activity log files) during their interactive sessions with the simulation. An individual human assistant was provided along with the computer simulation and the videotaped interaction student/assistant was then analysed in detail and related to the students' outcomes. The results indicate possible advantages of using ISP-like systems for assessment. The VP was for instance able to reliably differentiate between students' performances but some weaknesses were also identified, like a confounding influence on students' outcomes by the assistants used. Significant differences, affecting the results, were found between the students in their degree of affective response towards the system as well as the perceived usefulness of assistance. Students need to be trained beforehand in mastering the assessment tool. Rating compliance needs to be targeted before VP-based systems like ISP can be used in exams and if such systems would be used in high-stake exams, the use of human assistants should be limited and scoring rubrics validated (and preferably automated).

40 CFR 300.145 - Special teams and other assistance available to OSCs/RPMs.

Code of Federal Regulations, 2014 CFR

2014-07-01

... 40 Protection of Environment 28 2014-07-01 2014-07-01 false Special teams and other assistance... SUBSTANCES POLLUTION CONTINGENCY PLAN Responsibility and Organization for Response § 300.145 Special teams and other assistance available to OSCs/RPMs. (a) The NSF is a special team established by the USCG...

40 CFR 300.145 - Special teams and other assistance available to OSCs/RPMs.

Code of Federal Regulations, 2011 CFR

2011-07-01

... 40 Protection of Environment 28 2011-07-01 2011-07-01 false Special teams and other assistance... SUBSTANCES POLLUTION CONTINGENCY PLAN Responsibility and Organization for Response § 300.145 Special teams and other assistance available to OSCs/RPMs. (a) The NSF is a special team established by the USCG...

40 CFR 300.145 - Special teams and other assistance available to OSCs/RPMs.

Code of Federal Regulations, 2010 CFR

2010-07-01

... 40 Protection of Environment 27 2010-07-01 2010-07-01 false Special teams and other assistance... SUBSTANCES POLLUTION CONTINGENCY PLAN Responsibility and Organization for Response § 300.145 Special teams and other assistance available to OSCs/RPMs. (a) The NSF is a special team established by the USCG...

40 CFR 300.145 - Special teams and other assistance available to OSCs/RPMs.

Code of Federal Regulations, 2013 CFR

2013-07-01

... 40 Protection of Environment 29 2013-07-01 2013-07-01 false Special teams and other assistance... SUBSTANCES POLLUTION CONTINGENCY PLAN Responsibility and Organization for Response § 300.145 Special teams and other assistance available to OSCs/RPMs. (a) The NSF is a special team established by the USCG...

40 CFR 300.145 - Special teams and other assistance available to OSCs/RPMs.

Code of Federal Regulations, 2012 CFR

2012-07-01

... 40 Protection of Environment 29 2012-07-01 2012-07-01 false Special teams and other assistance... SUBSTANCES POLLUTION CONTINGENCY PLAN Responsibility and Organization for Response § 300.145 Special teams and other assistance available to OSCs/RPMs. (a) The NSF is a special team established by the USCG...

Correlation of ALDH1 and Notch3 Expression: Clinical implication in Ovarian Carcinomas.

PubMed

Kim, Mi Joung; Kim, A-Ram; Jeong, Ju-Yeon; Kim, Kwang-Il; Kim, Tae-Heon; Lee, Chan; Chung, Kwanghoe; Ko, Young-Hyeh; An, Hee-Jung

2017-01-01

Purpose : ALDH1 is a putative cancer stem cell marker, while the Notch signaling pathway is involved in regulation of cancer stem cell (CSC)s. This study aims to determine the expression of Notch signaling genes in ovarian CSCs, and to assess the clinical impact of expression of ALDH1 and Notch signaling genes in ovarian cancers. Methods : We examined expression of Notch signaling genes in FACS-sorted ALDH1(+) putative ovarian CSCs and expression of ALDH1 and Notch signaling genes in 86 ovarian epithelial tumors and various ovarian cancer cell lines by real-time RT-PCR, including Notch receptors ( Notch1-4 ), Notch ligands ( Jagged1 and Jagged2 ), and the downstream molecule, Hes1 . Furthermore, we correlated their expression with clinicopathological parameters and patient's survival in ovarian serous carcinoma (OSC)s, the most prevalent type of ovarian cancer. Results : The higher expression levels of ALDH1 and Notch related genes, especially Notch3 were associated with CSCs and with chemoresistant OSCs and paclitaxel-resistant SKpac ovarian cancer cells. Among the Notch signaling genes, high Notch3 expression was significantly associated with all the parameters of poor prognosis, i.e., advanced stage, lymph node and distant metastases, and chemoresistance, whereas other genes were less correlated with these parameters. A combined upregulation of ALDH1 and Notch3 was an independent poor prognostic factor in OSCs. Conclusions : ALDH1 correlates with Notch3 expression in ovarian carcinomas. ALDH1 and Notch3 overexpression is an independent poor prognostic indicator for worse patient's survival in this subset of OSCs.

Assessment Methods of an Undergraduate Psychiatry Course at a Saudi University

PubMed Central

Amr, Mostafa; Amin, Tarek

2012-01-01

Objectives: In Arab countries there are few studies on assessment methods in the field of psychiatry. The objective of this study was to assess the outcome of different forms of psychiatric course assessment among fifth year medical students at King Faisal University, Saudi Arabia. Methods: We examined the performance of 110 fifth-year medical students through objective structured clinical examinations (OSCE), traditional oral clinical examinations (TOCE), portfolios, multiple choice questions (MCQ), and a written examination. Results: The score ranges in TOCE, OSCE, portfolio, and MCQ were 32–50, 7–15, 5–10 and 22–45, respectively. In regression analysis, there was a significant correlation between OSCE and all forms of psychiatry examinations, except for the MCQ marks. OSCE accounted for 65.1% of the variance in total clinical marks and 31.5% of the final marks (P = 0.001), while TOCE alone accounted for 74.5% of the variance in the clinical scores. Conclusions: This study demonstrates a consistency among the students’ assessment methods used in the psychiatry course, particularly the clinical component, in an integrated manner. This information would be useful for future developments in undergraduate teaching. PMID:22548141

The Correlation between the Scores of Written Examination, the Clinical Clerkship Examination, the Clinical Skill Assessment, and the Graduation Examination of the Medical Students.

PubMed

Koh, Suk Bong; Park, Hye Jin

2009-12-01

The aim of this study was to investigate correlations between medical student scores on 4 examinations: the written examination, clinical clerkship examination, clinical skill assessment, and graduation examination. Scores for 51 students who entered Daegu Catholic Medical School in 2005 on the written examination, clinical clerkship examination, clinical skill assessment, and graduation examination were included. Correlations between the scores were analyzed statistically. The scores on the written examination showed a strong correlation with those of the clinical clerkship assessment (0.833) and graduation examination (0.821). The clinical clerkship assessment scores correlated significantly with graduation examination scores (0.907). In addition, clinical skill assessment scores correlated with the written examination (0.579), clinical clerkship examination (0.570), and graduation examination (0.465) scores. Overall, the correlation between the scores on the clinical clerkship examination and the written examination was more significant than the correlation between scores on the clinical clerkship examination and clinical skill assessment. Therefore, we need to improve the evaluation method for the clinical clerkship examination and clinical skill assessment.

The effect of student self-video of performance on clinical skill competency: a randomised controlled trial.

PubMed

Maloney, Stephen; Storr, Michael; Morgan, Prue; Ilic, Dragan

2013-03-01

Emerging technologies and student information technology literacy are enabling new methods of teaching and learning for clinical skill performance. Facilitating experiential practice and reflection on performance through student self-video, and exposure to peer benchmarks, may promote greater levels of skill competency. This study examines the impact of student self-video on the attainment of clinical skills. A total of 60 Physiotherapy students (100%) consented to participate in the randomised controlled trial. One group (50%) was taught a complex clinical skill with regular practical tutoring, whilst the other group (50%) supplemented the tutoring with a self-video task aimed at promoting reflection on performance. Student skill performance was measured in an objective structured clinical examination (OSCE). Students also completed an anonymous questionnaire, which explored their perception of their learning experiences. Students received significantly higher scores in the OSCE when the examined clinical skill had been supplemented with a self-video of performance task (P = 0.048). Descriptive analysis of the questionnaires relating to student perceptions on the teaching methods identified that the self-video of performance task utilised contributed to improvement in their clinical performance and their confidence for future clinical practice. Students identified a number of aspects of the submission process that contributed to this perception of educational value. The novel results of this study demonstrate that greater clinical skill competency is achieved when traditional tutoring methods are supplemented with student self-video of performance tasks. Additional benefits included the ability of staff and students to monitor longitudinal performance, and an increase in feedback opportunities.

Attachment styles and clinical communication performance in trainee doctors.

PubMed

Fletcher, Ian; McCallum, Rachel; Peters, Sarah

2016-11-01

To investigate the relationship between trainee doctors' attachment style and their performance in qualifying clinical and communication skills assessments. Participants were 190 undergraduate medical students whose performance was assessed by examiners across two areas (communication and clinical skills) during their qualifying Objective Structured Clinical Examination (OSCE). Simulated patients also rated communication skills. Participants' attachment style was rated across two dimensions, avoidance and anxiety, using the Relationship Questionnaire (RQ). Lower levels of attachment avoidance and anxiety significantly predicted higher performance in both communication and clinical skills. Trainee doctors' attachment styles are associated with patient communication and clinical performance. Further research is needed to investigate the impact of attachment on consultations between doctors and patients within clinical settings. Attachment theory can inform our understanding why, for some student doctors, interacting with patients may be particularly challenging and require additional support by medical educators. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.

Online examiner calibration across specialties.

PubMed

Sturman, Nancy; Wong, Wai Yee; Turner, Jane; Allan, Chris

2017-09-26

Integrating undergraduate medical curricula horizontally across clinical medical specialties may be a more patient-centred and learner-centred approach than rotating students through specialty-specific teaching and assessment, but requires some interspecialty calibration of examiner judgements. Our aim was to evaluate the acceptability and feasibility of an online pilot of interdisciplinary examiner calibration. Fair clinical assessment is important to both medical students and clinical teachers METHODS: Clinical teachers were invited to rate video-recorded student objective structured clinical examination (OSCE) performances and join subsequent online discussions using the university's learning management system. Post-project survey free-text and Likert-scale participant responses were analysed to evaluate the acceptability of the pilot and to identify recommendations for improvement. Although 68 clinicians were recruited to participate, and there were 1599 hits on recordings and discussion threads, only 25 clinical teachers rated at least one student performance, and 18 posted at least one comment. Participants, including rural doctors, appeared to value the opportunity for interdisciplinary rating calibration and discussion. Although the asynchronous online format had advantages, especially for rural doctors, participants reported considerable IT challenges. Our findings suggest that fair clinical assessment is important to both medical students and clinical teachers. Interspecialty discussions about assessment may have the potential to enrich intraspecialty perspectives, enhance interspecialty engagement and collaboration, and improve the quality of clinical teacher assessment. Better alignment of university and hospital systems, a face to face component and other modifications may have enhanced clinician engagement with this project. Findings suggest that specialty assessment cultures and content expertise may not be barriers to pursuing more integrated

One-Stop Clinic Utilization in Plastic Surgery: Our Local Experience and the Results of a UK-Wide National Survey.

PubMed

Gorman, Mark; Coelho, James; Gujral, Sameer; McKay, Alastair

2015-01-01

Introduction. "See and treat" one-stop clinics (OSCs) are an advocated NHS initiative to modernise care, reducing cancer treatment waiting times. Little studied in plastic surgery, the existing evidence suggests that though they improve care, they are rarely implemented. We present our experience setting up a plastic surgery OSC for minor skin surgery and survey their use across the UK. Methods. The OSC was evaluated by 18-week wait target compliance, measures of departmental capacity, and patient satisfaction. Data was obtained from 32 of the 47 UK plastic surgery departments to investigate the prevalence of OSCs for minor skin cancer surgery. Results. The OSC improved 18-week waiting times, from a noncompliant mean of 80% to a compliant 95% average. Department capacity increased 15%. 95% of patients were highly satisfied with and preferred the OSC to a conventional service. Only 25% of UK plastic surgery units run OSCs, offering varying reasons for not doing so, 42% having not considered their use. Conclusions. OSCs are underutilised within UK plastic surgery, where a significant proportion of units have not even considered their benefit. This is despite associated improvements in waiting times, department capacity, and levels of high patient satisfaction. We offer our considerations and local experience instituting an OSC service.

One-Stop Clinic Utilization in Plastic Surgery: Our Local Experience and the Results of a UK-Wide National Survey

PubMed Central

Gorman, Mark; Coelho, James; Gujral, Sameer; McKay, Alastair

2015-01-01

Introduction. “See and treat” one-stop clinics (OSCs) are an advocated NHS initiative to modernise care, reducing cancer treatment waiting times. Little studied in plastic surgery, the existing evidence suggests that though they improve care, they are rarely implemented. We present our experience setting up a plastic surgery OSC for minor skin surgery and survey their use across the UK. Methods. The OSC was evaluated by 18-week wait target compliance, measures of departmental capacity, and patient satisfaction. Data was obtained from 32 of the 47 UK plastic surgery departments to investigate the prevalence of OSCs for minor skin cancer surgery. Results. The OSC improved 18-week waiting times, from a noncompliant mean of 80% to a compliant 95% average. Department capacity increased 15%. 95% of patients were highly satisfied with and preferred the OSC to a conventional service. Only 25% of UK plastic surgery units run OSCs, offering varying reasons for not doing so, 42% having not considered their use. Conclusions. OSCs are underutilised within UK plastic surgery, where a significant proportion of units have not even considered their benefit. This is despite associated improvements in waiting times, department capacity, and levels of high patient satisfaction. We offer our considerations and local experience instituting an OSC service. PMID:26236502

Validity of three clinical performance assessments of internal medicine clerks.

PubMed

Hull, A L; Hodder, S; Berger, B; Ginsberg, D; Lindheim, N; Quan, J; Kleinhenz, M E

1995-06-01

To analyze the construct validity of three methods to assess the clinical performances of internal medicine clerks. A multitrait-multimethod (MTMM) study was conducted at the Case Western Reserve University School of Medicine to determine the convergent and divergent validity of a clinical evaluation form (CEF) completed by faculty and residents, an objective structured clinical examination (OSCE), and the medicine subject test of the National Board of Medical Examiners. Three traits were involved in the analysis: clinical skills, knowledge, and personal characteristics. A correlation matrix was computed for 410 third-year students who completed the clerkship between August 1988 and July 1991. There was a significant (p < .01) convergence of the four correlations that assessed the same traits by using different methods. However, the four convergent correlations were of moderate magnitude (ranging from .29 to .47). Divergent validity was assessed by comparing the magnitudes of the convergence correlations with the magnitudes of correlations among unrelated assessments (i.e., different traits by different methods). Seven of nine possible coefficients were smaller than the convergent coefficients, suggesting evidence of divergent validity. A significant CEF method effect was identified. There was convergent validity and some evidence of divergent validity with a significant method effect. The findings were similar for correlations corrected for attenuation. Four conclusions were reached: (1) the reliability of the OSCE must be improved, (2) the CEF ratings must be redesigned to further discriminate among the specific traits assessed, (3) additional methods to assess personal characteristics must be instituted, and (4) several assessment methods should be used to evaluate individual student performances.

Introduction of craniomaxillofacial surgery as a component of medical student training in general surgery.

PubMed

Schuebel, Florian; Höfer, Sebastian H; Rüsseler, Miriam; Walcher, Felix; Sader, Robert; Landes, Constantin

2014-11-01

This study provides an overview of the objective structured clinical examination (OSCE) in concept, determination of task difficulty, execution, and evaluation by students and examiners. During a 4-semester study period, 507 medical students completed a practical skills training (PST) course and subsequently participated in a 16-station OSCE, which contained 2 craniomaxillofacial surgical (CMS) stations covering the following key tasks: craniofacial examination and facial trauma fracture management. The students were rated using dedicated checklists. The students subjectively evaluated the PST and the OSCE using anonymous evaluation forms. Students rated the PST and OSCE as "very positive." The CMS OSCE stations were rated as having good task difficulty (74.05 ± 1.78% average task fulfilment for the examination and 74.45 ± 3.40% for the management station). With no changes to the examination station, no significant improvement of performance occurred over the entire investigation period (P = .787). In contrast, students improved slightly at the management station (P = .308). The CMS stations showed high selectivity and were representative in the overall context of the OSCE; improvement of selectivity increased from 0.259 ± 0.088 to 0.465 ± 0.109. CMS was successfully implemented in the general surgical training for medical students, with an initial PST and a final OSCE concordant with the literature. The CMS implementation effectively trained and fairly evaluated clinical skills. Although an OSCE consumes time and resources, this addition proved feasible and valuable, even with large numbers of students, and students expressed a high level of satisfaction with the training. Copyright © 2014 American Association of Oral and Maxillofacial Surgeons. Published by Elsevier Inc. All rights reserved.

Genetics objective structured clinical exams at the Maimonides Infants & Children's Hospital of Brooklyn, New York.

PubMed

Altshuler, Lisa; Kachur, Elizabeth; Krinshpun, Shifra; Sullivan, Deborah

2008-11-01

In 2003, the Maimonides Infants & Children's Hospital received a Title VII Residency Training in Primary Care grant to integrate genetic-specific competencies into postgraduate pediatrics education. As part of that endeavor, mandatory yearly genetics objective structured clinical exams (OSCEs) were instituted for third-year residents. This article reports on the first three years of experience with this innovative educational tool.After an overview of genetic concepts, dysmorphology, and communication styles, residents complete a five-station OSCE and receive feedback from standardized patients and from the faculty who observe them. After this clinical exercise, the residents participate in a small-group debriefing session to share strategies for effective communication and clinical case management and to discuss the ethical issues that arise with these genetic cases.In three years, 60 residents have completed the genetics OSCE program. Evaluation data demonstrate that the program has been effective in both introducing genetic-specific challenges and assessing residents' clinical skills. It has helped trainees self-identify both strengths and further training needs. Pre- and postsurveys among the trainees show increased comfort levels in performing 5 of 12 genetic-related clinical tasks.We conclude that genetics OSCEs are an enriching educational tool. Merely providing trainees and practicing physicians with the latest scientific information is unlikely to prepare them for counseling patients about complex genetic issues. Developing proficiency requires focused practice and effective feedback.This article is part of a theme issue of Academic Medicine on the Title VII health professions training programs.

Learning physical examination skills outside timetabled training sessions: what happens and why?

PubMed

Duvivier, Robbert J; van Geel, Koos; van Dalen, Jan; Scherpbier, Albert J J A; van der Vleuten, Cees P M

2012-08-01

Lack of published studies on students' practice behaviour of physical examination skills outside timetabled training sessions inspired this study into what activities medical students undertake to improve their skills and factors influencing this. Six focus groups of a total of 52 students from Years 1-3 using a pre-established interview guide. Interviews were recorded, transcribed and analyzed using qualitative methods. The interview guide was based on questionnaire results; overall response rate for Years 1-3 was 90% (n = 875). Students report a variety of activities to improve their physical examination skills. On average, students devote 20% of self-study time to skill training with Year 1 students practising significantly more than Year 3 students. Practice patterns shift from just-in-time learning to a longitudinal selfdirected approach. Factors influencing this change are assessment methods and simulated/real patients. Learning resources used include textbooks, examination guidelines, scientific articles, the Internet, videos/DVDs and scoring forms from previous OSCEs. Practising skills on fellow students happens at university rooms or at home. Also family and friends were mentioned to help. Simulated/real patients stimulated students to practise of physical examination skills, initially causing confusion and anxiety about skill performance but leading to increased feelings of competence. Difficult or enjoyable skills stimulate students to practise. The strategies students adopt to master physical examination skills outside timetabled training sessions are self-directed. OSCE assessment does have influence, but learning takes place also when there is no upcoming assessment. Simulated and real patients provide strong incentives to work on skills. Early patient contacts make students feel more prepared for clinical practice.

Using low-cost Android tablets and instructional videos to teach clinical skills to medical students in Kenya: a prospective study

PubMed Central

Ahn, Roy; Nelson, Brett D; Kagan, Calvin; Burke, Thomas F

2016-01-01

Objectives To assess the feasibility and impact of using a low-cost Android tablet to deliver clinical skills training to third-year medical students in Kenya. Design A prospective study using a low cost tablet called ‘connecTAB’, which was designed and manufactured specifically for areas with low bandwidth. Instructional video tutorials demonstrating techniques of cardiovascular and abdominal clinical examinations were pre-loaded onto the tablet. Setting Maseno University School of Medicine, Western Kenya. Participants Fifty-one third-year medical students from Maseno University School of Medicine were subjects in the study. Twenty-five students were assigned to the intervention group and 26 to the control group. Main outcome measures At the start of the study, students from both groups completed an Observed Structured Clinical Examination (OSCE) of the cardiovascular and abdominal evaluations. Students who were allocated to the intervention group then received the connecTAB, whereas students in the control group did not. After a period of three weeks, students from both groups completed a post-study OSCE for both the cardiovascular and abdominal evaluations. Results There were significantly higher improvements in the scores for both cardiovascular and abdominal examinations (p < 0.001) within the group who received the e-tablets as compared to the control group. Conclusion The study suggests that access to connecTAB improves clinical education and efficacy and holds promise for international training in both medical and allied healthcare professional spheres in resource-limited settings. PMID:27540487

Using low-cost Android tablets and instructional videos to teach clinical skills to medical students in Kenya: a prospective study.

PubMed

O'Donovan, James; Ahn, Roy; Nelson, Brett D; Kagan, Calvin; Burke, Thomas F

2016-08-01

To assess the feasibility and impact of using a low-cost Android tablet to deliver clinical skills training to third-year medical students in Kenya. A prospective study using a low cost tablet called 'connecTAB', which was designed and manufactured specifically for areas with low bandwidth. Instructional video tutorials demonstrating techniques of cardiovascular and abdominal clinical examinations were pre-loaded onto the tablet. Maseno University School of Medicine, Western Kenya. Fifty-one third-year medical students from Maseno University School of Medicine were subjects in the study. Twenty-five students were assigned to the intervention group and 26 to the control group. At the start of the study, students from both groups completed an Observed Structured Clinical Examination (OSCE) of the cardiovascular and abdominal evaluations. Students who were allocated to the intervention group then received the connecTAB, whereas students in the control group did not. After a period of three weeks, students from both groups completed a post-study OSCE for both the cardiovascular and abdominal evaluations. There were significantly higher improvements in the scores for both cardiovascular and abdominal examinations (p < 0.001) within the group who received the e-tablets as compared to the control group. The study suggests that access to connecTAB improves clinical education and efficacy and holds promise for international training in both medical and allied healthcare professional spheres in resource-limited settings.

Assessment of current undergraduate anesthesia course in a Saudi University.

PubMed

Shams, Tarek; El-Masry, Ragaa; Al Wadani, Hamed; Amr, Mostafa

2013-04-01

The assessment of the anesthesia course in our university comprises Objective Structured Clinical Examinations (OSCEs), in conjunction with portfolio and multiple-choice questions (MCQ). The objective of this study was to evaluate the outcome of different forms of anesthesia course assessment among 5(th) year medical students in our university, as well as study the influence of gender on student performance in anesthesia. We examined the performance of 154, 5(th) year medical students through OSCE, portfolios, and MCQ. The score ranges in the portfolio, OSCE, and MCQs were 16-24, 4.2-28.9, and 15.5-44.5, respectively. There was highly significant difference in scores in relation to gender in all assessments other than the written one (P=0.000 for Portfolio, OSCE, and Total exam, whereas P=0.164 for written exam). In the generated linear regression model, OSCE alone could predict 86.4% of the total mark if used alone. In addition, if the score of the written examination is added, OSCE will drop to 57.2% and the written exam will be 56.8% of the total mark. This study demonstrates that different clinical methods used to assess medical students during their anesthesia course were consistent and integrated. The performance of female was superior to male in OSCE and portfolio. This information is the basis for improving educational and assessment standards in anesthesiology and for introducing a platform for developing modern learning media in countries with dearth of anesthesia personnel.

Can physician examiners overcome their first impression when examinee performance changes?

PubMed

Wood, Timothy J; Pugh, Debra; Touchie, Claire; Chan, James; Humphrey-Murto, Susan

2018-03-20

There is an increasing focus on factors that influence the variability of rater-based judgments. First impressions are one such factor. First impressions are judgments about people that are made quickly and are based on little information. Under some circumstances, these judgments can be predictive of subsequent decisions. A concern for both examinees and test administrators is whether the relationship remains stable when the performance of the examinee changes. That is, once a first impression is formed, to what degree will an examiner be willing to modify it? The purpose of this study is to determine the degree that first impressions influence final ratings when the performance of examinees changes within the context of an objective structured clinical examination (OSCE). Physician examiners (n = 29) viewed seven videos of examinees (i.e., actors) performing a physical exam on a single OSCE station. They rated the examinees' clinical abilities on a six-point global rating scale after 60 s (first impression or FIGR). They then observed the examinee for the remainder of the station and provided a final global rating (GRS). For three of the videos, the examinees' performance remained consistent throughout the videos. For two videos, examinee performance changed from initially strong to weak and for two videos, performance changed from initially weak to strong. The mean FIGR rating for the Consistent condition (M = 4.80) and the Strong to Weak condition (M = 4.87) were higher compared to their respective GRS ratings (M = 3.93, M = 2.73) with a greater decline for the Strong to Weak condition. The mean FIGR rating for the Weak to Strong condition was lower (3.60) than the corresponding mean GRS (4.81). This pattern of findings suggests that raters were willing to change their judgments based on examinee performance. Future work should explore the impact of making a first impression judgment explicit versus implicit and the role of context on the

Assessment of current undergraduate anesthesia course in a Saudi University

PubMed Central

Shams, Tarek; El-Masry, Ragaa; al Wadani, Hamed; Amr, Mostafa

2013-01-01

Background: The assessment of the anesthesia course in our university comprises Objective Structured Clinical Examinations (OSCEs), in conjunction with portfolio and multiple-choice questions (MCQ). The objective of this study was to evaluate the outcome of different forms of anesthesia course assessment among 5th year medical students in our university, as well as study the influence of gender on student performance in anesthesia. Methods: We examined the performance of 154, 5th year medical students through OSCE, portfolios, and MCQ. Results: The score ranges in the portfolio, OSCE, and MCQs were 16-24, 4.2-28.9, and 15.5-44.5, respectively. There was highly significant difference in scores in relation to gender in all assessments other than the written one (P=0.000 for Portfolio, OSCE, and Total exam, whereas P=0.164 for written exam). In the generated linear regression model, OSCE alone could predict 86.4% of the total mark if used alone. In addition, if the score of the written examination is added, OSCE will drop to 57.2% and the written exam will be 56.8% of the total mark. Conclusions: This study demonstrates that different clinical methods used to assess medical students during their anesthesia course were consistent and integrated. The performance of female was superior to male in OSCE and portfolio. This information is the basis for improving educational and assessment standards in anesthesiology and for introducing a platform for developing modern learning media in countries with dearth of anesthesia personnel. PMID:23956708

Effects of ray profile modeling on resolution recovery in clinical CT

DOE Office of Scientific and Technical Information (OSTI.GOV)

Hofmann, Christian; Knaup, Michael; Kachelrieß, Marc, E-mail: marc.kachelriess@dkfz-heidelberg.de

2014-02-15

Purpose: Iterative image reconstruction gains more and more interest in clinical routine, as it promises to reduce image noise (and thereby patient dose), to reduce artifacts, or to improve spatial resolution. However, among vendors and researchers, there is no consensus of how to best achieve these goals. The authors are focusing on the aspect of geometric ray profile modeling, which is realized by some algorithms, while others model the ray as a straight line. The authors incorporate ray-modeling (RM) in nonregularized iterative reconstruction. That means, instead of using one simple single needle beam to represent the x-ray, the authors evaluatemore » the double integral of attenuation path length over the finite source distribution and the finite detector element size in the numerical forward projection. Our investigations aim at analyzing the resolution recovery (RR) effects of RM. Resolution recovery means that frequencies can be recovered beyond the resolution limit of the imaging system. In order to evaluate, whether clinical CT images can benefit from modeling the geometrical properties of each x-ray, the authors performed a 2D simulation study of a clinical CT fan-beam geometry that includes the precise modeling of these geometrical properties. Methods: All simulations and reconstructions are performed in native fan-beam geometry. A water phantom with resolution bar patterns and a Forbild thorax phantom with circular resolution patterns representing calcifications in the heart region are simulated. An FBP reconstruction with a Ram–Lak kernel is used as a reference reconstruction. The FBP is compared to iterative reconstruction techniques with and without RM: An ordered subsets convex (OSC) algorithm without any RM (OSC), an OSC where the forward projection is modeled concerning the finite focal spot and detector size (OSC-RM) and an OSC with RM and with a matched forward and backprojection pair (OSC-T-RM, T for transpose). In all cases, noise was

Patterns of nucleotide diversity and phenotypes of two domestication related genes (OsC1 and Wx) in indigenous rice varieties in Northeast India

PubMed Central

2014-01-01

Background During the domestication of crops, individual plants with traits desirable for human needs have been selected from their wild progenitors. Consequently, genetic and nucleotide diversity of genes associated with these selected traits in crop plants are expected to be lower than their wild progenitors. In the present study, we surveyed the pattern of nucleotide diversity of two selected trait specific genes, Wx and OsC1, which regulate amylose content and apiculus coloration respectively in cultivated rice varieties. The analyzed samples were collected from a wide geographic area in Northeast (NE) India, and included contrasting phenotypes considered to be associated with selected genes, namely glutinous and nonglutinous grains and colored and colorless apiculus. Results No statistically significant selection signatures were detected in both Wx and OsC1gene sequences. However, low level of selection that varied across the length of each gene was evident. The glutinous type varieties showed higher levels of nucleotide diversity at the Wx locus (πtot = 0.0053) than nonglutinous type varieties (πtot = 0.0043). The OsC1 gene revealed low levels of selection among the colorless apiculus varieties with lower nucleotide diversity (πtot = 0.0010) than in the colored apiculus varieties (πtot = 0.0023). Conclusions The results revealed that functional mutations at Wx and OsC1genes considered to be associated with specific phenotypes do not necessarily correspond to the phenotypes in indigenous rice varieties in NE India. This suggests that other than previously reported genomic regions may also be involved in determination of these phenotypes. PMID:24935343

An objective structured clinical exam to measure intrinsic CanMEDS roles.

PubMed

Kassam, Aliya; Cowan, Michèle; Donnon, Tyrone

2016-01-01

Background The CanMEDS roles provide a comprehensive framework to organize competency-based curricula; however, there is a challenge in finding feasible, valid, and reliable assessment methods to measure intrinsic roles such as Communicator and Collaborator. The objective structured clinical exam (OSCE) is more commonly used in postgraduate medical education for the assessment of clinical skills beyond medical expertise. Method We developed the CanMEDS In-Training Exam (CITE), a six-station OSCE designed to assess two different CanMEDS roles (one primary and one secondary) and general communication skills at each station. Correlation coefficients were computed for CanMEDS roles within and between stations, and for general communication, global rating, and total scores. One-way analysis of variance (ANOVA) was used to investigate differences between year of residency, sex, and the type of residency program. Results In total, 63 residents participated in the CITE; 40 residents (63%) were from internal medicine programs, whereas the remaining 23 (37%) were pursuing other specialties. There was satisfactory internal consistency for all stations, and the total scores of the stations were strongly correlated with the global scores r=0.86, p<0.05. Noninternal medicine residents scored higher in terms of the Professional competency overall, whereas internal medicine residents scored significantly higher in the Collaborator competency overall. Discussion The OSCE checklists developed for the assessment of intrinsic CanMEDS roles were functional, but the specific items within stations required more uniformity to be used between stations. More generic types of checklists may also improve correlations across stations. Conclusion An OSCE measuring intrinsic competence is feasible; however, further development of our cases and checklists is needed. We provide a model of how to develop an OSCE to measure intrinsic CanMEDS roles that educators may adopt as residency programs move

Communication Skills in Standardized-Patient Assessment of Final-Year Medical Students: A Psychometric Study

ERIC Educational Resources Information Center

Guiton, Gretchen; Hodgson, Carol S.; Delandshere, Ginett; Wilkerson, Luann

2004-01-01

The purpose of this study is to investigate the content-specificity of communication skills. It investigates the reliability and dimensionality of standardized patient (SP) ratings of communication skills in an Objective Structured Clinical Examination(OSCE) for final year medical students. An OSCE consisting of seven standardized patient(SP)…

An Optometric Clinical Practicum Examination Model.

ERIC Educational Resources Information Center

Eskridge, Jess B.

1979-01-01

A practical clinical examination model for use by state board examiners in optometry is described including purpose, format, examination design, procedures, evaluation examples and administration. (JMF)

Does a Rater's Professional Background Influence Communication Skills Assessment?

PubMed

Artemiou, Elpida; Hecker, Kent G; Adams, Cindy L; Coe, Jason B

2015-01-01

There is increasing pressure in veterinary education to teach and assess communication skills, with the Objective Structured Clinical Examination (OSCE) being the most common assessment method. Previous research reveals that raters are a large source of variance in OSCEs. This study focused on examining the effect of raters' professional background as a source of variance when assessing students' communication skills. Twenty-three raters were categorized according to their professional background: clinical sciences (n=11), basic sciences (n=4), clinical communication (n=5), or hospital administrator/clinical skills technicians (n=3). Raters from each professional background were assigned to the same station and assessed the same students during two four-station OSCEs. Students were in year 2 of their pre-clinical program. Repeated-measures ANOVA results showed that OSCE scores awarded by the rater groups differed significantly: (F(matched_station_1) [2,91]=6.97, p=.002), (F(matched_station_2) [3,90]=13.95, p=.001), (F(matched_station_3) [3,90]=8.76, p=.001), and ((Fmatched_station_4) [2,91]=30.60, p=.001). A significant time effect between the two OSCEs was calculated for matched stations 1, 2, and 4, indicating improved student performances. Raters with a clinical communication skills background assigned scores that were significantly lower compared to the other rater groups. Analysis of written feedback provided by the clinical sciences raters showed that they were influenced by the students' clinical knowledge of the case and that they did not rely solely on the communication checklist items. This study shows that it is important to consider rater background both in recruitment and training programs for communication skills' assessment.

Comparison of computer-assisted instruction (CAI) versus traditional textbook methods for training in abdominal examination (Japanese experience).

PubMed

Qayumi, A K; Kurihara, Y; Imai, M; Pachev, G; Seo, H; Hoshino, Y; Cheifetz, R; Matsuura, K; Momoi, M; Saleem, M; Lara-Guerra, H; Miki, Y; Kariya, Y

2004-10-01

This study aimed to compare the effects of computer-assisted, text-based and computer-and-text learning conditions on the performances of 3 groups of medical students in the pre-clinical years of their programme, taking into account their academic achievement to date. A fourth group of students served as a control (no-study) group. Participants were recruited from the pre-clinical years of the training programmes in 2 medical schools in Japan, Jichi Medical School near Tokyo and Kochi Medical School near Osaka. Participants were randomly assigned to 4 learning conditions and tested before and after the study on their knowledge of and skill in performing an abdominal examination, in a multiple-choice test and an objective structured clinical examination (OSCE), respectively. Information about performance in the programme was collected from school records and students were classified as average, good or excellent. Student and faculty evaluations of their experience in the study were explored by means of a short evaluation survey. Compared to the control group, all 3 study groups exhibited significant gains in performance on knowledge and performance measures. For the knowledge measure, the gains of the computer-assisted and computer-assisted plus text-based learning groups were significantly greater than the gains of the text-based learning group. The performances of the 3 groups did not differ on the OSCE measure. Analyses of gains by performance level revealed that high achieving students' learning was independent of study method. Lower achieving students performed better after using computer-based learning methods. The results suggest that computer-assisted learning methods will be of greater help to students who do not find the traditional methods effective. Explorations of the factors behind this are a matter for future research.

Sustained impact of a short small group course with systematic feedback in addition to regular clinical clerkship activities on musculoskeletal examination skills--a controlled study.

PubMed

Perrig, Martin; Berendonk, Christoph; Rogausch, Anja; Beyeler, Christine

2016-01-28

The discrepancy between the extensive impact of musculoskeletal complaints and the common deficiencies in musculoskeletal examination skills lead to increased emphasis on structured teaching and assessment. However, studies of single interventions are scarce and little is known about the time-dependent effect of assisted learning in addition to a standard curriculum. We therefore evaluated the immediate and long-term impact of a small group course on musculoskeletal examination skills. All 48 Year 4 medical students of a 6 year curriculum, attending their 8 week clerkship of internal medicine at one University department in Berne, participated in this controlled study. Twenty-seven students were assigned to the intervention of a 6×1 h practical course (4-7 students, interactive hands-on examination of real patients; systematic, detailed feedback to each student by teacher, peers and patients). Twenty-one students took part in the regular clerkship activities only and served as controls. In all students clinical skills (CS, 9 items) were assessed in an Objective Structured Clinical Examination (OSCE) station, including specific musculoskeletal examination skills (MSES, 7 items) and interpersonal skills (IPS, 2 items). Two raters assessed the skills on a 4-point Likert scale at the beginning (T0), the end (T1) and 4-12 months after (T2) the clerkship. Statistical analyses included Friedman test, Wilcoxon rank sum test and Mann-Whitney U test. At T0 there were no significant differences between the intervention and control group. At T1 and T2 the control group showed no significant changes of CS, MSES and IPS compared to T0. In contrast, the intervention group significantly improved CS, MSES and IPS at T1 (p < 0.001). This enhancement was sustained for CS and MSES (p < 0.05), but not for IPS at T2. Year 4 medical students were incapable of improving their musculoskeletal examination skills during regular clinical clerkship activities. However, an additional

Advances in clinical pharmacy education in Germany: a quasi-experimental single-blinded study to evaluate a patient-centred clinical pharmacy course in psychiatry.

PubMed

Dircks, Monika; Mayr, Andreas; Freidank, Annette; Kornhuber, Johannes; Dörje, Frank; Friedland, Kristina

2017-12-12

The pharmacy profession has shifted towards patient-centred care. To meet the new challenges it is necessary to provide students with clinical competencies. A quasi-experimental single-blinded teaching and learning study was carried out using a parallel-group design to evaluate systematically the benefits of clinical teaching in pharmacy education in Germany. A clinical pharmacy course on a psychiatric ward was developed and implemented for small student groups. The learning aims included: the improvement of patient and interdisciplinary communication skills and the identification and management of pharmaceutical care issues. The control group participated only in the preparation lecture, while the intervention group took part in the complete course. The effects were assessed by an objective structured clinical examination (OSCE) and a student satisfaction survey. The intervention group achieved significantly better overall results on the OSCE assessment (46.20 ± 10.01 vs. 26.58 ± 12.91 of a maximum of 90 points; p < 0.0001).The practical tasks had the greatest effect, as reflected in the outcomes of tasks 1-5 (34.94 ± 9.60 vs. 18.63 ± 10.24 of a maximum of 60 points; p < 0.0001). Students' performance on the theoretical tasks (tasks 6-10) was improved but unsatisfying in both groups considering the maximum score (11.50 ± 4.75 vs. 7.50 ± 4.00 of a maximum of 30 points; p < 0.0001). Of the students, 93% rated the course as practice-orientated, and 90% felt better prepared for patient contact. Many students suggested a permanent implementation and an extension of the course. The results suggest that the developed ward-based course provided learning benefits for clinical skills. Students' perception of the course was positive. Implementation into the regular clinical pharmacy curriculum is therefore advisable.

Student perceptions of a video-based blended learning approach for improving pediatric physical examination skills.

PubMed

Lehmann, Ronny; Seitz, Anke; Bosse, Hans Martin; Lutz, Thomas; Huwendiek, Sören

2016-11-01

Physical examination skills are crucial for a medical doctor. The physical examination of children differs significantly from that of adults. Students often have only limited contact with pediatric patients to practice these skills. In order to improve the acquisition of pediatric physical examination skills during bedside teaching, we have developed a combined video-based training concept, subsequently evaluating its use and perception. Fifteen videos were compiled, demonstrating defined physical examination sequences in children of different ages. Students were encouraged to use these videos as preparation for bedside teaching during their pediatric clerkship. After bedside teaching, acceptance of this approach was evaluated using a 10-item survey, asking for the frequency of video use and the benefits to learning, self-confidence, and preparation of bedside teaching as well as the concluding OSCE. N=175 out of 299 students returned survey forms (58.5%). Students most frequently used videos, either illustrating complete examination sequences or corresponding focus examinations frequently assessed in the OSCE. Students perceived the videos as a helpful method of conveying the practical process and preparation for bedside teaching as well as the OSCE, and altogether considered them a worthwhile learning experience. Self-confidence at bedside teaching was enhanced by preparation with the videos. The demonstration of a defined standardized procedural sequence, explanatory comments, and demonstration of infrequent procedures and findings were perceived as particularly supportive. Long video segments, poor alignment with other curricular learning activities, and technical problems were perceived as less helpful. Students prefer an optional individual use of the videos, with easy technical access, thoughtful combination with the bedside teaching, and consecutive standardized practice of demonstrated procedures. Preparation with instructional videos combined with bedside

Using Simulation in Assessment and Teaching: OSCE Adapted for Social Work

ERIC Educational Resources Information Center

Bogo, Marion; Rawlings, Mary; Katz, Ellen; Logie, Carmen

2014-01-01

This detailed book by the most experienced authors in the field describes how to develop and implement the objective structured clinical examination (OSCE) for social work education. In addition to a wealth of practical material in the appendices, two videos produced especially for this book (accessible online) show the OSCE process step-by-step.…

Improved OSC Amtec generator design to meet goals of JPL's candidate Europa Orbiter mission

DOE Office of Scientific and Technical Information (OSTI.GOV)

Schock, A.; Noravian, H.; Or, C.

1998-07-01

The preceding paper (Paper IECEC.98.244) described OSC's initial designs of AMTEC (Alkali Metal Thermal-to-Electrical Conversion) power systems, consisting of one or two generators, each with 2, 3, or 4 General Purpose Heat Source (GPHS) modules and with 16 refractory AMTEC cells containing 5 Beta Alumina Solid Electrolyte (BASE) tubes; and presented the effect of heat input and voltage output on the generator's BOM evaporator and clad temperatures and on its EOM system efficiency and power output. Comparison of the computed results with JPL's goals for the Europa Orbiter mission showed that all of the initial 16-cell design options yielded eithermore » excessive evaporator and clad temperatures or insufficient EOM power to satisfy the JPL-specified mission goals. The present paper describes modified OSC generator designs with different numbers of AMTEC cells, cell diameters, cell lengths, cell materials, BASE tube lengths, and number of tubes per cell. These efforts succeeded in identifying generator designs with only half the number of AMTEC cells which -- for the same assumptions -- can produce EOM power outputs substantially in excess of JPL's goals for NASA's Europa Orbiter mission while operating well below the prescribed BOM limits on evaporator and clad temperature; and revealed that lowering the emissivity of the generator's housing to raise the cells' condenser temperatures can achieve substantial additional performance improvement. Finally, the paper culminates in programmatic recommendations.« less

[Current teaching, learning and examination methods in medical education and potential applications in rehabilitative issues].

PubMed

Schwarzkopf, S R; Morfeld, M; Gülich, M; Lay, W; Horn, K; Mau, W

2007-04-01

With introduction of the new Federal Medical Licensing Regulations (Approbationsordnung) in Germany, integrated teaching in "Rehabilitation, Physical Medicine, Naturopathic Treatment" (Querschnittsbereich Q12) has become obligatory for the first time. Furthermore, the new Regulations require the medical faculties in Germany to realize an innovative didactic orientation in teaching. This paper provides an overview of recent applications of teaching techniques and examination methods in medical education with special consideration of the new integrated course Q12 and further teaching methods related to rehabilitative issues. Problem-oriented learning (POL), problem-based learning (PBL), bedside teaching, eLearning, and the examination methods Objective Structured Clinical Examination (OSCE) and Triple Jump are in the focus. This overview is intended as the basis for subsequent publications of the Commission for Undergraduate and Postgraduate Training of the German Society of Rehabilitation Science (DGRW), which will present examples of innovative teaching material.

Outcomes of Individualized Formative Assessments in a Pharmacy Skills Laboratory.

PubMed

Gums, Tyler Harris; Kleppinger, Erika L; Urick, Benjamin Y

2014-11-15

To determine the effectiveness of an individualized teaching method in a pharmacy skills laboratory. All third-year students enrolled in an Accreditation Council for Pharmacy Education (ACPE) accredited doctor of pharmacy program (n=150) received an individual formative assessment from clinical pharmacists on communication skills and clinical competency after the students counseled standardized mock glaucoma patients during a laboratory focused on alternative dosing formulations. Objective structured clinical examination (OSCE) scores for this station from the 2012 and 2013 classes were compared before and after the intervention. Ophthalmic OSCE station scores were higher after the individual formative feedback intervention. Students in 2013 had a mean score of 83.2 ± 8.3% compared to a mean of 74.3 ± 12.9% in 2012 for this OSCE station. The percentage of students receiving an "A" on the OSCE station increased from 8.1% to 31.3% after the intervention. Individualized formative teaching methods benefited students in both their communication skills and clinical assessment. Future research should focus on wider implementation and overcoming obstacles, such as increased facilitator needs.

Clinical versus ultrasound examination of the thyroid gland in common clinical practice.

PubMed

Brander, A; Viikinkoski, P; Tuuhea, J; Voutilainen, L; Kivisaari, L

1992-01-01

In a prospective series of 72 patients, clinical and ultrasonographic examination of the thyroid gland were compared in detail. Normal-sized lobes were differentiated from enlarged ones both by inspection and by palpation. When lobar size was assessed by palpation, the estimate was most clearly influenced by increase in width. The correlation between two examiners in lobe size assessment was significant. In the classification of thyroid disease as diffuse, solitary, or multinodular, clinical examination and ultrasonography correlated significantly. However, only one third of the clinically solitary nodules proved to be solitary by ultrasound examination. Of 77 separate nodules, 43 escaped detection on clinical examination. Of these 43, 14 nodules exceeded 2 cm in diameter. It is concluded that the use of ultrasonography frequently alters the primary evaluation of thyroid nodularity based on palpation.

Assessment of first-year post-graduate residents: usefulness of multiple tools.

PubMed

Yang, Ying-Ying; Lee, Fa-Yauh; Hsu, Hui-Chi; Huang, Chin-Chou; Chen, Jaw-Wen; Cheng, Hao-Min; Lee, Wen-Shin; Chuang, Chiao-Lin; Chang, Ching-Chih; Huang, Chia-Chang

2011-12-01

Objective Structural Clinical Examination (OSCE) usually needs a large number of stations with long test time, which usually exceeds the resources available in a medical center. We aimed to determine the reliability of a combination of Direct Observation of Procedural Skills (DOPS), Internal Medicine in-Training Examination (IM-ITE(®)) and OSCE, and to verify the correlation between the small-scale OSCE+DOPS+IM-ITE(®)-composited scores and 360-degree evaluation scores of first year post-graduate (PGY(1)) residents. Between 2007 January to 2010 January, two hundred and nine internal medicine PGY1 residents completed DOPS, IM-ITE(®) and small-scale OSCE at our hospital. Faculty members completed 12-item 360-degree evaluation for each of the PGY(1) residents regularly. The small-scale OSCE scores correlated well with the 360-degree evaluation scores (r = 0.37, p < 0.021). Interestingly, the addition of DOPS scores to small-scale OSCE scores [small-scale OSCE+DOPS-composited scores] increased it's correlation with 360-degree evaluation scores of PGY(1) residents (r = 0.72, p < 0.036). Further, combination of IM-ITE(®) score with small-scale OSCE+DOPS scores [small-scale OSCE+DOPS+IM-ITE(®)-composited scores] markedly enhanced their correlation with 360-degree evaluation scores (r = 0.85, p < 0.016). The strong correlations between 360-degree evaluation and small-scale OSCE+DOPS+IM-ITE(®)-composited scores suggested that both methods were measuring the same quality. Our results showed that the small-scale OSCE, when associated with both the DOPS and IM-ITE(®), could be an important assessment method for PGY(1) residents. Copyright © 2011. Published by Elsevier B.V.

Respiratory modulation of oscillometric cuff pressure pulses and Korotkoff sounds during clinical blood pressure measurement in healthy adults.

PubMed

Chen, Diliang; Chen, Fei; Murray, Alan; Zheng, Dingchang

2016-05-10

Accurate blood pressure (BP) measurement depends on the reliability of oscillometric cuff pressure pulses (OscP) and Korotkoff sounds (KorS) for automated oscillometric and manual techniques. It has been widely accepted that respiration is one of the main factors affecting BP measurement. However, little is known about how respiration affects the signals from which BP measurement is obtained. The aim was to quantify the modulation effect of respiration on oscillometric pulses and KorS during clinical BP measurement. Systolic and diastolic BPs were measured manually from 40 healthy subjects (from 23 to 65 years old) under normal and regular deep breathing. The following signals were digitally recorded during linear cuff deflation: chest motion from a magnetometer to obtain reference respiration, cuff pressure from an electronic pressure sensor to derive OscP, and KorS from a digital stethoscope. The effects of respiration on both OscP and KorS were determined from changes in their amplitude associated with respiration between systole and diastole. These changes were normalized to the mean signal amplitude of OscP and KorS to derive the respiratory modulation depth. Reference respiration frequency, and the frequencies derived from the amplitude modulation of OscP and KorS were also calculated and compared. Respiratory modulation depth was 14 and 40 % for OscP and KorS respectively under normal breathing condition, with significant increases (both p < 0.05) to 16 and 49 % with deeper breathing. There was no statistically significant difference between the reference respiration frequency and those derived from the oscillometric and Korotkoff signals (both p > 0.05) during deep breathing, and for the oscillometric signal during normal breathing (p > 0.05). Our study confirmed and quantified the respiratory modulation effect on the oscillometric pulses and KorS during clinical BP measurement, with increased modulation depth under regular deeper breathing.

An exploratory trial exploring the use of a multiple intelligences teaching approach (MITA) for teaching clinical skills to first year undergraduate nursing students.

PubMed

Sheahan, Linda; While, Alison; Bloomfield, Jacqueline

2015-12-01

The teaching and learning of clinical skills is a key component of nurse education programmes. The clinical competency of pre-registration nursing students has raised questions about the proficiency of teaching strategies for clinical skill acquisition within pre-registration education. This study aimed to test the effectiveness of teaching clinical skills using a multiple intelligences teaching approach (MITA) compared with the conventional teaching approach. A randomised controlled trial was conducted. Participants were randomly allocated to an experimental group (MITA intervention) (n=46) and a control group (conventional teaching) (n=44) to learn clinical skills. Setting was in one Irish third-level educational institution. Participants were all first year nursing students (n=90) in one institution. The experimental group was taught using MITA delivered by the researcher while the control group was taught by a team of six experienced lecturers. Participant preference for learning was measured by the Index of Learning Styles (ILS). Participants' multiple intelligence (MI) preferences were measured with a multiple intelligences development assessment scale (MIDAS). All participants were assessed using the same objective structured clinical examination (OSCE) at the end of semester one and semester two. MI assessment preferences were measured by a multiple intelligences assessment preferences questionnaire. The MITA intervention was evaluated using a questionnaire. The strongest preference on ILS for both groups was the sensing style. The highest MI was interpersonal intelligence. Participants in the experimental group had higher scores in all three OSCEs (p<0.05) at Time 1, suggesting that MITA had a positive effect on clinical skill acquisition. Most participants favoured practical examinations, followed by multiple choice questions as methods of assessment. MITA was evaluated positively. The study findings support the use of MITA for clinical skills teaching

Performance in physical examination on the USMLE Step 2 Clinical Skills examination.

PubMed

Peitzman, Steven J; Cuddy, Monica M

2015-02-01

To provide descriptive information about history-taking (HX) and physical examination (PE) performance for U.S. medical students as documented by standardized patients (SPs) during the Step 2 Clinical Skills (CS) component of the United States Medical Licensing Examination. The authors examined two hypotheses: (1) Students perform worse in PE compared with HX, and (2) for PE, students perform worse in the musculoskeletal system and neurology compared with other clinical domains. The sample included 121,767 student-SP encounters based on 29,442 examinees from U.S. medical schools who took Step 2 CS for the first time in 2011. The encounters comprised 107 clinical presentations, each categorized into one of five clinical domains: cardiovascular, gastrointestinal, musculoskeletal, neurological, and respiratory. The authors compared mean percent-correct scores for HX and PE via a one-tailed paired-samples t test and examined mean score differences by clinical domain using analysis of variance techniques. Average PE scores (59.6%) were significantly lower than average HX scores (78.1%). The range of scores for PE (51.4%-72.7%) was larger than for HX (74.4%-81.0%), and the standard deviation for PE scores (28.3) was twice as large as the HX standard deviation (14.7). PE performance was significantly weaker for musculoskeletal and neurological encounters compared with other encounters. U.S. medical students perform worse on PE than HX; PE performance was weakest in musculoskeletal and neurology clinical domains. Findings may reflect imbalances in U.S. medical education, but more research is needed to fully understand the relationships among PE instruction, assessment, and proficiency.

Peer-assisted learning model enhances clinical clerk's procedural skills.

PubMed

Huang, Chia-Chang; Hsu, Hui-Chi; Yang, Ling-Yu; Chen, Chen-Huan; Yang, Ying-Ying; Chang, Ching-Chih; Chuang, Chiao-Lin; Lee, Wei-Shin; Lee, Fa-Yauh; Hwang, Shinn-Jang

2018-05-17

Failure to transfer procedural skills learned in a laboratory to the bedside is commonly due to a lack of peer support/stimulation. A digital platform (Facebook) allows new clinical clerks to share experiences and tips that help augment their procedural skills in a peer-assisted learning/teaching method. This study aims to investigate the effectiveness of the innovation of using the digital platform to support the transfer of laboratory-trained procedural skills in the clinical units. Volunteer clinical clerks (n = 44) were enrolled into the peer-assisted learning (PAL) group, which was characterized by the peer-assisted learning of procedural skills during their final 3-month clinical clerkship block. Other clerks (n = 51) did not join the procedural skills-specific Facebook group and served as the self-directed learning regular group. The participants in both the PAL and regular groups completed pre- and post-intervention self-assessments for general self-assessed efficiency ratings (GSER) and skills specific self-assessed efficiency ratings (SSSER) for performing vein puncture, intravenous (IV) catheter and nasogastric (NG) tube insertion. Finally, all clerks received the post-intervention 3-station Objective Structured Clinical Skills Examination (OSCE) to test their proficiency for the abovementioned three procedural skills. Higher cumulative numbers of vein punctures, IV catheter insertions and NG tube insertions at the bedside were carried out by the PAL group than the regular group. A greater improvement in GSERs and SSSERs for medical procedures was found in the PAL group than in the regular group. The PAL group obtained higher procedural skills scores in the post-intervention OSCEs than the regular group. Our study suggested that the implementation of a procedural skill-specific digital platform effectively helps clerks to transfer laboratory-trained procedural skills into the clinical units. In comparison with the regular self-directed learning

Clinical skills development in student-run free clinic volunteers: a multi-trait, multi-measure study.

PubMed

Nakamura, Mio; Altshuler, David; Chadwell, Margit; Binienda, Juliann

2014-12-12

At Wayne State University School of Medicine (WSU SOM), the Robert R. Frank Student Run Free Clinic (SRFC) is one place preclinical students can gain clinical experience. There have been no published studies to date measuring the impact of student-run free clinic (SRFC) volunteerism on clinical skills development in preclinical medical students. Surveys were given to first year medical students at WSU SOM at the beginning and end of Year 1 to assess perception of clinical skills, including self-confidence, self-reflection, and professionalism. Scores of the Year 1 Objective Structured Clinical Exam (OSCE) were compared between SRFC volunteers and non-volunteers. There were a total of 206 (68.2%) and 80 (26.5%) survey responses at the beginning and end of Year 1, respectively. Of the 80 students, 31 (38.7%) volunteered at SRFC during Year 1. Statistically significant differences were found between time points in self-confidence (p < 0.001) in both groups. When looking at self-confidence in skills pertaining to SRFC, the difference between groups was statistically significant (p = 0.032) at both time points. A total of 302 students participated in the Year 1 OSCE, 27 (9%) of which were SRFC volunteers. No statistically significant differences were found between groups for mean score (p = 0.888) and established level of rapport (p = 0.394). While this study indicated no significant differences in clinical skills in students who volunteer at the SRFC, it is a first step in attempting to measure clinical skill development outside of the structured medical school setting. The findings lend themselves to development of research designs, clinical surveys, and future studies to measure the impact of clinical volunteer opportunities on clinical skills development in future physicians.

"PERLE bedside-examination-course for candidates in state examination" - Developing a training program for the third part of medical state examination (oral examination with practical skills).

PubMed

Karthaus, Anne; Schmidt, Anita

2016-01-01

In preparation for the state examination, many students have open questions and a need for advice. Tutors of the Skills Lab PERLE-"Praxis ERfahren und Lernen" (experiencing and learning practical skills) have developed a new course concept to provide support and practical assistance for the examinees. The course aims to familiarize the students with the exam situation in order to gain more confidence. This enables the students to experience a confrontation with the specific situation of the exam in a protected environment. Furthermore, soft skills are utilized and trained. Concept of the course: The course was inspired by the OSCE-model (Objective Structured Clinical Examination), an example for case-based learning and controlling. Acquired knowledge can be revised and extended through the case studies. Experienced tutors provide assistance in discipline-specific competencies, and help in organizational issues such as dress code and behaviour. Evaluation of the course: An evaluation was conducted by the attending participants after every course. Based on this assessment, the course is constantly being developed. In March, April and October 2015 six courses, with a total of 84 participants, took place. Overall 76 completed questionnaires (91%) were analysed. Strengths of the course are a good tutor-participants-ratio with 1:4 (1 Tutor provides guidance for 4 participants), the interactivity of the course, and the high flexibility in responding to the group's needs. Weaknesses are the tight schedule, and the currently not yet performed evaluation before and after the course. In terms of "best practise", this article shows an example of how to offer low-cost and low-threshold preparation for the state examination.

Development, Impact, and Measurement of Enhanced Physical Diagnosis Skills

ERIC Educational Resources Information Center

Smith, Miriam A.; Burton, William B.; Mackay, Meggan

2009-01-01

Evidence suggests that the quality and frequency of bedside clinical examination have declined. We undertook the study to (1) determine whether intensive instruction in physical examination enhances medical student skills and (2) develop a tool to evaluate those skills using a modified observed structured clinical examination (OSCE). This was a…

The new final Clinical Skills examination in human medicine in Switzerland: Essential steps of exam development, implementation and evaluation, and central insights from the perspective of the national Working Group

PubMed Central

Berendonk, Christoph; Schirlo, Christian; Balestra, Gianmarco; Bonvin, Raphael; Feller, Sabine; Huber, Philippe; Jünger, Ernst; Monti, Matteo; Schnabel, Kai; Beyeler, Christine; Guttormsen, Sissel; Huwendiek, Sören

2015-01-01

Objective: Since 2011, the new national final examination in human medicine has been implemented in Switzerland, with a structured clinical-practical part in the OSCE format. From the perspective of the national Working Group, the current article describes the essential steps in the development, implementation and evaluation of the Federal Licensing Examination Clinical Skills (FLE CS) as well as the applied quality assurance measures. Finally, central insights gained from the last years are presented. Methods: Based on the principles of action research, the FLE CS is in a constant state of further development. On the foundation of systematically documented experiences from previous years, in the Working Group, unresolved questions are discussed and resulting solution approaches are substantiated (planning), implemented in the examination (implementation) and subsequently evaluated (reflection). The presented results are the product of this iterative procedure. Results: The FLE CS is created by experts from all faculties and subject areas in a multistage process. The examination is administered in German and French on a decentralised basis and consists of twelve interdisciplinary stations per candidate. As important quality assurance measures, the national Review Board (content validation) and the meetings of the standardised patient trainers (standardisation) have proven worthwhile. The statistical analyses show good measurement reliability and support the construct validity of the examination. Among the central insights of the past years, it has been established that the consistent implementation of the principles of action research contributes to the successful further development of the examination. Conclusion: The centrally coordinated, collaborative-iterative process, incorporating experts from all faculties, makes a fundamental contribution to the quality of the FLE CS. The processes and insights presented here can be useful for others planning a similar

Teaching core competencies of reconstructive microsurgery with the use of standardized patients.

PubMed

Son, Ji; Zeidler, Kamakshi R; Echo, Anthony; Otake, Leo; Ahdoot, Michael; Lee, Gordon K

2013-04-01

The Accreditation Council of Graduate Medical Education has defined 6 core competencies that residents must master before completing their training. Objective structured clinical examinations (OSCEs) using standardized patients are effective educational tools to assess and teach core competencies. We developed an OSCE specific for microsurgical head and neck reconstruction. Fifteen plastic surgery residents participated in the OSCE simulating a typical new patient consultation, which involved a patient with oral cancer. Residents were scored in all 6 core competencies by the standardized patients and faculty experts. Analysis of participant performance showed that although residents performed well overall, many lacked proficiency in systems-based practice. Junior residents were also more likely to omit critical elements of the physical examination compared to senior residents. We have modified our educational curriculum to specifically address these deficiencies. Our study demonstrates that the OSCE is an effective assessment tool for teaching and assessing all core competencies in microsurgery.

Effectiveness of early cardiology undergraduate learning using simulation on retention, application of learning and level of confidence during clinical clerkships

PubMed Central

Lin, Weiqin; Lee, Glenn K; Loh, Joshua P; Tay, Edgar L; Sia, Winnie; Lau, Tang-Ching; Hooi, Shing-Chuan; Poh, Kian-Keong

2015-01-01

INTRODUCTION This study aimed to assess the effectiveness of the use of a cardiopulmonary patient simulator in the teaching of second-year medical students. Effectiveness was measured in terms of the extent of knowledge retention and students’ ability to apply the skills learned in subsequent real-life patient contact. METHODS In this study, ten third-year medical students who had previously undergone simulator training as part of their second-year curriculum underwent an objective structured clinical examination (OSCE) and a multiple-choice question (MCQ) test to assess their ability to apply the knowledge gained during the simulator training when dealing with real patients. The performance of this group of students was compared with that of a group of ten fourth-year medical students who did not undergo simulation training. RESULTS Although the third-year medical students performed well in the OSCE, they were outperformed by the group of fourth-year medical students, who had an extra year of clinical exposure. The MCQ scores of the two groups of students were similar. Post-simulation training survey revealed that students were generally in favour of incorporating cardiopulmonary simulator training in the preclinical curriculum. CONCLUSION Cardiopulmonary simulator training is a useful tool for the education of preclinical medical students. It aids the translation of preclinical knowledge into real-life clinical skills. PMID:25715855

[Peer teaching and peer assessment are appropriate tools in medical education in otorhinolaryngology].

PubMed

Kemper, M; Linke, J; Zahnert, T; Neudert, M

2014-06-01

The use of student tutors (peers) is an accepted method in medical education. In 2011, final year students of the otorhinolaryngology (ORL) department of the University Hospital in Dresden were appointed as peers for the clinical ORL examination. They assisted in the instruction of the clinical ORL examination (peer teaching, PT) and served as examiners (peer assessment, PA) in the final objective structured clinical examination (OSCE). The effect on the quality of education and examination was examined. 248 medical students (5(th) year) were divided in 2 groups. They were trained and finally examined in the standardized clinical ORL examination by peers and/or physicians. Group I (n=118) was exclusively trained and examined by physicians and group II (n=130) by peers and physicians. The results of the OSCE were stratified for the 2 groups and in group II for the subgroups according to the instructors' and examiners' qualification (peer or physician). The students evaluated the internship and the instructors' and examiners' quality with a validated questionnaire. In the OSCE, group I scored in the mean 59.9±4.9 points (max. 65). In group II the mean score was 58.3±4.3 points examined by the peers and 59.5±4.8 points for same performance assessed by the physicians. There were no statistical significant differences in the examination results when stratified for the instructors' and examiners' qualification. The evaluation results were consistently positive and identical when compared to the previous year without use of PT and PA and between the 2 groups and subgroups. When using a standardized clinical examination routine peers can be used for PT and PA to appropriate tools in student's medical education without any decrease in the teaching and examination quality. © Georg Thieme Verlag KG Stuttgart · New York.

Disparity between Clinical and Ultrasound Examinations in Neonatal Hip Screening.

PubMed

Kyung, Bong Soo; Lee, Soon Hyuck; Jeong, Woong Kyo; Park, Si Young

2016-06-01

For early detection of developmental dysplasia of the hip (DDH), neonatal hip screening using clinical examination and/or ultrasound has been recommended. Although there have been many studies on the reliability of both screening techniques, there is still controversy in the screening strategies; clinical vs. selective or universal ultrasound screening. To determine the screening strategy, we assessed the agreement among the methods; clinical examination by an experienced pediatric orthopedic surgeon, sonographic morphology, and sonographic stability. From January 2004 to June 2009, a single experienced pediatric orthopedic surgeon performed clinical hip screenings for 2,686 infants in the neonatal unit and 43 infants who were referred due to impressions of hip dysplasia before 3 months of age. Among them, 156 clinically unstable or high-risk babies selectively received bilateral hip ultrasound examinations performed by the same surgeon using the modified Graf method. The results were analyzed statistically to detect any correlations between the clinical and sonographic findings. Although a single experienced orthopedic surgeon conducted all examinations, we detected only a limited relationship between the results of clinical and ultrasound examinations. Ninety-three percent of the clinically subluxatable hips were normal or immature based on static ultrasound examination, and 74% of dislocating hips and 67% of limited abduction hips presented with the morphology below Graf IIa. A total of 80% of clinically subluxatable, 42% of dislocating and 67% of limited abduction hips appeared stable or exhibited minor instability on dynamic ultrasound examination. About 7% of clinically normal hips were abnormal upon ultrasound examination; 5% showed major instability and 3% showed dysplasia above Graf IIc. Clinical stability had small coefficients between ultrasound examinations; 0.39 for sonographic stability and 0.37 for sonographic morphology. Between sonographic

Performance of OSC's initial Amtec generator design, and comparison with JPL's Europa Orbiter goals

DOE Office of Scientific and Technical Information (OSTI.GOV)

Schock, A.; Noravian, H.; Or, C.

1998-07-01

The procedure for the analysis (with overpotential correction) of multitube AMTEC (Alkali Metal Thermal-to-Electrical Conversion) cells described in Paper IECEC 98-243 was applied to a wide range of multicell radioisotope space power systems. System design options consisting of one or two generators, each with 2, 3, or 4 stacked GPHS (General Purpose Heat Source) modules, identical to those used on previous NASA missions, were analyzed and performance-mapped. The initial generators analyzed by OSC had 8 AMTEC cells on each end of the heat source stack, with five beta-alumina solid electrolyte (BASE) tubes per cell. The heat source and converters inmore » the Orbital generator designs are embedded in a thermal insulation system consisting of Min-K fibrous insulation surrounded by graded-length molybdenum multifoils. Detailed analyses in previous Orbital studies found that such an insulation system could reduce extraneous heat losses to about 10%. For the above design options, the present paper presents the system mass and performance (i.e., the EOM system efficiency and power output and the BOM evaporator and clad temperatures) for a wide range of heat inputs and load voltages, and compares the results with JPL's preliminary goals for the Europa Orbiter mission to be launched in November 2003. The analytical results showed that the initial 16-cell generator designs resulted in either excessive evaporator and clad temperatures and/or insufficient power outputs to meet the JPL-specified mission goals. The computed performance of modified OSC generators with different numbers of AMTEC cells, cell diameters, cell lengths, cell materials, BASE tube lengths, and number of tubes per cell are described in Paper IECEC.98.245 in these proceedings.« less

[Potential improvements in medical education as retrospectively evaluated by candidates for specialist examinations].

PubMed

Hofer, M; Jansen, M; Soboll, S

2006-02-24

As part of the new regulations for licensing doctors there have been numerous attempts at reform by many medical faculties to consider interdisciplinary linkage of the curriculum with emphasis on teaching of small groups of students. This study was undertaken to help answer the question of how much weight should be given to the various subjects and what resources are needed for any reformed curriculum and what key areas of competence need to be given greater importance. 1029 candidates of specialist examinations of the Medical Council of North-Rhine in 2002 and 2003 filled in questionnaires to evaluate retrospectively the actual relevance of individual preclinical and clinical subjects, courses and areas of practical competence to their further medical education and related potentials for improvement in their studies. The participants were from 5 medical faculties in the North-Rhine area of Germany. They were also asked about methods of examination that were effective in aiding their learning behaviour. Those answering the questionnaire considered especially chemistry and physics as well as environmental, occupational and forensic medicine, bio-mathematics, radiotherapy and nuclear medicine among the less relevant subjects. On the other hand, anatomy, physiology, internal medicine, pharmacology and surgery were considered especially relevant. The greatest deficiencies in most of the medical curricula as taught in the North-Rhine medical courses are in the areas of competence in communication and practical clinical skills. Members of this group also pleaded for an increased use of standardized objective structured clinical examinations (OSCE).

How well do final year undergraduate medical students master practical clinical skills?

PubMed Central

Störmann, Sylvère; Stankiewicz, Melanie; Raes, Patricia; Berchtold, Christina; Kosanke, Yvonne; Illes, Gabrielle; Loose, Peter; Angstwurm, Matthias W.

2016-01-01

Introduction: The clinical examination and other practical clinical skills are fundamental to guide diagnosis and therapy. The teaching of such practical skills has gained significance through legislative changes and adjustments of the curricula of medical schools in Germany. We sought to find out how well final year undergraduate medical students master practical clinical skills. Methods: We conducted a formative 4-station objective structured clinical examination (OSCE) focused on practical clinical skills during the final year of undergraduate medical education. Participation was voluntary. Besides the examination of heart, lungs, abdomen, vascular system, lymphatic system as well as the neurological, endocrinological or orthopaedic examination we assessed other basic clinical skills (e.g. interpretation of an ECG, reading a chest X-ray). Participants filled-out a questionnaire prior to the exam, inter alia to give an estimate of their performance. Results: 214 final year students participated in our study and achieved a mean score of 72.8% of the total score obtainable. 9.3% of participants (n=20) scored insufficiently (<60%). We found no influence of sex, prior training in healthcare or place of study on performance. Only one third of the students correctly estimated their performance (35.3%), whereas 30.0% and 18.8% over-estimated their performance by 10% and 20% respectively. Discussion: Final year undergraduate medical students demonstrate considerable deficits performing practical clinical skills in the context of a formative assessment. Half of the students over-estimate their own performance. We recommend an institutionalised and frequent assessment of practical clinical skills during undergraduate medical education, especially in the final year. PMID:27579358

Objective, domain-specific HER2 measurement in uterine and ovarian serous carcinomas and its clinical significance.

PubMed

Carvajal-Hausdorf, Daniel E; Schalper, Kurt A; Bai, Yalai; Black, Jonathan; Santin, Alessandro D; Rimm, David L

2017-04-01

HER2 overexpression/amplification is identified in up to 40% of uterine serous carcinomas (USC) and 10% of ovarian serous carcinomas (OSC). However, clinical trials using various HER2-targeted agents failed to show significant responses. FDA-approved HER2 assays target only the protein's intracellular domain (ICD) and not the extracellular domain (ECD). Previous quantitative studies in breast cancer by our group have shown that ICD of HER2 is expressed in some cases that do not express the HER2 ECD. We measured HER2 ICD and ECD in USC and OSC samples, and determined their relationship with clinico-pathologic characteristics and survival. We measured HER2 ICD and ECD levels in 2 cohorts of USC and OSC comprising 102 and 175 patients, respectively. HER2 antibodies targeting ICD (CB11) and ECD (SP3) were validated and standardized using the AQUA® method of quantitative immunofluorescence (QIF) and a previously reported HER2 standardization tissue microarray (TMA). Objective, population-based cut-points were used to stratify patients according to HER2 ICD/ECD status. In USC, 8% of patients with high HER2 ICD had low ECD levels (6/75 patients). In OSC, 42% of patients with high HER2 ICD had low ECD levels (29/69 patients). HER2 ICD/ECD status in USC and OSC was not significantly associated with major clinico-pathological features or survival. Using objective, domain-specific HER2 measurement, 8% of USC and 42% of OSC patients with high HER2 ICD levels do not show uniform overexpression of the ECD. This may be related to the presence of p95 HER2, an oncogenic fragment generated by full protein cleavage or alternative initiation of translation. These observations raise the possibility that USC/OSCs expressing low ECD despite being HER2-positive by ICD measurement, may benefit from therapies directed against the intracellular domain (e.g. lapatinib or afatinib) alone or in combination with extracellular domain-directed drugs (e.g. trastuzumab, pertuzumab, T-DM1

Effects of a new parallel primary healthcare centre and on-campus training programme on history taking, physical examination skills and medical students’ preparedness: a prospective comparative study in Taiwan

PubMed Central

Yang, Ying-Ying; Wang, Shuu-Jiun; Yang, Ling-Yu; Lirng, Jiing-Feng; Huang, Chia-Chang; Liang, Jen-Feng; Lee, Fa-Yauh; Hwang, Shinn-Jang; Huang, Chin-Chou; Kirby, Ralph

2017-01-01

Objectives The primary healthcarecentre (PHCC) is the first place that medical students experience patient contact. Usually, medical students are frustrated by a lack of proper skills training for on-campus history taking (HT), physical examination (PE) and self-directed learning (SDL) to prepare for their PHCC and inhospital patient contact. For pre-clerks, this study aims to compare the effectiveness of PHCC training and PHCC training in combination with on-campus HT and PE training modules (PHCC+on-campus) on their clerkship preparedness. Design This comparative study utilised prospective, consecutive, end of pre-clerkship group objective structured clinical examination (GOSCE), beginning of clerkship OSCE and self-administered Preparation for Hospital Practice Questionnaire (PHPQ). Setting/participants 128 pre-clinical clerk volunteers (64 each year) receiving PHCC training (7 week PHCCtraining in addition to 7 week assignment based group learning, academic year 2014, controls) and PHCC training in combination with on-campus module training (academic year 2015, 7 week PHCCtraining in addition to 7 week on-campus sessions) were sequentially assessed before the module (week 1), at the end of the module (week 14) and at the beginning of clerkship (week 25). Results For overall HT and PE skills, both PHCC and PHCC+on-campus module trained pre-clerks performed better on OSCE than GOSCE. Additionally, the improvement was accompanied by higher self-reported PHPQ scores in ‘confidence/coping’ and ‘SDL’ domains. At the end of the pre-clerkship and the beginning of the clerkship stages, the degree of improvement in preparedness in ‘confidence/coping’ and ‘SDL’ domains was higher for those in the PHCC+on-campus group than for those in the PHCC group. Among the PHCC+on-campus module participants, a positive association was observed between high mean PHPQ-SDL scores and high OSCE scores. Conclusions Our study suggests that the PHCC+on-campus module

Effects of a new parallel primary healthcare centre and on-campus training programme on history taking, physical examination skills and medical students' preparedness: a prospective comparative study in Taiwan.

PubMed

Yang, Ying-Ying; Wang, Shuu-Jiun; Yang, Ling-Yu; Lirng, Jiing-Feng; Huang, Chia-Chang; Liang, Jen-Feng; Lee, Fa-Yauh; Hwang, Shinn-Jang; Huang, Chin-Chou; Kirby, Ralph

2017-09-25

The primary healthcarecentre (PHCC) is the first place that medical students experience patient contact. Usually, medical students are frustrated by a lack of proper skills training for on-campus history taking (HT), physical examination (PE) and self-directed learning (SDL) to prepare for their PHCC and inhospital patient contact. For pre-clerks, this study aims to compare the effectiveness of PHCC training and PHCC training in combination with on-campus HT and PE training modules (PHCC+on-campus) on their clerkship preparedness. This comparative study utilised prospective, consecutive, end of pre-clerkship group objective structured clinical examination (GOSCE), beginning of clerkship OSCE and self-administered Preparation for Hospital Practice Questionnaire (PHPQ). 128 pre-clinical clerk volunteers (64 each year) receiving PHCC training (7 week PHCCtraining in addition to 7 week assignment based group learning, academic year 2014, controls) and PHCC training in combination with on-campus module training (academic year 2015, 7 week PHCCtraining in addition to 7 week on-campus sessions) were sequentially assessed before the module (week 1), at the end of the module (week 14) and at the beginning of clerkship (week 25). For overall HT and PE skills, both PHCC and PHCC+on-campus module trained pre-clerks performed better on OSCE than GOSCE. Additionally, the improvement was accompanied by higher self-reported PHPQ scores in 'confidence/coping' and 'SDL' domains. At the end of the pre-clerkship and the beginning of the clerkship stages, the degree of improvement in preparedness in 'confidence/coping' and 'SDL' domains was higher for those in the PHCC+on-campus group than for those in the PHCC group. Among the PHCC+on-campus module participants, a positive association was observed between high mean PHPQ-SDL scores and high OSCE scores. Our study suggests that the PHCC+on-campus module, which is paired faculty led and pre-trained dyad student assisted, is

National survey of clinical communication assessment in medical education in the United Kingdom (UK)

PubMed Central

2014-01-01

Background All medical schools in the UK are required to be able to provide evidence of competence in clinical communication in their graduates. This is usually provided by summative assessment of clinical communication, but there is considerable variation in how this is carried out. This study aimed to gain insight into the current assessment of clinical communication in UK medical schools. Methods The survey was sent via e-mail to communication leads who then were asked to consult with all staff within their medical school involved in the assessment of communication. Results Results were obtained from 27 out of 33 schools (response rate 82%) and a total of 34 courses. The average number of assessments per year was 2.4 (minimum 0, maximum 10). The Objective Structured Clinical Exam (OSCE) was the most commonly used method of assessment (53%). Other assessments included MCQ and workplace based assessments. Only nine courses used a single method of assessment. Issues raised included, logistics and costs of assessing mainly by OSCE, the robustness and reliability of such exams and integration with other clinical skills. Conclusions It is encouraging that a variety of assessment methods are being used within UK medical schools and that these methods target different components of clinical communication skills acquisition. PMID:24417939

Simulation-based end-of-life care training during surgical clerkship: assessment of skills and perceptions.

PubMed

Parikh, Priti P; Brown, Ronald; White, Mary; Markert, Ronald J; Eustace, Rosemary; Tchorz, Kathryn

2015-06-15

Assessment of interpersonal and psychosocial competencies during end-of-life care training is essential. This study reports the relationship between simulation-based end-of-life care Objective Structured Clinical Examination ratings and communication skills, trust, and self-assessed empathy along with the perceptions of students regarding their training experiences. Medical students underwent simulation-based end-of-life care OSCE training that involved standardized patients who evaluated students' communication skills and physician trust with the Kalamazoo Essential Elements Communication Checklist and the Wake Forest Physician Trust Scale. Students also completed the Jefferson Scale of Physician Empathy. Pearson correlation was used to examine the relationship between OSCE performance grades and communication, trust, and empathy scores. Student comments were analyzed using the constant comparative method of analysis to identify dominant themes. The 389 students (mean age 26.6 ± 2.8 y; 54.5% female) had OSCE grades that were positively correlated with physician trust scores (r = 0.325, P < 0.01) and communication skills (r = 0.383, P < 0.01). However, OSCE grades and self-reported empathy were not related (r = 0.021, P = 0.68). Time of clerkship differed for OSCE grade and physician trust scores; however, there was no trend identified. No differences were noted between the time of clerkship and communication skills or empathy. Overall, students perceived simulation-based end-of-life care training to be a valuable learning experience and appreciated its placement early in clinical training. We found that simulation-based OSCE training in palliative and end-of-life care can be effectively conducted during a surgery clerkship. Moreover, the standardized patient encounters combined with the formal assessment of communication skills, physician trust, and empathy provide feedback to students at an early phase of their professional life. The positive and appreciative

Do Clinical Breast Examination Skills Improve During Medical School?

ERIC Educational Resources Information Center

Lee, Karen C.; Dunlop, Dorothy; Dolan, Nancy C.

1998-01-01

A study assessed the effect of training stage, gender, and specialty interest on 493 Northwestern University (Illinois) medical students' breast cancer knowledge, attitudes, and clinical breast examination skills. Results suggest knowledge and attitudes are not related to clinical breast examination proficiency, which is a practiced tactile skill.…

The GP tests of competence assessment: which part best predicts fitness to practise decisions?

PubMed

Jayaweera, Hirosha Keshani; Potts, Henry W W; Keshwani, Karim; Valerio, Chris; Baker, Magdalen; Mehdizadeh, Leila; Sturrock, Alison

2018-01-02

The General Medical Council (GMC) conducts Tests of Competence (ToC) for doctors referred for Fitness to Practise (FtP) issues. GPs take a single best answer knowledge test, an Objective Structured Clinical Examination (OSCE), and a Simulated Surgery (SimSurg) assessment which is a simulated GP consultation. The aim of this study was to examine the similarities between OSCEs and SimSurg to determine whether each assessment contributed something unique to GP ToCs. A mixed methods approach was used. Data were collated on 153 GPs who were required to undertake a ToC as a part of being investigated for FtP issues between February 2010 and October 2016. Using correlation analysis, we examined to what degree performance on the knowledge test, OSCE, and SimSurg related to case examiner recommendations and FtP outcomes, including the unique predictive power of these three assessments. The outcome measures were case examiner recommendations (i) not fit to practise; ii) fit to practise on a limited basis; or iii) fit to practise) as well as FtP outcomes (i) erased/removed from the register; ii) having restrictions/conditions; or iii) be in good standing). For the qualitative component, 45 GP assessors were asked to rate whether they assess the same competencies and which assessment provides better feedback about candidates. There was significant overlap between OSCEs and SimSurg, p < 0.001. SimSurg had additional predictive power in the presence of OSCEs and the knowledge test (p = 0.030) in distinguishing doctors from different FtP categories, while OSCEs did not (p = 0.080). Both the OSCEs (p = 0.004) and SimSurg (p < 0.001) had significant negative correlations with case examiner recommendations when accounting for the effects of the other two assessments. Inductive thematic analysis of the responses to the questionnaire showed that assessors perceived OSCEs to be better suited to target specific knowledge and skills. SimSurg was thought to produce a

Construct Validity of Three Clerkship Performance Assessments

ERIC Educational Resources Information Center

Lee, Ming; Wimmers, Paul F.

2010-01-01

This study examined construct validity of three commonly used clerkship performance assessments: preceptors' evaluations, OSCE-type clinical performance measures, and the NBME [National Board of Medical Examiners] medicine subject examination. Six hundred and eighty-six students taking the inpatient medicine clerkship from 2003 to 2007…

Incorporating Active Learning into a Psychiatry Clerkship: Does It Make a Difference?

ERIC Educational Resources Information Center

Morreale, Mary; Arfken, Cynthia; Bridge, Patrick; Balon, Richard

2012-01-01

Objective: Medical students' satisfaction with the psychiatry clerkship, sense of preparedness for an institutional Objective Structured Clinical Exam (OSCE), expressed likelihood of choosing psychiatry as a specialty, and National Board of Medical Examiners (NBME) psychiatry shelf-examination scores were compared after a curriculum based on…

Assessor Training: Its Effects on Criterion-Based Assessment in a Medical Context

ERIC Educational Resources Information Center

Pell, Godfrey; Homer, Matthew S.; Roberts, Trudie E.

2008-01-01

Increasingly, academic institutions are being required to improve the validity of the assessment process; unfortunately, often this is at the expense of reliability. In medical schools (such as Leeds), standardized tests of clinical skills, such as "Objective Structured Clinical Examinations" (OSCEs) are widely used to assess clinical…

Peer feedback as an aid to learning--what do we want? Feedback. When do we want it? Now!

PubMed

Cushing, Annie; Abbott, Stephen; Lothian, Doug; Hall, Angela; Westwood, Olwyn M R

2011-01-01

With 360° appraisals integral to professional life, learning how to give constructive feedback is an essential generic skill. To use a formative objective structured clinical examination (OSCE) for skills acquisition and development in giving feedback, whilst facilitating awareness of the importance of communication skills in clinical practice. Medical and nursing students took part in a formative OSCE. Using actors as simulated patients, a three-station OSCE circuit was repeated three times so that students could rotate through the roles as 'candidate', 'examiner' and 'observer'. As 'candidates', they received immediate feedback on their consultation from the 'examiner'/'observer'. The events were evaluated using a questionnaire and focus groups. Students immensely valued this learning event for considering expectations for a performance (91-100%). Concerns around giving peers feedback were acknowledged, and they were divided on preference for feedback from peers or tutors (48% versus 52%). But training in providing feedback and criteria for assessment were considered helpful, as was instruction by faculty to give corrective feedback to peers. Peer observation and professional accountability for giving constructive feedback enhanced awareness of their skills education and training needs. It also opened the dialogue for identifying opportunities for peer assessment and feedback to support work-based education and skills development.

A meta-analysis of mammographic screening with and without clinical breast examination

PubMed Central

Hamashima, Chisato; Ohta, Koji; Kasahara, Yoshio; Katayama, Takafumi; Nakayama, Tomio; Honjo, Satoshi; Ohnuki, Koji

2015-01-01

Mammographic screening with clinical breast examination has been recommended in Japan since 2000. Although mammographic screening without clinical breast examination has not been recommended, its introduction is anticipated. The efficacies of mammographic screening with and without clinical breast examination were evaluated based on the results of randomized controlled trials. PubMed and other databases for studies published between 1985 and 2014 were searched. The study design was limited to randomized controlled trials to evaluate mortality reduction from breast cancer. Five studies were eligible for meta-analysis of mammographic screening without clinical breast examination. The relative risk for women aged 40–74 years was 0.75 (95% confidence interval, 0.67–0.83). Three studies evaluated the efficacy of mammographic screening with clinical breast examination. The relative risk for women aged 40–64 years was 0.87 (95% confidence interval, 0.77–0.98). The number needed to invite was always lower in mammographic screening without clinical breast examination than in mammographic screening with clinical breast examination. In both screening methods, the number needed to invite was higher in women aged 40–49 years than in women aged 50–70 years. These results suggest that mammographic screening without clinical breast examination can afford higher benefits to women aged 50 years and over. Although evidence of the efficacy of mammographic screening without clinical breast examination was confirmed based on the results of the randomized controlled trials, a Japanese study is needed to resolve local problems. PMID:25959787

Performance of International Medical Students In psychosocial medicine.

PubMed

Huhn, D; Lauter, J; Roesch Ely, D; Koch, E; Möltner, A; Herzog, W; Resch, F; Herpertz, S C; Nikendei, C

2017-07-10

Particularly at the beginning of their studies, international medical students face a number of language-related, social and intercultural challenges. Thus, they perform poorer than their local counterparts in written and oral examinations as well as in Objective Structured Clinical Examinations (OSCEs) in the fields of internal medicine and surgery. It is still unknown how international students perform in an OSCE in the field of psychosocial medicine compared to their local fellow students. All students (N = 1033) taking the OSCE in the field of psychosocial medicine and an accompanying written examination in their eighth or ninth semester between 2012 and 2015 were included in the analysis. The OSCE consisted of four different stations, in which students had to perform and manage a patient encounter with simulated patients suffering from 1) post-traumatic stress disorder, 2) schizophrenia, 3) borderline personality disorder and 4) either suicidal tendency or dementia. Students were evaluated by trained lecturers using global checklists assessing specific professional domains, namely building a relationship with the patient, conversational skills, anamnesis, as well as psychopathological findings and decision-making. International medical students scored significantly poorer than their local peers (p < .001; η 2  = .042). Within the specific professional domains assessed, they showed poorer scores, with differences in conversational skills showing the highest effect (p < .001; η 2  = .053). No differences emerged within the multiple-choice examination (p = .127). International students showed poorer results in clinical-practical exams in the field of psychosocial medicine, with conversational skills yielding the poorest scores. However, regarding factual and practical knowledge examined via a multiple-choice test, no differences emerged between international and local students. These findings have decisive implications for relationship building in

NBME subject examination in surgery scores correlate with surgery clerkship clinical experience.

PubMed

Myers, Jonathan A; Vigneswaran, Yalini; Gabryszak, Beth; Fogg, Louis F; Francescatti, Amanda B; Golner, Christine; Bines, Steven D

2014-01-01

Most medical schools in the United States use the National Board of Medical Examiners Subject Examinations as a method of at least partial assessment of student performance, yet there is still uncertainty of how well these examination scores correlate with clinical proficiency. Thus, we investigated which factors in a surgery clerkship curriculum have a positive effect on academic achievement on the National Board of Medical Examiners Subject Examination in Surgery. A retrospective analysis of 83 third-year medical students at our institution with 4 unique clinical experiences on the general surgery clerkship for the 2007-2008 academic year was conducted. Records of the United States Medical Licensing Examination Step 1 scores, National Board of Medical Examiners Subject Examination in Surgery scores, and essay examination scores for the groups were compared using 1-way analysis of variance testing. Rush University Medical Center, Chicago IL, an academic institution and tertiary care center. Our data demonstrated National Board of Medical Examiners Subject Examination in Surgery scores from the group with the heavier clinical loads and least time for self-study were statistically higher than the group with lighter clinical services and higher rated self-study time (p = 0.036). However, there was no statistical difference of National Board of Medical Examiners Subject Examination in Surgery scores between the groups with equal clinical loads (p = 0.751). Students experiencing higher clinical volumes on surgical services, but less self-study time demonstrated statistically higher academic performance on objective evaluation, suggesting clinical experience may be of higher value than self-study and reading. Copyright © 2014 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Assessing patient-centered care: one approach to health disparities education.

PubMed

Wilkerson, LuAnn; Fung, Cha-Chi; May, Win; Elliott, Donna

2010-05-01

Patient-centered care has been described as one approach to cultural competency education that could reduce racial and ethnic health disparities by preparing providers to deliver care that is respectful and responsive to the preferences of each patient. In order to evaluate the effectiveness of a curriculum in teaching patient-centered care (PCC) behaviors to medical students, we drew on the work of Kleinman, Eisenberg, and Good to develop a scale that could be embedded across cases in an objective structured clinical examination (OSCE). To compare the reliability, validity, and feasibility of an embedded patient-centered care scale with the use of a single culturally challenging case in measuring students' use of PCC behaviors as part of a comprehensive OSCE. A total of 322 students from two California medical schools participated in the OSCE as beginning seniors. Cronbach's alpha was used to assess the internal consistency of each approach. Construct validity was addressed by establishing convergent and divergent validity using the cultural challenge case total score and OSCE component scores. Feasibility assessment considered cost and training needs for the standardized patients (SPs). Medical students demonstrated a moderate level of patient-centered skill (mean = 63%, SD = 11%). The PCC Scale demonstrated an acceptable level of internal consistency (alpha = 0.68) over the single case scale (alpha = 0.60). Both convergent and divergent validities were established through low to moderate correlation coefficients. The insertion of PCC items across multiple cases in a comprehensive OSCE can provide a reliable estimate of students' use of PCC behaviors without incurring extra costs associated with implementing a special cross-cultural OSCE. This approach is particularly feasible when an OSCE is already part of the standard assessment of clinical skills. Reliability may be increased with an additional investment in SP training.

The rational clinical examination. Does this infant have pneumonia?

PubMed

Margolis, P; Gadomski, A

1998-01-28

Acute lower respiratory tract illness is common among children seen in primary care. We reviewed the accuracy and precision of the clinical examination in detecting pneumonia in children. Although most cases are viral, it is important to identify bacterial pneumonia to provide appropriate therapy. Studies were identified by searching MEDLINE from 1982 to 1995, reviewing reference lists, reviewing a published compendium of studies of the clinical examination, and consulting experts. Observer agreement is good for most signs on the clinical examination. Each study was reviewed by 2 observers and graded for methodologic quality. There is better agreement about signs that can be observed (eg, use of accessory muscles, color, attentiveness; kappa, 0.48-0.66) than signs that require auscultation of the chest (eg, adventitious sounds; kappa, 0.3). Measurements of the respiratory rate are enhanced by counting for 60 seconds. The best individual finding for ruling out pneumonia is the absence of tachypnea. Chest indrawing, and other signs of increased work of breathing, increases the likelihood of pneumonia. If all clinical signs (respiratory rate, auscultation, and work of breathing) are negative, the chest x-ray findings are unlikely to be positive. Studies are needed to assess the value of clinical findings when they are used together.

“PERLE bedside-examination-course for candidates in state examination” – Developing a training program for the third part of medical state examination (oral examination with practical skills)

PubMed Central

Karthaus, Anne; Schmidt, Anita

2016-01-01

Introduction: In preparation for the state examination, many students have open questions and a need for advice. Tutors of the Skills Lab PERLE-„Praxis ERfahren und Lernen“ (experiencing and learning practical skills) have developed a new course concept to provide support and practical assistance for the examinees. Objectives: The course aims to familiarize the students with the exam situation in order to gain more confidence. This enables the students to experience a confrontation with the specific situation of the exam in a protected environment. Furthermore, soft skills are utilized and trained. Concept of the course: The course was inspired by the OSCE-model (Objective Structured Clinical Examination), an example for case-based learning and controlling. Acquired knowledge can be revised and extended through the case studies. Experienced tutors provide assistance in discipline-specific competencies, and help in organizational issues such as dress code and behaviour. Evaluation of the course: An evaluation was conducted by the attending participants after every course. Based on this assessment, the course is constantly being developed. In March, April and October 2015 six courses, with a total of 84 participants, took place. Overall 76 completed questionnaires (91%) were analysed. Discussion: Strengths of the course are a good tutor-participants-ratio with 1:4 (1 Tutor provides guidance for 4 participants), the interactivity of the course, and the high flexibility in responding to the group's needs. Weaknesses are the tight schedule, and the currently not yet performed evaluation before and after the course. Conclusion: In terms of “best practise”, this article shows an example of how to offer low-cost and low-threshold preparation for the state examination. PMID:27579355

[Clinical examination and the Valsalva maneuver in heart failure].

PubMed

Liniado, Guillermo E; Beck, Martín A; Gimeno, Graciela M; González, Ana L; Cianciulli, Tomás F; Castiello, Gustavo G; Gagliardi, Juan A

2018-01-01

Congestion in heart failure patients with reduced ejection fraction (HFrEF) is relevant and closely linked to the clinical course. Bedside blood pressure measurement during the Valsalva maneuver (Val) added to clinical examination may improve the assessment of congestion when compared to NT-proBNP levels and left atrial pressure (LAP) estimation by Doppler echocardiography, as surrogate markers of congestion in HFrEF. A clinical examination, LAP and blood tests were performed in 69 HFrEF ambulatory patients with left ventricular ejection fraction ≤ 40% and sinus rhythm. Framingham Heart Failure Score (HFS) was used to evaluate clinical congestion; Val was classified as normal or abnormal, NT-proBNP was classified as low (< 1000 pg/ml) or high (≥ 1000 pg/ml) and the ratio between Doppler early mitral inflow and tissue diastolic velocity was used to estimate LAP and was classified as low (E/e'< 15) or high (E/e' ≥ 15). A total of 69 patients with HFrEF were included; 27 had a HFS ≥ 2 and 13 of them had high NT-proBNP. HFS ≥ 2 had a 62% sensitivity, 70% specificity and a positive likelihood ratio of 2.08 (p=0.01) to detect congestion. When Val was added to clinical examination, the presence of a HFS ≥ 2 and abnormal Val showed a 100% sensitivity, 64% specificity and a positive likelihood ratio of 2.8 (p = 0.0004). Compared with LAP, the presence of HFS = 2 and abnormal Val had 86% sensitivity, 54% specificity and a positive likelihood ratio of 1.86 (p = 0.03). In conclusion, an integrated clinical examination with the addition Valsalva maneuver may improve the assessment of congestion in patients with HFrEF.

Clinical examination of subjects with halitosis.

PubMed

Donaldson, A C; Riggio, M P; Rolph, H J; Bagg, J; Hodge, P J

2007-01-01

To develop and apply a detailed clinical protocol for screening and assessing subjects with a complaint of halitosis. Cross-sectional. Several methods were used to recruit subjects with a complaint of halitosis, including a newspaper advertisement. A definition of halitosis arising from within the oral cavity, which is not related to generalized chronic gingivitis, chronic periodontitis or pathology of the oral mucosa was used. An extensive list of exclusion criteria was applied at the initial visit. Eligible subjects were asked to follow strict instructions and complete a questionnaire prior to their second visit for data collection. The clinical examination consisted of an organoleptic assessment, Halimeter reading and periodontal examination. The best method of recruiting subjects was advertising. Of 66 individuals recruited, four failed to attend the screening visit and 25 were excluded. The main reasons for exclusion were poor oral hygiene and existing periodontal disease. Thirty-seven completed the full protocol, resulting in identification of 18 with halitosis and 19 controls. Application of the exclusion criteria resulted in significant attrition of eligible participants. Our results suggest that organoleptic assessment should be regarded as a useful standard for defining subjects with halitosis.

Bell palsy: Clinical examination and management.

PubMed

Patel, Donika K; Levin, Kerry H

2015-07-01

Bell palsy is a common neurologic disorder characterized by acute facial mononeuropathy of unclear cause presenting with unilateral facial weakness. Careful examination and a detailed history are important in making an accurate diagnosis. Early recognition is essential, as treatment with corticosteroids within 72 hours of onset has been shown to hasten recovery. Fortunately, most patients recover spontaneously within 3 weeks, even if untreated. Copyright © 2015 Cleveland Clinic.

Anatomy meets dentistry! Linking anatomy and clinical practice in the preclinical dental curriculum.

PubMed

Rafai, Nicole; Lemos, Martin; Kennes, Lieven Nils; Hawari, Ayichah; Gerhardt-Szép, Susanne; Classen-Linke, Irmgard

2016-11-25

Establishing a strong link early on between preclinical coursework and the clinical context is necessary for students to be able to recognize the practical relevance of the curriculum during their preclinical anatomical courses and to transfer knowledge more easily. Our objective was to enhance the clinical relevance of a preclinical anatomy course for second-year medical students of dentistry by implementing an interdisciplinary skills training course on "Palpation of the Head and Neck Muscles" and to measure the learning outcomes. For the curricular development of the expanded course module, Kern's 6-step approach was applied including subjective evaluation. We used a peer-teaching format supported by an e-learning application. A randomized control study measured effects of the two components (skills training, e-module) on learning outcomes. Four learning methods were compared: (1) lecture, (2) lecture + e-module, (3) lecture + skills training, (4) lecture + skills training + e-module. An objective structured clinical examination (OSCE) was used to measure and compare learning outcomes. The two-way variance analysis demonstrated that participation in the skills training had a statistically significant effect on the OSCE results (p = 0.0007). Students who participated in the skills training did better (φ 107.4 ± 14.4 points) than students who only attended the lecture (φ 88.8 ± 26.2 points). Students who used the e-module but did not attend the skills training earned a slightly but not significantly higher average number of points (φ 91.8 ± 31.3 points) than those who only attended the lecture. The learning outcomes of the skills training were again significantly increased when the training was combined with the e-module (φ 121.8 ± 21.8 points), thus making it the ideal method for achieving the learning objectives defined in this study. The "Palpation of the Head and Neck Muscles" interdisciplinary skills training course

Longitudinal effects of medical students' communication skills on future performance.

PubMed

Dong, Ting; LaRochelle, Jeffrey S; Durning, Steven J; Saguil, Aaron; Swygert, Kimberly; Artino, Anthony R

2015-04-01

The Essential Elements of Communication (EEC) were developed from the Kalamazoo consensus statement on physician-patient communication. The Uniformed Services University of the Health Sciences (USU) has adopted a longitudinal curriculum to use the EEC both as a learning tool during standardized patient encounters and as an evaluation tool culminating with the end of preclerkship objective-structured clinical examinations (OSCE). Medical educators have recently emphasized the importance of teaching communication skills, as evidenced by the United States Medical Licensing Examination testing both the integrated clinical encounter (ICE) and communication and interpersonal skills (CIS) within the Step 2 Clinical Skills exam (CS). To determine the associations between students' EEC OSCE performance at the end of the preclerkship period with later communication skills assessment and evaluation outcomes in the context of a longitudinal curriculum spanning both undergraduate medical education and graduate medical education. Retrospective data from preclerkship (overall OSCE scores and EEC OSCE scores) and clerkship outcomes (internal medicine [IM] clinical points and average clerkship National Board of Medical Examiners [NBME] scores) were collected from 167 USU medical students from the class of 2011 and compared to individual scores on the CIS and ICE components of Step 2 CS, as well as to the communication skills component of the program directors' evaluation of trainees during their postgraduate year 1 (PGY-1) residency. In addition to bivariate Pearson correlation analysis, we conducted multiple linear regression analysis to examine the predictive power of the EEC score beyond the IM clerkship clinical points and the average NBME Subject Exams score on the outcome measures. The EEC score was a significant predictor of the CIS score and the PGY-1 communication skills score. Beyond the average NBME Subject Exams score and the IM clerkship clinical points, the EEC score

The next (re)generation of ovarian biology and fertility in women: is current science tomorrow's practice?

PubMed

Woods, Dori C; Tilly, Jonathan L

2012-07-01

Stem cell-based strategies for ovarian regeneration and oocyte production have been proposed as future clinical therapies for treating infertility in women. However, utilization of embryonic stem cells or induced pluripotent stem cells to produce oocytes has had limited success in vitro. A recent report of the isolation and characterization of endogenous oocyte-producing or oogonial stem cells (OSCs) from ovaries of reproductive age women describes the first stable and pure human female germ cell culture model in which a subset of cells appear to initiate and complete meiosis. In addition, purified human OSCs introduced into adult human ovarian cortical tissue generate oocytes that arrest at the diplotene stage of meiosis and successfully recruit granulosa cells to form new primordial follicles. This overview examines the current landscape of in vitro and in vivo gametogenesis from stem cells, with emphasis on generation of human oocytes. Future research objectives for this area of work, as well as potential clinical applications involving the use of human OSCs, are discussed. Copyright © 2012 American Society for Reproductive Medicine. Published by Elsevier Inc. All rights reserved.

Evaluation of an Obstetric Ultrasound Curriculum for Midwives in Liberia.

PubMed

Bentley, Suzanne; Hexom, Braden; Nelson, Bret P

2015-09-01

Point-of-care ultrasound is an effective tool for clinical decision making in low- and middle-income countries, but lack of trained providers is a barrier to its utility in these settings. In Liberia, given that midwives provide most prenatal care, it is hypothesized that training them in prenatal ultrasound through an intensive condensed training course is both feasible and practical. This quantitative prospective study of preobservational and postobservational assessment evaluated a 1-week ultrasound curriculum consisting of 4 modules, each comprising a didactic component, a practical session, and supervised patient encounters. A knowledge-based pretest and presurvey addressing prior use and comfort were administered. At the intervention conclusion, identical posttests and postsurveys were administered with an objective structured clinical examination (OSCE). The test, survey, and OSCE were repeated after 1 year. All scores and responses were tabulated, and qualitative analysis with paired t tests was performed. Thirty-one midwives underwent intervention and written evaluation, with 14 followed up at 1 year. Seventeen underwent the OSCE, with 8 retained at 1 year. There was a significant increase between pretest and immediate and 1-year posttest scores (36.6% versus 90% and 66%; P < .001) but no difference between immediate and 1-year posttest scores (90% versus 66%; P > .05). Average overall comfort using ultrasound increased from presurvey to immediate postsurvey scores (from 1.8 to 3.8; P< .001) and remained higher at the 1-year postsurvey (1.8 to 3.4; P< .05). Overall OSCE scores remained high from immediately after the OSCE to 1 year after the OSCE (78% to 55%; P > .05). Midwives in Liberia had very low baseline knowledge and comfort using ultrasound. A 1-week curriculum increased both short- and long-term knowledge and comfort and led to adequate overall OSCE scores that were retained at 1 year. © 2015 by the American Institute of Ultrasound in Medicine.

Technical skills acquisition in surgery-bound senior medical students: an evaluation of student assertiveness.

PubMed

Talbott, Vanessa A; Marks, Joshua A; Bodzin, Adam S; Comeau, Jason A; Maxwell, Pinckney J; Isenberg, Gerald A; Martin, Niels D

2012-01-01

To prepare students pursuing surgical careers, we devised a senior subinternship curriculum supplement that focused on the acquisition of technical skills required of surgical residents. We hypothesized that more assertive students, those that accomplished more of the curriculum, would perform better on a technical skills Objective Structured Clinical Examination (OSCE). Senior medical students rotating on their first general surgery subinternship were administered a 6-station OSCE on the first day of their subinternship and again during the final week of the month-long rotation. A self-directed, 38-task "scavenger hunt" representing common intern level clinical skills, procedures, and patient care activities was provided to each student. The study was performed at Jefferson Medical College, a large, private medical school in Philadelphia, PA. Forty-nine senior students completed surgical subinternships between July 2009 and September 2010, and participated both in the pre-/post-OSCEs and the scavenger hunt. Students performed significantly better on the post-rotation OSCE than on the pre-rotation OSCE; 70.2% ± 8.1% vs. 60.4% ± 12.0%, p < 0.0001. Assertiveness scores from the "scavenger hunt" did not correlate with final OSCE scores (r = -0.328, p = 0.25), and were negatively correlated with the change between pre- and post-OSCE scores (r = -0.573, p < 0.04). Individual student assertiveness scores were determined by the number of tasks completed over the course of the rotation. As surgical education becomes more streamlined with evolving work hour restrictions, medical school education is playing an increasingly pivotal role in preparing students for internship. In our study, individual assertiveness in completing structured self-directed learning tasks did not directly predict the acquisition of proficiency in technical skills. We feel assertiveness is overshadowed by other factors that may carry more weight in terms of technical skills acquisition. Further

Criterion validity of a competency-based assessment center in medical education--a 4-year follow-up study.

PubMed

Rotthoff, Thomas; Ostapczuk, Martin S; Kröncke, Klaus D; Zimmerhofer, Alexander; Decking, Ulrich; Schneider, Matthias; Ritz-Timme, Stefanie

2014-01-01

Core competencies have progressively gained importance in medical education. In other contexts, especially personnel selection and development, assessment centers (ACs) are used to assess competencies, but there is only a limited number of studies on competency-based ACs in medical education. To the best of our knowledge, the present study provides the first data on the criterion-related validity of a competency-based AC in medical education. We developed an AC tailored to measure core competencies relevant to medical education (social-ethical, communicative, self, and teaching) and tested its validity in n=30 first-year medical students using 3- to 4-year follow-up measures such as (a) objective structured clinical examinations (OSCE) on basic clinical skills (n=26), (b) OSCE on communication skills (n=21), and (c) peer feedback (n=18). The AC contained three elements: interview, group discussion, and role play. Additionally, a self-report questionnaire was provided as a basis for the interview. Baseline AC average score and teaching competency correlated moderately with the communication OSCE average score (r=0.41, p=0.03, and r=0.38, p=0.04, respectively). Social-ethical competency in the AC showed a very strong convergent association with the communication OSCE average score (r=0.60, p<0.01). The AC total score also showed a moderate correlation with the overall peer feedback score provided in Year 4 (r=0.38, p=0.06). In addition, communicative competency correlated strongly with the overall peer feedback (r=0.50, p=0.02). We found predominantly low and insignificant correlations between the AC and the OSCE on basic clinical skills (r=-0.33 to 0.30, all p's>0.05). The results showed that competency-based ACs can be used at a very early stage of medical training to successfully predict future performance in core competencies.

Criterion validity of a competency-based assessment center in medical education - a 4-year follow-up study.

PubMed

Rotthoff, Thomas; Ostapczuk, Martin S; Kröncke, Klaus D; Zimmerhofer, Alexander; Decking, Ulrich; Schneider, Matthias; Ritz-Timme, Stefanie

2014-01-01

Introduction Core competencies have progressively gained importance in medical education. In other contexts, especially personnel selection and development, assessment centers (ACs) are used to assess competencies, but there is only a limited number of studies on competency-based ACs in medical education. To the best of our knowledge, the present study provides the first data on the criterion-related validity of a competency-based AC in medical education. Methods We developed an AC tailored to measure core competencies relevant to medical education (social-ethical, communicative, self, and teaching) and tested its validity in n=30 first-year medical students using 3- to 4-year follow-up measures such as (a) objective structured clinical examinations (OSCE) on basic clinical skills (n=26), (b) OSCE on communication skills (n=21), and (c) peer feedback (n=18). The AC contained three elements: interview, group discussion, and role play. Additionally, a self-report questionnaire was provided as a basis for the interview. Results Baseline AC average score and teaching competency correlated moderately with the communication OSCE average score (r=0.41, p=0.03, and r=0.38, p=0.04, respectively). Social-ethical competency in the AC showed a very strong convergent association with the communication OSCE average score (r=0.60, p<0.01). The AC total score also showed a moderate correlation with the overall peer feedback score provided in Year 4 (r=0.38, p=0.06). In addition, communicative competency correlated strongly with the overall peer feedback (r=0.50, p=0.02). We found predominantly low and insignificant correlations between the AC and the OSCE on basic clinical skills (r=-0.33 to 0.30, all p's>0.05). Conclusion The results showed that competency-based ACs can be used at a very early stage of medical training to successfully predict future performance in core competencies.

Multimodality approach to classifying hand utilization for the clinical breast examination.

PubMed

Laufer, Shlomi; Cohen, Elaine R; Maag, Anne-Lise D; Kwan, Calvin; Vanveen, Barry; Pugh, Carla M

2014-01-01

The clinical breast examination (CBE) is performed to detect breast pathology. However, little is known regarding clinical technique and how it relates to diagnostic accuracy. We sought to quantify breast examination search patterns and hand utilization with a new data collection and analysis system. Participants performed the CBE while the sensor mapping and video camera system collected performance data. From this data, algorithms were developed that measured the number of hands used during the exam and active examination time. This system is a feasible and reliable method to collect new information on CBE techniques.

Effectiveness Of Horizontal Peer-Assisted Learning In Physical Examination Performance.

PubMed

Shah, Inamullah; Mahboob, Usman; Shah, Sajida

2017-01-01

All students cannot be individually trained in physical examination skills due to faculty and time limitations. Peer-assisted learning (PAL) can solve this dilemma if it is used in undergraduate curriculum. Empirical effectiveness of horizontal peer-assisted learning model has not been reported previously. The objective of this study was to compare horizontal peer-assisted learning (PAL) with expert-assisted learning (EAL) in teaching of physical examination skills. This is a randomized controlled study (Solomon four group design) carried out at a medical school. A total of 120 undergraduate year 5 students were randomized into two groups to undergo training in four areas of physical examination. Stratified random sampling technique was used. Group 1 was trained by EAL while Group 2 by PAL. Half students from both groups were given a pre-test to assess the testing effect. Both groups were given a post-test in the form of an OSCE. Independent samples t-test and paired sample t-test were used as tests of significance. Group 2 scored significantly higher than Group 1. There was significant difference (p=.000) in mean post-test scores of Group-1 (69.98±5.6) and Group-2 (85.27±5.6). Difference in mean scores was not significant (p=.977) between students who had taken the pre-test and those who had not. This study has implications in curriculum development as it provides quantitative evidence indicating that horizontal PAL as a learning strategy can actually replace, rather than augment, expert-assisted learning in teaching clinical skills to undergraduate students.

Physical Examination for the Academic Psychiatrist: Primer and Common Clinical Scenarios.

PubMed

Azzam, Pierre N; Gopalan, Priya; Brown, Jennifer R; Aquino, Patrick R

2016-04-01

As clinical psychiatry has evolved to mirror the patient care model followed in other medical specialties, psychiatrists are called upon increasingly to utilize general medical skills in routine practice. Psychiatrists who practice in academic settings are often required to generate broad differential diagnoses that include medical and neurologic conditions and, as a result, benefit from incorporating physical examination into their psychiatric assessments. Physical examination allows psychiatrists to follow and to teach patient-informed clinical practices and comprehensive treatment approaches. In this commentary, the authors encourage routine use of a targeted physical examination and outline common scenarios in which physical examination would be useful for the academic psychiatrist: delirium, toxidromes, and unexplained medical conditions (e.g., somatic symptom disorders).

The biasing effect of clinical history on physical examination diagnostic accuracy.

PubMed

Sibbald, Matthew; Cavalcanti, Rodrigo B

2011-08-01

Literature on diagnostic test interpretation has shown that access to clinical history can both enhance diagnostic accuracy and increase diagnostic error. Knowledge of clinical history has also been shown to enhance the more complex cognitive task of physical examination diagnosis, possibly by enabling early hypothesis generation. However, it is unclear whether clinicians adhere to these early hypotheses in the face of unexpected physical findings, thus resulting in diagnostic error. A sample of 180 internal medicine residents received a short clinical history and conducted a cardiac physical examination on a high-fidelity simulator. Resident Doctors (Residents) were randomised to three groups based on the physical findings in the simulator. The concordant group received physical examination findings consistent with the diagnosis that was most probable based on the clinical history. Discordant groups received findings associated with plausible alternative diagnoses which either lacked expected findings (indistinct discordant) or contained unexpected findings (distinct discordant). Physical examination diagnostic accuracy and physical examination findings were analysed. Physical examination diagnostic accuracy varied significantly among groups (75 ± 44%, 2 ± 13% and 31 ± 47% in the concordant, indistinct discordant and distinct discordant groups, respectively (F(2,177)  = 53, p < 0.0001). Of the 115 Residents who were diagnostically unsuccessful, 33% adhered to their original incorrect hypotheses. Residents verbalised an average of 12 findings (interquartile range: 10-14); 58 ± 17% were correct and the percentage of correct findings was similar in all three groups (p = 0.44). Residents showed substantially decreased diagnostic accuracy when faced with discordant physical findings. The majority of trainees given discordant physical findings rejected their initial hypotheses, but were still diagnostically unsuccessful. These results

The Clinical anatomy of the physical examination of the abdomen: A comprehensive review.

PubMed

Bilal, Muhammad; Voin, Vlad; Topale, Nitsa; Iwanaga, Joe; Loukas, Marios; Tubbs, R Shane

2017-04-01

Physical examination of the abdomen is an essential skill. Knowledge of its clinical anatomy and application is vital for making diagnoses. Misinterpretation of anatomy during examination can have serious consequences. This review addresses understanding of the anatomy, methodology, and complications of abdominal physical examination. It includes particular reference to modern technology and investigations. Physical examination is performed for diagnostic purposes. However, the art of physical examination is declining as more and more clinicians rely on newer technology. This can have regrettable consequences: negligence, waste of time and resources, and deterioration of clinical skills. With a sound knowledge of clinical anatomy, and realization of the importance of physical examination of the abdomen, clinician, and patients alike can benefit. Clin. Anat. 30:352-356, 2017. © 2017 Wiley Periodicals, Inc. © 2017 Wiley Periodicals, Inc.

DOPS (Direct Observation of Procedural Skills) in undergraduate skills-lab: Does it work? Analysis of skills-performance and curricular side effects.

PubMed

Profanter, Christoph; Perathoner, Alexander

2015-01-01

Sufficient teaching and assessing clinical skills in the undergraduate setting becomes more and more important. In a surgical skills-lab course at the Medical University of Innsbruck fourth year students were teached with DOPS (direct observation of procedural skills). We analyzed whether DOPS worked or not in this setting, which performance levels could be reached compared to tutor teaching (one tutor, 5 students) and which curricular side effects could be observed. In a prospective randomized trial in summer 2013 (April - June) four competence-level-based skills were teached in small groups during one week: surgical abdominal examination, urethral catheterization (phantom), rectal-digital examination (phantom), handling of central venous catheters. Group A was teached with DOPS, group B with a classical tutor system. Both groups underwent an OSCE (objective structured clinical examination) for assessment. 193 students were included in the study. Altogether 756 OSCE´s were carried out, 209 (27,6%) in the DOPS- and 547 (72,3%) in the tutor-group. Both groups reached high performance levels. In the first month there was a statistically significant difference (p<0,05) in performance of 95% positive OSCE items in the DOPS-group versus 88% in the tutor group. In the following months the performance rates showed no difference anymore and came to 90% in both groups. In practical skills the analysis revealed a high correspondence between positive DOPS (92,4%) and OSCE (90,8%) results. As shown by our data DOPS furnish high performance of clinical skills and work well in the undergraduate setting. Due to the high correspondence of DOPS and OSCE results DOPS should be considered as preferred assessment tool in a students skills-lab. The approximation of performance-rates within the months after initial superiority of DOPS could be explained by an interaction between DOPS and tutor system: DOPS elements seem to have improved tutoring and performance rates as well. DOPS in

Improving Communication With Surrogate Decision-Makers: A Pilot Initiative.

PubMed

Meltzer, Ellen C; Shi, Zhenzhen; Suppes, Alexandra; Hersh, Jennifer E; Orlander, Jay D; Calhoun, Aaron W; Tung, Judy; Logio, Lia; Manna, Ruth; Bialer, Philip A; Acres, Cathleen A; Fins, Joseph J

2017-08-01

Difficult conversations in medical care often occur between physicians and patients' surrogates, individuals entrusted with medical decisions for patients who lack the capacity to make them. Poor communication between patients' surrogates and physicians may exacerbate anxiety and guilt for surrogates, and may contribute to physician stress and burnout. This pilot study assesses the effectiveness of an experiential learning workshop that was conducted in a clinical setting, and aimed at improving resident physician communication skills with a focus on surrogate decision-making. From April through June 2016, we assessed internal medicine residents' baseline communication skills through an objective structured clinical examination (OSCE) with actors representing standardized surrogates. After an intensive, 6-hour communication skills workshop, residents were reassessed via an OSCE on the same day. A faculty facilitator and the surrogate evaluated participants' communication skills via the expanded Gap Kalamazoo Consensus Statement Assessment Form. Wilcoxon signed rank tests (α of .05) compared mean pre- and postworkshop scores. Of 44 residents, 33 (75%) participated. Participants' average preworkshop OSCE scores ( M  = 3.3, SD = 0.9) were significantly lower than postworkshop scores ( M  = 4.3; SD = 0.8; Z  = 4.193; P  < .001; effect size r  = 0.52). After the workshop, the majority of participants self-reported feeling "more confident." Residents' communication skills specific to surrogate decision-making benefit from focused interventions. Our pilot assessment of a workshop showed promise, and additionally demonstrated the feasibility of bringing OSCEs and simulated encounters into a busy clinical practice.

Intensive point-of-care ultrasound training with long-term follow-up in a cohort of Rwandan physicians.

PubMed

Henwood, Patricia C; Mackenzie, David C; Rempell, Joshua S; Douglass, Emily; Dukundane, Damas; Liteplo, Andrew S; Leo, Megan M; Murray, Alice F; Vaillancourt, Samuel; Dean, Anthony J; Lewiss, Resa E; Rulisa, Stephen; Krebs, Elizabeth; Raja Rao, A K; Rudakemwa, Emmanuel; Rusanganwa, Vincent; Kyanmanywa, Patrick; Noble, Vicki E

2016-12-01

We delivered a point-of-care ultrasound training programme in a resource-limited setting in Rwanda, and sought to determine participants' knowledge and skill retention. We also measured trainees' assessment of the usefulness of ultrasound in clinical practice. This was a prospective cohort study of 17 Rwandan physicians participating in a point-of-care ultrasound training programme. The follow-up period was 1 year. Participants completed a 10-day ultrasound course, with follow-up training delivered over the subsequent 12 months. Trainee knowledge acquisition and skill retention were assessed via observed structured clinical examinations (OSCEs) administered at six points during the study, and an image-based assessment completed at three points. Trainees reported minimal structured ultrasound education and little confidence using point-of-care ultrasound before the training. Mean scores on the image-based assessment increased from 36.9% (95% CI 32-41.8%) before the initial 10-day training to 74.3% afterwards (95% CI 69.4-79.2; P < 0.001). The mean score on the initial OSCE after the introductory course was 81.7% (95% CI 78-85.4%). The mean OSCE performance at each subsequent evaluation was at least 75%, and the mean OSCE score at the 58-week follow up was 84.9% (95% CI 80.9-88.9%). Physicians providing acute care in a resource-limited setting demonstrated sustained improvement in their ultrasound knowledge and skill 1 year after completing a clinical ultrasound training programme. They also reported improvements in their ability to provide patient care and in job satisfaction. © 2016 John Wiley & Sons Ltd.

Videotape Reliability: A Method of Evaluation of a Clinical Performance Examination.

ERIC Educational Resources Information Center

And Others; Liu, Philip

1980-01-01

A method of statistically analyzing clinical performance examinations for reliability and the application of this method in determining the reliability of two examinations of skill in administering anesthesia are described. Videotaped performances for the Spinal Anesthesia Skill Examination and the Anesthesia Setup and Machine Checkout Examination…

Improving antibiotic prescribing skills in medical students: the effect of e-learning after 6 months.

PubMed

Sikkens, Jonne J; Caris, Martine G; Schutte, Tim; Kramer, Mark H H; Tichelaar, Jelle; van Agtmael, Michiel A

2018-05-09

Antimicrobial prescribing behaviour is first established during medical study, but teachers often cite lack of time as an important problem in the implementation of antimicrobial stewardship in the medical curriculum. The use of electronic learning (e-learning) is a potentially time-efficient solution, but its effectiveness in changing long-term prescribing behaviour in medical students is as yet unknown. We performed a prospective controlled intervention study of the long-term effects of a short interactive e-learning course among fourth year medical students in a Dutch university. The e-learning was temporarily implemented as a non-compulsory course during a 6 week period. Six months later, all students underwent an infectious disease-based objective structured clinical examination (OSCE) aimed at simulating postgraduate prescribing. If they passed, each student did the OSCE only once. We created a control group of students from a period when the e-learning was not implemented. Main outcomes were the OSCE pass percentage and knowledge, drug choice and overall scores. We used propensity scores to create equal comparisons. We included 71 students in the intervention group and 285 students in the control group. E-learning participation in the intervention group was 81%. The OSCE pass percentage was 86% in the control group versus 97% in the intervention group (+11%, OR 5.9, 95% CI 1.7-20.0). OSCE overall, knowledge and drug choice grades (1-10) were also significantly higher in the intervention group (differences +0.31, +0.31 and +0.51, respectively). E-learning during a limited period can significantly improve medical students' performance of an antimicrobial therapeutic consultation in a situation simulating clinical practice 6 months later.

Clinical Examination Component of Telemedicine, Telehealth, mHealth, and Connected Health Medical Practices.

PubMed

Weinstein, Ronald S; Krupinski, Elizabeth A; Doarn, Charles R

2018-05-01

Telemedicine and telehealth are the practices of medicine at a distance. Performing the equivalent of a complete clinical examination by telemedicine would be unusual. However, components of a more traditional clinical examination are part of the telemedicine workup for specific conditions. Telemedicine clinical examinations are facilitated, and enhanced, through the integration of a class of medical devices referred to as telemedicine peripherals (eg, electronic stethoscopes, tele-ophthalmoscopes, video-otoscopes, and so forth). Direct-to-consumer telehealth is a rapidly expanding segment of the health care service industry. Copyright © 2018 Elsevier Inc. All rights reserved.

The rational clinical examination. Does this patient have strep throat?

PubMed

Ebell, M H; Smith, M A; Barry, H C; Ives, K; Carey, M

2000-12-13

Sore throat is a common complaint, and identifying patients with group A beta-hemolytic streptococcal pharyngitis (strep throat) is an important task for clinicians. Previous reviews have not systematically reviewed and synthesized the evidence. To review the precision and accuracy of the clinical examination in diagnosing strep throat. MEDLINE search for articles about diagnosis of strep throat using history-taking and physical examination. Large blinded, prospective studies (having > or =300 patients with sore throat) reporting history and physical examination data and using throat culture as the reference standard were included. Of 917 articles identified by the search, 9 met all inclusion criteria. Pairs of authors independently reviewed each article and used consensus to resolve discrepancies. The most useful findings for evaluating the likelihood of strep throat are presence of tonsillar exudate, pharyngeal exudate, or exposure to strep throat infection in the previous 2 weeks (positive likelihood ratios, 3.4, 2.1, and 1.9, respectively) and the absence of tender anterior cervical nodes, tonsillar enlargement, or exudate (negative likelihood ratios, 0.60, 0.63, and 0.74, respectively). No individual element of history-taking or physical examination is accurate enough by itself to rule in or rule out strep throat. Three validated clinical prediction rules are described for adult and pediatric populations. While no single element of history-taking or physical examination is sufficiently accurate to exclude or diagnose strep throat, a well-validated clinical prediction rule can be useful and can help physicians make more informed use of rapid antigen tests and throat cultures.

Do quality indicators for general practice teaching practices predict good outcomes for students?

PubMed

Bartlett, Maggie; Potts, Jessica; McKinley, Bob

2016-07-01

Keele medical students spend 113 days in general practices over our five-year programme. We collect practice data thought to indicate good quality teaching. We explored the relationships between these data and two outcomes for students; Objective Structured Clinical Examination (OSCE) scores and feedback regarding the placements. Though both are surrogate markers of good teaching, they are widely used. We collated practice and outcome data for one academic year. Two separate statistical analyses were carried out: (1) to determine how much of the variation seen in the OSCE scores was due to the effect of the practice and how much to the individual student. (2) to identify practice characteristics with a relationship to student feedback scores. (1) OSCE performance: 268 students in 90 practices: six quality indicators independently influenced the OSCE score, though without linear relationships and not to statistical significance. (2) Student satisfaction: 144 students in 69 practices: student feedback scores are not influenced by practice characteristics. The relationships between the quality indicators we collect for practices and outcomes for students are not clear. It may be that neither the quality indicators nor the outcome measures are reliable enough to inform decisions about practices' suitability for teaching.

Near-peer education: a novel teaching program.

PubMed

de Menezes, Sara; Premnath, Daphne

2016-05-30

This study aims to: 1) Evaluate whether a near-peer program improves perceived OSCE performance; 2) Identify factors motivating students to teach; 3) Evaluate role of near-peer teaching in medical education. A near-peer OSCE teaching program was implemented at Monash University's Peninsula Clinical School over the 2013 academic year. Forty 3rd-year and thirty final-year medical students were recruited as near-peer learners and educators, respectively. A post-program questionnaire was completed by learners prior to summative OSCEs (n=31), followed by post-OSCE focus groups (n=10). Near-peer teachers were interviewed at the program's conclusion (n=10). Qualitative data was analysed for emerging themes to assess the perceived value of the program. Learners felt peer-led teaching was more relevant to assessment, at an appropriate level of difficulty and delivered in a less threatening environment than other methods of teaching. They valued consistent practice and felt confident approaching their summative OSCEs. Educators enjoyed the opportunity to develop their teaching skills, citing mutual benefit and gratitude to past peer-educators as strong motivators to teach others. Near-peer education, valued by near-peer learners and teachers alike, was a useful method to improve preparation and perceived performance in summative examinations. In particular, a novel year-long, student-run initiative was regarded as a valuable and feasible adjunct to faculty teaching.

Has the UK Clinical Aptitude Test improved medical student selection?

PubMed

Wright, Sarah R; Bradley, Philip M

2010-11-01

In 2006, the United Kingdom Clinical Aptitude Test (UKCAT) was introduced as a new medical school admissions tool. The aim of this cohort study was to determine whether the UKCAT has made any improvements to the way medical students are selected. Regression analysis was performed in order to study the ability of previous school type and gender to predict UKCAT, personal statement or interview scores in two cohorts of accepted students. The ability of admissions scores and demographic data to predict performance on knowledge and skills examinations was also studied. Previous school type was not a significant predictor of either interview or UKCAT scores amongst students who had been accepted onto the programme (n = 307). However, it was a significant predictor of personal statement score, with students from independent and grammar schools performing better than students from state-maintained schools. Previous school type, personal statements and interviews were not significant predictors of knowledge examination performance. UKCAT scores were significant predictors of knowledge examination performance for all but one examination administered in the first 2 years of medical school. Admissions data explained very little about performance on skills (objective structured clinical examinations [OSCEs]) assessments. The use of personal statements as a basis for selection results in a bias towards students from independent and grammar schools. However, no evidence was found to suggest that students accepted from these schools perform any better than students from maintained schools on Year 1 and 2 medical school examinations. Previous school type did not predict interview or UKCAT scores of accepted students. UKCAT scores are predictive of Year 1 and 2 examination performance at this medical school, whereas interview scores are not. The results of this study challenge claims made by other authors that aptitude tests do not have a place in medical school selection in the UK

Comparative values of medical school assessments in the prediction of internship performance.

PubMed

Lee, Ming; Vermillion, Michelle

2018-02-01

Multiple undergraduate achievements have been used for graduate admission consideration. Their relative values in the prediction of residency performance are not clear. This study compared the contributions of major undergraduate assessments to the prediction of internship performance. Internship performance ratings of the graduates of a medical school were collected from 2012 to 2015. Hierarchical multiple regression analyses were used to examine the predictive values of undergraduate measures assessing basic and clinical sciences knowledge and clinical performances, after controlling for differences in the Medical College Admission Test (MCAT). Four hundred eighty (75%) graduates' archived data were used in the study. Analyses revealed that clinical competencies, assessed by the USMLE Step 2 CK, NBME medicine exam, and an eight-station objective structured clinical examination (OSCE), were strong predictors of internship performance. Neither the USMLE Step 1 nor the inpatient internal medicine clerkship evaluation predicted internship performance. The undergraduate assessments as a whole showed a significant collective relationship with internship performance (ΔR 2  = 0.12, p < 0.001). The study supports the use of clinical competency assessments, instead of pre-clinical measures, in graduate admission consideration. It also provides validity evidence for OSCE scores in the prediction of workplace performance.

Comparison of the problem based learning-driven with the traditional didactic-lecture-based curricula.

PubMed

Zahid, Muhammad A; Varghese, Ramani; Mohammed, Ahmed M; Ayed, Adel K

2016-06-12

To compare the Problem-based learning (PBL) with the traditional lecture-based curricula. The single best answer Multiple Choice Questions (MCQ) and the Objective Structured Clinical Examination (OSCE) were used to compare performance of the lecture-based curriculum with the PBL medical student groups. The reliability for the MCQs and OSCE was calculated with Kuder-Richardson formula and Cronbach's alpha, respectively. The content validity of the MCQs and OSCE were tested by the Independent Subject Experts (ISE). The Student's t-test for independent samples was used to compare the item difficulty of the MCQs and OSCE's, and the Chi-square test was used to compare the grades between the two student groups. The PBL students outperformed the old curriculum students in overall grades, theoretical knowledge base (tested with K2 type MCQs) and OSCE. The number of the PBL students with scores between 80-90% (grade B) was significantly (p=0.035) higher while their number with scores between 60 to 69% (grade C) was significantly p=0.001) lower than the old curriculum students. Similarly, the mean MCQ and the OSCE scores of the new curriculum students were significantly higher (p = 0.001 and p = 0.025, respectively) than the old curriculum students. Lastly, the old curriculum students found the K2-MCQs to be more (p = 0.001) difficult than the single correct answer (K1 type) MCQs while no such difference was found by the new curriculum students. Suitably designed MCQs can be used to tap the higher cognitive knowledge base acquired in the PBL setting.

Lateral hip pain: findings from magnetic resonance imaging and clinical examination.

PubMed

Woodley, Stephanie J; Nicholson, Helen D; Livingstone, Vicki; Doyle, Terence C; Meikle, Grant R; Macintosh, Janet E; Mercer, Susan R

2008-06-01

Prospective cross-sectional study. To examine the radiological and physical therapy diagnoses of lateral hip pain (LHP), and determine the validity of selected clinical variables for predicting gluteal tendon pathology. LHP is frequently encountered by clinicians. Further investigation is required to establish the specific pathologies implicated in the cause of LHP, and which clinical tests are useful in the assessment of this problem. Forty patients with unilateral LHP underwent a physical therapy examination followed by magnetic resonance imaging (MRI) studies. Three radiologists analyzed the images of both hips for signs of pathology. Interobserver reliability of the image analyses, the agreement between the physical therapy and radiological diagnoses, and the validity of the clinical tests were examined. Gluteus medius tendon pathology, bursitis, osteoarthritis and gluteal muscle atrophy (predominantly affecting gluteus minimus) were all implicated in the imaging report of LHP. While prevalent in symptomatic hips, abnormalities were also identified in asymptomatic hips, particularly relating to the diagnosis of bursitis. The strength of agreement between radiologists was variable and little agreement existed between the physical therapy and radiological diagnoses of pathology. Nine of the 26 clinical variables examined in relation to gluteal tendon pathology had likelihood ratios above 2.0 or below 0.5, but the associated 95% confidence intervals were large. The diagnosis of LHP is challenging and our results highlight some problems associated with the use of MRI as a diagnostic reference standard. This factor, together with the imprecise point estimates of the likelihood ratios, means that no firm conclusions can be made regarding the diagnostic utility of the clinical tests used in the assessment of gluteal tendon pathology.

Test anxiety and academic performance in chiropractic students.

PubMed

Zhang, Niu; Henderson, Charles N R

2014-01-01

Objective : We assessed the level of students' test anxiety, and the relationship between test anxiety and academic performance. Methods : We recruited 166 third-quarter students. The Test Anxiety Inventory (TAI) was administered to all participants. Total scores from written examinations and objective structured clinical examinations (OSCEs) were used as response variables. Results : Multiple regression analysis shows that there was a modest, but statistically significant negative correlation between TAI scores and written exam scores, but not OSCE scores. Worry and emotionality were the best predictive models for written exam scores. Mean total anxiety and emotionality scores for females were significantly higher than those for males, but not worry scores. Conclusion : Moderate-to-high test anxiety was observed in 85% of the chiropractic students examined. However, total test anxiety, as measured by the TAI score, was a very weak predictive model for written exam performance. Multiple regression analysis demonstrated that replacing total anxiety (TAI) with worry and emotionality (TAI subscales) produces a much more effective predictive model of written exam performance. Sex, age, highest current academic degree, and ethnicity contributed little additional predictive power in either regression model. Moreover, TAI scores were not found to be statistically significant predictors of physical exam skill performance, as measured by OSCEs.

Continuous Practice-Based Research on the Use of Standardized Patients: Experience from Shanghai Medical College of Fudan University

ERIC Educational Resources Information Center

Zeng, Yong; Wu, Yan; Lai, Yanni; Lu, Yingqing; Zou, Hejian; Feng, Xueshan

2014-01-01

In the past ten years, the objective structured clinical examination (OSCE) project team of the Shanghai Medical College of Fudan University has continuously conducted further study on the development and maintenance of standardized patients and their application in teaching. The team carried out a series of randomized controlled studies on the…

Too much small talk? Medical students' pelvic examination skills falter with pleasant patients.

PubMed

Posner, Glenn D; Hamstra, Stanley J

2013-12-01

The competent performance of a female pelvic examination requires both technical proficiency and superlative communication skills. However, the ideal medium with which to assess these skills remains to be elucidated. Part-task trainers (PTTs) offer an effective and affordable means of testing technical skills, but may not allow students to demonstrate their communication skills. Hybrids involving standardised patients (SPs) (SP-PTT) offer a more realistic assessment of communication, but students may feel awkward when examining the female genitalia. The objective of this study was to compare the use of PTTs with that of SP-PTT hybrids in the assessment of technical and communication skills in the female pelvic examination. A total of 145 medical students were randomised to one of three conditions during their summative objective structured clinical examination (OSCE) at the completion of clerkship. Students performed the female pelvic examination on: (i) a PTT alone ('plastic' condition); (ii) an SP-PTT hybrid with an SP who did not engage in any superfluous conversation ('perfunctory' condition), or (iii) an SP-PTT hybrid with an SP who was trained to offer small talk and banter, which was judged to better reflect the typical doctor-patient interaction ('pleasant' condition). Communication skills did not differ significantly among the three groups (p = 0.354). There was a significant difference among groups in technical skills scores (p = 0.0018). Students in the 'plastic' condition performed best, followed by those in the 'perfunctory' and 'pleasant' conditions, respectively. Medical students demonstrate equivalent communication skills whether they work with a PTT or an SP-PTT hybrid, but their technical skills suffer in the presence of an SP. Working with the PTT alone does not appear to disadvantage students in terms of communication skills, but may offer better conditions for performing technical aspects of the procedure. Whether the 'plastic patient' is

The effect on reliability and sensitivity to level of training of combining analytic and holistic rating scales for assessing communication skills in an internal medicine resident OSCE.

PubMed

Daniels, Vijay John; Harley, Dwight

2017-07-01

Although previous research has compared checklists to rating scales for assessing communication, the purpose of this study was to compare the effect on reliability and sensitivity to level of training of an analytic, a holistic, and a combined analytic-holistic rating scale in assessing communication skills. The University of Alberta Internal Medicine Residency runs OSCEs for postgraduate year (PGY) 1 and 2 residents and another for PGY-4 residents. Communication stations were scored with an analytic scale (empathy, non-verbal skills, verbal skills, and coherence subscales) and a holistic scale. Authors analyzed reliability of individual and combined scales using generalizability theory and evaluated each scale's sensitivity to level of training. For analytic, holistic, and combined scales, 12, 12, and 11 stations respectively yielded a Phi of 0.8 for the PGY-1,2 cohort, and 16, 16, and 14 stations yielded a Phi of 0.8 for the PGY-4 cohort. PGY-4 residents scored higher on the combined scale, the analytic rating scale, and the non-verbal and coherence subscales. A combined analytic-holistic rating scale increased score reliability and was sensitive to level of training. Given increased validity evidence, OSCE developers should consider combining analytic and holistic scales when assessing communication skills. Copyright © 2017 Elsevier B.V. All rights reserved.

[A school-level longitudinal study of clinical performance examination scores].

PubMed

Park, Jang Hee

2015-06-01

This school-level longitudinal study examined 7 years of clinical performance data to determine differences (effects) in students and annual changes within a school and between schools; examine how much their predictors (characteristics) influenced the variation in student performance; and calculate estimates of the schools' initial status and growth. A school-level longitudinal model was tested: level 1 (between students), level 2 (annual change within a school), and level 3 (between schools). The study sample comprised students who belonged to the CPX Consortium (n=5,283 for 2005~2008 and n=4,337 for 2009~2011). Despite a difference between evaluation domains, the performance outcomes were related to individual large-effect differences and small-effect school-level differences. Physical examination, clinical courtesy, and patient education were strongly influenced by the school effect, whereas patient-physician interaction was not affected much. Student scores are influenced by the school effect (differences), and the predictors explain the variation in differences, depending on the evaluation domain.

Therapist turnover and new program sustainability in mental health clinics as a function of organizational culture, climate, and service structure.

PubMed

Glisson, Charles; Schoenwald, Sonja K; Kelleher, Kelly; Landsverk, John; Hoagwood, Kimberly Eaton; Mayberg, Stephen; Green, Philip

2008-03-01

The present study incorporates organizational theory and organizational characteristics in examining issues related to the successful implementation of mental health services. Following the theoretical foundations of socio-technical and cultural models of organizational effectiveness, organizational climate, culture, legal and service structures, and workforce characteristics are examined as correlates of therapist turnover and new program sustainability in a nationwide sample of mental health clinics. Results of General Linear Modeling (GLM) with the organization as the unit of analysis revealed that organizations with the best climates as measured by the Organizational Social Context (OSC) profiling system, had annual turnover rates (10%) that were less than half the rates found in organizations with the worst climates (22%). In addition, organizations with the best culture profiles sustained new treatment or service programs over twice as long (50 vs. 24 months) as organizations with the worst cultures. Finally, clinics with separate children's services units had higher turnover rates than clinics that served adults and children within the same unit. The findings suggest that strategies to support the implementation of new mental health treatments and services should attend to organizational culture and climate, and to the compatibility of organizational service structures with the demand characteristics of treatments.

Caries assessment by clinical examination with or without radiographs of young Chinese adults.

PubMed

Chu, C H; Chung, B T O; Lo, E C M

2008-10-01

To compare caries status assessment of posterior teeth of young Chinese adults by using clinical examination alone and with the supplemental use of bitewing radiographs. Two calibrated dentists examined the posterior teeth of 200 Chinese university students (aged 18-24 years) using dental mirrors and probes under optimal lighting. Caries was diagnosed by visual detection of carious cavities. Duplicate examinations were performed to monitor intra- and inter-examiner variations. Bitewing radiographs were taken and examined by an independent dentist. Caries was recorded when a lesion extended into dentine. Among the 3,162 posterior teeth examined, 113 were detected with caries. More than one third (35.4%) of the caries found in the posterior teeth was not detected from reading the radiographs but was detected by clinical examination. About half (51.4%) of the caries was found on the bitewing radiographs only, leaving 13.2% being detected by using either method. With the supplement of bitewing radiographs, there was a 105% increase in the number of carious lesions detected. This leads to a correction factor of 1.13 for adjustment of the mean DMFT score obtained from conducting clinical examinations alone. Due to the significant number of clinically undetected carious cavities in these young Chinese adults who live in a community with water fluoridation, it may be advisable to use a correction factor to adjust the caries experience obtained from epidemiological surveys when bitewing radiographs are not available.

Clinical assessment, gross examination, frozen section of ovarian masses: do patients benefit?

PubMed

Ghaemmaghami, Fatemah; Fakour, Fereshteh; Karimi Zarchi, Mojgan; Behtash, Nadereh; Modares Gilani, Mitra; Mousavi, Azamsadat; Shariat, Mamak

2008-09-01

The overall risk of malignancy in ovarian neoplasm is 13% in premenopausal women and 45% in postmenopausal women. Differentiating benign and malignant disease with frozen section is possible during operation; however, information on patients' history, physical examination, paraclinical criteria (tumour markers, imaging) and gross examination of tumour can also be helpful in planing the surgery. This study was conducted on 150 women who underwent laparotomy due to adnexal mass between April 2003 and October 2005 at Vali-e-Asr Hospital, Tehran, Iran. Sensitivity and specificity of clinical assessment (history, tumour marker and imaging), gross examination and frozen section were calculated. Based on our findings frozen section had the highest sensitivity for diagnosing malignant tumour comparing with other methods of diagnosis (88.9%). Sensitivity was 71.3% for preoperative clinical examination, 83% for ultrasonography, 89.8% for CT scan, 70% for CA125 and 84.1% for gross examination, likewise the highest specificity was seen for frozen section (93.5%). This data confirm that frozen section diagnosis is a reliable method for the surgical management of patients with an ovarian mass, but history of disease, Para clinical criteria and gross examination can help to surgeon to perform on appropriate operation in the areas where frozen section is not possible.

Novel examination for evaluating medical student clinical reasoning: reliability and association with patients seen.

PubMed

Hemmer, Paul A; Dong, Ting; Durning, Steven J; Pangaro, Louis N

2015-04-01

Medical students learn clinical reasoning, in part, through patient care. Although the numbers of patients seen is associated with knowledge examination scores, studies have not demonstrated an association between patient problems and an assessment of clinical reasoning. To examine the reliability of a clinical reasoning examination and investigate whether there was association between internal medicine core clerkship students' performance on this examination and the number of patients they saw with matching problems during their internal medicine clerkship. Students on the core internal medicine clerkship at the Uniformed Services University students log 11 core patient problems based on the Clerkship Directors in Internal Medicine curriculum. On a final clerkship examination (Multistep), students watch a scripted video encounter between physician and patient actors that assesses three sequential steps in clinical reasoning: Step One focuses on history and physical examination; Step Two, students write a problem list after viewing additional clinical findings; Step Three, students complete a prioritized differential diagnosis and treatment plan. Each Multistep examination has three different cases. For graduating classes 2010-2012 (n = 497), we matched the number of patients seen with the problem most represented by the Multistep cases (epigastric pain, generalized edema, monoarticular arthritis, angina, syncope, pleuritic chest pain). We report two-way Pearson correlations between the number of patients students reported with similar problems and the student's percent score on: Step One, Step Two, Step Three, and Overall Test. Multistep reliability: Step 1, 0.6 to 0.8; Step 2, 0.41 to 0.65; Step 3, 0.53 to 0.78; Overall examination (3 cases): 0.74 to 0.83. For three problems, the number of patients seen had small to modest correlations with the Multistep Examination of Analytic Ability total score (r = 0.27 for pleuritic pain, p < 0.05, n = 81 patients; r = 0

Distant peer-tutoring of clinical skills, using tablets with instructional videos and Skype: A pilot study in the UK and Malaysia.

PubMed

O'Donovan, James; Maruthappu, Mahiben

2015-05-01

To assess the feasibility and impact of using low-cost Android tablets to deliver video tutorials and remote online peer-tutoring for clinical skills between two countries. Nine junior medical students from Malaysia were paired with five senior medical students from the UK, who played the role of peer-tutors. Students from Malaysia were given a low-cost Android tablet from which they could access instructional video tutorials. At the end of each week, the peer-tutors would observe their peer-learners as they performed a clinical examination. Tutors would then provide individual feedback using a videoconferencing tool. Outcomes were assessed using Observed Structured Clinical Examination (OSCE) scores, post-study questionnaires and semi-structured interviews with participants. Peer-learners reported an increased confidence in clinical examination of 8.4 (±1.0) on a 10-point scale and all nine said they would recommend the scheme to their peers. Both peer-tutors and peer-learners were able to establish a strong rapport over video, rating it as 8.4 (±0.6) and 8.4 (±0.9), respectively. Peer-learners' rated the sound and video quality of the tablet as 7.0 (±1.1) but were less satisfied with the screen resolution of the tablet, rating this as 4.0 (±1.5). This preliminary pilot study presents an innovative, low cost approach to international medical education with significant potential for future development.

Peer feedback for examiner quality assurance on MRCGP International South Asia: a mixed methods study.

PubMed

Perera, D P; Andrades, Marie; Wass, Val

2017-12-08

The International Membership Examination (MRCGP[INT]) of the Royal College of General Practitioners UK is a unique collaboration between four South Asian countries with diverse cultures, epidemiology, clinical facilities and resources. In this setting good quality assurance is imperative to achieve acceptable standards of inter rater reliability. This study aims to explore the process of peer feedback for examiner quality assurance with regard to factors affecting the implementation and acceptance of the method. A sequential mixed methods approach was used based on focus group discussions with examiners (n = 12) and clinical examination convenors who acted as peer reviewers (n = 4). A questionnaire based on emerging themes and literature review was then completed by 20 examiners at the subsequent OSCE exam. Qualitative data were analysed using an iterative reflexive process. Quantitative data were integrated by interpretive analysis looking for convergence, complementarity or dissonance. The qualitative data helped understand the issues and informed the process of developing the questionnaire. The quantitative data allowed for further refining of issues, wider sampling of examiners and giving voice to different perspectives. Examiners stated specifically that peer feedback gave an opportunity for discussion, standardisation of judgments and improved discriminatory abilities. Interpersonal dynamics, hierarchy and perception of validity of feedback were major factors influencing acceptance of feedback. Examiners desired increased transparency, accountability and the opportunity for equal partnership within the process. The process was stressful for examiners and reviewers; however acceptance increased with increasing exposure to receiving feedback. The process could be refined to improve acceptability through scrupulous attention to training and selection of those giving feedback to improve the perceived validity of feedback and improved reviewer feedback

Examination of Racial Differences on the MMPI-2 Clinical and Restructured Clinical Scales in an Outpatient Sample

ERIC Educational Resources Information Center

Castro, Yessenia; Gordon, Kathryn H.; Brown, Jessica S.; Anestis, Joye C.; Joiner, Thomas E., Jr.

2008-01-01

The current study examined the possibility of differential predictive accuracy of selected Minnesota Multiphasic Personality Inventory-Second Edition (MMPI-2) clinical and Restructured Clinical (RC) scales in a group of Black and White mental health center clients. Results indicate that Black clients scored higher than White clients on one…

Near-peer education: a novel teaching program

PubMed Central

Premnath, Daphne

2016-01-01

Objectives This study aims to: 1) Evaluate whether a near-peer program improves perceived OSCE performance; 2) Identify factors motivating students to teach; 3) Evaluate role of near-peer teaching in medical education. Methods A near-peer OSCE teaching program was implemented at Monash University’s Peninsula Clinical School over the 2013 academic year. Forty 3rd-year and thirty final-year medical students were recruited as near-peer learners and educators, respectively. A post-program questionnaire was completed by learners prior to summative OSCEs (n=31), followed by post-OSCE focus groups (n=10). Near-peer teachers were interviewed at the program’s conclusion (n=10). Qualitative data was analysed for emerging themes to assess the perceived value of the program. Results Learners felt peer-led teaching was more relevant to assessment, at an appropriate level of difficulty and delivered in a less threatening environment than other methods of teaching. They valued consistent practice and felt confident approaching their summative OSCEs. Educators enjoyed the opportunity to develop their teaching skills, citing mutual benefit and gratitude to past peer-educators as strong motivators to teach others. Conclusions Near-peer education, valued by near-peer learners and teachers alike, was a useful method to improve preparation and perceived performance in summative examinations. In particular, a novel year-long, student-run initiative was regarded as a valuable and feasible adjunct to faculty teaching. PMID:27239951

Formative assessment of GP trainees' clinical skills.

PubMed

Wiener-Ogilvie, Sharon; Begg, Drummond

2012-03-01

Clinical skill assessment (CSA) has been an integral part of the Royal College of General Practitioners' membership examination (MRCGP) since 2008. It is an expensive, high-stakes examination with first time pass rates ranging from 76.4 to 81.3. In this paper we describe the South East Scotland Deanery, NHS Education Scotland, pilot of a formative clinical skills assessment (fCSA) using the principles of formative assessment and OSCE. The purpose of the study was to assess the acceptability of the fCSA and to examine whether trainees, identified during the fCSA as 'at risk of failing the MRCGP CSA exam', are more likely to fail the MRCGP CSA exam later on in the year. Trainees were assessed in four clinical skills stations under exam conditions. After each station they were given verbal feedback and subsequently both trainee and their trainer received written feedback. We assessed the value of the exercise through written feedback from trainees and trainers. Each trainee's performance in fCSA was triangulated with trainer assessment to identify 'flagged trainees'. We compared flagged and non-flagged trainees' performance in MRCGP CSA. Both trainees and trainers highly rated the fCSA. Overall 97% of non-flagged trainees have passed the RCGP CSA exam by May of that year in comparison to 80% of flagged trainees who have passed the RCGP CSA (P = 0.005). Trainers and trainees rated the fCSA as excellent and useful. We were able to demonstrate that the fCSA can be used to identify those trainees likely to fail the RCGP CSA. Contrary to reservations about the potential to demoralise trainees, the fCSA was viewed as a useful and a positive experience by both trainees and trainers. In addition, we suggest that feedback from fCSA was useful in triggering appropriate educational interventions. Early intervention with trainees who are predicted to fail the CSA has the potential to reduce deaneries overall fail rate. Preventing one trainee failure could save over £30 000.

Assessing cultural competency skills in gastroenterology fellowship training.

PubMed

Balzora, Sophie; Abiri, Benjamin; Wang, Xiao-Jing; McKeever, James; Poles, Michael; Zabar, Sondra; Gillespie, Colleen; Weinshel, Elizabeth

2015-02-14

To assess and teach cultural competency skills at the fellowship training level through the use of objective structured clinical examinations (OSCEs). We revised four scenarios to infuse a specific focus on cross-cultural care, and to render them appropriate for gastroenterology fellows. Three are discussed here: (1) Poor Health Literacy; (2) Disclosing/Apologizing for a Complication to a Patient Who Mistrusts the Healthcare System; and (3) Breaking Bad News to a Fatalistic Patient. A fourth case emphasizing shared decision-making will be described elsewhere. Four stations were completed by fellows and observed live by four faculty members, and the fellows' performance was assessed. Eleven fellows from four programs participated in the four OSCE. In the "Poor Health Literacy" case, 18% (2/11) of participants recognized that the standardized patient (SP) had below-basic health literacy. None successfully evaluated the SP's reading skills in a culturally-sensitive manner. In "Disclosing/Apologizing for a Complication", 4/11 (36%) personally apologized for the complication. 1/11 recognized the SP's mistrust of the medical system. With "Breaking Bad News", 27% (3/11) explored the patient's values to identify her fatalistic beliefs. OSCEs can be used to assess deficiencies in culturally-competent care at the fellowship level. OSCEs also afford fellowships the opportunity to inform future training curricula.

Long-term effectiveness of patient-centered training in cultural competence: what is retained? What is lost?

PubMed

Ho, Ming-Jung; Yao, Grace; Lee, Keng-Lin; Hwang, Tzung-Jeng; Beach, Mary Catherine

2010-04-01

To determine whether the effects of a patient-centered cultural competence curriculum could be sustained for one year. In 2006, 57 fifth-year medical students at National Taiwan University were randomly assigned either to a group that received training in patient-centered cross-cultural communication skills or one that received no training. Students' scores on objective structured clinical exams (OSCEs) were compared in the realms of exploring (1) patient perspectives and (2) social factors related to illness, immediately after training (OSCE1) and one year after training (OSCE2). Regarding students' exploration of patient perspectives, the intervention group scored significantly higher than the control group at OSCE1, but there was a significant decrease from OSCE1 to OSCE2 in the intervention group and no significant difference between the intervention and control group at OSCE2. Regarding students' exploration of social factors related to illness, the intervention group scored significantly higher than the control group at OSCE1, with a nonsignificant decrease from OSCE1 to OSCE2 in the two groups, such that the intervention group again scored higher than the control group in OSCE2. The effect of a patient-centered cultural competence training curriculum on students' exploration of social factors related to illness was sustained to a significant degree after one year, whereas the effects on students' exploration of patient perspectives were not. Further research is needed to determine the extent to which additional training can prevent the loss of student skills.

Clinical skills center attending: an innovative senior medical school elective.

PubMed

Moseley, Thomas H; Cantrell, Mary J; Deloney, Linda A

2002-11-01

Although residents are expected to assume teaching responsibilities, the traditional medical school curriculum does not formally prepare students for the teaching role. In 1999 an elective was developed to provide senior medical students with opportunities to acquire instructional and leadership skills by participating in clinical education activities as a clinical skills center attending. This elective also allowed the senior student to explore academic medicine as a potential career choice. During the four-week elective, a senior student acted as an attending in the clinical skills center (CSC), a state-of-the-art facility that is designed and equipped for teaching and testing medical skills. (The CSC has ten fully operational patient examining rooms for student-patient interaction, and each room is equipped with dual cameras and two-way audio response capability.) The participating student spent approximately 40 hours per week teaching clinical skills to freshmen, sophomore, and junior medical students and assisting with testing activities for the Colleges of Medicine, Pharmacy, and Nursing. A specific requirement for full credit was writing an objective standardized clinical examination (OSCE) case. The case format required development of a checklist for minimal competencies of the examinee and suggested techniques for evaluating those competencies. Another specific requirement was that the senior student participate in the training of standardized patients to portray one or more OSCE cases. Other activities were tailored to meet the needs of the senior student and/or users of the CSC. Two course co-directors provided guidance for all students. Evaluation was on a "pass/fail" basis. There were no written or oral exams. The purpose of the elective was achieved through individual research and completion of the assigned activities. This elective was first offered to senior medical students at during 1999-2000. Each student participated in an average of ten

Investigating possible ethnicity and sex bias in clinical examiners: an analysis of data from the MRCP(UK) PACES and nPACES examinations.

PubMed

McManus, I C; Elder, Andrew T; Dacre, Jane

2013-07-30

Bias of clinical examiners against some types of candidate, based on characteristics such as sex or ethnicity, would represent a threat to the validity of an examination, since sex or ethnicity are 'construct-irrelevant' characteristics. In this paper we report a novel method for assessing sex and ethnic bias in over 2000 examiners who had taken part in the PACES and nPACES (new PACES) examinations of the MRCP(UK). PACES and nPACES are clinical skills examinations that have two examiners at each station who mark candidates independently. Differences between examiners cannot be due to differences in performance of a candidate because that is the same for the two examiners, and hence may result from bias or unreliability on the part of the examiners. By comparing each examiner against a 'basket' of all of their co-examiners, it is possible to identify examiners whose behaviour is anomalous. The method assessed hawkishness-doveishness, sex bias, ethnic bias and, as a control condition to assess the statistical method, 'even-number bias' (i.e. treating candidates with odd and even exam numbers differently). Significance levels were Bonferroni corrected because of the large number of examiners being considered. The results of 26 diets of PACES and six diets of nPACES were examined statistically to assess the extent of hawkishness, as well as sex bias and ethnicity bias in individual examiners. The control (odd-number) condition suggested that about 5% of examiners were significant at an (uncorrected) 5% level, and that the method therefore worked as expected. As in a previous study (BMC Medical Education, 2006, 6:42), some examiners were hawkish or doveish relative to their peers. No examiners showed significant sex bias, and only a single examiner showed evidence consistent with ethnic bias. A re-analysis of the data considering only one examiner per station, as would be the case for many clinical examinations, showed that analysis with a single examiner runs a serious

Obstetrics and gynecology clerkship for males and females: similar curriculum, different outcomes?

PubMed Central

Craig, LaTasha B.; Smith, Chad; Crow, Sheila M.; Driver, Whitney; Wallace, Michelle; Thompson, Britta M.

2013-01-01

Objective To determine if performance differences exist between male and female students on a 6-week obstetrics and gynecology (Ob/Gyn) clerkship and to evaluate potential variables that might underlie any observed variations. Study Design Final clerkship grades and component scores (clinical evaluations, objective structured clinical examination [OSCE], oral examination, and National Board of Medical Examiners [NBME] subject examination) from July 2007 to June 2010 were matched by student and analyzed by gender. Basic science grade point average (GPA) and initial United States Medical Licensing Exam (USMLE) Step 1 scores were used to establish students’ baseline medical knowledge. On a post-clerkship questionnaire, a subset of students reported the numbers of procedures they performed during the clerkship; students also completed online pre- and post-clerkship questionnaires reflecting their self-assessed confidence in women's health clinical skills. Results Scores were analyzed for 136 women and 220 men. Final clerkship grades were significantly higher for females than for males (89.05 vs. 87.34, p=0.0004, η 2=0.08). Specifically, females outscored males on the OSCE, oral, and NBME subject examination portions of the clerkship but not clinical evaluations. Males reported completing fewer breast examinations (p=0.001, η 2=0.14). Pre-clerkship, males were significantly less confident than females in women's health clinical skills (p<0.01) but reached similar levels upon completion of the clerkship. No gender differences were detected for basic science GPA and USMLE Step 1 scores. Conclusion Student gender is associated with final grades on an Ob/Gyn clerkship. Further research regarding these differences should be explored. PMID:24300748

Prevalence of clinical findings at examinations of young Swedish warmblood riding horses

PubMed Central

2013-01-01

Background Soundness of an individual horse is important for animal welfare and owner economy. However, knowledge of health status in normal horse populations is limited due to lack of systematic health recordings. The aim of the investigation was to study the prevalence of veterinary clinical findings in 4-5-year-old Swedish warmblood riding horses, and their influence on overall health scores, where associations to future longevity has been indicated. Results The prevalence of clinical findings in 8,281 horses examined during 1983–2005 was studied according to a standardised protocol and related to overall health scores in linear statistical models. Effects of sex, age, examination event and changes over time were included. In total, 49% of the horses had clinical findings of medical health (MED), 42% in hooves (HOOF) and 74% of palpatory orthopaedic health (PALP). However, only 6%, 3% and 24% had moderate or severe findings, of MED, HOOF and PALP, respectively. Flexion test reactions were reported in 21% of the horses (5% moderate/severe), heavily influencing the overall score (H2). One fifth of these horses also had findings of unprovoked lameness while 83% had PALP findings (44% with moderate/severe findings). Acute clinical signs, i.e. heat or soreness, had a large influence on the H2 score but were rare, whereas more common clinical findings had smaller effects on overall health. Large variations in recorded health results were observed among events. A decrease in findings has occurred since 1983, in particular for PALP findings. Conclusions Results of occurrence and relevance of evaluated clinical findings could be used for advice on preventive actions to keep horses sound, and possibly for benchmarking, and genetic evaluation of health traits. The distinct effect of event on recorded clinical findings emphasises that further harmonisation of veterinary examinations are desirable. PMID:23597257

Correlation of clinical examination characteristics with three sources of chronic low back pain.

PubMed

Young, Sharon; Aprill, Charles; Laslett, Mark

2003-01-01

Research has demonstrated some progress in using a clinical examination to predict discogenic or sacroiliac (SI) joint sources of pain. No clear predictors of symptomatic lumbar zygapophysial joints have yet been demonstrated. To identify significant components of a clinical examination that are associated with symptomatic lumbar discs, zygapophysial joints and SI joints. A prospective, criterion-related concurrent validity study performed at a private radiology practice specializing in spinal diagnostics. The sample consisted of 81 patients with chronic lumbopelvic pain referred for diagnostic injections. Contingency tables were constructed for nine features of the clinical evaluation compared with the results of diagnostic injections. Statistical analysis included chi-squared test for independence, phi and odds ratios with confidence intervals. Patients received blinded clinical examinations by physical therapists, and diagnostic injections were used as the criterion standard. Significant relationships were found between discogenic pain and centralization of pain during repeated movement testing, and pain when rising from sitting. Lumbar zygapophysial joint pain was associated with absence of pain when rising from sitting. Sacroiliac joint pain was related to three or more positive pain provocation tests, pain when rising from sitting, unilateral pain and absence of lumbar pain. Significant correlations exist between clinical examination findings and symptomatic lumbar discs, zygapophysial and SI joints. The strongest relationships were seen between SI joint pain and three or more positive pain provocation tests, centralization of pain for symptomatic discs and absence of pain when rising from sitting for symptomatic lumbar zygapophysial joints.

[Authorized Qualifications of Staff Conducting Examinations in the Field of Clinical Microbiology].

PubMed

Nishiyama, Hiroyuki

2015-04-01

Because of the increase in healthcare-associated infections, appearance of highly resistant bacteria, and that of emerging/re-emerging infectious diseases, it is necessary for the skills of clinical microbiological technologists and the associated technology to be improved. Technologist in Microbiology (4,717 certified) and Specialist in Microbiology (58 certified) are authorized qualifications in the field of examination for clinical microbiology, with a history of 60 years, and Clinical Microbiological Technologist (670 certified) and Infection Control Microbiological Technologist (ICMT) (528 certified) are necessary qualifications to become a member of an infection control team. As problems to be resolved, clarifying the relationships among the authorized qualifications, reconsidering the fairness of evaluating written examinations, and further consideration of the administration method for an increasing number of examinees need to be tackled.

[Skills lab training in veterinary medicine. Effective preparation for clinical work at the small animal clinic of the University for Veterinary Medicine Hannover, Foundation].

PubMed

Engelskirchen, Simon; Ehlers, Jan; Kirk, Ansgar T; Tipold, Andrea; Dilly, Marc

2017-09-20

During five and a half years of studying veterinary medicine, students should in addition to theoretical knowledge acquire sufficient practical skills. Considering animal welfare and ethical aspects, opportunities for hands-on learning on living animals are limited because of the high annual number of students. The first German veterinary clinical-skills lab, established in 2013 at the University for Veterinary Medicine Hannover, Foundation (TiHo), offers opportunities for all students to learn, train and repeat clinical skills on simulators and models as frequently as they would like, until they feel sufficiently confident to transfer these skills to living animals. This study describes the establishment of clinical-skills lab training within the students' practical education, using the example of the small-animal clinic of the TiHo. Two groups of students were compared: without skills lab training (control group K) and with skills lab training (intervention group I). At the end of both the training and a subsequent 10-week clinical rotation in different sections of the clinic, an objective structured clinical examination (OSCE) was performed, testing the students' practical skills at 15 stations. An additional multiple-choice test was performed before and after the clinical rotation to evaluate the increased theoretical knowledge. Students of group I achieved significantly (p ≤ 0.05) better results in eight of the 15 tested skills. The multiple-choice test revealed a significant (p ≤ 0.05) gain of theoretical knowledge in both groups without any differences between the groups. Students displayed a high degree of acceptance of the skills lab training. Using simulators and models in veterinary education is an efficient teaching concept, and should be used continually and integrated in the curriculum.

Viewpoint: suggestions for a shift in teaching clinical skills to medical students: the reflective clinical examination.

PubMed

Benbassat, Jochanan; Baumal, Reuben; Heyman, Samuel N; Brezis, Mayer

2005-12-01

How medical students are taught physical examination (PE) skills appears to have changed little since the 1950s. Textbooks are organized according to organ systems and describe methods of eliciting and recording history and PE data using a routine format. In many medical schools, the preclinical teaching programs for clinical examination skills similarly emphasize an orderly collection of data. Teaching students to use diagnostic reasoning is postponed until students have learned history-taking and PE skills. The authors propose three modifications to this educational approach. First, rather than performing the clinical examination using a routine format, students should be encouraged to form diagnostic hypotheses early on while listening to the patient's narrative, and conduct the subsequent search for history and PE data in a reflective way in order to confirm or refute these hypotheses. Second, the authors propose that interviewing patients and conducting the PE be taught by one-on-one tutoring until students achieve mastery. Last, they suggest that the PE be guided not only by students' diagnostic hypotheses, but also by patients' expectations. These modifications are consistent with current trends in medical education that encourage a reflective practice and problem-based learning (PBL), and they also introduce medical students to the precepts of clinical reasoning. The authors suggest that challenging students to seek specific physical findings may increase the likelihood of detecting findings when they are present, and may transform patient interviewing and conducting the PE from routine activities into intellectually exciting experiences.

Special Physical Examination Tests for Superior Labrum Anterior-Posterior Shoulder Tears: An Examination of Clinical Usefulness

PubMed Central

Sandrey, Michelle A.

2013-01-01

Reference/Citation: Calvert E, Chambers GK, Regan W, Hawkins RH, Leith JM. Special physical examination tests for superior labrum anterior-posterior shoulder injuries are clinically limited and invalid: a diagnostic systematic review. J Clin Epidemiol. 2009;62(5):558–563. Clinical Question: The systematic review focused on diagnostic accuracy studies to determine if evidence was sufficient to support the use of superior labrum anterior-posterior (SLAP) physical examination tests as valid and reliable. The primary question was whether there was sufficient evidence in the published literature to support the use of SLAP physical examination tests as valid and reliable diagnostic test procedures. Data Sources: Studies published in English were identified through database searches on MEDLINE, EMBASE, and the Cochrane database (1970–2004) using the search term SLAP lesions. The medical subject headings of arthroscopy, shoulder joint, and athletic injuries were combined with test or testing, physical examination, and sensitivity and specificity to locate additional sources. Other sources were identified by rereviewing the reference lists of included studies and review articles. Study Selection: Studies were eligible based on the following criteria: (1) published in English, (2) focused on the physical examination of SLAP lesions, and (3) presented original data. A study was excluded if the article was limited to a clinical description of 1 or more special tests without any research focus to provide clinical accuracy data or if it did not focus on the topic. Data Extraction: The abstracts that were located through the search strategies were reviewed, and potentially relevant abstracts were selected. Strict epidemiologic methods were used to obtain and collate all relevant studies; the authors developed a study questionnaire to record study name, year of publication, study design, sample size, and statistics. Validity of the diagnostic test study was determined by

Assessing the clinical utility of combined movement examination in symptomatic degenerative lumbar spondylosis.

PubMed

Monie, A P; Price, R I; Lind, C R P; Singer, K P

2015-07-01

The aim of this study is to report the development and validation of a low back computer-aided combined movement examination protocol in normal individuals and record treatment outcomes of cases with symptomatic degenerative lumbar spondylosis. Test-retest, following intervention. Self-report assessments and combined movement examination were used to record composite spinal motion, before and following neurosurgical and pain medicine interventions. 151 normal individuals aged from 20 years to 69 years were assessed using combined movement examination between L1 and S1 spinal levels to establish a reference range. Cases with degenerative low back pain and sciatica were assessed before and after therapeutic interventions with combined movement examination and a battery of self-report pain and disability questionnaires. Change scores for combined movement examination and all outcome measures were derived. Computer-aided combined movement examination validation and intraclass correlation coefficient with 95% confidence interval and least significant change scores indicated acceptable reliability of combined movement examination when recording lumbar movement in normal subjects. In both clinical cases lumbar spine movement restrictions corresponded with self-report scores for pain and disability. Post-intervention outcomes all showed significant improvement, particularly in the most restricted combined movement examination direction. This study provides normative reference data for combined movement examination that may inform future clinical studies of the technique as a convenient objective surrogate for important clinical outcomes in lumbar degenerative spondylosis. It can be used with good reliability, may be well tolerated by individuals in pain and appears to change in concert with validated measures of lumbar spinal pain, functional limitation and quality of life. Copyright © 2015 Elsevier Ltd. All rights reserved.

The predictive validity of selection for entry into postgraduate training in general practice: evidence from three longitudinal studies.

PubMed

Patterson, Fiona; Lievens, Filip; Kerrin, Máire; Munro, Neil; Irish, Bill

2013-11-01

The selection methodology for UK general practice is designed to accommodate several thousand applicants per year and targets six core attributes identified in a multi-method job-analysis study To evaluate the predictive validity of selection methods for entry into postgraduate training, comprising a clinical problem-solving test, a situational judgement test, and a selection centre. A three-part longitudinal predictive validity study of selection into training for UK general practice. In sample 1, participants were junior doctors applying for training in general practice (n = 6824). In sample 2, participants were GP registrars 1 year into training (n = 196). In sample 3, participants were GP registrars sitting the licensing examination after 3 years, at the end of training (n = 2292). The outcome measures include: assessor ratings of performance in a selection centre comprising job simulation exercises (sample 1); supervisor ratings of trainee job performance 1 year into training (sample 2); and licensing examination results, including an applied knowledge examination and a 12-station clinical skills objective structured clinical examination (OSCE; sample 3). Performance ratings at selection predicted subsequent supervisor ratings of job performance 1 year later. Selection results also significantly predicted performance on both the clinical skills OSCE and applied knowledge examination for licensing at the end of training. In combination, these longitudinal findings provide good evidence of the predictive validity of the selection methods, and are the first reported for entry into postgraduate training. Results show that the best predictor of work performance and training outcomes is a combination of a clinical problem-solving test, a situational judgement test, and a selection centre. Implications for selection methods for all postgraduate specialties are considered.

Education Research: Bias and poor interrater reliability in evaluating the neurology clinical skills examination

PubMed Central

Schuh, L A.; London, Z; Neel, R; Brock, C; Kissela, B M.; Schultz, L; Gelb, D J.

2009-01-01

Objective: The American Board of Psychiatry and Neurology (ABPN) has recently replaced the traditional, centralized oral examination with the locally administered Neurology Clinical Skills Examination (NEX). The ABPN postulated the experience with the NEX would be similar to the Mini-Clinical Evaluation Exercise, a reliable and valid assessment tool. The reliability and validity of the NEX has not been established. Methods: NEX encounters were videotaped at 4 neurology programs. Local faculty and ABPN examiners graded the encounters using 2 different evaluation forms: an ABPN form and one with a contracted rating scale. Some NEX encounters were purposely failed by residents. Cohen’s kappa and intraclass correlation coefficients (ICC) were calculated for local vs ABPN examiners. Results: Ninety-eight videotaped NEX encounters of 32 residents were evaluated by 20 local faculty evaluators and 18 ABPN examiners. The interrater reliability for a determination of pass vs fail for each encounter was poor (kappa 0.32; 95% confidence interval [CI] = 0.11, 0.53). ICC between local faculty and ABPN examiners for each performance rating on the ABPN NEX form was poor to moderate (ICC range 0.14-0.44), and did not improve with the contracted rating form (ICC range 0.09-0.36). ABPN examiners were more likely than local examiners to fail residents. Conclusions: There is poor interrater reliability between local faculty and American Board of Psychiatry and Neurology examiners. A bias was detected for favorable assessment locally, which is concerning for the validity of the examination. Further study is needed to assess whether training can improve interrater reliability and offset bias. GLOSSARY ABIM = American Board of Internal Medicine; ABPN = American Board of Psychiatry and Neurology; CI = confidence interval; HFH = Henry Ford Hospital; ICC = intraclass correlation coefficients; IM = internal medicine; mini-CEX = Mini-Clinical Evaluation Exercise; NEX = Neurology Clinical

Resuscitation skills after Helping Babies Breathe training: a comparison of varying practice frequency and impact on retention of skills in different types of providers.

PubMed

Tabangin, M E; Josyula, S; Taylor, K K; Vasquez, J C; Kamath-Rayne, B D

2018-05-01

Helping Babies Breathe (HBB), a basic neonatal resuscitation curriculum, improves early neonatal mortality in low-resource settings. Our goal was to determine retention of resuscitation skills by different cadres of providers using the approved HBB Spanish translation in a rural clinic and community hospital in Honduras. Twelve clinic and 37 hospital providers were trained in 1 d HBB workshops and followed from July 2012 to February 2014. Resuscitation skills were evaluated by objective structured clinical evaluations (OSCEs) at regular intervals. Clinic providers practiced monthly, whereas hospital providers were randomized to monthly practice for 6 months vs three consecutive practices at 3, 5 and 6 months. In the rural clinic, follow-up OSCE assessment showed rapid loss of skills by 1 month after HBB training. For all providers, repeated monthly testing resulted in improvements and maintenance of OSCE performance. In the community hospital, over all time points, the group with monthly OSCEs had 2.9 greater odds of passing compared with the group who practiced less frequently. Physicians were found to have 4.3 times greater odds of passing compared with nurses. Rapid loss of resuscitation skills occurs after an initial training. Repeated practice leads to retention of skills in all types of providers. Further investigation is warranted to determine the clinical correlation of neonatal outcomes after HBB training.

Thoracic outlet syndrome: a controversial clinical condition. Part 1: anatomy, and clinical examination/diagnosis

PubMed Central

Hooper, Troy L; Denton, Jeff; McGalliard, Michael K; Brismée, Jean-Michel; Sizer, Phillip S

2010-01-01

Thoracic outlet syndrome (TOS) is a frequently overlooked peripheral nerve compression or tension event that creates difficulties for the clinician regarding diagnosis and management. Investigators have categorized this condition as vascular versus neurogenic, where vascular TOS can be subcategorized as either arterial or venous and neurogenic TOS can subcategorized as either true or disputed. The thoracic outlet anatomical container presents with several key regional components, each capable of compromising the neurovascular structures coursing within. Bony and soft tissue abnormalities, along with mechanical dysfunctions, may contribute to neurovascular compromise. Diagnosing TOS can be challenging because the symptoms vary greatly amongst patients with the disorder, thus lending to other conditions including a double crush syndrome. A careful history and thorough clinical examination are the most important components in establishing the diagnosis of TOS. Specific clinical tests, whose accuracy has been documented, can be used to support a clinical diagnosis, especially when a cluster of positive tests are witnessed. PMID:21655389

Clinical breast examination screening by trained laywomen in Malawi integrated with other health services.

PubMed

Gutnik, Lily; Lee, Clara; Msosa, Vanessa; Moses, Agnes; Stanley, Christopher; Mzumara, Suzgo; Liomba, N George; Gopal, Satish

2016-07-01

Breast cancer awareness and early detection are limited in sub-Saharan Africa. Resource limitations make screening mammography or clinical breast examination (CBE) by physicians or nurses impractical in many settings. We aimed to assess feasibility and performance of CBE by laywomen in urban health clinics in Malawi. Four laywomen were trained to deliver breast cancer educational talks and conduct CBE. After training, screening was implemented in diverse urban health clinics. Eligible women were ≥30 y, with no prior breast cancer or breast surgery, and clinic attendance for reasons other than a breast concern. Women with abnormal CBE were referred to a study surgeon. All palpable masses confirmed by surgeon examination were pathologically sampled. Patients with abnormal screening CBE but normal surgeon examination underwent breast ultrasound confirmation. In addition, 50 randomly selected women with normal screening CBE underwent breast ultrasound, and 45 different women with normal CBE were randomly assigned to surgeon examination. Among 1220 eligible women, 1000 (82%) agreed to CBE. Lack of time (69%) was the commonest reason for refusal. Educational talk attendance was associated with higher CBE participation (83% versus 77%, P = 0.012). Among 1000 women screened, 7% had abnormal CBE. Of 45 women with normal CBE randomized to physician examination, 43 had normal examinations and two had axillary lymphadenopathy not detected by CBE. Sixty of 67 women (90%) with abnormal CBE attended the referral visit. Of these, 29 (48%) had concordant abnormal physician examination. Thirty-one women (52%) had discordant normal physician examination, all of whom also had normal breast ultrasounds. Compared with physician examination, sensitivity for CBE by laywomen was 94% (confidence interval [CI] 79%-99%), specificity 58% (CI, 46%-70%), positive predictive value 48% (CI, 35%-62%), and negative predictive value 96% (CI, 85%-100%). Of 13 women who underwent recommended

The American Society for Clinical Pathology resident in-service examination: does resident performance provide insight into the effectiveness of clinical pathology education?