Status of Competency-Based Medical Education in Endoscopy Training: A Nationwide Survey of US ACGME-Accredited Gastroenterology Training Programs.

PubMed

Patel, S G; Keswani, R; Elta, G; Saini, S; Menard-Katcher, P; Del Valle, J; Hosford, L; Myers, A; Ahnen, D; Schoenfeld, P; Wani, S

2015-07-01

The Accreditation Council for Graduate Medical Education (ACGME) emphasizes the importance of medical trainees meeting specific performance benchmarks and demonstrating readiness for unsupervised practice. The aim of this study was to examine the readiness of Gastroenterology (GI) fellowship programs for competency-based evaluation in endoscopic procedural training. ACGME-accredited GI program directors (PDs) and GI trainees nationwide completed an online survey of domains relevant to endoscopy training and competency assessment. Participants were queried about current methods and perceived quality of endoscopy training and assessment of competence. Participants were also queried about factors deemed important in endoscopy competence assessment. Five-point Likert items were analyzed as continuous variables by an independent t-test and χ(2)-test was used for comparison of proportions. Survey response rate was 64% (94/148) for PDs and 47% (546/1,167) for trainees. Twenty-three percent of surveyed PDs reported that they do not have a formal endoscopy curriculum. PDs placed less importance (1—very important to 5—very unimportant) on endoscopy volume (1.57 vs. 1.18, P<0.001), adenoma detection rate (2.00 vs. 1.53, P<0.001), and withdrawal times (1.96 vs. 1.68, P=0.009) in determining endoscopy competence compared with trainees. A majority of PDs report that competence is assessed by procedure volume (85%) and teaching attending evaluations (96%). Only a minority of programs use skills assessment tools (30%) or specific quality metrics (28%). Specific competencies are mostly assessed by individual teaching attending feedback as opposed to official documentation or feedback from a PD. PDs rate the overall quality of their endoscopy training and assessment of competence as better than overall ratings by trainees. Although the majority of PDs and trainees nationwide believe that measuring specific metrics is important in determining endoscopy competence, most programs still rely on procedure volume and subjective attending evaluations to determine overall competence. As medical training transitions from an apprenticeship model to competency-based education, there is a need for improved endoscopy curricula which are better suited to demonstrate readiness for unsupervised practice.

Auto Collision Technician: An Instructional Guide for Teachers.

ERIC Educational Resources Information Center

Ohio State Univ., Columbus. Vocational Instructional Materials Lab.

This guide is designed to help teachers in auto collision technician programs for grades 11 and 12 teach the critical competencies of the program. The critical competencies covered are the High Priority-Individual (HP-I) competencies in Ohio's Occupational Competency Assessment Profile (OCAP) for Auto Collision Technician. HP-I competencies are…

A systems approach for implementing practice-based learning and improvement and systems-based practice in graduate medical education.

PubMed

Varkey, Prathibha; Karlapudi, Sudhakar; Rose, Steven; Nelson, Roger; Warner, Mark

2009-03-01

The Accreditation Council for Graduate Medical Education (ACGME) initiated its Outcome Project to better prepare physicians-in-training to practice in the rapidly changing medical environment and mandated assessment of competency in six outcomes, including Practice-Based Learning and Improvement (PBLI) and Systems-Based Practice (SBP). Before the initiation of the Outcome Project, these competencies were not an explicit element of most graduate medical education training programs. Since 1999, directors of ACGME-accredited programs nationwide have been challenged to teach and assess these competencies. The authors describe an institution-wide curriculum intended to facilitate the teaching and assessment of PBLI and SBP competencies in the 115 ACGME-accredited residency and fellowship programs (serving 1,327 trainees) sponsored by Mayo School of Graduate Medical Education. Strategies to establish the curriculum in 2005 included development of a Quality Improvement (QI) curriculum Web site, one-on-one consultations with program directors, a three-hour program director workshop, and didactic sessions for residents and fellows on core topics. An interim program director self-assessment survey revealed a 13% increase in perceived ability to measure competency in SBP, no change in their perceived ability to measure competence in PBLI, a 15% increase in their ability to provide written documentation of competence in PBLI, and a 35% increase in their ability to provide written documentation of competence in SBP between 2005 and 2007. Nearly 70% of the programs had trainees participating in QI projects. Further research is needed to evaluate the cost-effectiveness of such a program and to measure its impact on learner knowledge, skills, and attitudes and, ultimately, on patient outcomes.

Milestones: Critical Elements in Clinical Informatics Fellowship Programs

PubMed Central

Lehmann, Christoph U.; Munger, Benson

2016-01-01

Summary Background Milestones refer to points along a continuum of a competency from novice to expert. Resident and fellow assessment and program evaluation processes adopted by the ACGME include the mandate that programs report the educational progress of residents and fellows twice annually utilizing Milestones developed by a specialty specific ACGME working group of experts. Milestones in clinical training programs are largely unmapped to specific assessment tools. Residents and fellows are mainly assessed using locally derived assessment instruments. These assessments are then reviewed by the Clinical Competency Committee which assigns and reports trainee ratings using the specialty specific reporting Milestones. Methods and Results The challenge and opportunity facing the nascent specialty of Clinical Informatics is how to optimally utilize this framework across a growing number of accredited fellowships. The authors review how a mapped milestone framework, in which each required sub-competency is mapped to a single milestone assessment grid, can enable the use of milestones for multiple uses including individualized learning plans, fellow assessments, and program evaluation. Furthermore, such a mapped strategy will foster the ability to compare fellow progress within and between Clinical Informatics Fellowships in a structured and reliable fashion. Clinical Informatics currently has far less variability across programs and thus could easily utilize a more tightly defined set of milestones with a clear mapping to sub-competencies. This approach would enable greater standardization of assessment instruments and processes across programs while allowing for variability in how those sub-competencies are taught. Conclusions A mapped strategy for Milestones offers significant advantages for Clinical Informatics programs. PMID:27081414

Evaluating the Quality of Competency Assessment in Pharmacy: A Framework for Workplace Learning.

PubMed

Shah, Shailly; McLaughlin, Jacqueline E; Eckel, Stephen F; Mangun, Jesica; Hawes, Emily

2016-01-19

Demonstration of achieved competencies is critical in the pharmacy workplace. The purpose of this study was to evaluate the quality of the competency assessment program for pharmacy residents at an academic medical center. The competency assessment program (CAP) survey is a validated, 48-item instrument that evaluates the quality of an assessment program based on 12 criteria, each measured by four questions on a scale of 0 to 100. The CAP was completed by residents ( n = 23) and preceptors ( n = 28) from the pharmacy residency program between 2010 and 2013. Results were analyzed using descriptive statistics, Cronbach's alpha, and non-parametric tests. Educational Consequences was the only quality criteria falling below the standard for "good quality." Participants that completed residency training elsewhere rated the Comparability (0.04) and Meaningfulness (0.01) of the assessment program higher than those that completed residency at the academic medical center. There were no significant differences between resident and preceptor scores. Overall, the quality of the assessment program was rated highly by residents and preceptors. The process described here provides a useful framework for understanding the quality of workplace learning assessments in pharmacy practice.

After-School Program Engagement: Links to Child Competence and Program Quality and Content

ERIC Educational Resources Information Center

Mahoney, Joseph L; Parente, Maria E.; Lord, Heather

2007-01-01

This 2-year study assessed program-level differences in after-school program (ASP) engagement in relation to child competencies (effectance motivation, social competence, school grades) and program quality and content. Participants were 141 children (M age = 8.4 years) who attended 9 ASPs in an urban, disadvantaged city in the United States.…

The Study of Smartphone Usage Competency Assessment and Training for the Elderly.

PubMed

Lu, Sheng-Chieh; Wen, Tzu-Ning; Chang, Po-Lun

2017-01-01

This study aimed at developing an assessment of smartphone usage competence and constructing a training program for the elderly. A list of smartphone usage competencies with 34 items was defined through expert survey and panel. Based on the competence and previous literature, a training program and learning aids were designed in this study. There were 41 participants in our program. The results of self-administrated smartphone usage ability questionnaire indicated that all competencies were significantly improved after training. However, the results also demonstrated that some items were still difficult for the elderly to comprehend. Overall, this study provided a first exploration of defining smartphone usage competency and built a training program for the elderly. With strong suggestion, future mobile health (mHealth) services can follow this study to insure the smartphone usage ability of the elderly.

E-assessment and an e-training program among elderly care staff lacking formal competence: results of a mixed-methods intervention study.

PubMed

Nilsson, Annika; Engström, Maria

2015-05-06

Among staff working in elderly care, a considerable proportion lack formal competence for their work. Lack of formal competence, in turn, has been linked to higher staff ratings of stress symptoms, sleep disturbances and workload. 1) To describe the strengths and weaknesses of an e-assessment and subsequent e-training program used among elderly care staff who lack formal competence and 2) to study the effects of an e-training program on staff members' working life (quality of care and psychological and structural empowerment) and well-being (job satisfaction and psychosomatic health). The hypothesis was that staff who had completed the e-assessment and the e-training program would rate greater improvements in working life and well-being than would staff who had only participated in the e-assessments. An intervention study with a mixed-methods approach using quantitative (2010-2011) and qualitative data (2011) was conducted in Swedish elderly care. Participants included a total of 41 staff members. To describe the strengths and weaknesses of the e-assessment and the e-training program, qualitative data were gathered using semi-structured interviews together with a study-specific questionnaire. To study the effects of the intervention, quantitative data were collected using questionnaires on: job satisfaction, psychosomatic health, psychological empowerment, structural empowerment and quality of care in an intervention and a comparison group. Staff who completed the e-assessments and the e-training program primarily experienced strengths associated with this approach. The results were also in line with our hypotheses: Staff who completed the e-assessment and the e-training program rated improvements in their working life and well-being. Use of the e-assessments and e-training program employed in the present study could be one way to support elderly care staff who lack formal education by increasing their competence; increased competence, in turn, could improve their self-confidence, working life, and well-being.

Suicide Risk Assessment Training for Psychology Doctoral Programs: Core Competencies and a Framework for Training

PubMed Central

Cramer, Robert J.; Johnson, Shara M.; McLaughlin, Jennifer; Rausch, Emilie M.; Conroy, Mary Alice

2014-01-01

Clinical and counseling psychology programs currently lack adequate evidence-based competency goals and training in suicide risk assessment. To begin to address this problem, this article proposes core competencies and an integrated training framework that can form the basis for training and research in this area. First, we evaluate the extent to which current training is effective in preparing trainees for suicide risk assessment. Within this discussion, sample and methodological issues are reviewed. Second, as an extension of these methodological training issues, we integrate empirically- and expert-derived suicide risk assessment competencies from several sources with the goal of streamlining core competencies for training purposes. Finally, a framework for suicide risk assessment training is outlined. The approach employs Objective Structured Clinical Examination (OSCE) methodology, an approach commonly utilized in medical competency training. The training modality also proposes the Suicide Competency Assessment Form (SCAF), a training tool evaluating self- and observer-ratings of trainee core competencies. The training framework and SCAF are ripe for empirical evaluation and potential training implementation. PMID:24672588

Suicide Risk Assessment Training for Psychology Doctoral Programs: Core Competencies and a Framework for Training.

PubMed

Cramer, Robert J; Johnson, Shara M; McLaughlin, Jennifer; Rausch, Emilie M; Conroy, Mary Alice

2013-02-01

Clinical and counseling psychology programs currently lack adequate evidence-based competency goals and training in suicide risk assessment. To begin to address this problem, this article proposes core competencies and an integrated training framework that can form the basis for training and research in this area. First, we evaluate the extent to which current training is effective in preparing trainees for suicide risk assessment. Within this discussion, sample and methodological issues are reviewed. Second, as an extension of these methodological training issues, we integrate empirically- and expert-derived suicide risk assessment competencies from several sources with the goal of streamlining core competencies for training purposes. Finally, a framework for suicide risk assessment training is outlined. The approach employs Objective Structured Clinical Examination (OSCE) methodology, an approach commonly utilized in medical competency training. The training modality also proposes the Suicide Competency Assessment Form (SCAF), a training tool evaluating self- and observer-ratings of trainee core competencies. The training framework and SCAF are ripe for empirical evaluation and potential training implementation.

Assessing the relevance of higher education courses.

PubMed

Gómez, Pedro; González, María Jose; Gil, Francisco; Lupiáñez, José Luis; Moreno, María Francisca; Rico, Luis; Romero, Isabel

2007-05-01

The establishment of the European Higher Education Area has involved specifying lists of professional competencies that programs are expected to develop, and with this the need for procedures to measure how every course within a higher education program is aligned with the program's competencies. We propose an instrument for characterizing this alignment, a process that we call assessing the relevance of a course. Using information from the course syllabus (objectives, contents and assessment scheme), our instrument produces indicators for characterizing the syllabus in terms of a competence list and for assessing its coherence. Because assessment involves quality, the results obtained can also be used to revise and improve the course syllabus. We illustrate this process with an example of a methods course from a mathematics teacher education program at a Spanish university.

Using an Internally-Developed Tool to Assess Intercultural Competence in Short-Term Study Abroad Programs

ERIC Educational Resources Information Center

Kartoshkina, Yuliya

2013-01-01

An internally-developed tool was developed to assess the intercultural competence of students taking part in short-term study abroad programs. Four scales were built to assess possible change in students' host culture knowledge, cross-cultural awareness, cross-cultural adaptation, and self-assessed foreign language proficiency. Enrollment in a…

Acquired and Participatory Competencies in Health Professions Education: Definition and Assessment in Global Health.

PubMed

Eichbaum, Quentin

2017-04-01

Many health professions education programs in high-income countries (HICs) have adopted a competency-based approach to learning. Although global health programs have followed this trend, defining and assessing competencies has proven problematic, particularly in resource-constrained settings of low- and middle-income countries (LMICs) where HIC students and trainees perform elective work. In part, this is due to programs failing to take sufficient account of local learning, cultural, and health contexts.A major divide between HIC and LMIC settings is that the learning contexts of HICs are predominantly individualist, whereas those of LMICs are generally collectivist. Individualist cultures view learning as something that the individual acquires independent of context and can possess; collectivist cultures view learning as arising dynamically from specific contexts through group participation.To bridge the individualist-collectivist learning divide, the author proposes that competencies be classified as either acquired or participatory. Acquired competencies can be transferred across contexts and assessed using traditional psychometric approaches; participatory competencies are linked to contexts and require alternative assessment approaches. The author proposes assessing participatory competencies through the approach of self-directed assessment seeking, which includes multiple members of the health care team as assessors.The proposed classification of competencies as acquired or participatory may apply across health professions. The author suggests advancing participatory competencies through mental models of sharing. In global health education, the author recommends developing three new competency domains rooted in participatory learning, collectivism, and sharing: resourceful learning; transprofessionalism and transformative learning; and social justice and health equity.

Teaching and assessing competence in cataract surgery.

PubMed

Henderson, Bonnie An; Ali, Rasha

2007-02-01

To review recent literature regarding innovative techniques, methods of teaching and assessing competence and skill in cataract surgery. The need for assessment of surgical competency and the requirement of wet lab facilities in ophthalmic training programs are being increasingly emphasized. Authors have proposed the use of standardized forms to collect objective and subjective data regarding the residents' surgical performance. Investigators have reported methods to improve visualization of cadaver and animal eyes for the wet lab, including the use of capsular dyes. The discussion of virtual reality as a teaching tool for surgical programs continues. Studies have proven that residents trained on a laparoscopic simulator outperformed nontrained residents during actual surgery for both surgical times and numbers of errors. Besides virtual reality systems, a program is being developed to separate the cognitive portion from the physical aspects of surgery. Another program couples surgical videos with three-dimensional animation to enhance the trainees' topographical understanding. Proper assessment of surgical competency is becoming an important focus of training programs. The use of surgical data forms may assist in standardizing objective assessments. Virtual reality, cognitive curriculum and animation video programs can be helpful in improving residents' surgical performance.

An Examination of Cultural Competence Training in US Medical Education Guided by the Tool for Assessing Cultural Competence Training

PubMed Central

Jernigan, Valarie Blue Bird; Hearod, Jordan B.; Tran, Kim; Norris, Keith C.; Buchwald, Dedra

2015-01-01

In the United States, medical students must demonstrate a standard level of “cultural competence,” upon graduation. Cultural competence is most often defined as a set of congruent behaviors, attitudes, and policies that come together in a system, organization, or among professionals that enables effective work in cross-cultural situations. The Association of American Medical Colleges developed the Tool for Assessing Cultural Competence Training (TACCT) to assist schools in developing and evaluating cultural competence curricula to meet these requirements. This review uses the TACCT as a guideline to describe and assess pedagogical approaches to cultural competence training in US medical education and identify content gaps and opportunities for curriculum improvement. A total of 18 programs are assessed. Findings support previous research that cultural competence training can improve the knowledge, attitudes, and skills of medical trainees. However, wide variation in the conceptualization, implementation, and evaluation of cultural competence training programs exists, leading to differences in training quality and outcomes. More research is needed to establish optimal approaches to implementing and evaluating cultural competence training that incorporate cultural humility, the social determinants of health, and broader structural competency within the medical system. PMID:27818848

An Examination of Cultural Competence Training in US Medical Education Guided by the Tool for Assessing Cultural Competence Training.

PubMed

Jernigan, Valarie Blue Bird; Hearod, Jordan B; Tran, Kim; Norris, Keith C; Buchwald, Dedra

2016-01-01

In the United States, medical students must demonstrate a standard level of "cultural competence," upon graduation. Cultural competence is most often defined as a set of congruent behaviors, attitudes, and policies that come together in a system, organization, or among professionals that enables effective work in cross-cultural situations. The Association of American Medical Colleges developed the Tool for Assessing Cultural Competence Training (TACCT) to assist schools in developing and evaluating cultural competence curricula to meet these requirements. This review uses the TACCT as a guideline to describe and assess pedagogical approaches to cultural competence training in US medical education and identify content gaps and opportunities for curriculum improvement. A total of 18 programs are assessed. Findings support previous research that cultural competence training can improve the knowledge, attitudes, and skills of medical trainees. However, wide variation in the conceptualization, implementation, and evaluation of cultural competence training programs exists, leading to differences in training quality and outcomes. More research is needed to establish optimal approaches to implementing and evaluating cultural competence training that incorporate cultural humility, the social determinants of health, and broader structural competency within the medical system.

A Virtual Patient Software Program to Improve Pharmacy Student Learning in a Comprehensive Disease Management Course

PubMed Central

Casale, Jillian P.; Skirvin, J. Andrew; DiVall, Margarita V.

2013-01-01

Objective. To implement and assess the impact of a virtual patient pilot program on pharmacy students’ clinical competence skills. Design. Pharmacy students completed interactive software-based patient case scenarios embedded with drug-therapy problems as part of a course requirement at the end of their third year. Assessment. Assessments included drug-therapy problem competency achievement, performance on a pretest and posttest, and pilot evaluation survey instrument. Significant improvements in students’ posttest scores demonstrated advancement of clinical skills involving drug-therapy problem solving. Students agreed that completing the pilot program improved their chronic disease management skills and the program summarized the course series well. Conclusion. Using virtual patient technology allowed for assessment of student competencies and improved learning outcomes. PMID:24159213

The International State of Research on Measurement of Competency in Higher Education

ERIC Educational Resources Information Center

Zlatkin-Troitschanskaia, Olga; Shavelson, Richard J.; Kuhn, Christiane

2015-01-01

With the Program for International Student Assessment and Trends in International Mathematics and Science Study surveys, competency assessment became an important policy instrument in the school sector; only recently has international competency measurement gained attention in higher education with the Assessment of Higher Education Learning…

Student Gains in Self-Efficacy in an Advanced MSW Curriculum: A Customized Model for Outcomes Assessment

ERIC Educational Resources Information Center

Rishel, Carrie W.; Majewski, Virginia

2009-01-01

The new Educational Policy and Accreditation Standards (EPAS) identify assessment as "an integral component of competency-based education." It is not new, however, that programs must demonstrate plans to assess attainment of competencies or expected program outcomes and show how data collection and analysis inform curriculum decisions. Previous…

Army Enlisted Personnel Competency Assessment Program: Phase 2 Report

DTIC Science & Technology

2006-01-01

benefit analysis of a notional Army program will be conducted. v Findings: The prototype Army core assessment was successfully administered to over 600...about competency assessment. They will also be incorporated into a cost and benefit analysis to be conducted in Phase III. vi CONTENTS Page Chapter 1...Conduct a Cost- Benefit Analysis, and Make System Recommendations Phase I of PerformM21 resulted in program design recommendations that included such

Cultural Competency Training in Emergency Medicine.

PubMed

Mechanic, Oren J; Dubosh, Nicole M; Rosen, Carlo L; Landry, Alden M

2017-09-01

The Emergency Department is widely regarded as the epicenter of medical care for diverse and largely disparate types of patients. Physicians must be aware of the cultural diversity of their patient population to appropriately address their medical needs. A better understanding of residency preparedness in cultural competency can lead to better training opportunities and patient care. The objective of this study was to assess residency and faculty exposure to formal cultural competency programs and assess future needs for diversity education. A short survey was sent to all 168 Accreditation Council for Graduate Medical Education program directors through the Council of Emergency Medicine Residency Directors listserv. The survey included drop-down options in addition to open-ended input. Descriptive and bivariate analyses were used to analyze data. The response rate was 43.5% (73/168). Of the 68.5% (50/73) of residency programs that include cultural competency education, 90% (45/50) utilized structured didactics. Of these programs, 86.0% (43/50) included race and ethnicity education, whereas only 40.0% (20/50) included education on patients with limited English proficiency. Resident comfort with cultural competency was unmeasured by most programs (83.6%: 61/73). Of all respondents, 93.2% (68/73) were interested in a universal open-source cultural competency curriculum. The majority of the programs in our sample have formal resident didactics on cultural competency. Some faculty members also receive cultural competency training. There are gaps, however, in types of cultural competency training, and many programs have expressed interest in a universal open-source tool to improve cultural competency for Emergency Medicine residents. Copyright © 2017 Elsevier Inc. All rights reserved.

A virtual patient software program to improve pharmacy student learning in a comprehensive disease management course.

PubMed

Douglass, Mark A; Casale, Jillian P; Skirvin, J Andrew; DiVall, Margarita V

2013-10-14

To implement and assess the impact of a virtual patient pilot program on pharmacy students' clinical competence skills. Pharmacy students completed interactive software-based patient case scenarios embedded with drug-therapy problems as part of a course requirement at the end of their third year. Assessments included drug-therapy problem competency achievement, performance on a pretest and posttest, and pilot evaluation survey instrument. Significant improvements in students' posttest scores demonstrated advancement of clinical skills involving drug-therapy problem solving. Students agreed that completing the pilot program improved their chronic disease management skills and the program summarized the course series well. Using virtual patient technology allowed for assessment of student competencies and improved learning outcomes.

Assessment of Proficiency and Competency in Laboratory Animal Biomethodologies

PubMed Central

Clifford, Paula; Melfi, Natasha; Bogdanske, John; Johnson, Elizabeth J; Kehler, James; Baran, Szczepan W

2013-01-01

Personnel working with laboratory animals are required by laws and guidelines to be trained and qualified to perform biomethodologic procedures. The assessment of competency and proficiency is a vital component of a laboratory animal training program, because this process confirms that the trainees have met the learning objectives for a particular procedure. The approach toward qualification assessment differs between organizations because laws and guidelines do not outline how the assessment should be performed or which methods and tools should be used. Assessment of clinical and surgical medicine has received considerable attention over the last few decades and has progressed from simple subjective methods to well-defined and objective methods of assessing competency. Although biomethodology competency and proficiency assessment is discussed in the literature, a standard and objective assessment method has not yet been developed. The development and implementation of an objective and standardized biomethodologic assessment program can serve as a tool to improve standards, ensure consistent training, and decrease research variables yet ensure animal welfare. Here we review the definition and goals of training and assessment, review assessment methods, and propose a method to develop a standard and objective assessment program for the laboratory animal science field, particularly training departments and IACUC. PMID:24351758

Australia's first transition to professional practice in primary care program for graduate registered nurses: a pilot study.

PubMed

Aggar, Christina; Bloomfield, Jacqueline; Thomas, Tamsin H; Gordon, Christopher J

2017-01-01

Increases in ageing, chronic illness and complex co-morbidities in the Australian population are adding pressure to the primary care nursing workforce. Initiatives to attract and retain nurses are needed to establish a sustainable and skilled future primary care nursing workforce. We implemented a transition to professional practice program in general practice settings for graduate nurses and evaluated graduate nurse competency, the graduate nurse experience and program satisfaction. This study aimed to determine whether a transition to professional practice program implemented in the general practice setting led to competent practice nurses in their first year post-graduation. A longitudinal, exploratory mixed-methods design was used to assess the pilot study. Data were collected at three times points (3, 6, 12 months) with complete data sets from graduate nurses ( n =  4) and preceptors ( n =  7). We assessed perceptions of the graduates' nursing competency and confidence, satisfaction with the preceptor/graduate relationship, and experiences and satisfaction with the program. Graduate nurse competency was assessed using the National Competency Standards for Nurses in General Practice. Semi-structured interviews with participants at Time 3 sought information about barriers, enablers, and the perceived impact of the program. Graduate nurses were found to be competent within their first year of clinical practice. Program perceptions from graduate nurses and preceptors were positive and the relationship between the graduate nurse and preceptor was key to this development. With appropriate support registered nurses can transition directly into primary care and are competent in their first year post-graduation. While wider implementation and research is needed, findings from this study demonstrate the potential value of transition to professional practice programs within primary care as a nursing workforce development strategy.

Measuring the Impact of Cultural Competence Training for Dental Hygiene Students.

PubMed

Daugherty, Heather N; Kearney, Rachel C

2017-10-01

Purpose: The purpose of this study was to measure the change in levels of knowledge of providing culturally competent care and self-assessed cultural competence of senior level dental hygiene students after the implementation of an online cultural competence training module. Methods: Twenty-eight members of the senior class of 31 dental hygiene students (N=28) volunteered to participate in this IRB approved study at the Ohio State University School of Dentistry. The students took the online Inventory for Assessing the Process of Cultural Competence- Student Version (IAPCC-SV), to assess their self-perceived cultural competence. Upon completion of the pre-test, students then completed the United States Department of Health and Human Services (HHS) Office of Minority Health (OMH) Cultural Competency Program for Oral Health Professionals; a three-module online training program designed to measure increased knowledge of cultural competence. Three weeks following the initial pre-test and upon completion of the Cultural Competency Program for Oral Health Professionals online learning modules, students re-took the IAPCC-SV. Results: Twenty-eight senior dental hygiene students completed the IAPCC-SV pre-test, the OMH e-learning modules and the IAPCC-SV post-test. The average score on the pre-test was 55.14±7.54 and the average score on the post-test was 61.33±7.86. There was a significant difference in pre-test and post-test scores (p<0.001). There were also significant differences in the constructs of knowledge of cultural competence (p<0.001) and skill (p<0.001). Conclusion: The HHS OMH Cultural Competency Program for Oral Health Professionals was effective for increasing dental hygiene students' levels of knowledge of cultural competence. Copyright © 2017 The American Dental Hygienists’ Association.

Measuring teacher implementation in delivery of a bullying prevention program: the impact of instructional and procedural adherence and competence on student responsiveness.

PubMed

Goncy, Elizabeth A; Sutherland, Kevin S; Farrell, Albert D; Sullivan, Terri N; Doyle, Sarah T

2015-04-01

Although there is evidence that school-based prevention programs can produce positive effects on students' academic and behavioral functioning, the ability of teachers to sustain high-quality implementation remains an open and vexing question. Because teachers are often the intervention agents in school-based prevention programs, assessing both their adherence to program procedures and their competence in program delivery is critical for ensuring student responsiveness to prevention programs, which in turn may impact their efficacy. The current study assessed treatment fidelity of implementation of the Olweus' Bullying Prevention Program (OBPP) in two urban middle schools. Trained observers completed 280 observations of teachers' delivery of the class meeting component of the OBPP and rated teachers' instructional and procedural adherence and competence of delivery and students' responsiveness. Analyses using multilevel modeling indicated that competence of delivery was significantly related to student responsiveness above and beyond teacher instructional behavior adherence, such that class meetings conducted with higher instructional adherence and procedural competence resulted in higher student responsiveness to the program after controlling for the clustered nature of teachers, and several observation-level and teacher-level covariates. This study highlights the need for strategies to increase teacher use of effective instructional practices and competence with program procedures to enhance the efficacy of prevention programming in schools.

Exemplary Competency-Based Vocational Teacher Education Project: Handicapped Component. Competency and Criteria Identification Phase: Professional Competencies and Assessment Criteria for Administrators and Teachers of Vocational Education Programs for the Handicapped in Florida. Series No. 9.

ERIC Educational Resources Information Center

Florida State Univ., Tallahassee. Program of Vocational Education.

One of a series of nine reports of Project ACTIVE (Attaining Competence for Teaching in Vocational Education), this report focuses on the criteria for assessing mastery of the professional competencies (skills) important to vocational educators serving handicapped students. An overview of competency-based vocational teacher education (CBTE) and…

The problem with competencies in global health education.

PubMed

Eichbaum, Quentin

2015-04-01

The demand for global health educational opportunities among students and trainees in high-income countries (HICs) has led to a proliferation of available global health programs. In keeping with the drive towards competency-based medical education, many of these programs have been defining their own global health competencies. Developing such competencies presents several unique challenges, including (1) a failure to take sufficient account of local contexts coupled with a lack of inclusiveness in developing these competencies, (2) the disjunction between the learning approaches of "individualism" in HICs and the relative "collectivism" of most host countries, and (3) shortcomings associated with assessing competencies in resource-limited settings. To meet these challenges, the author recommends reenvisioning the approach to competencies in global health using fresh metaphors, innovative modes of assessment, and the creation of more appropriate competency domains.

Competency assessment of microbiology medical laboratory technologists in Ontario, Canada.

PubMed

Desjardins, Marc; Fleming, Christine Ann

2014-08-01

Accreditation in Ontario, Canada, requires that licensed clinical laboratories participate in external quality assessment (also known as proficiency testing) and perform competency evaluation of their staff. To assess the extent of ongoing competency assessment practices, the Quality Management Program--Laboratory Services (QMP-LS) Microbiology Committee surveyed all 112 licensed Ontario microbiology laboratories. The questionnaire consisted of a total of 21 questions that included yes/no, multiple-choice, and short-answer formats. Participants were asked to provide information about existing programs, the frequency of testing, what areas are evaluated, and how results are communicated to the staff. Of the 111 responding laboratories, 6 indicated they did not have a formal evaluation program since they perform only limited bacteriology testing. Of the remaining 105 respondents, 87% perform evaluations at least annually or every 2 years, and 61% include any test or task performed, whereas 16% and 10% focus only on problem areas and high-volume complex tasks, respectively. The most common methods of evaluation were review of external quality assessment (EQA) challenges, direct observation, and worksheet review. With the exception of one participant, all communicate results to staff, and most take remedial action to correct the deficiencies. Although most accredited laboratories have a program to assess the ongoing competency of their staff, the methods used are not standardized or consistently applied, indicating that there is room for improvement. The survey successfully highlighted potential areas for improvement and allowed the QMP-LS Microbiology Committee to provide guidance to Ontario laboratories for establishing or improving existing microbiology-specific competency assessment programs. Copyright © 2014, American Society for Microbiology. All Rights Reserved.

Internal Medicine Residency Program Directors' Views of the Core Entrustable Professional Activities for Entering Residency: An Opportunity to Enhance Communication of Competency Along the Continuum.

PubMed

Angus, Steven V; Vu, T Robert; Willett, Lisa L; Call, Stephanie; Halvorsen, Andrew J; Chaudhry, Saima

2017-06-01

To examine internal medicine (IM) residency program directors' (PDs') perspectives on the Core Entrustable Professional Activities for Entering Residency (Core EPAs)-introduced into undergraduate medical education to further competency-based assessment-and on communicating competency-based information during transitions. A spring 2015 Association of Program Directors in Internal Medicine survey asked PDs of U.S. IM residency programs for their perspectives on which Core EPAs new interns must or should possess on day 1, which are most essential, and which have the largest gap between expected and observed performance. Their views and preferences were also requested regarding communicating competency-based information at transitions from medical school to residency and residency to fellowship/employment. The response rate was 57% (204/361 programs). The majority of PDs felt new interns must/should possess 12 of the 13 Core EPAs. PDs' rankings of Core EPAs by relative importance were more varied than their rankings by the largest gaps in performance. Although preferred timing varied, most PDs (82%) considered it important for medical schools to communicate Core EPA-based information to PDs; nearly three-quarters (71%) would prefer a checklist format. Many (60%) would be willing to provide competency-based evaluations to fellowship directors/employers. Most (> 80%) agreed that there should be a bidirectional communication mechanism for programs/employers to provide feedback on competency assessments. The gaps identified in Core EPA performance may help guide medical schools' curricular and assessment tool design. Sharing competency-based information at transitions along the medical education continuum could help ensure production of competent, practice-ready physicians.

Using Competencies to Assess Entry-Level Knowledge of Students Graduating from Parks and Recreation Academic Programs

ERIC Educational Resources Information Center

Hurd, Amy R.; Elkins, Daniel J.; Beggs, Brent A.

2014-01-01

To address the Council on Accreditation of Parks, Recreation, Tourism, and Related Professions accreditation standard 7.01.01, the Entry Level Competency Assessment was developed to measure 46 competencies in four categories needed by entry level professionals. Students rated their competence prior to beginning their senior internship. The results…

Using core competencies to build an evaluative framework: outcome assessment of the University of Guelph Master of Public Health program.

PubMed

Britten, Nicole; Wallar, Lauren E; McEwen, Scott A; Papadopoulos, Andrew

2014-07-31

Master of Public Health programs have been developed across Canada in response to the need for graduate-level trained professionals to work in the public health sector. The University of Guelph recently conducted a five-year outcome assessment using the Core Competencies for Public Health in Canada as an evaluative framework to determine whether graduates are receiving adequate training, and identify areas for improvement. A curriculum map of core courses and an online survey of University of Guelph Master of Public Health graduates comprised the outcome assessment. The curriculum map was constructed by evaluating course outlines, assignments, and content to determine the extent to which the Core Competencies were covered in each course. Quantitative survey results were characterized using descriptive statistics. Qualitative survey results were analyzed to identify common themes and patterns in open-ended responses. The University of Guelph Master of Public Health program provided a positive learning environment in which graduates gained proficiency across the Core Competencies through core and elective courses, meaningful practicums, and competent faculty. Practice-based learning environments, particularly in collaboration with public health organizations, were deemed to be beneficial to students' learning experiences. The Core Competencies and graduate surveys can be used to conduct a meaningful and informative outcome assessment. We encourage other Master of Public Health programs to conduct their own outcome assessments using a similar framework, and disseminate these results in order to identify best practices and strengthen the Canadian graduate public health education system.

Cultural Competency Education in Academic Dental Institutions in Australia and New Zealand: A Survey Study.

PubMed

Nicholson, Sheree L; Hayes, Melanie J; Taylor, Jane A

2016-08-01

The aim of this study was to assess the status of cultural competency education in Australian and New Zealand dental, dental hygiene, and oral health therapy programs. The study sought to explore the extent to which cultural competence is included in these programs' curricula, building on similar studies conducted in the United States and thus contributing to the international body of knowledge on this topic. A 12-item instrument was designed with questions in four areas (demographics, content of cultural competency education, organization of overall program curriculum, and educational methods used to teach cultural competence) and was sent to all Australian and New Zealand dental, dental hygiene, and oral health therapy educational programs. Of the total 24 programs, 15 responded for a response rate of 62.5%. The results showed that lectures were the most frequent teaching method used in cultural competency education; however, the variation in responses indicated inconsistencies across study participants, as discussions and self-directed learning also featured prominently in the responses. The majority of respondents reported that cultural competence was not taught as a specific course but rather integrated into their programs' existing curricula. The variations in methods may indicate the need for a standardized framework for cultural competency education in these countries. In addition, the notion of cultural competency education in academic dental institutions demands additional evaluation, and further research is required to develop a solid evidence base on which to develop cultural competency education, specifically regarding content, most effective pedagogies, and assessment of student preparedness.

An Effective Model for Improving Global Health Nursing Competence.

PubMed

Kang, Sun-Joo

2016-01-01

This paper proposed an effective model for improving global health nursing competence among undergraduate students. A descriptive case study was conducted by evaluation of four implemented programs by the author. All programs were conducted with students majoring in nursing and healthcare, where the researcher was a program director, professor, or facilitator. These programs were analyzed in terms of students' needs assessment, program design, and implementation and evaluation factors. The concept and composition of global nursing competence, identified within previous studies, were deemed appropriate in all of our programs. Program composition varied from curricular to extracurricular domains. During the implementation phase, some of the programs included non-Korean students to improve cultural diversity and overcome language barriers. Qualitative and quantitative surveys were conducted to assess program efficacy. Data triangulation from students' reflective journals was examined. Additionally, students' awareness regarding changes within global health nursing, improved critical thinking, cultural understanding, and global leadership skills were investigated pre- and post-program implementation. The importance of identifying students' needs regarding global nursing competence when developing appropriate curricula is discussed.

Occupational Competency Profile for Health Occupations Education Program: Teacher Self-Assessment. Information Series: Report No. 11.

ERIC Educational Resources Information Center

Walters, Norma J.

This assessment instrument is intended to assist teachers in evaluating the relevance of the competencies included in the health occupations education curriculum they are teaching and in assessing their own continuing education needs. The profile lists the competencies required of persons working at the following sites: hospital departments…

Assessment of Oral Communication Competencies at Johnson & Wales University. A Pilot Program Assessing Culinary Arts and Pastry Arts Students.

ERIC Educational Resources Information Center

Crossman, Joanne Marciano

The Oral Communication Competencies Assessment Project was designed to determine student communication competency across the curriculum, transferring skills taught in the communication skills class to authentic classroom performances. The 505 students who were required to make oral presentations across the curriculum during the first term of the…

Evaluation of a Cultural Competence Assessment for Preservice Teachers

ERIC Educational Resources Information Center

Bustamante, Rebecca M.; Skidmore, Susan T.; Nelson, Judith A.; Jones, Brandolyn E.

2016-01-01

Globally, public schools enroll culturally and linguistically diverse student populations and teacher preparation programs must assess the cultural competence of preservice teachers. Yet, few adequately tested measures of teacher cultural competence are available. In this research study, a sample of 396 preservice teachers were surveyed to…

Taxonomy for Assessing Evaluation Competencies in Extension

ERIC Educational Resources Information Center

Rodgers, Michelle S.; Hillaker, Barbara D.; Haas, Bruce E.; Peters, Cheryl

2012-01-01

Evaluation of public service programming is becoming increasingly important with current funding realities. The taxonomy of evaluation competencies compiled by Ghere et al. (2006) provided the starting place for Taxonomy for Assessing Evaluation Competencies in Extension. The Michigan State University Extension case study described here presents a…

Development, validation, and utility of an instrument to assess core competencies in the Leadership Education in Neurodevelopmental and Related Disabilities (LEND) program.

PubMed

Leff, Stephen S; Baum, Katherine T; Bevans, Katherine B; Blum, Nathan J

2015-02-01

To describe the development and psychometric evaluation of the Core Competency Measure (CCM), an instrument designed to assess professional competencies as defined by the Maternal Child Health Bureau (MCHB) and targeted by Leadership Education in Neurodevelopmental and Related Disabilities (LEND) programs. The CCM is a 44-item self-report measure comprised of six subscales to assess clinical, interdisciplinary, family-centered/cultural, community, research, and advocacy/policy competencies. The CCM was developed in an iterative fashion through participatory action research, and then nine cohorts of LEND trainees (N = 144) from 14 different disciplines completed the CCM during the first week of the training program. A 6-factor confirmatory factor analysis model was fit to data from the 44 original items. After three items were removed, the model adequately fit the data (comparative fit indices = .93, root mean error of approximation = .06) with all factor loadings exceeding .55. The measure was determined to be quite reliable as adequate internal consistency and test-retest reliability were found for each subscale. The instrument's construct validity was supported by expected differences in self-rated competencies among fellows representing various disciplines, and the convergent validity was supported by the pattern of inter-correlations between subscale scores. The CCM appears to be a reliable and valid measure of MCHB core competencies for our sample of LEND trainees. It provides an assessment of key training areas addressed by the LEND program. Although the measure was developed within only one LEND Program, with additional research it has the potential to serve as a standardized tool to evaluate the strengths and limitations of MCHB training, both within and between programs.

Finding the Perfect Doctor: Identifying Lesbian, Gay, Bisexual, and Transgender–Competent Physicians

PubMed Central

Khalili, Joshua; Leung, Lucinda B.

2015-01-01

Objectives. We assessed the existence of procedures and policies for identifying lesbian, gay, bisexual, and transgender (LGBT)–competent physicians at US academic faculty practices, and sought to identify physician training programs that enhance LGBT competency. Methods. We invited all 138 Liaison Committee on Medical Education–accredited US academic faculty practices to participate in a survey in 2012. We systematically assessed their procedures and policies to identify LGBT-competent physicians and their LGBT-competency training. We also assessed geographic region, funding source, and an LGBT health center in the same state. We performed univariate, bivariate, and multivariate logistic regression analyses. Results. The response rate was 50%. Few participants had existing procedures (9%) or policies (4%) to identify LGBT-competent physicians. Procedures included online directories with self-identified LGBT-competent physicians available to the public. Sixteen percent of participants reported having comprehensive LGBT-competency training, and 52% reported having no training. Of note, 80% of participants indicated interest to do more to address these issues. Conclusions. There exist both need and interest for US academic faculty practices to develop procedures, policies, and programs that improve access to LGBT-competent physicians and to train physicians to become LGBT-competent. PMID:25880937

Relating Women's Experience and Skills to Competencies Required in Selected Occupations and Vocational Education Programs. Project Report, Task C1, Revised Competency Analysis: Credentialing Women's Life Experiences (Project ACCESS).

ERIC Educational Resources Information Center

Ekstrom, Ruth B.; And Others

Competency scales were developed for 10 direct-entry occupations and 10 vocational education programs as part of Project ACCESS, a project to assess women's life experience learning for entrance into employment and for advanced placement in vocational education programs. Development of the occupational scales involved employer interviews, followed…

An Assessment System for Competence Based Education: The Educational Development, Dissemination, and Evaluation Training Program.

ERIC Educational Resources Information Center

Hood, Paul D.; Blackwell, Laird

This manual provides a description of the development and a guide to the use of the assessment resources developed in connection with the Far West Development, Dissemination, and Evaluation (DD&E) Functional Competence Training Program. The document concentrates on a user-oriented description of the content, validation, and use of the final…

An Assessment Program Designed To Improve Communication Instruction through a Competency-Based Core Curriculum.

ERIC Educational Resources Information Center

Aitken, Joan E.; Neer, Michael R.

This paper provides an example procedure used to design and install a program of assessment to improve communication instruction through a competency-based core curriculum at a mid-sized, urban university. The paper models the various steps in the process, and includes specific tests, forms, memos, course description, sources, and procedures which…

Postgraduate nurses' self-assessment of clinical competence and need for further training. A European cross-sectional survey.

PubMed

Wangensteen, Sigrid; Finnbakk, Elisabeth; Adolfsson, Annsofie; Kristjansdottir, Gudrun; Roodbol, Petrie; Ward, Helen; Fagerström, Lisbeth

2018-03-01

Nursing practice requires application of knowledge, skills and values in various combinations and has undergone substantial changes the last decades. An increased focus on inter-professional collaboration and possible new and more independent roles for nurses are described. A variety of programs have been developed in order to educate registered nurses (RN) to meet the changes and demands in health and nursing care throughout the world. The aims were to 1) describe nurses' self-assessment of clinical competence and need for further training, and 2) explore possible differences between nurses in specialist vs master's programs. A cross-sectional survey design was applied. 97 nurses in postgraduate programs from five countries responded (response rate 45%). A revised version of the Professional Nurse Self-Assessment Scale of clinical core competencies (PROFFNurseSASII) was used for data collection. Independent student t-test and regression analyses were carried out. The respondents rated their competence highest in taking full responsibility, cooperation with other health professionals and in acting ethically. Items where they considered themselves needing further training most were competence on medications, interaction and side effects and differential diagnoses. For all items, nurses in master's programs rated their competence higher than nurses in the specialist programs. Nurses in specialist programs rated their need for more training for all items higher than nurses in master's degree programs, and for 47 out of the 50 items these differences were statistically significant. Even though the nurses rated their competence high for important competence aspects such as taking responsibility and cooperation with other health professionals, it is worrying that their need for further training was highest for effects and interaction of various types of medications. Further studies are needed to conclude if and how master's education improves patient outcome. Copyright © 2017 Elsevier Ltd. All rights reserved.

The Development and Implementation of a Competency-Based Curriculum for Training in Global Health Research

PubMed Central

Ton, Thanh G. N.; Gladding, Sophia P.; Zunt, Joseph R.; John, Chandy; Nerurkar, Vivek R.; Moyer, Cheryl A.; Hobbs, Nicole; McCoy, Molly; Kolars, Joseph C.

2015-01-01

The Fogarty International Center (FIC) Global Health Fellows Program provides trainees with the opportunity to develop research skills through a mentored research experience, increase their content expertise, and better understand trends in global health research, funding organizations, and pathways to generate support. The Northern Pacific Global Health Fellows Research and Training Consortium, which hosts one of the FIC Global Health Programs, sought to enhance research training by developing, implementing, and evaluating a competency-based curriculum that uses a modular, asynchronous, web-based format. The curriculum has 8 core competencies, 36 learning objectives, and 58 assignments. Nineteen trainees completed their 11-month fellowship, engaged in the curriculum, and provided pre- and post-fellowship self-assessments. Self-assessed scores significantly improved for all competencies. Trainees identified the curriculum as one of the strengths of the program. This competency-based curriculum represents a first step toward creating a framework of global health research competencies on which further efforts could be based. PMID:25371189

Using core competencies to build an evaluative framework: outcome assessment of the University of Guelph Master of Public Health program

PubMed Central

2014-01-01

Background Master of Public Health programs have been developed across Canada in response to the need for graduate-level trained professionals to work in the public health sector. The University of Guelph recently conducted a five-year outcome assessment using the Core Competencies for Public Health in Canada as an evaluative framework to determine whether graduates are receiving adequate training, and identify areas for improvement. Methods A curriculum map of core courses and an online survey of University of Guelph Master of Public Health graduates comprised the outcome assessment. The curriculum map was constructed by evaluating course outlines, assignments, and content to determine the extent to which the Core Competencies were covered in each course. Quantitative survey results were characterized using descriptive statistics. Qualitative survey results were analyzed to identify common themes and patterns in open-ended responses. Results The University of Guelph Master of Public Health program provided a positive learning environment in which graduates gained proficiency across the Core Competencies through core and elective courses, meaningful practicums, and competent faculty. Practice-based learning environments, particularly in collaboration with public health organizations, were deemed to be beneficial to students’ learning experiences. Conclusions The Core Competencies and graduate surveys can be used to conduct a meaningful and informative outcome assessment. We encourage other Master of Public Health programs to conduct their own outcome assessments using a similar framework, and disseminate these results in order to identify best practices and strengthen the Canadian graduate public health education system. PMID:25078124

Competency Assessment of Microbiology Medical Laboratory Technologists in Ontario, Canada

PubMed Central

Fleming, Christine Ann

2014-01-01

Accreditation in Ontario, Canada, requires that licensed clinical laboratories participate in external quality assessment (also known as proficiency testing) and perform competency evaluation of their staff. To assess the extent of ongoing competency assessment practices, the Quality Management Program—Laboratory Services (QMP-LS) Microbiology Committee surveyed all 112 licensed Ontario microbiology laboratories. The questionnaire consisted of a total of 21 questions that included yes/no, multiple-choice, and short-answer formats. Participants were asked to provide information about existing programs, the frequency of testing, what areas are evaluated, and how results are communicated to the staff. Of the 111 responding laboratories, 6 indicated they did not have a formal evaluation program since they perform only limited bacteriology testing. Of the remaining 105 respondents, 87% perform evaluations at least annually or every 2 years, and 61% include any test or task performed, whereas 16% and 10% focus only on problem areas and high-volume complex tasks, respectively. The most common methods of evaluation were review of external quality assessment (EQA) challenges, direct observation, and worksheet review. With the exception of one participant, all communicate results to staff, and most take remedial action to correct the deficiencies. Although most accredited laboratories have a program to assess the ongoing competency of their staff, the methods used are not standardized or consistently applied, indicating that there is room for improvement. The survey successfully highlighted potential areas for improvement and allowed the QMP-LS Microbiology Committee to provide guidance to Ontario laboratories for establishing or improving existing microbiology-specific competency assessment programs. PMID:24899030

Competency Analytics Tool: Analyzing Curriculum Using Course Competencies

ERIC Educational Resources Information Center

Gottipati, Swapna; Shankararaman, Venky

2018-01-01

The applications of learning outcomes and competency frameworks have brought better clarity to engineering programs in many universities. Several frameworks have been proposed to integrate outcomes and competencies into course design, delivery and assessment. However, in many cases, competencies are course-specific and their overall impact on the…

Minimal Competency Exam Program.

ERIC Educational Resources Information Center

Griffith, E. H.

The high school minimal competency examination described in this document is part one of a three-part program that requires that all students satisfactorily complete tests in reading, language arts, and mathematics prior to receiving a high school diploma. The document outlines the test development and assessment program and describes the plan for…

Assessing the Relevance of Higher Education Courses

ERIC Educational Resources Information Center

Gomez, Pedro; Gonzalez, Maria Jose; Gil, Francisco; Lupianez, Jose Luiz; Moreno, Maria Francisco; Rico, Luis; Romero, Isabel

2007-01-01

The establishment of the European Higher Education Area has involved specifying lists of professional competencies that programs are expected to develop, and with this the need for procedures to measure how every course within a higher education program is aligned with the program's competencies. We propose an instrument for characterizing this…

Resident self-other assessor agreement: influence of assessor, competency, and performance level.

PubMed

Lipsett, Pamela A; Harris, Ilene; Downing, Steven

2011-08-01

To review the literature on self-assessment in the context of resident performance and to determine the correlation between self-assessment across competencies in high- and low-performing residents and assessments performed by raters from a variety of professional roles (peers, nurses, and faculty). Retrospective analysis of prospectively collected anonymous self-assessment and multiprofessional (360) performance assessments by competency and overall. University-based academic general surgical program. Sixty-two residents rotating in general surgery. Mean difference for each self-assessment dyad (self-peer, self-nurse, and self-attending physician) by resident performance quartile, adjusted for measurement error, correlation coefficients, and summed differences across all competencies. Irrespective of self-other dyad, residents asked to rate their global performance overestimated their skills. Residents in the upper quartile underestimated their specific skills while those in the lowest-performing quartile overestimated their abilities when compared with faculty, peers, and especially nurse raters. Moreover, overestimation was greatest in competencies related to interpersonal skills, communication, teamwork, and professionalism. Rater, level of performance, and the competency being assessed all influence the comparison of the resident's self-assessment and those of other raters. Self-assessment of competencies related to behavior may be inaccurate when compared with raters from various professions. Residents in the lowest-performing quartile are least able to identify their weakness. These data have important implications for residents, program directors, and the public and suggest that strategies that help the lowest-performing residents recognize areas in need of improvement are needed.

Competence of birth attendants at providing emergency obstetric care under India’s JSY conditional cash transfer program for institutional delivery: an assessment using case vignettes in Madhya Pradesh province

PubMed Central

2014-01-01

Background Access to emergency obstetric care by competent staff can reduce maternal mortality. India has launched the Janani Suraksha Yojana (JSY) conditional cash transfer program to promote institutional births. During implementation of the JSY, India witnessed a steep increase in the proportion of institutional deliveries-from 40% in 2004 to 73% in 2012. However, maternal mortality reduction follows a secular trend. Competent management of complications, when women deliver in facilities under the JSY, is essential for reduction in maternal mortality and therefore to a successful program outcome. We investigate, using clinical vignettes, whether birth attendants at institutions under the program are competent at providing appropriate care for obstetric complications. Methods A facility based cross-sectional study was conducted in three districts of Madhya Pradesh (MP) province. Written case vignettes for two obstetric complications, hemorrhage and eclampsia, were administered to 233 birth attendant nurses at 73 JSY facilities. Their competence at (a) initial assessment, (b) diagnosis, and (c) making decisions on appropriate first-line care for these complications was scored. Results The mean emergency obstetric care (EmOC) competence score was 5.4 (median = 5) on a total score of 20, and 75% of participants scored below 35% of the maximum score. The overall score, although poor, was marginally higher in respondents with Skilled Birth Attendant (SBA) training, those with general nursing and midwifery qualifications, those at higher facility levels, and those conducting >30 deliveries a month. In all, 14% of respondents were competent at assessment, 58% were competent at making a correct clinical diagnosis, and 20% were competent at providing first-line care. Conclusions Birth attendants in the JSY facilities have low competence at EmOC provision. Hence, births in the JSY program cannot be considered to have access to competent EmOC. Urgent efforts are required to effectively increase the competence of birth attendants at managing obstetric complications in order to translate large gains in coverage of institutional delivery services under JSY into reductions in maternal mortality in Madhya Pradesh, India. PMID:24885817

Competency Based Training Program for Department Chairpersons and Other Resource Personnel.

ERIC Educational Resources Information Center

Bingen, Frances N.; And Others

The Competency Based Training Program is a three part, three phase package. It contains: (1) a research document; (2) a set of 18 programed units and; (3) cassettes to accompany two specific units. The program phases require that: (1) the participant and a training advisor jointly perform a needs assessment activity and select appropriate units…

Investigating the Viability of a Competency-Based, Qualitative Laboratory Assessment Model in First-Year Undergraduate Chemistry

ERIC Educational Resources Information Center

Pullen, Reyne; Thickett, Stuart C.; Bissember, Alex C.

2018-01-01

In chemistry curricula, both the role of the laboratory program and the method of assessment used are subject to scrutiny and debate. The ability to identify clearly defined competencies for the chemistry laboratory program is crucial, given the numerous other disciplines that rely on foundation-level chemistry knowledge and practical skills. In…

Skills of U.S. Unemployed, Young, and Older Adults in Sharper Focus: Results from the Program for the International Assessment of Adult Competencies (PIAAC) 2012/2014. First Look. NCES 2016-039

ERIC Educational Resources Information Center

Rampey, Bobby D.; Finnegan, Robert; Goodman, Madeline; Mohadjer, Leyla; Krenzke, Tom; Hogan, Jacquie; Provasnik, Stephen

2016-01-01

The "Program for the International Assessment of Adult Competencies" (PIAAC) is a cyclical, large-scale study of adult skills and life experiences focusing on education and employment. Nationally representative samples of adults between the ages of 16 and 65 are administered an assessment of literacy, numeracy, and problem solving in…

Educational History, Employment Characteristics, and Desired Competencies of Doctoral-Educated Athletic Trainers

PubMed Central

West, Thomas F.; Buckley, W. E.; Denegar, Craig R.

2001-01-01

Objective: The study had 3 objectives: (1) to assess the educational history of doctoral-educated certified athletic trainers (ATCs) who work at academic institutions, (2) to determine the current employment characteristics of doctoral-educated ATCs who work at academic institutions, and (3) to identify which competencies doctoral-educated ATCs feel are important for new doctoral graduates to possess upon graduation. Design and Setting: Multiple sources were used to identify doctoral-educated ATCs who work at academic institutions. These individuals were surveyed to assess their educational histories, current employment characteristics, and opinions on desired competencies for new doctoral graduates. Data were analyzed using descriptive and inferential statistics. Subjects: Surveys were sent to 130 individuals, and the response rate was 89.2% (n = 116). Measurements: Subjects answered questions regarding their educational history and employment characteristics. A 5-point Likert scale was used to assess the importance of 22 competencies for new doctoral graduates to possess upon graduation. Comparisons were made between program directors and non–program directors, respondents employed at doctoral-granting institutions and non–doctoral-granting institutions, and doctoral student advisors and non-advisors. Results: Subjects reported several different educational backgrounds, job titles, and job responsibilities. Significant differences in job responsibilities and assessment of desired competencies were found between program directors and non–program directors, employees of doctoral-granting institutions and non–doctoral-granting institutions, and doctoral student advisors and non-advisors. Conclusions: As new doctoral programs are established in athletic training, students should receive training as classroom instructors and program administrators, in addition to learning the skills necessary to perform independent research in athletic training. PMID:12937515

Assessing Culturally Competent Scholarship.

ERIC Educational Resources Information Center

Mendias, Elnora P.; Guevara, Edilma B.

2001-01-01

Eight criteria for culturally competent scholarship (contextuality, relevance, communication styles, awareness of identity and power differences, disclosure, reciprocation, empowerment, time) were applied to an international education/research nursing program. Appropriate measures for each were developed and ways to improve the program were…

Standardized patients in audiology: a proposal for a new method of evaluating clinical competence.

PubMed

Dinsmore, Brooke Freeman; Bohnert, Carrie; Preminger, Jill E

2013-05-01

While accrediting organizations require AuD programs to provide evidence that their students are able to demonstrate knowledge and competencies in specific content areas, there are no generally accepted mechanisms for the assessment and the measurement of these proficiencies. We propose that AuD programs consider developing standardized patient (SP) cases in order to develop consistent summative assessment programs within and across universities. The purpose of this article is to provide a framework for establishing SP programs to evaluate competencies in AuD students by detailing the history of SP cases and their use, developing a rationale for this method of assessment, and outlining the steps for writing and implementing SP cases. Literature review. SPs have been used to assess clinical competence in medical students for over 50 yr. The prevalence of SP assessment in allied health professions (e.g., dentistry, psychology, pharmacy) has increased over the last two decades but has only gained a limited following in audiology. SP assessment has been implemented in medical education using the Objective Structured Clinical Examination, a multistation, timed exam that uses fictional cases to assess students' clinical abilities. To date, only one published report has been completed that evaluates the use of SPs to assess clinical abilities in audiology students. This article expands upon the work of English et al (2007) and their efforts to use SPs to evaluate counseling abilities. To this end, we describe the steps necessary to write a case, procedures to determine performance requirements, and the need to develop remediation plans. As an example, we include a case that we have developed in order to evaluate vestibular assessment and patient communication skills. Utilizing SP assessment in audiology education would provide useful means to evaluate competence in a uniform way. Future research is necessary to develop reliable and valid cases that may be implemented across programs. This article aims to serve as a call to audiology programs to begin developing and reporting these cases. Once these are established we can begin to use SP cases for summative assessment. American Academy of Audiology.

Innovate and Evaluate: Expanding the Research Base for Competency-Based Education. AEI Series on Competency-Based Higher Education

ERIC Educational Resources Information Center

Kelly, Andrew P.; Columbus, Rooney

2016-01-01

Competency-based education (CBE) has garnered significant attention lately from reformers and policymakers. Put simply, CBE awards credit based on what students have learned rather than how much time they spend in class. Competency-based programs identify specific competencies, develop assessments to measure mastery of those competencies, and then…

Cultural competence: assessment and education resources for home care and hospice clinicians.

PubMed

Hines, Deborah

2014-05-01

Home healthcare and hospice clinicians face many challenges in the complex healthcare system caring for patients and their families in the home environment. One of those challenges is providing culturally competent care for an increasingly diverse population. This article will highlight free, easily accessible, online resources to assist clinicians and organizations to assess organizational and individual cultural competence and provide many resources for cultural competency education programs.

Adult Bronchoscopy Training

PubMed Central

Wahidi, Momen M.; Read, Charles A.; Buckley, John D.; Addrizzo-Harris, Doreen J.; Shah, Pallav L.; Herth, Felix J. F.; de Hoyos Parra, Alberto; Ornelas, Joseph; Yarmus, Lonny; Silvestri, Gerard A.

2015-01-01

BACKGROUND: The determination of competency of trainees in programs performing bronchoscopy is quite variable. Some programs provide didactic lectures with hands-on supervision, other programs incorporate advanced simulation centers, whereas others have a checklist approach. Although no single method has been proven best, the variability alone suggests that outcomes are variable. Program directors and certifying bodies need guidance to create standards for training programs. Little well-developed literature on the topic exists. METHODS: To provide credible and trustworthy guidance, rigorous methodology has been applied to create this bronchoscopy consensus training statement. All panelists were vetted and approved by the CHEST Guidelines Oversight Committee. Each topic group drafted questions in a PICO (population, intervention, comparator, outcome) format. MEDLINE data through PubMed and the Cochrane Library were systematically searched. Manual searches also supplemented the searches. All gathered references were screened for consideration based on inclusion criteria, and all statements were designated as an Ungraded Consensus-Based Statement. RESULTS: We suggest that professional societies move from a volume-based certification system to skill acquisition and knowledge-based competency assessment for trainees. Bronchoscopy training programs should incorporate multiple tools, including simulation. We suggest that ongoing quality and process improvement systems be introduced and that certifying agencies move from a volume-based certification system to skill acquisition and knowledge-based competency assessment for trainees. We also suggest that assessment of skill maintenance and improvement in practice be evaluated regularly with ongoing quality and process improvement systems after initial skill acquisition. CONCLUSIONS: The current methods used for bronchoscopy competency in training programs are variable. We suggest that professional societies and certifying agencies move from a volume- based certification system to a standardized skill acquisition and knowledge-based competency assessment for pulmonary and thoracic surgery trainees. PMID:25674901

Assessment Practices in Undergraduate Accounting Programs

ERIC Educational Resources Information Center

Lusher, Anna L.

2010-01-01

This study examined accounting program assessment plans at 102 colleges and universities in the United States. The research focused on identifying assessment practices in undergraduate accounting programs by examining the skills and competencies assessed and determining the methods of assessment used. The study also investigated what course and/or…

Assessing and Interpreting Student Progress: Evaluating the Competency in the Preparation of Teachers.

ERIC Educational Resources Information Center

Stolworthy, Reed L.

The purpose of this study was to determine the adequacy of the preparation provided by the teacher preparation program at Washburn University (Kansas) relative to the competency of assessing and interpreting student progress. Answers were sought to the following questions: (1) How does the student teacher evaluate his/her competence in regards to…

Assessing Opportunities for Student Pharmacist Leadership Development at Schools of Pharmacy in the United States.

PubMed

Feller, Tara T; Doucette, William R; Witry, Matthew J

2016-06-25

Objective. To summarize student pharmacist leadership development opportunities delivered by pharmacy programs, to describe selected opportunities, and to assess how these opportunities meet leadership development competencies. Methods. A multi-method study was conducted that comprised a systematic content analysis of pharmacy education journals, pharmacy program websites, and telephone interviews with key informants, which included open-ended questions and scaled responses. Results. Review of six articles, 37 American Association of Colleges of Pharmacy (AACP) Annual Meeting abstracts, and 138 websites resulted in the identification of 191 leadership development opportunities. These consisted of courses, projects/programs, and events/speaker series. Interviews with 12 key informants detailed unique events that developed leadership competencies. Formal assessments of student leadership development were limited and primarily focused on informal feedback and course evaluations. Conclusion. Most US pharmacy programs offer their students an array of opportunities to develop leadership abilities. Pharmacy programs should consider expanding opportunities beyond elective courses, learn from the successes of others to implement new leadership development opportunities, and bolster the assessment of student leadership competencies and outcomes.

Assessing Opportunities for Student Pharmacist Leadership Development at Schools of Pharmacy in the United States

PubMed Central

Feller, Tara T.; Witry, Matthew J.

2016-01-01

Objective. To summarize student pharmacist leadership development opportunities delivered by pharmacy programs, to describe selected opportunities, and to assess how these opportunities meet leadership development competencies. Methods. A multi-method study was conducted that comprised a systematic content analysis of pharmacy education journals, pharmacy program websites, and telephone interviews with key informants, which included open-ended questions and scaled responses. Results. Review of six articles, 37 American Association of Colleges of Pharmacy (AACP) Annual Meeting abstracts, and 138 websites resulted in the identification of 191 leadership development opportunities. These consisted of courses, projects/programs, and events/speaker series. Interviews with 12 key informants detailed unique events that developed leadership competencies. Formal assessments of student leadership development were limited and primarily focused on informal feedback and course evaluations. Conclusion. Most US pharmacy programs offer their students an array of opportunities to develop leadership abilities. Pharmacy programs should consider expanding opportunities beyond elective courses, learn from the successes of others to implement new leadership development opportunities, and bolster the assessment of student leadership competencies and outcomes. PMID:27402982

Skills of U.S. Unemployed, Young, and Older Adults in Sharper Focus: Results from the Program for the International Assessment of Adult Competencies (PIAAC) 2012/2014. First Look. NCES 2016-039rev

ERIC Educational Resources Information Center

Rampey, Bobby D.; Finnegan, Robert; Mohadjer, Leyla; Krenzke, Tom; Hogan, Jacquie; Provasnik, Stephen

2016-01-01

The Program for the International Assessment of Adult Competencies (PIAAC) is a cyclical, large-scale study of adult skills and life experiences focusing on education and employment. Nationally representative samples of adults between the ages of 16 and 65 are administered an assessment of literacy, numeracy, and problem solving in technology rich…

Assessment of a career development program for executive amd mid-level managers

NASA Technical Reports Server (NTRS)

Swanson, James R., Sr.

1994-01-01

This project sought to validate the competencies required of mid-level and executive managers at the Kennedy Space Center (KSC), in order to enable an assessment of the Resident Management Education Program (RMEP). Forty (40) statements describing management competencies were presented to a sample of 37 KSC managers, who judged each as essential, useful but not essential, or not needed at each of two management levels. A content validity ratio (CVR) was calculated for each competency statement at the two management levels. There was general agreement on the validity of 36 or the 40 competency statements. Based on the content validity ratios and comments from respondents, recommendations for improvement of the RMEP were made.

Army Enlisted Personnel Competency Assessment Program: Phase III Pilot Tests

DTIC Science & Technology

2007-03-01

Officer’s Representatives and Subject Matter POCs: Tonia Heffner and Peter Greenston Contract for Manpower, Personnel, Leader Development, and Training ...3926 March 2007 Army Project Number Personnel Performance 622785A790 and Training Technology Approved for public release; distribution is unlimited. 111...8217 ARMY ENLISTED PERSONNEL COMPETENCY ASSESSMENT PROGRAM: PHASE III PILOT TESTS EXECUTIVE SUMMARY Research Requirement: The Army Training and Leader

Competency Testing. An Annotated Bibliography.

ERIC Educational Resources Information Center

Jackson, Michael; Battiste, Barbara

Competency testing for either graduation from high school, or as a method for assessing whether a student should advance to a higher grade level, is the focus of this annotated bibliography. Included are annotations that relate to accountability, competency testing, program descriptions where competency testing is utilized, general testing…

Are All Competencies Equal in the Eyes of Residents? A Multicenter Study of Emergency Medicine Residents' Interest in Feedback.

PubMed

Bentley, Suzanne; Hu, Kevin; Messman, Anne; Moadel, Tiffany; Khandelwal, Sorabh; Streich, Heather; Noelker, Joan

2017-01-01

Feedback, particularly real-time feedback, is critical to resident education. The emergency medicine (EM) milestones were developed in 2012 to enhance resident assessment, and many programs use them to provide focused resident feedback. The purpose of this study was to evaluate EM residents' level of interest in receiving real-time feedback on each of the 23 competencies/sub-competencies. This was a multicenter cross-sectional study of EM residents. We surveyed participants on their level of interest in receiving real-time on-shift feedback on each of the 23 competencies/sub-competencies. Anonymous paper or computerized surveys were distributed to residents at three four-year training programs and three three-year training programs with a total of 223 resident respondents. Residents rated their level of interest in each milestone on a six-point Likert-type response scale. We calculated average level of interest for each of the 23 sub-competencies, for all 223 respondents and separately by postgraduate year (PGY) levels of training. One-way analyses of variance were performed to determine if there were differences in ratings by level of training. The overall survey response rate across all institutions was 82%. Emergency stabilization had the highest mean rating (5.47/6), while technology had the lowest rating (3.24/6). However, we observed no differences between levels of training on any of the 23 competencies/sub-competencies. Residents seem to ascribe much more value in receiving feedback on domains involving high-risk, challenging procedural skills as compared to low-risk technical and communication skills. Further studies are necessary to determine whether residents' perceived importance of competencies/sub-competencies needs to be considered when developing an assessment or feedback program based on these 23 EM competencies/sub-competencies.

Cultural competence in the master's curriculum--a course exemplar.

PubMed

Cross, Deborah; Brennan, Ann Marie Walsh; Cotter, Valerie T; Watts, Rosalyn J

2008-01-01

This article focuses on the teaching-learning strategies for integration of cultural competence in the first clinical core course in Primary Care of the Middle Aged and Older Adult, a required course for graduate students enrolled in the Adult Health Nurse Practitioner Program, Gerontology Nurse Practitioner Program, and the Family Health Nurse Practitioner Program at the University of Pennsylvania School of Nursing. Multiple teaching-learning strategies for the first clinical course consisted of preliminary online self-assessment, clinical case scenarios, critique of multicultural clinical vignettes, and cultural assessment of the clinical agency. In the outcomes of these teaching-learning strategies, it was shown, through the use of reflective diaries of nurse practitioner students and course evaluations, that the multiple strategic approaches were effective for cultural competence integration within each of the nurse practitioner programs.

A needs assessment survey of dental public health graduate education in Saudi Arabia

PubMed Central

Al Agili, Dania Ebrahim

2015-01-01

Objectives The Faculty of Dentistry at King Abdulaziz University (KAU) is planning to develop a master’s program in dental public health (DPH). To develop a curriculum for this program, a needs assessment was conducted in order to identify the level of DPH expertise that currently exists in Saudi Arabia, to identify gaps in knowledge, and to explore current perceptions regarding this type of program. Methods A competency-based survey instrument was administered to private and government affiliated dental practitioners in Jeddah, Saudi Arabia. Participants’ knowledge, attitudes, and competencies in DPH were assessed. In addition, questions were submitted that addressed preferred strategies of teaching, curriculum delivery methods, course content, and prerequisites for DPH. These data were combined with data previously collected from dentists holding academic positions at KAU (n = 146) and were analyzed using Statistical Analysis System version 9.3 software. Mean values and frequencies were calculated for the study variables. Proportional odds ratios and 95% confidence intervals were estimated to assess differences in educational preferences and DPH competencies according to age, gender, and qualification. Results Most of the participants (95%) reported a need for a DPH graduate program. The respondents had a basic knowledge of DPH and moderate experience in DPH competencies. A variety of preferred educational strategies and methods were identified and differences in educational preferences according to age, gender, and qualification of the respondents were identified. The responses obtained also acknowledged skills and competencies that the participants considered most important for a DPH practice and that would be important for students accepted into a DPH graduate program. Conclusions This needs assessment survey represents a preliminary step in establishing a DPH graduate program that addresses current gaps in knowledge and in the practice of public health dentistry. This survey also provided valuable feedback regarding the development of course content for a graduate education program in DPH. PMID:26236128

Predictors of Rater Bias in the Assessment of Social-Emotional Competence

ERIC Educational Resources Information Center

Shapiro, Valerie B.; Kim, B. K. Elizabeth; Accomazzo, Sarah; Roscoe, Joe N.

2016-01-01

"The Devereux Student Strengths Assessment Mini" (DESSA-Mini) (LeBuffe, Shapiro, & Naglieri, 2014) efficiently monitors the growth of Social-Emotional Competence (SEC) in the routine implementation of Social Emotional Learning programs. The DESSA-Mini is used to assess approximately half a million children around the world. Since…

To Assess Students' Attitudes, Skills and Competencies in Mathematical Modeling

ERIC Educational Resources Information Center

Lingefjard, Thomas; Holmquist, Mikael

2005-01-01

Peer-to-peer assessment, take-home exams and a mathematical modeling survey were used to monitor and assess students' attitudes, skills and competencies in mathematical modeling. The students were all in a secondary mathematics, teacher education program with a comprehensive amount of mathematics studies behind them. Findings indicate that…

Assessment of Teaching Competence for Improvement of Instruction.

ERIC Educational Resources Information Center

National IOTA Program, Tempe, AZ.

This report provides a general overview of the Instrument for the Observation of Teaching Activities (IOTA) program for assessing and improving teacher competence. IOTA is an analytic, objective, and specific means of assessing teaching activities. The normal three-step progression of groups through the introductory and training stages of the…

Aid Professional Growth. Module CG D-2 of Category D--Operating. Competency-Based Career Guidance Modules.

ERIC Educational Resources Information Center

Ruff, Eldon E.

This learning module, one in a series of competency-based guidance program training packages focusing upon professional and paraprofessional competencies of guidance personnel, deals with aiding professional growth. Addressed in the module are the following topics: assessing competencies; determining certification, licensure, and registration…

Trainees' Perceptions of a Final Oral Competency Examination

ERIC Educational Resources Information Center

Goldberg, Robert W.; Young, Kevin R.

2016-01-01

Objective(s): The focus on competency attainment by professional psychology trainees obligates training programs to assess these competencies prior to completion of an internship. However, little is known about how trainees may perceive such testing. This study examines relationships between performance on an Oral Final Competency Examination of a…

PDE Occupational Competency Assessment Project--1979. Final Report. Occupational Competency Evaluation Monograph, Number 10. Vocational Technical Education Research Report, Volume 17, Number 23.

ERIC Educational Resources Information Center

Funk, Gerald W.

A project continued activity to improve the occupational competency assessment program for evaluating and certifying vocational education teachers. Development of new testing was continued by Temple University, The Pennsylvania State University, and University of Pittsburgh. Workshops for test developers were conducted to ensure standardization of…

Guidelines for the Statement and Assessment of Student Competencies. Teacher Education Forum Series. Vol. 1, No. 10.

ERIC Educational Resources Information Center

Bullock, Terry; And Others

This paper, prepared by the Division of Teacher Education Evaluation Team at Indiana University, presents a set of proposed student competencies and ways to assess them. It also contains the guidelines developed by the evaluation team to help teacher education projects and programs in developing competencies and measurement procedures, as well as…

Benchmarking ACEJMC Competencies: What It Means for Assessment

ERIC Educational Resources Information Center

Henderson, Jennifer J.; Christ, William G.

2014-01-01

The Accrediting Council on Education in Journalism and Mass Communications (ACEJMC) has developed twelve professional values and competencies that all students in accredited programs must demonstrate before graduation. This study asked Association of Schools of Journalism and Mass Communication (ASJMC) program administrators which competencies…

Improving Prevention Programs: First Results on the Relation between Subjectively Perceived Levels of Usefulness and Social Competencies

ERIC Educational Resources Information Center

Grumm, Mandy; Hein, Sascha; Fingerle, Michael

2013-01-01

School-based aggression prevention programs have been implemented in many educational institutions, and fostering the development of social competencies is one of the central aspects of many approaches. The aim of the present study was to assess the level of subjectively perceived usefulness of the prevention program "Faustlos" in…

Developing a tool for assessing competency in root cause analysis.

PubMed

Gupta, Priyanka; Varkey, Prathibha

2009-01-01

Root cause analysis (RCA) is a tool for identifying the key cause(s) contributing to a sentinel event or near miss. Although training in RCA is gaining popularity in medical education, there is no published literature on valid or reliable methods for assessing competency in the same. A tool for assessing competency in RCA was pilot tested as part of an eight-station Objective Structured Clinical Examination that was conducted at the completion of a three-week quality improvement (QI) curriculum for the Mayo Clinic Preventive Medicine and Endocrinology fellowship programs. As part of the curriculum, fellows completed a QI project to enhance physician communication of the diagnosis and treatment plan at the end of a patient visit. They had a didactic session on RCA, followed by process mapping of the information flow at the project clinic, after which fellows conducted an actual RCA using the Ishikawa fishbone diagram. For the RCA competency assessment, fellows performed an RCA regarding a scenario describing an adverse medication event and provided possible solutions to prevent such errors in the future. All faculty strongly agreed or agreed that they were able to accurately assess competency in RCA using the tool. Interrater reliability for the global competency rating and checklist scoring were 0.96 and 0.85, respectively. Internal consistency (Cronbach's alpha) was 0.76. Six of eight of the fellows found the difficulty level of the test to be optimal. Assessment methods must accompany education programs to ensure that graduates are competent in QI methodologies and are able to apply them effectively in the workplace. The RCA assessment tool was found to be a valid, reliable, feasible, and acceptable method for assessing competency in RCA. Further research is needed to examine its predictive validity and generalizability.

How Is Health Related to Literacy, Numeracy, and Technological Problem-Solving Skills among U.S. Adults? Evidence from the Program for the International Assessment of Adult Competencies (PIAAC)

ERIC Educational Resources Information Center

Prins, Esther; Monnat, Shannon; Clymer, Carol; Toso, Blaire Wilson

2015-01-01

This paper uses data from the Program for the International Assessment of Adult Competencies (PIAAC) to analyze the relationship between U.S. adults' self-reported health and proficiencies in literacy, numeracy, and technological problem solving. Ordinal logistic regression analyses showed that scores on all three scales were positively and…

Competency Assessment in Family Medicine Residency: Observations, Knowledge-Based Examinations, and Advancement.

PubMed

Mainous, Arch G; Fang, Bo; Peterson, Lars E

2017-12-01

The Family Medicine (FM) Milestones are competency-based assessments of residents in key dimensions relevant to practice in the specialty. Residency programs use the milestones in semiannual reviews of resident performance from the time of entry into the program to graduation. Using a national sample, we investigated the relationship of FM competency-based assessments to resident progress and the complementarity of milestones with knowledge-based assessments in FM residencies. We used midyear and end-of-year milestone ratings for all FM residents in Accreditation Council for Graduate Medical Education-accredited programs during academic years 2014-2015 and 2015-2016. The milestones contain 22 items across 6 competencies. We created a summative index across the milestones. The American Board of Family Medicine database provided resident demographics and in-training examination (ITE) scores. We linked information to the milestone data. The sample encompassed 6630 FM residents. The summative milestone index increased, on average, for each cohort (postgraduate year 1 [PGY-1] to PGY-2 and PGY-2 to PGY-3) at each assessment. The correlation between the milestone index that excluded the medical knowledge milestone and ITE scores was r  = .195 ( P  < .001) for PGY-1 to PGY-2 cohort and r  = .254 ( P  < .001) for PGY-2 to PGY-3 cohort. For both cohorts, ITE scores and composite milestone assessments were higher for residents who advanced than for those who did not. Competency-based assessment using the milestones for FM residents seems to be a viable multidimensional tool to assess the successful progression of residents.

Developing an Assessment Program for a University Health Sciences Major.

ERIC Educational Resources Information Center

Travis, H. Richard

1996-01-01

Reviews the procedures used by James Madison University (Virginia) to develop an assessment plan for the Health Sciences major. The assessment program included cognitive areas, basic competencies of entry-level health educators, student teaching, alumni surveys, and information literacy. The assessment program was reviewed by outside peer…

Service-Based Learning for Residents: A Success for Communities and Medical Education.

PubMed

Gefter, Liana; Merrell, Sylvia Bereknyei; Rosas, Lisa G; Morioka-Douglas, Nancy; Rodriguez, Eunice

2015-01-01

Community-based service-learning opportunities could support residents' acquisition of Accreditation Council for Graduate Medical Education (ACGME) competencies, but this concept has not been tested, and such programs are difficult to find. The objective of this work was to assess the value and the ACGME competency relevance of a service-learning program for residents that could be easily replicated nationally. Forty-one family medicine residents from three training programs participated in the Stanford Youth Diabetes Coaches Program at six high schools in California and Georgia serving minority students of low socioeconomic status. Residents completed online surveys to provide qualitative feedback and assess the program's impact on their acquisition of residency program competencies and self-management support proficiencies, including prior use and planned use of action plans-a key self-management support strategy. Ninety-five percent of residents indicated that the program was a valuable experience that contributed to acquisition of residency program competencies, including interpersonal and communication skills and communication with teens. Compared with baseline, significantly more residents reported intention to use action plans with patients following participation. Themes from qualitative feedback included: valuing the overall experience, increasing opportunities to practice teaching, enhancing their ability to communicate with adolescents, contributing to the health of the community, recognizing the potential of action plans, and increasing intent to use action plans. This pilot demonstrated that a brief service-learning program can enhance standard residency curriculum by encouraging acquisition of ACGME competencies and promoting utilization of self-management support in clinical practice.

Assessment of Multiple Physician Competencies in Postgraduate Training: Utility of the Structured Oral Examination

ERIC Educational Resources Information Center

Jefferies, Ann; Simmons, Brian; Ng, Eugene; Skidmore, Martin

2011-01-01

Competency based medical education involves assessing physicians-in-training in multiple roles. Training programs are challenged by the need to introduce appropriate yet feasible assessment methods. We therefore examined the utility of a structured oral examination (SOE) in the assessment of the 7 CanMEDS roles (Medical Expert, Communicator,…

Diversity in emergency medicine education: expanding the horizon.

PubMed

Bowman, Steven H; Moreno-Walton, Lisa; Ezenkwele, Ugo A; Heron, Sheryl L

2011-10-01

An emergency medicine (EM)-based curriculum on diversity, inclusion, and cultural competency can also serve as a mechanism to introduce topics on health care disparities. Although the objectives of such curricula and the potential benefits to EM trainees are apparent, there are relatively few resources available for EM program directors to use to develop these specialized curricula. The object of this article is to 1) broadly discuss the current state of curricula of diversity, inclusion, and cultural competency in EM training programs; 2) identify tools and disseminate strategies to embed issues of disparities in health care in the creation of the curriculum; and 3) provide resources for program directors to develop their own curricula. A group of EM program directors with an interest in cultural competency distributed a preworkshop survey through the Council of Emergency Medicine Residency Directors (CORD) e-mail list to EM program directors to assess the current state of diversity and cultural competency training in EM programs. Approximately 50 members attended a workshop during the 2011 CORD Academic Assembly as part of the Best Practices track, where the results of the survey were disseminated and discussed. In addition to the objectives listed above, the presenters reviewed the literature regarding the rationale for a cultural competency curriculum and its relationship to addressing health care disparities, the relationship to unconscious physician bias, and the Tool for Assessing Cultural Competence Training (TACCT) model for curriculum development. © 2011 by the Society for Academic Emergency Medicine.

Family Medicine Residency Program Directors Attitudes and Knowledge of Family Medicine CAM Competencies

PubMed Central

Gardiner, Paula; Filippelli, Amanda C.; Lebensohn, Patricia; Bonakdar, Robert

2013-01-01

Context Little is known about the incorporation of integrative medicine (IM) and complementary and alternative medicine (CAM) into family medicine residency programs. Objective The Society for Teachers of Family Medicine (STFM) approved a set of CAM/IM competencies for family medicine residencies. We hope to evaluate with an online survey tool, whether residency programs are implementing such competencies into their curriculum. We also hope to assess the knowledge and attitudes of Residency Directors (RDs) on the CAM/IM competencies. Design A survey was distributed by the CAFM (Council of Academic Family Medicine) Educational Research Alliance to RDs via email. The survey was distributed to 431 RDs. Of those who received it, 212 responded for a response rate of 49.1%. Questions assessed the knowledge and attitudes of CAM/IM competencies and incorporation of CAM/IM into residency curriculum. Results Forty-five percent of RDs were aware of the competencies. In term of RD attitudes, 58% reported that CAM/IM is an important component of residents' curriculum yet, 60% report not having specific learning objectives for CAM/IM in their residency curriculum. Among all programs, barriers to CAM/IM implementation included: time in residents' schedules (77%); faculty training (75%); access to CAM experts (43%); lack of reimbursement (43%), and financial resources (29%). Conclusions While many RDs are aware of the STFM CAM/IM competencies and acknowledge their role in residence education, there are many barriers preventing residencies to implementing the STFM CAM/IM competencies. PMID:24021471

Family medicine residency program directors attitudes and knowledge of family medicine CAM competencies.

PubMed

Gardiner, Paula; Filippelli, Amanda C; Lebensohn, Patricia; Bonakdar, Robert

2013-01-01

Little is known about the incorporation of integrative medicine (IM) and complementary and alternative medicine (CAM) into family medicine residency programs. The Society for Teachers of Family Medicine (STFM) approved a set of CAM/IM competencies for family medicine residencies. We hope to evaluate whether residency programs are implementing such competencies into their curriculum using an online survey tool. We also hope to assess the knowledge and attitudes of Residency Directors (RDs) on the CAM/IM competencies. A survey was distributed by the Council of Academic Family Medicine (CAFM) Educational Research Alliance to RDs via e-mail. The survey was distributed to 431 RDs. Of those who received it, 212 responded, giving a response rate of 49.1%. Questions assessed the knowledge and attitudes of CAM/IM competencies and incorporation of CAM/IM into the residency curriculum. Forty-five percent of RDs were aware of the competencies. In terms of RD attitudes, 58% reported that CAM/IM is an important component of residents' curriculum; yet, 60% report not having specific learning objectives for CAM/IM in their residency curriculum. Among all programs, barriers to CAM/IM implementation included time in residents' schedules (77%); faculty training (75%); access to CAM experts (43%); lack of reimbursement (43%); and financial resources (29%). While many RDs are aware of the STFM CAM/IM competencies and acknowledge their role in residence education, there are many barriers that prevent residencies from implementing the STFM CAM/IM competencies. © 2013 Elsevier Inc. All rights reserved.

The State of Evaluation in Internal Medicine Residency

PubMed Central

Holmboe, Eric; Beasley, Brent W.

2008-01-01

Background There are no nationwide data on the methods residency programs are using to assess trainee competence. The Accreditation Council for Graduate Medical Education (ACGME) has recommended tools that programs can use to evaluate their trainees. It is unknown if programs are adhering to these recommendations. Objective To describe evaluation methods used by our nation’s internal medicine residency programs and assess adherence to ACGME methodological recommendations for evaluation. Design Nationwide survey. Participants All internal medicine programs registered with the Association of Program Directors of Internal Medicine (APDIM). Measurements Descriptive statistics of programs and tools used to evaluate competence; compliance with ACGME recommended evaluative methods. Results The response rate was 70%. Programs were using an average of 4.2–6.0 tools to evaluate their trainees with heavy reliance on rating forms. Direct observation and practice and data-based tools were used much less frequently. Most programs were using at least 1 of the Accreditation Council for Graduate Medical Education (ACGME)’s “most desirable” methods of evaluation for all 6 measures of trainee competence. These programs had higher support staff to resident ratios than programs using less desirable evaluative methods. Conclusions Residency programs are using a large number and variety of tools for evaluating the competence of their trainees. Most are complying with ACGME recommended methods of evaluation especially if the support staff to resident ratio is high. PMID:18612734

Ethics education in family medicine training in the United States: a national survey.

PubMed

Manson, Helen M; Satin, David; Nelson, Valerie; Vadiveloo, Thenmalar

2014-01-01

Although professional organizations endorse ethics education in family medicine training, there is little published evidence that ethics teaching occurs. This survey collated data on the aims, content, pedagogical methods, assessment, and barriers relating to formal ethics education in family medicine residency programs in the United States. A questionnaire surveyed all 445 family medicine residency programs in the United States. Forty percent of programs responded (178/445). Of these, 95% formally teach at least one ethics topic, 68.2% teach six or more topics, and 7.1% teach all 13 core topics specified in the questionnaire. Programs show variation, providing between zero to 100 hours' ethics education over the 3 years of residency training. Of the responding programs, 3.5% specify well-defined aims for ethics teaching, 25.9% designate overall responsibility for the ethics curriculum to one individual, and 33.5% formally assess ethics competencies. The most frequent barriers to ethics education are finding time in residents' schedules (59.4%) and educator expertise (21.8%). Considerable variation in ethics education is apparent in both curricular content and delivery among family medicine residency programs in the United States. Additional findings included a lack of specification of explicit curricular aims for ethics teaching allied to ACGME or AAFP competencies, a tendency not to designate one faculty member with lead responsibility for ethics teaching in the residency program, and a lack of formal assessment of ethics competencies. This has occurred in the context of an absence of robust assessment of ethics competencies at board certification level.

Implementing Competency-Based Medical Education in a Postgraduate Family Medicine Residency Training Program: A Stepwise Approach, Facilitating Factors, and Processes or Steps That Would Have Been Helpful.

PubMed

Schultz, Karen; Griffiths, Jane

2016-05-01

In 2009-2010, the postgraduate residency training program at the Department of Family Medicine, Queen's University, wrestled with the practicalities of competency-based medical education (CBME) implementation when its accrediting body, the College of Family Physicians of Canada, introduced the competency-based Triple C curriculum. The authors used a stepwise approach to implement CMBE; the steps were to (1) identify objectives, (2) identify competencies, (3) map objectives and competencies to learning experiences and assessment processes, (4) plan learning experiences, (5) develop an assessment system, (6) collect and interpret data, (7) adjust individual residents' training programs, and (8) distribute decisions to stakeholders. The authors also note overarching processes, costs, and facil itating factors and processes or steps that would have been helpful for CBME implementation. Early outcomes are encouraging. Residents are being directly observed more often with increased documented feedback about performance based on explicit competency standards (24,000 data points for 150 residents from 2013 to 2015). These multiple observations are being collated in a way that is allowing the identification of patterns of performance, red flags, and competency development trajectory. Outliers are being identified earlier, resulting in earlier individualized modification of their residency training program. The authors will continue to provide and refine faculty development, are developing an entrustable professional activity field note app for handheld devices, and are undertaking research to explore what facilitates learners' competency development, what increases assessors' confidence in making competence decisions, and whether residents are better trained as a result of CBME implementation.

Effects of a Multifocused Prevention Program on Preschool Children's Competencies and Behavior Problems

ERIC Educational Resources Information Center

Stefan, Catrinel A.; Miclea, Mircea

2013-01-01

This study was designed to assess the effectiveness of a multifocused (child-, teacher- and parent-focused) prevention program for Romanian preschoolers, targeting social--emotional competence development, as well as reduction of behavior problems. Fourteen classrooms were randomly assigned to the intervention and control conditions. Subsequent…

Criteria for Reviewing District Competency Tests.

ERIC Educational Resources Information Center

Herman, Joan L.

A formative evaluation minimum competency test model is examined. The model systematically uses assessment information to support and facilitate program improvement. In terms of the model, four inter-related qualities are essential for a sound testing program. The content validity perspective looks at how well the district has defined competency…

Medicine in the 21st century: recommended essential geriatrics competencies for internal medicine and family medicine residents.

PubMed

Williams, Brent C; Warshaw, Gregg; Fabiny, Anne Rebecca; Lundebjerg Mpa, Nancy; Medina-Walpole, Annette; Sauvigne, Karen; Schwartzberg, Joanne G; Leipzig, Rosanne M

2010-09-01

Physician workforce projections by the Institute of Medicine require enhanced training in geriatrics for all primary care and subspecialty physicians. Defining essential geriatrics competencies for internal medicine and family medicine residents would improve training for primary care and subspecialty physicians. The objectives of this study were to (1) define essential geriatrics competencies common to internal medicine and family medicine residents that build on established national geriatrics competencies for medical students, are feasible within current residency programs, are assessable, and address the Accreditation Council for Graduate Medical Education competencies; and (2) involve key stakeholder organizations in their development and implementation. Initial candidate competencies were defined through small group meetings and a survey of more than 100 experts, followed by detailed item review by 26 program directors and residency clinical educators from key professional organizations. Throughout, an 8-member working group made revisions to maintain consistency and compatibility among the competencies. Support and participation by key stakeholder organizations were secured throughout the project. The process identified 26 competencies in 7 domains: Medication Management; Cognitive, Affective, and Behavioral Health; Complex or Chronic Illness(es) in Older Adults; Palliative and End-of-Life Care; Hospital Patient Safety; Transitions of Care; and Ambulatory Care. The competencies map directly onto the medical student geriatric competencies and the 6 Accreditation Council for Graduate Medical Education Competencies. Through a consensus-building process that included leadership and members of key stakeholder organizations, a concise set of essential geriatrics competencies for internal medicine and family medicine residencies has been developed. These competencies are well aligned with concerns for residency training raised in a recent Medicare Payment Advisory Commission report to Congress. Work is underway through stakeholder organizations to disseminate and assess the competencies among internal medicine and family medicine residency programs.

The Comparison of School-Age Children's Performance on Two Motor Assessments: The Test of Gross Motor Development and the Movement Assessment Battery for Children

ERIC Educational Resources Information Center

Logan, Samuel W.; Robinson, Leah E.; Rudisill, Mary E.; Wadsworth, Danielle D.; Morera, Maria

2014-01-01

Background: Competence in the motor domain is associated with positive, health-related outcomes. Physical education teachers often administer assessments into their programs to measure motor competence for a variety of reasons. Recently, researchers have questioned the relatedness of performance on different assessments. Purpose: The purpose of…

Procedural training and assessment of competency utilizing simulation.

PubMed

Sawyer, Taylor; Gray, Megan M

2016-11-01

This review examines the current environment of neonatal procedural learning, describes an updated model of skills training, defines the role of simulation in assessing competency, and discusses potential future directions for simulation-based competency assessment. In order to maximize impact, simulation-based procedural training programs should follow a standardized and evidence-based approach to designing and evaluating educational activities. Simulation can be used to facilitate the evaluation of competency, but must incorporate validated assessment tools to ensure quality and consistency. True competency evaluation cannot be accomplished with simulation alone: competency assessment must also include evaluations of procedural skill during actual clinical care. Future work in this area is needed to measure and track clinically meaningful patient outcomes resulting from simulation-based training, examine the use of simulation to assist physicians undergoing re-entry to practice, and to examine the use of procedural skills simulation as part of a maintenance of competency and life-long learning. Copyright © 2016 Elsevier Inc. All rights reserved.

Competency-based achievement system: using formative feedback to teach and assess family medicine residents' skills.

PubMed

Ross, Shelley; Poth, Cheryl N; Donoff, Michel; Humphries, Paul; Steiner, Ivan; Schipper, Shirley; Janke, Fred; Nichols, Darren

2011-09-01

Family medicine residency programs require innovative means to assess residents' competence in "soft" skills (eg, patient-centred care, communication, and professionalism) and to identify residents who are having difficulty early enough in their residency to provide remedial training. To develop a method to assess residents' competence in various skills and to identify residents who are having difficulty. The Competency-Based Achievement System (CBAS) was designed to measure competence using 3 main principles: formative feedback, guided self-assessment, and regular face-to-face meetings. The CBAS is resident driven and provides a framework for meaningful interactions between residents and advisors. Residents use the CBAS to organize and review their feedback, to guide their own assessment of their progress, and to discern their future learning needs. Advisors use the CBAS to monitor, guide, and verify residents' knowledge of and competence in important skills. By focusing on specific skills and behaviour, the CBAS enables residents and advisors to make formative assessments and to communicate their findings. Feedback indicates that the CBAS is a user-friendly and helpful system to assess competence.

Creation of a competency-based professional development program for infection preventionists guided by the APIC Competency Model: steps in the process.

PubMed

Bernard, Heather; Hackbarth, Diana; Olmsted, Russell N; Murphy, Denise

2018-06-07

Infection Preventionists have varying levels of educational preparation. Many have no prior experience in IP. The diversity makes design of professional development programs challenging. Recent surveys suggest that only about half of practicing IPs are board certified. There is an urgent need to employ competent IP's to drive improvement in patient outcomes. This is a project that utilized the APIC Competency Model to create a professional development program characterizing three career stages. Methods included a review of literature on professional development; a survey of IP competence; an assessment of job descriptions and performance evaluations; and a crosswalk of IP competencies. The professional development program includes competency - based IP job descriptions and performance evaluations for each career stage; a professional portfolio; and a toolkit for supervisors. Participants agreed that application of the model resulted in tools which are more closely aligned with current roles for IPs; and increased satisfaction and motivation with the new program. Competent and knowledgeable IP's are crucial to optimizing efficacy of IPC programs. A professional development program has the potential to guide staff orientation, improve satisfaction and retention, improve patient outcomes and promote a positive trajectory in advancing practice. Copyright © 2018 Association for Professionals in Infection Control and Epidemiology, Inc. Published by Elsevier Inc. All rights reserved.

Multi-institutional validation of a web-based core competency assessment system.

PubMed

Tabuenca, Arnold; Welling, Richard; Sachdeva, Ajit K; Blair, Patrice G; Horvath, Karen; Tarpley, John; Savino, John A; Gray, Richard; Gulley, Julie; Arnold, Teresa; Wolfe, Kevin; Risucci, Donald A

2007-01-01

The Association of Program Directors in Surgery and the Division of Education of the American College of Surgeons developed and implemented a web-based system for end-of-rotation faculty assessment of ACGME core competencies of residents. This study assesses its reliability and validity across multiple programs. Each assessment included ratings (1-5 scale) on 23 items reflecting the 6 core competencies. A total of 4241 end-of-rotation assessments were completed for 332 general surgery residents (> or =5 evaluations each) at 5 sites during the 2004-2005 and 2005-2006 academic years. The mean rating for each resident on each item was computed for each academic year. The mean rating of items representing each competency was computed for each resident. Additional data included USMLE and ABSITE scores, PGY, and status in program (categorical, designated preliminary, and undesignated preliminary). Coefficient alpha was greater than 0.90 for each competency score. Mean ratings for each competency increased significantly (p < 0.01) as a function of PGY. Mean ratings for professionalism and interpersonal/communication skills (IPC) were significantly higher than all other competencies at all PGY levels. Competency ratings of PGY 1 residents correlated significantly with USMLE Step I, ranging from (r = 0.26, p < 0.01) for Professionalism to (r = 0.41, p < 0.001) for Systems-Based Practice. Ratings of Knowledge (r = 0.31, p < 0.01), Practice-Based Learning & Improvement (PBLI; r = 0.22, p < 0.05), and Systems-Based Practice (r = 0.20, p < 0.05) correlated significantly with 2005 ABSITE Total Percentile. Ratings of all competencies correlated significantly with the 2006 ABSITE Total Percentile Score (range: r = 0.20, p < 0.05 for professionalism to r = 0.35, p < 0.001 for knowledge). Categorical and designated preliminary residents received significantly higher ratings (p < 0.05) than nondesignated preliminaries for knowledge, patient care, PBLI, and systems-based practice only. Faculty ratings of core competencies are internally consistent. The pattern of statistically significant correlations between competency ratings and USMLE and ABSITE scores supports the postdictive and concurrent validity, respectively, of faculty perceptions of resident knowledge. The pattern of increased ratings as a function of PGY supports the construct validity of faculty ratings of resident core competencies.

An Assessment of an Operational Educational Accountability System for Continuing Education in the Health Professions.

ERIC Educational Resources Information Center

Walsh, Patrick L.

1982-01-01

The Educational Quality Assessment and Assurance System for continuing education in health sciences includes three components to measure inputs, processes, and outcomes. They are (1) Program Coordinator Competency List, (2) Quality Assessment and Assurance Program, and (3) evaluation of educational programs. (SK)

Assessing and Teaching Competence

ERIC Educational Resources Information Center

Grant, Terri

2004-01-01

The Professional Communication Unit (PCU) at the University of Cape Town (UCT) recently conducted a business communication needs analysis to determine student perceptions of their communicative competence and the teaching strategies being used to develop such competence. Students felt that the specialist, stand-alone communication program was more…

Implementing Competency-Based Business Curricula in Higher Education

ERIC Educational Resources Information Center

Dragoo, Amie; Barrows, Richard

2016-01-01

Development of competency-based education business curricula at three universities showed substantial variation. Curriculum competencies were developed from traditional learning objectives or employer interviews and addressed once or several times. Assessments were unique or based on traditional program or national examinations. Faculty roles were…

Increasing Cultural Competence through Needs Assessment and Professional Development

ERIC Educational Resources Information Center

Smith, Natasha L.; Bahr, Michael W.

2014-01-01

The increasing cultural diversity of American students makes it imperative for school-based professionals to engage in culturally-competent practice, thereby ensuring high-quality mental health services. Although most cultural competence training occurs in university programs, research shows practicing mental health professionals would benefit…

Assessing competencies: an evaluation of ASTD's Certified Professional in Learning and Performance (CPLP) designation.

PubMed

Kwon, Seolim; Wadholm, Robert R; Carmody, Laurie E

2014-06-01

The American Society of Training and Development's (ASTD) Certified Professional in Learning and Performance (CPLP) program is purported to be based on the ASTD's competency model, a model which outlines foundational competencies, roles, and areas of expertise in the field of training and performance improvement. This study seeks to uncover the relationship between the competency model and the CPLP knowledge exam questions and work product submissions (two of the major instruments used to test for competency of CPLP applicants). A mixed qualitative-quantitative approach is used to identify themes, quantify relationships, and assess questions and guidelines. Multiple raters independently analyzed the data and identified key themes, and Fleiss' Kappa coefficient was used in measuring inter-rater agreement. The study concludes that several discrepancies exist between the competency model and the knowledge exam and work product submission guidelines. Recommendations are given for possible improvement of the CPLP program. Copyright © 2014 Elsevier Ltd. All rights reserved.

Conceptualization and Pilot Testing of a Core Competency-Based Training Workshop in Suicide Risk Assessment and Management: Notes From the Field.

PubMed

Cramer, Robert J; Bryson, Claire N; Eichorst, Morgam K; Keyes, Lee N; Ridge, Brittany E

2017-03-01

As professional psychology training programs and continuing education have moved toward competency based approaches, it has become equally important to develop uniform, evidence-based approaches for suicide risk assessment and management. The present article presents a workshop curriculum based on established core competencies in suicide risk assessment and management. Drawing on theories suicide risk formation, the workshop features an integration of didactic, process, and experiential components. We present pilot data from 2 small group workshops (n = 17): 1 from a clinical psychology doctoral program and 1 from a university counseling center. Workshop participation yielded increases in (a) the ability to recognize appropriate clinician responses to suicidal client statements, (b) self-perceptions of general capacity to interface with suicidal patients and mastery of the 10 core competencies, (c) factual knowledge concerning suicide risk assessment and management, and (d) the self-rated ability to assess and manage a suicidal patient. We discuss statistical and generalizability limitations as well as implications for future modification, implementation, and provision of this training method. © 2016 Wiley Periodicals, Inc.

Continuing education training focused on the development of behavioral telehealth competencies in behavioral healthcare providers.

PubMed

Gifford, V; Niles, B; Rivkin, I; Koverola, C; Polaha, J

2012-01-01

Telehealth allows behavioral health care and specialty services to be extended to rural residents. Telehealth is an important resource for the Alaskan healthcare system, which is tasked with providing services to culturally diverse populations living in remote areas. Training competent providers to deliver telehealth services is vital for the implementation of successful telehealth programs. Yet, the literature is lacking in the area of provider behavioral telehealth competency training. This study assessed the impact of a Behavioral Telehealth Ethical Competencies Training program on 16 behavioral health providers' development of behavioral telehealth competency. A total of 14 competencies were developed, which required participants to understand the roles and responsibilities of a behavioral telehealth coordinator working at the distal site as well as the roles and responsibilities of the therapist. Video vignettes evaluating the 14 competencies, self-reported competence surveys and follow-up surveys of progress on telehealth goals were utilized to assess effects of the training. Results indicated participants' behavioral telehealth competencies increased following training. Participants reported positive perceptions regarding their competency, and achieved progress on the majority of behavioral telehealth goals set during the training. This study provides a baseline for developing a best practice model for behavioral telehealth service delivery by identifying specific provider competencies for administering effective behavioral telehealth services. A unique continuing education training model, led by content experts including university professors and Alaska Native Elders, incorporating behavioral telehealth, rural ethics, cultural competency and vicarious trauma training is described. Lastly, this study details the use of an innovative video vignette assessment instrument for evaluating the effectiveness of continuing education training.

Literacy, Numeracy, and Problem Solving in Technology-Rich Environments among U.S. Adults: Results from the Program for the International Assessment of Adult Competencies 2012. Appendix D: Standard Error Tables. First Look. NCES 2014-008

ERIC Educational Resources Information Center

National Center for Education Statistics, 2013

2013-01-01

This paper provides Appendix D, Standard Error tables, for the full report, entitled. "Literacy, Numeracy, and Problem Solving in Technology-Rich Environments among U.S. Adults: Results from the Program for the International Assessment of Adult Competencies 2012. First Look. NCES 2014-008." The full report presents results of the Program…

Literacy, Numeracy, and Problem Solving in Technology-Rich Environments among U.S. Adults: Results from the Program for the International Assessment of Adult Competencies 2012. First Look. NCES 2014-008

ERIC Educational Resources Information Center

Goodman, Madeline; Finnegan, Robert; Mohadjer, Leyla; Krenzke, Tom; Hogan, Jacquie

2013-01-01

The Program for the International Assessment of Adult Competencies (PIAAC) is a cyclical, large scale study of adult skills and life experience focusing on education and employment that was developed and organized by the Organization for Economic Cooperation and Development (OECD). In the United States, the study was conducted in 2011-12 with a…

Modifying the Primary Care Exception Rule to Require Competency-Based Assessment.

PubMed

Tobin, Daniel G; Doolittle, Benjamin R; Ellman, Matthew S; Ruser, Christopher B; Brienza, Rebecca S; Genao, Inginia

2017-03-01

Teaching residents to practice independently is a core objective of graduate medical education (GME). However, billing rules established by the Centers for Medicare and Medicaid Services (CMS) require that teaching physicians physically be present in the examination room for the care they bill, unless the training program qualifies for the Primary Care Exception Rule (PCER). Teaching physicians in programs that use this exception can bill for indirectly supervised ambulatory care once the resident who provides that care has completed six months of training. However, CMS does not mandate that programs assess or attest to residents' clinical competence before using this rule. By requiring this six-month probationary period, the implication is that residents are adequately prepared for indirectly supervised practice by this time. As residents' skill development varies, this may or may not be true. The PCER makes no attempt to delineate how residents' competence should be assessed, nor does the GME community have a standard for how and when to make this assessment specifically for the purpose of determining residents' readiness for indirectly supervised primary care practice.In this Perspective, the authors review the history and current requirements of the PCER, explore its limitations, and offer suggestions for how to modify the teaching physician billing requirements to mandate the evaluation of residents' competence using the existing milestones framework. They also recommend strategies to standardize this process of evaluation and to develop benchmarks across training programs.

Initial construct validity evidence of a virtual human application for competency assessment in breaking bad news to a cancer patient.

PubMed

Guetterman, Timothy C; Kron, Frederick W; Campbell, Toby C; Scerbo, Mark W; Zelenski, Amy B; Cleary, James F; Fetters, Michael D

2017-01-01

Despite interest in using virtual humans (VHs) for assessing health care communication, evidence of validity is limited. We evaluated the validity of a VH application, MPathic-VR, for assessing performance-based competence in breaking bad news (BBN) to a VH patient. We used a two-group quasi-experimental design, with residents participating in a 3-hour seminar on BBN. Group A (n=15) completed the VH simulation before and after the seminar, and Group B (n=12) completed the VH simulation only after the BBN seminar to avoid the possibility that testing alone affected performance. Pre- and postseminar differences for Group A were analyzed with a paired t -test, and comparisons between Groups A and B were analyzed with an independent t -test. Compared to the preseminar result, Group A's postseminar scores improved significantly, indicating that the VH program was sensitive to differences in assessing performance-based competence in BBN. Postseminar scores of Group A and Group B were not significantly different, indicating that both groups performed similarly on the VH program. Improved pre-post scores demonstrate acquisition of skills in BBN to a VH patient. Pretest sensitization did not appear to influence posttest assessment. These results provide initial construct validity evidence that the VH program is effective for assessing BBN performance-based communication competence.

Initial construct validity evidence of a virtual human application for competency assessment in breaking bad news to a cancer patient

PubMed Central

Guetterman, Timothy C; Kron, Frederick W; Campbell, Toby C; Scerbo, Mark W; Zelenski, Amy B; Cleary, James F; Fetters, Michael D

2017-01-01

Background Despite interest in using virtual humans (VHs) for assessing health care communication, evidence of validity is limited. We evaluated the validity of a VH application, MPathic-VR, for assessing performance-based competence in breaking bad news (BBN) to a VH patient. Methods We used a two-group quasi-experimental design, with residents participating in a 3-hour seminar on BBN. Group A (n=15) completed the VH simulation before and after the seminar, and Group B (n=12) completed the VH simulation only after the BBN seminar to avoid the possibility that testing alone affected performance. Pre- and postseminar differences for Group A were analyzed with a paired t-test, and comparisons between Groups A and B were analyzed with an independent t-test. Results Compared to the preseminar result, Group A’s postseminar scores improved significantly, indicating that the VH program was sensitive to differences in assessing performance-based competence in BBN. Postseminar scores of Group A and Group B were not significantly different, indicating that both groups performed similarly on the VH program. Conclusion Improved pre–post scores demonstrate acquisition of skills in BBN to a VH patient. Pretest sensitization did not appear to influence posttest assessment. These results provide initial construct validity evidence that the VH program is effective for assessing BBN performance-based communication competence. PMID:28794664

Are All Competencies Equal in the Eyes of Residents? A Multicenter Study of Emergency Medicine Residents’ Interest in Feedback

PubMed Central

Bentley, Suzanne; Hu, Kevin; Messman, Anne; Moadel, Tiffany; Khandelwal, Sorabh; Streich, Heather; Noelker, Joan

2017-01-01

Introduction Feedback, particularly real-time feedback, is critical to resident education. The emergency medicine (EM) milestones were developed in 2012 to enhance resident assessment, and many programs use them to provide focused resident feedback. The purpose of this study was to evaluate EM residents’ level of interest in receiving real-time feedback on each of the 23 competencies/sub-competencies. Methods This was a multicenter cross-sectional study of EM residents. We surveyed participants on their level of interest in receiving real-time on-shift feedback on each of the 23 competencies/sub-competencies. Anonymous paper or computerized surveys were distributed to residents at three four-year training programs and three three-year training programs with a total of 223 resident respondents. Residents rated their level of interest in each milestone on a six-point Likert-type response scale. We calculated average level of interest for each of the 23 sub-competencies, for all 223 respondents and separately by postgraduate year (PGY) levels of training. One-way analyses of variance were performed to determine if there were differences in ratings by level of training. Results The overall survey response rate across all institutions was 82%. Emergency stabilization had the highest mean rating (5.47/6), while technology had the lowest rating (3.24/6). However, we observed no differences between levels of training on any of the 23 competencies/sub-competencies. Conclusion Residents seem to ascribe much more value in receiving feedback on domains involving high-risk, challenging procedural skills as compared to low-risk technical and communication skills. Further studies are necessary to determine whether residents’ perceived importance of competencies/sub-competencies needs to be considered when developing an assessment or feedback program based on these 23 EM competencies/sub-competencies. PMID:28116012

Evaluation of staff performance and interpretation of the screening program for prevention of thalassemia.

PubMed

Prommetta, Simaporn; Sanchaisuriya, Kanokwan; Fucharoen, Goonnapa; Yamsri, Supawadee; Chaiboonroeng, Attawut; Fucharoen, Supan

2017-06-15

Thalassemia screening program has been implemented for years in Southeast Asia, but no external quality assessment program has been established. We have developed and initiated the proficiency testing (PT) program for the first time in Thailand with the aim to assess the screening performance of laboratory staff and their competency in interpretation of the screening results. Three PT cycles per year were organized. From the first to the third cycle of the PT scheme, a total number of participant laboratories increased from 59 to 67. In each cycle, 2 PT items (assigned as blood samples of the couple) were provided. Performance evaluation was based on the accuracy of screening results, i.e . mean corpuscular volume (MCV), mean corpuscular haemoglobin (MCH) and the dichlorophenolindophenol (DCIP) test for haemoglobin E, including the competency in interpretation of screening results and assessment of foetal risk. Performance was assessed by comparing the participants' result against the assigned value. Of all 3 cycles, most laboratories reported acceptable MCV and MCH values. From the first to the third cycle, incorrect DCIP test and misinterpretation rates were decreased while incorrect risk assessment varied by cycle to cycle. Combining the accuracy of thalassemia screening and the competency in interpretation and risk assessment, approximately half of participants showed excellent performance. Improved performance observed in many laboratories reflects the achievement and benefit of the PT program which should be regularly provided.

Innovative Methods for Promoting and Assessing Intercultural Competence in Higher Education

ERIC Educational Resources Information Center

Hiller, Gundula Gwenn

2010-01-01

This paper presents an intercultural training program that was developed by the Center for Intercultural Learning at the European University Viadrina in cooperation with students. A few of the student-generated activities will be described in detail. The program, aimed at enabling students to acquire intercultural competence, was developed at an…

Fourteen Years of Assessment: Regents' Testing Program.

ERIC Educational Resources Information Center

Bridges, Jean Bolen

In 1972, the Board of Regents of the University System of Georgia instituted the Regents' Testing Program (RTP) to provide systemwide information on the status of student competence in reading and writing and to provide a uniform means of identifying those students who fail to attain minimum levels of competence in these areas. Since 1972, some…

Skills Students Need in the Real World: Competencies Desired by Agricultural and Natural Resources Industry Leaders

ERIC Educational Resources Information Center

Easterly, R. G., III; Warner, Anna J.; Myers, Brian E.; Lamm, Alexa J.; Telg, Ricky W.

2017-01-01

The competencies addressed by undergraduate agricultural education programs should be assessed so programs are effective in supplying a well-prepared agricultural- and natural resources-oriented workforce, and so human capital is optimized. In this study, agricultural and natural resources leaders were surveyed to determine the workforce…

Competency Testing: Assessment or Politics? Draft.

ERIC Educational Resources Information Center

Carter, David G., Sr.

Competency testing legislation is the result of citizen pressure and lacks the benefit of careful deliberation by professionals. Hastily passed legislation has forced state departments of education and school districts to accept their duty to implement competency testing programs without the appropriate resources. Many of the basic problems of…

Developing Intercultural Competence by Participating in Intensive Intercultural Service-Learning

ERIC Educational Resources Information Center

De Leon, Nadia

2014-01-01

This quasi-experimental study investigates the effects of an intensive intercultural service-learning program on the intercultural competence of undergraduate students by utilizing pre- and post-course assessments of intercultural competence as measured by the cultural intelligence (Van Dyne, Koh, & Ang, 2008) and intercultural sensitivity…

State Minimum Competencies for High School Graduation. Technical Note.

ERIC Educational Resources Information Center

Lawlor, Joseph

This paper contains descriptions of mandated minimum competency programs in 13 states: Connecticut, Delaware, Georgia, Hawaii, Idaho, Kansas, Missouri, New Jersey, New York, North Carolina, South Carolina, Texas, and Vermont. Each description provides the skills assessed in the state, the assessment instruments used, and the overall purposes of…

The visibility of QSEN competencies in clinical assessment tools in Swedish nurse education.

PubMed

Nygårdh, Annette; Sherwood, Gwen; Sandberg, Therese; Rehn, Jeanette; Knutsson, Susanne

2017-12-01

Prospective nurses need specific and sufficient knowledge to be able to provide quality care. The Swedish Society of Nursing has emphasized the importance of the six quality and safety competencies (QSEN), originated in the US, in Swedish nursing education. To investigate the visibility of the QSEN competencies in the assessment tools used in clinical practice METHOD: A quantitative descriptive method was used to analyze assessment tools from 23 universities. Teamwork and collaboration was the most visible competency. Patient-centered care was visible to a large degree but was not referred to by name. Informatics was the least visible, a notable concern since all nurses should be competent in informatics to provide quality and safety in care. These results provide guidance as academic and clinical programs around the world implement assessment of how well nurses have developed these essential quality and safety competencies. Copyright © 2017 Elsevier Ltd. All rights reserved.

An exploratory study of an assessment tool derived from the competencies of the interprofessional education collaborative.

PubMed

Dow, Alan W; DiazGranados, Deborah; Mazmanian, Paul E; Retchin, Sheldon M

2014-07-01

Linking the outcomes from interprofessional education to improvements in patient care has been hampered by educational assessments that primarily measure the short-term benefits of specific curricular interventions. Competencies, recently published by the Interprofessional Education Collaborative (IPEC), elaborate overarching goals for interprofessional education by specifying desired outcomes for graduating health professions students. The competencies define a transition point between the prescribed and structured educational experience of a professional degree program and the more self-directed, patient-oriented learning associated with professional practice. Drawing on the IPEC competencies for validity, we created a 42-item questionnaire to assess outcomes related to collaborative practice at the degree program level. To establish the usability and psychometric properties of the questionnaire, it was administered to all the students on a health science campus at a large urban university in the mid-Atlantic of the United States. The student responses (n = 481) defined four components aligned in part with the four domains of the IPEC competencies. In addition, the results demonstrated differences in scores by domain that can be used to structure future curricula. These findings suggest a questionnaire based on the IPEC competencies might provide a measure to assess programmatic outcomes related to interprofessional education. We discuss directions for future research, such as a comparison of results within and between institutions, and how these results could provide valuable insights about the effect of different curricular approaches to interprofessional education and the success of various educational programs at preparing students for collaborative practice.

AN EXPLORATORY STUDY OF AN ASSESSMENT TOOL DERIVED FROM THE COMPETENCIES OF THE INTERPROFESSIONAL EDUCATION COLLABORATIVE

PubMed Central

Dow, Alan W.; DiazGranados, Deborah; Mazmanian, Paul E.; Retchin, Sheldon M.

2015-01-01

Linking the outcomes from interprofessional education to improvements in patient care has been hampered by educational assessments that primarily measure the short-term benefits of specific curricular interventions. Competencies, recently published by the Interprofessional Education Collaborative (IPEC), elaborate overarching goals for interprofessional education by specifying desired outcomes for graduating health professions students. The competencies define a transition point between the prescribed and structured educational experience of a professional degree program and the more self-directed, patient-oriented learning associated with professional practice. Drawing on the IPEC competencies for validity, we created a 42-item questionnaire to assess outcomes related to collaborative practice at the degree program level. To establish the usability and psychometric properties of the questionnaire, it was administered to all the students on a health science campus at a large urban university in the mid-Atlantic of the United States. The student responses (n = 481) defined four components aligned in part with the four domains of the IPEC competencies. In addition, the results demonstrated differences in scores by domain that can be used to structure future curricula. These findings suggest a questionnaire based on the IPEC competencies might provide a measure to assess programmatic outcomes related to interprofessional education. We discuss directions for future research, such as a comparison of results within and between institutions, and how these results could provide valuable insights about the effect of different curricular approaches to interprofessional education and the success of various educational programs at preparing students for collaborative practice. PMID:24593327

Development and Psychometric Testing of the Caregiver Communication Competence Scale in Patients With Dementia.

PubMed

Chao, Hui-Chen; Yang, Ya-Ping; Huang, Mei-Chih; Wang, Jing-Jy

2016-01-01

Appropriate communication skills are essential for understanding patient needs, particularly those of patients with dementia. Assessing health care providers' competence in communicating with patients with dementia is critical for planning a communication education program. However, no formally established scale can be used. The purpose of the current study was to develop a valid and reliable instrument for determining the communication competence of health care providers with patients with dementia. Through use of a literature review and previous clinical experience, an initial 28-item scale was developed to assess the frequency of use of each item by health care providers. Fourteen items were extracted and three factors were distinguished. Results indicated that the internal consistency reliability of the 14-item scale was 0.84. Favorable convergent and discriminant validities were reached. The communication competence scale provides administrators or educators with a useful tool for assessing communication competence of health care providers when interacting with patients with dementia so a suitable education program can be planned and implemented. Copyright 2016, SLACK Incorporated.

The Effectiveness of a Web-Based Motor Skill Assessment Training Program

ERIC Educational Resources Information Center

Kelly, Luke E.; Moran, Thomas E.

2010-01-01

The purpose of this study was to evaluate the effectiveness of a web-based, intereactive video assessment program on teaching preservice physical education majors to assess the motor skill of kicking. The program provided component specific feedback through tutorial, guided practice, and competency training options. The 72 participants were…

A Comparison of High and Low Performing Secondary Physical Education Programs in South Carolina.

ERIC Educational Resources Information Center

Castelli, Darla M.

This study compared high and low performing schools in a state secondary physical education high stakes assessment and accountability program. The South Carolina Physical Education Assessment Program (SCPEAP) required teachers to assess samples of students on competency across four state mandated performance indicators. This study examined the…

Various Assessments Utilized in California Preliminary Administrative Services Preparation Programs

ERIC Educational Resources Information Center

Erickson, Deborah E.

2016-01-01

Every two years, institutions sponsoring credentialing programs in California are required to submit a detailed biennial report, which includes data on at least four key assessments showing 1) candidate competence and/or 2) program efficacy. This article reports the types of assessments used from 25 institutions that completed biennial reports for…

The false dichotomy of quality and quantity in the discourse around assessment in competency-based education.

PubMed

Ten Cate, Olle

2015-08-01

Competency-based medical education stresses the attainment of competencies rather than the completion of fixed time in rotations. This sometimes leads to the interpretation that quantitative features of a program are of less importance, such as procedures practiced and weeks or months spent in clinical practice. An educational philosophy like "We don't require numbers of procedures completed but focus on competencies" suggests a dichotomy of either competency-based or time and procedures based education. The author argues that this dichotomy is not useful, and may even compromise education, as long as valid assessment of all relevant competencies is not possible or feasible. Requiring quantities of experiences of learners is not in contrast with competency-based education.

ACGME core competency training, mentorship, and research in surgical subspecialty fellowship programs.

PubMed

Francesca Monn, M; Wang, Ming-Hsien; Gilson, Marta M; Chen, Belinda; Kern, David; Gearhart, Susan L

2013-01-01

To determine the perceived effectiveness of surgical subspecialty training programs in teaching and assessing the 6 ACGME core competencies including research. Cross-sectional survey. ACGME approved training programs in pediatric urology and colorectal surgery. Program Directors and recent trainees (2007-2009). A total of 39 program directors (60%) and 57 trainees (64%) responded. Both program directors and recent trainees reported a higher degree of training and mentorship (75%) in patient care and medical knowledge than the other core competencies (p<0.0001). Practice based learning and improvement, interpersonal and communication, and professionalism training were perceived effective to a lesser degree. Specifically, in the areas of teaching residents and medical students and team building, program directors, compared with recent trainees, perceived training to be more effective, (p = 0.004, p = 0.04). Responses to questions assessing training in systems based practice ubiquitously identified a lack of training, particularly in financial matters of running a practice. Although effective training in research was perceived as lacking by recent trainees, 81% reported mentorship in this area. According to program directors and recent trainees, the most effective method of teaching was faculty supervision and feedback. Only 50% or less of the recent trainees reported mentorship in career planning, work-life balance, and job satisfaction. Not all 6 core competencies and research are effectively being taught in surgery subspecialty training programs and mentorship in areas outside of patient care and research is lacking. Emphasis should be placed on faculty supervision and feedback when designing methods to better incorporate all 6 core competencies, research, and mentorship. Copyright © 2012 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Competency of psychiatric residents in the treatment of people with severe mental illness before and after a community psychiatry rotation.

PubMed

Randall, Melinda; Romero-Gonzalez, Mauricio; Gonzalez, Gerardo; Klee, Anne; Kirwin, Paul

2011-01-01

psychiatric rehabilitation is an evidence-based service with the goal of recovery for people with severe mental illness. Psychiatric residents should understand the services and learn the principles of psychiatric rehabilitation. This study assessed whether a 3-month rotation in a psychiatric rehabilitation center changes the competency level of second-year psychiatric residents in evidence-based treatment of severe mental illness. the study is a prospective, case-control comparison using the validated Competency Assessment Instrument (CAI), which measures 15 provider competencies critical to recovery, rehabilitation, and empowerment for people with severe mental illness, providing a score for each competency. Participants were second-year psychiatric residents attending a 3-month rotation at the Community Reintegration Program, a psychiatric rehabilitation day program. The authors administered the CAI at the beginning and the end of the residents' 3-month rotation in order to assess change in their competency in psychiatric rehabilitation. The authors also administered the CAI to a comparison group of second-year psychiatric residents who did not rotate through the Community Reintegration Program, and therefore had no formal training in psychiatric rehabilitation. a 3-month rotation in psychiatric rehabilitation significantly improved residents' competency in the domains of goal functioning, client preferences, holistic approach, skills, and team value relative to nonrotating residents. a brief community psychiatry rotation in the second year of residency likely improves some skills in the treatment of people with severe mental illness. Future research should evaluate year-long electives and public psychiatry fellowships.

Roadmap to Measuring Distance Education Instructional Design Competencies

ERIC Educational Resources Information Center

Dooley, Kim E.; Lindner, James R.; Telg, Ricky W.; Irani, Tracy; Moore, Lori; Lundy, Lisa

2007-01-01

This study was designed to measure instructional design competencies as a result of participation in a 9-month Web-based training program called "Roadmap to Effective Distance Education Instructional Design." The researchers used a self-assessment pre- and posttest to determine participant initial and final competence in 12 areas: adult…

Improving Communicative Competence: Validation of a Social Skills Training Workshop.

ERIC Educational Resources Information Center

Dawson, Pamela J.; Spitzberg, Brian H.

The effectiveness of a social skills training workshop was assessed by comparing the rated competence of participants in an Interpersonal Skills Training Program to the rated competence of nonparticipants. Subjects' self-ratings were included. This comparison was operationalized through a pretest-posttest design with 12 experimental and 22 control…

An Assessment of the Child Development Associate Competencies.

ERIC Educational Resources Information Center

Butler, Florence; And Others

Competencies for the Child Development Associates is a comprehensive, developmental training program for teachers of preschool children, in which the total design is to help children acquire the basic competencies and skills for full development, while at the same time assuring that the quality of the child's experiences is emotionally satisfying…

Simulation for Teaching Orthopaedic Residents in a Competency-based Curriculum: Do the Benefits Justify the Increased Costs?

PubMed

Nousiainen, Markku T; McQueen, Sydney A; Ferguson, Peter; Alman, Benjamin; Kraemer, William; Safir, Oleg; Reznick, Richard; Sonnadara, Ranil

2016-04-01

Although simulation-based training is becoming widespread in surgical education and research supports its use, one major limitation is cost. Until now, little has been published on the costs of simulation in residency training. At the University of Toronto, a novel competency-based curriculum in orthopaedic surgery has been implemented for training selected residents, which makes extensive use of simulation. Despite the benefits of this intensive approach to simulation, there is a need to consider its financial implications and demands on faculty time. This study presents a cost and faculty work-hours analysis of implementing simulation as a teaching and evaluation tool in the University of Toronto's novel competency-based curriculum program compared with the historic costs of using simulation in the residency training program. All invoices for simulation training were reviewed to determine the financial costs before and after implementation of the competency-based curriculum. Invoice items included costs for cadavers, artificial models, skills laboratory labor, associated materials, and standardized patients. Costs related to the surgical skills laboratory rental fees and orthopaedic implants were waived as a result of special arrangements with the skills laboratory and implant vendors. Although faculty time was not reimbursed, faculty hours dedicated to simulation were also evaluated. The academic year of 2008 to 2009 was chosen to represent an academic year that preceded the introduction of the competency-based curriculum. During this year, 12 residents used simulation for teaching. The academic year of 2010 to 2011 was chosen to represent an academic year when the competency-based curriculum training program was functioning parallel but separate from the regular stream of training. In this year, six residents used simulation for teaching and assessment. The academic year of 2012 to 2013 was chosen to represent an academic year when simulation was used equally among the competency-based curriculum and regular stream residents for teaching (60 residents) and among 14 competency-based curriculum residents and 21 regular stream residents for assessment. The total costs of using simulation to teach and assess all residents in the competency-based curriculum and regular stream programs (academic year 2012-2013) (CDN 155,750, USD 158,050) were approximately 15 times higher than the cost of using simulation to teach residents before the implementation of the competency-based curriculum (academic year 2008-2009) (CDN 10,090, USD 11,140). The number of hours spent teaching and assessing trainees increased from 96 to 317 hours during this period, representing a threefold increase. Although the financial costs and time demands on faculty in running the simulation program in the new competency-based curriculum at the University of Toronto have been substantial, augmented learner and trainer satisfaction has been accompanied by direct evidence of improved and more efficient learning outcomes. The higher costs and demands on faculty time associated with implementing simulation for teaching and assessment must be considered when it is used to enhance surgical training.

Cultural competence education in university rehabilitation programs.

PubMed

Matteliano, Mary A; Stone, John H

2014-01-01

The Center of International Rehabilitation Research, Information, and Exchange (CIRRIE) has prepared curriculum guides for rehabilitation professionals in occupational therapy, physical therapy, speech language pathology, and rehabilitation counseling. The objective is to provide a resource to faculty who wish to include or strengthen cultural competency education in their program and courses. CIRRIE assessed students'cultural needs, and solicited assistance from experts in the field to assist with the development of the guides. After the guides were published CIRRIE conducted surveys to assess their usefulness. Survey responses were highest among occupational therapy faculty. Among faculty who responded, most intended to use the cultural competence activities, case studies, and resources that the guides offer throughout their curriculum.

Barriers to Implementing the ACGME Outcome Project: A Systematic Review of Program Director Surveys.

PubMed

Malik, Mohammad U; Diaz Voss Varela, David A; Stewart, Charles M; Laeeq, Kulsoom; Yenokyan, Gayane; Francis, Howard W; Bhatti, Nasir I

2012-12-01

The Accreditation Council for Graduate Medical Education (ACGME) introduced the Outcome Project in July 2001 to improve the quality of resident education through competency-based learning. The purpose of this systematic review is to determine and explore the perceptions of program directors regarding challenges to implementing the ACGME Outcome Project. We used the PubMed and Web of Science databases and bibliographies for English-language articles published between January 1, 2001, and February 17, 2012. Studies were included if they described program directors' opinions on (1) barriers encountered when attempting to implement ACGME competency-based education, and (2) assessment methods that each residency program was using to implement competency-based education. Articles meeting the inclusion criteria were screened by 2 researchers. The grading criterion was created by the authors and used to assess the quality of each study. The survey-based data reported the opinions of 1076 program directors. Barriers that were encountered include: (1) lack of time; (2) lack of faculty support; (3) resistance of residents to the Outcome Project; (4) insufficient funding; (5) perceived low priority for the Outcome Project; (6) inadequate salary incentive; and (7) inadequate knowledge of the competencies. Of the 6 competencies, those pertaining to patient care and medical knowledge received the most responses from program directors and were given highest priority. The reviewed literature revealed that time and financial constraints were the most important barriers encountered when implementing the ACGME Outcome Project.

Time to rethink the role of the library in educating doctors: driving information literacy in the clinical environment.

PubMed

Simons, Mary R; Morgan, Michael Kerin; Davidson, Andrew Stewart

2012-10-01

Can information literacy (IL) be embedded into the curriculum and clinical environment to facilitate patient care and lifelong learning? The Australian School of Advanced Medicine (ASAM) provides competence-based programs incorporating patient-centred care and lifelong learning. ASAM librarians use outcomes-based educational theory to embed and assess IL into ASAM's educational and clinical environments. A competence-based IL program was developed where learning outcomes were linked to current patients and assessed with checklists. Weekly case presentations included clinicians' literature search strategies, results, and conclusions. Librarians provided support to clinicians' literature searches and assessed their presentations using a checklist. Outcome data showed clinicians' searching skills improved over time; however, advanced MEDLINE searching remained challenging for some. Recommendations are provided. IL learning that takes place in context using measurable outcomes is more meaningful, is enduring, and likely contributes to patient care. Competence-based assessment drives learning in this environment.

The Effects of Conflict Resolution Education on Conflict Resolution Skills, Social Competence, and Aggression in Turkish Elementary School Students

ERIC Educational Resources Information Center

Akgun, Serap; Araz, Arzu

2014-01-01

The purpose of the study was to implement "we can resolve our conflicts" training program to elementary school students and to assess the effectiveness of this school-based conflict resolution training program, designed to enhance students' conflict resolution skills and social competence and consequently decrease aggression. Three…

Teaching Applied Behavior Analysis Knowledge Competencies to Direct-Care Service Providers: Outcome Assessment and Social Validation of a Training Program

ERIC Educational Resources Information Center

Luiselli, James K.; Bass, Jennifer D.; Whitcomb, Sara A.

2010-01-01

Staff training is a critical performance improvement objective within behavioral health care organizations. This study evaluated a systematic training program for teaching applied behavior analysis knowledge competencies to newly hired direct-care employees at a day and residential habilitation services agency for adults with intellectual and…

Variation in Sustainability Competency Development According to Age, Gender, and Disciplinary Affiliation: Implications for Teaching Practice and Overall Program Structure

ERIC Educational Resources Information Center

Remington-Doucette, Sonya; Musgrove, Sheryl

2015-01-01

Purpose: The purpose of this paper is to present the results of a classroom assessment aimed at determining the extent to which five key sustainability competencies develop in students during an introductory transdisciplinary sustainability course. University sustainability programs intend to provide integrated education that fosters the key…

Learner-Centered SEM and Competency-Based Education: Exploring the Learning Frontier of Graduate Enrollment Futures

ERIC Educational Resources Information Center

Snowden, Monique L.

2014-01-01

In March 2013, the US Department of Education issued guidance to institutions on how to attain approval for competency-based programs under the current title IV, Higher Education Act (HEA) regulations on direct assessment programs. This article considers the graduate enrollment futures of colleges and universities that have chosen and will elect…

Core Competencies: The Challenge For Graduate Peace and Conflict Studies Education

NASA Astrophysics Data System (ADS)

Windmueller, John; Wayne, Ellen Kabcenell; Botes, Johannes (Jannie)

2009-05-01

This article uses a case study of the assessment of a graduate program in negotiations and conflict management as a springboard for discussing several critical, but unanswered questions in our field. It raises questions regarding the lack of clear core competencies and expectations regarding curricula at the graduate-level of peace and conflict studies programs, as well as concerns over how educators in this field can or should assess their own work and train students for practice. It also addresses, via a comparative case analysis in Tajikistan, the degree to which the competencies and pedagogical approaches in this field are culturally bound. The picture that emerges from these case studies suggests that there have been important omissions in the way that the varied educational programs and the larger peace and conflict studies field itself have developed thus far.

New Mexico Statewide Assessment Program (NMSAP) Procedures Manual, 2007-2008

ERIC Educational Resources Information Center

New Mexico Public Education Department, 2007

2007-01-01

This manual has been prepared for all New Mexico Statewide Assessment Program (NMSAP) assessment administrators, teachers, school specialists, and principals. It includes information about the following topics: PED contacts, New Mexico Standards Based Assessments (SBA), Grades 3-8 and 11; New Mexico High School Competency Examination (NMHSCE);…

Competence Assessment Integrating Reflective Practice in a Professional Psychology Program

ERIC Educational Resources Information Center

Lewis, Deborah; Virden, Tom; Hutchings, Philinda Smith; Bhargava, Ruchi

2011-01-01

The Midwestern University Clinical Psychology Program--Glendale Campus (MWU) created a Comprehensive Assessment Method in Psychology (CAMP) comprised of 35 different "tasks" of authentic work products representing a variety of assessment techniques based on pedagogical theory. Each task assesses one or more components of one of the…

Personal Computers in Iowa Vocational Agriculture Programs: Competency Assessment and Usage.

ERIC Educational Resources Information Center

Miller, W. Wade; And Others

The competencies needed by Iowa vocational agriculture instructors at the secondary school level to integrate computer technology into the classroom were assessed, as well as the status of computer usage, types of computer use and software utilities and hardware used, and the sources of computer training obtained by instructors. Surveys were…

Gap analysis: a method to assess core competency development in the curriculum.

PubMed

Fater, Kerry H

2013-01-01

To determine the extent to which safety and quality improvement core competency development occurs in an undergraduate nursing program. Rapid change and increased complexity of health care environments demands that health care professionals are adequately prepared to provide high quality, safe care. A gap analysis compared the present state of competency development to a desirable (ideal) state. The core competencies, Nurse of the Future Nursing Core Competencies, reflect the ideal state and represent minimal expectations for entry into practice from pre-licensure programs. Findings from the gap analysis suggest significant strengths in numerous competency domains, deficiencies in two competency domains, and areas of redundancy in the curriculum. Gap analysis provides valuable data to direct curriculum revision. Opportunities for competency development were identified, and strategies were created jointly with the practice partner, thereby enhancing relevant knowledge, attitudes, and skills nurses need for clinical practice currently and in the future.

PLA and CBE on the Competency Continuum: The Relationship between Prior Learning Assessment and Competency-Based Education

ERIC Educational Resources Information Center

Tate, Pamela; Klein-Collins, Rebecca

2015-01-01

Competency-based education (CBE) is the hot new thing in higher education. While forms of CBE have been around since the 1970s, there has been a surge of interest in CBE, with more than 600 postsecondary institutions now reporting that they are either offering competency-based degree programs or are planning to do so. Similarly, institutional…

Improving Social Competence in a Middle School.

ERIC Educational Resources Information Center

Levinsohn, Mary; Klyap, John M.

This paper describes the implementation and evaluation of a social competence promotion program conducted in the sixth grade of a middle school. The need to increase social competence within the school arose from the results of enumerative and stakeholder data collected at the school. This paper outlines the steps of the needs assessment, program…

Health care leader competencies and the relevance of emotional intelligence.

PubMed

Weiszbrod, Twila

2015-01-01

As health care leader competencies continue to be refined and emphasized in health care administration educational programs, the "soft skills" of emotional intelligence have often been implied, but not included explicitly. The purpose of this study was to better understand what relationship, if any, could be identified between health care leader competencies and emotional intelligence. A quantitative correlational method of study was used, utilizing self-assessments and 360-degree assessments of both constructs. There were 43 valid participants in the study, representing the various types of health care delivery systems. Correlational analysis suggested there was a positive relationship; for each unit of increase in emotional intelligence, there was a 0.6 increase in overall health care leadership competence. This study did not suggest causation, but instead suggested that including the study and development of emotional intelligence in health care administration programs could have a positive impact on the degree of leader competence in graduates. Some curricula suggestions were provided, and further study was recommended.

Essential competencies in entry-level pediatric physical therapy education.

PubMed

Rapport, Mary Jane; Furze, Jennifer; Martin, Kathy; Schreiber, Joe; Dannemiller, Lisa A; Dibiasio, Paula A; Moerchen, Victoria A

2014-01-01

The Section on Pediatrics (SoP) convened an Education Summit in July 2012 to examine, discuss, and respond to documented inconsistencies and challenges in teaching pediatric physical therapy (PT) content in entry-level professional education programs. Despite previous attempts by the SoP to provide guidance around teaching pediatric PT, variability continued to be extensive across programs. This article presents the core competencies developed out of the Summit to inform pediatric content in the entry-level PT curriculum. In addition, the core competencies were linked to teaching strategies, learning activities, assessment outcomes, and curricular structures. Consensus was reached on 5 core competencies that represent a knowledge base essential to all graduates of PT programs. In contrast to prior SoP documents, these competencies were specifically designed to focus on knowledge and skills unique to pediatric practice but essential for all graduates of accredited entry-level PT education programs. For more insights from the authors, see Supplemental Digital Content 1, at http://links.lww.com/PPT/A50.

Assessing and counseling the obese patient: Improving resident obesity counseling competence.

PubMed

Iyer, Shwetha; Jay, Melanie; Southern, William; Schlair, Sheira

To evaluate obesity counseling competence among residents in a primary care training program METHODS: We delivered a 3h obesity curriculum to 28 Primary Care residents and administered a pre-curriculum and post curriculum survey looking specifically at self-assessed obesity counseling competence. Nineteen residents completed both the pre curriculum survey and the post curriculum survey. The curriculum had a positive impact on residents' ability to ascertain patient's stage of change, use different methods to obtain diet history (including 24h recall, food record or food frequency questionnaire), respond to patient's questions regarding treatment options, assist patients in setting realistic goals for weight loss based on making permanent lifestyle changes, and use of motivational interviewing to change behavior. When looking at the 5As domains, there was a significant improvement in the domains of Assess, Advise, and Assist. The proportion of residents with a lower level of self-assessed obesity counseling competence reduced from 75% before the curriculum to 37.5% (p=0.04) after the curriculum. Our curriculum addressing weight loss counseling using the 5As model increased obesity counseling competence among residents in a primary care internal medicine residency program. Copyright © 2018 Asia Oceania Association for the Study of Obesity. Published by Elsevier Ltd. All rights reserved.

The Impact of a Developed Measurement and Evaluation Development Program on Pre-Service Physical Education Teachers' Perceptions Related to Measurement and Evaluation

ERIC Educational Resources Information Center

Arslan, Yunus; Erturan Ilker, Gokce; Demirhan, Giyasettin

2013-01-01

The purpose of this study was to investigate the impact of the Measurement and Evaluation Development Program on pre-service physical education teachers' general perceptions and competency perceptions related to alternative assessment in physical education, and their competency perceptions related to educational measurement and evaluation. The…

Development and evaluation of an undergraduate training course for developing International Council of Nurses disaster nursing competencies in China.

PubMed

Chan, Sunshine S S; Chan, Wai-shan; Cheng, Yijuan; Fung, Olivia W M; Lai, Timothy K H; Leung, Amanda W K; Leung, Kevin L K; Li, Sijian; Yip, Annie L K; Pang, Samantha M C

2010-12-01

Nurses are often called upon to play the role of first responder when disaster occurs. Yet the lack of accepted competencies and gaps in education make it difficult to recruit nurses prepared to respond to a disaster and provide assistance in an effective manner. Based on the International Council of Nurses (ICN) Framework of Disaster Nursing Competencies and Global Standards for the Initial Education of Professional Nurses and Midwives, a training course titled "Introduction to Disaster Nursing" was designed and implemented with 150 students. A pre-post survey design was used to assess changes in participants' self-rated disaster nursing competencies. The impact of the training course on participants' attitudes toward disaster nursing and their learning experience were also assessed. All participants passed the assessments and examination with an average score of 70%. Pre- and posttraining self-ratings of the disaster nursing competencies increased from 2.09 to 3.71 (p < .001) on a Likert scale of 1 to 5, and the effect size was large, with Cohen's d higher than 0.8. No significant difference in both examination results (60% group assignments; 40% written examination) and self-rated competencies was noted between the senior year students and graduate nurse participants by Mann-Whitney U test (p value = .90). The majority of participants indicated their willingness to participate as a helper in disaster relief and saw themselves competent to work under supervision. The ICN Framework of Disaster Nursing Competencies was instrumental to guide the training curriculum development. This introductory training course could be incorporated into undergraduate nursing education programs as well as serve as a continuing education program for graduate nurses. The training program can be used for preparing generalist nurses of their nursing competencies in disaster preparedness, response and post-disaster recovery and rehabilitation. © 2010 Sigma Theta Tau International.

Accreditation Council for Graduate Medical Education Core Competencies at a Community Teaching Hospital: Is There a Gap in Awareness?

PubMed

Al-Temimi, Mohammed; Kidon, Michael; Johna, Samir

2016-01-01

Reports evaluating faculty knowledge of the Accreditation Council for Graduate Medical Education (ACGME) core competencies in community hospitals without a dedicated residency program are uncommon. Faculty evaluation regarding knowledge of ACGME core competencies before a residency program is started. Physicians at the Kaiser Permanente Fontana Medical Center (N = 480) were surveyed for their knowledge of ACGME core competencies before starting new residency programs. Knowledge of ACGME core competencies. Fifty percent of physicians responded to the survey, and 172 (71%) of respondents were involved in teaching residents. Of physicians who taught residents and had complete responses (N = 164), 65 (39.7%) were unsure of their knowledge of the core competencies. However, most stated that they provided direct teaching to residents related to the knowledge, skills, and attitudes stated in each of the 6 competencies as follows: medical knowledge (96.3%), patient care (95.7%), professionalism (90.7%), interpersonal and communication skills (86.3%), practice-based learning (85.9%), and system-based practice (79.6%). Physician specialty, years in practice (1-10 vs > 10), and number of rotations taught per year (1-6 vs 7-12) were not associated with knowledge of the competencies (p > 0.05); however, full-time faculty (teaching 10-12 rotations per year) were more likely to provide competency-based teaching. Objective assessment of faculty awareness of ACGME core competencies is essential when starting a residency program. Discrepancy between knowledge of the competencies and acclaimed provision of competency-based teaching emphasizes the need for standardized teaching methods that incorporate the values of these competencies.

Nine Constructs of Cultural Competence for Curriculum Development

PubMed Central

Brookover, Cecile; Kennedy, Kathleen

2010-01-01

Objective To examine the self-administered Clinical Cultural Competency Questionnaire (CCCQ) and assess the perceived level of cultural competence of students in Xavier University of Louisiana College of Pharmacy to guide curriculum development within the 4-year academic program. Methods The CCCQ was administrated to each class of pharmacy students during spring 2009. Exploratory factor analysis with principal components and varimax rotation was conducted to build the constructs explaining the factors measuring students' self-assessment of cultural competence. Results Nine factors, including 46 items extracted from the CCCQ and explaining 79% of the total variance, were found as the best fit to measure students' self-assessment of cultural competence. Conclusions The CCCQ was found to be a practical, valid, and reliable self-assessment instrument to measure the perceived level of pharmacy students' knowledge, skills, attitudes, and encounters in cross-cultural environments. The questionnaire allowed the identification of students' needs for training in cultural competence and the development of a curriculum tailored to satisfy those needs. PMID:21436922

Information Competence of Doctoral Students in Information Science in Spain and Latin America: A Self-Assessment

ERIC Educational Resources Information Center

Pinto, Maria; Fernandez-Ramos, Andres; Sanchez, Gerardo; Meneses, Grizly

2013-01-01

The study was carried out with students of official doctoral programs of Information Science in four universities in Spain and Latin America with the purpose of finding out, through self-assessments, student perceptions of their own information competence. A survey was designed to determine self-perceptions of knowledge, skills and attitudes…

Assessing the Writing Competence of High School Students: Lorain's EECAP, Its History and Implementation.

ERIC Educational Resources Information Center

Valentino, Marilyn J.

In response to a nationwide concern for quality education and academic preparedness, the Ohio State Board of Education created in 1983 the Early English Composition Assessment Program (EECAP) for improving the writing competency of exiting high school students. Faculty from more than 15 two- and four-year institutions and many more high schools…

[Needs assessment for developing teaching competencies of medical educators].

PubMed

Si, Jihyun

2015-09-01

This study conducted a needs assessment for developing teaching competencies of medical educators by assessing their perceived ability to perform teaching competencies as well as their perceived importance of these competencies. Additionally, this study examined whether there were any differences in needs assessments scores among three faculty groups. Hundred and eighteen professors from Dong-A University College of Medicine were surveyed, and the data from 44 professors who answered all the questions were analyzed using IBM SPSS 21. The needs assessment tool measured participants' perceived ability to perform teaching competencies and perceived importance of these competencies. The Borich formula was used to calculate needs assessment scores. The most urgent needs for faculty development were identified for the teaching competencies of "diagnosis and reflection," followed by "test and feedback," and "facilitation." Additionally, two, out of 51, items with the highest needs assessment scores were "developing a thorough course syllabus" and "introducing students to the course syllabus on the first day of class." The assistant professor group scored significantly higher on educational needs related to "facilitation," "affection and concern for students," and "respect for diversity" competencies than the professor group. Furthermore, the educational needs scores for all the teaching competencies except "diagnosis and reflection," "global mindset," and "instructional management" were higher for the assistant professor group than the other two faculty groups. Thus, the educational needs assessment scores obtained in this study can be used as criteria for designing and developing faculty development programs for medical educators.

Core Competencies for Injury and Violence Prevention

PubMed Central

Stephens-Stidham, Shelli; Peek-Asa, Corinne; Bou-Saada, Ingrid; Hunter, Wanda; Lindemer, Kristen; Runyan, Carol

2009-01-01

Efforts to reduce the burden of injury and violence require a workforce that is knowledgeable and skilled in prevention. However, there has been no systematic process to ensure that professionals possess the necessary competencies. To address this deficiency, we developed a set of core competencies for public health practitioners in injury and violence prevention programs. The core competencies address domains including public health significance, data, the design and implementation of prevention activities, evaluation, program management, communication, stimulating change, and continuing education. Specific learning objectives establish goals for training in each domain. The competencies assist in efforts to reduce the burden of injury and violence and can provide benchmarks against which to assess progress in professional capacity for injury and violence prevention. PMID:19197083

Evaluating the Effectiveness of Public Health Leadership Training: The NEPHLI Experience

PubMed Central

Saleh, Shadi S.; Williams, Dwight; Balougan, Modinat

2004-01-01

Objectives. We assessed the effect of public health leadership training on the capacity of public health leaders to perform competencies derived from the list of “Ten Essential Public Health Services” presented in 1994 by the steering committee of the Public Health Functions Project. Methods. Graduating scholars of the Northeast Public Health Leadership Institute were surveyed to determine differences in skill level in 15 competency areas before and after training. Surveys were completed after program completion. Results. The training program improved the skill levels of participants in all 15 competency areas. A relation also was detected between the frequency of use of the competency and the improvement experienced. Conclusions. Public health leadership training programs are effective in improving the skills of public health workers. PMID:15226150

CE: Original Research: Creating an Evidence-Based Progression for Clinical Advancement Programs.

PubMed

Burke, Kathleen G; Johnson, Tonya; Sites, Christine; Barnsteiner, Jane

2017-05-01

: Background: The Institute of Medicine (IOM) and the Quality and Safety Education for Nurses (QSEN) project have identified six nursing competencies and supported their integration into undergraduate and graduate nursing curricula nationwide. But integration of those competencies into clinical practice has been limited, and evidence for the progression of competency proficiency within clinical advancement programs is scant. Using an evidence-based approach and building on the competencies identified by the IOM and QSEN, a team of experts at an academic health system developed eight competency domains and 186 related knowledge, skills, and attitudes (KSAs) for professional nursing practice. The aim of our study was to validate the eight identified competencies and 186 related KSAs and determine their developmental progression within a clinical advancement program. Using the Delphi technique, nursing leadership validated the newly identified competency domains and KSAs as essential to practice. Clinical experts from 13 Magnet-designated hospitals with clinical advancement programs then participated in Delphi rounds aimed at reaching consensus on the developmental progression of the 186 KSAs through four levels of clinical advancement. Two Delphi rounds resulted in consensus by the expert participants. All eight competency domains were determined to be essential at all four levels of clinical practice. At the novice level of practice, the experts identified a greater number of KSAs in the domains of safety and patient- and family-centered care. At more advanced practice levels, the experts identified a greater number of KSAs in the domains of professionalism, teamwork, technology and informatics, and continuous quality improvement. Incorporating the eight competency domains and the 186 KSAs into a framework for clinical advancement programs will likely result in more clearly defined role expectations; enhance accountability; and elevate and promote nursing practice, thereby improving clinical outcomes and quality of care. With their emphasis on quality and safety, the eight competency domains also offer a framework for enhancing position descriptions, performance evaluations, clinical recognition, initial and ongoing competency assessment programs, and orientation and residency programs.

Assessing competence in communication and interpersonal skills: the Kalamazoo II report.

PubMed

Duffy, F Daniel; Gordon, Geoffrey H; Whelan, Gerald; Cole-Kelly, Kathy; Frankel, Richard; Buffone, Natalie; Lofton, Stephanie; Wallace, MaryAnne; Goode, Leslie; Langdon, Lynn

2004-06-01

Accreditation of residency programs and certification of physicians requires assessment of competence in communication and interpersonal skills. Residency and continuing medical education program directors seek ways to teach and evaluate these competencies. This report summarizes the methods and tools used by educators, evaluators, and researchers in the field of physician-patient communication as determined by the participants in the "Kalamazoo II" conference held in April 2002. Communication and interpersonal skills form an integrated competence with two distinct parts. Communication skills are the performance of specific tasks and behaviors such as obtaining a medical history, explaining a diagnosis and prognosis, giving therapeutic instructions, and counseling. Interpersonal skills are inherently relational and process oriented; they are the effect communication has on another person such as relieving anxiety or establishing a trusting relationship. This report reviews three methods for assessment of communication and interpersonal skills: (1) checklists of observed behaviors during interactions with real or simulated patients; (2) surveys of patients' experience in clinical interactions; and (3) examinations using oral, essay, or multiple-choice response questions. These methods are incorporated into educational programs to assess learning needs, create learning opportunities, or guide feedback for learning. The same assessment tools, when administered in a standardized way, rated by an evaluator other than the teacher, and using a predetermined passing score, become a summative evaluation. The report summarizes the experience of using these methods in a variety of educational and evaluation programs and presents an extensive bibliography of literature on the topic. Professional conversation between patients and doctors shapes diagnosis, initiates therapy, and establishes a caring relationship. The degree to which these activities are successful depends, in large part, on the communication and interpersonal skills of the physician. This report focuses on how the physician's competence in professional conversation with patients might be measured. Valid, reliable, and practical measures can guide professional formation, determine readiness for independent practice, and deepen understanding of the communication itself.

Indo-Canadian Collaboration for Suicide Prevention: Training Needs Assessment for Healthcare Professionals in India.

PubMed

Shah, Ravi; Eynan, Rahel; Srivastava, Amresh; Reiss, Leanna; Sathyanarayana Rao, T S; Parkar, Shubhangi; Dutt, Lakshman; Kadam, Kranti; Links, Paul S

2016-07-01

The main purpose of the study was to conduct a comprehensive needs assessment of primary healthcare professionals in order to develop a training program aimed at enhancing competencies in suicide risk assessment and management. A total of 144 primary healthcare professionals (physicians = 46; primary care workers = 98) completed the needs assessment questionnaire. The majority of healthcare professionals rated their level of comfort and competence in assessing, treating, and referring suicidal patients as medium or high. However, their knowledge about suicide, risk factors for suicide, asking about suicidal behaviour, and helping a suicidal patient was rated low or medium. Overall, the scarcity of qualified healthcare professionals and the existing gaps in core competencies for suicide risk assessment and management was identified. Development of innovative and effective competencies-based suicide specific training for primary care providers in India is urgently required.

Women’s Health Training in Gastroenterology Fellowship: A National Survey of Fellows and Program Directors

PubMed Central

Roberson, Erica; Richie, Kelly; Lindstrom, Mary J.; Esposti, Silvia Degli; Wald, Arnold

2013-01-01

Background and Aims The Gastroenterology Core Curriculum requires training in women’s digestive disorders; however, requirements do not necessarily produce knowledge and competence. Our study goals were: (1) to compare perceptions of education, fellow-reported levels of competence, and attitudes towards training in women’s gastrointestinal (GI) health issues during fellowship between gastroenterology fellows and program directors, and (2) to determine the barriers for meeting training requirements. Methods A national survey assessing four domains of training was conducted. All GI program directors in the United States (n = 153) and a random sample of gastroenterology fellows (n = 769) were mailed surveys. Mixed effects linear modeling was used to estimate all mean scores and to assess differences between the groups. Cronbach’s alpha was used to assess the consistency of the measures which make up the means. Results Responses were received from 61% of program directors and 31% of fellows. Mean scores in perceived didactic education, clinical experiences, and competence in women’s GI health were low and significantly differed between the groups (P < 0.0001). Fellows’ attitudes towards women’s GI health issues were more positive compared to program directors’ (P = 0.004). Barriers to training were: continuity clinic at a Veteran’s Administration hospital, low number of pregnant patients treated, low number of referrals from obstetrics and gynecology, and lack of faculty interest in women’s health. Conclusions (1) Fellows more so than program directors perceive training in women’s GI health issues to be low. (2) Program directors more so than fellows rate fellows to be competent in women’s GI health. (3) Multiple barriers to women’s health training exist. PMID:21267780

Influence of Feedback, Teacher Praise, and Parental Support on Self-Competency of Third Graders.

ERIC Educational Resources Information Center

Davis, Lonnie H.; And Others

The purpose of this study was to demonstrate how an early assessment of self-competency can be combined with an effective program for preventing maladaptive affective (self-competency) and academic skills. Eleven third graders participated in this study of three interventions. Feedback of multisource data, teacher praise (positive reinforcement),…

Development of Competency-Based Articulated Automotive Program. Big Bend Community College and Area High Schools. Final Report.

ERIC Educational Resources Information Center

Buche, Fred; Cox, Charles

A competency-based automotive mechanics curriculum was developed at Big Bend Community College (Washington) in order to provide the basis for an advanced placement procedure for high school graduates and experienced adults through a competency assessment. In order to create the curriculum, Big Bend Community College automotive mechanics…

Teacher Testing: I'm O.K., You're O.K., But Somebody's Not!

ERIC Educational Resources Information Center

Martin, Dawn Vincent

Concern about the preparation and competence of teachers has brought about a rapid spread of teacher competency assessment programs. Currently, 36 states test or plan to test teachers prior to certification. Two states, Arkansas and Texas, are already involved with testing teachers in service. Teacher competency testing has become embroiled in…

Organizational cultural competence consultation to a mental health institution.

PubMed

Fung, Kenneth; Lo, Hung-Tat Ted; Srivastava, Rani; Andermann, Lisa

2012-04-01

Cultural competence is increasingly recognized as an essential component of effective mental health care delivery to address diversity and equity issues. Drawing from the literature and our experience in providing cultural competence consultation and training, the paper will discuss our perspective on the foundational concepts of cultural competence and how it applies to a health care organization, including its programs and services. Based on a recent consultation project, we present a methodology for assessing cultural competence in health care organizations, involving mixed quantitative and qualitative methods. Key findings and recommendations from the resulting cultural competence plan are discussed, including core principles, change strategies, and an Organizational Cultural Competence Framework, which may be applicable to other health care institutions seeking such changes. This framework, consisting of eight domains, can be used for organizational assessment and cultural competence planning, ultimately aiming at enhancing mental health care service to the diverse patients, families, and communities.

Welcome to cultural competency: surgery's efforts to acknowledge diversity in residency training.

PubMed

Ly, Catherine L; Chun, Maria B J

2013-01-01

Although cultural competency is not a new concept in healthcare, it has only recently been formally embraced as important in the field of surgery. All physicians, including and especially surgeons, must acknowledge the potential influence of culture in order to provide effective and equitable care for patients of all backgrounds. The Accreditation Council for Graduate Medical Education (ACGME) recognizes cultural competency as a component of "patient care," "professionalism," and "interpersonal and communication skills." A systematic literature search was conducted using the MEDLINE, EBSCOhost, Web of Science, and Google Scholar databases. All publications focusing on surgical residents and the assessment of patient care, professionalism, interpersonal and communication skills, or specifically cultural competency and/or were considered. This initial search resulted in 12 articles. To further refine the review, publications discussing curricula in residencies other than surgery, the assessment of technical, or clinical skills and/or without any explicit focus on cultural competency were excluded. Based on the specified inclusion and exclusion criteria, 5 articles were selected. These studies utilized various methods to improve surgical residents' cultural competency, including lectures, Objective Structural Clinical Examinations (OSCE), and written exercises and evaluations. A number of surgical residency programs have made promising strides in training culturally competent surgeons. Ultimately, in order to maximize our collective efforts to improve the quality of health care, the development of cultural competency curricula must be made a priority and such training should be a requirement for all trainees in surgical residency programs. Copyright © 2013 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Palliative Care Education in Emergency Medicine Residency Training: A Survey of Program Directors, Associate Program Directors, and Assistant Program Directors.

PubMed

Kraus, Chadd K; Greenberg, Marna R; Ray, Daniel E; Dy, Sydney Morss

2016-05-01

Emergency medicine (EM) residents perceive palliative care (PC) skills as important and want training, yet there is a general lack of formal PC training in EM residency programs. A clearer definition of the PC educational needs of EM trainees is a research priority. To assess PC competency education in EM residency programs. This was a mixed-mode survey of residency program directors, associate program directors, and assistant program directors at accredited EM residency programs, evaluating four educational domains: 1) importance of specific competencies for senior EM residents, 2) senior resident skills in PC competencies, 3) effectiveness of educational methods, and 4) barriers to training. Response rate was 50% from more than 100 residency programs. Most respondents (64%) identified PC competencies as important for residents to learn, and 59% reported that they teach7 PC skills in their residency program. In Domains 1 and 2, crucial conversations, management of pain, and management of the imminently dying had the highest scores for importance and residents' skill. In Domain 3, bedside teaching, mentoring from hospice and palliative medicine faculty, and case-based simulation were the most effective educational methods. In Domain 4, lack of PC expertise among faculty and lack of interest by faculty and residents were the greatest barriers. There were differences between competency importance and senior resident skill level for management of the dying child, withdrawal/withholding of nonbeneficial interventions, and ethical/legal issues. There are specific barriers and opportunities for PC competency training and gaps in resident skill level. Specifically, there are discrepancies in competency importance and residency skill in the management of the dying child, nonbeneficial interventions, and ethical and legal issues that could be a focus for educational interventions in PC competency training in EM residencies. Copyright © 2016 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.

An evidence based approach to undergraduate physical assessment practicum course development.

PubMed

Anderson, Brenda; Nix, Elizabeth; Norman, Bilinda; McPike, H Dawn

2014-05-01

Physical assessment is an important component of professional nursing practice. New nurse graduates experience difficulty transitioning the traditional head to toe physical assessment into real world nursing practice. This study was conducted to provide current data concerning physical assessment competencies utilized consistently by registered nurses. This quantitative study used a 126 item survey mailed to 900 Registered Nurses. Participants used a Likert-type scale to report frequency of use for physical assessment competencies. Thirty seven competencies were determined to be essential components of the physical assessment, 18 were determined supplemental, and 71 were determined to be non-essential. Transition of the new graduate nurse into professional practice can be enhanced by focusing content in physical assessment practicum courses on the essential competencies of physical assessment. Faculty for the university has analyzed data from this study to support evidence based changes to the undergraduate nursing program physical assessment practicum course. Copyright © 2013 Elsevier Ltd. All rights reserved.

Assessing the New Competencies for Resident Education: A Model from an Emergency Medicine Program.

ERIC Educational Resources Information Center

Reisdorff, Earl J.; Hayes, Oliver W.; Carlson, Dale J.; Walker, Gregory L.

2001-01-01

Based on the experience of Michigan State University's emergency medicine residency program, proposes a practical method for modifying an existing student evaluation format. The model provides a template other programs could use in assessing residents' acquisition of the knowledge, skills, and attitudes reflected in the six general competencies…

Improving Evaluation of Dental Hygiene Students' Cultural Competence with a Mixed-Methods Approach.

PubMed

Flynn, Priscilla; Sarkarati, Nassim

2018-02-01

Most dental hygiene educational programs include cultural competence education, but may not evaluate student outcomes. The aim of this study was to design and implement a mixed-methods evaluation to measure dental hygiene students' progression toward cultural competence. Two cohorts consisting of consecutive classes in one U.S. dental hygiene program participated in the study. A total of 47 dental hygiene students (100% response rate) completed self-assessments to measure their attitudes and knowledge at three time points between 2014 and 2016. Mean scores were calculated for three domains: Physical Environment, Communication, and Values. Qualitative analysis of the students' cultural diversity papers was also conducted to further evaluate students' knowledge and skills. Bennett's five-level conceptual framework was used to code phrases or sentences to place students in the general categories of ethnocentric or ethno-relative. The quantitative and qualitative results yielded different outcomes for Cohort 1, but not for Cohort 2. The Cohort 1 students assessed themselves statistically significantly lower over time in one of the three measured domains. However, the Cohort 2 students assessed themselves as statistically significantly more culturally competent in all three domains. Qualitative results placed 72% of Cohort 1 students and 83% of Cohort 2 students in the more desirable ethno-relative category. Since quantitative methods consisting of student self-assessments may not adequately measure students' cultural competence, adding qualitative methods to measure skills specific to patient care in this study added a robust dimension to evaluating this complex dental hygiene student competence.

The Development and Validation of the Transition Competence Battery for Adolescents and Young Adults with Deafness.

ERIC Educational Resources Information Center

Reiman, John; Bullis, Michael

1988-01-01

The lack of appropriate assessment tools designed for deaf adolescents and young adults making the transition from educational programs to adult life is cited as one of the most glaring deficits in the field of deafness. The Transition Competence Battery (TCB) is being developed as an assessment tool that will guide individual training decisions…

The role of assessment in competency-based medical education.

PubMed

Holmboe, Eric S; Sherbino, Jonathan; Long, Donlin M; Swing, Susan R; Frank, Jason R

2010-01-01

Competency-based medical education (CBME), by definition, necessitates a robust and multifaceted assessment system. Assessment and the judgments or evaluations that arise from it are important at the level of the trainee, the program, and the public. When designing an assessment system for CBME, medical education leaders must attend to the context of the multiple settings where clinical training occurs. CBME further requires assessment processes that are more continuous and frequent, criterion-based, developmental, work-based where possible, use assessment methods and tools that meet minimum requirements for quality, use both quantitative and qualitative measures and methods, and involve the wisdom of group process in making judgments about trainee progress. Like all changes in medical education, CBME is a work in progress. Given the importance of assessment and evaluation for CBME, the medical education community will need more collaborative research to address several major challenges in assessment, including "best practices" in the context of systems and institutional culture and how to best to train faculty to be better evaluators. Finally, we must remember that expertise, not competence, is the ultimate goal. CBME does not end with graduation from a training program, but should represent a career that includes ongoing assessment.

Competency-Based Education in Low Resource Settings: Development of a Novel Surgical Training Program.

PubMed

McCullough, Meghan; Campbell, Alex; Siu, Armando; Durnwald, Libby; Kumar, Shubha; Magee, William P; Swanson, Jordan

2018-03-01

The unmet burden of surgical disease represents a major global health concern, and a lack of trained providers is a critical component of the inadequacy of surgical care worldwide. Competency-based training has been advanced in high-income countries, improving technical skills and decreasing training time, but it is poorly understood how this model might be applied to low- and middle-income countries. We describe the development of a competency-based program to accelerate specialty training of in-country providers in cleft surgery techniques. The program was designed and piloted among eight trainees at five international cleft lip and palate surgical mission sites in Latin America and Africa. A competency-based evaluation form, designed for the program, was utilized to grade general technical and procedure-specific competencies, and pre- and post-training scores were analyzed using a paired t test. Trainees demonstrated improvement in average procedure-specific competency scores for both lip repairs (60.4-71.0%, p < 0.01) and palate (50.6-66.0%, p < 0.01). General technical competency scores also improved (63.6-72.0%, p < 0.01). Among the procedural competencies assessed, surgical markings showed the greatest improvement (19.0 and 22.8% for lip and palate, respectively), followed by nasal floor/mucosal approximation (15.0%) and hard palate dissection (17.1%). Surgical delivery models in LMICs are varied, and trade-offs often exist between goals of case throughput, quality and training. Pilot program results show that procedure-specific and general technical competencies can be improved over a relatively short time and demonstrate the feasibility of incorporating such a training program into surgical outreach missions.

Allergy education in otolaryngology residency: a survey of program directors and residents.

PubMed

Bailey, Sarah E; Franzese, Christine; Lin, Sandra Y

2014-02-01

The purpose of this study was to survey program directors of the accredited otolaryngology residency programs and resident attendees of the 2013 American Academy of Otolaryngic Allergy (AAOA) Basic/MOC Course regarding resident education and participation as well as assessment of competency in otolaryngic allergy and immunotherapy. A multiple-choice questionnaire was sent to all accredited otolaryngology residency training programs in the United States as part of resident attendance at the 2013 AAOA CORE Basic/MOC Course. Following this, a similar multiple-choice survey was sent to all resident attendees from the programs that responded positively. Program directors reported that 73% of their academic institutions offer allergy testing and immunotherapy. More PDs than residents indicated that residents participate in allergy practice and perform/interpret skin testing and in vitro testing, and more residents (85%) than program directors (63%) reported inadequate or no allergy training. Program directors and residents equally indicated that residents do not calculate immunotherapy vial formulations or administer immunotherapy injections. The majority of program directors indicated that resident competency in allergy was assessed through direct observation, whereas residents more commonly perceived that no assessment of competency was being performed for any portion of allergy practice. This survey demonstrates a discrepancy between program directors and residents regarding resident involvement and adequacy of training in the allergy practice. Although the majority of otolaryngology residencies report offering otolaryngic allergy services and education, the vast majority of residents report inadequate allergy training and less participation in an allergy practice compared to the majority of program directors. © 2013 ARS-AAOA, LLC.

Designing the framework for competency-based master of public health programs in India.

PubMed

Sharma, Kavya; Zodpey, Sanjay; Morgan, Alison; Gaidhane, Abhay; Syed, Zahiruddin Quazi; Kumar, Rajeev

2013-01-01

Competency in the practice of public health is the implicit goal of education institutions that offer master of public health (MPH) programs. With the expanding number of institutions offering courses in public health in India, it is timely to develop a common framework to ensure that graduates are proficient in critical public health. Steps such as situation assessment, survey of public health care professionals in India, and national consultation were undertaken to develop a proposed competency-based framework for MPH programs in India. The existing curricula of all 23 Indian MPH courses vary significantly in content with regard to core, concentration, and crosscutting discipline areas and course durations. The competency or learning outcome is not well defined. The findings of the survey suggest that MPH graduates in India should have competencies ranging from monitoring of health problems and epidemics in the community, applying biostatistics in public health, conducting action research, understanding social and community influence on public health developing indicators and instruments to monitor and evaluate community health programs, developing proposals, and involving community in planning, delivery, and monitoring of health programs. Competency statements were framed and mapped with domains including epidemiology, biostatistics, social and behavioral sciences, health care system, policy, planning, and financing, and environmental health sciences and a crosscutting domain that include health communication and informatics, health management and leadership, professionalism, systems thinking, and public health biology. The proposed competency-based framework for Indian MPH programs can be adapted to meet the needs of diverse, unique programs. The framework ensures the uniqueness and diversity of individual MPH programs in India while contributing to measures of overall program success.

Time to rethink the role of the library in educating doctors: driving information literacy in the clinical environment

PubMed Central

Simons, Mary R.; Morgan, Michael Kerin; Davidson, Andrew Stewart

2012-01-01

Question: Can information literacy (IL) be embedded into the curriculum and clinical environment to facilitate patient care and lifelong learning? Setting: The Australian School of Advanced Medicine (ASAM) provides competence-based programs incorporating patient-centred care and lifelong learning. ASAM librarians use outcomes-based educational theory to embed and assess IL into ASAM's educational and clinical environments. Methods: A competence-based IL program was developed where learning outcomes were linked to current patients and assessed with checklists. Weekly case presentations included clinicians' literature search strategies, results, and conclusions. Librarians provided support to clinicians' literature searches and assessed their presentations using a checklist. Main Results: Outcome data showed clinicians' searching skills improved over time; however, advanced MEDLINE searching remained challenging for some. Recommendations are provided. Conclusion: IL learning that takes place in context using measurable outcomes is more meaningful, is enduring, and likely contributes to patient care. Competence-based assessment drives learning in this environment. PMID:23133329

Pilot training program for developing disaster nursing competencies among undergraduate students in China.

PubMed

Pang, Samantha M C; Chan, Sunshine S S; Cheng, Yichuan

2009-12-01

As nurses constitute the largest group of health-care providers, their readiness to respond to disasters and to participate in preparedness and disaster recovery activities will be significant for making a community more resilient against disaster. Concern is raised regarding how to build the capacity of all nurses with a knowledge base and a minimum set of skills in responding to various disasters. Drawing on the ICN Framework of Disaster Nursing Competencies and Global Standards for the Initial Education of Professional Nurses and Midwives, a training program entitled "Introduction to Disaster Nursing" was developed. Four teaching methods including action learning, problem-based learning, skill training, and lecture were used to orchestrate a series of planned activities for helping students develop the required disaster nursing competencies in a 2-week intensive training program held in Sichuan China in July 2009. The pre- and post-tests which were given to assess the students' perceived level of competencies demonstrated a significant gain in relevant knowledge and skills constituting the required competencies upon completion of the program. In the program evaluation, most students indicated their willingness and capability in disaster relief work under supervision, and they were keen to advance their competencies in the field of disaster nursing.

Accreditation Council for Graduate Medical Education Core Competencies at a Community Teaching Hospital: Is There a Gap in Awareness?

PubMed Central

Al-Temimi, Mohammed; Kidon, Michael; Johna, Samir

2016-01-01

Context Reports evaluating faculty knowledge of the Accreditation Council for Graduate Medical Education (ACGME) core competencies in community hospitals without a dedicated residency program are uncommon. Objective Faculty evaluation regarding knowledge of ACGME core competencies before a residency program is started. Design Physicians at the Kaiser Permanente Fontana Medical Center (N = 480) were surveyed for their knowledge of ACGME core competencies before starting new residency programs. Main Outcome Measures Knowledge of ACGME core competencies. Results Fifty percent of physicians responded to the survey, and 172 (71%) of respondents were involved in teaching residents. Of physicians who taught residents and had complete responses (N = 164), 65 (39.7%) were unsure of their knowledge of the core competencies. However, most stated that they provided direct teaching to residents related to the knowledge, skills, and attitudes stated in each of the 6 competencies as follows: medical knowledge (96.3%), patient care (95.7%), professionalism (90.7%), interpersonal and communication skills (86.3%), practice-based learning (85.9%), and system-based practice (79.6%). Physician specialty, years in practice (1–10 vs > 10), and number of rotations taught per year (1–6 vs 7–12) were not associated with knowledge of the competencies (p > 0.05); however, full-time faculty (teaching 10–12 rotations per year) were more likely to provide competency-based teaching. Conclusion Objective assessment of faculty awareness of ACGME core competencies is essential when starting a residency program. Discrepancy between knowledge of the competencies and acclaimed provision of competency-based teaching emphasizes the need for standardized teaching methods that incorporate the values of these competencies. PMID:27768565

Next generation leadership: a profile of self-rated competencies among administrative resident and fellows.

PubMed

Helfand, Brad; Cherlin, Emily; Bradley, Elizabeth H

2005-01-01

Healthcare executives and program faculty have voiced concerns that early careerists lack needed competencies for future leadership in the increasingly complex healthcare industry. However, empirical studies of early careerists' competency levels are limited. We sought to describe administrative fellows' and residents' (n = 78, response rate 73.6%) self-rated competency in several key areas and assess how these ratings differed by individuals' gender, age, prior work experience, year of graduate training, and type of degree program. Respondents rated their competence particularly high (41.7% of respondents rated themselves "A") in the domain of interpersonal and emotional intelligence, which included being an effective team leader and member, coaching and developing others, self-awareness, and self-regulation. Lower ratings were in the domains of facilities management and in development and fundraising. Compared to males, females rated their competency in the financial skills domain lower (P-value = 0.04). Age, prior work experience, year of graduate training, and type of degree program were not significantly associated with self-rated competency in any area. These results provide early evidence that may help program faculty and preceptors consider pedagogical approaches that reflect students' vocalized needs and may help to design strategies that effectively cultivate next generation leadership.

The use of CellaVision competency software for external quality assessment and continuing professional development.

PubMed

Horiuchi, Yuki; Tabe, Yoko; Idei, Mayumi; Bengtsson, Hans-Inge; Ishii, Kiyoshi; Horii, Takashi; Miyake, Kazunori; Satoh, Naotake; Miida, Takashi; Ohsaka, Akimichi

2011-07-01

Quality assessment of blood cell morphological testing, such as white blood cell (WBC) differential and its interpretation, is one of the most important and difficult assignments in haematology laboratories. A monthly survey was performed to assess the possible role of the proficiency testing program produced by CellaVision competency software (CCS) in external quality assessment (EQA) of the clinical laboratories of affiliated university hospitals and the effective utilisation of this program in continuing professional development (CPD). Four monthly proficiency surveys were conducted in collaboration with four clinical laboratories affiliated with the teaching hospitals of Juntendo University of Medicine in Japan. EQA results by the CCS proficiency testing program revealed a difference of performance levels of WBC differential and morphological interpretation and a discrepancy in the WBC differential criteria among laboratories. With regard to the utilisation of this proficiency program as a tool for CPD, this program successfully improved the performance of the low-scoring laboratories and less experienced individuals. The CCS proficiency testing program was useful for the quality assessment of laboratory performance, for education, and for the storage and distribution of cell images to be utilised for further standardisation and education.

Improving Emotional Intelligence through Personality Development: The Effect of the Smart Phone Application based Dharma Life Program on Emotional Intelligence

PubMed Central

Poonamallee, Latha; Harrington, Alex M.; Nagpal, Manisha; Musial, Alec

2018-01-01

Emotional intelligence is established to predict success in leadership effectiveness in various contexts and has been linked to personality factors. This paper introduces Dharma Life Program, a novel approach to improving emotional intelligence by targeting maladaptive personality traits and triggering neuroplasticity through the use of a smart-phone application and mentoring. The program uses neuroplasticity to enable users to create a more adaptive application of their maladaptive traits, thus improving their emotional intelligence. In this study 26 participants underwent the Dharma Life Program in a leadership development setting. We assessed their emotional and social intelligence before and after the Dharma Life Program intervention using the Emotional and Social Competency Inventory (ESCI). The study found a significant improvement in the lowest three competencies and a significant improvement in almost all domains for the entire sample. Our findings suggest that the completion of the Dharma Life Program has a significant positive effect on Emotional and Social Competency scores and offers a new avenue for improving emotional intelligence competencies. PMID:29527182

Improving Emotional Intelligence through Personality Development: The Effect of the Smart Phone Application based Dharma Life Program on Emotional Intelligence.

PubMed

Poonamallee, Latha; Harrington, Alex M; Nagpal, Manisha; Musial, Alec

2018-01-01

Emotional intelligence is established to predict success in leadership effectiveness in various contexts and has been linked to personality factors. This paper introduces Dharma Life Program, a novel approach to improving emotional intelligence by targeting maladaptive personality traits and triggering neuroplasticity through the use of a smart-phone application and mentoring. The program uses neuroplasticity to enable users to create a more adaptive application of their maladaptive traits, thus improving their emotional intelligence. In this study 26 participants underwent the Dharma Life Program in a leadership development setting. We assessed their emotional and social intelligence before and after the Dharma Life Program intervention using the Emotional and Social Competency Inventory (ESCI). The study found a significant improvement in the lowest three competencies and a significant improvement in almost all domains for the entire sample. Our findings suggest that the completion of the Dharma Life Program has a significant positive effect on Emotional and Social Competency scores and offers a new avenue for improving emotional intelligence competencies.

Meeting the challenge of assessing clinical competence of occupational therapists within a program management environment.

PubMed

Salvatori, Penny; Simonavicius, Nijole; Moore, Joan; Rimmer, Georgina; Patterson, Michele

2008-02-01

Program management models have raised concerns among occupational therapists about professional standards related to clinical competence, performance review procedures, and quality improvement initiatives. This paper describes how a chart-stimulated recall (CSR) peer-review process and interview tool was revised, implemented, and evaluated as a pilot project to assess the clinical competence of occupational therapy staff at a large urban health centre in southern Ontario. Fourteen pairs (n=28) of occupational therapists representing various practice areas participated in this project. Half served as peer assessors and half as interviewees. Peer assessors conducted an independent chart review followed by a one-hour personal interview with a peer partner to discuss clinical management issues related to the client cases. Each interviewer rated his or her partner's clinical competence in eight areas of performance using a 7-point Likert scale. Results indicated that the CSR tool could discriminate among occupational therapists in terms of overall levels of clinical competence and also identify specific areas of concern that could be targeted for professional development. Feedback from participants was positive. The CSR tool was found to be useful for assessing clinical competence of occupational therapists in this large health centre as a quality improvement initiative within that discipline group. Further research is needed to establish the reliability and validity of the CSR tool.

Resident-Specific Morbidity Reduced Following ACS NSQIP Data-Driven Quality Program.

PubMed

Turrentine, Florence E; Hanks, John B; Tracci, Megan C; Jones, R Scott; Schirmer, Bruce D; Smith, Philip W

2018-04-16

The Accreditation Council for Graduate Medical Education Milestone Project for general surgery provided a more robust method for developing and tracking residents' competence. This framework enhanced systematic and progressive development of residents' competencies in surgical quality improvement. A 22-month interactive, educational program based on resident-specific surgical outcomes data culminated in a quality improvement project for postgraduate year 4 surgery residents. Self- assessment, quality knowledge test, and resident-specific American College of Surgeons National Surgical Quality Improvement Program Quality In-Training Initiative morbidity were compared before and after the intervention. Quality in-training initiative morbidity decreased from 25% (82/325) to 18% (93/517), p = 0.015 despite residents performing more complex cases. All participants achieved level 4 competency (4/4) within the general surgery milestones improvement of care, practice-based learning and improvement competency. Institutional American College of Surgeons National Surgical Quality Improvement Program general surgery morbidity improved from the ninth to the sixth decile. Quality assessment and improvement self-assessment postintervention scores (M = 23.80, SD = 4.97) were not significantly higher than preintervention scores (M = 19.20, SD = 5.26), p = 0.061. Quality Improvement Knowledge Application Tool postintervention test scores (M = 17.4, SD = 4.88), were not significantly higher than pretest scores (M = 13.2, SD = 1.92), p = 0.12. Sharing validated resident-specific clinical data with participants was associated with improved surgical outcomes. Participating fourth year surgical residents achieved the highest score, a level 4, in the practice based learning and improvement competency of the improvement of care practice domain and observed significantly reduced surgical morbidity for cases in which they participated. Copyright © 2018. Published by Elsevier Inc.

Teaching implementation science in a new Master of Science Program in Germany: a survey of stakeholder expectations.

PubMed

Ullrich, Charlotte; Mahler, Cornelia; Forstner, Johanna; Szecsenyi, Joachim; Wensing, Michel

2017-04-27

Implementation science in healthcare is an evolving discipline in German-speaking countries. In 2015, the Medical Faculty of the University of Heidelberg, Germany, implemented a two-year full-time Master of Science program Health Services Research and Implementation Science. The curriculum introduces implementation science in the context of a broader program that also covers health services research, healthcare systems, research methods, and generic academic skills. Our aim was to assess the expectations of different stakeholder groups regarding the master's program. An online survey listing desired competencies of prospective graduates was developed and administered to four groups: national experts in the field (including potential employers of graduates), teaching staff, enrolled students, and prospective students (N = 169). Competencies were extracted from the curriculum's module handbook. A five-point Likert scale was used for the assessment of 42 specific items. Data were analyzed descriptively. A total of 83 people participated in the survey (response rate 49%). The online survey showed a strong agreement across the groups concerning the desired competencies of graduates. About two-thirds of the listed competencies (27 items) were felt to be crucial or very important by 80% or more of participants, with little difference between stakeholder groups. Of the eight items specifically related to implementation in practice, six were in this category. Knowledge of implementation strategies (90% very important), knowledge of barriers and enablers of implementation (89%), and knowledge of evidence-based practice (89%) were the top priorities. The master's program is largely orientated towards the desired competencies of graduates according to students, teaching staff, and national experts.

Toward an objective assessment of technical skills: a national survey of surgical program directors in Saudi Arabia.

PubMed

Alkhayal, Abdullah; Aldhukair, Shahla; Alselaim, Nahar; Aldekhayel, Salah; Alhabdan, Sultan; Altaweel, Waleed; Magzoub, Mohi Elden; Zamakhshary, Mohammed

2012-01-01

After almost a decade of implementing competency-based programs in postgraduate training programs, the assessment of technical skills remains more subjective than objective. National data on the assessment of technical skills during surgical training are lacking. We conducted this study to document the assessment tools for technical skills currently used in different surgical specialties, their relationship with remediation, the recommended tools from the program directors' perspective, and program directors' attitudes toward the available objective tools to assess technical skills. This study was a cross-sectional survey of surgical program directors (PDs). The survey was initially developed using a focus group and was then sent to 116 PDs. The survey contains demographic information about the program, the objective assessment tools used, and the reason for not using assessment tools. The last section discusses the recommended tools to be used from the PDs' perspective and the PDs' attitude and motivation to apply these tools in each program. The associations between the responses to the assessment questions and remediation were statistically evaluated. Seventy-one (61%) participants responded. Of the respondents, 59% mentioned using only nonstandardized, subjective, direct observation for technical skills assessment. Sixty percent use only summative evaluation, whereas 15% perform only formative evaluations of their residents, and the remaining 22% conduct both summative and formative evaluations of their residents' technical skills. Operative portfolios are kept by 53% of programs. The percentage of programs with mechanisms for remediation is 29% (19 of 65). The survey showed that surgical training programs use different tools to assess surgical skills competency. Having a clear remediation mechanism was highly associated with reporting remediation, which reflects the capability to detect struggling residents. Surgical training leadership should invest more in standardizing the assessment of surgical skills.

Diagnostic and procedural imaging curricula in physical therapist professional degree programs.

PubMed

Boissonnault, William G; White, Douglas M; Carney, Sara; Malin, Brittany; Smith, Wayne

2014-08-01

Descriptive survey. To describe the status of diagnostic and procedural imaging curricula within United States physical therapist professional degree programs. As patient direct access to physical therapy services increases, the ability to refer patients directly for diagnostic imaging could promote more efficient delivery of care. Appropriate patient referral is contingent on physical therapists having the requisite knowledge base and skills. While evidence describing imaging competence of physical therapists with advanced training in military institutions exists, evidence is lacking for other physical therapists, including new graduates of physical therapist professional degree programs. Faculty members teaching imaging at 206 United States physical therapist professional degree programs recognized by the Commission on Accreditation in Physical Therapy Education were recruited via e-mail correspondence. An e-mail attachment included the survey on which faculty reported imaging curricula and faculty qualifications, attitudes, and experiences. Faculty from 155 (75.2%) programs responded to the survey, with imaging being included in the curriculum of 152 programs. Content was integrated by required standalone courses or clinical science track courses, and/or through elective courses. The average reported estimate of imaging contact hours was 24.4 hours (range, 2-75 hours). Emphasis was on the musculoskeletal system, including 76.3% of the required standalone course content. Student competence was assessed in 147 (96.7%) programs, primarily by written (66.7%) and practical (19.7%) examinations. Faculty rated student competence on a scale of 1 (not competent) to 5 (competent), with ratings ranging from a high of 4.0 (identifying normal anatomy on plain-film radiography) to a low of 1.9 (identifying common tissue pathological processes/injuries on ultrasound). While a majority of programs reported including imaging curricula, variability was noted in all curricular aspects. These results may serve as a benchmark for faculty to assess existing curricula, allow for further development of imaging curricula, and provide a benchmark for the profession regarding current level of training for recent graduates of entry-level physical therapist professional degree programs.

An innovative approach to enhance dermatology competencies for advanced practice nurses: service–learning with a migrant farm worker health clinic.

PubMed

Downes, Elizabeth A; Connor, Ann; Howett, Maeve

2014-12-01

The purpose of this article is to describe a novel service–learning opportunity for graduate nursing students that promotes competency in dermatology. A hybrid service–learning course with online didactic content is described, along with tools for evaluation of dermatology competencies. Student evaluation of the course is discussed, and selected research articles are reviewed. Advanced practice nursing and medical education frequently does not adequately prepare primary care providers to be competent in the assessment and management of dermatologic conditions. Embedding dermatology content in a service–learning program can optimize the provision of care, strengthen competencies in dermatology and inter-professional care, and allow students to gain a deeper understanding of the population with which they work. The innovative service–learning program presented is a model for advanced practice nursing education. Tools for evaluating clinical competency and courses often need validation. Copyright 2014, SLACK Incorporated.

Emergency medicine point-of-care ultrasonography: a national needs assessment of competencies for general and expert practice.

PubMed

Fischer, Lisa M; Woo, Michael Y; Lee, A Curtis; Wiss, Ray; Socransky, Steve; Frank, Jason R

2015-01-01

Emergency medicine point-of-care ultrasonography (EM-PoCUS) is a core competency for residents in the Royal College of Physicians and Surgeons of Canada and College of Family Physicians of Canada emergency medicine (EM) training programs. Although EM-PoCUS fellowships are currently offered in Canada, there is little consensus regarding what training should be included in a Canadian EM-PoCUS fellowship curriculum or how this contrasts with the training received in an EM residency.Objectives To conduct a systematic needs assessment of major stakeholders to define the essential elements necessary for a Canadian EM-PoCUS fellowship training curriculum. We carried out a national survey of experts in EM-PoCUS, EM residency program directors, and EM residents. Respondents were asked to identify competencies deemed either nonessential to EM practice, essential for general EM practice, essential for advanced EM practice, or essential for EM-PoCUS fellowship trained (‘‘expert’’) practice. The response rate was 81% (351 of 435). PoCUS was deemed essential to general EM practice for basic cardiac, aortic, trauma, and procedural imaging. PoCUS was deemed essential to advanced EM practice in undifferentiated symptomatology, advanced chest pathologies, and advanced procedural applications. Expert-level PoCUS competencies were identified for administrative, pediatric, and advanced gynecologic applications. Eighty-seven percent of respondents indicated that there was a need for EM-PoCUS fellowships, with an ideal length of 6 months. This is the first needs assessment of major stakeholders in Canada to identify competencies for expert training in EM-PoCUS. The competencies should form the basis for EM-PoCUS fellowship programs in Canada.

Competency-Based, Time-Variable Education in the Health Professions: Crossroads.

PubMed

Lucey, Catherine R; Thibault, George E; Ten Cate, Olle

2018-03-01

Health care systems around the world are transforming to align with the needs of 21st-century patients and populations. Transformation must also occur in the educational systems that prepare the health professionals who deliver care, advance discovery, and educate the next generation of physicians in these evolving systems. Competency-based, time-variable education, a comprehensive educational strategy guided by the roles and responsibilities that health professionals must assume to meet the needs of contemporary patients and communities, has the potential to catalyze optimization of educational and health care delivery systems. By designing educational and assessment programs that require learners to meet specific competencies before transitioning between the stages of formal education and into practice, this framework assures the public that every physician is capable of providing high-quality care. By engaging learners as partners in assessment, competency-based, time-variable education prepares graduates for careers as lifelong learners. While the medical education community has embraced the notion of competencies as a guiding framework for educational institutions, the structure and conduct of formal educational programs remain more aligned with a time-based, competency-variable paradigm.The authors outline the rationale behind this recommended shift to a competency-based, time-variable education system. They then introduce the other articles included in this supplement to Academic Medicine, which summarize the history of, theories behind, examples demonstrating, and challenges associated with competency-based, time-variable education in the health professions.

Core principles of assessment in competency-based medical education.

PubMed

Lockyer, Jocelyn; Carraccio, Carol; Chan, Ming-Ka; Hart, Danielle; Smee, Sydney; Touchie, Claire; Holmboe, Eric S; Frank, Jason R

2017-06-01

The meaningful assessment of competence is critical for the implementation of effective competency-based medical education (CBME). Timely ongoing assessments are needed along with comprehensive periodic reviews to ensure that trainees continue to progress. New approaches are needed to optimize the use of multiple assessors and assessments; to synthesize the data collected from multiple assessors and multiple types of assessments; to develop faculty competence in assessment; and to ensure that relationships between the givers and receivers of feedback are appropriate. This paper describes the core principles of assessment for learning and assessment of learning. It addresses several ways to ensure the effectiveness of assessment programs, including using the right combination of assessment methods and conducting careful assessor selection and training. It provides a reconceptualization of the role of psychometrics and articulates the importance of a group process in determining trainees' progress. In addition, it notes that, to reach its potential as a driver in trainee development, quality care, and patient safety, CBME requires effective information management and documentation as well as ongoing consideration of ways to improve the assessment system.

Perceived Competence and Comfort in Respiratory Protection

PubMed Central

Burgel, Barbara J.; Novak, Debra; Burns, Candace M.; Byrd, Annette; Carpenter, Holly; Gruden, MaryAnn; Lachat, Ann; Taormina, Deborah

2015-01-01

In response to the Institute of Medicine (2011) report Occupational Health Nurses and Respiratory Protection: Improving Education and Training, a nationwide survey was conducted in May 2012 to assess occupational health nurses’ educational preparation, roles, responsibilities, and training needs in respiratory protection. More than 2,000 occupational health nurses responded; 83% perceived themselves as competent, proficient, or expert in respiratory protection, reporting moderate comfort with 12 respiratory program elements. If occupational health nurses had primary responsibility for the respiratory protection program, they were more likely to perceive higher competence and more comfort in respiratory protection, after controlling for occupational health nursing experience, highest education, occupational health nursing certification, industry sector, Association of Occupational Health Professionals in Healthcare membership, taking a National Institute for Occupational Safety and Health spirometry course in the prior 5 years, and perceiving a positive safety culture at work. These survey results document high perceived competence and comfort in respiratory protection. These findings support the development of targeted educational programs and interprofessional competencies for respiratory protection. PMID:23429638

Educating and Training the Future Adolescent Health Workforce.

PubMed

Kokotailo, Patricia K; Baltag, Valentina; Sawyer, Susan M

2018-05-01

Unprecedented attention is now focused on adolescents with growing appreciation of their disease burden and of the opportunities of investing in adolescent health. New investments are required to build the technical capacity for policy, programming, research, and clinical care across the world, especially in resource-poor settings where most adolescents live. Strategies to educate and train the future workforce are needed. Competency-based education and training is the standard of education in preservice (undergraduate and postgraduate) health education and medical specialty training. Yet competency is difficult to quantify and standardize, as are the processes that underpin competency-based education and training. The primary objective of this review was to identify how quality education in adolescent health and medicine is determined. This information was used to inform the development of a conceptual framework for institutions teaching adolescent health, which can be used to assess the quality of teaching and learning and to monitor the implementation of these adolescent health competencies. Specific teaching modalities and assessment tools that have been used to teach adolescent health are described to exemplify how an educational program can be delivered and assessed. This framework is a step toward the development of a more adolescent-competent health workforce. Copyright © 2017 The Society for Adolescent Health and Medicine. Published by Elsevier Inc. All rights reserved.

Counselor Competence, Performance Assessment, and Program Evaluation: Using Psychometric Instruments

ERIC Educational Resources Information Center

Tate, Kevin A.; Bloom, Margaret L.; Tassara, Marcel H.; Caperton, William

2014-01-01

Psychometric instruments have been underutilized by counselor educators in performance assessment and program evaluation efforts. As such, we conducted a review of the literature that revealed 41 instruments fit for such efforts. We described and critiqued these instruments along four dimensions--"Target Domain," "Format,"…

Development and implementation of a competency-based clinical evaluation tool for midwifery education.

PubMed

Woeber, Kate

2018-07-01

The learning goals and evaluation strategies of competency-based midwifery programs must be explicit and well-defined. In the US, didactic learning is evaluated through a standardized certification examination, but standardized clinical competence evaluation is lacking. The Midwifery Competency Assessment Tool (MCAT) has been adapted from the International Confederation of Midwives' (ICM) "Essential Competencies" and from the American College of Nurse-Midwives' (ACNM) "Core Competencies", with student self-evaluation based on Benner's Novice-to-Expert theory. The MCAT allows for the measurement and monitoring of competence development in all domains of full-scope practice over the course of the midwifery program. Strengths of the MCAT are that it provides clear learning goals and performance evaluations for students, ensures and communicates content mapping across a curriculum, and highlights strengths and gaps in clinical opportunities at individual clinical sites and for entire programs. Challenges of the MCAT lie in balancing the number of competency items to be measured with the tedium of form completion, in ensuring the accuracy of student self-evaluation, and in determining "adequate" competence achievement when particular clinical opportunities are limited. Use of the MCAT with competency-based clinical education may facilitate a more standardized approach to clinical evaluation, as well as a more strategic approach to clinical site development and use. Copyright © 2018 Elsevier Ltd. All rights reserved.

Self-evaluation of assessment programs: a cross-case analysis.

PubMed

Baartman, Liesbeth K J; Prins, Frans J; Kirschner, Paul A; van der Vleuten, Cees P M

2011-08-01

The goal of this article is to contribute to the validation of a self-evaluation method, which can be used by schools to evaluate the quality of their Competence Assessment Program (CAP). The outcomes of the self-evaluations of two schools are systematically compared: a novice school with little experience in competence-based education and assessment, and an innovative school with extensive experience. The self-evaluation was based on 12 quality criteria for CAPs, including both validity and reliability, and criteria stressing the importance of the formative function of assessment, such as meaningfulness and educational consequences. In each school, teachers, management and examination board participated. Results show that the two schools use different approaches to assure assessment quality. The innovative school seems to be more aware of its own strengths and weaknesses, to have a more positive attitude towards teachers, students, and educational innovations, and to explicitly involve stakeholders (i.e., teachers, students, and the work field) in their assessments. This school also had a more explicit vision of the goal of competence-based education and could design its assessments in accordance with these goals. Copyright © 2011 Elsevier Ltd. All rights reserved.

Evaluation of the Effectiveness of the H.A.N.D.S.SM Program: A School Nurse Diabetes Management Education Program.

PubMed

Breneman, Charity B; Heidari, Khosrow; Butler, Sarah; Porter, Ryan R; Wang, Xuewen

2015-12-01

The purpose of this project was to determine the effectiveness of the Helping Administer to the Needs of the Student with Diabetes in Schools (H.A.N.D.S.(sm)) continuing education program in improving the level of experience and competence in performing services associated with diabetes care. This program is a live course for school nurses providing clinical information about diabetes management and their professional role in the care of students with diabetes. Pre- and post-surveys were administered via e-mail to assess their level of experience and competence in diabetes care. A total of 105 nurses completed both surveys and were included in the analysis. The changes between pre- and post-survey questions were assessed. The H.A.N.D.S. participants' levels of experience and competence for each of the four categories of diabetes care improved significantly, and a greater number of nurses reported being able to perform the services independently and having the ability to teach others. © The Author(s) 2015.

Can One Portfolio Measure the Six ACGME General Competencies?

ERIC Educational Resources Information Center

Jarvis, Robert M.; O'Sullivan, Patricia S.; McClain, Tina; Clardy, James A.

2004-01-01

Objective: To determine that portfolios, useable by any program, can provide needed evidence of resident performance within the ACGME general competencies. Methods: Eighteen residents constructed portfolios with selected entries from thirteen psychiatric skills. Two raters assessed whether entries reflected resident performance within the general…

Assessing the ACGME Competencies in Psychiatry Training Programs

ERIC Educational Resources Information Center

Swick, Susan; Hall, Sarah; Beresin, Eugene

2006-01-01

In 2000, the Accreditation Council of Graduate Medical Education (ACGME) laid out a definition of competence that included six specific areas of focus: patient care (including clinical reasoning), medical knowledge, practice-based learning and improvement, interpersonal and communication skills, professionalism, and systems-based practice. The…

Four New Course Competencies for Majors.

ERIC Educational Resources Information Center

Van Leuven, Jim

1999-01-01

Notes changes in the past decade in the field of public relations. Proposes four new required core competencies for all undergraduate public-relations majors in programs housed in journalism/mass-communication units. Articulates these regarding appropriate outcomes, pedagogies, and assessment methods. Notes special considerations for small,…

Assessing the ACEJMC Professional Values and Competencies

ERIC Educational Resources Information Center

Christ, William G.; Henderson, Jennifer J.

2014-01-01

The accrediting body for media education, the Accrediting Council on Education in Journalism and Mass Communications (ACEJMC), has established twelve professional values and competencies that all students must demonstrate before graduating from accredited journalism and mass communication programs. A close reading suggests that these twelve…

Japanese Language and Culture: 9-Year Program Classroom Assessment Materials, Grade 4

ERIC Educational Resources Information Center

Alberta Education, 2008

2008-01-01

This document is designed to provide assessment materials for specific Grade 4 outcomes in the Japanese Language and Culture Nine-year Program, Grades 4-5-6. The assessment materials are designed for the beginner level in the context of teaching for communicative competence. Grade 4 learning outcomes from the Japanese Language and Culture…

German Language and Culture: 9-Year Program Classroom Assessment Materials, Grade 4

ERIC Educational Resources Information Center

Alberta Education, 2008

2008-01-01

This document is designed to provide assessment materials for specific Grade 4 outcomes in the German Language and Culture Nine-year Program, Grades 4-5-6. The assessment materials are designed for the beginner level in the context of teaching for communicative competence. Grade 4 learning outcomes from the German Language and Culture Nine-year…

Punjabi Language and Culture: 9-Year Program Classroom Assessment Materials, Grade 4

ERIC Educational Resources Information Center

Alberta Education, 2008

2008-01-01

This document is designed to provide assessment materials for specific Grade 4 outcomes in the Punjabi Language and Culture Nine-year Program, Grades 4-5-6. The assessment materials are designed for the beginner level in the context of teaching for communicative competence. Grade 4 learning outcomes from the Punjabi Language and Culture Nine-year…

The Implementation and Evaluation of Health Promotion Services and Programs to Improve Cultural Competency: A Systematic Scoping Review.

PubMed

Jongen, Crystal Sky; McCalman, Janya; Bainbridge, Roxanne Gwendalyn

2017-01-01

Cultural competency is a multifaceted intervention approach, which needs to be implemented at various levels of health-care systems to improve quality of care for culturally and ethnically diverse populations. One level of health care where cultural competency is required is in the provision of health promotion services and programs targeted to diverse patient groups who experience health-care and health inequalities. To inform the implementation and evaluation of health promotion programs and services to improve cultural competency, research must assess both intervention strategies and intervention outcomes. This scoping review was completed as part of a larger systematic literature search conducted on evaluations of cultural competence interventions in health care in Canada, the United States, Australia, and New Zealand. Seventeen peer-reviewed databases, 13 websites and clearinghouses, and 11 literature reviews were searched. Overall, 64 studies on cultural competency interventions were found, with 22 being health promotion programs and services. A process of thematic analysis was utilized to identify key intervention strategies and outcomes reported in the literature. The review identified three overarching strategies utilized in health promotion services and programs to improve cultural competency: community-focused strategies, culturally focused strategies, and language-focused strategies. Studies took different approaches to delivering culturally competent health interventions, with the majority incorporating multiple strategies from each overarching category. There were various intermediate health-care and health outcomes reported across the included studies. Most commonly reported were positive reports of patient satisfaction, patient/participant service access, and program/study retention rates. The health outcome results indicate positive potential of health promotion services and programs to improve cultural competency to impact cardiovascular disease and mental health outcomes. However, due to measurement and study quality issues, it is difficult to determine the extent of the impacts. Examined together, these intervention strategies and outcomes provide a framework that can be used by service providers and researchers in the implementation and evaluation of health promotion services and programs to improve cultural competency. While there is evidence indicating the effectiveness of such health promotion interventions in improving intermediate and health outcomes, further attention is needed to issues of measurement and study quality.

A Comparison of National Board Certified Teachers with Non-National Board Certified Teachers on Student Competency in High School Physical Education

ERIC Educational Resources Information Center

Phillips, Amber

2008-01-01

The purpose of this study was to describe the differences of teachers with and without National Board Certification in relation to their percentages of student competency in high school physical education. Data from the South Carolina Physical Education Assessment Program (SCPEAP) were used as the measure of student competency. Student competency…

RN-to-BSN Students' Quality Improvement Knowledge, Skills, Confidence, and Systems Thinking.

PubMed

Trent, Peggy; Dolansky, Mary A; DeBrew, Jacqueline Kayler; Petty, Gayle M

2017-12-01

Little evidence demonstrates that RN-to-baccalaureate nursing (BSN) graduates have met The Essentials of Baccalaureate Education for Professional Nursing Practice-specifically, evidence of the graduates' organizational and systems leadership related to quality care and patient safety. This BSN Essentials reflects the QSEN quality improvement (QI) competency. The purpose of this pilot study was to develop and test an assessment strategy to measure RN-to BSN students' QI competence and their perception of QI knowledge and skills. Students (N = 59) from six RN-to-BSN programs participated in a Qualtrics survey e-mailed during the last semester of their program. The majority of students (60%) reported that they did not experience QI content in their program. Scores on QI knowledge, skills, and systems thinking were low, yet the students self-reported that they were confident in their ability to perform QI. This pilot study provides an assessment strategy to measure students' competence related to QI. Nursing education has an opportunity to integrate and measure QI competence to ensure that nurses have the knowledge and skills to continually improve patient care. [J Nurs Educ. 2017;56(12):737-740.]. Copyright 2017, SLACK Incorporated.

Promoting clinical competence: using scaffolded instruction for practice-based learning.

PubMed

Tilley, Donna Scott; Allen, Patricia; Collins, Cathie; Bridges, Ruth Ann; Francis, Patricia; Green, Alexia

2007-01-01

Competency-based education is essential for bridging the gap between education and practice. The attributes of competency-based education include an outcomes focus, allowance for increasing levels of competency, learner accountability, practice-based learning, self-assessment, and individualized learning experiences. One solution to this challenge is scaffolded instruction, where collaboration and knowledge facilitate learning. Collaboration refers to the role of clinical faculty who model desired clinical skills then gradually shift responsibility for nursing activity to the student. This article describes scaffolded instruction as applied in a Web-based second-degree bachelor of science in nursing (BSN) program. This second-degree BSN program uses innovative approaches to education, including a clinical component that relies on clinical coaches. Students in the program remain in their home community and complete their clinical hours with an assigned coach. The method will be described first, followed by a description of how the method was applied.

Constructing a competency-based bariatric surgery fellowship training curriculum.

PubMed

McBride, Corrigan L; Rosenthal, Raul J; Brethauer, Stacy; DeMaria, Eric; Kelly, John J; Morton, John M; Lo Menzo, Emanuele; Moore, Rachel; Pomp, Alfons; Nguyen, Ninh T

2017-03-01

Bariatric fellowship training after general surgery has historically been time based and competence was determined at completion based on a minimum number of cases during the fellowship. Graduate medical education is moving toward competency-based medical education where learners are evaluated during the course of their training and competence assessment occurs throughout. The Executive Council of the American Society of Metabolic and Bariatric Surgery (ASMBS) at the direction of the American Board of Surgery wanted to transition the bariatric surgery fellowship curriculum from its traditional format to a competency-based curriculum using competency-based medical education principles. The ASMBS Education and Training Committee established a task force of 9 members to create a new curriculum and all of the necessary evaluation tools to support the curriculum, and initiate a pilot program. A competency-based curriculum consisting of 6 modules with cognitive and technical milestones, and the innovative evaluation tools needed to evaluate the learners, was created. A pilot program consisting of 10 programs and 19 fellows has been undertaken for the 2016-2017 academic year. The Education Committee of the ASMBS is leading the charge in curriculum development for competency-based medical education for bariatric fellowship. Copyright © 2017 American Society for Bariatric Surgery. Published by Elsevier Inc. All rights reserved.

Assessing competency in practice-based learning: a foundation for milestones in learning portfolio entries.

PubMed

Webb, Travis P; Merkley, Taylor R; Wade, Thomas J; Simpson, Deborah; Yudkowsky, Rachel; Harris, Ilene

2014-01-01

Graduate medical education is undergoing a dramatic shift toward competency-based assessment of learners. Competency assessment requires clear definitions of competency and validated assessment methods. The purpose of this study is to identify criteria used by surgical educators to judge competence in Practice-Based Learning and Improvement (PBL&I) as demonstrated in learning portfolios. A total of 6 surgical learning and instructional portfolio entries served as documents to be assessed by 3 senior surgical educators. These faculty members were asked to rate and then identify criteria used to assess PBL&I competency. Individual interviews and group discussions were conducted, recorded, and transcribed to serve as the study dataset. Analysis was performed using qualitative methodology to identify themes for the purpose of defining competence in PBL&I. The assessment themes derived are presented with narrative examples to describe the progression of competency. The collaborative coding process resulted in identification of 7 themes associated with competency in PBL&I related to surgical learning and instructional portfolio entries: (1) self-awareness regarding effect of actions; (2) identification and thorough description of learning goals; (3) cases used as catalyst for reflection; (4) reconceptualization with appropriate use and critique of cited literature; (5) communication skills/completeness of entry template; (6) description of future behavioral change; and (7) engagement in process--identifies as personally relevant. The identified themes are consistent with and complement other criteria emerging from reflective practice literature and experiential learning theory. This study provides a foundation for further development of a tool for assessing learner portfolios consistent with the Accreditation Council for Graduate Medical Education's Next Accreditation System requirements. Copyright © 2014 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

A theory-informed, process-oriented Resident Scholarship Program

PubMed Central

Thammasitboon, Satid; Darby, John B.; Hair, Amy B.; Rose, Karen M.; Ward, Mark A.; Turner, Teri L.; Balmer, Dorene F.

2016-01-01

Background The Accreditation Council for Graduate Medical Education requires residency programs to provide curricula for residents to engage in scholarly activities but does not specify particular guidelines for instruction. We propose a Resident Scholarship Program that is framed by the self-determination theory (SDT) and emphasize the process of scholarly activity versus a scholarly product. Methods The authors report on their longitudinal Resident Scholarship Program, which aimed to support psychological needs central to SDT: autonomy, competence, and relatedness. By addressing those needs in program aims and program components, the program may foster residents’ intrinsic motivation to learn and to engage in scholarly activity. To this end, residents’ engagement in scholarly processes, and changes in perceived autonomy, competence, and relatedness were assessed. Results Residents engaged in a range of scholarly projects and expressed positive regard for the program. Compared to before residency, residents felt more confident in the process of scholarly activity, as determined by changes in increased perceived autonomy, competence, and relatedness. Scholarly products were accomplished in return for a focus on scholarly process. Conclusions Based on our experience, and in line with the SDT, supporting residents’ autonomy, competence, and relatedness through a process-oriented scholarship program may foster the curiosity, inquisitiveness, and internal motivation to learn that drives scholarly activity and ultimately the production of scholarly products. PMID:27306995

A theory-informed, process-oriented Resident Scholarship Program.

PubMed

Thammasitboon, Satid; Darby, John B; Hair, Amy B; Rose, Karen M; Ward, Mark A; Turner, Teri L; Balmer, Dorene F

2016-01-01

The Accreditation Council for Graduate Medical Education requires residency programs to provide curricula for residents to engage in scholarly activities but does not specify particular guidelines for instruction. We propose a Resident Scholarship Program that is framed by the self-determination theory (SDT) and emphasize the process of scholarly activity versus a scholarly product. The authors report on their longitudinal Resident Scholarship Program, which aimed to support psychological needs central to SDT: autonomy, competence, and relatedness. By addressing those needs in program aims and program components, the program may foster residents' intrinsic motivation to learn and to engage in scholarly activity. To this end, residents' engagement in scholarly processes, and changes in perceived autonomy, competence, and relatedness were assessed. Residents engaged in a range of scholarly projects and expressed positive regard for the program. Compared to before residency, residents felt more confident in the process of scholarly activity, as determined by changes in increased perceived autonomy, competence, and relatedness. Scholarly products were accomplished in return for a focus on scholarly process. Based on our experience, and in line with the SDT, supporting residents' autonomy, competence, and relatedness through a process-oriented scholarship program may foster the curiosity, inquisitiveness, and internal motivation to learn that drives scholarly activity and ultimately the production of scholarly products.

Nurse leaders and the innovation competence gap.

PubMed

White, Kenneth R; Pillay, Rubin; Huang, Xuan

2016-01-01

Nurses are well-positioned for innovation in health care delivery, although innovation is not generally learned in formal educational programs. The purpose of this study was to assess critical competencies for innovation success among nurse leaders in academia and practice, the perceived gaps on those competencies, and teaching methods that would be helpful in developing competencies related to innovation. A Web-enabled descriptive survey design was used to capture nurse leaders' perceptions of important innovation competencies and how they assess their level of competence in the particular innovation domain. Preferred approaches for innovation pedagogy were also queried. Respondents indicated significant gaps in 18 of 19 innovation competencies. Implications are for inclusion of innovation competencies in formal and continuing nursing education. The most preferred innovation pedagogical approaches are case studies of failures and successes and project- and field-based approaches. Traditional lectures are the least preferred way to address innovation competency gaps. There is a significant gap in innovation competencies among nurse leaders in practice and academia. The way we teach innovation needs to involve closer collaboration between academia and practice. Copyright © 2015 Elsevier Inc. All rights reserved.

Home Management and Human Service Competencies.

ERIC Educational Resources Information Center

Regional Learning Service of Central New York, Syracuse.

Faculty representatives from five postsecondary institutions having human service/human ecology programs and two members of the Regional Learning Service staff comprised a task force whose objectives were to identify competencies acquired through home management which relate to undergraduate course objectives, to recommend ways to assess these,…

[Public health competencies and contents in pharmacy degree programs in Spanish universities].

PubMed

Lumbreras, Blanca; Davó-Blanes, María Carmen; Vives-Cases, Carmen; Bosch, Félix

2015-01-01

To identify public health core competencies and contents in pharmacy degrees at a meeting of public health lecturers in pharmacy degrees from various public and private universities. The first Meeting of the Forum of University Teaching Staff in Pharmacy Degrees was held at the Faculty of Medicine in the Complutense University, Madrid, Spain on the 19(th) and 20(th) of November 2013. The meeting was attended by 17 lecturers. Participants brought their own teaching programs and were given two previous studies on public health competencies for analysis of public health contents and competencies in pharmacy degrees. Working groups were formed and the results were shared. The highest number of core competencies was identified in the following functions: "Assessment of the population's health needs" and "Developing health policies". The final program included basic contents organized into 8 units: Concept of Public Health, Demography, Epidemiological Method, Environment and Health, Food Safety, Epidemiology of Major Health Problems, Health Promotion and Education, and Health Planning and Management. Representation of almost all the Spanish Pharmacy Faculties and the consensus reached in the description of competences and program contents will greatly improve the quality of teaching in this area. Copyright © 2014 SESPAS. Published by Elsevier Espana. All rights reserved.

On the Assessment of Paramedic Competence: A Narrative Review with Practice Implications.

PubMed

Tavares, W; Boet, S

2016-02-01

Paramedicine is experiencing significant growth in scope of practice, autonomy, and role in the health care system. Despite clinical governance models, the degree to which paramedicine ultimately can be safe and effective will be dependent on the individuals the profession deems suited to practice. This creates an imperative for those responsible for these decisions to ensure that assessments of paramedic competence are indeed accurate, trustworthy, and defensible. The purpose of this study was to explore and synthesize relevant theoretical foundations and literature informing best practices in performance-based assessment (PBA) of competence, as it might be applied to paramedicine, for design or evaluation of assessment programs. A narrative review methodology was applied to focus intentionally, but broadly, on purpose relevant, theoretically derived research that could inform assessment protocols in paramedicine. Primary and secondary studies from a number of health professions that contributed to and informed best practices related to the assessment of paramedic clinical competence were included and synthesized. Multiple conceptual frameworks, psychometric requirements, and emerging lines of research are forwarded. Seventeen practice implications are derived to promote understanding as well as best practices and evaluation criteria for educators, employers, and/or licensing/certifying bodies when considering the assessment of paramedic competence. The assessment of paramedic competence is a complex process requiring an understanding, appreciation for, and integration of conceptual and psychometric principles. The field of PBA is advancing rapidly with numerous opportunities for research.

Motor Skill Competence and Perceived Motor Competence: Which Best Predicts Physical Activity among Girls?

PubMed

Khodaverdi, Zeinab; Bahram, Abbas; Khalaji, Hassan; Kazemnejad, Anoshirvan

2013-10-01

The main purpose of this study was to determine which correlate, perceived motor competence or motor skill competence, best predicts girls' physical activity behavior. A sample of 352 girls (mean age=8.7, SD=0.3 yr) participated in this study. To assess motor skill competence and perceived motor competence, each child completed the Test of Gross Motor Development-2 and Physical Ability sub-scale of Marsh's Self-Description Questionnaire. Children's physical activity was assessed by the Physical Activity Questionnaire for Older Children. Multiple linear regression model was used to determine whether perceived motor competence or motor skill competence best predicts moderate-to-vigorous self-report physical activity. Multiple regression analysis indicated that motor skill competence and perceived motor competence predicted 21% variance in physical activity (R(2)=0.21, F=48.9, P=0.001), and motor skill competence (R(2)=0.15, ᵝ=0.33, P= 0.001) resulted in more variance than perceived motor competence (R(2)=0.06, ᵝ=0.25, P=0.001) in physical activity. Results revealed motor skill competence had more influence in comparison with perceived motor competence on physical activity level. We suggest interventional programs based on motor skill competence and perceived motor competence should be administered or implemented to promote physical activity in young girls.

Promoting medical students' reflection on competencies to advance a global health equities curriculum.

PubMed

Mullan, Patricia B; Williams, Joy; Malani, Preeti N; Riba, Michelle; Haig, Andrew; Perry, Julie; Kolars, Joseph C; Mangrulkar, Rajesh; Williams, Brent

2014-05-03

The move to frame medical education in terms of competencies - the extent to which trainees "can do" a professional responsibility - is congruent with calls for accountability in medical education. However, the focus on competencies might be a poor fit with curricula intended to prepare students for responsibilities not emphasized in traditional medical education. This study examines an innovative approach to the use of potential competency expectations related to advancing global health equity to promote students' reflections and to inform curriculum development. In 2012, 32 medical students were admitted into a newly developed Global Health and Disparities (GHD) Path of Excellence. The GHD program takes the form of mentored co-curricular activities built around defined competencies related to professional development and leadership skills intended to ameliorate health disparities in medically underserved settings, both domestically and globally. Students reviewed the GHD competencies from two perspectives: a) their ability to perform the identified competencies that they perceived themselves as holding as they began the GHD program and b) the extent to which they perceived that their future career would require these responsibilities. For both sets of assessments the response scale ranged from "Strongly Disagree" to "Strongly Agree." Wilcoxon's paired T-tests compared individual students' ordinal rating of their current level of ability to their perceived need for competence that they anticipated their careers would require. Statistical significance was set at p < .01. Students' ratings ranged from "strongly disagree" to "strongly agree" that they could perform the defined GHD-related competencies. However, on most competencies, at least 50 % of students indicated that the stated competencies were beyond their present ability level. For each competency, the results of Wilcoxon paired T-tests indicate - at statistically significant levels - that students perceive more need in their careers for GHD-program defined competencies than they currently possess. This study suggests congruence between student and program perceptions of the scope of practice required for GHD. Students report the need for enhanced skill levels in the careers they anticipate. This approach to formulating and reflecting on competencies will guide the program's design of learning experiences aligned with students' career goals.

An Integrative Review of the Quality and Outcomes of Diabetes Education Programs for Children and Adolescents.

PubMed

Colson, Sébastien; Côté, José; Gentile, Stéphanie; Hamel, Valérie; Sapuppo, Cédric; Ramirez-Garcia, Pilar; Reynaud, Rachel; Lagouanelle-Simeoni, Marie-Claude

2016-10-01

The purpose of this study was twofold: (1) to describe the content of recent diabetes education programs and their outcomes in terms of glycemic control, disease management, and psychosocial criteria for children and adolescents with type 1 diabetes and (2) to gauge the match between these programs and the recommendations of the International Society for Pediatric and Adolescent Diabetes (ISPAD). The integrative review was carried out according to the Cochrane recommendations. Thirteen databases were searched for evaluations of education programs published from 2009 to 2014. Program characteristics and outcomes were described. Quality of studies was assessed, and program match with ISPAD recommendations was gauged. Of 2528 studies found, 43 covering 36 education programs intended for youth with type 1 diabetes were retained for review. Nine of these centered on self-care competencies, 18 on psychosocial competencies, and 9 on both types of competency (mixed program). Programs varied widely in terms of organization, procedure, and content. Glycemic control was an indicator assessed in the majority of programs, but only half of these (for the most part, self-care programs) reported positive findings in this regard. Few programs seemed to affect psychosocial indicators. An online mixed program, which was the program that best met the ISPAD recommendations, proved to have an influence on glycemic control and several psychosocial criteria. Various avenues can be considered to improve participant engagement in education programs and to align these programs more closely with international recommendations. Further research is required to enhance knowledge in this field. © 2016 The Author(s).

Can Source Triangulation Be Used to Overcome Limitations of Self-Assessments? Assessing Educational Needs and Professional Competence of Pharmacists Practicing in Qatar.

PubMed

Kheir, Nadir; Al-Ismail, Muna Said; Al-Nakeeb, Reem

2017-01-01

Continuing professional development activities should be designed to meet the identified personal goals of the learner. This article aims to explore the self-perceived competency levels and the professional educational needs of pharmacists in Qatar and to compare these with observations of pharmacy students undergoing experiential training in pharmacies (students) and pharmacy academics, directors, and managers (managers). Three questionnaires were developed and administered to practicing pharmacists, undergraduate pharmacy students who have performed structured experiential training rotations in multiple pharmacy outlets in Qatar and pharmacy managers. The questionnaires used items extracted from the National Association of Pharmacy Regulatory Authorities (NAPRA) Professional competencies for Canadian pharmacists at entry to practice and measured self- and observed pharmacists' competency and satisfaction with competency level. Training and educational needs were similar between the pharmacists and observers, although there was trend for pharmacists to choose more fact-intensive topics compared with observers whose preferences were toward practice areas. There was no association between the competency level of pharmacists as perceived by observers and as self-assessed by pharmacists (P ≤ .05). Pharmacists' self-assessed competency level was consistently higher than that reported by students (P ≤ .05). The results suggest that the use of traditional triangulation might not be sufficient to articulate the professional needs and competencies of practicing pharmacists as part of a strategy to build continuing professional development programs. Pharmacists might have a limited ability to accurately self-assess, and observer assessments might be significantly different from self-assessments which present a dilemma on which assessment to consider closer to reality. The processes currently used to evaluate competence may need to be enhanced through the use of well-designed rubrics or other strategies to empower and to better inform respondents and subsequently improve their ability to self-assess their competencies.

Culturally Competent Counselors: A Self-Assessment Rubric.

ERIC Educational Resources Information Center

Ametrano, Irene Mass; Callaway, Yvonne L.; Stickel, Sue A.

This paper examines graduate counseling students' affective and cognitive development related to cultural competence. Counseling Process and Cross Cultural Counseling, two required courses in a master's degree program at a regional university in the Midwest, were designed to provide a knowledge-base about cultural differences and to project how…

Leisure Service Career Programs Model. Final Report.

ERIC Educational Resources Information Center

Twining, Marilyn

This report identifies leisure career occupations, determines the occupational outlook, and develops primary core competencies as well as specialized, optional competencies for entry level employment. The main method of inquiry is described as a needs assessment based on an audit at Moraine Valley Community College, two previous studies by the…

A Dynamic Community of Discovery: Planning, Learning, and Change

ERIC Educational Resources Information Center

Gordon, Michelle; Ireland, Martha; Wong, Mina

2011-01-01

Ryerson University's Prior Learning and Competency Evaluation and Documentation (PLACED) program is funded by the Government of Ontario to engage internationally educated professionals (IEPs), employers, and regulatory/occupational bodies in the use of competency-based practices. In 2008, the authors created a self-assessment tool for IEPs that…

CASAS: An Effective Measurement System for Life Skills.

ERIC Educational Resources Information Center

Stiles, Richard L.; And Others

The California Adult Student Assessment System (CASAS) is a comprehensive educational system designed to enable adult educators to develop and evaluate a life skills curriculum for competency based educational programs. The system comprises the CASAS Competency List, the CASAS Item Bank, the User's Manual, the Curriculum Index and Matrix, and…

Intercultural Competence in Short-Term Study Abroad

ERIC Educational Resources Information Center

Nguyen, Annie

2017-01-01

Assessment is growing for short-term study abroad as the majority of students (63.1%) continue to choose this option (Institute of International Education, 2016). This study uses the Intercultural Effectiveness Scale (IES) to examine the impact of short-term study abroad programs on students' overall intercultural competency and the connections…

Gerontological Competencies among MSW Students: Evaluation of a Gerontology Specialization Program.

PubMed

Wilks, Scott E; Cain, Daphne S; Reed-Ashcraft, Kellie B; Geiger, Jen

2017-01-01

The purpose of this study was to conduct a preliminary evaluation of a gerontology specialization program (GSP) within a Council on Social Work Education (CSWE)-accredited master of social work (MSW) program. This study utilized a pretest/posttest design with a three-group comparison: group 1-GSP students; group 2-students from the group 1 program but not in GSP; and group 3-students at two external MSW programs with no GSPs. The overall sample comprised 220 advanced year students. A CSWE Gero-Ed Center/Hartford Partnership empirical measure was used to assess overall, gero social work practice competency. Within-group analyses revealed a significant increase in gero competency scores from pretest to posttest among all groups, with GSP students showing the largest increase. Between-group analysis at pretest revealed that the GSP group showed lower gero competency scores than both non-GSP groups. At posttest, these results overturned: GSP students scored significantly higher gero competency scores than both non-GSP groups. These preliminary findings suggest that the GSP offers an impactful, positive role in development of practice skills for the next generation of gero social work practitioners and scholars. A follow-up study with additional years of data will increase longitudinal rigor and confidence in the long-range efficacy of this GSP.

Evaluation of Curricula Content Based on Thai Pharmacy Competency Standards

PubMed Central

Maitreemit, Pagamas; Pongcharoensuk, Petcharat; Armstrong, Edward P.

2008-01-01

Objective To evaluate the curricula content of Thai pharmacy schools based on the Thai pharmacy competency standards. Methods Course syllabi were collected from 11 pharmacy schools. A questionnaire was developed based on the Thai pharmacy competency standards. Course coordinators completed the questionnaire assessing the curricula content. Results The curricula for both the bachelor of science in pharmacy degree (BS Pharm) and doctor of pharmacy (PharmD) degree programs included the minimum content required by the 8 competency domains. The dominant content area in BS Pharm degree programs was product-oriented material. The content ratio of patient to product to social and administrative pharmacy in the BS Pharm degree programs was 2:3:1, respectively. However, the content ratio suggested by the Thai Pharmacy Council was 3:2:1, respectively. For the PharmD programs, the largest content area was patient-oriented material, which was in agreement with the framework suggested by the Thai Pharmacy Council. Conclusions The curricula of all Thai pharmacy schools met the competency standards; however, some patient-oriented material should be expanded and some product-oriented content deleted in order to meet the recommended content ratio. PMID:18322571

The need for a systematic approach to disaster psychosocial response: a suggested competency framework.

PubMed

Cox, Robin S; Danford, Taryn

2014-04-01

Competency models attempt to define what makes expert performers "experts." Successful disaster psychosocial planning and the institutionalizing of psychosocial response within emergency management require clearly-defined skill sets. This necessitates anticipating both the short- and long-term psychosocial implications of a disaster or health emergency (ie, pandemic) by developing effective and sustained working relationships among psychosocial providers, programs, and other planning partners. The following article outlines recommended competencies for psychosocial responders to enable communities and organizations to prepare for and effectively manage a disaster response. Competency-based models are founded on observable performance or behavioral indicators, attitudes, traits, or personalities related to effective performance in a specific role or job. After analyzing the literature regarding competency-based frameworks, a proposed competency framework that details 13 competency domains is suggested. Each domain describes a series of competencies and suggests behavioral indicators for each competency and, where relevant, associated training expectations. These domains have been organized under three distinct categories or types of competencies: general competency domains; disaster psychosocial intervention competency domains; and disaster psychosocial program leadership and coordination competency domains. Competencies do not replace job descriptions nor should they be confused with performance assessments. What they can do is update and revise job descriptions; orient existing and new employees to their disaster/emergency roles and responsibilities; target training needs; provide the basis for ongoing self-assessment by agencies and individuals as they evaluate their readiness to respond; and provide a job- or role-relevant basis for performance appraisal dimensions or standards and review discussions. Using a modular approach to psychosocial planning, service providers can improve their response capacity by utilizing differences in levels of expertise and training. The competencies outlined in this paper can thus be used to standardize expectations about levels of psychosocial support interventions. In addition this approach provides an adaptable framework that can be adjusted for various contexts.

Alabama Industrial Technician Education Cooperative Demonstration Program (I-TEC). Final Performance Report.

ERIC Educational Resources Information Center

John M. Patterson State Technical Coll., Montgomery, AL.

A cooperative demonstration program between industry (General Electric) and education (John Patterson State Technical College, Alabama) designed and conducted a training program and competency assessment for individuals entering high technology positions related to industrial production in Alabama. The program was designed to develop employees as…

Leadership Behaviour and Effectiveness of Academic Program Directors in Australian Universities

ERIC Educational Resources Information Center

Vilkinas, Tricia; Ladyshewsky, Richard K.

2012-01-01

This article focuses on leadership behaviour and effectiveness of university academic program directors who have responsibility for managing a program or course of study. The leadership capabilities were assessed using the Integrated Competing Values Framework as its theoretical foundation. Data from 90 academic program directors and 710…

Workplace Education Partnerships: Compromises, Promises, and Practices.

ERIC Educational Resources Information Center

Hellman, Linda

A Pima County (Arizona) adult workplace education program in English as a Second Language (ESL) is outlined. Salient elements in program design, student recruitment and program marketing, student assessment, instructional methods, and program evaluation are noted, and the topical content of the ESL curriculum is charted. Tasks/competencies and…

Designing a physician leadership development program based on effective models of physician education.

PubMed

Hopkins, Joseph; Fassiotto, Magali; Ku, Manwai Candy; Mammo, Dagem; Valantine, Hannah

2017-02-02

Because of modern challenges in quality, safety, patient centeredness, and cost, health care is evolving to adopt leadership practices of highly effective organizations. Traditional physician training includes little focus on developing leadership skills, which necessitates further training to achieve the potential of collaborative management. The aim of this study was to design a leadership program using established models for continuing medical education and to assess its impact on participants' knowledge, skills, attitudes, and performance. The program, delivered over 9 months, addressed leadership topics and was designed around a framework based on how physicians learn new clinical skills, using multiple experiential learning methods, including a leadership active learning project. The program was evaluated using Kirkpatrick's assessment levels: reaction to the program, learning, changes in behavior, and results. Four cohorts are evaluated (2008-2011). Reaction: The program was rated highly by participants (mean = 4.5 of 5). Learning: Significant improvements were reported in knowledge, skills, and attitudes surrounding leadership competencies. Behavior: The majority (80%-100%) of participants reported plans to use learned leadership skills in their work. Improved team leadership behaviors were shown by increased engagement of project team members. All participants completed a team project during the program, adding value to the institution. Results support the hypothesis that learning approaches known to be effective for other types of physician education are successful when applied to leadership development training. Across all four assessment levels, the program was effective in improving leadership competencies essential to meeting the complex needs of the changing health care system. Developing in-house programs that fit the framework established for continuing medical education can increase physician leadership competencies and add value to health care institutions. Active learning projects provide opportunities to practice leadership skills addressing real word problems.

Use of a television crime-drama series to promote legal understanding in mentally ill, incompetent defendants: a pilot study.

PubMed

Montgomery, John; Brooks, Martin H

2005-03-01

Videotaped material is used for educational purposes in many areas of medicine. In forensic facilities, programs designed to restore competency to stand trial (CST) in incompetent, mentally ill defendants have utilized videotaped courtroom proceedings as learning tools. This pilot study reviewed the progress of incompetent defendants (N = 15) who participated in a program that utilized videotaped segments of the television crime-drama "Law & Order", among other techniques, to promote CST in individuals deemed unfit to stand trial. The authors hypothesized that participation in at least one cycle of the Competency Restoration Group (CRG)'s curriculum would be associated with improvement in the areas of understanding, reasoning and appreciation. In order to assess whether the group was beneficial to the patient's treatment goal of competency restoration, patients were screened using the MacArthur Competence Assessment Tool-Criminal Adjudication (MacCAT-CA) prior to starting the group and after completing a cycle of the group's curriculum. The Wilcoxon signed ranks test was employed to analyze the results from the pre- and post-group MacCAT-CA testing. The tests yielded significant (p < 0.005) post-test differences in the hypothesized direction for each of the three subsections: Understanding, Reasoning, and Appreciation as well as a significant post test improvement in the total MacCAT-CA scores. These results suggest that a didactic program, using a popular crime drama series, can be effective in facilitating learning in competency restoration programs. Limitations of this study include its lack of a control group and small population.

Administration and Research of Competency-/Performance-Based Teacher Education Programs.

ERIC Educational Resources Information Center

Trzasko, Joseph A.

This paper describes the proposed Assessment Center at Mercy College in Dobbs Ferry, New York. The center is intended to provide statistical and technical support for the Mercy College elementary education, special education, and speech and hearing departments in the areas of student assessment, student guidance, and program evaluation. Evaluation…

Beginning Teachers' Perceptions of the California Teaching Performance Assessment (TPA)

ERIC Educational Resources Information Center

Campbell, Conni; Ayala, Carlos Cuauhtémoc; Railsback, Gary; Freking, Frederick W.; McKenna, Corey; Lausch, David

2016-01-01

The teaching performance assessment (TPA) seeks to measure the knowledge, skills, and competencies of teachers during the credential phase of their training. The TPA was introduced in California in 2004 with programs piloting it and then became mandatory for candidates enrolling in preliminary programs in 2008. Although California has multiple…

Tracing Changes in Families Who Participated in the Home-Start Parenting Program: Parental Sense of Competence as Mechanism of Change

PubMed Central

Asscher, Jessica J.; Hermanns, Jo; Reitz, Ellen; Prinzie, Peter; van den Akker, Alithe L.

2010-01-01

The present study aimed to (1) determine the long-term effectiveness of Home-Start, a preventive parenting program, and (2) test the hypothesis that changes in maternal sense of competence mediate the program’s effects. Participants were 124 mothers (n = 66 intervention, n = 58 comparison). Four assessments took place during a 1-year period. Latent growth modeling showed that Home-Start enhanced growth in maternal sense of competence and supportive parenting, and led to a decrease in the use of inept discipline. Results of mediational and cross-lagged analyses were consistent with the hypothesized model: Participation in Home-Start was related to the changes in maternal sense of competence, which in turn predicted changes in parenting. The results affirm the importance of directly targeting parental sense of competence in the context of prevention work with parents. PMID:20101464

Examining Factors in the Research Institute on Addictions Self-Inventory (RIASI): Associations with Alcohol Use and Problems at Assessment and Follow-Up

PubMed Central

Mann, Robert E.; Stoduto, Gina; Zalcman, Rosely Flam; Nochajski, Thomas H.; Hall, Louise; Dill, Patricia; Wells-Parker, Elisabeth

2009-01-01

Impaired driving is a leading cause of alcohol-related deaths and injuries. Rehabilitation or remedial programs, involving assessment and screening of convicted impaired drivers to determine problem severity and appropriate programs, are an important component of society’s response to this problem. Ontario’s remedial program, Back on Track (BOT), involves an assessment process that includes administration of the Research Institute on Addictions Self-Inventory (RIASI) to determine assignment to an education or treatment program. The purpose of this study is to identify factors within the RIASI and examine how factor scores are associated with alcohol use and problem indicators at assessment and six-month follow-up. The sample included 22,298 individuals who completed BOT from 2000 to 2005. Principal component factor analysis with varimax rotation was conducted on RIASI data and an eight factor solution was retained: (1) Negative Affect, (2) Sensation Seeking, (3) Alcohol-Quantity, (4) Social Conformity, (5) High Risk Lifestyle, (6) Alcohol Problems, (7) Interpersonal Competence, and (8) Family History. Regression analyses were conducted to examine associations between factors and alcohol and problem measures obtained at assessment and at follow-up. Most factors, except for Interpersonal Competence, were associated with more alcohol use and problems at assessment. A similar pattern was observed at 6-month follow-up, but interestingly some factors (Negative Affect, Sensation Seeking, Alcohol-Quantity and Family History) predicted fewer days of alcohol use. The Interpersonal Competence factor was associated with significantly lower levels of alcohol use and problems at both assessment and follow-up. This work suggests that the RIASI provides information on several domains that have important relationships with alcohol problem severity and outcomes. PMID:20049234

Intern Boot Camp: Feasibility and impact of a 1-hour session to ensure graduating medical student competency in falls risk assessment.

PubMed

Omlor, Rebecca L; Watkins, Franklin S; Lawlor, Janice S; Lovato, James F; Fino, Nora F; Atkinson, Hal H

2017-01-01

The authors evaluated the feasibility of a 1-hour session to ensure competency in gait and falls risk assessment for medical students at their institution. The session included a history and exam with faculty and staff as standardized patients, gait recognition videos, and case evaluation for falls risk assessment and prevention. Student perceptions were evaluated using a retrospective pre-post survey, scored on a 5-point Likert-type scale. Wilcoxon signed-rank tests were used to assess change and Kruskal-Wallis tests were used to analyze differences by residency choice. A range of five to 11 faculty and staff certified 238 medical students during eight 1-hour sessions. Overall self-perception of competence in falls risk assessment and prevention improved (p ≤ .001), and did not differ by residency choice, both before and after the training program (p = .73 and p = .25). Feedback was positive. This session is a feasible way to teach and assess the competency for falls risk assessment with modest time commitment.

Evaluating the short-term effects of a communication skills program for preclinical medical students.

PubMed

Lee, Young-Mee; Lee, Young Hee

2014-09-01

Regardless of the growing importance of communication skills as a core clinical competence, few studies have determined the effects of communication skills courses in undergraduate medical curricula in Asian medical schools. The purpose of this study was to examine the effectiveness of a communication skills program for preclinical medical students. A communication skills course was provided to 111 second-year medical students in a medical college in Korea. Students' self-assessed competency of communication skills was evaluated by a questionnaire survey. To examine the improvement in observed communication skills, the students' encounters with standardized patients (SPs) were assessed at the first session and at the final course assessment. A structured checklist, consisting of 25 communication skills items, was used for the assessment. Students' self-assessed competency of communication skills increased significantly after completion of the course (p<0.001). The observed communication skills scores also improved significantly at the end of the course; the mean scores of the first SPs encounters was 49.6 (standard deviation [SD], 11.1), and those of cases A and B at the final assessment were 61.5 (SD, 8.4) and 69.6 (SD, 7.8), respectively (F₆₁=269.54, p<0.001). Even a short period of medical communication skills course was beneficial in developing and improving communication skills competency in preclinical medical students. Further studies should be followed to examine whether the acquisition of communication skills during preclinical studies can be sustained into clerkship and actual practice.

A Canadian survey of postgraduate education in Aboriginal women's health in obstetrics and gynaecology.

PubMed

Jumah, Naana Afua; Wilson, Don; Shah, Rajiv

2013-07-01

To assess Canadian obstetrics and gynaecology residents' knowledge of and experience in Indigenous women's health (IWH), including a self-assessment of competency, and to assess the ability of residency program directors to provide a curriculum in IWH and to assess the resources available to support this initiative. Surveys for residents and for program directors were distributed to all accredited obstetrics and gynaecology residency programs in Canada. The resident survey consisted of 20 multiple choice questions in four key areas: general knowledge regarding Indigenous peoples in Canada; the impact of the residential school system; clinical experience in IWH; and a self-assessment of competency in IWH. The program director survey included an assessment of the content of the curriculum in IWH and of the resources available to support this curriculum. Residents have little background knowledge of IWH and the determinants of health, and are aware of their knowledge gap. Residents are interested in IWH and recognize the importance of IWH training for their future practice. Program directors support the development of an IWH curriculum, but they lack the resources to provide a comprehensive IWH curriculum and would benefit from having a standardized curriculum available. A nationwide curriculum initiative may be an effective way to facilitate the provision of education in IWH while decreasing the need for resources in individual programs.

Cultural competence springs up in the desert: the story of the center for cultural competence in health care at Weill Cornell Medical College in Qatar.

PubMed

Elnashar, Maha; Abdelrahim, Huda; Fetters, Michael D

2012-06-01

The authors describe the factors that led Weill Cornell Medical College in Qatar (WCMC-Q) to establish the Center for Cultural Competence in Health Care from the ground up, and they explore challenges and successes in implementing cultural competence training.Qatar's capital, Doha, is an extremely high-density multicultural setting. When WCMC-Q's first class of medical students began their clinical clerkships at the affiliated teaching hospital Hamad Medical Corporation in 2006, the complicated nature of training in a multicultural and multilingual setting became apparent immediately. In response, initiatives to improve students' cultural competence were undertaken. Initiatives included launching a medical interpretation program in 2007; surveying the patients' spoken languages, examining the effect of an orientation program on interpretation requests, and surveying faculty using the Tool for Assessing Cultural Competence Training in 2008; implementing cultural competence training for students and securing research funding in 2009; and expanding awareness to the Qatar community in 2010. These types of initiatives, which are generally highly valued in U.S. and Canadian settings, are also apropos in the Arabian Gulf region.The authors report on their initial efforts, which can serve as a resource for other programs in the Arabian Gulf region.

A Crisis in Competency: The Strategic and Ethical Imperative to Assessing New Graduate Nurses' Clinical Reasoning.

PubMed

Kavanagh, Joan M; Szweda, Christine

The aim of the study was to assess entry-level competency and practice readiness of newly graduated nurses. Literature on success of new graduates focuses primarily on National Council of State Boards of Nursing Licensure Examination (NCLEX-RN) pass rates, creating a false and incomplete picture of practice readiness. Posthire and prestart Performance-Based Development System assessments were administered to more than 5,000 newly graduated nurses at a large midwestern academic medical center between July 2010 and July 2015. Aggregate baseline data indicate that only 23 percent of newly graduated nurses demonstrate entry-level competencies and practice readiness. New data suggest that we are losing ground in the quest for entry-level competency. Graduates often are underprepared to operate in the complex field of professional practice where increased patient acuity and decreased length of stay, coupled with a lack of deep learning in our academic nursing programs, have exacerbated a crisis in competency.

Activities of daily living in children with hemiparesis: influence of cognitive abilities and motor competence.

PubMed

Adler, Caroline; Rauchenzauner, Markus; Staudt, Martin; Berweck, Steffen

2014-12-01

The aim of the article is to investigate whether motor competence and cognitive abilities influence the quality of performance of activities of daily living (ADL) in children with hemiparesis. Patients and A total of 20 children with hemiparesis (age, 6-12 years; 11 congenital, 9 acquired during childhood) were studied. Motor competence was assessed with the Assisting Hand Assessment, cognitive abilities with the German version of the Wechsler Intelligence Scale for Children IV, and the quality of ADL performance with the Assessment of Motor and Process Skills (AMPS). The motor skills scale of the AMPS correlated with motor competence, and the process skills scale of the AMPS correlated with cognitive abilities. The quality of ADL performance is influenced not only by motor competence but also by the cognitive abilities of a hemiparetic child. This suggests that, in addition to motor-oriented training programs, an optimal therapy for hemiparetic children should also consider cognitive approaches. Georg Thieme Verlag KG Stuttgart · New York.

Assurance of Learning in the MIS Program

ERIC Educational Resources Information Center

Harper, Jeffrey S.; Harder, Joseph T.

2009-01-01

This article describes the development of a systematic and practical methodology for assessing program effectiveness and monitoring student development in undergraduate decision sciences programs. The model we present is based on a student's progression through learning stages associated with four key competencies: technical, analytical,…

Update on the Health Services Research Doctoral Core Competencies.

PubMed

Burgess, James F; Menachemi, Nir; Maciejewski, Matthew L

2018-03-13

To present revised core competencies for doctoral programs in health services research (HSR), modalities to deliver these competencies, and suggested methods for assessing mastery of these competencies. Core competencies were originally developed in 2005, updated (but unpublished) in 2008, modestly updated for a 2016 HSR workforce conference, and revised based on feedback from attendees. Additional feedback was obtained from doctoral program directors, employer/workforce experts and attendees of presentation on these competencies at the AcademyHealth's June 2017 Annual Research Meeting. The current version (V2.1) competencies include the ethical conduct of research, conceptual models, development of research questions, study designs, data measurement and collection methods, statistical methods for analyzing data, professional collaboration, and knowledge dissemination. These competencies represent a core that defines what HSR researchers should master in order to address the complexities of microsystem to macro-system research that HSR entails. There are opportunities to conduct formal evaluation of newer delivery modalities (e.g., flipped classrooms) and to integrate new Learning Health System Researcher Core Competencies, developed by AHRQ, into the HSR core competencies. Core competencies in HSR are a continually evolving work in progress because new research questions arise, new methods are developed, and the trans-disciplinary nature of the field leads to new multidisciplinary and team building needs. © Health Research and Educational Trust.

Researcher perspectives on competencies of return-to-work coordinators.

PubMed

Gardner, Bethany T; Pransky, Glenn; Shaw, William S; Hong, Qua Nha; Loisel, Patrick

2010-01-01

Return-to-work (RTW) coordination programs are successful in reducing long-term work disability, but research reports have not adequately described the role and competencies of the RTW coordinator. This study was conducted to clarify the impact of RTW coordinators, and competencies (knowledge, skills, and attitudes) required to achieve optimal RTW outcomes in injured workers. Studies involving RTW coordination for injured workers were identified through literature review. Semi-structured interviews were conducted with 12 principal investigators to obtain detailed information about the RTW coordinator role and competencies not included in published articles. Interview results were synthesized into principal conceptual groups by affinity mapping. All investigators strongly endorsed the role of RTW coordinator as key to the program's success. Affinity mapping identified 10 groups of essential competencies: (1) individual traits/qualities, (2) relevant knowledge base, (3) RTW focus and attitude, (4) organizational/administrative skills, (5) assessment skills, (6) communication skills, (7) interpersonal relationship skills, (8) conflict resolution skills, (9) problem-solving skills, and (10) RTW facilitation skills. Specific consensus competencies were identified within each affinity group. Most investigators endorsed similar competencies, although there was some variation by setting or scope of RTW intervention. RTW coordinators are essential contributors in RTW facilitation programs. This study identified specific competencies required to achieve success. More emphasis on mentorship and observation will be required to develop and evaluate necessary skills in this area.

Competency-Based Education for the Molecular Genetic Pathology Fellow

PubMed Central

Talbert, Michael L.; Dunn, S. Terence; Hunt, Jennifer; Hillyard, David R.; Mirza, Imran; Nowak, Jan A.; Van Deerlin, Vivianna; Vnencak-Jones, Cindy L.

2009-01-01

The following report represents guidelines for competency-based fellowship training in Molecular Genetic Pathology (MGP) developed by the Association for Molecular Pathology Training and Education Committee and Directors of MGP Programs in the United States. The goals of the effort were to describe each of the Accreditation Council for Graduate Medical Education competencies as they apply to MGP fellowship training, provide a summary of goals and objectives, and recommend assessment tools. These guidelines are particularly pertinent to MGP training, which is a relatively new specialty that operates within a rapidly changing scientific and technological arena. It is hoped that this document will provide additional material for directors of existing MGP programs to consider for improvement of program objectives and enhancement of evaluation tools already in place. In addition, the guidelines should provide a valuable framework for the development of new MGP programs. PMID:19797613

[Public health competencies and contents in Spanish university degree programs of physical therapy, occupational therapy, environmental science, dentistry and veterinary science].

PubMed

Davó-Blanes, M Carmen; Vives-Cases, Carmen; Alvarez-Dardet, Carlos; Segura-Benedicto A, Andreu; Bosch Llonch, Fèlix; G Benavides, Fernando

2014-01-01

To identify the basic competencies and contents related to public health to be included in degree programs according to the perspective of lecturers from various Spanish universities. In the context of the Second Workshop on Public Health Contents in Degree Programs (Mahon, 19 to 20 September 2012), 20 lecturers from different Spanish universities were distributed in five working groups. The lecturers had been selected from the instructional guides on public health and epidemiology published on the web sites of the Rectors' Conference of Spanish Universities. Each group worked on a degree program and the results were discussed in plenary sessions. The activities and competencies related to the three basic functions of public health were identified in all degree programs. Most of the professional competencies identified were related to the function of «assessment of population health needs». The contents proposed by the working groups related to epidemiology, basic concepts in public health, public health intervention, health management, and health policy. The main common topics among the degrees concerned the first three contents. Public health professional competencies and contents were identified in the degree programs examined. These results may serve as a starting point for a more detailed review of public health programs across degree levels and the search for a consensus on the common content that should be included in each of them. Copyright © 2013 SESPAS. Published by Elsevier Espana. All rights reserved.

Significance of Objective Structured Clinical Examinations to Plastic Surgery Residency Training.

PubMed

Simmons, Brian J; Zoghbi, Yasmina; Askari, Morad; Birnbach, David J; Shekhter, Ilya; Thaller, Seth R

2017-09-01

Objective structured clinical examinations (OSCEs) have proven to be a powerful tool. They possess more than a 30-year track record in assessing the competency of medical students, residents, and fellows. Objective structured clinical examinations have been used successfully in a variety of medical specialties, including surgery. They have recently found their way into the subspecialty of plastic surgery. This article uses a systematic review of the available literature on OSCEs and their recent use in plastic surgery. It incorporates survey results assessing program directors' views on the use of OSCEs. Approximately 40% of programs surveyed use OSCEs to assess the Accreditation Council for Graduate Medical Education core competencies. We found that 40% use OSCEs to evaluate specific plastic surgery milestones. Objective structured clinical examinations are usually performed annually. They cost anywhere between $100 and more than $1000 per resident. Four milestones giving residents the most difficulties on OSCEs were congenital anomalies, noncancer breast surgery, breast reconstruction, and practice-based learning and improvement. It was determined that challenges with milestones were due to lack of adequate general knowledge and surgical ward patient care, as well as deficits in professionalism and system-based problems. Programs were able to remediate weakness found by OSCEs using a variety of methods. Objective structured clinical examinations offer a unique tool to objectively assess the proficiency of residents in key areas of the Accreditation Council for Graduate Medical Education core competencies. In addition, they can be used to assess the specific milestones that plastic surgery residents must meet. This allows programs to identify and improve identified areas of weakness.

Working towards Best Practice in Assessment. A Case Study Approach to Some Issues Concerning Competency-Based Assessment in the Vocational Education and Training Sector.

ERIC Educational Resources Information Center

Bloch, Barbara; Thomson, Peter

Between July and November 1993, a cross-section of Australia's school- and workplace-based vocational education and training programs was studied to identify programs using innovative assessment strategies and materials. As innovative strategies/materials were identified, the study methodology was revised and a case study approach was adopted. The…

Motor Skill Competence and Perceived Motor Competence: Which Best Predicts Physical Activity among Girls?

PubMed Central

Khodaverdi, Zeinab; Bahram, Abbas; Khalaji, Hassan; Kazemnejad, Anoshirvan

2013-01-01

Abstract Background The main purpose of this study was to determine which correlate, perceived motor competence or motor skill competence, best predicts girls’ physical activity behavior. Methods A sample of 352 girls (mean age=8.7, SD=0.3 yr) participated in this study. To assess motor skill competence and perceived motor competence, each child completed the Test of Gross Motor Development-2 and Physical Ability sub-scale of Marsh’s Self-Description Questionnaire. Children’s physical activity was assessed by the Physical Activity Questionnaire for Older Children. Multiple linear regression model was used to determine whether perceived motor competence or motor skill competence best predicts moderate-to-vigorous self-report physical activity. Results Multiple regression analysis indicated that motor skill competence and perceived motor competence predicted 21% variance in physical activity (R2=0.21, F=48.9, P=0.001), and motor skill competence (R2=0.15, ᵝ=0.33, P= 0.001) resulted in more variance than perceived motor competence (R2=0.06, ᵝ=0.25, P=0.001) in physical activity. Conclusion Results revealed motor skill competence had more influence in comparison with perceived motor competence on physical activity level. We suggest interventional programs based on motor skill competence and perceived motor competence should be administered or implemented to promote physical activity in young girls. PMID:26060623

Competency-Based Education: What Is the Issue and Why Does It Matter? Policy Snapshot

ERIC Educational Resources Information Center

Anderson, Lexi

2017-01-01

The increasing need for highly-skilled employees in the workplace has policymakers and higher education leaders focused on innovative ways for students to access postsecondary education. These access points can include online programs, prior learning assessments and, the subject of this snapshot, competency-based education. The National Center for…

Addressing Problems of Professional Competence: Collaborating with University Training Programs to Support Struggling Supervisees

ERIC Educational Resources Information Center

Guiney, Meaghan C.

2018-01-01

As a university-based supervisor (UBS) for school psychology interns, one of the highlights of the author's job is seeing students complete their capstone training experiences and move on to become credentialed, practicing school psychologists. This requires that students demonstrate competence, or the academic, assessment, clinical, ethical, and…

Linking Essential Learning Outcomes and Interprofessional Collaborative Practice Competency in Health Science Undergraduates

ERIC Educational Resources Information Center

Reed, Carole-Rae; Garcia, Luis Ivan; Slusser, Margaret M.; Konowitz, Sharon; Yep, Jewelry

2017-01-01

Assessing student learning outcomes and determining achievement of the Interprofessional Collaborative Practice (IPCEP) Core Competency of Values/Ethics in a generic pre-professional Bachelor of Science in Health Science (BSHS) program is challenging. A course level Student Learning Outcome (SLO) is: "….articulate the impact of personal…

Assessing Cultural and Linguistic Competencies in Doctoral Clinical Psychology Students

ERIC Educational Resources Information Center

Rivero, Rosanna

2017-01-01

The increase of Spanish-speaking populations in the U.S. has resulted in an increased demand for culturally competent, Spanish-speaking mental health providers. Yet, little is known about the methods in which academic programs and clinical training sites are preparing their bilingual students to deliver services in Spanish to the Latino…

Enhanced Requirements for Assessment in a Competency-Based, Time-Variable Medical Education System.

PubMed

Gruppen, Larry D; Ten Cate, Olle; Lingard, Lorelei A; Teunissen, Pim W; Kogan, Jennifer R

2018-03-01

Competency-based, time-variable medical education has reshaped the perceptions and practices of teachers, curriculum designers, faculty developers, clinician educators, and program administrators. This increasingly popular approach highlights the fact that learning among different individuals varies in duration, foundation, and goal. Time variability places particular demands on the assessment data that are so necessary for making decisions about learner progress. These decisions may be formative (e.g., feedback for improvement) or summative (e.g., decisions about advancing a student). This article identifies challenges to collecting assessment data and to making assessment decisions in a time-variable system. These challenges include managing assessment data, defining and making valid assessment decisions, innovating in assessment, and modeling the considerable complexity of assessment in real-world settings and richly interconnected social systems. There are hopeful signs of creativity in assessment both from researchers and practitioners, but the transition from a traditional to a competency-based medical education system will likely continue to create much controversy and offer opportunities for originality and innovation in assessment.

Using student writing assignments to assess critical thinking skills: a holistic approach.

PubMed

Niedringhaus, L K

2001-04-01

This work offers an example of one school's holistic approach to the evaluation of critical thinking by using student writing assignments. Faculty developed tools to assess achievement of critical thinking competencies, such as analysis, synthesis, insight, reflection, open mindedness, and depth, breadth, and appropriateness of clinical interventions. Faculty created a model for the development of program-specific critical thinking competencies, selected appropriate writing assignments that demonstrate critical thinking, and implemented a holistic assessment plan for data collection and analysis. Holistic assessment involves the identification of shared values and practices, and the use of concepts and language important to nursing.

Developing medical students as teachers: an anatomy-based student-as-teacher program with emphasis on core teaching competencies.

PubMed

Andrew Jay, Erie; Starkman, Sidney J; Pawlina, Wojciech; Lachman, Nirusha

2013-01-01

Teaching is an increasingly recognized responsibility of the resident physician. Residents, however, often assume teaching responsibilities without adequate preparation. Consequently, many medical schools have implemented student-as-teacher (SAT) programs that provide near-peer teaching opportunities to senior medical students. Near-peer teaching is widely regarded as an effective teaching modality; however, whether near-peer teaching experiences in medical school prepare students for the teaching demands of residency is less understood. We explored whether the anatomy-based SAT program through the Human Structure didactic block at Mayo Medical School addressed the core teaching competencies of a medical educator and prepared its participants for further teaching roles in their medical careers. A web-based survey was sent to all teaching assistants in the anatomy-based SAT program over the past five years (2007-2011). Survey questions were constructed based on previously published competencies in seven teaching domains--course development, course organization, teaching execution, student coaching, student assessment, teacher evaluation, and scholarship. Results of the survey indicate that participants in the anatomy-based SAT program achieved core competencies of a medical educator and felt prepared for the teaching demands of residency. Copyright © 2013 American Association of Anatomists.

Oncology Nurse Generalist Competencies: Oncology Nursing Society’s Initiative to Establish Best Practice

PubMed

Gaguski, Michele; George, Kim; Bruce, Susan; Brucker, Edie; Leija, Carol; LeFebvre, Kristine; Thompson Mackey, Heather

2017-09-25

A project team was formulated by the Oncology Nursing Society (ONS) to create evidence-based oncology nurse generalist (ONG) competencies to establish best practices in competency development, including high-risk tasks, critical thinking criteria, and measurement of key areas for oncology nurses. This article aims to describe the process and the development of ONG competencies. This article describes how the ONG competencies were accomplished, and includes outcomes and suggestions for use in clinical practice. Institutions can use the ONG competencies to assess and develop competency programs, offer unique educational strategies to measure and appraise proficiency, and establish processes to foster a workplace environment committed to mentoring and teaching future oncology nurses. 2017 Oncology Nursing Society

Assuring dental hygiene clinical competence for licensure: a national survey of dental hygiene program directors.

PubMed

Fleckner, Lucinda M; Rowe, Dorothy J

2015-02-01

To conduct a national survey of dental hygiene program directors to gain their opinions of alternative assessments of clinical competency, as qualifications for initial dental hygiene licensure. A 22 question survey, comprised of statements eliciting Likert-scale responses, was developed and distributed electronically to 341 U.S. dental hygiene program directors. Responses were tabulated and analyzed using University of California, San Francisco Qualtrics® computer software. Data were summarized as frequencies of responses to each item on the survey. The response rate was 42% (n=143). The majority of respondents (65%) agreed that graduating from a Commission on Dental Accreditation (CODA)-approved dental hygiene program and passing the national board examination was the best measure to assure competence for initial licensure. The addition of "successfully completing all program's competency evaluations" to the above core qualifications yielded a similar percentage of agreement. Most (73%) agreed that "the variability of live patients as test subjects is a barrier to standardizing the state and regional examinations," while only 29% agreed that the "use of live patients as test subjects is essential to assure competence for initial licensure." The statement that the one-time state and regional examinations have "low validity in reflecting the complex responsibilities of the dental hygienist in practice" had a high (77%) level of agreement. Most dental hygiene program directors agree that graduating from a CODA-approved dental hygiene program and passing the national board examination would ensure that a graduate has achieved clinical competence and readiness to provide comprehensive patient-centered care as a licensed dental hygienist. Copyright © 2015 The American Dental Hygienists’ Association.

Institutional capacity for health systems research in East and Central Africa schools of public health: enhancing capacity to design and implement teaching programs.

PubMed

Nangami, Mabel N; Rugema, Lawrence; Tebeje, Bosena; Mukose, Aggrey

2014-06-02

The role of health systems research (HSR) in informing and guiding national programs and policies has been increasingly recognized. Yet, many universities in sub-Saharan African countries have relatively limited capacity to teach HSR. Seven schools of public health (SPHs) in East and Central Africa undertook an HSR institutional capacity assessment, which included a review of current HSR teaching programs. This study determines the extent to which SPHs are engaged in teaching HSR-relevant courses and assessing their capacities to effectively design and implement HSR curricula whose graduates are equipped to address HSR needs while helping to strengthen public health policy. This study used a cross-sectional study design employing both quantitative and qualitative approaches. An organizational profile tool was administered to senior staff across the seven SPHs to assess existing teaching programs. A self-assessment tool included nine questions relevant to teaching capacity for HSR curricula. The analysis triangulates the data, with reflections on the responses from within and across the seven SPHs. Proportions and average of values from the Likert scale are compared to determine strengths and weaknesses, while themes relevant to the objectives are identified and clustered to elicit in-depth interpretation. None of the SPHs offer an HSR-specific degree program; however, all seven offer courses in the Master of Public Health (MPH) degree that are relevant to HSR. The general MPH curricula partially embrace principles of competency-based education. Different strengths in curricula design and staff interest in HSR at each SPH were exhibited but a number of common constraints were identified, including out-of-date curricula, face-to-face delivery approaches, inadequate staff competencies, and limited access to materials. Opportunities to align health system priorities to teaching programs include existing networks. Each SPH has key strengths that can be leveraged to design and implement HSR teaching curricula. We propose networking for standardizing HSR curricula competencies, institutionalizing sharing of teaching resources, creating an HSR eLearning platform to expand access, regularly reviewing HSR teaching content to infuse competency-based approaches, and strengthening staff capacity to deliver such curricula.

Institutional capacity for health systems research in East and Central Africa schools of public health: enhancing capacity to design and implement teaching programs

PubMed Central

2014-01-01

Background The role of health systems research (HSR) in informing and guiding national programs and policies has been increasingly recognized. Yet, many universities in sub-Saharan African countries have relatively limited capacity to teach HSR. Seven schools of public health (SPHs) in East and Central Africa undertook an HSR institutional capacity assessment, which included a review of current HSR teaching programs. This study determines the extent to which SPHs are engaged in teaching HSR-relevant courses and assessing their capacities to effectively design and implement HSR curricula whose graduates are equipped to address HSR needs while helping to strengthen public health policy. Methods This study used a cross-sectional study design employing both quantitative and qualitative approaches. An organizational profile tool was administered to senior staff across the seven SPHs to assess existing teaching programs. A self-assessment tool included nine questions relevant to teaching capacity for HSR curricula. The analysis triangulates the data, with reflections on the responses from within and across the seven SPHs. Proportions and average of values from the Likert scale are compared to determine strengths and weaknesses, while themes relevant to the objectives are identified and clustered to elicit in-depth interpretation. Results None of the SPHs offer an HSR-specific degree program; however, all seven offer courses in the Master of Public Health (MPH) degree that are relevant to HSR. The general MPH curricula partially embrace principles of competency-based education. Different strengths in curricula design and staff interest in HSR at each SPH were exhibited but a number of common constraints were identified, including out-of-date curricula, face-to-face delivery approaches, inadequate staff competencies, and limited access to materials. Opportunities to align health system priorities to teaching programs include existing networks. Conclusions Each SPH has key strengths that can be leveraged to design and implement HSR teaching curricula. We propose networking for standardizing HSR curricula competencies, institutionalizing sharing of teaching resources, creating an HSR eLearning platform to expand access, regularly reviewing HSR teaching content to infuse competency-based approaches, and strengthening staff capacity to deliver such curricula. PMID:24888353

Career Assessment, Remediation, Education, Employment, and Re-entry Program (CAREER). El Paso Community College Career Grant. Final Report.

ERIC Educational Resources Information Center

LaFleur, Carol A.

Objectives of the Career Assessment, Remediation, Education, Employment, and Re-entry (CAREER) project were to establish a series of intensive, short-term job training programs using competency-based instruction to serve Hispanic persons who were economically disadvantaged, displaced, unemployed, or underemployed, as well as Hispanic females who…

Assessing Impact of Physical Activity-Based Youth Development Programs: Validation of the "Life Skills Transfer Survey" (LSTS)

ERIC Educational Resources Information Center

Weiss, Maureen R.; Bolter, Nicole D.; Kipp, Lindsay E.

2014-01-01

Purpose: A signature characteristic of positive youth development (PYD) programs is the opportunity to develop life skills, such as social, behavioral, and moral competencies, that can be generalized to domains beyond the immediate activity. Although context-specific instruments are available to assess developmental outcomes, a measure of…

Teaching and clinical educator competency: bringing two worlds together.

PubMed

Robinson, Cathy P

2009-01-01

More sessional clinical educators are being employed in educational institutions today than ever before. Also identified in the literature are issues affecting sessional clinical educators' ability to develop and maintain educator competency. Using the definition of educator competency by the National League for Nursing (NLN 2005a), explored in this paper are ways of increasing sessional clinical educator competency, such as orientation and mentorship programs to support student learning in clinical environments. Approaches in the form of theoretical models designed to evaluate clinical educator competency are examined. A new Sessional Clinical Educator Competency (SCEC) Framework is offered to provide direction for implementing strategies to develop and evaluate sessional clinical educator competency. Suggested is that the SCEC framework could be useful for educational administrators and sessional clinical educators to assess clinical educator competency.

Developing physician-leaders: key competencies and available programs.

PubMed

Stoller, James K

2008-01-01

Because effective leadership is critical to organizational success, frontrunner organizations cultivate leaders for bench depth and pipeline development. The many challenges in healthcare today create a special need for great leadership. This paper reviews the leadership competencies needed by physician-leaders and current experience with developing physician-leaders in healthcare institution-sponsored programs. On the basis of this review, six key leadership competency domains are proposed: 1. technical skills and knowledge (regarding operational, financial, and information systems, human resources, and strategic planning), 2. industry knowledge (e.g., regarding clinical processes, regulation, and healthcare trends), 3. problem-solving skills, 4. emotional intelligence, 5. communication, and 6. a commitment to lifelong learning. Review of current experience indicates that, in addition to leadership training through degree and certificate-granting programs (e.g., by universities and/or official medical societies), healthcare institutions themselves are developing intramural programs to cultivate physician-leaders. Greater attention is needed to assessing the impact and effectiveness of such programs in developing leaders and benefiting organizational outcomes.

Prenatal consultation: perspectives on training, relevance, and utilization among pediatric subspecialty program directors.

PubMed

Danziger, Phoebe; Laventhal, Naomi

2018-05-08

To characterize the experience and training of house officers in prenatal consultation, and to assess program directors' perceptions regarding adequacy of training, and relevance and utilization of prenatal consultation in their field. An online survey was distributed to program directors of all ACGME-accredited programs in the United States in relevant pediatric subspecialties. Ninety-five percent (142/150) of respondents agreed that prenatal consultation from their field can impact decision-making, yet 46% (69/149) believe their prenatal consult services are underutilized. The majority (56%, 86/152) reported no formal curriculum related to prenatal consultation in their program. Nine percent (14/150) rated their trainees as not adequately trained to perform competent prenatal consultation upon graduation; 35% (52/150) rated trainees as only "somewhat" competent. Our study, the first of its kind, reveals widespread lack of formal training curricula, which may explain the finding that many graduating trainees are perceived as inadequately prepared to perform competent prenatal consultation.

Toward Defining, Measuring, and Evaluating LGBT Cultural Competence for Psychologists

PubMed Central

Boroughs, Michael S.; Andres Bedoya, C.; O'Cleirigh, Conall; Safren, Steven A.

2015-01-01

A central part of providing evidence-based practice is appropriate cultural competence to facilitate psychological assessment and intervention with diverse clients. At a minimum, cultural competence with lesbian, gay, bisexual, and transgender (LGBT) people involves adequate scientific and supervised practical training, with increasing depth and complexity across training levels. In order to further this goal, we offer 28 recommendations of minimum standards moving toward ideal training for LGBT-specific cultural competence. We review and synthesize the relevant literature to achieve and assess competence across the various levels of training (doctoral, internship, post-doctoral, and beyond) in order to guide the field towards best practices. These recommendations are aligned with educational and practice guidelines set forth by the field and informed by other allied professions in order to provide a roadmap for programs, faculty, and trainees in improving the training of psychologists to work with LGBT individuals. PMID:26279609

An objective structured clinical exam to measure intrinsic CanMEDS roles.

PubMed

Kassam, Aliya; Cowan, Michèle; Donnon, Tyrone

2016-01-01

Background The CanMEDS roles provide a comprehensive framework to organize competency-based curricula; however, there is a challenge in finding feasible, valid, and reliable assessment methods to measure intrinsic roles such as Communicator and Collaborator. The objective structured clinical exam (OSCE) is more commonly used in postgraduate medical education for the assessment of clinical skills beyond medical expertise. Method We developed the CanMEDS In-Training Exam (CITE), a six-station OSCE designed to assess two different CanMEDS roles (one primary and one secondary) and general communication skills at each station. Correlation coefficients were computed for CanMEDS roles within and between stations, and for general communication, global rating, and total scores. One-way analysis of variance (ANOVA) was used to investigate differences between year of residency, sex, and the type of residency program. Results In total, 63 residents participated in the CITE; 40 residents (63%) were from internal medicine programs, whereas the remaining 23 (37%) were pursuing other specialties. There was satisfactory internal consistency for all stations, and the total scores of the stations were strongly correlated with the global scores r=0.86, p<0.05. Noninternal medicine residents scored higher in terms of the Professional competency overall, whereas internal medicine residents scored significantly higher in the Collaborator competency overall. Discussion The OSCE checklists developed for the assessment of intrinsic CanMEDS roles were functional, but the specific items within stations required more uniformity to be used between stations. More generic types of checklists may also improve correlations across stations. Conclusion An OSCE measuring intrinsic competence is feasible; however, further development of our cases and checklists is needed. We provide a model of how to develop an OSCE to measure intrinsic CanMEDS roles that educators may adopt as residency programs move into competency-based medical education.

Process for Mapping Global Health Competencies in Undergraduate and Graduate Nursing Curricula.

PubMed

Dawson, Martha; Gakumo, C Ann; Phillips, Jennan; Wilson, Lynda

2016-01-01

Determining the extent to which existing nursing curricula prepare students to address global health issues is a critical step toward ensuring competence to practice in an increasingly globalized world. This article describes the process used by nursing faculty at a public university in the southern United States to assess the extent to which global health competencies for nurses were being addressed across nursing programs. Steps used and lessons learned throughout this process are discussed.

Intellectual Skills Development Program. Annual Report, 1986-1987.

ERIC Educational Resources Information Center

McCauley, Lynne

The 1986-1987 annual report on the Intellectual Skills Development Program (ISDP) at Western Michigan University is presented. The program is designed to identify new students who do not meet entry-level competencies in reading, writing, and mathematics, and to provide academic support for these students. In reviewing assessment policies and…

Perspective of ophthalmology residents in the United States about residency programs and competency in relation to the International Council of Ophthalmology guidelines.

PubMed

Abdelfattah, Nizar Saleh; Radwan, Ahmed E; Sadda, Srinivas R

2016-09-01

To evaluate the perspective of ophthalmology residents in the US about their residency programs and compare the competency of residency programs to international competency levels set by the International Council of Ophthalmology (ICO). A cross-sectional web-based survey extracted from the ICO published competency standards was sent to program directors of ophthalmology residency programs in the US to forward it to current PGY-3, 4 residents, and residency graduates from 2011 to 2014. Eighty-seven responses were received, comprising 61 residents and 26 graduates. Most respondents were highly satisfied with their programs (93.6%). Clinic-based training was rated satisfactorily. Insufficient exposure to low-vision rehabilitation (38.5%), refraction and contact lenses prescription (38.5%), and vitreo-retinal surgeries (38.5%) was reported. Respondents were satisfied with their overall surgical experiences, with the vast majority (>83%) rating case volume, complexity, and variety as satisfactory or better. A significant group stated they had insufficient exposure to extra-capsular cataract extraction (26.3%), refractive surgery (19.7%), and orbital surgery (64.5%). All graduates surveyed passed their Ophthalmic Knowledge Assessment Program (OKAP) examinations, and 72% felt their residency programs adequately prepared them for the examinations. All respondents reported insufficient training in certain nonclinical areas, such as practice management, staffing, and administration skills. Ophthalmology residents in the US express high levels of satisfaction with their residency training programs. While most programs adequately address most ICO core objectives, certain curriculum modifications should be considered.

Outcomes Assessment of Computer-Assisted Behavioral Objectives for Accounting Graduates.

ERIC Educational Resources Information Center

Moore, John W.; Mitchem, Cheryl E.

1997-01-01

Presents behavioral objectives for accounting students and an outcomes assessment plan with five steps: (1) identification and definition of student competencies; (2) selection of valid instruments; (3) integration of assessment and instruction; (4) determination of levels of assessment; and (5) attribution of improvements to the program. (SK)

Family Medicine Maternity Care Call to Action: Moving Toward National Standards for Training and Competency Assessment.

PubMed

Magee, Susanna R; Eidson-Ton, W Suzanne; Leeman, Larry; Tuggy, Michael; Kim, Thomas O; Nothnagle, Melissa; Breuner, Joseph; Loafman, Mark

2017-03-01

Maternity care is an integral part of family medicine, and the quality and cost-effectiveness of maternity care provided by family physicians is well documented. Considering the population health perspective, increasing the number of family physicians competent to provide maternity care is imperative, as is working to overcome the barriers discouraging maternity care practice. A standard that clearly defines maternity care competency and a systematic set of tools to assess competency levels could help overcome these barriers. National discussions between 2012 and 2014 revealed that tools for competency assessment varied widely. These discussions resulted in the formation of a workgroup, culminating in a Family Medicine Maternity Care Summit in October 2014. This summit allowed for expert consensus to describe three scopes of maternity practice, draft procedural and competency assessment tools for each scope, and then revise the tools, guided by the Family Medicine and OB/GYN Milestones documents from the respective residency review committees. The summit group proposed that achievement of a specified number of procedures completed should not determine competency; instead, a standardized competency assessment should take place after a minimum number is performed. The traditionally held required numbers for core procedures were reassessed at the summit, and the resulting consensus opinion is proposed here. Several ways in which these evaluation tools can be disseminated and refined through the creation of a learning collaborative across residency programs is described. The summit group believed that standardization in training will more clearly define the competencies of family medicine maternity care providers and begin to reduce one of the barriers that may discourage family physicians from providing maternity care.

Social Competence and Social Skills Training and Intervention for Children with Autism Spectrum Disorders

ERIC Educational Resources Information Center

Cotugno, Albert J.

2009-01-01

This study examined the effectiveness of a 30 week social competence and social skills group intervention program with children, ages 7-11, diagnosed with Autism Spectrum Disorders (ASD). Eighteen children with ASD were assessed with pretreatment and posttreatment measures on the Walker-McConnell Scale (WMS) and the MGH YouthCare Social Competence…

Development of a Tool to Assess Resident Physicians' Perceived Competence for Patient-Centered Obesity Counseling

ERIC Educational Resources Information Center

Burton, Amy M.; Brezausek, Carl M.; Hendricks, Peter S.; Agne, April A.; Hankins, Shirley L.; Cherrington, Andrea L.

2015-01-01

Physicians report a number of barriers to obesity counseling, among them low perceived competence in the ability to counsel. While there is increasing recognition of the need for resident training on counseling, implementation requires residency programs to have the necessary curricula and tools to evaluate training effectiveness. This study's…

Assessing Intercultural Competence as a Result of Internationalization at Home Efforts: A Case Study From the Nightingale Mentoring Program

ERIC Educational Resources Information Center

Prieto-Flores, Òscar; Feu, Jordi; Casademont, Xavier

2016-01-01

In the last decades, many higher education institutions have developed practices of internationalization of curricula aiming at developing intercultural competences among the non-mobile majority of students. Some of them have developed service-learning activities focusing on working with underserved communities from different cultures. This…

Group Training of Applied Behavior Analysis (ABA) Knowledge Competencies to Community-Based Service Providers for Adults with Developmental Disabilities

ERIC Educational Resources Information Center

Luiselli, James K.; St. Amand, CarrieAnne; MaGee, Christine; Sperry, James M.

2008-01-01

We describe a training program to teach applied behavior analysis (ABA) knowledge competencies to paraprofessional staff (N = 47) at a habilitation services agency for adults with developmental disabilities. Before and following training, staff completed assessment of knowledge tests for three content areas: basic learning principles,…

Putting the pediatrics milestones into practice: a consensus roadmap and resource analysis.

PubMed

Schumacher, Daniel J; Spector, Nancy D; Calaman, Sharon; West, Daniel C; Cruz, Mario; Frohna, John G; Gonzalez Del Rey, Javier; Gustafson, Kristina K; Poynter, Sue Ellen; Rosenbluth, Glenn; Southgate, W Michael; Vinci, Robert J; Sectish, Theodore C

2014-05-01

The Accreditation Council for Graduate Medical Education has partnered with member boards of the American Board of Medical Specialties to initiate the next steps in advancing competency-based assessment in residency programs. This initiative, known as the Milestone Project, is a paradigm shift from traditional assessment efforts and requires all pediatrics residency programs to report individual resident progression along a series of 4 to 5 developmental levels of performance, or milestones, for individual competencies every 6 months beginning in June 2014. The effort required to successfully make this shift is tremendous given the number of training programs, training institutions, and trainees. However, it holds great promise for achieving training outcomes that align with patient needs; developing a valid, reliable, and meaningful way to track residents' development; and providing trainees with a roadmap for learning. Recognizing the resources needed to implement this new system, the authors, all residency program leaders, provide their consensus view of the components necessary for implementing and sustaining this effort, including resource estimates for completing this work. The authors have identified 4 domains: (1) Program Review and Development of Stakeholders and Participants, (2) Assessment Methods and Validation, (3) Data and Assessment System Development, and (4) Summative Assessment and Feedback. This work can serve as a starting point and framework for collaboration with program, department, and institutional leaders to identify and garner necessary resources and plan for local and national efforts that will ensure successful transition to milestones-based assessment. Copyright © 2014 by the American Academy of Pediatrics.

Anthropometric Training Project. Final Report.

ERIC Educational Resources Information Center

San Diego State Coll., CA.

The Anthropometric Training Project was aimed at providing a training program for select students to develop research competency in an area relating body type, composition, anthropometric assessment, and physical performance measures. The program involves interdisciplinary cooperation in training through seminars, laboratory practice, and…

Concurrent Validity of the Strength-Based "Behavioral Objective Sequence"

ERIC Educational Resources Information Center

Wilder, Lynn K.; Braaten, Sheldon; Wilhite, Kathi; Algozzine, Bob

2006-01-01

An essential task of diagnosticians is the accurate assessment of behavioral skills. Traditionally, deficit-based behavioral assessments have underscored student social skill deficits. Strength-based assessments delineate student competencies and are useful for individualized education program (IEP) and behavioral intervention plan (BIP)…

Status of Microsurgical Simulation Training in Plastic Surgery: A Survey of United States Program Directors.

PubMed

Al-Bustani, Saif; Halvorson, Eric G

2016-06-01

Various simulation models for microsurgery have been developed to overcome the limitations of Halstedian training on real patients. We wanted to assess the status of microsurgery simulation in plastic surgery residency programs in the United States. Data were analyzed from responses to a survey sent to all plastic surgery program directors in the United States, asking for type of simulation, quality of facilities, utilization by trainees, evaluation of trainee sessions, and perception of the relevance of simulation. The survey response rate was 50%. Of all programs, 69% provide microsurgical simulation and 75% of these have a laboratory with microscope and 52% provide live animal models. Half share facilities with other departments. The quality of facilities is rated as good or great in 89%. Trainee utilization is once every 3 to 6 months in 82% of programs. Only in 11% is utilization monthly. Formal evaluation of simulation sessions is provided by 41% of programs. All program directors agree simulation is relevant to competence in microsurgery, 60% agree simulation should be mandatory, and 43% require trainees to complete a formal microsurgery course prior to live surgery. There seems to be consensus that microsurgical simulation improves competence, and the majority of program directors agree it should be mandatory. Developing and implementing standardized simulation modules and assessment tools for trainees across the nation as part of a comprehensive competency-based training program for microsurgery is an important patient safety initiative that should be considered. Organizing with other departments to share facilities may improve their quality and hence utilization.

Workplace based assessment: a step to promote competency based postgraduate training.

PubMed

Singh, Tejinder; Modi, Jyoti Nath

2013-06-08

There has been an increasing emphasis on defining outcomes of medical education in terms of performance of trainees. This is a step beyond the description of outcomes in terms of competence that encompasses mostly potential abilities rather than the actual performance. The contextual adaptations and behavior judgments of the trainees are best assessed by a program of in-training assessment. Workplace based assessment (WPBA) is one of the modalities, which assesses the trainee in authentic settings. Though Postgraduate (PG) medical training in India is said to be competency-based, most institutions do not have any formative or in-training assessment program for the same. The two cardinal elements of WPBA are direct observation and conducted in work place in addition to provision of feedback to the trainee. The WPBA conforms to the highest (Level 4: Does) of Millers pyramid and also has the potential to assess at all four levels. Some of the tools used for WPBA are: Logbooks, Clinical Encounter Cards (CEC), mini-Clinical Evaluation Exercise (mini-CEX), Case based discussions, Direct Observation of Procedural Skills (DOPS), Multisource feedback (peers, co-workers, seniors, patients) etc. These can be documented in the form of a portfolio that provides a longitudinal view of experiences and progress of the trainee. The WPBA scores high on validity and educational impact by virtue of being based on direct observation in real situation and contextual feedback. The feasibility and acceptability is enhanced by making appropriate choices of tools, advance planning, building of mutual trust, and training of assessors. Given the established benefits of WPBA in shaping clinical learning, there is an imminent need for including this mode of assessment in our clinical training programs especially PG training.

Core Professionalism Education in Surgery: A Systematic Review.

PubMed

Sarıoğlu Büke, Akile; Karabilgin Öztürkçü, Özlem Sürel; Yılmaz, Yusuf; Sayek, İskender

2018-03-15

Professionalism education is one of the major elements of surgical residency education. To evaluate the studies on core professionalism education programs in surgical professionalism education. Systematic review. This systematic literature review was performed to analyze core professionalism programs for surgical residency education published in English with at least three of the following features: program developmental model/instructional design method, aims and competencies, methods of teaching, methods of assessment, and program evaluation model or method. A total of 27083 articles were retrieved using EBSCOHOST, PubMed, Science Direct, Web of Science, and manual search. Eight articles met the selection criteria. The instructional design method was presented in only one article, which described the Analysis, Design, Development, Implementation, and Evaluation model. Six articles were based on the Accreditation Council for Graduate Medical Education criterion, although there was significant variability in content. The most common teaching method was role modeling with scenario- and case-based learning. A wide range of assessment methods for evaluating professionalism education were reported. The Kirkpatrick model was reported in one article as a method for program evaluation. It is suggested that for a core surgical professionalism education program, developmental/instructional design model, aims and competencies, content, teaching methods, assessment methods, and program evaluation methods/models should be well defined, and the content should be comparable.

Milestones: a rapid assessment method for the Clinical Competency Committee

PubMed Central

Nabors, Christopher; Forman, Leanne; Peterson, Stephen J.; Gennarelli, Melissa; Aronow, Wilbert S.; DeLorenzo, Lawrence; Chandy, Dipak; Ahn, Chul; Sule, Sachin; Stallings, Gary W.; Khera, Sahil; Palaniswamy, Chandrasekar; Frishman, William H.

2016-01-01

Introduction Educational milestones are now used to assess the developmental progress of all U.S. graduate medical residents during training. Twice annually, each program’s Clinical Competency Committee (CCC) makes these determinations and reports its findings to the Accreditation Council for Graduate Medical Education (ACGME). The ideal way to conduct the CCC is not known. After finding that deliberations reliant upon the new milestones were time intensive, our internal medicine residency program tested an approach designed to produce rapid but accurate assessments. Material and methods For this study, we modified our usual CCC process to include pre-meeting faculty ratings of resident milestones progress with in-meeting reconciliation of their ratings. Data were considered largely via standard report and presented in a pre-arranged pattern. Participants were surveyed regarding their perceptions of data management strategies and use of milestones. Reliability of competence assessments was estimated by comparing pre-/post-intervention class rank lists produced by individual committee members with a master class rank list produced by the collective CCC after full deliberation. Results Use of the study CCC approach reduced committee deliberation time from 25 min to 9 min per resident (p < 0.001). Committee members believed milestones improved their ability to identify and assess expected elements of competency development (p = 0.026). Individual committee member assessments of trainee progress agreed well with collective CCC assessments. Conclusions Modification of the clinical competency process to include pre-meeting competence ratings with in-meeting reconciliation of these ratings led to shorter deliberation times, improved evaluator satisfaction and resulted in reliable milestone assessments. PMID:28144272

Development of a competency framework for nurse managers in Ireland.

PubMed

McCarthy, Geraldine; Fitzpatrick, Joyce J

2009-08-01

This article describes the results of an Irish national study on the Competency Model for Nursing Management commissioned by the Office of Health Management. More than 300 nurse managers and 80 service stakeholders (other professionals, managers, and service colleagues) participated in the development of generic competencies for nurse managers and specific competencies for three levels of managers-director level, middle manager level, and front-line managers. Examples of behavioral indicators (both positive and negative) for each competency level also have been delineated. Future efforts are being directed toward evaluating the usefulness of the competency model for assessing readiness to manage among job applicants, implementation of continuing education programs for nurse managers, and overall career development and planning. Copyright 2009, SLACK Incorporated.

Promoting medical competencies through international exchange programs: benefits on communication and effective doctor-patient relationships.

PubMed

Jacobs, Fabian; Stegmann, Karsten; Siebeck, Matthias

2014-03-04

Universities are increasingly organizing international exchange programs to meet the requirements of growing globalisation in the field of health care. Analyses based on the programs' fundamental theoretical background are needed to confirm the learning value for participants. This study investigated the extent of sociocultural learning in an exchange program and how sociocultural learning affects the acquisition of domain-specific competencies. Sociocultural learning theories were applied to study the learning effect for German medical students from the LMU Munich, Munich, Germany, of participation in the medical exchange program with Jimma University, Jimma, Ethiopia. First, we performed a qualitative study consisting of interviews with five of the first program participants. The results were used to develop a questionnaire for the subsequent, quantitative study, in which 29 program participants and 23 matched controls performed self-assessments of competencies as defined in the Tuning Project for Health Professionals. The two interrelated studies were combined to answer three different research questions. The participants rated their competence significantly higher than the control group in the fields of doctor-patient relationships and communication in a medical context. Participant responses in the two interrelated studies supported the link between the findings and the suggested theoretical background. Overall, we found that the exchange program affected the areas of doctor-patient relationships and effective communication in a medical context. Vygotsky's sociocultural learning theory contributed to explaining the learning mechanisms of the exchange program.

A competency framework for colonoscopy training derived from cognitive task analysis techniques and expert review.

PubMed

Zupanc, Christine M; Burgess-Limerick, Robin; Hill, Andrew; Riek, Stephan; Wallis, Guy M; Plooy, Annaliese M; Horswill, Mark S; Watson, Marcus O; Hewett, David G

2015-12-01

Colonoscopy is a difficult cognitive-perceptual-motor task. Designing an appropriate instructional program for such a task requires an understanding of the knowledge, skills and attitudes underpinning the competency required to perform the task. Cognitive task analysis techniques provide an empirical means of deriving this information. Video recording and a think-aloud protocol were conducted while 20 experienced endoscopists performed colonoscopy procedures. "Cued-recall" interviews were also carried out post-procedure with nine of the endoscopists. Analysis of the resulting transcripts employed the constant comparative coding method within a grounded theory framework. The resulting draft competency framework was modified after review during semi-structured interviews conducted with six expert endoscopists. The proposed colonoscopy competency framework consists of twenty-seven skill, knowledge and attitude components, grouped into six categories (clinical knowledge; colonoscope handling; situation awareness; heuristics and strategies; clinical reasoning; and intra- and inter-personal). The colonoscopy competency framework provides a principled basis for the design of a training program, and for the design of formative assessment to gauge progress towards attaining the knowledge, skills and attitudes underpinning the achievement of colonoscopy competence.

[Assessment of competence in pediatric postgraduate education: implementation of a pediatric version of the Mini-Cex].

PubMed

Urman, Gabriela; Folgueral, Silvana; Gasparri, Mercedes; López, Diana; Urman, Jorge; Grosman, Arnoldo; Alves de Lima, Alberto

2011-12-01

Faced with the increased challenge of assessing competences in young doctors, the purpose of the study was to evaluate the implementation of a pediatric version of the Mini-Cex in pediatric trainees as well as the level of satisfaction of teachers and students with the new assessment tool. From July 2007 to August 2009, 54 pediatric trainees were periodically monitored in a variety of clinical settings by 50 teachers. The competences evaluated included medical interviewing, physical examination and counseling skills, humanistic qualities/ professionalism, clinical judgment, organization and overall clinical competence. The feasibility of this study was defined as an average 4 observations per participant, and observations in all clinical rotations. During the study, 388 observations were carried over 54 students (average of 7.18 observations per student); 57% took place in ambulatory settings, 60% were of low complexity and 85% involved healthy children programmed consultations. The ratings for specific competences had little variation; the focus related to the setting. Used in a variety of settings, with different patient problems, the method was well accepted by both students and teachers.

Emotional Intelligence and the ACGME Competencies.

PubMed

Webb, Anita R; Young, Richard A; Baumer, Joane G

2010-12-01

Residency programs desire assessment tools for teaching and measuring resident attainment of the Accreditation Council for Graduate Medical Education competencies, including interpersonal and communication skills. We sought to evaluate the use of emotional intelligence (EI) assessment and training tools in assessing and enhancing interpersonal and communication skills. We used a quasi-experimental design, with an intervention and control group composed of 1 class each of family medicine residents. The intervention was EI coaching. The assessment used the Emotional and Social Competence Inventory, a 360-degree EI survey consisting of self and other (colleague) ratings for 12 EI competencies. There were 21 participants in each of the 3 assessments (test, posttest, and control). Our EI coaching intervention had very limited participation due to a lack of protected time for EI coaching and residents' competing obligations. Return rates for self surveys were 86% to 91% and 66% to 68% for others. On all 3 trials, ratings by others were significantly higher than self ratings for every competence (range, P < .001-.045). None of the self ratings by the intervention group increased significantly for any of the competencies. None of the intervention group self ratings increased significantly on posttesting, whereas ratings by others increased significantly for coach/mentor (P < .001). The teamwork rating decreased significantly on both self and other ratings (P < .001). Achievement orientation was the highest intervention group posttest rating, and teamwork was the lowest. EI is a necessary skill in today's health care environment, and our study found that a tool from another sector was useful in assessing resident EI skills. Because our EI coaching intervention was unsuccessful, the effects of coaching on interpersonal and communication skills could not be assessed.

Research of Curriculum Content, Data Processing Program. Final Report.

ERIC Educational Resources Information Center

Stoehr, Keith; And Others

A study was conducted to assess the relationship between data processing competencies taught in Wisconsin Vocational, Technical, and Adult Education District Data Processing programs and on-the-job demands, as a basis for curriculum review and revision. A sample of program graduates, their employers, and instructors were asked to rate 75…

Factors Associated with Teacher Delivery of a Classroom-Based Tier 2 Prevention Program.

PubMed

Sutherland, Kevin S; Conroy, Maureen A; McLeod, Bryce D; Algina, James; Kunemund, Rachel L

2018-02-01

Teachers sometimes struggle to deliver evidence-based programs designed to prevent and ameliorate chronic problem behaviors of young children with integrity. Identifying factors associated with variations in the quantity and quality of delivery is thus an important goal for the field. This study investigated factors associated with teacher treatment integrity of BEST in CLASS, a tier-2 prevention program designed for young children at risk for developing emotional/behavioral disorders. Ninety-two early childhood teachers and 231 young children at-risk for emotional/behavioral disorders participated in the study. Latent growth curve analyses indicated that both adherence and competence of delivery increased across six observed time points. Results suggest that teacher education and initial levels of classroom quality may be important factors to consider when teachers deliver tier-2 (i.e., targeted to children who are not responsive to universal or tier-1 programming) prevention programs in early childhood settings. Teachers with higher levels of education delivered the program with more adherence and competence initially. Teachers with higher initial scores on the Emotional Support subscale of the Classroom Assessment Scoring System (CLASS) delivered the program with more competence initially and exhibited higher growth in both adherence and competence of delivery across time. Teachers with higher initial scores on the Classroom Organization subscale of the CLASS exhibited lower growth in adherence across time. Contrary to hypotheses, teacher self-efficacy did not predict adherence, and teachers who reported higher initial levels of Student Engagement self-efficacy exhibited lower growth in competence of delivery. Results are discussed in relation to teacher delivery of evidence-based programs in early childhood classrooms.

Graduate medical education competencies for international health electives: A qualitative study.

PubMed

Nordhues, Hannah C; Bashir, M Usmaan; Merry, Stephen P; Sawatsky, Adam P

2017-11-01

Residency programs offer international health electives (IHEs), providing multiple educational benefits. This study aimed to identify how IHEs fulfill the Accreditation Council for Graduate Medical Education (ACGME) core competencies. We conducted a thematic analysis of post-rotation reflective reports from residents who participated in IHEs through the Mayo International Health Program. We coded reports using a codebook created from the ACGME competencies. Using a constant comparative method, we identified significant themes within each competency. Residents from 40 specialties participated in 377 IHEs in 56 countries from 2001 to 2014. Multiple themes were identified within each of the six ACGME core competencies: Patient Care and Procedural Skills (4), Medical Knowledge (5), Practice-Based Learning and Improvement (3), Interpersonal and Communication Skills (5), Professionalism (4), and Systems-Based Practice and Improvement (3). Themes included improving physical exam and procedural skills, providing care in resource-limited setting, gaining knowledge of tropical and non-tropical diseases, identifying socioeconomic determinants of health, engaging in the education of others, and increasing communication across cultures and multidisciplinary teams. Through IHEs, residents advanced their knowledge, skills, and attitudes in each of the six ACGME competencies. These data can be used for development of IHE competencies and milestones for resident assessment.

Environmental health training: a survey of family practice residency program directors.

PubMed

Musham, C; Bellack, J P; Graber, D R; Holmes, D

1996-01-01

The Institute of Medicine and the American College of Physicians have advocated that physicians broaden their participation in the environmental aspects of medical care. Accordingly, both organizations recommend training of future primary care physicians for greater competency in and appreciation of this area of medicine. This study assessed the present emphasis on environmental health in family practice residency programs by examining the extent program directors expect graduates to have specific competencies in environmental medicine. A written survey was mailed to directors of all 393 family practice residency programs listed in the 1993 Directory of Family Practice Residency Programs. Respondents were asked to indicate the extent to which each of eight environmental health competencies was expected of their graduates. The list of environmental health competencies was based on the literature and on interviews with family practice educators. Perceptions about the "present" and "ideal" environmental health emphasis in their programs were also measured. A total of 262 completed surveys were returned for a response rate of 67%. Respondents reported that they expected their graduates to have general knowledge of and competence in environmental health areas that pertain to patient care. Competencies with social and political implications were least likely to be expected. Two thirds of respondents indicated that "minimal emphasis" is presently placed on environmental health. Seventy percent indicated that the "ideal" amount of emphasis placed on this topic is "moderate." This survey's results suggest that family practice residency program directors expect their graduates to know basic environmental health concepts and be skilled in related aspects of patient care. The development of environmental health training programs must take into account that environmental health may be viewed as a topic of secondary importance and that in most residencies, faculty expertise in this area is limited. For this reason, a self-tutoring strategy, aimed toward the educational needs of both faculty and residents, is recommended.

Program director and resident perspectives of a competency-based medical education anesthesia residency program in Canada: a needs assessment

PubMed Central

2016-01-01

Purpose: In July 2015, the University of Ottawa introduced a competency-based medical education (CBME) postgraduate program for anesthesia. Prior to program implementation, this study aimed to identify Canadian anesthesiology program directors perceptions of CBME and residents’ opinion on how the program should be designed and perceived consequences of CBME. Methods: This two-phase, qualitative study included semi-structured interviews with Canadian anesthesia program directors (Phase I) and a focus group interview with residents enrolled in the University of Ottawa time-based anesthesia program (Phase II). Both phases sought to gauge participant’s perceptions of CBME. Interviews were recorded, transcribed verbatim and thematically analyzed. Results: Data was combined to protect anonymity of the six participants (three program directors and three residents). Participants spoke about the perceived advantages of CBME, the need to establish definitions, and challenges to a CBME program highlighting logistical factors, implications for trainees and the role assessment plays in CBME. Conclusion: These findings will inform CBME implementation strategies in anesthesia programs across the country, and may assist other residency programs in the design of their programs. Furthermore, our findings may help identify potential challenges and issues that other postgraduate specialties may face as they transition to a CBME model. PMID:26913772

Assessing medical students' performance in core competencies using multiple admission programs for colleges and universities: from the perspective of multi-source feedback.

PubMed

Fang, Ji-Tseng; Ko, Yu-Shien; Chien, Chu-Chun; Yu, Kuang-Hui

2013-01-01

Since 1994, Taiwanese medical universities have employed the multiple application method comprising "recommendations and screening" and "admission application." The purpose of this study is to examine whether medical students admitted using different admission programs gave different performances. To evaluate the six core competencies for medical students proposed by Accreditation Council for Graduate Medical Education (ACGME), this study employed various assessment tools, including student opinion feedback, multi-source feedback (MSF), course grades, and examination results.MSF contains self-assessment scale, peer assessment scale, nursing staff assessment scale, visiting staff assessment scale, and chief resident assessment scale. In the subscales, the CronbachÊs alpha were higher than 0.90, indicating good reliability. Research participants consisted of 182 students from the School of Medicine at Chang Gung University. Regarding studentsÊ average grade for the medical ethics course, the performance of students who were enrolled through school recommendations exceeded that of students who were enrolled through the National College University Entrance Examination (NCUEE) p = 0.011), and all considered "teamwork" as the most important. Different entry pipelines of students in the "communication," "work attitude," "medical knowledge," and "teamwork" assessment scales showed no significant difference. The improvement rate of the students who were enrolled through the school recommendations was better than that of the students who were enrolled through the N CUEE in the "professional skills," "medical core competencies," "communication," and "teamwork" projects of self-assessment and peer assessment scales. However, the students who were enrolled through the NCUEE were better in the "professional skills," "medical core competencies," "communication," and "teamwork" projects of the visiting staff assessment scale and the chief resident assessment scale. Collectively, the performance of the students enrolled through recommendations was slightly better than that of the students enrolled through the NCUEE, although statistical significance was found in certain parts of the grades only.

Personal characteristics of residents may predict competency improvement.

PubMed

Park, EunMi; Ha, Patrick K; Eisele, David W; Francis, Howard W; Kim, Young J

2016-08-01

We hypothesized that personal characteristics of residents may affect how well competency is attained in a surgical residency. To this end, we examined two concepts of global trait emotional intelligence and learner autonomy profile and their factor relationship with competency outcomes in a residency program in otolaryngology-head and neck surgery. A cohort study prospectively gathered competency change scores for 1 year and retrospectively analyzed the factor associations. We measured two personal characteristics using the Trait Emotional Intelligence Questionnaire-Short Form and Learner Autonomy Profile-Short Form between 2013 and 2014 in a tertiary otolaryngology-head and neck residency program. We prospectively examined faculty-rated resident competency scores monitored in the same time period and correlated the personal attributes with cumulative competency improvement scores. Statistical analyses included factor correlations and univariate regression. With a response rate of 64% (N = 16/25), we identified two statically significant predictors of competency improvement outcome attained by the end of the year. Regression analyses showed that emotionality factor of global trait emotional intelligence (P = .04) and learner autonomy profile (P < .01) were significant predictors for the higher improvement of aggregate competency outcome. Personal factors of individual residents can affect their improvement of overall competency. Practicing competency-based education should, therefore, include assessing individual resident factors as well as teaching clinical knowledge and technical skills. NA Laryngoscope, 126:1746-1752, 2016. © 2015 The American Laryngological, Rhinological and Otological Society, Inc.

Development of a web-based, specialty specific portfolio.

PubMed

Clay, A S; Petrusa, E; Harker, M; Andolsek, K

2007-05-01

This article illustrates the creation of a specialty specific portfolio that can be used by several different residency programs to document resident competence during a given rotation. Three different disciplines (anesthesiology, surgery and medicine) worked together to create a critical care medicine portfolio. We began by reviewing the curriculum requirements for critical care medicine and organized these requirements into the six ACGME core competencies. We then developed learner led exercises in each core competency that were specific to critical care. Each exercise includes assessment of resident knowledge and application, an evaluation of the exercise, a learner self-assessment of skill, and a review of performance by a faculty member. Portfolio entries are highlighted in a multi-disciplinary weekly conference and posted on a critical care web site at our University. Creation of specialty specific portfolio reduces redundancy between disciplines, allows for increased time to be spent on the development of exercises specific to rotation objectives, and aids program directors in the collection of portfolio entries for each resident over the course of a residency.

Predictors of Acquisition of Competitive Employment for People Enrolled in Supported Employment Programs.

PubMed

Corbière, Marc; Lecomte, Tania; Reinharz, Daniel; Kirsh, Bonnie; Goering, Paula; Menear, Matthew; Berbiche, Djamal; Genest, Karine; Goldner, Elliot M

2017-04-01

This study aims at assessing the relative contribution of employment specialist competencies working in supported employment (SE) programs and client variables in determining the likelihood of obtaining competitive employment. A total of 489 persons with a severe mental illness and 97 employment specialists working in 24 SE programs across three Canadian provinces were included in the study. Overall, 43% of the sample obtained competitive work. Both client variables and employment specialist competencies, while controlling for the quality of SE programs implementation, predicted job acquisition. Multilevel analyses further indicated that younger client age, shorter duration of unemployment, and client use of job search strategies, as well as the working alliance perceived by the employment specialist, were the strongest predictors of competitive employment for people with severe mental illness, with 51% of variance explained. For people with severe mental illness seeking employment, active job search behaviors, relational abilities, and employment specialist competencies are central contributors to acquisition of competitive employment.

Building Collaboration: A Scoping Review of Cultural Competency and Safety Education and Training for Healthcare Students and Professionals in Canada.

PubMed

Guerra, Olivia; Kurtz, Donna

2017-01-01

Phenomenon: This scoping literature review summarizes current Canadian health science education and training aimed to lessen health gaps between Aboriginal and non-Aboriginal peoples. Keyword searches of peer-reviewed and gray literature databases, websites, and resources recommended by local Aboriginal community members identified 1,754 resources. Using specific inclusion and exclusion criteria, 26 resources relevant to education and training of healthcare professionals and students in Canada were selected. Information included self-assessment for cultural competency/safety skills, advocacy within Canadian healthcare, and descriptions of current programs and training approaches. In spite of increasing awareness and use of cultural competency and safety concepts, few programs have been successfully implemented. Insights: A concerted effort among health science education and training bodies to develop integrated and effective programs could result in comprehensive processes that hasten the Canadian culturally safe healthcare provision, thus reducing the gaps among populations.

Definitions and competencies for practice-based learning and improvement.

PubMed

Hayden, Stephen R; Dufel, Susan; Shih, Richard

2002-11-01

The Outcome Project is a long-term initiative by which the Accreditation Council for Graduate Medical Education (ACGME) is increasing emphasis on educational outcomes in the evaluation of residency programs. The ACGME initiated the Outcome Project to "ensure and improve the quality of graduate medical education." In order to assist program directors in emergency medicine (EM) to begin complying with components of the ACGME Outcome Project, the Council of Residency Directors in Emergency Medicine (CORD-EM) convened a consensus conference in March 2002 in conjunction with several other EM organizations. The working group for the competency of Practice-based Learning and Improvement (PBL) defined the components of PBL as: 1) analyze and assess practice experience and perform practice-based improvement; 2) locate, appraise, and utilize scientific evidence related to the patient's health problems and the larger population from which they are drawn; 3) apply knowledge of study design and statistical methods to critically appraise the medical literature; 4) utilize information technology to enhance personal education and improve patient care; and 5) facilitate the learning of students, colleagues, and other health care professionals in EM principles and practice. Establishing resident portfolios is a preferred method to chronicle resident competence in PBL. Traditional global evaluation of resident performance is de-emphasized. Checklist evaluation is appropriate for assessing any competency that can be broken down into specific behaviors or actions. 360-degree evaluation may be used to assess teamwork, communication skills, management skills, and clinical decision making. Chart-stimulated recall and record review are additional evaluation methods that can be used to assess resident competency in PBL. Simulations and models, such as computer-based scenarios, may be ideal for low-frequency but critical procedures.

A self-instructional model to teach systems-based practice and practice-based learning and improvement.

PubMed

Peters, Antoinette S; Kimura, Joe; Ladden, Maryjoan D; March, Elizabeth; Moore, Gordon T

2008-07-01

When mandated as resident competencies in 1999, systems-based practice (SBP) and practice-based learning and improvement (PBLI) were new concepts to many. To describe and evaluate a 4-week clinical elective (Achieving Competence Today-ACT) to teach residents SBP and PBLI. ACT consisted of a four-week active learning course and follow-up teaching experience, guided and supported by web-based materials. The curriculum included readings, scheduled activities, work products including an improvement project, and weekly meetings with a non-expert preceptor. The evaluation used a before-after cross-comparison of ACT residents and their peers. Seventy-eight residents and 42 faculty in 18 US Internal Medicine residency programs participated between 2003 and 2005. RESULTS AND MAIN MEASUREMENTS: All residents and faculty preceptors responded to a knowledge test, survey of attitudes, and self-assessment of competency to do 15 tasks related to SBP/PBLI. All measures were normalized to a 100-point scale. Each program's principal investigator (PI) identified aspects of ACT that were most and least effective in enhancing resident learning. ACT residents' gains in knowledge (4.4 on a 100-point scale) and self-assessed competency (11.3) were greater than controls' (-1.9, -8.0), but changes in attitudes were not significantly different. Faculty preceptors' knowledge scores did not change, but their attitudes became more positive (15.8). PIs found a ready-to-use curriculum effective (rated 8.5 on a 10-point scale). ACT increased residents' knowledge and self-assessment of their own competency and raised faculty's assessment of the importance of residents' learning SBP/PBLI. Faculty content expertise is not required for residents to learn SBP/PBLI.

Developing a culturally competent health network: a planning framework and guide.

PubMed

Gertner, Eric J; Sabino, Judith N; Mahady, Erica; Deitrich, Lynn M; Patton, Jarret R; Grim, Mary Kay; Geiger, James F; Salas-Lopez, Debbie

2010-01-01

The number of cultural competency initiatives in healthcare is increasing due to many factors, including changing demographics, quality improvement and regulatory requirements, equitable care missions, and accreditation standards. To facilitate organization-wide transformation, a hospital or healthcare system must establish strategic goals, objectives, and implementation tasks for culturally competent provision of care. This article reports the largely successful results of a cultural competency program instituted at a large system in eastern Pennsylvania. Prior to the development of its cultural competency initiative, Lehigh Valley Health Network, Allentown, Pennsylvania, saw isolated activities producing innovative solutions to diversity and culture issues in the provision of equitable care. But it took a transformational event to support an organization-wide program in cultural competency by strengthening leadership buy-in and providing a sense of urgency, excitement, and shared vision among multiple stakeholders. A multidisciplinary task force, including senior leaders and a diverse group of employees, was created with the authority and responsibility to enact changes. Through a well-organized strategic planning process, existing patient and community demographic data were reviewed to describe existing disparities, a baseline assessment was completed, a mission statement was created, and clear metrics were developed. The strategic plan, which focused on five key areas (demographics, language-appropriate services, employees, training, and education/communication), was approved by the network's chief executive officer and senior managers to demonstrate commitment prior to implementation. Strategic plan implementation proceeded through a project structure consisting of subproject teams charged with achieving the following specific objectives: develop a cultural material repository, enhance employee recruitment/retention, establish a baseline assessment, standardize data collection, provide language-appropriate services, and develop an education program. Change management and project management methodologies; defined roles and responsibilities; and specific, measurable, attainable, realistic, and time-bound goals were used in the implementation. This process has supported organizational change, thereby promoting high-quality, safe, and equitable care through widespread expectations of culturally competent care delivery across the entire network. Using this "ecologic approach" will ensure long-term success.

Exploring the Moderating Effects of Cognitive Abilities on Social Competence Intervention Outcomes.

PubMed

Stichter, Janine P; Herzog, Melissa J; Kilgus, Stephen P; Schoemann, Alexander M

2018-01-01

Many populations served by special education, including those identified with autism, emotional impairments, or students identified as not ready to learn, experience social competence deficits. The Social Competence Intervention-Adolescents' (SCI-A) methods, content, and materials were designed to be maximally pertinent and applicable to the social competence needs of early adolescents (i.e., age 11-14 years) identified as having scholastic potential but experiencing significant social competence deficits. Given the importance of establishing intervention efficacy, the current paper highlights the results from a four-year cluster randomized trial (CRT) to examine the efficacy of SCI-A (n = 146 students) relative to Business As Usual (n = 123 students) school-based programming. Educational personnel delivered all programming including both intervention and BAU conditions. Student functioning was assessed across multiple time points, including pre-, mid-, and post-intervention. Outcomes of interest included social competence behaviors, which were assessed via both systematic direct observation and teacher behavior rating scales. Data were analyzed using multilevel models, with students nested within schools. Results suggested after controlling for baseline behavior and student IQ, BAU and SCI students differed to a statistically significant degree across multiple indicators of social performance. Further consideration of standardized mean difference effect sizes revealed these between-group differences to be representative of medium effects (d > .50). Such outcomes pertained to student (a) awareness of social cues and information, and (b) capacity to appropriately interact with teachers and peers. The need for additional power and the investigation of potential moderators and mediators of social competence effectiveness are explored.

Agribusiness and Natural Resources Education in Michigan: Manpower Needs, Competencies Needed, School Program Characteristics. A Final Report.

ERIC Educational Resources Information Center

Thuemmel, William L.; And Others

A study was conducted to assess the agricultural manpower needs in Michigan in terms of present jobs available and jobs projected over the next five years, to identify and validate competencies needed for agricultural entry upon graduation from high school, and to determine the degree of congruency and discrepancy between the characteristics of…

Risk and Protective Factors for Children of Adolescents: Maternal Depression and Parental Sense of Competence

ERIC Educational Resources Information Center

Knoche, Lisa L.; Givens, Jami E.; Sheridan, Susan M.

2007-01-01

We investigated the relationship between depression and parental sense of competence to child cognitive outcomes for a sample of 49 adolescent mothers and their young children ("Mean age" = 9 1/2 months) enrolled in a student parenting program. Cognitive development of the infants and toddlers was assessed using the Bayley Scales of Infant…

Competency Profile Development for Management in Marketing Education on the Secondary Level and Cooperative Vocational/Industrial Education Programs on the Secondary Level.

ERIC Educational Resources Information Center

Smith, Clifton L.

A project revalidated, revised, and adapted/modified the minimum core competencies for the management and cooperative vocational/industrial education (CIE) courses on the secondary level. In Missouri, each marketing instructor teaching a management course and each CIE instructor completed a survey instrument for the assessment of each core…

Promoting medical competencies through international exchange programs: benefits on communication and effective doctor-patient relationships

PubMed Central

2014-01-01

Background Universities are increasingly organizing international exchange programs to meet the requirements of growing globalisation in the field of health care. Analyses based on the programs’ fundamental theoretical background are needed to confirm the learning value for participants. This study investigated the extent of sociocultural learning in an exchange program and how sociocultural learning affects the acquisition of domain-specific competencies. Methods Sociocultural learning theories were applied to study the learning effect for German medical students from the LMU Munich, Munich, Germany, of participation in the medical exchange program with Jimma University, Jimma, Ethiopia. First, we performed a qualitative study consisting of interviews with five of the first program participants. The results were used to develop a questionnaire for the subsequent, quantitative study, in which 29 program participants and 23 matched controls performed self-assessments of competencies as defined in the Tuning Project for Health Professionals. The two interrelated studies were combined to answer three different research questions. Results The participants rated their competence significantly higher than the control group in the fields of doctor-patient relationships and communication in a medical context. Participant responses in the two interrelated studies supported the link between the findings and the suggested theoretical background. Conclusion Overall, we found that the exchange program affected the areas of doctor-patient relationships and effective communication in a medical context. Vygotsky’s sociocultural learning theory contributed to explaining the learning mechanisms of the exchange program. PMID:24589133

A Novel Scenario-Based Interview Tool to Evaluate Nontechnical Skills and Competencies in Global Health Delivery.

PubMed

Wroe, Emily B; McBain, Ryan K; Michaelis, Annie; Dunbar, Elizabeth L; Hirschhorn, Lisa R; Cancedda, Corrado

2017-08-01

Despite rapid growth in the number of physicians and academic institutions entering the field of global health, there are few tools that inform global health curricula and assess physician readiness for this field. To address this gap, we describe the development and pilot testing of a new tool to assess nontechnical competencies and values in global health. Competencies assessed include systems-based practice, interpersonal and cross-cultural communication, professionalism and self-care, patient care, mentoring, teaching, management, and personal motivation and experience. The Global Health Delivery Competency Assessment Tool presents 15 case vignettes and open-ended questions related to situations a global health practitioner might encounter, and grades the quality of responses on a 6-point ordinal scale. We interviewed 17 of 18 possible global health residents (94%), matched with 17 residents not training in global health, for a total of 34 interviews. A second reviewer independently scored recordings of 13 interviews for reliability. Pilot testing indicated a high degree of discriminant validity, as measured by the instrument's ability to distinguish between residents who were and were not enrolled in a global health program ( P  < .001). It also demonstrated acceptable consistency, as assessed by interrater reliability (κ = 0.53), with a range of item-level agreement from 84%-96%. The tool has potential applicability to a variety of academic and programmatic activities, including evaluation of candidates for global health positions and evaluating the success of training programs in equipping practitioners for entry into this field.

Developing a Competency-Based Assessment Approach for Student Learning

ERIC Educational Resources Information Center

Dunning, Pamela T.

2014-01-01

Higher education accrediting bodies are increasing the emphasis on assessing student learning outcomes as opposed to teaching methodology. The purpose of this article is to describe the process used by Troy University's Master of Public Administration program to change their assessment approach from a course learning objective perspective to a…

Diagnostic and Value-Added Assessment of Business Writing

ERIC Educational Resources Information Center

Fraser, Linda; Harich, Katrin; Norby, Joni; Brzovic, Kathy; Rizkallah, Teeanna; Loewy, Dana

2005-01-01

To assess students' business writing abilities upon entry into the business program and exit from the capstone course, a multitiered assessment package was developed that measures students' achievement of specific learning outcomes and provides "value-added" scores. The online segment of the test measures five competencies across three process…

Research on and Guidelines for Effective Use of Assessment Instruments and Strategies for Adult Learners Enrolled in Adult Basic and Literacy Education Programs. Final Report.

ERIC Educational Resources Information Center

Pennsylvania State Univ., University Park. Inst. for the Study of Adult Literacy.

The goal of this research project was to create a guide on the effective use of assessment instruments and methodologies, related resources, and guidelines for measuring adult learners' attainment of basic skills and competencies to document educational gains and demonstrate program quality. The project focused on confirming current use of…

Providing culturally competent services for American Indian and Alaska Native veterans to reduce health care disparities.

PubMed

Noe, Timothy D; Kaufman, Carol E; Kaufmann, L Jeanne; Brooks, Elizabeth; Shore, Jay H

2014-09-01

We conducted an exploratory study to determine what organizational characteristics predict the provision of culturally competent services for American Indian and Alaska Native (AI/AN) veterans in Department of Veterans Affairs (VA) health facilities. In 2011 to 2012, we adapted the Organizational Readiness to Change Assessment (ORCA) for a survey of 27 VA facilities in the Western Region to assess organizational readiness and capacity to adopt and implement native-specific services and to profile the availability of AI/AN veteran programs and interest in and resources for such programs. Several ORCA subscales (Program Needs, Leader's Practices, and Communication) statistically significantly predicted whether VA staff perceived that their facilities were meeting the needs of AI/AN veterans. However, none predicted greater implementation of native-specific services. Our findings may aid in developing strategies for adopting and implementing promising native-specific programs and services for AI/AN veterans, and may be generalizable for other veteran groups.

Providing Culturally Competent Services for American Indian and Alaska Native Veterans to Reduce Health Care Disparities

PubMed Central

Kaufman, Carol E.; Kaufmann, L. Jeanne; Brooks, Elizabeth; Shore, Jay H.

2014-01-01

Objectives. We conducted an exploratory study to determine what organizational characteristics predict the provision of culturally competent services for American Indian and Alaska Native (AI/AN) veterans in Department of Veterans Affairs (VA) health facilities. Methods. In 2011 to 2012, we adapted the Organizational Readiness to Change Assessment (ORCA) for a survey of 27 VA facilities in the Western Region to assess organizational readiness and capacity to adopt and implement native-specific services and to profile the availability of AI/AN veteran programs and interest in and resources for such programs. Results. Several ORCA subscales (Program Needs, Leader’s Practices, and Communication) statistically significantly predicted whether VA staff perceived that their facilities were meeting the needs of AI/AN veterans. However, none predicted greater implementation of native-specific services. Conclusions. Our findings may aid in developing strategies for adopting and implementing promising native-specific programs and services for AI/AN veterans, and may be generalizable for other veteran groups. PMID:25100420

Rheumatology training experience across Europe: analysis of core competences.

PubMed

Sivera, Francisca; Ramiro, Sofia; Cikes, Nada; Cutolo, Maurizio; Dougados, Maxime; Gossec, Laure; Kvien, Tore K; Lundberg, Ingrid E; Mandl, Peter; Moorthy, Arumugam; Panchal, Sonia; da Silva, José A P; Bijlsma, Johannes W

2016-09-23

The aim of this project was to analyze and compare the educational experience in rheumatology specialty training programs across European countries, with a focus on self-reported ability. An electronic survey was designed to assess the training experience in terms of self-reported ability, existence of formal education, number of patients managed and assessments performed during rheumatology training in 21 core competences including managing specific diseases, generic competences and procedures. The target population consisted of rheumatology trainees and recently certified rheumatologists across Europe. The relationship between the country of training and the self-reported ability or training methods for each competence was analyzed through linear or logistic regression, as appropriate. In total 1079 questionnaires from 41 countries were gathered. Self-reported ability was high for most competences, range 7.5-9.4 (0-10 scale) for clinical competences, 5.8-9.0 for technical procedures and 7.8-8.9 for generic competences. Competences with lower self-reported ability included managing patients with vasculitis, identifying crystals and performing an ultrasound. Between 53 and 91 % of the trainees received formal education and between 7 and 61 % of the trainees reported limited practical experience (managing ≤10 patients) in each competence. Evaluation of each competence was reported by 29-60 % of the respondents. In adjusted multivariable analysis, the country of training was associated with significant differences in self-reported ability for all individual competences. Even though self-reported ability is generally high, there are significant differences amongst European countries, including differences in the learning structure and assessment of competences. This suggests that educational outcomes may also differ. Efforts to promote European harmonization in rheumatology training should be encouraged and supported.

Using the Journal Club to teach and assess competence in practice-based learning and improvement: a literature review and recommendation for implementation.

PubMed

Lee, Andrew G; Boldt, H Culver; Golnik, Karl C; Arnold, Anthony C; Oetting, Thomas A; Beaver, Hilary A; Olson, Richard J; Carter, Keith

2005-01-01

The traditional journal club has historically been used to teach residents about critically reading and reviewing the literature in order to improve patient care. The Accreditation Council for Graduate Medical Education competencies mandate requires that ophthalmology residency programs both teach and assess practice-based learning and improvement. A systematically conducted review of the literature regarding the use of the journal club in resident medical education was performed to define specific recommendations for implementation of a journal club tool. Selected best practices for a successful journal club were gleaned from the existing medical literature. These include the following: 1) the use of a structured review checklist, 2) explicit written learning objectives, and 3) a formalized meeting structure and process. The journal club might prove to be an excellent tool for the assessment of competencies like practice-based learning which may be difficult to assess by other means. Future study is necessary to determine if journal club can improve educational outcomes and promote lifelong competence in practice-based learning.

Long term impact of emotional, social and cognitive intelligence competencies and GMAT on career and life satisfaction and career success

PubMed Central

Amdurer, Emily; Boyatzis, Richard E.; Saatcioglu, Argun; Smith, Melvin L.; Taylor, Scott N.

2014-01-01

Career scholars have called for a broader definition of career success by inviting greater exploration of its antecedents. While success in various jobs has been predicted by intelligence and in other studies by competencies, especially in management, long term impact of having intelligence and using competencies has not been examined. Even in collegiate outcome studies, few have examined the longer term impact on graduates' careers or lives. This study assesses the impact of demonstrated emotional, social, and cognitive intelligence competencies assessed at graduation and g measured through GMAT at entry from an MBA program on career and life satisfaction, and career success assessed 5 to 19 years after graduation. Using behavioral measures of competencies (i.e., as assessed by others), we found that emotional intelligence competencies predict career satisfaction and success. Adaptability had a positive impact, but influence had the opposite effect on these career measures and life satisfaction. Life satisfaction was negatively affected by achievement orientation and positively affected by teamwork. Current salary, length of marriage, and being younger at time of graduation positively affect all three measures of life and career satisfaction and career success. GMAT (as a measure of g) predicted life satisfaction and career success to a slight but significant degree in the final model analyzed. Meanwhile, being female and number of children positively affected life satisfaction but cognitive intelligence competencies negatively affected it, and in particular demonstrated systems thinking was negative. PMID:25566128

Long term impact of emotional, social and cognitive intelligence competencies and GMAT on career and life satisfaction and career success.

PubMed

Amdurer, Emily; Boyatzis, Richard E; Saatcioglu, Argun; Smith, Melvin L; Taylor, Scott N

2014-01-01

Career scholars have called for a broader definition of career success by inviting greater exploration of its antecedents. While success in various jobs has been predicted by intelligence and in other studies by competencies, especially in management, long term impact of having intelligence and using competencies has not been examined. Even in collegiate outcome studies, few have examined the longer term impact on graduates' careers or lives. This study assesses the impact of demonstrated emotional, social, and cognitive intelligence competencies assessed at graduation and g measured through GMAT at entry from an MBA program on career and life satisfaction, and career success assessed 5 to 19 years after graduation. Using behavioral measures of competencies (i.e., as assessed by others), we found that emotional intelligence competencies predict career satisfaction and success. Adaptability had a positive impact, but influence had the opposite effect on these career measures and life satisfaction. Life satisfaction was negatively affected by achievement orientation and positively affected by teamwork. Current salary, length of marriage, and being younger at time of graduation positively affect all three measures of life and career satisfaction and career success. GMAT (as a measure of g) predicted life satisfaction and career success to a slight but significant degree in the final model analyzed. Meanwhile, being female and number of children positively affected life satisfaction but cognitive intelligence competencies negatively affected it, and in particular demonstrated systems thinking was negative.

15 CFR 285.14 - Criteria for accreditation.

Code of Federal Regulations, 2012 CFR

2012-01-01

... INSTITUTE OF STANDARDS AND TECHNOLOGY, DEPARTMENT OF COMMERCE ACCREDITATION AND ASSESSMENT PROGRAMS NATIONAL... for the competence of testing and calibration laboratories, including revisions from time to time. ...

15 CFR 285.14 - Criteria for accreditation.

Code of Federal Regulations, 2011 CFR

2011-01-01

... INSTITUTE OF STANDARDS AND TECHNOLOGY, DEPARTMENT OF COMMERCE ACCREDITATION AND ASSESSMENT PROGRAMS NATIONAL... for the competence of testing and calibration laboratories, including revisions from time to time. ...

15 CFR 285.14 - Criteria for accreditation.

Code of Federal Regulations, 2014 CFR

2014-01-01

... INSTITUTE OF STANDARDS AND TECHNOLOGY, DEPARTMENT OF COMMERCE ACCREDITATION AND ASSESSMENT PROGRAMS NATIONAL... for the competence of testing and calibration laboratories, including revisions from time to time. ...

15 CFR 285.14 - Criteria for accreditation.

Code of Federal Regulations, 2010 CFR

2010-01-01

... INSTITUTE OF STANDARDS AND TECHNOLOGY, DEPARTMENT OF COMMERCE ACCREDITATION AND ASSESSMENT PROGRAMS NATIONAL... for the competence of testing and calibration laboratories, including revisions from time to time. ...

15 CFR 285.14 - Criteria for accreditation.

Code of Federal Regulations, 2013 CFR

2013-01-01

... INSTITUTE OF STANDARDS AND TECHNOLOGY, DEPARTMENT OF COMMERCE ACCREDITATION AND ASSESSMENT PROGRAMS NATIONAL... for the competence of testing and calibration laboratories, including revisions from time to time. ...

Towards an operational definition of pharmacy clinical competency

NASA Astrophysics Data System (ADS)

Douglas, Charles Allen

The scope of pharmacy practice and the training of future pharmacists have undergone a strategic shift over the last few decades. The pharmacy profession recognizes greater pharmacist involvement in patient care activities. Towards this strategic objective, pharmacy schools are training future pharmacists to meet these new clinical demands. Pharmacy students have clerkships called Advanced Pharmacy Practice Experiences (APPEs), and these clerkships account for 30% of the professional curriculum. APPEs provide the only opportunity for students to refine clinical skills under the guidance of an experienced pharmacist. Nationwide, schools of pharmacy need to evaluate whether students have successfully completed APPEs and are ready treat patients. Schools are left to their own devices to develop assessment programs that demonstrate to the public and regulatory agencies, students are clinically competent prior to graduation. There is no widely accepted method to evaluate whether these assessment programs actually discriminate between the competent and non-competent students. The central purpose of this study is to demonstrate a rigorous method to evaluate the validity and reliability of APPE assessment programs. The method introduced in this study is applicable to a wide variety of assessment programs. To illustrate this method, the study evaluated new performance criteria with a novel rating scale. The study had two main phases. In the first phase, a Delphi panel was created to bring together expert opinions. Pharmacy schools nominated exceptional preceptors to join a Delphi panel. Delphi is a method to achieve agreement of complex issues among experts. The principal researcher recruited preceptors representing a variety of practice settings and geographical regions. The Delphi panel evaluated and refined the new performance criteria. In the second phase, the study produced a novel set of video vignettes that portrayed student performances based on recommendations of an expert panel. Pharmacy preceptors assessed the performances with the new performance criteria. Estimates of reliability and accuracy from preceptors' assessments can be used to establish benchmarks for future comparisons. Findings from the first phase suggested preceptors held a unique perspective, where APPE assessments are based in relevance to clinical activities. The second phase analyzed assessment results from pharmacy preceptors who watched the video simulations. Reliability results were higher for non-randomized compared to randomized video simulations. Accuracy results showed preceptors more readily identified high and low student performances compared to average students. These results indicated the need for pharmacy preceptor training in performance assessment. The study illustrated a rigorous method to evaluate the validity and reliability of APPE assessment instruments.

Evaluation of the Military Functional Assessment Program: Preliminary Assessment of the Construct Validity Using an Archived Database of Clinical Data.

PubMed

Kelley, Amanda M; Ranes, Bethany M; Estrada, Art; Grandizio, Catherine M

2015-01-01

Several important factors must be considered when deciding to return a soldier to duty after a traumatic brain injury (TBI). Premature return increases risk for not only second-impact syndrome during the acute phase but also permanent changes from repetitive concussions. Thus, there is a critical need for return-to-duty (RTD) assessment criteria that encompass the spectrum of injury and disease experienced by US soldiers, particularly TBI. To provide evidence-based standards to eventually serve as criteria for operational competence and performance of a soldier after injury. Specifically, the relationships between clinical assessments and novel military-specific tasks were evaluated. Exploratory analyses (including nonparametric tests and Spearman rank correlations) of an archived database. A total of 79 patients with TBI who participated in an RTD assessment program at a US Army rehabilitation and recovery center. Military Functional Assessment Program (to determine a soldier's operational competence and performance after TBI) tasks; Dizziness Handicap Inventory; Dynamic Visual Acuity (vestibular function); Sensory Organization Test (postural control); Repeatable Battery for the Assessment of Neuropsychological Status (neuropsychological screening test); Beck Depression Inventory-II; Beck Anxiety Inventory; Comprehensive Trail Making Test (visual search and sequencing); posttraumatic stress disorder checklist military version; Alcohol Use Disorders Identification Test; Epworth Sleepiness Scale; Patient Health Questionnaire; and Military Acute Concussion Evaluation. Selected military operational assessment tasks correlated significantly with clinical measures of vestibular function, psychological well-being, and cognitive function. Differences on occupational therapy assessments, a concussion screening tool, and a self-report health questionnaire were seen between those who passed and those who failed the RTD assessment. Specifically, those who passed the RTD assessment scored more favorably on these clinical assessments. This study demonstrated convergent validity between Military Functional Assessment Program tasks and clinical assessment scores. The Military Functional Assessment Program shows promise for augmenting decision making related to RTD and soldier skills. Additional research is needed to determine the effectiveness of this program in predicting RTD success.

Competency-Based Assessment for Clinical Supervisors: Design-Based Research on a Web-Delivered Program

PubMed Central

Williams, Lauren Therese; Grealish, Laurie; Jamieson, Maggie

2015-01-01

Background Clinicians need to be supported by universities to use credible and defensible assessment practices during student placements. Web-based delivery of clinical education in student assessment offers professional development regardless of the geographical location of placement sites. Objective This paper explores the potential for a video-based constructivist Web-based program to support site supervisors in their assessments of student dietitians during clinical placements. Methods This project was undertaken as design-based research in two stages. Stage 1 describes the research consultation, development of the prototype, and formative feedback. In Stage 2, the program was pilot-tested and evaluated by a purposeful sample of nine clinical supervisors. Data generated as a result of user participation during the pilot test is reported. Users’ experiences with the program were also explored via interviews (six in a focus group and three individually). The interviews were transcribed verbatim and thematic analysis conducted from a pedagogical perspective using van Manen’s highlighting approach. Results This research succeeded in developing a Web-based program, “Feed our Future”, that increased supervisors’ confidence with their competency-based assessments of students on clinical placements. Three pedagogical themes emerged: constructivist design supports transformative Web-based learning; videos make abstract concepts tangible; and accessibility, usability, and pedagogy are interdependent. Conclusions Web-based programs, such as Feed our Future, offer a viable means for universities to support clinical supervisors in their assessment practices during clinical placements. A design-based research approach offers a practical process for such Web-based tool development, highlighting pedagogical barriers for planning purposes. PMID:25803172

Promoting medical students’ reflection on competencies to advance a global health equities curriculum

PubMed Central

2014-01-01

Background The move to frame medical education in terms of competencies – the extent to which trainees “can do” a professional responsibility - is congruent with calls for accountability in medical education. However, the focus on competencies might be a poor fit with curricula intended to prepare students for responsibilities not emphasized in traditional medical education. This study examines an innovative approach to the use of potential competency expectations related to advancing global health equity to promote students’ reflections and to inform curriculum development. Methods In 2012, 32 medical students were admitted into a newly developed Global Health and Disparities (GHD) Path of Excellence. The GHD program takes the form of mentored co-curricular activities built around defined competencies related to professional development and leadership skills intended to ameliorate health disparities in medically underserved settings, both domestically and globally. Students reviewed the GHD competencies from two perspectives: a) their ability to perform the identified competencies that they perceived themselves as holding as they began the GHD program and b) the extent to which they perceived that their future career would require these responsibilities. For both sets of assessments the response scale ranged from “Strongly Disagree” to “Strongly Agree.” Wilcoxon’s paired T-tests compared individual students’ ordinal rating of their current level of ability to their perceived need for competence that they anticipated their careers would require. Statistical significance was set at p < .01. Results Students’ ratings ranged from “strongly disagree” to “strongly agree” that they could perform the defined GHD-related competencies. However, on most competencies, at least 50 % of students indicated that the stated competencies were beyond their present ability level. For each competency, the results of Wilcoxon paired T-tests indicate – at statistically significant levels - that students perceive more need in their careers for GHD-program defined competencies than they currently possess. Conclusion This study suggests congruence between student and program perceptions of the scope of practice required for GHD. Students report the need for enhanced skill levels in the careers they anticipate. This approach to formulating and reflecting on competencies will guide the program’s design of learning experiences aligned with students’ career goals. PMID:24886229

Process-oriented Approach to Designing Immersion Assessments

DTIC Science & Technology

2014-02-01

Command (USSOCOM) Command Language Program Manager (CLPM) Advanced Competencies Course in a presentation titled, The Language Needs Assessment Process and...Techniques can be very similar • Physical v. psychological fidelity • Johns (2006) Discrete Context—task, social and physical • 4Ps : Purpose

A Needs Assessment of Aquaculture Extension Agents, Specialists, and Program Administrators in Extension Programming

ERIC Educational Resources Information Center

Schwarz, Michael H.; Gibson, Jerry

2010-01-01

The study reported here identified continuing education and training needs of aquaculture Extension agents, specialists, and program administrators in 10 competency areas relating to the need for continuing education or training. Fourteen resources on the AquaNIC Web site were also evaluated, as was the efficacy of the AQUA-EXT listserv. Data were…

Oncology Nurse Generalist Competencies: Oncology Nursing Society's Initiative to Establish Best Practice.

PubMed

Gaguski, Michele E; George, Kim; Bruce, Susan D; Brucker, Edie; Leija, Carol; LeFebvre, Kristine B; Mackey, Heather

2017-12-01

A project team was formulated to create evidence-based oncology nurse generalist competencies (ONGCs) to establish best practices in competency development, including high-risk tasks, critical thinking criteria, and measurement of key areas for oncology nurses.
. This article aims to describe the process and the development of ONGCs. 
. This article explains how the ONGCs were accomplished, and includes outcomes and suggestions for use in clinical practice. 
. Institutions can use the ONGCs to assess and develop competency programs, offer educational strategies to measure proficiency, and establish processes to foster a workplace committed to mentoring and teaching future oncology nurses.

[Development of a Tool for Training and Evaluation of the Competencies in Occupational Mental Health Necessary for Labor and Social Security Attorneys].

PubMed

Morimoto, Hideki; Shibata, Yoshiyuki; Kayashima, Kotaro; Motoyama, Kyoko; Wakabayashi, Tadashi; Horasawa, Ken; Maruta, Wakako; Ogasawara, Takayuki; Nishikido, Noriko; Oyama, Yuji; Toyoda, Hiroyuki; Mori, Ayaka; Mori, Koji

2016-06-01

Labor and Social Security Attorneys (LSSAs) advise their clients about occupational mental health, but the competencies necessary in this field are not clear to them. We standardized the necessary competencies as a counseling guide for LSSAs, and we also designed a related discussion training program. These competencies were summarized in a brainstorming session at a research conference comprised of physicians, an occupational health nurse, LSSAs, an instructional design expert, and a management consultant, and then a training program (lasting 9 hours 30 minutes) was developed. Nineteen trainees who were introduced by members of the research conference collectively completed a seven-question written test, both before and after the training, in order to assess its effectiveness. Sixteen trainees who completed the training were surveyed, with a recovery rate of 100%. The necessary competencies that they identified were: information about circular notices from the Ministry of Health, Labor and Welfare; behavior such as the gathering of information; and dealing with the reinstatement of employees. The scores were subjected to the Wilcoxon signed-rank test in order to evaluate the training, and the answers from the pre-training were compared with those from the post-training. A significant difference (P < 0.05) was seen for each question. These results show the effectiveness of the developed training program for the learning of the competencies necessary for LSSAs.

Why competencies in graduate health management and policy education?

PubMed

Calhoun, Judith G; Vincent, Eric T; Calhoun, Gary L; Brandsen, Laura E

2008-01-01

During the past decade there has been a growing interest in learning and competency-based systems in various areas of education, training, and professional development. As a result, a number of competency initiatives have been undertaken across the health professions, including medicine, nursing, and pharmacy. Concurrent with these activities have been the resounding calls for: 1) both curricular content and process review in health administration and related training programs, 2) rethinking and reform of current educational practices, and 3) evidence-based, outcomes-focused education in health management and policy education. In spite of governmental mandates and accrediting body specification for educational improvement, the debate about the use of competency models, competencies themselves, and competency-based education (CBE) still continues in a number of post-secondary educational settings-both within and outside of the professions. Specifically, faculties in health management and policy educational programs, including undergraduate and graduate education across the US, have questioned the need for the evolving competencies, competency models, and outcomes-based educational processes and assessment methods currently being developed and or adopted within the profession. Outlined in this paper are four of the current inflection points related to the competency/outcomes-based movement in the professions during the past decade: 1) The Changing Workforce and Workplace, 2) Reform in the Educational Continuum, 3) Evolving Accreditation Requirements, and 4) Continuous Quality Improvement (CQI) in Health Management and Policy Education.

Development and Field-Test of an Instrument to Assess the Extent to Which a Vocational Educational Program Is Either Competency-Based or Conventional. Final Report from September 1, 1984 to August 31, 1985.

ERIC Educational Resources Information Center

University of Central Florida, Orlando. Coll. of Education.

This report describes the production and pilot test of an assessment instrument for vocational education programs. The instrument was designed to be used following a site visit that includes a 30- to 45-minute interview with the program instructor and a 30-minute interview with one small group of students. Reliability and validity information was…

A Novel Tool for Assessment of Emergency Medicine Resident Skill in Determining Diagnosis and Management for Emergent Electrocardiograms: A Multicenter Study.

PubMed

Hartman, Nicholas D; Wheaton, Natasha B; Williamson, Kelly; Quattromani, Erin N; Branzetti, Jeremy B; Aldeen, Amer Z

2016-12-01

Reading emergent electrocardiograms (ECGs) is one of the emergency physician's most crucial tasks, yet no well-validated tool exists to measure resident competence in this skill. To assess validity of a novel tool measuring emergency medicine resident competency for interpreting, and responding to, critical ECGs. In addition, we aim to observe trends in this skill for resident physicians at different levels of training. This is a multi-center, prospective study of postgraduate year (PGY) 1-4 residents at five emergency medicine (EM) residency programs in the United States. An assessment tool was created that asks the physician to identify either the ECG diagnosis or the best immediate management. One hundred thirteen EM residents from five EM residency programs submitted completed assessment surveys, including 43 PGY-1s, 33 PGY-2s, and 37 PGY-3/4s. PGY-3/4s averaged 74.6% correct (95% confidence interval [CI] 70.9-78.4) and performed significantly better than PGY-1s, who averaged 63.2% correct (95% CI 58.0-68.3). PGY-2s averaged 69.0% (95% CI 62.2-73.7). Year-to-year differences were more pronounced in management than in diagnosis. Residency training in EM seems to be associated with improved ability to interpret "critical" ECGs as measured by our assessment tool. This lends validity evidence for the tool by correlating with a previously observed association between residency training and improved ECG interpretation. Resident skill in ECG interpretation remains less than ideal. Creation of this sort of tool may allow programs to assess resident performance as well as evaluate interventions designed to improve competency. Copyright © 2016 Elsevier Inc. All rights reserved.

Exploring the Gap between Evidence and Judgement: Using Video Vignettes for Practice-based Assessment of Physiotherapy Undergraduates.

ERIC Educational Resources Information Center

Cross, Vinette; Hicks, Carolyn; Barwell, Fred

2001-01-01

Using videos of physiotherapy students, compared two assessment forms for validity and reliability (the first currently used by an academic program and the second developed from practitioners' perceptions of competence). Also investigated effects of training on assessment decisions. Found wide differences in individual ability to assess students…

Summary of ACOP (American College of Osteopathic Pediatricians) Program Directors' Annual Reports for First-Year Residents and Relationships between Resident Competency Performance Ratings and COMLEX-USA Test Scores

ERIC Educational Resources Information Center

Langenau, Erik E.; Pugliano, Gina; Roberts, William L.; Hostoffer, Robert

2010-01-01

Context: The Accreditation Council for Graduate Medical Education (ACGME) and American Osteopathic Association (AOA) endorsed the use of competency-based assessment, with the intention to improve health care administration [1, 2]. High-stakes licensing exams, such as the Comprehensive Osteopathic Medical Licensing Examination -- USA (COMLEX-USA),…

Training on the DSM-5 Cultural Formulation Interview Improves Cultural Competence in General Psychiatry Residents: A Multi-site Study.

PubMed

Mills, Stacia; Wolitzky-Taylor, Kate; Xiao, Anna Q; Bourque, Marie Claire; Rojas, Sandra M Peynado; Bhattacharya, Debanjana; Simpson, Annabelle K; Maye, Aleea; Lo, Pachida; Clark, Aaron; Lim, Russell; Lu, Francis G

2016-10-01

The authors assessed whether a 1-h didactic session on the DSM-5 Cultural Formulation Interview (CFI) improves cultural competence of general psychiatry residents. Psychiatry residents at six residency programs completed demographics and pre-intervention questionnaires, were exposed to a 1-h session on the CFI, and completed a post-intervention questionnaire. Repeated measures ANCOVA compared pre- to post-intervention change. Linear regression assessed whether previous cultural experience predicted post-intervention scores. Mean scores on the questionnaire significantly changed from pre- to post-intervention (p < 0.001). Previous cultural experience did not predict post-intervention scores. Psychiatry residents' cultural competence scores improved with a 1-h session on the CFI but with notable limitations.

Core Professionalism Education in Surgery: A Systematic Review

PubMed Central

Sarıoğlu Büke, Akile; Karabilgin Öztürkçü, Özlem Sürel; Yılmaz, Yusuf; Sayek, İskender

2018-01-01

Background: Professionalism education is one of the major elements of surgical residency education. Aims: To evaluate the studies on core professionalism education programs in surgical professionalism education. Study Design: Systematic review. Methods: This systematic literature review was performed to analyze core professionalism programs for surgical residency education published in English with at least three of the following features: program developmental model/instructional design method, aims and competencies, methods of teaching, methods of assessment, and program evaluation model or method. A total of 27083 articles were retrieved using EBSCOHOST, PubMed, Science Direct, Web of Science, and manual search. Results: Eight articles met the selection criteria. The instructional design method was presented in only one article, which described the Analysis, Design, Development, Implementation, and Evaluation model. Six articles were based on the Accreditation Council for Graduate Medical Education criterion, although there was significant variability in content. The most common teaching method was role modeling with scenario- and case-based learning. A wide range of assessment methods for evaluating professionalism education were reported. The Kirkpatrick model was reported in one article as a method for program evaluation. Conclusion: It is suggested that for a core surgical professionalism education program, developmental/instructional design model, aims and competencies, content, teaching methods, assessment methods, and program evaluation methods/models should be well defined, and the content should be comparable. PMID:29553464

Health advocacy for refugees

PubMed Central

Pottie, Kevin; Hostland, Sara

2007-01-01

PROBLEM BEING ADDRESSED Canadian family physicians serve a patient population that is increasingly diverse, both culturally and linguistically. Family medicine needs to take a leadership role in developing social accountability and cultural sensitivity among physicians. OBJECTIVE OF PROGRAM To train medical students to work with newly arriving refugees, to foster competence in handling cultural issues, to raise awareness of global health, and to engage medical students in work with underserviced populations in primary care. PROGRAM DESCRIPTION The program is composed of an Internet-based training module and a self-assessment quiz focused on global and refugee health, a workshop to increase competence in cultural matters, an experience working with at least 1 refugee family at a shelter for newly arriving refugees, family physician mentorship, and a debriefing workshop at the end of the experience. Students who complete this program are eligible for further electives at a refugee health clinic. CONCLUSION The program has been received enthusiastically by students, refugees, and family physicians. Working with refugees provides a powerful introduction to issues related to global health and competence in cultural matters. The program also provides an opportunity for medical students to work alongside family physicians and nurtures their interest in working with disadvantaged populations. PMID:18000269

Expanding undergraduate dietetic education through a health promotion internship program.

PubMed

Rye, J A; Weston, C

1987-05-01

The Lifestyle Assistant Program is a health promotion internship offered by the University of Wisconsin-Stevens Point Health Service. Students majoring in health-related disciplines (e.g., dietetics) gain skills in promoting the six dimensions of wellness: social, occupational, spiritual, physical, intellectual, and emotional. Thirteen competencies provide the basis for training Lifestyle Assistants, who develop, market, present, and evaluate wellness sessions for the university and residential communities. Assistants earn academic credit or a wage. Of particular benefit to assistants majoring in dietetics are studying and operating a self-testing physical assessment unit, which approximates body composition, cardiovascular endurance, muscular strength, and flexibility; using a health hazard appraisal; assisting the University's Nutrition Task Force with its education campaign in the campus cafeterias; and presenting programs on popular nutrition topics (e.g., the athlete's diet). Program evaluation reveals that 84% of participants in programs conducted by assistants gained information of personal benefit. The Lifestyle Assistant competencies support The American Dietetic Association Plan IV minimum competencies in such areas as communication and education. The Lifestyle Assistant experience is in accordance with The American Dietetic Association's Dietetic Manpower Study recommendations: to provide student learning experiences in wellness programs and fitness settings.

LGBT-Competence in Social Work Education: The Relationship of School Contexts to Student Sexual Minority Competence.

PubMed

McCarty-Caplan, David

2018-01-01

This study examined the relationship between master of social work programs' (MSW) support of lesbian, gay, bisexual, and transgender people (LGBT-competence) and the sexual minority competence (LGB-competence) of social work students. Data were gathered from a sample of MSW program directors, faculty members, and students (N = 1385) within 34 MSW programs in the United States. A series of hierarchical linear models tested if a MSW program's LGBT-competence was associated with the LGB-competence of its students. Results showed a significant relationship between organizational LGBT-competence and individual LGB-competence within schools of social work, and that programs with greater LGBT-competence also had students who felt more competent to work with sexual minorities. These findings suggest schools of social work can take substantive action at an organizational level to improve the professional LGB-competence of future social workers. Implications for social work education are discussed.

Competence development for the promotion of gender equality in development cooperation: the case of the Swedish International Development Cooperation Agency (SIDA).

PubMed

Hannan-andersson, C

1997-01-01

The Swedish International Development Cooperation Agency (SIDA) has created an Action Program for Promoting Equality Between Women and Men in Partner Countries that emphasizes competency development as a means of achieving gender equality. Competency development goes beyond formal training and utilizes existing entry points while creating innovative ones. SIDA's partnership approach requires clear delineation of roles for SIDA personnel and partner countries, with SIDA 1) applying a gender perspective to assessments, 2) initiating a constructive dialogue about gender equality if needed, 3) assessing the need for gender equality promoting competency development, 4) studying the local context, and 5) developing effective local networks. In addition, the needs of different groups within SIDA should be met with appropriate competency development inputs while SIDA continues support to competency development in partner countries by developing local capacity for gender training and gender sensitization at the regional and national levels. At SIDA, gender training has evolved since 1989 to its current focus on the practical and concrete challenges facing participants. In addition, departments and divisions conduct sector- and issue-specific training, and gender equality is integrated in all SIDA training activities on every topic. The challenges for future competency development are to 1) increase the number of men involved in provision of competency development inputs, 2) improve competency at embassy and field levels, and 3) improve competency in policy dialogues.

Virtual reality in ophthalmology training.

PubMed

Khalifa, Yousuf M; Bogorad, David; Gibson, Vincent; Peifer, John; Nussbaum, Julian

2006-01-01

Current training models are limited by an unstructured curriculum, financial costs, human costs, and time constraints. With the newly mandated resident surgical competency, training programs are struggling to find viable methods of assessing and documenting the surgical skills of trainees. Virtual-reality technologies have been used for decades in flight simulation to train and assess competency, and there has been a recent push in surgical specialties to incorporate virtual-reality simulation into residency programs. These efforts have culminated in an FDA-approved carotid stenting simulator. What role virtual reality will play in the evolution of ophthalmology surgical curriculum is uncertain. The current apprentice system has served the art of surgery for over 100 years, and we foresee virtual reality working synergistically with our current curriculum modalities to streamline and enhance the resident's learning experience.

Development of Antimicrobial Competencies and Training for Staff Hospital Pharmacists

PubMed Central

Crader, Marsha F.

2014-01-01

Antimicrobial stewardship is an important component in health care outcomes of all patients. Many institutions are seeking the best methods to incorporate antimicrobial stewardship strategies into their hospitals including pharmacy services. Multiple factors should be considered when beginning or expanding an antimicrobial stewardship program. The purpose of this article is to discuss the development of basic antibiotic competencies and training for staff pharmacists in a community hospital. The article includes an assessment of pharmacists’ knowledge pre education and post education, perception of benefits from an antibiotic education program, and learning needs and preferences. PMID:24421561

Adult Education Attainment and Assessment Scores: A Cross-National Comparison. Stats in Brief. NCES 2018-007

ERIC Educational Resources Information Center

Mamedova, Saida; Sparks, Dinah; Hoyer, Kathleen Mulvaney

2017-01-01

The Organization for Economic Cooperation and Development (OECD) conducted the Program for the International Assessment of Adult Competencies (PIAAC), a multi-domain adult skills assessment with an extensive background questionnaire, in 2012. PIAAC is a global effort to understand how individuals' education, workplace experiences, and other…

A multi-level assessment of a program to teach medical students to teach.

PubMed

Blatt, Benjamin; Greenberg, Larrie

2007-02-01

Few longitudinal programs exist to teach senior students (MS4s) to be teachers, nor have there been any reports of comprehensive program evaluation in this area. The primary objectives of this study were to describe our ongoing faculty development effort and to develop a multi-level program evaluation, using Dixon's model. The TALKS (Teaching and Learning Communication Skills) program is a senior elective and open to all MS4s. We evaluated our program through assessment of its participants at three levels: level 1, opinion; level 2, competence; and level 3, performance; but not level 4, patient outcomes. The authors used a retrospective, pre-post questionnaire to assess MS4 attitudes about their educational experiences, a traditional instrument to assess their teaching, an interaction analysis technique using Bloom's taxonomy to assess MS4s' feedback skills, and a SP exam to assess MS4 communication skills. The authors hypothesized that MS4s participating in TALKS would view medical education more positively and informatively, would demonstrate important principles in giving feedback, would be assessed as excellent teachers, and would perform better than controls in an SP exam emphasizing communication skills. Results revealed that MS4s' ratings as teachers were very good to excellent, with the highest scores on the items "knowledgeable, supportive of me, and answering questions clearly." (Level 1, Opinion) MS4s' perceptions of their knowledge, attitudes and skills increased significantly from the pre to the post-questionnaire. (Level 2, Competence) MS4 feedback skills to MS2s revealed they did more talking than ideal, often at the lowest levels of Bloom's taxonomy. (Level 3, Performance) MS4s demonstrated better communication skills than controls on an evaluation by professional SPs. (Level 3, Performance).

Utilizing a Meals on Wheels program to teach falls risk assessment to medical students.

PubMed

Demons, Jamehl L; Chenna, Swapna; Callahan, Kathryn E; Davis, Brooke L; Kearsley, Linda; Sink, Kaycee M; Watkins, Franklin S; Williamson, Jeff D; Atkinson, Hal H

2014-01-01

Falls are a critical public health issue for older adults, and falls risk assessment is an expected competency for medical students. The aim of this study was to design an innovative method to teach falls risk assessment using community-based resources and limited geriatrics faculty. The authors developed a Fall Prevention Program through a partnership with Meals-on-Wheels (MOW). A 3rd-year medical student accompanies a MOW client services associate to a client's home and performs a falls risk assessment including history of falls, fear of falling, medication review, visual acuity, a Get Up and Go test, a Mini-Cog, and a home safety evaluation, reviewed in a small group session with a faculty member. During the 2010 academic year, 110 students completed the in-home falls risk assessment, rating it highly. One year later, 63 students voluntarily completed a retrospective pre/postsurvey, and the proportion of students reporting moderate to very high confidence in performing falls risk assessments increased from 30.6% to 87.3% (p < .001). Students also reported using most of the skills learned in subsequent clerkships. A single educational intervention in the MOW program effectively addressed geriatrics competencies with minimal faculty effort and could be adopted by many medical schools.

Development and Assessment of a Horizontally Integrated Biological Sciences Course Sequence for Pharmacy Education

PubMed Central

Wright, Nicholas J.D.; Alston, Gregory L.

2015-01-01

Objective. To design and assess a horizontally integrated biological sciences course sequence and to determine its effectiveness in imparting the foundational science knowledge necessary to successfully progress through the pharmacy school curriculum and produce competent pharmacy school graduates. Design. A 2-semester course sequence integrated principles from several basic science disciplines: biochemistry, molecular biology, cellular biology, anatomy, physiology, and pathophysiology. Each is a 5-credit course taught 5 days per week, with 50-minute class periods. Assessment. Achievement of outcomes was determined with course examinations, student lecture, and an annual skills mastery assessment. The North American Pharmacist Licensure Examination (NAPLEX) results were used as an indicator of competency to practice pharmacy. Conclusion. Students achieved course objectives and program level outcomes. The biological sciences integrated course sequence was successful in providing students with foundational basic science knowledge required to progress through the pharmacy program and to pass the NAPLEX. The percentage of the school’s students who passed the NAPLEX was not statistically different from the national percentage. PMID:26430276

Improving interprofessional competence in undergraduate students using a novel blended learning approach.

PubMed

Riesen, Eleanor; Morley, Michelle; Clendinneng, Debra; Ogilvie, Susan; Ann Murray, Mary

2012-07-01

Interprofessional simulation interventions, especially when face-to-face, involve considerable resources and require that all participants convene in a single location at a specific time. Scheduling multiple people across different programs is an important barrier to implementing interprofessional education interventions. This study explored a novel way to overcome the challenges associated with scheduling interprofessional learning experiences through the use of simulations in a virtual environment (Web.Alive™) where learners interact as avatars. In this study, 60 recent graduates from nursing, paramedic, police, and child and youth service programs participated in a 2-day workshop designed to improve interprofessional competencies through a blend of learning environments that included virtual face-to-face experiences, traditional face-to-face experiences and online experiences. Changes in learners' interprofessional competence were assessed through three outcomes: change in interprofessional attitudes pre- to post-workshop, self-perceived changes in interprofessional competence and observer ratings of performance across three clinical simulations. Results from the study indicate that from baseline to post-intervention, there was significant improvement in learners' interprofessional competence across all outcomes, and that the blended learning environment provided an acceptable way to develop these competencies.

Assessing Leader Development: Lessons from a Historical Review of MBA Outcomes

ERIC Educational Resources Information Center

Passarelli, Angela M.; Boyatzis, Richard E.; Wei, Hongguo

2018-01-01

Graduate management education seeks to enhance the likelihood that graduates will be effective leaders, managers, or professionals. This requires programs that are designed to enable students to develop the related competencies, and increasing regulatory pressures require programs to document evidence of success. However, both the design of…

SUNY Management Flexibility Program. Program Audit.

ERIC Educational Resources Information Center

New York State Legislative Commission on Expenditure Review, Albany.

This audit assesses implementation of the University Operating Flexibility Act by the State University of New York (SUNY). The legislation was designed to give SUNY more autonomy to make daily operating decisions, in order that SUNY could better compete with other major higher education institutions nationwide. The legislation empowered SUNY to…

Preparing Teachers for Technology Integration: Programs, Competencies, and Factors from the Literature

ERIC Educational Resources Information Center

Oliver, Kevin; Townsend, Latricia

2013-01-01

This article presents a review of recent literature about preparing teachers for technology integration. The review found six types of training programs are commonly implemented: pre-service training, long-term courses, short-term workshops and institutes, coaching/mentoring, learning communities, and product/assessment approaches. The review…

Effectiveness of a Core-Competency-based Program on Residents' Learning and Experience.

PubMed

Charles, Lesley; Triscott, Jean; Dobbs, Bonnie; Tian, Peter George; Babenko, Oksana

2016-06-01

The Care of the Elderly (COE) Diploma Program is a six-to-twelve-month enhanced skills program taken after two years of core residency training in Family Medicine. In 2010, we developed and implemented a core-competency-based COE Diploma program (CC), in lieu of one based on learning objectives (LO). This study assessed the effectiveness of the core-competency-based program on residents' learning and their training experience as compared to residents trained using learning objectives. The data from the 2007-2013 COE residents were used in the study, with nine and eight residents trained in the LO and CC programs, respectively. Residents' learning was measured using preceptors' evaluations of residents' skills/abilities throughout the program (118 evaluations in total). Residents' rating of training experience was measured using the Graduate's Questionnaire which residents completed after graduation. For residents' learning, overall, there was no significant difference between the two programs. However, when examined as a function of the four CanMEDS roles, there were significant increases in the CC residents' scores for two of the CanMEDS roles: Communicator/Collaborator/Manager and Scholar compared to residents in the LO program. With respect to residents' training experience, seven out of ten program components were rated by the CC residents higher than by the LO residents. The implementation of a COE CC program appears to facilitate resident learning and training experience.

Communicating With Patients: Skills Assessment in US Colleges of Pharmacy

PubMed Central

2006-01-01

Objective To describe current practices in assessing patient communication skills in US colleges and schools of pharmacy. Methods Syllabi and behavioral assessment forms were solicited and key faculty members were interviewed. Forms were analyzed to determine skills most commonly assessed in communication with simulated or role-playing patients. Results Fifty schools submitted behavioral assessment forms for patient communication skills. Individuals from 47 schools were interviewed. Colleges were found to vary in the way communication skills were assessed. Assessment forms focused more on dispensing a new prescription than monitoring ongoing therapy. Providing information was emphasized more than promoting adherence. Common faculty concerns were lack of continuity and congruence of assessment across the curriculum. Conclusions A common understanding of the standards and procedures for determining competence is needed. Experience and assessment activities should be sequenced throughout a program to build competence. PMID:17136187

Educating clinicians about cultural competence and disparities in health and health care.

PubMed

Like, Robert C

2011-01-01

An extensive body of literature has documented significant racial and ethnic disparities in health and health care. Cultural competency interventions, including the training of physicians and other health care professionals, have been proposed as a key strategy for helping to reduce these disparities. The continuing medical education (CME) profession can play an important role in addressing this need by improving the quality and assessing the outcomes of multicultural education programs. This article provides an overview of health care policy, legislative, accreditation, and professional initiatives relating to these subjects. The status of CME offerings on cultural competence/disparities is reviewed, with examples provided of available curricular resources and online courses. Critiques of cultural competence training and selected studies of its effectiveness are discussed. The need for the CME profession to become more culturally competent in its development, implementation, and evaluation of education programs is examined. Future challenges and opportunities are described, and a call for leadership and action is issued. Copyright © 2010 The Alliance for Continuing Medical Education, the Society for Academic Continuing Medical Education, and the Council on CME, Association for Hospital Medical Education.

Proposed In-Training Electrocardiogram Interpretation Competencies for Undergraduate and Postgraduate Trainees.

PubMed

Antiperovitch, Pavel; Zareba, Wojciech; Steinberg, Jonathan S; Bacharova, Ljuba; Tereshchenko, Larisa G; Farre, Jeronimo; Nikus, Kjell; Ikeda, Takanori; Baranchuk, Adrian

2018-03-01

Despite its importance in everyday clinical practice, the ability of physicians to interpret electrocardiograms (ECGs) is highly variable. ECG patterns are often misdiagnosed, and electrocardiographic emergencies are frequently missed, leading to adverse patient outcomes. Currently, many medical education programs lack an organized curriculum and competency assessment to ensure trainees master this essential skill. ECG patterns that were previously mentioned in literature were organized into groups from A to D based on their clinical importance and distributed among levels of training. Incremental versions of this organization were circulated among members of the International Society of Electrocardiology and the International Society of Holter and Noninvasive Electrocardiology until complete consensus was reached. We present reasonably attainable ECG interpretation competencies for undergraduate and postgraduate trainees. Previous literature suggests that methods of teaching ECG interpretation are less important and can be selected based on the available resources of each education program and student preference. The evidence clearly favors summative trainee evaluation methods, which would facilitate learning and ensure that appropriate competencies are acquired. Resources should be allocated to ensure that every trainee reaches their training milestones and should ensure that no electrocardiographic emergency (class A condition) is ever missed. We hope that these guidelines will inform medical education programs and encourage them to allocate sufficient resources and develop organized curricula. Assessments must be in place to ensure trainees acquire the level-appropriate ECG interpretation skills that are required for safe clinical practice. © 2017 Society of Hospital Medicine.

Charting the Road to Competence: Developmental Milestones for Internal Medicine Residency Training

PubMed Central

Green, Michael L.; Aagaard, Eva M.; Caverzagie, Kelly J.; Chick, Davoren A.; Holmboe, Eric; Kane, Gregory; Smith, Cynthia D.; Iobst, William

2009-01-01

Background The Accreditation Council for Graduate Medical Education (ACGME) Outcome Project requires that residency program directors objectively document that their residents achieve competence in 6 general dimensions of practice. Intervention In November 2007, the American Board of Internal Medicine (ABIM) and the ACGME initiated the development of milestones for internal medicine residency training. ABIM and ACGME convened a 33-member milestones task force made up of program directors, experts in evaluation and quality, and representatives of internal medicine stakeholder organizations. This article reports on the development process and the resulting list of proposed milestones for each ACGME competency. Outcomes The task force adopted the Dreyfus model of skill acquisition as a framework the internal medicine milestones, and calibrated the milestones with the expectation that residents achieve, at a minimum, the “competency” level in the 5-step progression by the completion of residency. The task force also developed general recommendations for strategies to evaluate the milestones. Discussion The milestones resulting from this effort will promote competency-based resident education in internal medicine, and will allow program directors to track the progress of residents and inform decisions regarding promotion and readiness for independent practice. In addition, the milestones may guide curriculum development, suggest specific assessment strategies, provide benchmarks for resident self-directed assessment-seeking, and assist remediation by facilitating identification of specific deficits. Finally, by making explicit the profession's expectations for graduates and providing a degree of national standardization in evaluation, the milestones may improve public accountability for residency training. PMID:21975701

[Diagnostic and formative assessment of competencies at the beginning of undergraduate medical internship].

PubMed

Martínez-González, Adrián; Lifshitz-Guinzberg, Alberto; Trejo-Mejía, Juan Andrés; Torruco-García, Uri; Fortoul-van der Goes, Teresa I; Flores-Hernández, Fernando; Peña-Balderas, Jorge; Martínez-Franco, Adrián Israel; Hernández-Nava, Alejandro; Elena-González, Diana; Sánchez-Mendiola, Melchor

2017-01-01

Research on diagnostic and formative assessment competencies during undergraduate medical training is scarce in Latin America. To assess the level of clinical competence of students at the beginning of their medical internship in a new curriculum. This was an observational cross-sectional study in UNAM Faculty of Medicine students in Mexico City: a formative assessment of the second class of Curriculum 2010 students as part of the integral evaluation of the program. The assessment had two components: theoretical and practical. We assessed 577 students (65.5%) of the 880 total population that finished the 9th semester of Curriculum 2010. The written exam consisted of 232 items, with a mean of 61.0 ± 19.6, a difficulty index of 0.61, and Cronbach's alpha of 0.89. The mean of the objective structured clinical examination (OSCE) was 62.2 ± 16.8, with a mean Cronbach's alpha of 0.51. Results were analyzed by knowledge area and exam stations. The overall results provide evidence that students achieve sufficiently the competencies established in the curriculum at the beginning of the internship, that they have the necessary foundation for learning new and more complex information, and integrate it with existing knowledge to achieve significant learning and continue their training.

A pilot Tuning Project-based national study on recently graduated medical students' self-assessment of competences--the TEST study.

PubMed

Grilo Diogo, Pedro; Barbosa, Joselina; Ferreira, Maria Amélia

2015-12-19

The Tuning Project is an initiative funded by the European Commission that developed core competences for primary medical degrees in Europe. Students' grouped self-assessments are used for program evaluation and improvement of curricula. The TEST study aimed to assess how do Portuguese medical graduates self-assess their acquisition of core competences and experiences of contact with patients in core settings according to the Tuning framework. Translation of the Tuning's competences (Clinical Practice - CP), Knowledge (K) items and Clinical Settings (CS) was performed. Questionnaires were created in paper and electronic formats and distributed to 1591 graduates from seven Portuguese medical schools (July 2014). Items were rated in a 6-point Likert scale (0-5) of levels of competence. Exploratory factor analysis (EFA) was conducted and Cronbach's alpha was used to evaluate the internal consistency of the questionnaire. Kruskal-Wallis and Dunn's tests were used for multiple comparisons. Three hundred eighty seven questionnaires were analyzed, corresponding to 24% of the target population. EFA yielded an 11-factor solution for CP and a 6-factor solution for K items. The median value of CP factors was 2.8 (p25 = 2.0; p75 = 3.5) and the median value of K factors was 2.6 (2.0; 3.2). Factor scores ranged from 1.3 (Legal principles) to 4.0 (Ethical principles). Clinical presentations, psychological aspects of illness, evidence-based medicine and promotion of health showed the highest results. Lower scores were detected in medical emergencies, practical procedures, prescribing drugs and legal principles. More than 90% of graduates experienced having contact with patients in 8 CS but only 24% of graduates had contact in all 14 CS. Graduates had the least contact with patients in the emergency rooms, intensive care units, palliative, rehabilitation and anesthetic care. Significant differences (p < 0.05) among schools were detected in 8 factors and 7 settings. We developed a valid questionnaire supporting national SWOT analysis on the acquisition of core competences in medical education. Results suggest that Portuguese graduates are not fully prepared for clinical practice. Curricular improvements in core competences and the educational development of the transition period between undergraduate and postgraduate education ought to be considered. Outcome-based program evaluation relying on graduates' grouped self-assessments contributes to inform changes in medical education.

Critical analysis of a computer-assisted tutorial on ECG interpretation and its ability to determine competency.

PubMed

Burke, J F; Gnall, E; Umrudden, Z; Kyaw, M; Schick, P K

2008-01-01

We developed a computer-based tutorial and a posttest on ECG interpretation for training residents and determining competency. Forty residents, 6 cardiology fellows, and 4 experienced physicians participated. The tutorial emphasized recognition and understanding of abnormal ECG features. Active learning was promoted by asking questions prior to the discussion of ECGs. Interactivity was facilitated by providing rapid and in-depth rationale for correct answers. Responses to questions were recorded and extensively analyzed to determine the quality of questions, baseline knowledge at different levels of training and improvement of grades in posttest. Posttest grades were used to assess improvement and to determine competency. The questions were found to be challenging, fair, appropriate and discriminative. This was important since the quality of Socratic questions is critical for the success of interactive programs. The information on strengths and weakness in baseline knowledge at different levels of training were used to adapt our training program to the needs of residents. The posttest revealed that the tutorial contributed to marked improvement in feature recognition. Competency testing distinguished between residents with outstanding grades and those who needed remediation. The strategy for critical evaluation of our computer program could be applied to any computer-based educational program, regardless of topic.

National programmes for validating physician competence and fitness for practice: a scoping review.

PubMed

Horsley, Tanya; Lockyer, Jocelyn; Cogo, Elise; Zeiter, Jeanie; Bursey, Ford; Campbell, Craig

2016-04-15

To explore and categorise the state of existing literature for national programmes designed to affirm or establish the continuing competence of physicians. Scoping review. MEDLINE, ERIC, Sociological Abstracts, web/grey literature (2000-2014). Included when a record described a (1) national-level physician validation system, (2) recognised as a system for affirming competence and (3) reported relevant data. Using bibliographic software, title and abstracts were reviewed using an assessment matrix to ensure duplicate, paired screening. Dyads included both a methodologist and content expert on each assessment, reflective of evidence-informed best practices to decrease errors. 45 reports were included. Publication dates ranged from 2002 to 2014 with the majority of publications occurring in the previous six years (n=35). Country of origin--defined as that of the primary author--included the USA (N=32), the UK (N=8), Canada (N=3), Kuwait (N=1) and Australia (N=1). Three broad themes emerged from this heterogeneous data set: contemporary national programmes, contextual factors and terminological consistency. Four national physician validation systems emerged from the data: the American Board of Medical Specialties Maintenance of Certification Program, the Federation of State Medical Boards Maintenance of Licensure Program, the Canadian Revalidation Program and the UK Revalidation Program. Three contextual factors emerged as stimuli for the implementation of national validation systems: medical regulation, quality of care and professional competence. Finally, great variation among the definitions of key terms was identified. There is an emerging literature focusing on national physician validation systems. Four major systems have been implemented in recent years and it is anticipated that more will follow. Much of this work is descriptive, and gaps exist for the extent to which systems build on current evidence or theory. Terminology is highly variable across programmes for validating physician competence and fitness for practice. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://www.bmj.com/company/products-services/rights-and-licensing/

National programmes for validating physician competence and fitness for practice: a scoping review

PubMed Central

Horsley, Tanya; Lockyer, Jocelyn; Cogo, Elise; Zeiter, Jeanie; Bursey, Ford; Campbell, Craig

2016-01-01

Objective To explore and categorise the state of existing literature for national programmes designed to affirm or establish the continuing competence of physicians. Design Scoping review. Data sources MEDLINE, ERIC, Sociological Abstracts, web/grey literature (2000–2014). Selection Included when a record described a (1) national-level physician validation system, (2) recognised as a system for affirming competence and (3) reported relevant data. Data extraction Using bibliographic software, title and abstracts were reviewed using an assessment matrix to ensure duplicate, paired screening. Dyads included both a methodologist and content expert on each assessment, reflective of evidence-informed best practices to decrease errors. Results 45 reports were included. Publication dates ranged from 2002 to 2014 with the majority of publications occurring in the previous six years (n=35). Country of origin—defined as that of the primary author—included the USA (N=32), the UK (N=8), Canada (N=3), Kuwait (N=1) and Australia (N=1). Three broad themes emerged from this heterogeneous data set: contemporary national programmes, contextual factors and terminological consistency. Four national physician validation systems emerged from the data: the American Board of Medical Specialties Maintenance of Certification Program, the Federation of State Medical Boards Maintenance of Licensure Program, the Canadian Revalidation Program and the UK Revalidation Program. Three contextual factors emerged as stimuli for the implementation of national validation systems: medical regulation, quality of care and professional competence. Finally, great variation among the definitions of key terms was identified. Conclusions There is an emerging literature focusing on national physician validation systems. Four major systems have been implemented in recent years and it is anticipated that more will follow. Much of this work is descriptive, and gaps exist for the extent to which systems build on current evidence or theory. Terminology is highly variable across programmes for validating physician competence and fitness for practice. PMID:27084276

Assessment Practices in Higher Education & Results of the German Research Program Modeling and Measuring Competencies in Higher Education (KoKoHs)

ERIC Educational Resources Information Center

Zlatkin-Troitschanskaia, Olga; Pant, Hans Anand; Kuhn, Christiane; Toepper, Miriam; Lautenbach, Corinna

2016-01-01

The ever-increasing internationalization of study programs and global mobility of students call for greater transparency of and valid information on the knowledge and skills students acquire over the course of their studies. Several theoretical and methodological challenges arise from the immense diversity of degree courses, study programs, and…

Exploring Self-Esteem in a Girls' Sports Program: Competencies and Connections Create Change

ERIC Educational Resources Information Center

Markowitz, Ellen

2012-01-01

Self-esteem has been problematic for researchers because it is complex, stable, and hard to measure. When assessing the self-esteem of out-of-school time (OST) program participants, some researchers may think their instruments will not detect changes, either because the program does not last long enough to make a difference or because self-esteem…

Examining the effectiveness of an intervention designed for the restoration of competency to stand trial.

PubMed

Mueller, Crystal; Wylie, A Michael

2007-01-01

This study examined the effectiveness of the Fitness Game, an intervention created for the restoration of competency to stand trial. Of 28 participants who completed either the experimental or control intervention at Hawai'i State Hospital (HSH), it was found that both groups had significant pretest to posttest improvements on Understanding and Appreciation subsets of the MacArthur Competence Assessment Tool-Criminal Adjudication (MacCAT-CA). However, there was no statistically significant difference between the groups on competency measures, indicating that the Fitness Game was not significantly more effective at restoring competency than non-legal programming. In other words, individuals committed to a psychiatric hospital for care and treatment were as likely to improve as those receiving additional specialized competency restoration treatment. Copyright (c) 2007 John Wiley & Sons, Ltd.

Integrating Interprofessional Education and Cultural Competency Training to Address Health Disparities.

PubMed

McElfish, Pearl Anna; Moore, Ramey; Buron, Bill; Hudson, Jonell; Long, Christopher R; Purvis, Rachel S; Schulz, Thomas K; Rowland, Brett; Warmack, T Scott

2018-01-01

Many U.S. medical schools have accreditation requirements for interprofessional education and training in cultural competency, yet few programs have developed programs to meet both of these requirements simultaneously. Furthermore, most training programs to address these requirements are broad in nature and do not focus on addressing health disparities. The lack of integration may reduce the students' ability to apply the knowledge learned. Innovative programs that combine these two learning objectives and focus on disenfranchised communities are needed to train the next generation of health professionals. A unique interprofessional education program was developed at the University of Arkansas for Medical Sciences Northwest. The program includes experiential learning, cultural exposure, and competence-building activities for interprofessional teams of medicine, nursing, and pharmacy students. The activities include (a) educational seminars, (b) clinical experiential learning in a student-led clinic, and (c) community-based service-learning through health assessments and survey research events. The program focuses on interprofessional collaboration to address the health disparities experienced by the Marshallese community in northwest Arkansas. The Marshallese are Pacific Islanders who suffer from significant health disparities related to chronic and infectious diseases. Comparison tests revealed statistically significant changes in participants' retrospectively reported pre/posttest scores for Subscales 1 and 2 of the Readiness for Interpersonal Learning Scale and for the Caffrey Cultural Competence in Healthcare Scale. However, no significant change was found for Subscale 3 of the Readiness for Interpersonal Learning Scale. Qualitative findings demonstrated a change in students' knowledge, attitudes, and behavior toward working with other professions and the underserved population. The program had to be flexible enough to meet the educational requirements and class schedules of the different health professions' education programs. The target community spoke limited English, so providing interpretation services using bilingual Marshallese community health workers was integral to the program's success.

A psychometric evaluation of an advanced pharmacy practice experience clinical competency framework.

PubMed

Douglas Ried, L; Doty, Randell E; Nemire, Ruth E

2015-03-25

To assess the psychometric properties of the clinical competency framework known as the System of Universal Clinical Competency Evaluation in the Sunshine State (SUCCESS), including its internal consistency and content, construct, and criterion validity. Sub-competency items within each hypothesized competency pair were subjected to principal components factor analysis to demonstrate convergent and discriminant validity. Varimax rotation was conducted for each competency pair (eg, competency 1 vs competency 2, competency 1 vs competency 3, competency 2 vs competency 3). Internal consistency was evaluated using Cronbach alpha. Of the initial 78 pairings, 44 (56%) demonstrated convergent and discriminant validity. Five pairs of competencies were unidimensional. Of the 34 pairs where at least 1 competency was multidimensional, most (91%) were from competencies 7, 11, and 12, indicating modifications were warranted in those competencies. After reconfiguring the competencies, 76 (94%) of the 81 pairs resulted in 2 factors as required. A unidimensional factor emerged when all 13 of the competencies were entered into a factor analysis. The internal consistency of all of the competencies was satisfactory. Psychometric evaluation shows the SUCCESS framework demonstrates adequate reliability and validity for most competencies. However, it also provides guidance where improvements are needed as part of a continuous quality improvement program.

IT Workforce: Key Practices Help Ensure Strong Integrated Program Teams; Selected Departments Need to Assess Skill Gaps

DTIC Science & Technology

2016-11-01

personnel, career paths for program managers, plans to strengthen program management, and use of special hiring authorities) Monitor and report...agencies with direct hiring authority for program managers and directed OPM to create a specialized career path. OMB also tasked agencies with...guidance for developing career paths for IT program managers.14 OPM’s career path guide was to build upon its IT Program Management Competency Model

Analysis of professional competencies for the clinical research data management profession: implications for training and professional certification.

PubMed

Zozus, Meredith N; Lazarov, Angel; Smith, Leigh R; Breen, Tim E; Krikorian, Susan L; Zbyszewski, Patrick S; Knoll, Shelly K; Jendrasek, Debra A; Perrin, Derek C; Zambas, Demetris N; Williams, Tremaine B; Pieper, Carl F

2017-07-01

To assess and refine competencies for the clinical research data management profession. Based on prior work developing and maintaining a practice standard and professional certification exam, a survey was administered to a captive group of clinical research data managers to assess professional competencies, types of data managed, types of studies supported, and necessary foundational knowledge. Respondents confirmed a set of 91 professional competencies. As expected, differences were seen in job tasks between early- to mid-career and mid- to late-career practitioners. Respondents indicated growing variability in types of studies for which they managed data and types of data managed. Respondents adapted favorably to the separate articulation of professional competencies vs foundational knowledge. The increases in the types of data managed and variety of research settings in which data are managed indicate a need for formal education in principles and methods that can be applied to different research contexts (ie, formal degree programs supporting the profession), and stronger links with the informatics scientific discipline, clinical research informatics in particular. The results document the scope of the profession and will serve as a foundation for the next revision of the Certified Clinical Data Manager TM exam. A clear articulation of professional competencies and necessary foundational knowledge could inform the content of graduate degree programs or tracks in areas such as clinical research informatics that will develop the current and future clinical research data management workforce. © The Author 2017. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For Permissions, please email: journals.permissions@oup.com

The Relationship between Classworks and Georgia State Testing

ERIC Educational Resources Information Center

Baker, Amanda

2014-01-01

As teachers in Georgia utilize formative assessments to ensure successful performance on the state mandated Criterion Referenced Competency Test (CRCT), it is essential that the data they receive from these assessments are accurate. This study examined the correlation between the computer-assisted instructional program, Classworks, and student…

From Capstones to Touchstones: Preparative Assessment and Its Use in Teacher Education

ERIC Educational Resources Information Center

Brock, Patricia Ann

2004-01-01

Assessment of teacher competence follows current educational trends in rubrics, standards, and high-stakes testing. Simultaneously, the traditional preservice education classroom is expanding into cyberspace; many teacher preparation programs are being offered through distance learning. As preservice education students complete required courses…

An Overview of Cultural Competency Curricula in ACGME-accredited General Surgery Residency Programs.

PubMed

Shah, Sagar S; Sapigao, Francisco B; Chun, Maria B J

Cultural competency(CC) in surgical residency curricula is not the novel idea it was fourteen years ago when the ACGME challenged program directors to teach and assess six core competencies. CC is recognized as a component of "patient care", "professionalism", and "interpersonal and communication skills." The results of five programs (2004-2012) with CC curricula were identified in a 2013 paper by Ly and Chun. The primary objective of this paper is to provide the current status of CC curricula in general surgery residency programs. Three sources were used for this study. First, a four question survey on the current status of CC education was sent to program directors of ACGME-accredited surgery residency programs. Second, the lead authors from five programs previously reported in the 2013 paper were interviewed. Third, the survey mentioned above was resent to 52 residency programs who implemented New York University's (NYU) SPICE program, which has a CC component. Participants for the survey consisted of program directors of ACGME-accredited surgery residency programs. The interviews were conducted with the corresponding authors from the previous study by Ly and Chun. Of the 256 surveyed, nine responded; seven stated that CC is not taught formally at their institution while four stated that they do not feel any part of CC curricula is missing from their program. Due to the low response rate, we identified and conducted interviews with general surgery residency programs with CC curricula. Of the five programs contacted, only three remain active and utilize Objective Structured Clinical Examinations (OSCEs) to teach cultural competency. One of the three, the SPICE program at NYU, has expanded to 52 other residency programs in the US. Although the importance of CC has been identified in general surgery, formal curricula and documentation of implementation remains elusive. Copyright © 2016 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Food-safety educational goals for dietetics and hospitality students.

PubMed

Scheule, B

2000-08-01

To identify food-safety educational goals for dietetics and hospitality management students. Written questionnaires were used to identify educational goals and the most important food safety competencies for entry-level dietitians and foodservice managers. The sample included all directors of didactic programs in dietetics approved by the American Dietetic Association and baccalaureate-degree hospitality programs with membership in the Council on Hotel, Restaurant, and Institutional Education. Fifty-one percent of the directors responded. Descriptive statistics were calculated. chi 2 analysis and independent t tests were used to compare educators' responses for discrete and continuous variables, respectively. Exploratory factor analysis grouped statements about food safety competence. Internal consistency of factors was measured using Cronbach alpha. Thirty-four percent of dietetics programs and 70% of hospitality programs required or offered food safety certification. Dietetics educators reported multiple courses with food safety information, whereas hospitality educators identified 1 or 2 courses. In general, the educators rated food-safety competencies as very important or essential. Concepts related to Hazard Analysis and Critical Control Points (HAACP), irradiation, and pasteurization were rated less highly, compared with other items. Competencies related to reasons for outbreaks of foodborne illness were rated as most important. Food safety certification of dietitians and an increased emphasis on HAACP at the undergraduate level or during the practice component are suggested. Research is recommended to assess the level of food-safety competence expected by employers of entry-level dietitians and foodservice managers.

Validation of the Competencies Needed by Vocational Education Teachers, Middle Managers, and Administrators. Phase II of a Professional Development Study for Massachusetts, Volume I.

ERIC Educational Resources Information Center

Boston Univ., MA. School of Education.

This is the first of four volumes reporting phase 2 of a two-phase project to examine the competency-based vocational teacher education movement and analyze the current state of the art (phase 1), and to assess the implications for preservice, inservice, and leadership level professional development programs in career and occupational education in…

The effect of using different competence frameworks to audit the content of a masters program in public health.

PubMed

Harrison, Roger A; Gemmell, Isla; Reed, Katie

2015-01-01

(1) To quantify the effect of using different public health competence frameworks to audit the curriculum of an online distance learning MPH program, and (2) to measure variation in the outcomes of the audit depending on which competence framework is used. Retrospective audit. We compared the teaching content of an online distance learning MPH program against each competence listed in different public health competence frameworks relevant to an MPH. We then compared the number of competences covered in each module in the program's teaching curriculum and in the program overall, for each of the competence frameworks used in this audit. A comprehensive search of the literature identified two competence frameworks specific to MPH programs and two for public health professional/specialty training. The number of individual competences in each framework were 32 for the taught aspects of the UK Faculty of Public Health Specialist Training Program, 117 for the American Association of Public Health, 282 for the exam curriculum of the UK Faculty of Public Health Part A exam, and 393 for the European Core Competencies for MPH Education. This gave a total of 824 competences included in the audit. Overall, the online MPH program covered 88-96% of the competences depending on the specific framework used. This fell when the audit focused on just the three mandatory modules in the program, and the variation between the different competence frameworks was much larger. Using different competence frameworks to audit the curriculum of an MPH program can give different indications of its quality, especially as it fails to capture teaching considered to be relevant, yet not included in an existing competence framework. The strengths and weaknesses of using competence frameworks to audit the content of an MPH program have largely been ignored. These debates are vital given that external organizations responsible for accreditation specify a particular competence framework to be used. Our study found that each of four different competence frameworks suggested different levels of quality in our teaching program, at least in terms of the competences included in the curriculum. Relying on just one established framework missed some aspects of the curriculum included in other frameworks used in this study. Conversely, each framework included items not covered by the others. Thus, levels of agreement with the content of our MPH and established areas of competence were, in part, dependent on the competence framework used to compare its' content. While not entirely a surprising finding, this study makes an important point and makes explicit the challenges of selecting an appropriate competence framework to inform MPH programs, and especially one which recruits students from around the world.

Determinants of managerial competencies for primary care managers in Southern Thailand.

PubMed

Mohd-Shamsudin, Faridahwati; Chuttipattana, Nirachon

2012-01-01

The purpose of this paper is first, to identify the critical managerial competencies of primary care managers; and second, to determine the relationship between personality and motivation, and managerial competency. A survey was conducted involving distribution of questionnaires to 358 rural primary care managers in Southern Thailand. The survey found six critical managerial competencies: visionary leadership; assessment, planning, and evaluation; promotion of health and prevention of disease; information management; partnership and collaboration; and communication. Both personality and motivation are found to significantly influence primary care managers' managerial competency. In particular, conscientiousness (i.e. perseveres until the task is finished, does a thorough job, full of energy, does things efficiently, and a lot of enthusiasm) is related to all managerial competencies. It is clear that extrinsic and intrinsic factors (i.e. quality of supervision and leadership, organizational policy and administration, interpersonal relationship, working conditions, work itself, amount of responsibility, and job recognition) are influential in primary care manager motivation that can significantly improve morale. The short version of the personality instrument may limit the generalization of some of the findings. Future research is needed to assess the relationship between managerial competency and performance. Further research could be done in other countries to see if this conclusion is in fact correct. It would also be useful to research if the findings apply to other health and social areas. Personality and motivation are able to co-predict managerial competency whereby motivation tends to have a stronger influence than personality. These findings will be useful to policy makers and to those responsible for the human development in the preparation of management training and development programs. Moreover, top management should not overlook the motivational system as a way to encourage managers to be competent in their job. The paper contributes to our understanding of managerial competency within the context of rural primary care sectors. The success of any organized health program depends upon effective management, but health systems worldwide face a lack of competent management at all levels. Management development for health systems, particularly at the first line of supervision, must be given much higher priority for investment.

13 CFR 125.5 - What is the Certificate of Competency Program?

Code of Federal Regulations, 2014 CFR

2014-01-01

... Competency Program? 125.5 Section 125.5 Business Credit and Assistance SMALL BUSINESS ADMINISTRATION GOVERNMENT CONTRACTING PROGRAMS § 125.5 What is the Certificate of Competency Program? (a) General. (1) The Certificate of Competency (COC) Program is authorized under section 8(b)(7) of the Small Business Act (15 U.S...

Measuring trainer fidelity in the transfer of suicide prevention training

PubMed Central

Cross, Wendi F.; Pisani, Anthony R.; Schmeelk-Cone, Karen; Xia, Yinglin; Tu, Xin; McMahon, Marcie; Munfakh, Jimmie Lou; Gould, Madelyn S.

2014-01-01

Background Finding effective and efficient models to train large numbers of suicide prevention interventionists, including ‘hotline’ crisis counselors, is a high priority. Train-the-trainer (TTT) models are widely used but understudied. Aims To assess the extent to which trainers following TTT delivered the Applied Suicide Intervention Skills Training (ASIST) program with fidelity, and to examine fidelity across two trainings and seven training segments. Methods We recorded and reliably rated trainer fidelity, defined as adherence to program content and competence of program delivery, for 34 newly trained ASIST trainers delivering the program to crisis center staff on two separate occasions. A total of 324 observations were coded. Trainer demographics were also collected. Results On average, trainers delivered two-thirds of the program. Previous training was associated with lower levels of trainer adherence to the program. 18% of trainers' observations were rated as solidly competent. Trainers did not improve fidelity from their first to second training. Significantly higher fidelity was found for lectures and lower fidelity was found for interactive training activities including asking about suicide and creating a safe plan. Conclusions We found wide variability in trainer fidelity to the ASIST program following TTT and few trainers had high levels of both adherence and competence. More research is needed to examine the cost-effectiveness of TTT models. PMID:24901061

The Core Competencies for General Orthopaedic Surgeons.

PubMed

Kellam, James F; Archibald, Douglas; Barber, James W; Christian, Eugene P; D'Ascoli, Richard J; Haynes, Richard J; Hecht, Suzanne S; Hurwitz, Shepard R; Kellam, James F; McLaren, Alexander C; Peabody, Terrance D; Southworth, Stephen R; Strauss, Robert W; Wadey, Veronica M R

2017-01-18

With the changing delivery of orthopaedic surgical care, there is a need to define the knowledge and competencies that are expected of an orthopaedist providing general and/or acute orthopaedic care. This article provides a proposal for the knowledge and competencies needed for an orthopaedist to practice general and/or acute care orthopaedic surgery. Using the modified Delphi method, the General Orthopaedic Competency Task Force consisting of stakeholders associated with general orthopaedic practice has proposed the core knowledge and competencies that should be maintained by orthopaedists who practice emergency and general orthopaedic surgery. For relevancy to clinical practice, 2 basic sets of competencies were established. The assessment competencies pertain to the general knowledge needed to evaluate, investigate, and determine an overall management plan. The management competencies are generally procedural in nature and are divided into 2 groups. For the Management 1 group, the orthopaedist should be competent to provide definitive care including assessment, investigation, initial or emergency care, operative or nonoperative care, and follow-up. For the Management 2 group, the orthopaedist should be competent to assess, investigate, and commence timely non-emergency or emergency care and then either transfer the patient to the appropriate subspecialist's care or provide definitive care based on the urgency of care, exceptional practice circumstance, or individual's higher training. This may include some higher-level procedures usually performed by a subspecialist, but are consistent with one's practice based on experience, practice environment, and/or specialty interest. These competencies are the first step in defining the practice of general orthopaedic surgery including acute orthopaedic care. Further validation and discussion among educators, general orthopaedic surgeons, and subspecialists will ensure that these are relevant to clinical practice. These competencies provide many stakeholders, including orthopaedic educators and orthopaedists, with what may be the minimum knowledge and competencies necessary to deliver acute and general orthopaedic care. This document is the first step in defining a practice-based standard for training programs and certification groups.

Student Self-Assessment and Faculty Assessment of Performance in an Interprofessional Error Disclosure Simulation Training Program.

PubMed

Poirier, Therese I; Pailden, Junvie; Jhala, Ray; Ronald, Katie; Wilhelm, Miranda; Fan, Jingyang

2017-04-01

Objectives. To conduct a prospective evaluation for effectiveness of an error disclosure assessment tool and video recordings to enhance student learning and metacognitive skills while assessing the IPEC competencies. Design. The instruments for assessing performance (planning, communication, process, and team dynamics) in interprofessional error disclosure were developed. Student self-assessment of performance before and after viewing the recordings of their encounters were obtained. Faculty used a similar instrument to conduct real-time assessments. An instrument to assess achievement of the Interprofessional Education Collaborative (IPEC) core competencies was developed. Qualitative data was reviewed to determine student and faculty perceptions of the simulation. Assessment. The interprofessional simulation training involved a total of 233 students (50 dental, 109 nursing and 74 pharmacy). Use of video recordings made a significant difference in student self-assessment for communication and process categories of error disclosure. No differences in student self-assessments were noted among the different professions. There were differences among the family member affects for planning and communication for both pre-video and post-video data. There were significant differences between student self-assessment and faculty assessment for all paired comparisons, except communication in student post-video self-assessment. Students' perceptions of achievement of the IPEC core competencies were positive. Conclusion. The use of assessment instruments and video recordings may have enhanced students' metacognitive skills for assessing performance in interprofessional error disclosure. The simulation training was effective in enhancing perceptions on achievement of IPEC core competencies. This enhanced assessment process appeared to enhance learning about the skills needed for interprofessional error disclosure.

Student Self-Assessment and Faculty Assessment of Performance in an Interprofessional Error Disclosure Simulation Training Program

PubMed Central

Pailden, Junvie; Jhala, Ray; Ronald, Katie; Wilhelm, Miranda; Fan, Jingyang

2017-01-01

Objectives. To conduct a prospective evaluation for effectiveness of an error disclosure assessment tool and video recordings to enhance student learning and metacognitive skills while assessing the IPEC competencies. Design. The instruments for assessing performance (planning, communication, process, and team dynamics) in interprofessional error disclosure were developed. Student self-assessment of performance before and after viewing the recordings of their encounters were obtained. Faculty used a similar instrument to conduct real-time assessments. An instrument to assess achievement of the Interprofessional Education Collaborative (IPEC) core competencies was developed. Qualitative data was reviewed to determine student and faculty perceptions of the simulation. Assessment. The interprofessional simulation training involved a total of 233 students (50 dental, 109 nursing and 74 pharmacy). Use of video recordings made a significant difference in student self-assessment for communication and process categories of error disclosure. No differences in student self-assessments were noted among the different professions. There were differences among the family member affects for planning and communication for both pre-video and post-video data. There were significant differences between student self-assessment and faculty assessment for all paired comparisons, except communication in student post-video self-assessment. Students’ perceptions of achievement of the IPEC core competencies were positive. Conclusion. The use of assessment instruments and video recordings may have enhanced students’ metacognitive skills for assessing performance in interprofessional error disclosure. The simulation training was effective in enhancing perceptions on achievement of IPEC core competencies. This enhanced assessment process appeared to enhance learning about the skills needed for interprofessional error disclosure. PMID:28496274

Training scholars in dissemination and implementation research for cancer prevention and control: a mentored approach.

PubMed

Padek, Margaret; Mir, Nageen; Jacob, Rebekah R; Chambers, David A; Dobbins, Maureen; Emmons, Karen M; Kerner, Jon; Kumanyika, Shiriki; Pfund, Christine; Proctor, Enola K; Stange, Kurt C; Brownson, Ross C

2018-01-22

As the field of D&I (dissemination and implementation) science grows to meet the need for more effective and timely applications of research findings in routine practice, the demand for formalized training programs has increased concurrently. The Mentored Training for Dissemination and Implementation Research in Cancer (MT-DIRC) Program aims to build capacity in the cancer control D&I research workforce, especially among early career researchers. This paper outlines the various components of the program and reports results of systematic evaluations to ascertain its effectiveness. Essential features of the program include selection of early career fellows or more experienced investigators with a focus relevant to cancer control transitioning to a D&I research focus, a 5-day intensive training institute, ongoing peer and senior mentoring, mentored planning and work on a D&I research proposal or project, limited pilot funding, and training and ongoing improvement activities for mentors. The core faculty and staff members of the MT-DIRC program gathered baseline and ongoing evaluation data regarding D&I skill acquisition and mentoring competency through participant surveys and analyzed it by iterative collective reflection. A majority (79%) of fellows are female, assistant professors (55%); 59% are in allied health disciplines, and 48% focus on cancer prevention research. Forty-three D&I research competencies were assessed; all improved from baseline to 6 and 18 months. These effects were apparent across beginner, intermediate, and advanced initial D&I competency levels and across the competency domains. Mentoring competency was rated very highly by the fellows--higher than rated by the mentors themselves. The importance of different mentoring activities, as rated by the fellows, was generally congruent with their satisfaction with the activities, with the exception of relatively greater satisfaction with the degree of emotional support and relatively lower satisfaction for skill building and opportunity initially. These first years of MT-DIRC demonstrated the program's ability to attract, engage, and improve fellows' competencies and skills and implement a multicomponent mentoring program that was well received. This account of the program can serve as a basis for potential replication and evolution of this model in training future D&I science researchers.

Curricular Innovations in Tobacco Cessation Education for Prelicensure Baccalaureate Nursing Students.

PubMed

Schwindt, Rhonda G; McNelis, Angela M; Agley, Jon

2016-08-01

Tobacco use is the primary preventable cause of morbidity and mortality in the United States, resulting in enormous health care expenditures. The burden of smoking is higher among disadvantaged populations, such as individuals with mental illness. As the largest group of health care providers, nurses must assume a leading role in tobacco control efforts to decrease the deleterious impact on health outcomes. Investigators used a randomized control group design to assess the effectiveness of a theory-based tobacco education program on the perceived competence and intrinsic motivation of prelicensure BSN students (N = 134) to engage in cessation interventions with patients with mental illness. Students completing the program reported a significant increase in perceived competence, compared with their peers who received standard instruction only. Intrinsic motivation did not increase significantly for either group. Findings suggest that the program improves students' perceived competence, but further research is needed to determine its effect on motivation and its usefulness in other health care contexts. [J Nurs Educ. 2016;55(8):425-431.]. Copyright 2016, SLACK Incorporated.

Geospatial Technology and Geosciences - Defining the skills and competencies in the geosciences needed to effectively use the technology (Invited)

NASA Astrophysics Data System (ADS)

Johnson, A.

2010-12-01

Maps, spatial and temporal data and their use in analysis and visualization are integral components for studies in the geosciences. With the emergence of geospatial technology (Geographic Information Systems (GIS), remote sensing and imagery, Global Positioning Systems (GPS) and mobile technologies) scientists and the geosciences user community are now able to more easily accessed and share data, analyze their data and present their results. Educators are also incorporating geospatial technology into their geosciences programs by including an awareness of the technology in introductory courses to advanced courses exploring the capabilities to help answer complex questions in the geosciences. This paper will look how the new Geospatial Technology Competency Model from the Department of Labor can help ensure that geosciences programs address the skills and competencies identified by the workforce for geospatial technology as well as look at new tools created by the GeoTech Center to help do self and program assessments.

Assessing nursing clinical skills competence through objective structured clinical examination (OSCE) for open distance learning students in Open University Malaysia.

PubMed

Oranye, Nelson Ositadimma; Ahmad, Che'an; Ahmad, Nora; Bakar, Rosnida Abu

2012-06-01

The objective structured clinical skills examination (OSCE) has over the years emerged as a method of evaluating clinical skills in most medical and allied professions. Although its validity and objectivity has evoked so much debate in the literature, little has been written about its application in non-traditional education systems such as in distance learning. This study examined clinical skills competence among practising nursing students who were enrolled in a distance learning programme. The study examined the effect of work and years of nursing practice on nurses' clinical skills competence. This study used observational design whereby nursing students' clinical skills were observed and scored in five OSCE stations. Two instruments were used for the data collection - A self-administered questionnaire on the students' bio-demographic data, and a check list on the clinical skills which the examiners rated on a four point scale. The findings revealed that 14% of the nurses had level four competence, which indicated that they could perform the tasks correctly and complete. However, 12% failed the OSCE, even though they had more than 10 years experience in nursing and post basic qualifications. Inter-rater reliability was 0.92 for the five examiners. Factor analysis indicated that five participant factors accounted for 74.1% of the variations in clinical skills performance. An OSCE is a necessary assessment tool that should be continuously applied in nursing education, regardless of the mode of the education program, the student's years of experience or his/her clinical placement. This study validates the need for OSCE in both the design of tertiary nursing degree programs and the assessment of nurses' clinical competency level.

The Relationship between Studying Music and Mathematics Performance on the New Jersey High School Proficiency Assessment

ERIC Educational Resources Information Center

Prokop, Kristie L.

2011-01-01

On assessments such as Trends in International Mathematics and Science Study (TIMSS) (Stigler & Hiebert, 1999) and Program for International Assessment (PISA) ("PISA 2006 Science Competencies for Tomorrow's World", 2007) students in the United States have not been performing as well in mathematics as students in other countries. In…

Technical Report of the Survey of Adult Skills (PIAAC)

ERIC Educational Resources Information Center

OECD Publishing, 2013

2013-01-01

The Programme for the International Assessment of Adult Competencies (PIAAC) has been planned as an ongoing program of assessment. The first cycle of the assessment has involved two "rounds." The first round, which is covered by this report, took place over the period of January 2008-October 2013. The main features of the first cycle of…

Incorporating active-learning techniques and competency assessment into a critical care elective course.

PubMed

Malcom, Daniel R; Hibbs, Jennifer L

2012-09-10

To design, implement, and measure the effectiveness of a critical care elective course for second-year students in a 3-year accelerated doctor of pharmacy (PharmD) program. A critical care elective course was developed that used active-learning techniques, including cooperative learning and group presentations, to deliver content on critical care topics. Group presentations had to include a disease state overview, practice guidelines, and clinical recommendations, and were evaluated by course faculty members and peers. Students' mean scores on a 20-question critical-care competency assessment administered before and after the course improved by 11% (p < 0.05). Course evaluations and comments were positive. A critical care elective course resulted in significantly improved competency in critical care and was well-received by students.

Social competence promotion with inner-city and suburban young adolescents: effects on social adjustment and alcohol use.

PubMed

Caplan, M; Weissberg, R P; Grober, J S; Sivo, P J; Grady, K; Jacoby, C

1992-02-01

This study assessed the impact of school-based social competence training on skills, social adjustment, and self-reported substance use of 282 sixth and seventh graders. Training emphasized broad-based competence promotion in conjunction with domain-specific application to substance abuse prevention. The 20-session program comprised six units: stress management, self-esteem, problem solving, substances and health information, assertiveness, and social networks. Findings indicated positive training effects on Ss' skills in handling interpersonal problems and coping with anxiety. Teacher ratings revealed improvements in Ss' constructive conflict resolution with peers, impulse control, and popularity. Self-report ratings indicated gains in problem-solving efficacy. Results suggest some preventive impact on self-reported substance use intentions and excessive alcohol use. In general, the program was found to be beneficial for both inner-city and suburban students.

Speaking across the Curriculum as an Alternative Assessment Process.

ERIC Educational Resources Information Center

Weiss, Robert O.

Speaking across the curriculum programs are a readily accessible venue for the assessment of oral communication competence and in some instances are already being used for such purposes. While so far the implementation of simple holistic judgments for quality assurance purposes has emerged as one practical procedure, further exploration should…

Student Performance in Business and Marketing Education

ERIC Educational Resources Information Center

McEwen, Beryl C.

2004-01-01

Assessments are not ends in themselves as Suskie (2002) noted. Their purpose is to indicate how effectively educational programs are meeting their goals for student learning. This paper reviews assessment data from the North Carolina Vocational Competency Achievement Tracking System (VoCATS) for business and marketing education to examine student…

Assessing Professionalism and Ethics Knowledge and Skills: Preferences of Psychiatry Residents

ERIC Educational Resources Information Center

Marrero, Isis; Bell, Michael; Dunn, Laura B.; Roberts, Laura Weiss

2013-01-01

Background: Professionalism is one of the fundamental expectations and a core competency in residency education. Although programs use a variety of evaluative methods, little is known about residents' views of and preferences regarding various methods of assessment. Method: The authors surveyed residents at seven psychiatry residency programs…

34 CFR 403.203 - What are the State's responsibilities for a State assessment?

Code of Federal Regulations, 2012 CFR

2012-07-01

...) Develop assessment criteria no later than the beginning of the 1991-1992 school year; and (2) Widely... leading to both academic and occupational competencies. (3) Increased student work skill attainment and... respect to vocational education. (7) Raising the quality of vocational education programs in schools with...

34 CFR 403.203 - What are the State's responsibilities for a State assessment?

Code of Federal Regulations, 2010 CFR

2010-07-01

...) Develop assessment criteria no later than the beginning of the 1991-1992 school year; and (2) Widely... leading to both academic and occupational competencies. (3) Increased student work skill attainment and... respect to vocational education. (7) Raising the quality of vocational education programs in schools with...

34 CFR 403.203 - What are the State's responsibilities for a State assessment?

Code of Federal Regulations, 2013 CFR

2013-07-01

...) Develop assessment criteria no later than the beginning of the 1991-1992 school year; and (2) Widely... leading to both academic and occupational competencies. (3) Increased student work skill attainment and... respect to vocational education. (7) Raising the quality of vocational education programs in schools with...

34 CFR 403.203 - What are the State's responsibilities for a State assessment?

Code of Federal Regulations, 2014 CFR

2014-07-01

...) Develop assessment criteria no later than the beginning of the 1991-1992 school year; and (2) Widely... leading to both academic and occupational competencies. (3) Increased student work skill attainment and... respect to vocational education. (7) Raising the quality of vocational education programs in schools with...

34 CFR 403.203 - What are the State's responsibilities for a State assessment?

Code of Federal Regulations, 2011 CFR

2011-07-01

...) Develop assessment criteria no later than the beginning of the 1991-1992 school year; and (2) Widely... leading to both academic and occupational competencies. (3) Increased student work skill attainment and... respect to vocational education. (7) Raising the quality of vocational education programs in schools with...

Addressing Diversity in Teacher Education Programs

ERIC Educational Resources Information Center

Valentin, Sylvia

2006-01-01

Different aspects of diversity have been explored in order to assess whether preservice teachers are being prepared to meet the needs of their diverse student population. Diversity continues to be examined in a fragmented way by looking at issues separately. It seems necessary that prior to assessing preservice teachers' competence in diversity,…

Assessment of a Multinational Online Faculty Development Program on Online Teaching: Reflections of Candidate E-Tutors

ERIC Educational Resources Information Center

Adnan, Muge; Kalelioglu, Filiz; Gulbahar, Yasemin

2017-01-01

Teaching online requires different skills, roles and competencies for online instructors compared to teaching in traditional learning environments. Universities should offer ongoing support in various forms to help academic staff through their online journey. This paper provides insights into a multinational faculty development program for…

Effectiveness of a Formal Post-Baccalaureate Pre-Medicine Program for Underrepresented Minority Students.

ERIC Educational Resources Information Center

Giordani, Bruno; Edwards, Amy S.; Segal, Stuart S.; Gillum, Linda H.; Lindsay, Angela; Johnson, Nakia

2001-01-01

Assessed the effectiveness of an intense, year-long experience of course work, research, and personal development for underrepresented minority students before medical school. Program participants demonstrated competency in the first year of medical school consistent with traditional students even though they had lower MCAT scores and college…

A Technological and Historical Consideration of Equity Issues Associated with Proposals to Change the Nation's Testing Policy.

ERIC Educational Resources Information Center

Madaus, George F.

1994-01-01

Historically, such testing programs as intelligence tests and Chapter I minimum competency testing have inadvertently perpetuated inequalities. An equitable national testing program must look beyond the mystique of testing technologies, clearly define purposes of assessment, recruit minorities into the testing field, and establish an independent…

Assessing Strategic Cultural Competency: Holistic Approaches to Student Learning through Media

ERIC Educational Resources Information Center

Hammer, Judith; Swaffar, Janet

2012-01-01

The current study investigated the impact of a German television program on changes in 4th-semester German students' reflections on cultural perceptions over the course of 1 semester. Sixty-nine students at the University of Texas at Austin watched 4 episodes of the popular German television program "Lindenstrasse". After viewing,…

A Proposed Resident's Operative Case Tracking and Evaluation System.

PubMed

Sehli, Deema N; Esene, Ignatius N; Baeesa, Saleh S

2016-03-01

Neurosurgery program trainers are continuously searching for new methods to evaluate trainees' competency besides number of cases and training duration. Recently, efforts are made on the development of reliable methods to teach competency and valid methods to measure teaching efficacy. Herein, we propose the "Resident's Operative Case Tracking and Evaluation System" (ROCTES) for the assessment and monitoring of the resident's performance quality during each procedure. We developed a data-based website and smartphone application for neurosurgical attending physicians, residents, and resident review committees in our accredited neurosurgical institutions. ROCTES runs through five steps: Login (Resident), Case Entry, Login (Attending Physician), Case Approval and Evaluation, and Report. The Resident enters each case record under "Case Entry" field and can "save," "edit," or "submit" the case data to the Attending Physician. The latter from the attending physician login profile will be able to "approve and evaluate" the resident's "knowledge," "skills," and "attitude" ranking from 1 to 15 for that particular case; add his comments and then "save," "edit," or "submit" the data, which can be viewed by users as a "report." Program Directors can also "login" to monitor the resident's progress. The implementation of this communication tool should enable the filtering and retrieval of information needed for the better assessment and monitoring of residents' exposure to variety of cases in each training center. This proposed evaluation system will provide a transparent assessment for residency training programs and should convert trainees into competent neurosurgeons. Copyright © 2016 Elsevier Inc. All rights reserved.

Clinical nurse leaders' and academics' perspectives in clinical assessment of final-year nursing students: A qualitative study.

PubMed

Wu, Xi Vivien; Enskär, Karin; Pua, Lay Hoon; Heng, Doreen Gek Noi; Wang, Wenru

2017-09-01

The nature of nursing practice is diverse; therefore, clinical assessment is a complex process. This study explores the perceptions of clinical nurse leaders and academics on clinical assessment for undergraduate nursing education during transition to practice. An explorative qualitative approach was applied. Eight nurse managers, six clinical nurse educators, and eight academics from two tertiary hospitals and a university in Singapore participated in four focus group discussions. Thematic analysis was conducted. Four overriding themes were revealed: the need for a valid and reliable clinical assessment tool, preceptors' competency in clinical assessment, challenges encountered by the students in clinical assessment, and the need for close academic and clinical collaboration to support preceptors and students. Closer academic-clinical partnership is recommended to review the clinical education curriculum. Clinical and educational institutions need to work closely to design a learning program to enhance preceptors' competence in clinical pedagogy and assessment. Furthermore, a stress management program could build students' resiliency in coping with unfamiliar clinical environments. Ongoing support needs to be provided for both preceptors and students to enrich the preceptorship and learning experiences. © 2017 John Wiley & Sons Australia, Ltd.

76 FR 50164 - Protocol Gas Verification Program and Minimum Competency Requirements for Air Emission Testing...

Federal Register 2010, 2011, 2012, 2013, 2014

2011-08-12

...-AQ06 Protocol Gas Verification Program and Minimum Competency Requirements for Air Emission Testing... correct certain portions of the Protocol Gas Verification Program and Minimum Competency Requirements for... final rule that amends the Agency's Protocol Gas Verification Program (PGVP) and the minimum competency...

Rapid Web-Based Platform for Assessment of Orthopedic Surgery Patient Care Milestones: A 2-Year Validation.

PubMed

Gundle, Kenneth R; Mickelson, Dayne T; Cherones, Arien; Black, Jason; Hanel, Doug P

To determine the validity, feasibility, and responsiveness of a new web-based platform for rapid milestone-based evaluations of orthopedic surgery residents. Single academic medical center, including a trauma center and pediatrics tertiary hospital. Forty residents (PG1-5) in an orthopedic residency program and their faculty evaluators. Residents and faculty were trained and supported in the use of a novel trainee-initiated web-based evaluation system. Residents were encouraged to use the system to track progress on patient care subcompetencies. Two years of prospectively collected data were reviewed from residents at an academic program. The primary outcome was Spearman's rank correlation between postgraduate year (PGY) and competency level achieved as a measure of validity. Secondary outcomes assessed feasibility, resident self-evaluation versus faculty evaluation, the distributions among subcompetencies, and responsiveness over time. Between February 2014 and February 2016, 856 orthopedic surgery patient care subcompetency evaluations were completed (1.2 evaluations per day). Residents promptly requested feedback after a procedure (median = 0 days, interquartile range: 0-2), and faculty responded within 2 days in 51% (median = 2 days, interquartile range: 0-13). Primary outcome showed a correlation between PGY and competency level (r = 0.78, p < 0.001), with significant differences in competency among PGYs (p < 0.001 by Kruskal-Wallis rank sum test). Self-evaluations by residents substantially agreed with faculty-assigned competency level (weighted Cohen's κ = 0.72, p < 0.001). Resident classes beginning the study as PGY1, 2, and 3 separately demonstrated gains in competency over time (Spearman's rank correlation 0.39, 0.60, 0.59, respectively, each p < 0.001). There was significant variance in the number of evaluations submitted per subcompetency (median = 43, range: 6-113) and competency level assigned (p < 0.01). Rapid tracking of trainee competency with milestone-based evaluations in a learner-centered mobile platform demonstrated validity, feasibility, and responsiveness. Next Accreditation System-mandated data may be efficiently collected and used for trainee and program self-study. Published by Elsevier Inc.

Comparison of pharmacy students' perceived and actual knowledge using the Pharmacy Curricular Outcomes Assessment.

PubMed

Naughton, Cynthia A; Friesner, Daniel L

2012-05-10

To determine whether a correlation exists between third-year PharmD students' perceived pharmacy knowledge and actual pharmacy knowledge as assessed by the Pharmacy Curricular Outcomes Assessment (PCOA). In 2010 and 2011, the PCOA was administered in a low-stakes environment to third-year pharmacy students at North Dakota State University College of Pharmacy, Nursing, and Allied Sciences (COPNAS). A survey instrument was also administered on which students self-assessed their perceived competencies in each of the core areas covered by the PCOA examination. The pharmacy students rated their competencies slightly higher than average. Performance on the PCOA was similar to but slightly higher than national averages. Correlations between each of the 4 content areas (basic biomedical sciences, pharmaceutical sciences, social/administrative sciences, and clinical sciences) mirrored those reported nationally by the National Association of Boards of Pharmacy (NABP). Student performance on the basic biomedical sciences portion of the PCOA was significantly correlated with students' perceived competencies in the biomedical sciences. No other correlations between actual and perceived competencies were significant. A lack of correlation exists between what students perceive they know and what they actually know in the areas of pharmaceutical science; social, behavioral, and administrative science; and clinical science. Therefore, additional standardized measures are needed to assess curricular effectiveness and provide comparisons among pharmacy programs.

Ethics Education Seen through the Lens of Habermas's Conception of Practical Reason: The Quebec Education Program

ERIC Educational Resources Information Center

Bouchard, Nancy; Morris, Ronald W.

2012-01-01

This paper examines the Quebec Education Program (QEP), particularly the new course in ethics and religious culture (ERC), in the light of Habermas's conception of the moral and ethical uses of practical reason. Habermas's discursive theory of morality is used to assess the program's understanding of what it means to be competent in moral matters.…

Humanizing the Technological Learning Experience: The Role of Support Services as Socialization in a Human Resource Development Distance Education Program.

ERIC Educational Resources Information Center

Hatcher, Tim; Craig, Bob

The University of Arkansas developed a distance education (DE) baccalaureate degree program in human resource development (HRD) that may serve as a model for developing DE at any level. The program, which was designed on the basis of a statewide needs assessment and competencies researched by the American Society for Training and Development, is…

Growing Our Own: A Longitudinal Evaluation of a Professional Development Program for Early-Career 4-H Professionals

ERIC Educational Resources Information Center

Varrella, Gary F.; Luckey, Brian P.; Baca, Jacqueline S.; Peters, Curt

2016-01-01

We present the results of a longitudinal evaluation of the Western Region 4-H Institute, a 5-day training program designed to enhance the skill sets of early-career Extension professionals organized around the 4-H professional research, knowledge, and competencies model. Programs such as this often are assessed for their short-term relevance and…

Relationships between social competence, psychopathology and work performance and their predictive value for vocational rehabilitation of schizophrenic outpatients.

PubMed

Hoffmann, H; Kupper, Z

1997-01-17

Earlier studies suggest that social competence has a higher predictive value for vocational outcome than psychopathology. These studies, however, show methodological shortcomings, including the fact that the instruments used for assessing social competence, psychopathology and work performance are strongly interrelated. The present study, involving a population of 34 chronically schizophrenic outpatients enrolled in a vocational rehabilitation program, was conducted in order to determine: (1) how closely the Role Play Test, the Positive and Negative Syndrome Scale and the Work Behavior Assessment Scale are related to each other; and (2) whether social competence is a better predictor of work performance and outcome of vocational rehabilitation than psychopathology. Factor analysis has revealed that the instruments are interrelated, mainly in the dimensions of negative symptoms, social relationships, non-verbal measures of social competence and conceptual disorganization. In backward regression analyses, psychopathological indicators proved to be the best predictors of work performance both cross-sectionally as well as in the longterm course. In the traditional two-syndrome model of schizophrenic psychopathology only negative symptoms were left in the regression model. In a four-dimension model the disorder of relating and the conceptual disorganization dimension were the best predictors. Differences between disorder of relating and social competence, assessed by the Role Play Test, are discussed here as well as the implications of this study for rehabilitation.

Guidelines for clinical supervision in health service psychology.

PubMed

2015-01-01

This document outlines guidelines for supervision of students in health service psychology education and training programs. The goal was to capture optimal performance expectations for psychologists who supervise. It is based on the premises that supervisors (a) strive to achieve competence in the provision of supervision and (b) employ a competency-based, meta-theoretical approach to the supervision process. The Guidelines on Supervision were developed as a resource to inform education and training regarding the implementation of competency-based supervision. The Guidelines on Supervision build on the robust literatures on competency-based education and clinical supervision. They are organized around seven domains: supervisor competence; diversity; relationships; professionalism; assessment/evaluation/feedback; problems of professional competence, and ethical, legal, and regulatory considerations. The Guidelines on Supervision represent the collective effort of a task force convened by the American Psychological Association (APA) Board of Educational Affairs (BEA). PsycINFO Database Record (c) 2015 APA, all rights reserved.

Methods of Genomic Competency Integration in Practice

PubMed Central

Jenkins, Jean; Calzone, Kathleen A.; Caskey, Sarah; Culp, Stacey; Weiner, Marsha; Badzek, Laurie

2015-01-01

Purpose Genomics is increasingly relevant to health care, necessitating support for nurses to incorporate genomic competencies into practice. The primary aim of this project was to develop, implement, and evaluate a year-long genomic education intervention that trained, supported, and supervised institutional administrator and educator champion dyads to increase nursing capacity to integrate genomics through assessments of program satisfaction and institutional achieved outcomes. Design Longitudinal study of 23 Magnet Recognition Program® Hospitals (21 intervention, 2 controls) participating in a 1-year new competency integration effort aimed at increasing genomic nursing competency and overcoming barriers to genomics integration in practice. Methods Champion dyads underwent genomic training consisting of one in-person kick-off training meeting followed by monthly education webinars. Champion dyads designed institution-specific action plans detailing objectives, methods or strategies used to engage and educate nursing staff, timeline for implementation, and outcomes achieved. Action plans focused on a minimum of seven genomic priority areas: champion dyad personal development; practice assessment; policy content assessment; staff knowledge needs assessment; staff development; plans for integration; and anticipated obstacles and challenges. Action plans were updated quarterly, outlining progress made as well as inclusion of new methods or strategies. Progress was validated through virtual site visits with the champion dyads and chief nursing officers. Descriptive data were collected on all strategies or methods utilized, and timeline for achievement. Descriptive data were analyzed using content analysis. Findings The complexity of the competency content and the uniqueness of social systems and infrastructure resulted in a significant variation of champion dyad interventions. Conclusions Nursing champions can facilitate change in genomic nursing capacity through varied strategies but require substantial training in order to design and implement interventions. Clinical Relevance Genomics is critical to the practice of all nurses. There is a great opportunity and interest to address genomic knowledge deficits in the practicing nurse workforce as a strategy to improve patient outcomes. Exemplars of champion dyad interventions designed to increase nursing capacity focus on improving education, policy, and healthcare services. PMID:25808828

Interprofessional Competencies in Integrative Primary Healthcare

PubMed Central

Brooks, Audrey J.; Maizes, Victoria; Goldblatt, Elizabeth; Klatt, Maryanna; Koithan, Mary S.; Kreitzer, Mary Jo; Lee, Jeannie K.; Lopez, Ana Marie; McClafferty, Hilary; Rhode, Robert; Sandvold, Irene; Saper, Robert; Taren, Douglas; Wells, Eden; Lebensohn, Patricia

2015-01-01

In October 2014, the National Center for Integrative Primary Healthcare (NCIPH) was launched as a collaboration between the University of Arizona Center for Integrative Medicine and the Academic Consortium for Integrative Health and Medicine and supported by a grant from the Health Resources and Services Administration. A primary goal of the NCIPH is to develop a core set of integrative healthcare (IH) competencies and educational programs that will span the interprofessional primary care training and practice spectra and ultimately become a required part of primary care education. This article reports on the first phase of the NCIPH effort, which focused on the development of a shared set of competencies in IH for primary care disciplines. The process of development, refinement, and adoption of 10 “meta-competencies” through a collaborative process involving a diverse interprofessional team is described. Team members represent nursing, the primary care medicine professions, pharmacy, public health, acupuncture, naturopathy, chiropractic, nutrition, and behavioral medicine. Examples of the discipline-specific sub-competencies being developed within each of the participating professions are provided, along with initial results of an assessment of potential barriers and facilitators of adoption within each discipline. The competencies presented here will form the basis of a 45-hour online curriculum produced by the NCIPH for use in primary care training programs that will be piloted in a wide range of programs in early 2016 and then revised for wider use over the following year. PMID:26421232

Overview of Faculty Development Programs for Interprofessional Education.

PubMed

Ratka, Anna; Zorek, Joseph A; Meyer, Susan M

2017-06-01

Objectives. To describe characteristics of faculty development programs designed to facilitate interprofessional education, and to compile recommendations for development, delivery, and assessment of such faculty development programs. Methods. MEDLINE, CINAHL, ERIC, and Web of Science databases were searched using three keywords: faculty development, interprofessional education, and health professions. Articles meeting inclusion criteria were analyzed for emergent themes, including program design, delivery, participants, resources, and assessment. Results. Seventeen articles were identified for inclusion, yielding five characteristics of a successful program: institutional support; objectives and outcomes based on interprofessional competencies; focus on consensus-building and group facilitation skills; flexibility based on institution- and participant-specific characteristics; and incorporation of an assessment strategy. Conclusion. The themes and characteristics identified in this literature overview may support development of faculty development programs for interprofessional education. An advanced evidence base for interprofessional education faculty development programs is needed.

Structured journal club as a tool to teach and assess resident competence in practice-based learning and improvement.

PubMed

Lee, Andrew G; Boldt, H Culver; Golnik, Karl C; Arnold, Anthony C; Oetting, Thomas A; Beaver, Hilary A; Olson, Richard J; Zimmerman, M Bridget; Carter, Keith

2006-03-01

To describe the use of the journal club as a tool to teach and assess competency in practice-based learning (PBL) and improvement among residents in ophthalmology. Interventional case series. Ophthalmology residents. Three academic ophthalmology residency programs in the United States. A survey was performed of self-assessed skills in PBL among residents in ophthalmology training before and after the implementation of a structured review checklist during a traditional resident journal club. The survey had 5 domains, including (A) appraise and assimilate evidence, (B) read a journal article critically, (C) use a systematic and standardized checklist, (D) apply knowledge of study designs and statistical methods, and (E) maintain a self-documented written record of compliance. The respondents scored their ability (range, 1-5). The use of a structured journal club tool was associated with a statistically significant improvement in self-assessed ability in all 5 domains. Although validity, reliability, and long-term efficacy studies are necessary, the structured journal club is one method of teaching and assessing resident competency in PBL and improvement.

Disaster Education: A Survey Study to Analyze Disaster Medicine Training in Emergency Medicine Residency Programs in the United States.

PubMed

Sarin, Ritu R; Cattamanchi, Srihari; Alqahtani, Abdulrahman; Aljohani, Majed; Keim, Mark; Ciottone, Gregory R

2017-08-01

The increase in natural and man-made disasters occurring worldwide places Emergency Medicine (EM) physicians at the forefront of responding to these crises. Despite the growing interest in Disaster Medicine, it is unclear if resident training has been able to include these educational goals. Hypothesis This study surveys EM residencies in the United States to assess the level of education in Disaster Medicine, to identify competencies least and most addressed, and to highlight effective educational models already in place. The authors distributed an online survey of multiple-choice and free-response questions to EM residency Program Directors in the United States between February 7 and September 24, 2014. Questions assessed residency background and details on specific Disaster Medicine competencies addressed during training. Out of 183 programs, 75 (41%) responded to the survey and completed all required questions. Almost all programs reported having some level of Disaster Medicine training in their residency. The most common Disaster Medicine educational competencies taught were patient triage and decontamination. The least commonly taught competencies were volunteer management, working with response teams, and special needs populations. The most commonly identified methods to teach Disaster Medicine were drills and lectures/seminars. There are a variety of educational tools used to teach Disaster Medicine in EM residencies today, with a larger focus on the use of lectures and hospital drills. There is no indication of a uniform educational approach across all residencies. The results of this survey demonstrate an opportunity for the creation of a standardized model for resident education in Disaster Medicine. Sarin RR , Cattamanchi S , Alqahtani A , Aljohani M , Keim M , Ciottone GR . Disaster education: a survey study to analyze disaster medicine training in emergency medicine residency programs in the United States. Prehosp Disaster Med. 2017;32(4):368-373.

Interprofessional Communities of Practice in Continuing Medical Education for Promoting and Sustaining Practice Change: A Prospective Cohort Study.

PubMed

Barker, Megan; Lecce, Julia; Ivanova, Anna; Zawertailo, Laurie; Dragonetti, Rosa; Selby, Peter

2018-01-01

Standard knowledge delivery formats for CME may have limited impact on long-term practice change. A community of practice (CoP) is one tool that may enhance competencies and support practice change. This study explores the utility of an interprofessional CoP as an adjunct to a CME program in tobacco addiction treatment (Training Enhancement in Applied Counselling and Health [TEACH] Project) to promote and sustain practice change. A prospective cohort design was utilized to examine the long-term impact of the TEACH CoP on practice change. An online survey was administered to TEACH-trained practitioners to assess perceived feasibility, importance, and confidence related to course competencies, involvement in TEACH CoP activities, engagement in knowledge transfer (KT), and implementation of new programming. Chi-square tests were used to detect differences in KT and program development associated with CoP participation. Course competency scores from immediate postcourse surveys and long-term follow-up surveys were compared. No significant differences in participant characteristics were found between those who did (n = 300) and did not (n = 122) participate in the TEACH CoP. Mean self-perceived competency scores were greater immediately after course than at long-term follow-up; however, self-ratings of competency in pharmacological interventions and motivational interviewing were higher at follow-up. TEACH CoP participation was associated with significantly greater engagement in KT and implementation of new programming after training. The findings from this evaluation suggest the value of interprofessional CoPs offered posttraining as a mechanism to enhance practice. CME providers should consider offering CoPs as a component of training programs to promote and sustain practice change.

Objective assessment of technique in laparoscopic colorectal surgery: what are the existing tools?

PubMed

Foster, J D; Francis, N K

2015-01-01

Assessment can improve the effectiveness of surgical training and enable valid judgments of competence. Laparoscopic colon resection surgery is now taught within surgical residency programs, and assessment tools are increasingly used to stimulate formative feedback and enhance learning. Formal assessment of technical performance in laparoscopic colon resection has been successfully applied at the specialist level in the English "LAPCO" National Training Program. Objective assessment tools need to be developed for training and assessment in laparoscopic rectal cancer resection surgery. Simulation may have a future role in assessment and accreditation in laparoscopic colorectal surgery; however, existing virtual reality models are not ready to be used for assessment of this advanced surgery.

Effects of mobile and digital support for a structured, competency-based curriculum in neurosurgery residency education.

PubMed

Gonzalez, Nestor R; Dusick, Joshua R; Martin, Neil A

2012-07-01

Changes in neurosurgical practice and graduate medical education impose new challenges for training programs. We present our experience providing neurosurgical residents with digital and mobile educational resources in support of the departmental academic activities. A weekly mandatory conference program for all clinical residents based on the Accreditation Council for Graduate Medical Education competencies, held in protected time, was introduced. Topics were taught through didactic sessions and case discussions. Faculty and residents prepare high-quality presentations, equivalent to peer-review leading papers or case reports. Presentations are videorecorded, stored in a digital library, and broadcasted through our Website and iTunes U. Residents received mobile tablet devices with remote access to the digital library, applications for document/video management, and interactive teaching tools. Residents responded to an anonymous survey, and performances on the Self-Assessment in Neurological Surgery examination before and after the intervention were compared. Ninety-two percent reported increased time used to study outside the hospital and attributed the habit change to the introduction of mobile devices; 67% used the electronic tablets as the primary tool to access the digital library, followed by 17% hospital computers, 8% home computers, and 8% personal laptops. Forty-two percent have submitted operative videos, cases, and documents to the library. One year after introducing the program, results of the Congress of Neurological Surgeons-Self-Assessment in Neurological Surgery examination showed a statistically significant improvement in global scoring and improvement in 16 of the 18 individual areas evaluated, 6 of which reached statistical significance. A structured, competency-based neurosurgical education program supported with digital and mobile resources improved reading habits among residents and performance on the Congress of Neurological Surgeons-Self-Assessment in Neurological Surgery examination.

Peer teaching in paediatrics - medical students as learners and teachers on a paediatric course.

PubMed

Schauseil-Zipf, Ulrike; Karay, Yassin; Ehrlich, Roland; Knoop, Kai; Michalk, Dietrich

2010-01-01

Peer assisted learning is known as an effective educational strategy in medical teaching. We established a peer assisted teaching program by student tutors with a focus on clinical competencies for students during their practical training on paediatric wards. It was the purpose of this study to investigate the effects of a clinical skills training by tutors, residents and consultants on students evaluations of the teaching quality and the effects of a peer teaching program on self assessed clinical competencies by the students. Medical student peers in their 6(th) year were trained by an intensive instruction program for teaching clinical skills by paediatric consultants, doctors and psychologists. 109 students in their 5(th) year (study group) participated in a peer assisted teaching program for training clinical skills in paediatrics. The skills training by student peer teachers were supervised by paediatric doctors. 45 students (control group) participated in a conventional paediatric skills training by paediatric doctors and consultants. Students from both groups, which were consecutively investigated, completed a questionnaire with an evaluation of the satisfaction with their practical training and a self assessment of their practical competencies. The paediatric skills training with student peer teachers received significantly better ratings than the conventional skills training by paediatric doctors concerning both the quality of the practical training and the support by the teaching medical staff. Self assessed learning success in practical skills was higher rated in the peer teaching program than in the conventional training. The peer assisted teaching program of paediatric skills training was rated higher by the students regarding their satisfaction with the teaching quality and their self assessment of the acquired skills. Clinical skills training by student peer teachers have to be supervised by paediatric doctors. Paediatric doctors seem to be more motivated for their own teaching tasks if they are assisted by student peer teachers. More research is needed to investigate the influence of peer teaching on the motivation of paediatric doctors to teach medical students und the academic performance of the student peers.

The Use of Authentic Assessment to Report Accountability Data on Young Children's Language, Literacy and Pre-Math Competency

ERIC Educational Resources Information Center

Gao, Xin; Grisham-Brown, Jennifer

2011-01-01

This validity study examined the validity of Assessment, Evaluation, and Programming System, 2nd Edition (AEPS®), a curriculum-based, authentic assessment for infants and young children. The primary purposes were to: a) examine whether the AEPS® is a concurrently valid tool for measuring young children's language, literacy and pre-math skills for…

Resident learning across the full range of core competencies through a transitions of care curriculum.

PubMed

Pavon, Juliessa M; Pinheiro, Sandro O; Buhr, Gwendolen T

2018-01-01

The authors developed a Transitions of Care (TOC) curriculum to teach and measure learner competence in performing TOC tasks for older adults. Internal medicine interns at an academic residency program received the curriculum, which consisted of experiential learning, self-study, and small group discussion. Interns completed retrospective pre/post surveys rating their confidence in performing five TOC tasks, qualitative open-ended survey questions, and a self-reflection essay. A subset of interns also completed follow-up assessments. For all five TOC tasks, the interns' confidence improved following completion of the TOC curriculum. Self-confidence persisted for up to 3 months later for some but not all tasks. According to the qualitative responses, the TOC curriculum provided interns with learning experiences and skills integral to performing safe care transitions. The TOC curriculum and a mixed-method assessment approach effectively teaches and measures learner competency in TOC across all six Accreditation Council for Graduate Medical Education competency domains.

Cultural Awareness Among Nursing Staff at an Academic Medical Center.

PubMed

McElroy, Jennifer; Smith-Miller, Cheryl A; Madigan, Catherine K; Li, Yin

2016-03-01

The goal is to identify areas for targeted improvement in regard to cultural awareness and competence among nursing staff and in the work environment. Many facilities have initiated programs to facilitate cultural competence development among nursing staff; however, there has been little examination of the effect of these initiatives, assessment of experienced nurses' cultural awareness, or investigation of nurse leader's role in promoting cultural competence in the literature. In this cross-sectional descriptive study, a cultural awareness survey was modified and electronically distributed to all registered nurses and assistive personnel at an academic medical center. The modified survey instrument showed good reliability and validity among the study population. Most nursing staff exhibited a moderate to high level of cultural awareness and held positive opinions about nursing leadership and the work environment with regard to cultural issues. In increasingly diverse work environments, assessing the cultural awareness of nursing staff enables nurse leaders to evaluate efforts in promoting cultural competence and to identify specific areas in which to target staff development efforts and leadership training.

Self-rated competency and education/programming needs for Care of the Older Adult with Cardiovascular Disease: a survey of the members of the Council of Cardiovascular Nursing.

PubMed

Holm, Karyn; Chyun, Deborah; Lanuza, Dorothy M

2006-01-01

An online survey, Care of the Older Adult with Cardiovascular Disease (COA-CVD), was used to describe self-rated competency in the care of the aging adult with cardiovascular disease and subsequently determine the future education and programming needs of the Council of Cardiovascular Nursing. Respondents indicated that developing relationships, patient teaching, and assessment were areas where they felt most competent. The areas of highest priority for future programming included assessment of the older adult, diagnosis of health status, deriving a plan of care, implementing a treatment plan, patient teaching, and ensuring quality care. Most stated that content relative to the care of the older adult should be available at the annual meeting, Scientific Sessions of the American Heart Association, followed by self-study modules (65%), local and regional conferences (64%), and stand-alone national conferences (53%). The conclusions are that the Council of Cardiovascular Nursing and its membership need to address the importance of care of aging adults with cardiovascular disease and stroke in future programming. Although the Scientific Sessions of the American Heart Association is an appropriate venue, efforts can be directed toward developing self-study modules and local and regional conferences. As always, there is a need to work collaboratively with the other councils of the American Heart Association and other nursing organizations who view the care of the older adult as a high priority.

Observational Measures of Implementer Fidelity for a School-based Preventive Intervention: Development, Reliability and Validity

PubMed Central

Cross, Wendi; West, Jennifer; Wyman, Peter A.; Schmeelk-Cone, Karen; Xia, Yinglin; Tu, Xin; Teisl, Michael; Brown, C. Hendricks; Forgatch, Marion

2014-01-01

Current measures of implementer fidelity often fail to adequately measure core constructs of adherence and competence, and their relationship to outcomes can be mixed. To address these limitations, we used observational methods to assess these constructs and their relationships to proximal outcomes in a randomized trial of a school-based preventive intervention (Rochester Resilience Project) designed to strengthen emotion self-regulation skills in 1st–3rd graders with elevated aggressive-disruptive behaviors. Within the intervention group (n = 203), a subsample (n = 76) of students was selected to reflect the overall sample. Implementers were 10 paraprofessionals. Videotaped observations of three lessons from Year 1 of the intervention (14 lessons) were coded for each implementer-child dyad on Adherence (content) and Competence (quality). Using multi-level modeling we examined how much of the variance in the fidelity measures was attributed to implementer and to the child within implementer. Both measures had large and significant variance accounted for by implementer (Competence, 68%; Adherence, 41%); child within implementer did not account for significant variance indicating that ratings reflected stable qualities of the implementer rather than the child. Raw Adherence and Competence scores shared 46% of variance (r = .68). Controlling for baseline differences and age, the amount (Adherence) and quality (Competence) of program delivered predicted children’s enhanced response to the intervention on both child and parent reports after six months, but not on teacher report of externalizing behavior. Our findings support the use of multiple observations for measuring fidelity and that adherence and competence are important components of fidelity which could be assessed by many programs using these methods. PMID:24736951

Assessing Health Professional Students' Cultural Competence Using a Global Perspective.

PubMed

Jones, Sophia; Pinto-Zipp, Genevieve

2017-01-01

The United States has become a diverse society, and healthcare professionals must view culture from a global perspective. The purpose of this study was to determine cultural competence levels of entering and exiting health science students within and across differing professional programs using the Global Worldview Cultural Competence Survey (GWCCS). 196 students participated in the study: 146 were entering students and 59 were exiting students. From the 146 entering students, 138 surveys were usable in the data analysis, and 58 of the 59 exiting were usable. Two separate cohorts of health professional students completed the GWCCS. Cohort 1 completed the GWCCS during the first 2 weeks of their academic program, and Cohort 2 completed the GWCCS in their final-year post-clinical experience. A significant difference in GWCCS total score was observed between entering and exiting students in health sciences, with the exiting students being more culturally competent. Although this study did not utilize a longitudinal study design, the findings demonstrate that the exiting cohort of health science students was more culturally competent than the entering cohort of health science students as determined by the GWCCS. However, neither cohort of students reached the level of proficiency.

Identifying interprofessional global health competencies for 21st-century health professionals.

PubMed

Jogerst, Kristen; Callender, Brian; Adams, Virginia; Evert, Jessica; Fields, Elise; Hall, Thomas; Olsen, Jody; Rowthorn, Virginia; Rudy, Sharon; Shen, Jiabin; Simon, Lisa; Torres, Herica; Velji, Anvar; Wilson, Lynda L

2015-01-01

At the 2008 inaugural meeting of the Consortium of Universities for Global Health (CUGH), participants discussed the rapid expansion of global health programs and the lack of standardized competencies and curricula to guide these programs. In 2013, CUGH appointed a Global Health Competency Subcommittee and charged this subcommittee with identifying broad global health core competencies applicable across disciplines. The purpose of this paper is to describe the Subcommittee's work and proposed list of interprofessional global health competencies. After agreeing on a definition of global health to guide the Subcommittee's work, members conducted an extensive literature review to identify existing competencies in all fields relevant to global health. Subcommittee members initially identified 82 competencies in 12 separate domains, and proposed four different competency levels. The proposed competencies and domains were discussed during multiple conference calls, and subcommittee members voted to determine the final competencies to be included in two of the four proposed competency levels (global citizen and basic operational level - program oriented). The final proposed list included a total of 13 competencies across 8 domains for the Global Citizen Level and 39 competencies across 11 domains for the Basic Operational Program-Oriented Level. There is a need for continued debate and dialog to validate the proposed set of competencies, and a need for further research to identify best strategies for incorporating these competencies into global health educational programs. Future research should focus on implementation and evaluation of these competencies across a range of educational programs, and further delineating the competencies needed across all four proposed competency levels. Copyright © 2015 The Authors. Published by Elsevier Inc. All rights reserved.

Competency-based education: a new model for teaching orthopaedics.

PubMed

Alman, Benjamin A; Ferguson, Peter; Kraemer, William; Nousiainen, Markku T; Reznick, Richard K

2013-01-01

The current methods used to train residents to become orthopaedic surgeons are based on tradition, not evidence-based models. Educators have only a limited ability to assess trainees for competency using validated tests in various domains. The reduction in resident work hours limits the time available for clinical training, which has resulted in some calls for lengthening the training process. Another approach to address limited training hours is to focus training in a program that allows residents to graduate from a rotation based on demonstrated competency rather than on time on a service. A pilot orthopaedic residency curriculum, which uses a competency-based framework of resident training and maximizes the use of available training hours, has been designed and is being implemented.

The Importance of Military Cultural Competence.

PubMed

Meyer, Eric G; Writer, Brian W; Brim, William

2016-03-01

Military cultural competence has recently gained national attention. Experts have posited that limited outcomes in the treatment of posttraumatic stress disorder and depression in the military may be related to limited familiarity with the military. National surveys have indicated low military cultural competence among providers and limited educational efforts on military culture or pertinent military pathology in medical schools and residency training programs. Military families, with their own unique military cultural identity, have been identified as a population with increased risks associated with deployment. In response to these findings, several curricula regarding military culture have been established and widely distributed. Assessments of military cultural competence have also been developed. The clinical impact of enhanced cultural competence in general has thus far been limited. The military, however, with its highly prescribed cultural identity, may be a model culture for further study.

Errare Humanum Est! A Socio-Psychological Approach to a "Climbing Mount Fuji" PISA Question

ERIC Educational Resources Information Center

Selleri, Patrizia; Carugati, Felice

2018-01-01

There is a consensus that the items proposed by the Program for International Student Assessment (PISA) program allow us to focus on the outcomes of the processes of appropriation and transformation of learning tools at the end of compulsory schooling, particularly regarding the key competencies for lifelong learning and citizenship in digital…

Improving Dyadic Coping in Couples with a Stress-Oriented Approach: A 2-Year Longitudinal Study

ERIC Educational Resources Information Center

Bodenmann, Guy; Pihet, Sandrine; Shantinath, Shachi D.; Cina, Annette; Widmer, Kathrin

2006-01-01

This study sought to assess the effectiveness of a marital distress prevention program for couples by examining how marital quality, especially marital competencies such as dyadic coping, could be improved by means of a prevention program focusing on the enhancement of coping resources (Couples Coping Enhancement Training). The study consisted of…

Does Affirmative Training Matter? Assessing CFT Students' Beliefs about Sexual Orientation and Their Level of Affirmative Training

ERIC Educational Resources Information Center

Rock, Monica; Carlson, Thomas Stone; McGeorge, Christi R.

2010-01-01

This study examined couple and family therapy (CFT) students' beliefs about sexual orientation, their self-reported competency working with lesbian, gay, and bisexual (LGB) clients, and the level of affirmative training students received in their CFT programs. One hundred and ninety students from accredited CFT programs completed the study. While…

National IQs Predict Educational Attainment in Math, Reading and Science across 56 Nations

ERIC Educational Resources Information Center

Lynn, Richard; Mikk, Jaan

2009-01-01

The results of the 2006 PISA (Program for International Student Assessment) study of reading comprehension, mathematical ability, and science understanding administered to 15 year olds in 56 countries [OECD (2007). PISA 2006: Science Competencies for Tomorrow's World. Paris: OECD.] are examined to assess the predictive validity of the national IQs…

Assessment of Competencies of EMR and LD Children for Screening and Instructional Planning.

ERIC Educational Resources Information Center

Rentz, Charlotte C.

The CIRCUS Assessment battery has been demonstrated to be very effective when used by teachers in conventional preschool programs, with typical students. This discussion investigates the feasibility of using CIRCUS with educationally handicapped children: (1) for the early identification of educable mentally retarded (EMR) or learning disabled…

Internationalizing the Assessment Criteria to Build Cross-Cultural Competency: American and Chinese Educational Encounters

ERIC Educational Resources Information Center

Witte, Anne E.; Sequeira, Isabelle; Fonteyne, Charlotte

2003-01-01

International business programs, universities with international students, and educators who seek to internationalize their teaching need to make informed decisions about teaching, testing, and assessment criteria. The infusion of American business curricula throughout the world as well as the need to train American business students for…

Occupational Competency Profile for Health Occupations Education Program: Health Agency Assessment. Information Series: Report No. 10.

ERIC Educational Resources Information Center

Walters, Norma J.

This assessment instrument is intended to provide health occupations teachers and state departments of education with information needed to revise and improve the curriculum used in training prospective health occupations teachers and in updating certification requirements for practicing health care professionals. The profile lists the…

Self-Perceived End-of-Life Care Competencies of Health-Care Providers at a Large Academic Medical Center.

PubMed

Montagnini, Marcos; Smith, Heather M; Price, Deborah M; Ghosh, Bidisha; Strodtman, Linda

2018-01-01

In the United States, most deaths occur in hospitals, with approximately 25% of hospitalized patients having palliative care needs. Therefore, the provision of good end-of-life (EOL) care to these patients is a priority. However, research assessing staff preparedness for the provision of EOL care to hospitalized patients is lacking. To assess health-care professionals' self-perceived competencies regarding the provision of EOL care in hospitalized patients. Descriptive study of self-perceived EOL care competencies among health-care professionals. The study instrument (End-of-Life Questionnaire) contains 28 questions assessing knowledge, attitudes, and behaviors related to the provision of EOL care. Health-care professionals (nursing, medicine, social work, psychology, physical, occupational and respiratory therapist, and spiritual care) at a large academic medical center participated in the study. Means were calculated for each item, and comparisons of mean scores were conducted via t tests. Analysis of variance was used to identify differences among groups. A total of 1197 questionnaires was completed. The greatest self-perceived competency was in providing emotional support for patients/families, and the least self-perceived competency was in providing continuity of care. When compared to nurses, physicians had higher scores on EOL care attitudes, behaviors, and communication. Physicians and nurses had higher scores on most subscales than other health-care providers. Differences in self-perceived EOL care competencies were identified among disciplines, particularly between physicians and nurses. The results provide evidence for assessing health-care providers to identify their specific training needs before implementing educational programs on EOL care.

How was the intern year?: self and clinical assessment of four cohorts, from two medical curricula

PubMed Central

2014-01-01

Background Problem-based curricula have provoked controversy amongst educators and students regarding outcome in medical graduates, supporting the need for longitudinal evaluation of curriculum change. As part of a longitudinal evaluation program at the University of Adelaide, a mixed method approach was used to compare the graduate outcomes of two curriculum cohorts: traditional lecture-based ‘old’ and problem-based ‘new’ learning. Methods Graduates were asked to self-assess preparedness for hospital practice and consent to a comparative analysis of their work-place based assessments from their intern year. Comparative data were extracted from 692 work-place based assessments for 124 doctors who graduated from the University of Adelaide Medical School between 2003 and 2006. Results Self-assessment: Overall, graduates of the lecture-based curriculum rated the medical program significantly higher than graduates of the problem-based curriculum. However, there was no significant difference between the two curriculum cohorts with respect to their preparedness in 13 clinical skills. There were however, two areas where the cohorts rated their preparedness in the 13 broad practitioner competencies as significantly different: problem-based graduates rated themselves as better prepared in their ‘awareness of legal and ethical issues’ and the lecture-based graduates rated themselves better prepared in their ‘understanding of disease processes’. Work-place based assessment: There were no significant differences between the two curriculum cohorts for ‘Appropriate Level of Competence’ and ‘Overall Appraisal’. Of the 14 work-place based assessment skills assessed for competence, no significant difference was found between the cohorts. Conclusions The differences in the perceived preparedness for hospital practice of two curriculum cohorts do not reflect the work-place based assessments of their competence as interns. No significant difference was found between the two cohorts in relation to their knowledge and clinical skills. However results suggest a trend in ‘communication with peers and colleagues in other disciplines’ (χ2 (3, N = 596) =13.10, p = 0.056) that requires further exploration. In addition we have learned that student confidence in a new curriculum may impact on their self-perception of preparedness, while not affecting their actual competence. PMID:24961171

77 FR 36550 - Advisory Committee on Training in Primary Care Medicine and Dentistry; Notice of Meeting

Federal Register 2010, 2011, 2012, 2013, 2014

2012-06-19

...-supported program is to train clinical educators on methods to teach and assess trainee competencies for...'s development of performance measures and methods of longitudinal evaluation for Public Health...

Competence in pediatric urology upon graduation from residency: perceptions of residents, program directors and pediatric urologists.

PubMed

Mickelson, Jennifer J; Macneily, Andrew E; Samarasekera, Dinesh; Beiko, Darren; Afshar, Kourosh

2008-06-01

We aimed to clarify the scope of pediatric urological procedures that Canadian urology residents are perceived to be competent to perform upon graduation. We conducted a survey from April 2005 to June 2006 of urology residency program directors (UPDs), senior urology residents (SURs) and Pediatric Urologists of Canada (PUC) members from all 12 Canadian training programs. Questions focused on which of 23 pediatric urological procedures the 3 study groups perceived urology residents would be competent to perform upon completion of residency without further fellowship training. Procedures were based on the "A," "B" and "C" lists of procedures (least complex to most complex) as outlined in the Royal College of Physicians and Surgeons of Canada Objectives of Training in Urology. Response rates were 12/12 (100%), 41/53 (77%) and 17/23 (74%) for UPDs, SURs and PUC members, respectively. Average exposure to pediatric urology during residency was 5.4 (range 3-9) months and considered sufficient by 75% of UPDs and 69% of SURs, but only 41% of PUC members (p = 0.05). Overall, the 3 groups disagreed on the level of competence for performing level "A" and "B" procedures, with significant disagreement between PUC members and UPDs as well as SURs (p < 0.005). PUC members perceive Canadian urology residents' exposure to pediatric urology as insufficient and their competence for procedures of low to moderate complexity as inadequate. Further investigation regarding exposure to and competence in other emerging subspecialty spheres of urology may be warranted. Ongoing assessment of the objectives for training in pediatric urology is required.

Executive competencies in healthcare administration: preceptors of the Army-Baylor University Graduate Program.

PubMed

Finstuen, Kenn; Mangelsdorff, A David

2006-01-01

The purpose of this research was to identify the mentoring and executive competencies required among preceptors of the Army-Baylor University Graduate Program in Health and Business Administration, and to specify the requisite skills, knowledge, and abilities (SKAs) needed to achieve those competencies. In the first wave of inquiry, a list of 123 competencies and associated SKAs was elicited from a network of 80 current and past preceptor executives employing a Delphi methodology using e-mail. An expert panel, which consisted of seven past program directors, examined and sorted the list into four preceptor content domains, viz., Health Systems Management (HS Management), Leadership, Residency Administration, and Community Involvement. Frequency analyses showed that the HS Management domain constituted over half of the competencies, with particular emphasis on strategic thinking, planning, billing, finance, manpower, and contracting. In the second wave, the preceptor Delphi network reviewed the expertpanel list and made 7-pointSKA importance ratings on an 80-item structured questionnaire representative of the four domains. Findings indicated thataverage SKA ratings were reliable and agreed upon to a high degree among preceptors. Results, rank ordered by SKA item means within preceptor content domains and overall, suggested that the most important rated items centered on teamwork, negotiation, interpersonal skills, communication, leadership vision, and customer and healthcare business operations. Outcomes from the competency list are expected to be useful for preceptor mentoring, self-assessment, and for professional development. Additionally, specific SKAs can provide a means for developing job requirements and career performance criteria at a behavioral task level, and can contribute information for identifying continuing education and conference topical needs.

Competency-Based Employability Skills Program.

ERIC Educational Resources Information Center

North Carolina State Dept. of Public Instruction, Raleigh. Div. of Vocational Education.

This guide is intended for use in incorporating competency-based employability skills curricula into vocational and technical education programs. The guide is divided into five sections. The first is a competency listing that includes the competencies identified as necessary for students participating in an employability skills program and a…

Para Candidatos en Programas de Centros de Cuidado y Educacion Infantil con Bebes y "Toddlers": Asociado en Desarrollo Infantil Sistema de Evaluacion y Normas de Competencia CDA (Infant/Toddler Caregivers in Center-Based Programs: The Child Development Associate Assessment System and Competency Standards).

ERIC Educational Resources Information Center

Council for Early Childhood Professional Recognition, Washington, DC.

This Spanish-language booklet outlines the requirements of the Child Development Associate (CDA) credential for caregivers working in center-based infant and toddler day care programs. Part 1 provides an overview of the CDA credentialing system and the various options, settings, standards, and stages of the CDA assessment system. Part 2 explains…

Psychological Assessment Training in Clinical Psychology Doctoral Programs.

PubMed

Mihura, Joni L; Roy, Manali; Graceffo, Robert A

2017-01-01

We surveyed American Psychological Association-accredited clinical psychology doctoral programs' (n = 83) training in psychological assessment-specifically, their coverage of various assessment topics and tests in courses and practica, and whether the training was optional or required. We report results overall and separately per training model (clinical science, scientist-practitioner, and practitioner-focused). Overall, our results suggest that psychological assessment training is as active, or even more active, than in previous years. Areas of increased emphasis include clinical interviewing and psychometrics; multimethod, outcomes, health, and collaborative or therapeutic assessment; and different types of cognitive and self-report personality tests. All or almost all practice-focused programs offered training with the Thematic Apperception Test and Rorschach compared to about half of the scientist-practitioner programs and a third of the clinical science programs. Although almost all programs reported teaching multimethod assessment, what constitutes different methods of assessing psychopathology should be clarified in future studies because many programs appear to rely on one method-self-report (especially clinical science programs). Although doctoral programs covered many assessment topics and tests in didactic courses, there appears to be a shortage of program-run opportunities for students to obtain applied assessment training. Finally, we encourage doctoral programs to be familiar with (a) internships' assessment expectations and opportunities, (b) the professional guidelines for assessment training, and (c) the American Psychological Association's requirements for preinternship assessment competencies.

Guidelines for Biosafety Training Programs for Workers Assigned to BSL-3 Research Laboratories.

PubMed

Homer, Lesley C; Alderman, T Scott; Blair, Heather Ann; Brocard, Anne-Sophie; Broussard, Elaine E; Ellis, Robert P; Frerotte, Jay; Low, Eleanor W; McCarthy, Travis R; McCormick, Jessica M; Newton, JeT'Aime M; Rogers, Francine C; Schlimgen, Ryan; Stabenow, Jennifer M; Stedman, Diann; Warfield, Cheryl; Ntiforo, Corrie A; Whetstone, Carol T; Zimmerman, Domenica; Barkley, Emmett

2013-03-01

The Guidelines for Biosafety Training Programs for Workers Assigned to BSL-3 Research Laboratories were developed by biosafety professionals who oversee training programs for the 2 national biocontainment laboratories (NBLs) and the 13 regional biocontainment laboratories (RBLs) that participate in the National Institute of Allergy and Infectious Diseases (NIAID) NBL/RBL Network. These guidelines provide a general training framework for biosafety level 3 (BSL-3) high-containment laboratories, identify key training concepts, and outline training methodologies designed to standardize base knowledge, understanding, and technical competence of laboratory personnel working in high-containment laboratories. Emphasis is placed on building a culture of risk assessment-based safety through competency training designed to enhance understanding and recognition of potential biological hazards as well as methods for controlling these hazards. These guidelines may be of value to other institutions and academic research laboratories that are developing biosafety training programs for BSL-3 research.

Cultural competence in mental health nursing: validity and internal consistency of the Portuguese version of the multicultural mental health awareness scale-MMHAS.

PubMed

de Almeida Vieira Monteiro, Ana Paula Teixeira; Fernandes, Alexandre Bastos

2016-05-17

Cultural competence is an essential component in rendering effective and culturally responsive services to culturally and ethnically diverse clients. Still, great difficulty exists in assessing the cultural competence of mental health nurses. There are no Portuguese validated measurement instruments to assess cultural competence in mental health nurses. This paper reports a study testing the reliability and validity of the Portuguese version of the Multicultural Mental Health Awareness Scale-MMHAS in a sample of Portuguese nurses. Following a standard forward/backward translation into Portuguese, the adapted version of MMHAS, along with a sociodemographic questionnaire, were applied to a sample of 306 Portuguese nurses (299 males, 77 females; ages 21-68 years, M = 35.43, SD = 9.85 years). A psychometric research design was used with content and construct validity and reliability. Reliability was assessed using internal consistency and item-total correlations. Construct validity was determined using factor analysis. The factor analysis confirmed that the Portuguese version of MMHAS has a three-factor structure of multicultural competencies (Awareness, Knowledge, and Skills) explaining 59.51% of the total variance. Strong content validity and reliability correlations were demonstrated. The Portuguese version of MMHAS has a strong internal consistency, with a Cronbach's alpha of 0.958 for the total scale. The results supported the construct validity and reliability of the Portuguese version of MMHAS, proving that is a reliable and valid measure of multicultural counselling competencies in mental health nursing. The MMHAS Portuguese version can be used to evaluate the effectiveness of multicultural competency training programs in Portuguese-speaking mental health nurses. The scale can also be a useful in future studies of multicultural competencies in Portuguese-speaking nurses.

Cultural Competence for Evaluators: A Guide for Alcohol and Other Drug Abuse Prevention Practitioners Working with Ethnic/Racial Communities. OSAP Cultural Competence Series 1.

ERIC Educational Resources Information Center

Orlandi, Mario A., Ed.; And Others

As an introduction to a series on the array of issues in the implementation and evaluation of substance abuse prevention programs, this volume attempts to integrate two types of competence for alcohol and other drug abuse prevention program practitioners: program evaluation competence and cultural competence. The chapters in this document provide…

Overview of Faculty Development Programs for Interprofessional Education

PubMed Central

Zorek, Joseph A.; Meyer, Susan M.

2017-01-01

Objectives. To describe characteristics of faculty development programs designed to facilitate interprofessional education, and to compile recommendations for development, delivery, and assessment of such faculty development programs. Methods. MEDLINE, CINAHL, ERIC, and Web of Science databases were searched using three keywords: faculty development, interprofessional education, and health professions. Articles meeting inclusion criteria were analyzed for emergent themes, including program design, delivery, participants, resources, and assessment. Results. Seventeen articles were identified for inclusion, yielding five characteristics of a successful program: institutional support; objectives and outcomes based on interprofessional competencies; focus on consensus-building and group facilitation skills; flexibility based on institution- and participant-specific characteristics; and incorporation of an assessment strategy. Conclusion. The themes and characteristics identified in this literature overview may support development of faculty development programs for interprofessional education. An advanced evidence base for interprofessional education faculty development programs is needed. PMID:28720924

The PLUNGE randomized controlled trial: evaluation of a games-based physical activity professional learning program in primary school physical education.

PubMed

Miller, Andrew; Christensen, Erin M; Eather, Narelle; Sproule, John; Annis-Brown, Laura; Lubans, David Revalds

2015-05-01

To evaluate the efficacy of the Professional Learning for Understanding Games Education (PLUNGE) program on fundamental movement skills (FMS), in-class physical activity and perceived sporting competence. A cluster-randomized controlled trial involving one year six class each from seven primary schools (n=168; mean age=11.2 years, SD=1.0) in the Hunter Region, NSW, Australia. In September (2013) participants were randomized by school into the PLUNGE intervention (n=97 students) or the 7-week wait-list control (n=71) condition. PLUNGE involved the use of Game Centered curriculum delivered via an in-class teacher mentoring program. Students were assessed at baseline and 8-week follow-up for three object control FMS (Test of Gross Motor Development 2), in-class physical activity (pedometer steps/min) and perceived sporting competence (Self-perception Profile for Children). Linear mixed models revealed significant group-by-time intervention effects (all p<0.05) for object control competency (effect size: d=0.9), and in-class pedometer steps/min (d=1.0). No significant intervention effects (p>0.05) were observed for perceived sporting competence. The PLUNGE intervention simultaneously improved object control FMS proficiency and in-class PA in stage three students. Copyright © 2015 Elsevier Inc. All rights reserved.

Exploring the acquisition of entry-to-practice competencies by second-degree nursing students during a preceptorship experience.

PubMed

Sedgwick, Monique; Kellett, Peter; Kalischuck, Ruth Grant

2014-03-01

Nursing programs across Canada have begun to implement at an unprecedented rate second-degree nursing programs in response to consumer demands and a nursing shortage. While these types of programs are enjoying considerable popularity among prospective students and employers, it is imperative that nursing programs assess their graduates' ability to meet Registered Nursing entry-to-practice competencies (ETCs). This study sought to determine if second-degree undergraduate nursing students achieved the entry-to-practice competencies established by the provincial regulatory body for registered nurses of Alberta, Canada. The study took place in southern Alberta, Canada as the first cohort of second-degree undergraduate nursing students were completing the final practice course for the program. In this exploratory study, quantitative and qualitative data generation approaches were used. Quantitative data were collected using the nursing program's standardized Clinical Evaluation Tool which is mapped to the 119 ETCs established by the regulatory body. Qualitative data were generated by conducting focus group interviews with students, faculty advisors, and preceptors. A convenience sample consisting of both male and female students (n=14) submitted their mid-term and final clinical evaluations for inclusion in the dataset. Thirteen preceptors submitted mid-term and final clinical evaluations. Three students, three faculty advisors, and two preceptors participated in focus group interviews. At mid-term, statistically significant differences were noted on 31% of the indicators within the clinical evaluation tool between students and preceptors with preceptors consistently ranking students higher than the students' ratings of their performance. Student and preceptor ratings of students' clinical performance were more consistent on the final evaluation. However, where there were differences, preceptors rated students higher than student ratings. Qualitative data analysis suggests that the concept of competence is complex and multifaceted and understood differently by students, preceptors, and advisors. The findings of this study suggest that there is ambiguity among second-degree students, preceptors and faculty advisors surrounding the concept of competence. In order to develop an understanding of competence, nursing program administrators must encourage faculty advisors, preceptors and students to engage in a discussion at the outset of the preceptored practice experience in regard to what is meant by competence within various practice setting. Further, we suggest nursing programs in collaboration with their clinical partners and re-examine their practice evaluation tools to determine the degree to which they are sensitive to the clinical practice context. Copyright © 2013 Elsevier Ltd. All rights reserved.

Defining and assessing professional competence.

PubMed

Epstein, Ronald M; Hundert, Edward M

2002-01-09

Current assessment formats for physicians and trainees reliably test core knowledge and basic skills. However, they may underemphasize some important domains of professional medical practice, including interpersonal skills, lifelong learning, professionalism, and integration of core knowledge into clinical practice. To propose a definition of professional competence, to review current means for assessing it, and to suggest new approaches to assessment. We searched the MEDLINE database from 1966 to 2001 and reference lists of relevant articles for English-language studies of reliability or validity of measures of competence of physicians, medical students, and residents. We excluded articles of a purely descriptive nature, duplicate reports, reviews, and opinions and position statements, which yielded 195 relevant citations. Data were abstracted by 1 of us (R.M.E.). Quality criteria for inclusion were broad, given the heterogeneity of interventions, complexity of outcome measures, and paucity of randomized or longitudinal study designs. We generated an inclusive definition of competence: the habitual and judicious use of communication, knowledge, technical skills, clinical reasoning, emotions, values, and reflection in daily practice for the benefit of the individual and the community being served. Aside from protecting the public and limiting access to advanced training, assessments should foster habits of learning and self-reflection and drive institutional change. Subjective, multiple-choice, and standardized patient assessments, although reliable, underemphasize important domains of professional competence: integration of knowledge and skills, context of care, information management, teamwork, health systems, and patient-physician relationships. Few assessments observe trainees in real-life situations, incorporate the perspectives of peers and patients, or use measures that predict clinical outcomes. In addition to assessments of basic skills, new formats that assess clinical reasoning, expert judgment, management of ambiguity, professionalism, time management, learning strategies, and teamwork promise a multidimensional assessment while maintaining adequate reliability and validity. Institutional support, reflection, and mentoring must accompany the development of assessment programs.

Effectiveness of an oral health program in improving the knowledge and competencies of head start staff.

PubMed

Chinn, Courtney Hugh

2011-01-01

Head Start and Early Head Start (HS/EHS) programs have partnered with the American Academy of Pediatric Dentistry to promote oral health and increase access to dental homes. Preparing HS/EHS staff for issues related to pediatric oral health promises to improve effectiveness of this collaboration. This paper's purpose was to describe the Columbia Head Start Oral Health Program (C-HSOHP) and changes in HS/EHS staff pediatric oral health knowledge and competencies after participating in C-HSOHP. Four HS/EHS grantees in New York City engaged in the 2008-09 C-HSOHP. A convenience sample of 61 staff completed pre- and postself assessments of knowledge and competencies. Significant paired mean improvements were found for staff-reported level of preparation to explain dental issues during pregnancy, the tooth decay process, and preparing parents for their child's first dental visit. Significant improvements were found in staff confidence in teaching parents about children's oral health issues, referring for pediatric dental services, and talking to a dentist about a concern. The Columbia Head Start Oral Health Program was effective in improving Head Start/Early Head Start staff self-confidence and self-perceived preparedness in teaching parents about oral health, applying oral health knowledge to HS/EHS programs, communicating with dental professionals, and improving access to pediatric dental services.

Changes in Perceived Supervision Quality After Introduction of Competency-Based Orthopedic Residency Training: A National 6-Year Follow-Up Study.

PubMed

van Vendeloo, Stefan N; Brand, Paul L P; Kollen, Boudewijn J; Verheyen, Cees C P M

2018-04-27

To evaluate the perceived quality of the learning environment, before and after introduction of competency-based postgraduate orthopedic education. From 2009 to 2014, we conducted annual surveys among Dutch orthopedic residents. The validated Dutch Residency Educational Climate Test (D-RECT, 50 items on 11 subscales) was used to assess the quality of the learning environment. Scores range from 1 (poor) to 5 (excellent). Dynamic cohort follow-up study. All Dutch orthopedic residents were surveyed during annual compulsory courses. Over the 6-year period, 641 responses were obtained (response rate 92%). Scores for "supervision" (95% CI for difference 0.06-0.28, p = 0.002) and "coaching and assessment" (95% CI 0.11-0.35, p < 0.001) improved significantly after introduction of competency-based training. There was no significant change in score on the other subscales of the D-RECT. After the introduction of some of the core components of competency-based postgraduate orthopedic education the perceived quality of "supervision" and "coaching and assessment" improved significantly. Copyright © 2018 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Geriatric core competencies for family medicine curriculum and enhanced skills: care of elderly.

PubMed

Charles, Lesley; Triscott, Jean A C; Dobbs, Bonnie M; McKay, Rhianne

2014-06-01

There is a growing mandate for Family Medicine residency programs to directly assess residents' clinical competence in Care of the Elderly (COE). The objectives of this paper are to describe the development and implementation of incremental core competencies for Postgraduate Year (PGY)-I Integrated Geriatrics Family Medicine, PGY-II Geriatrics Rotation Family Medicine, and PGY-III Enhanced Skills COE for COE Diploma residents at a Canadian University. Iterative expert panel process for the development of the core competencies, with a pre-defined process for implementation of the core competencies. Eighty-five core competencies were selected overall by the Working Group, with 57 core competencies selected for the PGY-I/II Family Medicine residents and an additional 28 selected for the PGY-III COE residents. The core competencies follow the CanMEDS Family Medicine roles. Both sets of core competencies are based on consensus. Due to demographic changes, it is essential that Family Physicians have the required skills and knowledge to care for the frail elderly. The core competencies described were developed for PGY-I/II Family Medicine residents and PGY-III Enhanced Skills COE, with a focus on the development of geriatric expertise for those patients that would most benefit.

The development of a cultural standardized patient examination for a general surgery residency program.

PubMed

Chun, Maria B J; Young, Keane G M; Honda, Andrea F; Belcher, Gary F; Maskarinec, Gregory G

2012-01-01

Cultural competency and cross-cultural care issues in surgery resident education are areas of recognized need. The Accreditation Council for Graduate Medical Education (ACGME) has developed 6 core competencies addressing training to provide high quality care. Of these, cultural training is addressed under 3: patient care, professionalism, and interpersonal and communication skills. Our study sought to develop a measurable tool-a cultural standardized patient (SP) examination-that integrates cross-cultural care issues within the core competencies. All first year surgery residents (PGY-1) were required to participate in the videotaped cultural SP examination as part of the general surgery residency curriculum. Two measures were utilized to assess resident performance. On the same day, we administered a Cross-Cultural Care Survey. The SP examination was assessed by trained surgery teaching faculty using a written checklist that was developed to evaluate residents on all 6 ACGME competencies. Of the 26 eligible participants over 2 years, we were able to analyze the pre- and post-test results for 24 residents. The post-test score of the "attitude toward cross-cultural care" subscale of the Cross-Cultural Care Survey was significantly lower than the pre-test score (p = 0.012; Wilcoxon signed-ranks test). There were significant differences by ethnicity on all 3 subscales of the Cross-Cultural Care Survey (attitude = p < 0.05, knowledge = p < 0.01, skills = p < 0.05) on the pre-test. However, only the knowledge subscale scores remained significantly different between ethnicities on the post-test (p < 0.01). After additional assessment, evaluation, and refinement, our goal is to incorporate cross-cultural health care training as a permanent part of our curriculum. Our hope is that efforts to provide training in cross-cultural healthcare leads to high quality care and positive outcomes for the patient. This will not only enhance our training program, but may also become a useful tool for other surgery residency programs. Copyright © 2012 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.

Competencies for Student Leadership Development in Doctor of Pharmacy Curricula to Assist Curriculum Committees and Leadership Instructors

PubMed Central

Traynor, Andrew P.; Boyle, Cynthia J.

2013-01-01

Objective. To assist curriculum committees and leadership instructors by gathering expert opinion to define student leadership development competencies for pharmacy curricula. Methods. Twenty-six leadership instructors participated in a 3-round, online, modified Delphi process to define competencies for student leadership development in pharmacy curricula. Round 1 asked open-ended questions about leadership knowledge, skills, and attitudes. Round 2 grouped responses for agreement rating and comment. Round 3 allowed rating and comment on competencies not yet meeting consensus, which was prospectively set at 80%. Results. Eleven competencies attained 80% consensus or higher and were grouped into 3 areas: leadership knowledge, personal leadership commitment, and leadership skill development. Connections to contemporary leadership development literature were outlined for each competency as a means of verifying the panel’s work. Conclusions. The leadership competencies will aid students in addressing: What is leadership? Who am I as a leader? What skills and abilities do I need to be effective? The competencies will help curriculum committees and leadership instructors to focus leadership development opportunities, identify learning assessments, and define program evaluation. PMID:24371346

Competencies for student leadership development in doctor of pharmacy curricula to assist curriculum committees and leadership instructors.

PubMed

Janke, Kristin K; Traynor, Andrew P; Boyle, Cynthia J

2013-12-16

To assist curriculum committees and leadership instructors by gathering expert opinion to define student leadership development competencies for pharmacy curricula. Twenty-six leadership instructors participated in a 3-round, online, modified Delphi process to define competencies for student leadership development in pharmacy curricula. Round 1 asked open-ended questions about leadership knowledge, skills, and attitudes. Round 2 grouped responses for agreement rating and comment. Round 3 allowed rating and comment on competencies not yet meeting consensus, which was prospectively set at 80%. Eleven competencies attained 80% consensus or higher and were grouped into 3 areas: leadership knowledge, personal leadership commitment, and leadership skill development. Connections to contemporary leadership development literature were outlined for each competency as a means of verifying the panel's work. The leadership competencies will aid students in addressing: What is leadership? Who am I as a leader? What skills and abilities do I need to be effective? The competencies will help curriculum committees and leadership instructors to focus leadership development opportunities, identify learning assessments, and define program evaluation.

Effect of a Cognitive-Behavioral Prevention Program on Depression 6 Years After Implementation Among At-Risk Adolescents: A Randomized Clinical Trial.

PubMed

Brent, David A; Brunwasser, Steven M; Hollon, Steven D; Weersing, V Robin; Clarke, Gregory N; Dickerson, John F; Beardslee, William R; Gladstone, Tracy R G; Porta, Giovanna; Lynch, Frances L; Iyengar, Satish; Garber, Judy

2015-11-01

Adolescents whose parents have a history of depression are at risk for developing depression and functional impairment. The long-term effects of prevention programs on adolescent depression and functioning are not known. To determine whether a cognitive-behavioral prevention (CBP) program reduced the incidence of depressive episodes, increased depression-free days, and improved developmental competence 6 years after implementation. A 4-site randomized clinical trial compared the effect of CBP plus usual care vs usual care, through follow-up 75 months after the intervention (88% retention), with recruitment from August 2003 through February 2006 at a health maintenance organization, university medical centers, and a community mental health center. A total of 316 participants were 13 to 17 years of age at enrollment and had at least 1 parent with current or prior depressive episodes. Participants could not be in a current depressive episode but had to have subsyndromal depressive symptoms or a prior depressive episode currently in remission. Analysis was conducted between August 2014 and June 2015. The CBP program consisted of 8 weekly 90-minute group sessions followed by 6 monthly continuation sessions. Usual care consisted of any family-initiated mental health treatment. The Depression Symptoms Rating scale was used to assess the primary outcome, new onsets of depressive episodes, and to calculate depression-free days. A modified Status Questionnaire assessed developmental competence (eg, academic or interpersonal) in young adulthood. Over the 75-month follow-up, youths assigned to CBP had a lower incidence of depression, adjusting for current parental depression at enrollment, site, and all interactions (hazard ratio, 0.71 [95% CI, 0.53-0.96]). The CBP program's overall significant effect was driven by a lower incidence of depressive episodes during the first 9 months after enrollment. The CBP program's benefit was seen in youths whose index parent was not depressed at enrollment, on depression incidence (hazard ratio, 0.54 [95% CI, 0.36-0.81]), depression-free days (d = 0.34, P = .01), and developmental competence (d = 0.36, P = .04); these effects on developmental competence were mediated via the CBP program's effect on depression-free days. The effect of CBP on new onsets of depression was strongest early and was maintained throughout the follow-up period; developmental competence was positively affected 6 years later. The effectiveness of CBP may be enhanced by additional booster sessions and concomitant treatment of parental depression. clinicaltrials.gov Identifier:NCT00073671.

Achieving Success in Small Business: A Self-Instruction Program for Small Business Owner-Managers. Assessing the Health of Your Business.

ERIC Educational Resources Information Center

Virginia Polytechnic Inst. and State Univ., Blacksburg. Div. of Vocational-Technical Education.

This self-instructional module on assessing the health of your business is the eleventh in a set of twelve modules designed for small business owner-managers. The competency for this module is to assess the financial condition of your business. Provided are information sections (key business records, balance sheet and profit and loss statements,…

A structural equation model on the attributes of a skills enhancement program affecting clinical competence of pre-graduate nursing students.

PubMed

Rebueno, Ma Carina D R; Tiongco, Dyan Dee D; Macindo, John Rey B

2017-02-01

Clinical competence remains an issue in nursing and has received greater emphasis than academic competence. Although skill enhancement programs are recommended and beneficial, there is limited evidence on its influence on the clinical competence of pre-graduate nursing students. This study explored the attributes of a skills enhancement program that affect the perceived clinical competence of pre-graduate nursing students. A cross-sectional study was conducted in a private higher education institution in the Philippines from April to May 2016. A total of 245 pre-graduate nursing students participated and completed a three-part survey composed of the respondent's robotfoto, the Skills Enhancement Program Questionnaire, and the Clinical Competence Questionnaire. Factor analysis explicated the attributes of the skills enhancement program while structural equation modeling and path analysis analyzed the variables' relationship. Findings showed that a skills enhancement program has 4 attributes: supportive clinical instructor, comprehensive orientation, formative goals and objectives, and conducive learning environment. Although all attributes of the program positively affected clinical competence, a supportive clinical instructor had the strongest influence on all clinical competency dimensions. A skills enhancement program that has a supportive clinical instructor, comprehensive orientation, formative goals and objectives, and conducive learning environment facilitates clinical competency development among pre-graduate nursing students. This knowledge provides momentum for nursing educators to review and refine their skills and the existing design of their skills enhancement program to further develop clinical competency among pre-graduate nursing students. Copyright © 2016 Elsevier Ltd. All rights reserved.

Comparison of Pharmacy Students’ Perceived and Actual Knowledge Using the Pharmacy Curricular Outcomes Assessment

PubMed Central

Friesner, Daniel L.

2012-01-01

Objective. To determine whether a correlation exists between third-year PharmD students’ perceived pharmacy knowledge and actual pharmacy knowledge as assessed by the Pharmacy Curricular Outcomes Assessment (PCOA). Methods. In 2010 and 2011, the PCOA was administered in a low-stakes environment to third-year pharmacy students at North Dakota State University College of Pharmacy, Nursing, and Allied Sciences (COPNAS). A survey instrument was also administered on which students self-assessed their perceived competencies in each of the core areas covered by the PCOA examination. Results. The pharmacy students rated their competencies slightly higher than average. Performance on the PCOA was similar to but slightly higher than national averages. Correlations between each of the 4 content areas (basic biomedical sciences, pharmaceutical sciences, social/administrative sciences, and clinical sciences) mirrored those reported nationally by the National Association of Boards of Pharmacy (NABP). Student performance on the basic biomedical sciences portion of the PCOA was significantly correlated with students’ perceived competencies in the biomedical sciences. No other correlations between actual and perceived competencies were significant. Conclusion. A lack of correlation exists between what students perceive they know and what they actually know in the areas of pharmaceutical science; social, behavioral, and administrative science; and clinical science. Therefore, additional standardized measures are needed to assess curricular effectiveness and provide comparisons among pharmacy programs. PMID:22611272

Toward competency-based curriculum: Application of workplace-based assessment tools in the National Saudi Arabian Anesthesia Training Program.

PubMed

Boker, Ama

2016-01-01

The anesthesia training program of the Saudi Commission for health specialties has introduced a developed competency-based anesthesia residency program starting from 2015 with the utilization of the workplace-based assessment (WBA) tools, namely mini-clinical exercises (mini-CEX), direct observation of procedural skills (DOPS), and case-based discussion (CBD). This work aimed to describe the process of development of anesthesia-specific list of mini-CEX, DOPS, and CBD tools within the Saudi Arabian Anesthesia Training Programs. To introduce the main concepts of formative WBA tools and to develop anesthesia-specific applications for each of the selected WBA tools, four 1-day workshops were held at the level of major training committees at eastern (Dammam), western (Jeddah), and central (Riyadh) regions in the Kingdom were conducted. Sixty-seven faculties participated in these workshops. After conduction of the four workshops, the anesthesia-specific applications setting of mini-CEX, DOPS, and CBD tools among the 5-year levels were fully described. The level of the appropriate consultation skills was divided according to the case complexity adopted from the American Society of Anesthesiologists physical classification for adult and obstetric and pediatric patient as well as the type of the targeted anesthetic procedure. WBA anesthesia-specific lists of mini-CEX, DOPS, and CBD forms were easily incorporated first into guidelines to help the first stage of implementation of formative assessment in the Saudi Arabian Anesthesia Residency Program, and this can be helpful to replicate such program within other various training programs in Saudi Arabia and abroad.

Competencies for 2020: Revalidation of the Curricular Competencies of the Emory University Doctor of Physical Therapy Program

ERIC Educational Resources Information Center

Bridges, Patricia H.; Carter, Vincent M.; Phillips, Tami; Chong, Hyun; Conwell, Ryan; Hensley, Brittany; Kimbrell, Alyson; Sigle, Mallory

2013-01-01

Background: Transformation in the healthcare environment prompted Emory University's Doctor of Physical Therapy Program (DPT) to revalidate its competency-based education program. The goal was to revalidate the essentialness of its curricular competencies: Provision of Patient Care, Interpersonal Relationships, Teaching and Learning, Research,…

Writing Assessment in a Competence-Based Undergraduate Program for Adult Students.

ERIC Educational Resources Information Center

Mirel, Barbara

The School for New Learning (SNL) was established in 1972 at DePaul University especially for adult students. SNL students are adults, age 24 or older, who want to accelerate their progress to a degree by using experience as well as classwork for academic credit, and who want to design their own programs with help from an advisory committee of…

Detection capacity, information gaps and the design of surveillance programs for invasive forest pests

Treesearch

Denys Yemshanov; Frank Koch; Yakov Ben-Haim; William Smith

2010-01-01

Integrated pest risk maps and their underlying assessments provide broad guidance for establishing surveillance programs for invasive species, but they rarely account for knowledge gaps regarding the pest of interest or how these can be reduced. In this study we demonstrate how the somewhat competing notions of robustness to uncertainty and potential knowledge gains...

California Adult Education 310 Mini-Grant Summaries. Selected 1984/85 and 1985/86 Reports.

ERIC Educational Resources Information Center

1987

This report profiles 39 programs that were funded by minigrants from Section 310 of the Adult Education Act in either 1984/85 or 1985/86. The following are among the instructional programs or products developed with the minigrant funds: an evaluation of targeted recruitment for competency-based adult education (CBAE); a self-assessment model; a…

Flexibility in Postgraduate Medical Training in the Netherlands.

PubMed

Hoff, Reinier G; Frenkel, Joost; Imhof, Saskia M; Ten Cate, Olle

2018-03-01

Postgraduate medical training in the Netherlands has become increasingly individualized. In this article, the authors describe current practices for three residency programs at the University Medical Center Utrecht: anesthesiology, pediatrics, and ophthalmology. These programs are diverse yet share characteristics allowing for individualized residency training. New residents enter each program throughout the year, avoiding a large simultaneous influx of inexperienced doctors. The usual duration of each is five years. However, the actual duration of rotations or of the program as a whole can be reduced because of residents' previous medical experience or demonstration of early mastery of relevant competencies. If necessary, the duration of training can also increase.Although working hours are already restricted by the European Working Time Directive, most residents choose to train on a part-time basis. The length of their program then is extended proportionally. The extension period added for those residents training part-time can be used to develop specific competencies, complete an elective rotation or research, or explore a focus area. If the resident meets all training objectives before the extension period is completed, the program director can choose to shorten the program length. Recently, entrustable professional activities have been introduced to strengthen workplace-based assessment. The effects on program duration have yet to be demonstrated.Flexible postgraduate training is feasible. Although improving work-life balance for residents is a necessity, attention must be paid to ensuring that they gain the necessary experience and competencies and maintain continuity of care to ensure that high-quality patient care is provided.

The Culture Audit: A Leadership Tool for Assessment and Strategic Planning in Diverse Schools and Colleges

ERIC Educational Resources Information Center

Bustamante, Rebecca M.

2006-01-01

This module is designed to introduce educational leaders to an organizational assessment tool called a "culture audit." Literature on organizational cultural competence suggests that culture audits are a valuable tool for determining how well school policies, programs, and practices respond to the needs of diverse groups and prepare…

An Assessment of Post-Professional Athletic Training Students' Critical Thinking Skills and Dispositions

ERIC Educational Resources Information Center

Walter, Jessica Marie

2013-01-01

The need for outcome measures in critical thinking skills and dispositions for post-professional athletic training programs (PPATPs) is significant. It has been suggested that athletic trainers who are competent and disposed towards thinking critically will be successful in the profession. The purpose of this study is to assess critical thinking…

Continuing Education on Suicide Assessment and Crisis Intervention for Social Workers and Other Mental Health Professionals: A Follow-Up Study

ERIC Educational Resources Information Center

Mirick, Rebecca G.; Bridger, Joanna; McCauley, James; Berkowitz, Larry

2016-01-01

Historically, graduate training programs have not taught suicide assessment and intervention skills in depth; therefore, the development of effective continuing education offerings is relevant and necessary for practicing social workers. Although the ability to increase knowledge and confidence is critical, a focus on competency-based education…

What Is the Criterion of Interest in Identifying Limited-English Speaking Students: Language Dominance or Proficiency?

ERIC Educational Resources Information Center

Estes, Gary D.; Estes, Carole

The issue of using language proficiency or language dominance to assess programs for high school students with limited English speaking backgrounds is addressed. The development and initial analyses of the Competency Based Oral Language Assessment (COLA) are discussed. Three components of oral language are rated separately: semantics; syntax and…

Career Preparedness Survey Outcomes of Food Science Graduates--A Follow-Up Assessment

ERIC Educational Resources Information Center

Bohlscheid, Jeffri; Clark, Stephanie

2012-01-01

Fifty-eight recent graduates (1998-2008) from the joint Washington State University (WSU) and University of Idaho (UI) BiState School of Food Science program and 27 of their employers participated in a survey assessing learning outcomes based on the 2001 Institute of Food Technologists (IFT) core competencies for undergraduate food science…

An interprofessional consensus of core competencies for prelicensure education in pain management: curriculum application for nursing.

PubMed

Herr, Keela; Marie, Barbara St; Gordon, Debra B; Paice, Judith A; Watt-Watson, Judy; Stevens, Bonnie J; Bakerjian, Debra; Young, Heather M

2015-06-01

Ineffective assessment and management of pain is a significant problem. A gap in prelicensure health science program pain content has been identified for the improvement of pain care in the United States. Through consensus processes, an expert panel of nurses, who participated in the interdisciplinary development of core competencies in pain management for prelicensure health professional education, developed recommendations to address the gap in nursing curricula. Challenges and incentives for implementation of pain competencies in nursing education are discussed, and specific recommendations for how to incorporate the competencies into entry-level nursing curricula are provided. Embedding pain management core competencies into prelicensure nursing education is crucial to ensure that nurses have the essential knowledge and skills to effectively manage pain and to serve as a foundation on which clinical practice skills can be later honed. [J Nurs Educ. 2015;54(6):317-327.]. Copyright 2015, SLACK Incorporated.

An Interprofessional Consensus of Core Competencies for Prelicensure Education in Pain Management: Curriculum Application for Nursing

PubMed Central

Herr, Keela; St. Marie, Barbara; Gordon, Debra B.; Paice, Judith A.; Watt-Watson, Judy; Stevens, Bonnie J.; Bakerjian, Debra; Young, Heather M.

2015-01-01

Background Ineffective assessment and management of pain is a significant problem. A gap in prelicensure health science program pain content has been identified for the improvement of pain care in the United States. Method Through consensus processes, an expert panel of nurses, who participated in the interdisciplinary development of core competencies in pain management for prelicensure health professional education, developed recommendations to address the gap in nursing curricula. Results Challenges and incentives for implementation of pain competencies in nursing education are discussed, and specific recommendations for how to incorporate the competencies into entry-level nursing curricula are provided. Conclusion Embedding pain management core competencies into prelicensure nursing education is crucial to ensure that nurses have the essential knowledge and skills to effectively manage pain and to serve as a foundation on which clinical practice skills can be later honed. PMID:26057425

Evidence-based decision-making as a practice-based learning skill: a pilot study.

PubMed

Falzer, Paul R; Garman, D Melissa

2012-03-01

As physicians are being trained to adapt their practices to the needs and experience of patients, initiatives to standardize care have been gaining momentum. The resulting conflict can be addressed through a practice-based learning and improvement (PBL) program that develops competency in using treatment guidelines as decision aids and incorporating patient-specific information into treatment recommendations. This article describes and tests a program that is consistent with the ACGME's multilevel competency-based approach, targets students at four levels of training, and features progressive learning objectives and assessments. The program was pilot-tested with 22 paid volunteer psychiatric residents and fellows. They were introduced to a schizophrenia treatment guideline and reviewed six case vignettes of varying complexity. PBL assessments were based on how treatment recommendations were influenced by clinical and patient-specific factors. The task permitted separate assessments of learning objectives all four training levels. Among the key findings at each level, most participants found the treatment guideline helpful in making treatment decisions. Recommendations were influenced by guideline-based assessment criteria and other clinical features. They were also influenced by patients' perceptions of their illness, patient-based progress assessments, and complications such as stressors and coping patterns. Recommendations were strongly influenced by incongruence between clinical facts and patient experience. Practical understanding of how patient experience joins with clinical knowledge can enhance the use of treatment guidelines as decision tools and enable clinicians to appreciate more fully how and why patients' perceptions of their illness should influence treatment recommendations. This PBL program can assist training facilities in preparing students to cope with contradictory demands to both standardize and adapt their practice. The program can be modified to accommodate various disorders and a range of clinical factors and patient-specific complications.