Bernhardt, Jay M; Stellefson, Michael; Weiler, Robert M; Anderson-Lewis, Charkarra; Miller, M David; MacInnes, Jann
2015-01-01
Background Social media can promote healthy behaviors by facilitating engagement and collaboration among health professionals and the public. Thus, social media is quickly becoming a vital tool for health promotion. While guidelines and trainings exist for public health professionals, there are currently no standardized measures to assess individual social media competency among Certified Health Education Specialists (CHES) and Master Certified Health Education Specialists (MCHES). Objective The aim of this study was to design, develop, and test the Social Media Competency Inventory (SMCI) for CHES and MCHES. Methods The SMCI was designed in three sequential phases: (1) Conceptualization and Domain Specifications, (2) Item Development, and (3) Inventory Testing and Finalization. Phase 1 consisted of a literature review, concept operationalization, and expert reviews. Phase 2 involved an expert panel (n=4) review, think-aloud sessions with a small representative sample of CHES/MCHES (n=10), a pilot test (n=36), and classical test theory analyses to develop the initial version of the SMCI. Phase 3 included a field test of the SMCI with a random sample of CHES and MCHES (n=353), factor and Rasch analyses, and development of SMCI administration and interpretation guidelines. Results Six constructs adapted from the unified theory of acceptance and use of technology and the integrated behavioral model were identified for assessing social media competency: (1) Social Media Self-Efficacy, (2) Social Media Experience, (3) Effort Expectancy, (4) Performance Expectancy, (5) Facilitating Conditions, and (6) Social Influence. The initial item pool included 148 items. After the pilot test, 16 items were removed or revised because of low item discrimination (r<.30), high interitem correlations (Ρ>.90), or based on feedback received from pilot participants. During the psychometric analysis of the field test data, 52 items were removed due to low discrimination, evidence of content redundancy, low R-squared value, or poor item infit or outfit. Psychometric analyses of the data revealed acceptable reliability evidence for the following scales: Social Media Self-Efficacy (alpha=.98, item reliability=.98, item separation=6.76), Social Media Experience (alpha=.98, item reliability=.98, item separation=6.24), Effort Expectancy(alpha =.74, item reliability=.95, item separation=4.15), Performance Expectancy (alpha =.81, item reliability=.99, item separation=10.09), Facilitating Conditions (alpha =.66, item reliability=.99, item separation=16.04), and Social Influence (alpha =.66, item reliability=.93, item separation=3.77). There was some evidence of local dependence among the scales, with several observed residual correlations above |.20|. Conclusions Through the multistage instrument-development process, sufficient reliability and validity evidence was collected in support of the purpose and intended use of the SMCI. The SMCI can be used to assess the readiness of health education specialists to effectively use social media for health promotion research and practice. Future research should explore associations across constructs within the SMCI and evaluate the ability of SMCI scores to predict social media use and performance among CHES and MCHES. PMID:26399428
Alber, Julia M; Bernhardt, Jay M; Stellefson, Michael; Weiler, Robert M; Anderson-Lewis, Charkarra; Miller, M David; MacInnes, Jann
2015-09-23
Social media can promote healthy behaviors by facilitating engagement and collaboration among health professionals and the public. Thus, social media is quickly becoming a vital tool for health promotion. While guidelines and trainings exist for public health professionals, there are currently no standardized measures to assess individual social media competency among Certified Health Education Specialists (CHES) and Master Certified Health Education Specialists (MCHES). The aim of this study was to design, develop, and test the Social Media Competency Inventory (SMCI) for CHES and MCHES. The SMCI was designed in three sequential phases: (1) Conceptualization and Domain Specifications, (2) Item Development, and (3) Inventory Testing and Finalization. Phase 1 consisted of a literature review, concept operationalization, and expert reviews. Phase 2 involved an expert panel (n=4) review, think-aloud sessions with a small representative sample of CHES/MCHES (n=10), a pilot test (n=36), and classical test theory analyses to develop the initial version of the SMCI. Phase 3 included a field test of the SMCI with a random sample of CHES and MCHES (n=353), factor and Rasch analyses, and development of SMCI administration and interpretation guidelines. Six constructs adapted from the unified theory of acceptance and use of technology and the integrated behavioral model were identified for assessing social media competency: (1) Social Media Self-Efficacy, (2) Social Media Experience, (3) Effort Expectancy, (4) Performance Expectancy, (5) Facilitating Conditions, and (6) Social Influence. The initial item pool included 148 items. After the pilot test, 16 items were removed or revised because of low item discrimination (r<.30), high interitem correlations (Ρ>.90), or based on feedback received from pilot participants. During the psychometric analysis of the field test data, 52 items were removed due to low discrimination, evidence of content redundancy, low R-squared value, or poor item infit or outfit. Psychometric analyses of the data revealed acceptable reliability evidence for the following scales: Social Media Self-Efficacy (alpha=.98, item reliability=.98, item separation=6.76), Social Media Experience (alpha=.98, item reliability=.98, item separation=6.24), Effort Expectancy(alpha =.74, item reliability=.95, item separation=4.15), Performance Expectancy (alpha =.81, item reliability=.99, item separation=10.09), Facilitating Conditions (alpha =.66, item reliability=.99, item separation=16.04), and Social Influence (alpha =.66, item reliability=.93, item separation=3.77). There was some evidence of local dependence among the scales, with several observed residual correlations above |.20|. Through the multistage instrument-development process, sufficient reliability and validity evidence was collected in support of the purpose and intended use of the SMCI. The SMCI can be used to assess the readiness of health education specialists to effectively use social media for health promotion research and practice. Future research should explore associations across constructs within the SMCI and evaluate the ability of SMCI scores to predict social media use and performance among CHES and MCHES.
Tommasini, Cristina; Dobrowolska, Beata; Zarzycka, Danuta; Bacatum, Claudia; Bruun, Anne Marie Gran; Korsath, Dag; Roel, Siv; Jansen, Mette Bro; Milling, Tine; Deschamps, Anne; Mantzoukas, Stefanos; Mantzouka, Christine; Palese, Alvisa
2017-04-01
Assessing clinical competence in nursing students abroad is a challenge, and requires both methods and instruments capable of capturing the multidimensional nature of the clinical competences acquired. The aim of the study was to compare the clinical competence assessment processes and instruments adopted for nursing students during their clinical placement abroad. A case study design was adopted in 2015. A purposeful sample of eight nursing programmes located in seven countries (Belgium, Denmark, Greece, Norway, Poland, Portugal and Italy) were approached. Tools as instruments for evaluating competences developed in clinical training by international nursing students, and written procedures aimed at guiding the evaluation process, were scrutinised through a content analysis method. All clinical competence evaluation procedures and instruments used in the nursing programmes involved were provided in English. A final evaluation of the competences was expected by all nursing programmes at the end of the clinical placement, while only four provided an intermediate evaluation. Great variability emerged in the tools, with between five and 88 items included. Through content analysis, 196 items emerged, classified into 12 different core competence categories, the majority were categorised as 'Technical skills' (=60), 'Self-learning and critical thinking' (=27) and 'Nursing care process' (=25) competences. Little emphasis was given in the tools to competences involving 'Self-adaptation', 'Inter-professional skills', 'Clinical documentation', 'Managing nursing care', 'Patient communication', and 'Theory and practice integration'. Institutions signing Bilateral Agreements should agree upon the competences expected from students during their clinical education abroad. The tools used in the process, as well as the role expected by the student, should also be agreed upon. Intercultural competences should be further addressed in the process of evaluation, in addition to adaptation to different settings. There is also a need to establish those competences achievable or not in the host country, aiming at increasing transparency in learning expectations and evaluation. Copyright © 2017 Elsevier Ltd. All rights reserved.
Lohse, Barbara; Cunningham-Sabo, Leslie
2012-10-01
Parent self-efficacy, outcome expectancies, and behaviors toward cooking and fruits and vegetables mediate children's eating. Eating competence, an intra-individual approach to food-related attitudes and behaviors, is associated with healthful outcomes but has not been studied as a moderator of parent food-related behaviors that mediate healthful eating in 4th grade children. Parents (n = 339; 78% Hispanic, 89% female) of 4th graders who participated in an impact study of the Cooking with Kids curriculum in Santa Fe, NM schools eligible for Supplemental Nutrition Assistance Program Education completed the following surveys: Satter eating competence inventory for low-income (ecSI/LI) (16 items, Likert scale, possible score 0-48); modeling behaviors related to food preparation and fruits/vegetables (11 items, Likert scale, possible score 0-33); self-efficacy/outcome expectancies (SE/OE) (12 items, Likert scale, possible score 12-60); and availability of fruits/vegetables (20 items, possible score 0-20). Higher scores indicate more desired behaviors. The mean ecSI/LI score was 33.6 ± 8.5; 59% were eating competent, i.e., ecSI/LI ≥ 32. Eating-competent parents demonstrated more modeling (16.3 ± 5.0 vs. 14.0 ± 4.3; P < 0.001), greater SE/OE (53.7 ± 10.1 vs. 51.2 ± 8.5; P = 0.03), and greater in-home fruit/vegetable availability (12.7 ± 3.0 vs. 11.9 ± 3.2; P = 0.02). Two clusters of modeling behavior were defined: achievers and strivers. Modeling achievers (34.9 ± 6.9) were more eating competent (P < 0.001) than strivers (30.3 ± 8.9). Eating competence moderated parent food-related behaviors. Measuring eating competence may contribute to understanding parent behavior as a mediator in school-based nutrition interventions.
Dalton, Megan; Davidson, Megan; Keating, Jenny
2011-01-01
Is the Assessment of Physiotherapy Practice (APP) a valid instrument for the assessment of entry-level competence in physiotherapy students? Cross-sectional study with Rasch analysis of initial (n=326) and validation samples (n=318). Students were assessed on completion of 4, 5, or 6-week clinical placements across one university semester. 298 clinical educators and 456 physiotherapy students at nine universities in Australia and New Zealand provided 644 completed APP instruments. APP data in both samples showed overall fit to a Rasch model of expected item functioning for interval scale measurement. Item 6 (Written communication) exhibited misfit in both samples, but was retained as an important element of competence. The hierarchy of item difficulty was the same in both samples with items related to professional behaviour and communication the easiest to achieve and items related to clinical reasoning the most difficult. Item difficulty was well targeted to person ability. No Differential Item Functioning was identified, indicating that the scale performed in a comparable way regardless of the student's age, gender or amount of prior clinical experience, and the educator's age, gender, or experience as an educator, or the type of facility, university, or clinical area. The instrument demonstrated unidimensionality confirming the appropriateness of summing the scale scores on each item to provide an overall score of clinical competence and was able to discriminate four levels of professional competence (Person Separation Index=0.96). Person ability and raw APP scores had a linear relationship (r(2)=0.99). Rasch analysis supports the interpretation that a student's APP score is an indication of their underlying level of professional competence in workplace practice. Copyright © 2011 Australian Physiotherapy Association. Published by .. All rights reserved.
Bernhard, Gerda; Knibbe, Ronald A.; von Wolff, Alessa; Dingoyan, Demet; Schulz, Holger; Mösko, Mike
2015-01-01
Background Cultural competence of healthcare professionals (HCPs) is recognized as a strategy to reduce cultural disparities in healthcare. However, standardised, valid and reliable instruments to assess HCPs’ cultural competence are notably lacking. The present study aims to 1) identify the core components of cultural competence from a healthcare perspective, 2) to develop a self-report instrument to assess cultural competence of HCPs and 3) to evaluate the psychometric properties of the new instrument. Methods The conceptual model and initial item pool, which were applied to the cross-cultural competence instrument for the healthcare profession (CCCHP), were derived from an expert survey (n = 23), interviews with HCPs (n = 12), and a broad narrative review on assessment instruments and conceptual models of cultural competence. The item pool was reduced systematically, which resulted in a 59-item instrument. A sample of 336 psychologists, in advanced psychotherapeutic training, and 409 medical students participated, in order to evaluate the construct validity and reliability of the CCCHP. Results Construct validity was supported by principal component analysis, which led to a 32-item six-component solution with 50% of the total variance explained. The different dimensions of HCPs’ cultural competence are: Cross-Cultural Motivation/Curiosity, Cross-Cultural Attitudes, Cross-Cultural Skills, Cross-Cultural Knowledge/Awareness and Cross-Cultural Emotions/Empathy. For the total instrument, the internal consistency reliability was .87 and the dimension’s Cronbach’s α ranged from .54 to .84. The discriminating power of the CCCHP was indicated by statistically significant mean differences in CCCHP subscale scores between predefined groups. Conclusions The 32-item CCCHP exhibits acceptable psychometric properties, particularly content and construct validity to examine HCPs’ cultural competence. The CCCHP with its five dimensions offers a comprehensive assessment of HCPs’ cultural competence, and has the ability to distinguish between groups that are expected to differ in cultural competence. This instrument can foster professional development through systematic self-assessment and thus contributes to improve the quality of patient care. PMID:26641876
Bernhard, Gerda; Knibbe, Ronald A; von Wolff, Alessa; Dingoyan, Demet; Schulz, Holger; Mösko, Mike
2015-01-01
Cultural competence of healthcare professionals (HCPs) is recognized as a strategy to reduce cultural disparities in healthcare. However, standardised, valid and reliable instruments to assess HCPs' cultural competence are notably lacking. The present study aims to 1) identify the core components of cultural competence from a healthcare perspective, 2) to develop a self-report instrument to assess cultural competence of HCPs and 3) to evaluate the psychometric properties of the new instrument. The conceptual model and initial item pool, which were applied to the cross-cultural competence instrument for the healthcare profession (CCCHP), were derived from an expert survey (n = 23), interviews with HCPs (n = 12), and a broad narrative review on assessment instruments and conceptual models of cultural competence. The item pool was reduced systematically, which resulted in a 59-item instrument. A sample of 336 psychologists, in advanced psychotherapeutic training, and 409 medical students participated, in order to evaluate the construct validity and reliability of the CCCHP. Construct validity was supported by principal component analysis, which led to a 32-item six-component solution with 50% of the total variance explained. The different dimensions of HCPs' cultural competence are: Cross-Cultural Motivation/Curiosity, Cross-Cultural Attitudes, Cross-Cultural Skills, Cross-Cultural Knowledge/Awareness and Cross-Cultural Emotions/Empathy. For the total instrument, the internal consistency reliability was .87 and the dimension's Cronbach's α ranged from .54 to .84. The discriminating power of the CCCHP was indicated by statistically significant mean differences in CCCHP subscale scores between predefined groups. The 32-item CCCHP exhibits acceptable psychometric properties, particularly content and construct validity to examine HCPs' cultural competence. The CCCHP with its five dimensions offers a comprehensive assessment of HCPs' cultural competence, and has the ability to distinguish between groups that are expected to differ in cultural competence. This instrument can foster professional development through systematic self-assessment and thus contributes to improve the quality of patient care.
Chung, Hui-Chun; Hsieh, Tsung-Cheng; Chen, Yueh-Chih; Chang, Shu-Chuan; Hsu, Wen-Lin
2017-11-29
To investigate the construct validity and reliability of the Chinese Comfort, Afford, Respect, and Expect scale, which can be used to determine clinical nurses' competence. The results can also serve to promote nursing competence and improve patient satisfaction. Nurse-patient interaction is critical for improving nursing care quality. However, to date, no relevant validated instrument has been proposed for assessing caring nurse-patient interaction competence in clinical practice. This study adapted and validated the Chinese version of the caring nurse-patient interaction scale. A cross-cultural adaptation and validation study. A psychometric analysis of the four major constructs of the Chinese Comfort, Afford, Respect, and Expect scale was conducted on a sample of 356 nurses from a medical centre in China. Item analysis and exploratory factor analysis were adopted to extract the main components, both the internal consistency and correlation coefficients were used to examine reliability and a confirmatory factor analysis was adopted to verify the construct validity. The goodness-of-fit results of the model were strong. The standardised factor loadings of the Chinese Comfort, Afford, Respect, and Expect scale ranged from 0.73-0.95, indicating that the validity and reliability of this instrument were favourable. Moreover, the 12 extracted items explained 95.9% of the measured content of the Chinese Comfort, Afford, Respect, and Expect scale. The results serve as empirical evidence regarding the validity and reliability of the Chinese Comfort, Afford, Respect, and Expect scale. Hospital nurses increasingly demand help from patients and their family members in identifying health problems and assisting with medical decision-making. Therefore, enhancing nurses' competence in nurse-patient interactions is crucial for nursing and hospital managers to improve nursing care quality. The Chinese caring nurse-patient interaction scale can serve as an effective tool for nursing and hospital managers to evaluate the caring nurse-patient interaction confidence of nurses and improve inpatient satisfaction and quality of care. © 2017 John Wiley & Sons Ltd.
Ullrich, Charlotte; Mahler, Cornelia; Forstner, Johanna; Szecsenyi, Joachim; Wensing, Michel
2017-04-27
Implementation science in healthcare is an evolving discipline in German-speaking countries. In 2015, the Medical Faculty of the University of Heidelberg, Germany, implemented a two-year full-time Master of Science program Health Services Research and Implementation Science. The curriculum introduces implementation science in the context of a broader program that also covers health services research, healthcare systems, research methods, and generic academic skills. Our aim was to assess the expectations of different stakeholder groups regarding the master's program. An online survey listing desired competencies of prospective graduates was developed and administered to four groups: national experts in the field (including potential employers of graduates), teaching staff, enrolled students, and prospective students (N = 169). Competencies were extracted from the curriculum's module handbook. A five-point Likert scale was used for the assessment of 42 specific items. Data were analyzed descriptively. A total of 83 people participated in the survey (response rate 49%). The online survey showed a strong agreement across the groups concerning the desired competencies of graduates. About two-thirds of the listed competencies (27 items) were felt to be crucial or very important by 80% or more of participants, with little difference between stakeholder groups. Of the eight items specifically related to implementation in practice, six were in this category. Knowledge of implementation strategies (90% very important), knowledge of barriers and enablers of implementation (89%), and knowledge of evidence-based practice (89%) were the top priorities. The master's program is largely orientated towards the desired competencies of graduates according to students, teaching staff, and national experts.
Prueba de Ciencia Primer Grado (Science Test for the First Grade). [In Spanish
ERIC Educational Resources Information Center
Puerto Rico State Dept. of Education, Hato Rey.
This document consists of three parts: (1) a manual for administering the science test to first graders (in Spanish), (2) a copy of the test itself (pictorial), and (3) a list of expected competencies in science for the first three grades (in English). The test consists of 25, four-choice items. For each item, the administrator reads a statement…
Identification and evaluation of competencies of public health nutritionists.
Sims, L S
1979-01-01
The Delphi Technique was used to elicit a number of essential competencies expected of the "entry-level" public health nutritionist from members of Graduate Faculties of Programs in Public Health Nutrition. Questionnaires composed of "competency statements" were constructed from these responses and sent to practitioners in public health nutrition. The questionnaire requested evaluation of the "necessity" of each competency. Responses served as the basis for "factor analysis" procedures, employed to obtain clusters of competency functions expected of the nutritionist. From the 109 competency items originally identified, 17 competency scales were derived from the factor analysis. A ranking from both faculties and practitioners revealed that both groups highly rated competencies to communicate, to counsel and deal with clients/patients, and to interpret scientific data in "lay language." Less important in the ranking were competencies which dealt with administrative abilities, program planning, legislative activism, and consumer advocacy. These findings have cimplications for the practitioner in public health nutrition as well as for academic groups who must plan and evaluate curricula in public health nutrition and in other fields of public health. PMID:507240
Validation of the Multidimensional Acculturative Stress Inventory on adolescents of Mexican origin.
Rodriguez, Norma; Flores, Thomas; Flores, Ramon T; Myers, Hector F; Vriesema, Christine Calderon
2015-12-01
The Multidimensional Acculturative Stress Inventory (MASI), a 36-item measure that assesses acculturative stress among people of Mexican origin living in the United States, was tested on 331 adolescent (14-20 years of age) high school students (204 female, 127 male) of Mexican origin. Exploratory factor analyses yielded 4 factors: bicultural practices conflict (9 items), Spanish competency pressures (8 items), English competency pressures (8 items), and bicultural self-consciousness (2 items). These factors accounted for 59.5% of the variance and correlated in the expected directions with criterion measures of acculturation and the Psychological General Well-Being Schedule. Bicultural practices conflict and bicultural self-consciousness emerged as the first and fourth factors for adolescents, which differed from the last 2 factors observed in a previous study of adults by Rodriguez, Myers, Mira, Flores, and Garcia-Hernandez (2002)--pressure to acculturate and pressure against acculturation. Comparisons of the MASI factor structures between adolescents and adults also revealed that English competency pressures and Spanish competency pressures played a prominent role for both adolescents in this study and adults in the study by Rodriguez et al. (2002). The congruence and difference in factor structure of the MASI between adolescents and adults indicates that both groups experience acculturative stress because of English- and Spanish-language competency pressures, but adolescents differentially experience difficulties in negotiating between American and Latino practices and identities. The results highlight the importance of assessing acculturative stress from both Latino and American culture and recognizing the varying levels of these sources of acculturative stress by generation. (c) 2015 APA, all rights reserved).
Development and Psychometric Assessment of the Healthcare Provider Cultural Competence Instrument
Schwarz, Joshua L.; Witte, Raymond; Sellers, Sherrill L.; Luzadis, Rebecca A.; Weiner, Judith L.; Domingo-Snyder, Eloiza; Page, James E.
2015-01-01
This study presents the measurement properties of 5 scales used in the Healthcare Provider Cultural Competence Instrument (HPCCI). The HPCCI measures a health care provider’s cultural competence along 5 primary dimensions: (1) awareness/sensitivity, (2) behaviors, (3) patient-centered communication, (4) practice orientation, and (5) self-assessment. Exploratory factor analysis demonstrated that the 5 scales were distinct, and within each scale items loaded as expected. Reliability statistics indicated a high level of internal consistency within each scale. The results indicate that the HPCCI effectively measures the cultural competence of health care providers and can provide useful professional feedback for practitioners and organizations seeking to increase a practitioner’s cultural competence. PMID:25911617
Being Close and Being Social: Peer Ratings of Distinct Aspects of Young Adult Social Competence
Larson, Justine J.; Whitton, Sarah W.; Hauser, Stuart T.; Allen, Joseph P.
2012-01-01
The present study had three main objectives: (1) to develop and validate scales of young adult social competence in two domains, close relationships and social groups, using peer ratings of California Q-sort (Block, 1974; Kremen & Block, 2002) items; (2) to test the hypothesis that social competence is associated with young adult well-being and ego development; (3) to test the hypothesis that close relationship competence aligns more closely than social group competence with young adult functioning. Psychometric data on peer ratings of social competence are presented. For 133 young adults, peer ratings of social competence were correlated in expected directions with indices of functioning (e.g., self-worth, education, psychological distress, criminal behavior, and ego development). Associations were generally stronger for competence in close relationships than in social groups. PMID:17764391
Wang, Jen; Thombs, Brett D.; Schmid, Margareta R.
2012-01-01
Abstract Background Growing recognition of the role of citizens and patients in health and health care has placed a spotlight on health literacy and patient education. Objective To identify specific competencies for health in definitions of health literacy and patient‐centred concepts and empirically test their dimensionality in the general population. Methods A thorough review of the literature on health literacy, self‐management, patient empowerment, patient education and shared decision making revealed considerable conceptual overlap as competencies for health and identified a corpus of 30 generic competencies for health. A questionnaire containing 127 items covering the 30 competencies was fielded as a telephone interview in German, French and Italian among 1255 respondents randomly selected from the resident population in Switzerland. Findings Analyses with the software MPlus to model items with mixed response categories showed that the items do not load onto a single factor. Multifactorial models with good fit could be erected for each of five dimensions defined a priori and their corresponding competencies: information and knowledge (four competencies, 17 items), general cognitive skills (four competencies, 17 items), social roles (two competencies, seven items), medical management (four competencies, 27 items) and healthy lifestyle (two competencies, six items). Multiple indicators and multiple causes models identified problematic differential item functioning for only six items belonging to two competencies. Conclusions The psychometric analyses of this instrument support broader conceptualization of health literacy not as a single competence but rather as a package of competencies for health. PMID:22390287
Miller, Louise C; Russell, Cynthia L; Cheng, An-Lin; Skarbek, Anita J
2015-05-01
While professional nurses are expected to communicate clearly, these skills are often not explicitly taught in undergraduate nursing education. In this research study, writing self-efficacy and writing competency were evaluated in 52 nontraditional undergraduate baccalaureate completion students in two distance-mediated 16-week capstone courses. The intervention group (n = 44) experienced various genres and modalities of written assignments set in the context of evidence-based nursing practice; the comparison group (n = 8) received usual writing undergraduate curriculum instruction. Self-efficacy, measured by the Post Secondary Writerly Self-Efficacy Scale, indicated significant improvements for all self-efficacy items (all p's = 0.00). Writing competency, assessed in the intervention group using a primary trait scoring rubric (6 + 1 Trait Writing Model(®) of Instruction and Assessment), found significant differences in competency improvement on five of seven items. This pilot study demonstrated writing skills can improve in nontraditional undergraduate students with guided instruction. Further investigation with larger, culturally diverse samples is indicated to validate these results. Copyright © 2014 Elsevier Ltd. All rights reserved.
Determining an Imaging Literacy Curriculum for Radiation Oncologists: An International Delphi Study
DOE Office of Scientific and Technical Information (OSTI.GOV)
Giuliani, Meredith E., E-mail: Meredith.Giuliani@rmp.uhn.on.ca; Department of Radiation Oncology, University of Toronto, Toronto, Ontario; Gillan, Caitlin
2014-03-15
Purpose: Rapid evolution of imaging technologies and their integration into radiation therapy practice demands that radiation oncology (RO) training curricula be updated. The purpose of this study was to develop an entry-to-practice image literacy competency profile. Methods and Materials: A list of 263 potential imaging competency items were assembled from international objectives of training. Expert panel eliminated redundant or irrelevant items to create a list of 97 unique potential competency items. An international 2-round Delphi process was conducted with experts in RO. In round 1, all experts scored, on a 9-point Likert scale, the degree to which they agreed anmore » item should be included in the competency profile. Items with a mean score ≥7 were included, those 4 to 6 were reviewed in round 2, and items scored <4 were excluded. In round 2, items were discussed and subsequently ranked for inclusion or exclusion in the competency profile. Items with >75% voting for inclusion were included in the final competency profile. Results: Forty-nine radiation oncologists were invited to participate in round 1, and 32 (65%) did so. Participants represented 24 centers in 6 countries. Of the 97 items ranked in round 1, 80 had a mean score ≥7, 1 item had a score <4, and 16 items with a mean score of 4 to 6 were reviewed and rescored in round 2. In round 2, 4 items had >75% of participants voting for inclusion and were included; the remaining 12 were excluded. The final list of 84 items formed the final competency profile. The 84 enabling competency items were aggregated into the following 4 thematic groups of key competencies: (1) imaging fundamentals (42 items); (2) clinical application (27 items); (3) clinical management (5 items); and (4) professional practice (10 items). Conclusions: We present an imaging literacy competency profile which could constitute the minimum training standards in radiation oncology residency programs.« less
Finstuen, Kenn; Mangelsdorff, A David
2006-01-01
The purpose of this research was to identify the mentoring and executive competencies required among preceptors of the Army-Baylor University Graduate Program in Health and Business Administration, and to specify the requisite skills, knowledge, and abilities (SKAs) needed to achieve those competencies. In the first wave of inquiry, a list of 123 competencies and associated SKAs was elicited from a network of 80 current and past preceptor executives employing a Delphi methodology using e-mail. An expert panel, which consisted of seven past program directors, examined and sorted the list into four preceptor content domains, viz., Health Systems Management (HS Management), Leadership, Residency Administration, and Community Involvement. Frequency analyses showed that the HS Management domain constituted over half of the competencies, with particular emphasis on strategic thinking, planning, billing, finance, manpower, and contracting. In the second wave, the preceptor Delphi network reviewed the expertpanel list and made 7-pointSKA importance ratings on an 80-item structured questionnaire representative of the four domains. Findings indicated thataverage SKA ratings were reliable and agreed upon to a high degree among preceptors. Results, rank ordered by SKA item means within preceptor content domains and overall, suggested that the most important rated items centered on teamwork, negotiation, interpersonal skills, communication, leadership vision, and customer and healthcare business operations. Outcomes from the competency list are expected to be useful for preceptor mentoring, self-assessment, and for professional development. Additionally, specific SKAs can provide a means for developing job requirements and career performance criteria at a behavioral task level, and can contribute information for identifying continuing education and conference topical needs.
Leff, Stephen S; Baum, Katherine T; Bevans, Katherine B; Blum, Nathan J
2015-02-01
To describe the development and psychometric evaluation of the Core Competency Measure (CCM), an instrument designed to assess professional competencies as defined by the Maternal Child Health Bureau (MCHB) and targeted by Leadership Education in Neurodevelopmental and Related Disabilities (LEND) programs. The CCM is a 44-item self-report measure comprised of six subscales to assess clinical, interdisciplinary, family-centered/cultural, community, research, and advocacy/policy competencies. The CCM was developed in an iterative fashion through participatory action research, and then nine cohorts of LEND trainees (N = 144) from 14 different disciplines completed the CCM during the first week of the training program. A 6-factor confirmatory factor analysis model was fit to data from the 44 original items. After three items were removed, the model adequately fit the data (comparative fit indices = .93, root mean error of approximation = .06) with all factor loadings exceeding .55. The measure was determined to be quite reliable as adequate internal consistency and test-retest reliability were found for each subscale. The instrument's construct validity was supported by expected differences in self-rated competencies among fellows representing various disciplines, and the convergent validity was supported by the pattern of inter-correlations between subscale scores. The CCM appears to be a reliable and valid measure of MCHB core competencies for our sample of LEND trainees. It provides an assessment of key training areas addressed by the LEND program. Although the measure was developed within only one LEND Program, with additional research it has the potential to serve as a standardized tool to evaluate the strengths and limitations of MCHB training, both within and between programs.
ERIC Educational Resources Information Center
Hasse, Sascha; Joachim, Cora; Bögeholz, Susanne; Hammann, Marcus
2014-01-01
In Germany, science education standards for students at the end of grade nine have been in existance since 2005. Some of these standards are dedicated to scientific inquiry (e.g. experimentation). They describe which abilities learners are expected to possess at the end of grade nine. In the USA, several documents describe standards for…
ERIC Educational Resources Information Center
Hasse, Sascha; Joachim, Cora; Bögeholz, Susanne; Hammann, Marcus
2014-01-01
In Germany, science education standards for students at the end of grade nine have been in existence since 2005. Some of these standards are dedicated to scientific inquiry (e.g. experimentation). They describe which abilities learners are expected to possess at the end of grade nine. In the USA, several documents describe standards for…
Adleman, Jenna; Gillan, Caitlin; Caissie, Amanda; Davis, Carol-Anne; Liszewski, Brian; McNiven, Andrea; Giuliani, Meredith
2017-06-01
To develop an entry-to-practice quality and safety competency profile for radiation oncology residency. A comprehensive list of potential quality and safety competency items was generated from public and professional resources and interprofessional focus groups. Redundant or out-of-scope items were eliminated through investigator consensus. Remaining items were subjected to an international 2-round modified Delphi process involving experts in radiation oncology, radiation therapy, and medical physics. During Round 1, each item was scored independently on a 9-point Likert scale indicating appropriateness for inclusion in the competency profile. Items indistinctly ranked for inclusion or exclusion were re-evaluated through web conference discussion and reranked in Round 2. An initial 1211 items were compiled from 32 international sources and distilled to 105 unique potential quality and safety competency items. Fifteen of the 50 invited experts participated in round 1: 10 radiation oncologists, 4 radiation therapists, and 1 medical physicist from 13 centers in 5 countries. Round 1 rankings resulted in 80 items included, 1 item excluded, and 24 items indeterminate. Two areas emerged more prominently within the latter group: change management and human factors. Web conference with 5 participants resulted in 9 of these 24 items edited for content or clarity. In Round 2, 12 participants rescored all indeterminate items resulting in 10 items ranked for inclusion. The final 90 enabling competency items were organized into thematic groups consisting of 18 key competencies under headings adapted from Deming's System of Profound Knowledge. This quality and safety competency profile may inform minimum training standards for radiation oncology residency programs. Copyright © 2017 Elsevier Inc. All rights reserved.
DOE Office of Scientific and Technical Information (OSTI.GOV)
Adleman, Jenna; Gillan, Caitlin; Radiation Medicine Program, Princess Margaret Cancer Centre, Toronto, Ontario
Purpose: To develop an entry-to-practice quality and safety competency profile for radiation oncology residency. Methods and Materials: A comprehensive list of potential quality and safety competency items was generated from public and professional resources and interprofessional focus groups. Redundant or out-of-scope items were eliminated through investigator consensus. Remaining items were subjected to an international 2-round modified Delphi process involving experts in radiation oncology, radiation therapy, and medical physics. During Round 1, each item was scored independently on a 9-point Likert scale indicating appropriateness for inclusion in the competency profile. Items indistinctly ranked for inclusion or exclusion were re-evaluated through webmore » conference discussion and reranked in Round 2. Results: An initial 1211 items were compiled from 32 international sources and distilled to 105 unique potential quality and safety competency items. Fifteen of the 50 invited experts participated in round 1: 10 radiation oncologists, 4 radiation therapists, and 1 medical physicist from 13 centers in 5 countries. Round 1 rankings resulted in 80 items included, 1 item excluded, and 24 items indeterminate. Two areas emerged more prominently within the latter group: change management and human factors. Web conference with 5 participants resulted in 9 of these 24 items edited for content or clarity. In Round 2, 12 participants rescored all indeterminate items resulting in 10 items ranked for inclusion. The final 90 enabling competency items were organized into thematic groups consisting of 18 key competencies under headings adapted from Deming's System of Profound Knowledge. Conclusions: This quality and safety competency profile may inform minimum training standards for radiation oncology residency programs.« less
Criterion-Referenced Test Items for Welding.
ERIC Educational Resources Information Center
Davis, Diane, Ed.
This test item bank on welding contains test questions based upon competencies found in the Missouri Welding Competency Profile. Some test items are keyed for multiple competencies. These criterion-referenced test items are designed to work with the Vocational Instructional Management System. Questions have been statistically sampled and validated…
Competency-based Radiology Residency: A Survey of Expectations from Singapore's Perspective.
Yang, Hui; Tan, Colin J X; Lau, Doreen A H; Lim, Winston E H; Tay, Kiang Hiong; Kei, Pin Lin
2015-03-01
In response to the demands of an ageing nation, the postgraduate medical education in Singapore is currently in the early stage of transition into the American-styled residency programme. This study assessed the expectations of both radiology trainees and faculty on their ideal clinical learning environment (CLE) which facilitates the programme development. A modified 23-item questionnaire was administered to both trainees and faculty at a local training hospital. All items were scored according to their envisioned level of importance and categorised into 5 main CLE domains-supervision, formal training programme, work-based learning, social atmosphere and workload. 'Supervision' was identified as the most important domain of the CLE by both trainees and faculty, followed by 'formal training programmes', 'work-based learning' and 'social atmosphere'. 'Workload' was rated as the least important domain. For all domains, the reported expectation between both trainees and faculty respondents did not differ significantly. Intragroup comparison also showed no significant difference within each group of respondents. This study has provided valuable insights on both respondents' expectations on their ideal CLE that can best train competency in future radiologists. Various approaches to address these concerns were also discussed. The similarities in findings between ours and previous studies suggest that the 'supervision', 'formal training programmes' and 'work-based learning' domains are crucial for the success of a postgraduate medical training and should be emphasised in future curriculum. 'Workload' remains a challenge in postgraduate medical training, but attempts to address this will have an impact in future radiology training.
Tateishi, Kazuko; Matsubayashi, Taro; Yoshimoto, Keiichi; Sakemi, Takanobu
2013-05-01
A few studies have compared nursing education systems of Japan and Europe, particularly focusing on competency. We evaluated the competency of registered Japanese nurses by comparing it with that of European nurses; the implications of evaluation for the education of nurses are discussed. Subjects were 468 European graduate nurses and 100 Japanese nurses. Study used data from the Graduates in Knowledge Society (REFLEX) survey in Europe and the Japanese language version of REFLEX (2006) used in a survey of Japanese nurses. The questionnaire referred to the survey items of REFLEX modified for use in Japan. Items common to the Japanese and European surveys were (1) The importance placed on university course elements while at university (2) Nineteen items of competency: for the abilities acquired in the present job ('Acquired skills') and those considered necessary to perform the job ('Required abilities on the job') (3) Usefulness of subject matter taught at university to the current job (1) The important course elements in Europe were 'Internship, work placement' and 'Lecture' while those in Japan were 'Theories and paradigms' and 'Lecture'. (2) The mean values for 'Acquired skills' were 5.06 for Europe and 3.73 for Japan and those for 'Required abilities on the job' were 4.86 for Europe and 5.16 for Japan. In Europe, no significant gap was observed between the above two scores, but in Japan, a big gap was found, particularly in relation to 'Ability to assert your authority'. (3) In terms of the usefulness of university-learned nursing education, Japan scored significantly lower on all five items. The content of basic university education for nursing is directly linked to the workplace in Europe but not in Japan. A comparison of competencies shows that in Japan, self-evaluation scores are low and expectations are high. Copyright © 2012 Elsevier Ltd. All rights reserved.
Criterion-Referenced Test Items for Auto Body.
ERIC Educational Resources Information Center
Tannehill, Dana, Ed.
This test item bank on auto body repair contains criterion-referenced test questions based upon competencies found in the Missouri Auto Body Competency Profile. Some test items are keyed for multiple competencies. The tests cover the following 26 competency areas in the auto body curriculum: auto body careers; measuring and mixing; tools and…
Annotti, Lee A; Teglasi, Hedwig
2017-01-01
Real-world contexts differ in the clarity of expectations for desired responses, as do assessment procedures, ranging along a continuum from maximal conditions that provide well-defined expectations to typical conditions that provide ill-defined expectations. Executive functions guide effective social interactions, but relations between them have not been studied with measures that are matched in the clarity of response expectations. In predicting teacher-rated social competence (SC) from kindergarteners' performance on tasks of executive functions (EFs), we found better model-data fit indexes when both measures were similar in the clarity of response expectations for the child. The maximal EF measure, the Developmental Neuropsychological Assessment, presents well-defined response expectations, and the typical EF measure, 5 scales from the Thematic Apperception Test (TAT), presents ill-defined response expectations (i.e., Abstraction, Perceptual Integration, Cognitive-Experiential Integration, and Associative Thinking). To assess SC under maximal and typical conditions, we used 2 teacher-rated questionnaires, with items, respectively, that emphasize well-defined and ill-defined expectations: the Behavior Rating Inventory: Behavioral Regulation Index and the Social Skills Improvement System: Social Competence Scale. Findings suggest that matching clarity of expectations improves generalization across measures and highlight the usefulness of the TAT to measure EF.
Developing a cultural competence inventory for nurses in China.
Cai, D; Kunaviktikul, W; Klunklin, A; Sripusanapan, A; Avant, P K
2017-06-01
To develop and psychometrically test the Cultural Competence Inventory for Nurses in China. Cultural competence is expected worldwide from nurses due to the increasing cultural diversity of people in healthcare establishments. Yet, no cultural competence framework or instrument for nurses has been identified to guide nursing practice in China where the cultural diversity of the populations and the characteristics of the healthcare system are different from those of the West. A review of literature and individual interviews among nurse experts generated 74 items, which were evaluated by six experts in transcultural nursing. A stratified random sampling technique was used to recruit 520 Chinese nurses for the field test. Construct validity and internal consistency reliability of the instrument were estimated by exploratory factor analysis and Cronbach's alpha, respectively. The data were collected from May 2015 to January 2016. The final instrument consists of 29 items in five dimensions, namely 'cultural awareness, cultural respect, cultural knowledge, cultural understanding and cultural skills'. Cronbach's alpha for the instrument was 0.94, with a range of 0.79-0.92 for the individual dimensions. The evidence for contrast-group validity (P < 0.001) was also obtained. The study provides evidence that the Cultural Competence Inventory for Nurses in China is reliable, valid and culturally sensitive for measuring nurses' cultural competence. The instrument development process facilitates the understanding of cultural competence globally. Cultural competence of nurses can be evaluated for self-development, workforce management and quality assurance. The instrument can also serve as the foundation to develop education curricula and nursing procedures or protocols to improve culturally competent nursing practice. © 2017 International Council of Nurses.
Adaptive behavior of institutionalized individuals with Down syndrome.
Silverstein, A B; Ageno, D; Alleman, A C; Derecho, K T; Gray, S B; White, J F
1985-03-01
Institutional residents with Down syndrome (N = 413) were matched with an equal number of residents in other diagnostic categories with respect to sex, age, length of hospitalization, and IQ. The two groups were compared on 62 items of the Client Development Evaluation Report, and significant differences were found on 19 of these items. The subjects with Down syndrome tended to show greater social competence (except in the clarity of their speech) and less maladaptive behavior. To account for these differences, we offer the speculative hypothesis that the favorable expectations of service providers for their clients with Down syndrome may come to serve as self-fulfilling prophecies.
Identifying Core Competencies of Infection Control Nurse Specialists in Hong Kong.
Chan, Wai Fong; Bond, Trevor G; Adamson, Bob; Chow, Meyrick
2016-01-01
To confirm a core competency scale for Hong Kong infection control nurses at the advanced nursing practice level from the core competency items proposed in a previous phase of this study. This would serve as the foundation of competency assurance in Hong Kong hospitals. A cross-sectional survey design was used. All public and private hospitals in Hong Kong. All infection control nurses in hospitals of Hong Kong. The 83-item proposed core competency list established in an earlier study was transformed into a questionnaire and sent to 112 infection control nurses in 48 hospitals in Hong Kong. They were asked to rate the importance of each infection prevention and control item using Likert-style response categories. Data were analyzed using the Rasch model. The response rate of 81.25% was achieved. Seven items were removed from the proposed core competency list, leaving a scale of 76 items that fit the measurement requirements of the unidimensional Rasch model. Essential core competency items of advanced practice for infection control nurses in Hong Kong were identified based on the measurement criteria of the Rasch model. Several items of the scale that reflect local Hong Kong contextual characteristics are distinguished from the overseas standards. This local-specific competency list could serve as the foundation for education and for certification of infection control nurse specialists in Hong Kong. Rasch measurement is an appropriate analytical tool for identifying core competencies of advanced practice nurses in other specialties and in other locations in a manner that incorporates practitioner judgment and expertise.
The Positive Illusory Bias in Children and Adolescents With ADHD: Further Evidence.
Volz-Sidiropoulou, Eftychia; Boecker, Maren; Gauggel, Siegfried
2016-02-01
This study aimed to examine the accuracy of self-reports of children and adolescents with ADHD in evaluating activity limitations. Self-reports of children/adolescents with ADHD (n = 89) were compared with those of nonreferred children (n = 94), relative to parent reports about children's competence. Competence was measured with a 34-item rating scale. Behavioral disorders were documented with the Child Behavior Checklist. Children/adolescents with ADHD were much more likely than controls to overestimate their competence in certain daily activities relative to parent reports, demonstrating a positive illusory bias. Positive illusory bias was found to be pronounced in activities, which were expected to be affected by symptoms of ADHD. Overestimations of competencies were more likely to be accompanied with externalizing problems. Results support the presence of the positive illusory bias also in the domain of everyday life activities. Improvement of self-evaluation of competencies should become a focus of treatment. © The Author(s) 2013.
Li, James T-C; Stoll, Doris A; Smith, June E; Lin, John J; Swing, Susan R
2003-09-01
The Accreditation Council for Graduate Medical Education (ACGME) and the American Board of Medical Specialties (ABMS) have identified six areas of general competency. This study surveyed graduates of allergy and immunology training programs about their perceived clinical competency and the adequacy of their subspecialty training. In August 2000 and May 2001, a questionnaire was mailed to 373 physicians who had completed a fellowship in allergy and immunology in the United States between 1995 and 2001. Physicians were asked to rate the perceived importance and adequacy of their training in, and their level of competency for, 57 general competencies and subspecialty-specific competencies and procedures. A total of 253 physicians responded (68%). All items in the six ACGME/ABMS general competencies had high ratings (>/= 90%) for perceived importance. One item in the practice-based learning area had low ratings for adequacy of training (57%) and intermediate for competency (75%). Two items in the system-based practice area had low ratings for training (65% and 67%) and intermediate for competency (86% and 88%). Generally, core specialty-specific items (allergic rhinitis, asthma, and urticaria) had high ratings (>/= 90%) for importance, training, and competency. Without exception, items with ratings of less than 70% for adequacy of training also had ratings of less than 90% for competency. The general competencies were considered important, but training in system-based practice and practice-based learning may be deficient. Although self-perceived competency in core areas of allergy and immunology was high, weaknesses in training and self-perceived competency in selected areas were identified.
Criterion-Referenced Test Items for Small Engines.
ERIC Educational Resources Information Center
Herd, Amon
This notebook contains criterion-referenced test items for testing students' knowledge of small engines. The test items are based upon competencies found in the Missouri Small Engine Competency Profile. The test item bank is organized in 18 sections that cover the following duties: shop procedures; tools and equipment; fasteners; servicing fuel…
Osman, Helen; Jorm, Anthony F; Killackey, Eoin; Francey, Shona; Mulcahy, Dianne
2017-08-09
The aim of this study was to identify the core competencies required of mental health professionals working in the early psychosis field, which could function as an evidence-based tool to support the early psychosis workforce and in turn assist early psychosis service implementation and strengthen early psychosis model fidelity. The Delphi method was used to establish expert consensus on the core competencies. In the first stage, a systematic literature search was conducted to generate competency items. In the second stage, a panel consisting of expert early psychosis clinicians from around the world was formed. Panel members then rated each of the competency items on how essential they are to the clinical practice of all early psychosis clinicians. In total, 1023 pieces of literature including textbooks, journal articles and grey literature were reviewed. A final 542 competency items were identified for inclusion in the questionnaire. A total of 63 early psychosis experts participated in 3 rating rounds. Of the 542 competency items, 242 were endorsed as the required core competencies. There were 29 competency items that were endorsed by 62 or more experts, and these may be considered the foundational competencies for early psychosis practice. The study generated a set of core competencies that provide a common language for early psychosis clinicians across professional disciplines and country of practice, and potentially are a useful professional resource to support early psychosis workforce development and service reform. © 2017 John Wiley & Sons Australia, Ltd.
Mori, Koji; Nagata, Masako; Hiraoka, Mika; Kudo, Megumi; Nagata, Tomohisa; Kajiki, Shigeyuki
2015-01-01
The aim of this study was to study the necessary competencies for specialist occupational physicians in Japan and the effective training methods for acquiring them. A competency list (61 items) was developed for the questionnaires in the study by making use of existing competency lists from the Japan Society for Occupational Health (JSOH) as well as lists from the US and Europe. Certified senior occupational physicians (CSOPs) in the certification program of the JSOH completed a questionnaire on the necessary competencies. Examiners of the examination for certified occupational physicians (COPs) completed another questionnaire on effective training methods. All 61 competencies in the questionnaires were evaluated as "necessary". Some of the competencies in the list from the JSOH were evaluated lower than the items added from the American and European lists. When the respondents were categorized into a "practical group", the members of which mainly provided occupational health services, an "academic group", the members of which belonged to research or education institutes such as medical schools, and all others, the practical group evaluated some competencies significantly higher than the academic group, particularly those related to work accommodation. Among three options for training methods, the most effective methods were lectures and textbooks for 5 competency items, on-the-job training (OJT) for 30 items, and case-based learning (CBL) for 29 items. Some competencies should be added to the JSOH list. CBL should be introduced in training programs for specialist occupational physicians.
Assessment of Self-Efficacy in Systems Engineering as an Indicator of Competency Level Achievement
2014-06-01
11 C. RESEARCH ON SELF-EFFICACY IN INFORMATION TECHNOLOGY —A PARALLEL TO SYSTEMS ENGINEERING ......13 1. Stakeholder Analysis...Expectancy value theory FA Factor analysis IT Information technology KSA Knowledge, skills, abilities MIS Management information systems NPS...item in particular reflected statistically significant pre- and post-survey results at p<.001, which was the student’s ability to pick a technology for
A Game of Hide and Seek: Expectations of Clumpy Resources Influence Hiding and Searching Patterns
Wilke, Andreas; Minich, Steven; Panis, Megane; Langen, Tom A.; Skufca, Joseph D.; Todd, Peter M.
2015-01-01
Resources are often distributed in clumps or patches in space, unless an agent is trying to protect them from discovery and theft using a dispersed distribution. We uncover human expectations of such spatial resource patterns in collaborative and competitive settings via a sequential multi-person game in which participants hid resources for the next participant to seek. When collaborating, resources were mostly hidden in clumpy distributions, but when competing, resources were hidden in more dispersed (random or hyperdispersed) patterns to increase the searching difficulty for the other player. More dispersed resource distributions came at the cost of higher overall hiding (as well as searching) times, decreased payoffs, and an increased difficulty when the hider had to recall earlier hiding locations at the end of the experiment. Participants’ search strategies were also affected by their underlying expectations, using a win-stay lose-shift strategy appropriate for clumpy resources when searching for collaboratively-hidden items, but moving equally far after finding or not finding an item in competitive settings, as appropriate for dispersed resources. Thus participants showed expectations for clumpy versus dispersed spatial resources that matched the distributions commonly found in collaborative versus competitive foraging settings. PMID:26154661
Development and Testing of the Nurse Manager EBP Competency Scale.
Shuman, Clayton J; Ploutz-Snyder, Robert J; Titler, Marita G
2018-02-01
The purpose of this study was to develop and evaluate the validity and reliability of an instrument to measure nurse manager competencies regarding evidence-based practice (EBP). The Nurse Manager EBP Competency Scale consists of 16 items for respondents to indicate their perceived level of competency on a 0 to 3 Likert-type scale. Content validity was demonstrated through expert panel review and pilot testing. Principal axis factoring and Cronbach's alpha evaluated construct validity and internal consistency reliability, respectively. Eighty-three nurse managers completed the scale. Exploratory factor analysis resulted in a 16-item scale with two subscales, EBP Knowledge ( n = 6 items, α = .90) and EBP Activity ( n = 10 items, α = .94). Cronbach's alpha for the entire scale was .95. The Nurse Manager EBP Competency Scale is a brief measure of nurse manager EBP competency with evidence of validity and reliability. The scale can enhance our understanding in future studies regarding how nurse manager EBP competency affects implementation.
The validation of the Supervision of Thesis Questionnaire (STQ).
Henricson, Maria; Fridlund, Bengt; Mårtensson, Jan; Hedberg, Berith
2018-06-01
The supervision process is characterized by differences between the supervisors' and the students' expectations before the start of writing a bachelor thesis as well as after its completion. A review of the literature did not reveal any scientifically tested questionnaire for evaluating nursing students' expectations of the supervision process when writing a bachelor thesis. The aim of the study was to determine the construct validity and internal consistency reliability of a questionnaire for measuring nursing students' expectations of the bachelor thesis supervision process. The study had a developmental and methodological design carried out in four steps including construct validity and internal consistency reliability statistical procedures: construction of the items, assessment of face validity, data collection and data analysis. This study was conducted at a university in southern Sweden, where students on the "Nursing student thesis, 15 ECTS" course were consecutively selected for participation. Of the 512 questionnaires distributed, 327 were returned, a response rate of 64%. Five factors with a total variance of 74% and good communalities, ≥0.64, were extracted from the 10-item STQ. The internal consistency of the 10 items was 0.68. The five factors were labelled: The nature of the supervision process, The supervisor's role as a coach, The students' progression to self-support, The interaction between students and supervisor and supervisor competence. A didactic, useful and secure questionnaire measuring nursing students' expectations of the bachelor thesis supervision process based on three main forms of supervision was created. Copyright © 2018 Elsevier Ltd. All rights reserved.
The development and validation of the Perceived Health Competence Scale.
Smith, M S; Wallston, K A; Smith, C A
1995-03-01
A sense of competence or self-efficacy is associated with many positive outcomes, particularly in the area of health behavior. A measure of a sense of competence in the domain of health behavior has not been developed. Most measures are either general measures of a general sense of self-efficacy or are very specific to a particular health behavior. The Perceived Health Competence Scale (PHCS), a domain-specific measure of the degree to which an individual feels capable of effectively managing his or her health outcomes, was developed to provide a measure of perceived competence at an intermediate level of specificity. Five studies using three different types of samples (students, adults and persons with a chronic illness) provide evidence for the reliability and validity of the PHCS. The eight items of the PHCS combine both outcome and behavioral expectancies. Results from the five studies indicate that the scale has good internal consistency and test-retest reliability. The construct validity of the scale is demonstrated through the support obtained for substantive hypotheses regarding the correlates of perceived health competence, such as health behavior intentions, general sense of competence and health locus of control.
ERIC Educational Resources Information Center
Downing, Steven M.; Maatsch, Jack L.
To test the effect of clinically relevant multiple-choice item content on the validity of statistical discriminations of physicians' clinical competence, data were collected from a field test of the Emergency Medicine Examination, test items for the certification of specialists in emergency medicine. Two 91-item multiple-choice subscales were…
Shewade, Hemant Deepak; Jeyashree, Kathiresan; Kalaiselvi, Selvaraj; Palanivel, Chinnakali; Panigrahi, Krishna Chandra
2017-01-01
A community-based training (CBT) program, where teaching and training are carried out in the community outside of the teaching hospital, is a vital part of undergraduate medical education. Worldwide, there is a shift to competency-based training, and CBT is no exception. We attempted to develop a tool that uses a competency-based approach for assessment of CBT. Based on a review on competencies, we prepared a preliminary list of major domains with items under each domain. We used the Delphi technique to arrive at a consensus on this assessment tool. The Delphi panel consisted of eight purposively selected experts from the field of community medicine. The panel rated each item for its relevance, sensitivity, specificity, and understandability on a scale of 0-4. Median ratings were calculated at the end of each round and shared with the panel. Consensus was predefined as when 70% of the experts gave a rating of 3 or above for an item under relevance, sensitivity, and specificity. If an item failed to achieve consensus after being rated in 2 consecutive rounds, it was excluded. Anonymity of responses was maintained. The panel arrived at a consensus at the end of 3 rounds. The final version of the self-assessment tool consisted of 7 domains and 74 items. The domains (number of items) were Public health - epidemiology and research methodology (13), Public health - biostatistics (6), Public health administration at primary health center level (17), Family medicine (24), Cultural competencies (3), Community development and advocacy (2), and Generic competence (9). Each item was given a maximum score of 5 and minimum score of 1. This is the first study worldwide to develop a tool for competency-based evaluation of CBT in undergraduate medical education. The competencies identified in the 74-item questionnaire may provide the base for development of authentic curricula for CBT.
Psychometric Evaluation of a Cultural Competency Assessment Instrument for Health Professionals
Haywood, Sonja H.; Goode, Tawara; Gao, Yong; Smith, Kristyn; Bronheim, Suzanne; Flocke, Susan A; Zyzanski, Steve
2012-01-01
Background Few valid and reliable measures exist for health care professionals interested in determining their levels of cultural and linguistic competence. Objective To evaluate the measurement properties of the Cultural Competence Health Practitioner Assessment (CCHPA-129). Methods The CCHPA-129 is a 129-item web-based instrument, developed by the National Center for Cultural Competence (NCCC). Responses on the CCHPA -129 were examined using factor analysis; Rasch modeling; and Differential Item Functioning (DIF) across race, ethnicity, gender, and profession. Subjects 2504 practitioners, including 1864 nurses (RN/LPN,/BSN); 341 clinicians (PA/NP); and 299 physicians (MD/DO), who completed the CCHPA-129 online between 2005 and 2008. Results Three factors representing domains of knowledge, adapting practice, and promoting health for culturally and linguistically diverse populations accounted for 46% of the variance. Among Knowledge factor items, 53% (23/43) fit the Rasch model, item difficulties ranged from −1.01 logits (least difficult) to +1.11 logits (most difficult), separation index (SI) 13.82, and Cronbach’s α 0.92. Forty-seven percent (21/44) Adapting Practice factor items fit the model, item difficulties −0.07 to +1.11 logits, SI 11.59, Cronbach’s α 0.88; and 58% (23/39). Promoting Health factor items fit the model, item difficulties −1.01 to +1.38 logits, SI 22.64, Cronbach’s α 0.92. Early evidence of validity was established by known groups having statistically different scores. Conclusion The 67-item CCHPA-67 is psychometrically sound. This shorted instrument can be used to establish associations between practitioners’ cultural and linguistic competence and health outcomes as well as to evaluate interventions to increase practitioners’ cultural and linguistic competence. PMID:22437625
Self-assessment of competencies in dental education in Germany - a multicentred survey.
Bitter, K; Rüttermann, S; Lippmann, M; Hahn, P; Giesler, M
2016-11-01
The aim was to assess the competencies of undergraduate dental students in Germany in the domains team competence, communicative competence, learning competence and scholarship. The survey was conducted at 11 dental schools that are equally distributed all over Germany. Competencies were assessed with the Freiburg Questionnaire to Assess Competencies in Medicine (FCM). A short version of the FCM was used in this study. This short form included the four domains: team competence (three items), communicative competence (eight items), learning competence (five items) and scholarship (four items). Students had to rate each item twice: first with regard to the respondent's current level of competence and second with regard to the level of competence that respondents think is required by their job. All items were rated on a five-point Likert scale (1 'very much' and 5 'not at all'). Responsible lecturers from all selected dental schools received another questionnaire to answer the questions whether the FCM domain corresponding learning objectives were taught at the respective dental school. A total of 317 undergraduate students from 11 dental schools in their last clinical year participated. The response rate varied between 48% and 92%. Cronbach's α for the FCM scales addressing the current level of competencies ranged from 0.70 to 0.89 and for the scales measuring the presumed level of competencies demanded by their job ranged from 0.72 to 0.82. The mean values of the scales for the assessment of the presumed level of competencies demanded by the job were significantly lower compared to the mean values of the scales for the current level of competencies (P < 0.001 in all analyses). We found large differences between the two levels - in terms of 'standardised response means' (SRM) - in the domains team competence (SRM 1.34), learning competence (SRM 1.27) and communicative competence (SRM 1.18). Overall, the learning objectives that correspond to the assessed domains of competencies were taught to 19.6% completely, to 55.4% partially and to 25% not at all at the participating dental schools. The results of the present survey revealed that the participating students perceived deficiencies in all domains of competencies. These results indicate that the assessed domains are still barely integrated into dental medicine curricula in Germany and that further research in this field is needed. © 2015 John Wiley & Sons A/S. Published by John Wiley & Sons Ltd.
Fleming, Michael; House, Stephanie; Hanson, Vansa Shewakramani; Yu, Lan; Garbutt, Jane; McGee, Richard; Kroenke, Kurt; Abedin, Zainab; Rubio, Doris M
2013-07-01
To determine the psychometric properties of the Mentoring Competency Assessment (MCA), a 26-item skills inventory that enables research mentors and mentees to evaluate six competencies of mentors: maintaining effective communication, aligning expectations, assessing understanding, addressing diversity, fostering independence, and promoting professional development. In 2010, investigators administered the MCA to 283 mentor-mentee pairs from 16 universities participating in a trial of a mentoring curriculum for clinical and translational research mentors. The authors analyzed baseline MCA data to describe the instrument's psychometric properties. Coefficient alpha scores for the MCA showed reliability (internal consistency). The hypothesized model with its six latent constructs (competencies) resulted in an acceptable fit to the data. For the instrument completed by mentors, chi-square = 663.20; df = 284; P < .001; root mean square error of approximation (RMSEA) = 0.069 (90% CI, 0.062-0.076); comparative fit index (CFI) = 0.85; and Tucker-Lewis index (TLI) = 0.83. For the instrument completed by mentees, chi-square = 840.62; df = 284; P < .001; RMSEA = 0.080 (90% CI, 0.063-0.077); CFI = 0.87; and TLI = 0.85. The correlations among the six competencies were high: 0.49-0.87 for mentors, 0.58-0.92 for mentees. All parameter estimates for the individual items were significant; standardized factor loadings ranged from 0.32 to 0.81 for mentors and 0.56 to 0.86 for mentees. The findings demonstrate that the MCA has reliability and validity. In addition, this study provides preliminary norms derived from a national sample of mentors and mentees.
An analysis of the masking of speech by competing speech using self-report data.
Agus, Trevor R; Akeroyd, Michael A; Noble, William; Bhullar, Navjot
2009-01-01
Many of the items in the "Speech, Spatial, and Qualities of Hearing" scale questionnaire [S. Gatehouse and W. Noble, Int. J. Audiol. 43, 85-99 (2004)] are concerned with speech understanding in a variety of backgrounds, both speech and nonspeech. To study if this self-report data reflected informational masking, previously collected data on 414 people were analyzed. The lowest scores (greatest difficulties) were found for the two items in which there were two speech targets, with successively higher scores for competing speech (six items), energetic masking (one item), and no masking (three items). The results suggest significant masking by competing speech in everyday listening situations.
Patient satisfaction with nursing care in an urban and suburban emergency department.
Wright, Greg; Causey, Sherry; Dienemann, Jacqueline; Guiton, Paula; Coleman, Frankie Sue; Nussbaum, Marcy
2013-10-01
Patient satisfaction is an important outcome measurement in the emergency department (ED). When unavoidable, the negative effect of patient wait time may be lessened by communicating expected wait time, affective support, health information, decisional control, and competent providers. This controlled quasi-experimental design used a convenience sample. The patient questionnaire included demographics, expected and perceived wait time, receiving of comfort items, information and engaging activities and their perceived helpfulness for coping with waiting, and the Consumer Emergency Care Satisfaction Scale measure of patient satisfaction with nursing. Systematic offering of comfort items, clinical information, and engaging activities were statistically analyzed for impact on perceived wait times, helpfulness in waiting, and satisfaction with nursing care. Interventions were supported by the data as helpful for coping with waiting and were significantly related to nursing care satisfaction. Interventions were less helpful for suburban patients who were also less satisfied. Nurses can influence patient satisfaction in the ED through communication and caring behaviors.
Using the Entrustable Professional Activities Framework in the Assessment of Procedural Skills.
Pugh, Debra; Cavalcanti, Rodrigo B; Halman, Samantha; Ma, Irene W Y; Mylopoulos, Maria; Shanks, David; Stroud, Lynfa
2017-04-01
The entrustable professional activity (EPA) framework has been identified as a useful approach to assessment in competency-based education. To apply an EPA framework for assessment, essential skills necessary for entrustment to occur must first be identified. Using an EPA framework, our study sought to (1) define the essential skills required for entrustment for 7 bedside procedures expected of graduates of Canadian internal medicine (IM) residency programs, and (2) develop rubrics for the assessment of these procedural skills. An initial list of essential skills was defined for each procedural EPA by focus groups of experts at 4 academic centers using the nominal group technique. These lists were subsequently vetted by representatives from all Canadian IM training programs through a web-based survey. Consensus (more than 80% agreement) about inclusion of each item was sought using a modified Delphi exercise. Qualitative survey data were analyzed using a framework approach to inform final assessment rubrics for each procedure. Initial lists of essential skills for procedural EPAs ranged from 10 to 24 items. A total of 111 experts completed the national survey. After 2 iterations, consensus was reached on all items. Following qualitative analysis, final rubrics were created, which included 6 to 10 items per procedure. These EPA-based assessment rubrics represent a national consensus by Canadian IM clinician educators. They provide a practical guide for the assessment of procedural skills in a competency-based education model, and a robust foundation for future research on their implementation and evaluation.
Development and Validation of the Career Competencies Indicator (CCI)
ERIC Educational Resources Information Center
Francis-Smythe, Jan; Haase, Sandra; Thomas, Erica; Steele, Catherine
2013-01-01
This article describes the development and validation of the Career Competencies Indicator (CCI); a 43-item measure to assess career competencies (CCs). Following an extensive literature review, a comprehensive item generation process involving consultation with subject matter experts, a pilot study and a factor analytic study on a large sample…
Giroux, Peter; Woodall, William; Weber, Mark; Bailey, Jessica
2012-02-01
The primary purpose of this study was to identify the practitioner competencies that occupational therapists perceive as important for handwriting evaluation and intervention in school-aged children. A secondary purpose was to compare the practitioner perceptions of those in school-based practice with those from other primary practice settings. A stratified random sample of 376 occupational therapists recruited from a national professional organization database participated by completing a survey instrument containing 80 competency items. A majority of the 80 practitioner competency items were perceived to be of high importance to the respondent groups. A significance difference in perception when comparing the school-based practitioners to all other practitioners was revealed in only 3-12 competency summary categories. Practitioner competency survey items were perceived to be of high importance to the participants. School-based practitioner perceptions of competency were, for the most part, mainly similar to those in other primary practice settings.
Using Likert-type and ipsative/forced choice items in sequence to generate a preference.
Ried, L Douglas
2014-01-01
Collaboration and implementation of a minimum, standardized set of core global educational and professional competencies seems appropriate given the expanding international evolution of pharmacy practice. However, winnowing down hundreds of competencies from a plethora of local, national and international competency frameworks to select the most highly preferred to be included in the core set is a daunting task. The objective of this paper is to describe a combination of strategies used to ascertain the most highly preferred items among a large number of disparate items. In this case, the items were >100 educational and professional competencies that might be incorporated as the core components of new and existing competency frameworks. Panelists (n = 30) from the European Union (EU) and United States (USA) were chosen to reflect a variety of practice settings. Each panelist completed two electronic surveys. The first survey presented competencies in a Likert-type format and the second survey presented many of the same competencies in an ipsative/forced choice format. Item mean scores were calculated for each competency, the competencies were ranked, and non-parametric statistical tests were used to ascertain the consistency in the rankings achieved by the two strategies. This exploratory study presented over 100 competencies to the panelists in the beginning. The two methods provided similar results, as indicated by the significant correlation between the rankings (Spearman's rho = 0.30, P < 0.09). A two-step strategy using Likert-type and ipsative/forced choice formats in sequence, appears to be useful in a situation where a clear preference is required from among a large number of choices. The ipsative/forced choice format resulted in some differences in the competency preferences because the panelists could not rate them equally by design. While this strategy was used for the selection of professional educational competencies in this exploratory study, it is applicable in other situations where a smaller set of highly preferred items might be selected from a large list of choices in other areas of inquiry (e.g., patient reported outcomes). Copyright © 2014 Elsevier Inc. All rights reserved.
Psychometric Properties of the Canadian Nurse Informatics Competency Assessment Scale.
Kleib, Manal; Nagle, Lynn
2018-04-10
Assessment of nursing informatics competencies has gained momentum in the scholarly literature in response to the increased need for resources available to support informatics capacity in nursing. The purpose of this study was to examine the factor structure and internal consistency reliability of the Canadian Nurse Informatics Competency Assessment Scale, a newly developed 21-item measure based on published entry-to-practice informatics competencies for RNs. For this study, 2844 nurses completed the Canadian Nurse Informatics Competency Assessment Scale through a cross-sectional survey. Exploratory principal component analysis with oblique promax rotation revealed a four-component/factor structure for the 21-item Canadian Nurse Informatics Competency Assessment Scale, explaining 61.04% of the variance. Item loading per each component reflected the original Canadian Association of Schools of Nursing grouping of nursing informatics competency indicators, as per three key domains of competency: information and knowledge management (α = .85); professional and regulatory accountability (α = .81); and use of information and communication technology in the delivery of patient care (α = .87) with the exception of one item (Indicator 3), which loaded into the category of foundational information and communication technology skills (α = .81). This study provided preliminary evidence for the construct validity of the entry-to-practice competency domains and the factor structure and reliability of the Canadian Nurse Informatics Competency Assessment Scale among practicing nurses. Further testing among nurses in other settings and among nursing students is recommended.
Gillespie, Brigid M; Polit, Denise F; Hamlin, Lois; Chaboyer, Wendy
2012-01-01
This paper describes the development and validation of the Revised Perioperative Competence Scale (PPCS-R). There is a lack of a psychometrically tested sound self-assessment tools to measure nurses' perceived competence in the operating room. Content validity was established by a panel of international experts and the original 98-item scale was pilot tested with 345 nurses in Queensland, Australia. Following the removal of several items, a national sample that included all 3209 nurses who were members of the Australian College of Operating Room Nurses was surveyed using the 94-item version. Psychometric testing assessed content validity using exploratory factor analysis, internal consistency using Cronbach's alpha, and construct validity using the "known groups" technique. During item reduction, several preliminary factor analyses were performed on two random halves of the sample (n=550). Usable data for psychometric assessment were obtained from 1122 nurses. The original 94-item scale was reduced to 40 items. The final factor analysis using the entire sample resulted in a 40 item six-factor solution. Cronbach's alpha for the 40-item scale was .96. Construct validation demonstrated significant differences (p<.0001) in perceived competence scores relative to years of operating room experience and receipt of specialty education. On the basis of these results, the psychometric properties of the PPCS-R were considered encouraging. Further testing of the tool in different samples of operating room nurses is necessary to enable cross-cultural comparisons. Copyright © 2011 Elsevier Ltd. All rights reserved.
Competency standards for newly graduated prosthetist/orthotists in Sweden.
Ramstrand, Nerrolyn; Ramstrand, Simon
2018-05-01
There are currently no national competency standards upon which to develop educational objectives for prosthetist/orthotists in Sweden. While standards have been developed in other countries, they cannot be applied without confirming their relevance in a Swedish context. To describe and obtain consensus on core competencies required for newly graduated prosthetist/orthotists in Sweden. Modified Delphi process. A modified Delphi technique was carried out. Focus groups were initially used to identify core competency domains. Two consecutive questionnaires, containing a list of potential competency items, were sent to a group of stakeholders with ties to the prosthetic and orthotic profession. Stakeholders were requested to rate their level of agreement with each competency item and provide written comments. Finally, two focus groups were conducted to obtain feedback on the draft competency standards. Forty-four competency items, listed under five key domains of practice, were identified as essential for newly graduated prosthetist/orthotists in Sweden. Many similarities exist in core competency descriptions for prosthetist/orthotists in Sweden when compared to other countries. Regional differences do however exist, and it is important to confirm the relevance of core competency items at a national level before they are applied. Clinical relevance Competency standards developed in this study can be used to guide development of learning objectives within an undergraduate prosthetic and orthotic program, provide a framework for workforce development, assist professional organizations in understanding the needs of their members, and prepare for international accreditation.
Application of cognitive diagnosis models to competency-based situational judgment tests.
García, Pablo Eduardo; Olea, Julio; De la Torre, Jimmy
2014-01-01
Profiling of jobs in terms of competency requirements has increasingly been applied in many organizational settings. Testing these competencies through situational judgment tests (SJTs) leads to validity problems because it is not usually clear which constructs SJTs measure. The primary purpose of this paper is to evaluate whether the application of cognitive diagnosis models (CDM) to competency-based SJTs can ascertain the underlying competencies measured by the items, and whether these competencies can be estimated precisely. The generalized deterministic inputs, noisy "and" gate (G-DINA) model was applied to 26 situational judgment items measuring professional competencies based on the great eight model. These items were applied to 485 employees of a Spanish financial company. The fit of the model to the data and the convergent validity between the estimated competencies and personality dimensions were examined. The G-DINA showed a good fit to the data and the estimated competency factors, adapting and coping and interacting and presenting were positively related to emotional stability and extraversion, respectively. This work indicates that CDM can be a useful tool when measuring professional competencies through SJTs. CDM can clarify the competencies being measured and provide precise estimates of these competencies.
Strand, G A
1981-01-01
A survey was conducted to determine leadership competencies as perceived by 679 community residents (urban/rural) in six states of the Northeast United States. Respondents were asked to rate the extent to which it is important for a community leader to use each competency listed in the instrument. A factor analysis reduced the list of 39 competency items examined into nine distinct factors. Alpha internal consistency estimates revealed the strength of correlation among items in each factor. A series of one-way analyses of variance failed to show a significant difference between urban/rural community respondents' scores for each factor. The findings suggest specific leadership competencies which should be emphasized in training experiences. Conceptual competencies were identified as most important (problem delineation, organization, management of change, etc.), followed by human competencies (demeanor, empathy, attitudes) and technical competencies (budgeting, supervision, needs assessment) respectively. Items within each factor have implications for development of specific content areas in a leadership training curriculum for public health educators. PMID:7468880
Chang, Li-Chun; Chen, Yu-Chi; Liao, Li-Ling; Wu, Fei Ling; Hsieh, Pei-Lin; Chen, Hsiao-Jung
2017-01-01
The study aimed to illustrate the constructs and test the psychometric properties of an instrument of health literacy competencies (IOHLC) for health professionals. A multi-phase questionnaire development method was used to develop the scale. The categorization of the knowledge and practice domains achieved consensus through a modified Delphi process. To reduce the number of items, the 92-item IOHLC was psychometrically evaluated through internal consistency, Rasch modeling, and two-stage factor analysis. In total, 736 practitioners, including nurses, nurse practitioners, health educators, case managers, and dieticians completed the 92-item IOHLC online from May 2012 to January 2013. The final version of the IOHLC covered 9 knowledge items and 40 skill items containing 9 dimensions, with good model fit, and explaining 72% of total variance. All domains had acceptable internal consistency and discriminant validity. The tool in this study is the first to verify health literacy competencies rigorously. Moreover, through psychometric testing, the 49-item IOHLC demonstrates adequate reliability and validity. The IOHLC may serve as a reference for the theoretical and in-service training of Chinese-speaking individuals' health literacy competencies.
ERIC Educational Resources Information Center
Pohl, Steffi; Gräfe, Linda; Rose, Norman
2014-01-01
Data from competence tests usually show a number of missing responses on test items due to both omitted and not-reached items. Different approaches for dealing with missing responses exist, and there are no clear guidelines on which of those to use. While classical approaches rely on an ignorable missing data mechanism, the most recently developed…
Development and validation of competencies for return to work coordinators.
Pransky, Glenn; Shaw, William S; Loisel, Patrick; Hong, Quan Nha; Désorcy, Bruno
2010-03-01
Return to work (RTW) coordinators are a key element in programs that facilitate RTW of injured or ill workers, yet little research documents the competencies required for success in this role. Competencies were defined as knowledge, skills, attitudes, and behaviors. Eight focus groups were conducted with 75 experienced RTW coordinators to identify 904 individual competencies. These were subsequently reduced to 234 unique items through affinity mapping, and sorted into eight groups: administration, individual personal attributes, information gathering, communication, professional credibility, evaluation, problem-solving, and conflict management. A subset of 100 items, including 88 items most often cited, were incorporated in an Internet-based survey that sampled a broad range of RTW coordinators from three countries. Eighty-three of the questionnaire items were rated 4 or 5 (very important or essential) by over half of the 148 respondents. There were no differences in affinity group mean ratings by country, employer, profession, or type of clients. The highest-rated items reflect general personal characteristics, or specific skills related to coordinating among all involved with the RTW process. RTW coordinators with nursing backgrounds provided slightly higher ratings for items related to medical knowledge, but otherwise their ratings were similar to non-nurses. These findings indicate a consensus across a wide range of RTW coordinators, and results can be applied to improve coordinator selection, training, and development. Certain key competencies may be well-established individual attributes, and others may be best developed through mentorship. Most of these competencies are probably best evaluated by direct observation.
Fleming, Michael; House, Stephanie; Shewakramani, Vansa; Yu, Lan; Garbutt, Jane; McGee, Richard; Kroenke, Kurt; Abedin, Zainab; Rubio, Doris M.
2013-01-01
Purpose To determine the psychometric properties of the Mentoring Competency Assessment (MCA), a 26-item skills inventory that enables research mentors and mentees to evaluate six competencies of mentors: maintaining effective communication, aligning expectations, assessing understanding, addressing diversity, and fostering independence promoting professional development. Method In 2010, investigators administered the MCA to 283 mentor–mentee pairs from 16 universities participating in a trial of a mentoring curriculum for clinical and translational research mentors. The authors analyzed baseline MCA data to describe the instrument’s psychometric properties. Results Coefficient alpha scores for the MCA showed reliability (internal consistency). The hypothesized model with its six latent constructs (competencies) resulted in an acceptable fit to the data. For the instrument completed by mentors, chi-square = 663.20; df = 284; P < .001; root mean square error of approximation (RMSEA) = 0.069 (90% CI, 0.062–0.076); confirmatory fit index (CFI) = 0.85; and Tucker-Lewis index (TLI) = 0.83. For the instrument completed by mentees, chi-square = 840.62; df = 284; P < .001; RMSEA = 0.080 (90% CI, 0.063–0.077); CFI = 0.87; and TLI = 0.85. The correlations among the six competencies were high: 0.49–0.87 for mentors, 0.58–0.92 for mentees. All parameter estimates for the individual items were significant; standardized factor loadings ranged from 0.32–0.81 for mentors and 0.56–0.86 for mentees. Conclusions The findings demonstrate that the MCA has reliability and validity. In addition, this study provides preliminary norms derived from a national sample of mentors and mentees. PMID:23702534
Multisociety task force recommendations of competencies in Pulmonary and Critical Care Medicine.
Buckley, John D; Addrizzo-Harris, Doreen J; Clay, Alison S; Curtis, J Randall; Kotloff, Robert M; Lorin, Scott M; Murin, Susan; Sessler, Curtis N; Rogers, Paul L; Rosen, Mark J; Spevetz, Antoinette; King, Talmadge E; Malhotra, Atul; Parsons, Polly E
2009-08-15
Numerous accrediting organizations are calling for competency-based medical education that would help define specific specialties and serve as a foundation for ongoing assessment throughout a practitioner's career. Pulmonary Medicine and Critical Care Medicine are two distinct subspecialties, yet many individual physicians have expertise in both because of overlapping content. Establishing specific competencies for these subspecialties identifies educational goals for trainees and guides practitioners through their lifelong learning. To define specific competencies for graduates of fellowships in Pulmonary Medicine and Internal Medicine-based Critical Care. A Task Force composed of representatives from key stakeholder societies convened to identify and define specific competencies for both disciplines. Beginning with a detailed list of existing competencies from diverse sources, the Task Force categorized each item into one of six core competency headings. Each individual item was reviewed by committee members individually, in group meetings, and conference calls. Nominal group methods were used for most items to retain the views and opinions of the minority perspective. Controversial items underwent additional whole group discussions with iterative modified-Delphi techniques. Consensus was ultimately determined by a simple majority vote. The Task Force identified and defined 327 specific competencies for Internal Medicine-based Critical Care and 276 for Pulmonary Medicine, each with a designation as either: (1) relevant, but competency is not essential or (2) competency essential to the specialty. Specific competencies in Pulmonary and Critical Care Medicine can be identified and defined using a multisociety collaborative approach. These recommendations serve as a starting point and set the stage for future modification to facilitate maximum quality of care as the specialties evolve.
A short questionnaire to assess pediatric resident’s competencies: the validation process
2013-01-01
Background In order to help assess resident performance during training, the Residency Affair Committee of the Pediatric Residency Program of the University of Padua (Italy) administered a Resident Assessment Questionnaire (ReAQ), which both residents and faculty were asked to complete. The aim of this article is to present the ReAQ and its validation. Methods The ReAQ consists of 20 items that assess the six core competencies identified by the Accreditation Council of Graduate Medical Education (ACGME). A many-facet Rasch measurement analysis was used for validating the ReAQ. Results Between July 2011 and June 2012, 211 evaluations were collected from residents and faculty. Two items were removed because their functioning changed with the gender of respondents. The step calibrations were ordered. The self evaluations (residents rating themselves) positively correlated with the hetero evaluations (faculty rating residents; Spearman’s ρ = 0.75, p < 0.001). Unfortunately, the observed agreement among faculty was smaller than expected (Exp = 47.1%; Obs = 41%), which indicates that no enough training to faculty for using the tool was provided. Conclusions In its final form, the ReAQ provides a valid unidimensional measure of core competences in pediatric residents. It produces reliable measures, distinguishes among groups of residents according to different levels of performance, and provides a resident evaluation that holds an analogous meaning for residents and faculty. PMID:23830041
Attitudes and values expected of public health nursing students at graduation: A delphi study.
Okura, Mika; Takizawa, Hiroko
2018-06-01
The skills and knowledge of the competencies expected of public health nursing (PHN) students at graduation have been clarified; however, the attitudes and values have not yet been studied in Japan. The objective of this study was to identify and reach a consensus among experts on the attitudes and values expected of PHN students at graduation. This survey was conducted as a two-stage Delphi study. We selected the following experts: 248 teachers in the faculty of public health nursing at a university as academic experts, and 250 public health nurses who were also experienced clinical instructors as clinical experts. The round 1 mailed survey was conducted using a questionnaire about the necessity and importance of attitudes and values, and 211 experts responded (42.4%, clinical; n = 124, academic; n = 87). In the Round 2 survey, the experts consisted of 60.2% of the round 1 participants (clinical; n = 73, academic; n = 54). Descriptive statistics were used for multiple imputation. We identified a total of 13 attitudes and values expected of PHN students, and reached ≥90% consensus for most items (except for one). Regarding the expected achievement level at graduation, there was no difference between clinical and academic experts except for one item. Consensus was clearly achieved for 13 attitudes and values expected of PHN students, as well as importance and expected achievement level at graduation. In the future, it is important to examine strategies that can effectively develop these attitudes and values through basic and continuous education. Copyright © 2018 Elsevier Ltd. All rights reserved.
Chao, Hui-Chen; Yang, Ya-Ping; Huang, Mei-Chih; Wang, Jing-Jy
2016-01-01
Appropriate communication skills are essential for understanding patient needs, particularly those of patients with dementia. Assessing health care providers' competence in communicating with patients with dementia is critical for planning a communication education program. However, no formally established scale can be used. The purpose of the current study was to develop a valid and reliable instrument for determining the communication competence of health care providers with patients with dementia. Through use of a literature review and previous clinical experience, an initial 28-item scale was developed to assess the frequency of use of each item by health care providers. Fourteen items were extracted and three factors were distinguished. Results indicated that the internal consistency reliability of the 14-item scale was 0.84. Favorable convergent and discriminant validities were reached. The communication competence scale provides administrators or educators with a useful tool for assessing communication competence of health care providers when interacting with patients with dementia so a suitable education program can be planned and implemented. Copyright 2016, SLACK Incorporated.
Brasseur, Sophie; Grégoire, Jacques; Bourdu, Romain; Mikolajczak, Moïra
2013-01-01
Emotional Competence (EC), which refers to individual differences in the identification, understanding, expression, regulation and use of one's own emotions and those of others, has been found to be an important predictor of individuals' adaptation to their environment. Higher EC is associated with greater happiness, better mental and physical health, more satisfying social and marital relationships and greater occupational success. While it is well-known that EC (as a whole) predicts a number of important outcomes, it is unclear so far which specific competency(ies) participate(s) in a given outcome. This is because no measure of EC distinctly measures each of the five core emotional competences, separately for one's own and others' emotions. This lack of information is problematic both theoretically (we do not understand the processes at stake) and practically (we cannot develop customized interventions). This paper aims to address this issue. We developed and validated in four steps a complete (albeit short: 50 items) self-reported measure of EC: the Profile of Emotional Competence. Analyses performed on a representative sample of 5676 subjects revealed promising psychometric properties. The internal consistency of scales and subscales alike was satisfying, factorial structure was as expected, and concurrent/discriminant validity was good.
Refining a self-assessment of informatics competency scale using Mokken scaling analysis.
Yoon, Sunmoo; Shaffer, Jonathan A; Bakken, Suzanne
2015-01-01
Healthcare environments are increasingly implementing health information technology (HIT) and those from various professions must be competent to use HIT in meaningful ways. In addition, HIT has been shown to enable interprofessional approaches to health care. The purpose of this article is to describe the refinement of the Self-Assessment of Nursing Informatics Competencies Scale (SANICS) using analytic techniques based upon item response theory (IRT) and discuss its relevance to interprofessional education and practice. In a sample of 604 nursing students, the 93-item version of SANICS was examined using non-parametric IRT. The iterative modeling procedure included 31 steps comprising: (1) assessing scalability, (2) assessing monotonicity, (3) assessing invariant item ordering, and (4) expert input. SANICS was reduced to an 18-item hierarchical scale with excellent reliability. Fundamental skills for team functioning and shared decision making among team members (e.g. "using monitoring systems appropriately," "describing general systems to support clinical care") had the highest level of difficulty, and "demonstrating basic technology skills" had the lowest difficulty level. Most items reflect informatics competencies relevant to all health professionals. Further, the approaches can be applied to construct a new hierarchical scale or refine an existing scale related to informatics attitudes or competencies for various health professions.
Shouryabi, Ali Asghar; Ghahrisarabi, Alireza; Anboohi, Sima Zohari; Nasiri, Malihe; Rassouli, Maryam
2017-11-01
Nursing competence is highly related to patient outcomes and patient safety issues, especially in intensive care units. Competence assessment tools are needed specifically for intensive care nursing. This study was performed to determine psychometric properties of the Intensive and Critical Care Nursing Competence Scale version-1 between Iranian Nurses. The present study was a methodological research in which 289 nurses of Intensive Care Units from nine hospitals in Shahid Beheshti University of Medical Sciences in Tehran were selected between 2015 and 2016. The original version of the scale was translated into Persian and back-translated into English, and the comments of the developer were applied. The validity of the scale was the determined quality (content validity and face validity) and quantity (confirmatory factor analysis). Reliability of the scale was reported by Cronbach's alpha coefficient and Intra class Correlation Coefficient. SPSS-PC (v.21) and LISREL (v.8.5) were used to analyze the data. The intensive and critical care nursing competence scale version-1 is a self-assessment test that consists of 144 items and four domains which are the knowledge base, the skill base, the attitudes and values base and the experience base, which are divided into clinical competence and professional competence. Content and face validity was confirmed by 10 experts and 10 practitioner nurses in the intensive care units. In confirmatory factor analysis, all fitness indexes, except goodness of fit index (0.64), confirmed the four-factor structure of the ICCN-CS-1. The results of the factor analysis, load factor between 0.304 and 0.727 items was estimated; only 4 items out of 144 items, that were loaded were less than 0.3 due to high Cronbach's alpha coefficient (0.984-0.986), all items were preserved, no item was removed and 4 subscales of the original scale were confirmed. The results of this study indicated that the Persian version of "The Intensive and Critical Care Nursing Competence Scale version-1" is a valid and reliable scale for the assessment of competency among Iranian nurses, and it can be used as a reliable scale in nursing management, education and research.
Development of the competency scale for primary care managers in Thailand: Scale development.
Kitreerawutiwong, Keerati; Sriruecha, Chanaphol; Laohasiriwong, Wongsa
2015-12-09
The complexity of the primary care system requires a competent manager to achieve high-quality healthcare. The existing literature in the field yields little evidence of the tools to assess the competency of primary care administrators. This study aimed to develop and examine the psychometric properties of the competency scale for primary care managers in Thailand. The scale was developed using in-depth interviews and focus group discussions among policy makers, managers, practitioners, village health volunteers, and clients. The specific dimensions were extracted from 35 participants. 123 items were generated from the evidence and qualitative data. Content validity was established through the evaluation of seven experts and the original 123 items were reduced to 84 items. The pilot testing was conducted on a simple random sample of 487 primary care managers. Item analysis, reliability testing, and exploratory factor analysis were applied to establish the scale's reliability and construct validity. Exploratory factor analysis identified nine dimensions with 48 items using a five-point Likert scale. Each dimension accounted for greater than 58.61% of the total variance. The scale had strong content validity (Indices = 0.85). Each dimension of Cronbach's alpha ranged from 0.70 to 0.88. Based on these analyses, this instrument demonstrated sound psychometric properties and therefore is considered an effective tool for assessment of the primary care manager competencies. The results can be used to improve competency requirements of primary care managers, with implications for health service management workforce development.
[Development of competency to stand trial rating scale in offenders with mental disorders].
Chen, Xiao-Bing; Cai, Wei-Xiong
2013-04-01
According with Chinese legal system, to develop a competency to stand trial rating scale in offenders with mental disorders. Proceeding from the juristical elements, 15 items were extracted and formulated a preliminary instrument named the competency to stand trial rating scale in offenders with mental disorders. The item analysis included six aspects, which were critical ratio, item-total correlation, corrected item-total correlation, alpha value if item deleted, communalities of items, and factor loading. The Logistic regression equation and cut-off score of ROC curve were used to explore the diagnostic efficiency. The data of critical ratio of extreme group were 18.390-46.763; item-total correlation, 0.639-0.952; corrected item-total correlation, 0.582-0.944; communalities of items, 0.377-0.916; and factor loadings, 0.614-0.957. Seven items were included in the regression equation and the accuracy of back substitution test was 96.0%. The score of 33 was ascertained as the cut-off score by ROC fitting curve, the overlapping ratio compared with the expertise was 95.8%. The sensibility and the specificity were 0.938 and 0.966, respectively, while the positive and negative likelihood ratios were 27.67 and 0.06, respectively. With all items satisfied the requirement of homogeneity test, the rating scale has a reasonable construct and excellent diagnostic efficiency.
A Leadership and Managerial Competency Framework for Public Hospital Managers in Vietnam
Van Tuong, Phan; Duc Thanh, Nguyen
2017-01-01
Objective The aim of this paper was to develop a leadership and managerial competency framework for public hospital managers in Vietnam. Methods This mixed-method study used a four-step approach. The first step was a position description content analysis to identify the tasks hospital managers are required to carry out. The resulting data were used to identify the leadership and managerial competency factors and items in the second step. In the third step, a workshop was organized to reach consensus about the validity of these competency factors and items. Finally, a quantitative survey was conducted across a sample of 891 hospital managers who are working in the selected hospitals in seven geographical regions in Vietnam to validate the competency scales using exploratory factor analysis (EFA) and Cronbach's alpha. Results The study identified a number of tasks required for public hospital managers and confirmed the competencies for implementing these tasks effectively. Four dimensions with 14 components and 81 items of leadership and managerial competencies were identified. These components exhibited 83.8% of variance and Cronbach's alpha were at good level of 0.9. Conclusions These competencies are required for public hospital managers which provide guidance to the further development of the competency-based training for the current management taskforce and preparing future hospital managers. PMID:29546227
A Leadership and Managerial Competency Framework for Public Hospital Managers in Vietnam.
Van Tuong, Phan; Duc Thanh, Nguyen
2017-01-01
The aim of this paper was to develop a leadership and managerial competency framework for public hospital managers in Vietnam. This mixed-method study used a four-step approach. The first step was a position description content analysis to identify the tasks hospital managers are required to carry out. The resulting data were used to identify the leadership and managerial competency factors and items in the second step. In the third step, a workshop was organized to reach consensus about the validity of these competency factors and items. Finally, a quantitative survey was conducted across a sample of 891 hospital managers who are working in the selected hospitals in seven geographical regions in Vietnam to validate the competency scales using exploratory factor analysis (EFA) and Cronbach's alpha. The study identified a number of tasks required for public hospital managers and confirmed the competencies for implementing these tasks effectively. Four dimensions with 14 components and 81 items of leadership and managerial competencies were identified. These components exhibited 83.8% of variance and Cronbach's alpha were at good level of 0.9. These competencies are required for public hospital managers which provide guidance to the further development of the competency-based training for the current management taskforce and preparing future hospital managers.
Development of the PROMIS health expectancies of smoking item banks.
Edelen, Maria Orlando; Tucker, Joan S; Shadel, William G; Stucky, Brian D; Cerully, Jennifer; Li, Zhen; Hansen, Mark; Cai, Li
2014-09-01
Smokers' health-related outcome expectancies are associated with a number of important constructs in smoking research, yet there are no measures currently available that focus exclusively on this domain. This paper describes the development and evaluation of item banks for assessing the health expectancies of smoking. Using data from a sample of daily (N = 4,201) and nondaily (N = 1,183) smokers, we conducted a series of item factor analyses, item response theory analyses, and differential item functioning analyses (according to gender, age, and race/ethnicity) to arrive at a unidimensional set of health expectancies items for daily and nondaily smokers. We also evaluated the performance of short forms (SFs) and computer adaptive tests (CATs) to efficiently assess health expectancies. A total of 24 items were included in the Health Expectancies item banks; 13 items are common across daily and nondaily smokers, 6 are unique to daily, and 5 are unique to nondaily. For both daily and nondaily smokers, the Health Expectancies item banks are unidimensional, reliable (reliability = 0.95 and 0.96, respectively), and perform similarly across gender, age, and race/ethnicity groups. A SF common to daily and nondaily smokers consists of 6 items (reliability = 0.87). Results from simulated CATs showed that health expectancies can be assessed with good precision with an average of 5-6 items adaptively selected from the item banks. Health expectancies of smoking can be assessed on the basis of these item banks via SFs, CATs, or through a tailored set of items selected for a specific research purpose. © The Author 2014. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.
Development of the PROMIS negative psychosocial expectancies of smoking item banks.
Stucky, Brian D; Edelen, Maria Orlando; Tucker, Joan S; Shadel, William G; Cerully, Jennifer; Kuhfeld, Megan; Hansen, Mark; Cai, Li
2014-09-01
Negative psychosocial expectancies of smoking include aspects of social disapproval and disappointment in oneself. This paper describes analyses conducted to develop and evaluate item banks for assessing psychosocial expectancies among daily and nondaily smokers. Using data from a sample of daily (N = 4,201) and nondaily (N =1,183) smokers, we conducted a series of item factor analyses, item response theory analyses, and differential item functioning analyses (according to gender, age, and race/ethnicity) to arrive at a unidimensional set of psychosocial expectancies items for daily and nondaily smokers. We also evaluated performance of short forms (SFs) and computer adaptive tests (CATs) to efficiently assess psychosocial expectancies. A total of 21 items were included in the Psychosocial Expectancies item banks: 14 items are common across daily and nondaily smokers, 6 are unique to daily, and 1 is unique to nondaily. For both daily and nondaily smokers, the Psychosocial Expectancies item banks are strongly unidimensional, highly reliable (reliability = 0.95 and 0.93, respectively), and perform similarly across gender, age, and race/ethnicity groups. A SF common to daily and nondaily smokers consists of 6 items (reliability = 0.85). Results from simulated CATs showed that, on average, fewer than 8 items are needed to assess psychosocial expectancies with adequate precision when using the item banks. Psychosocial expectancies of smoking can be assessed on the basis of these item banks via the SF, by using CAT, or through a tailored set of items selected for a specific research purpose. © The Author 2014. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.
A subjective utilitarian theory of moral judgment.
Cohen, Dale J; Ahn, Minwoo
2016-10-01
Current theories hypothesize that moral judgments are difficult because rational and emotional decision processes compete. We present a fundamentally different theory of moral judgment: the Subjective Utilitarian Theory of moral judgment. The Subjective Utilitarian Theory posits that people try to identify and save the competing item with the greatest "personal value." Moral judgments become difficult only when the competing items have similar personal values. In Experiment 1, we estimate the personal values of 104 items. In Experiments 2-5, we show that the distributional overlaps of the estimated personal values account for over 90% of the variance in reaction times (RTs) and response choices in a moral judgment task. Our model fundamentally restructures our understanding of moral judgments from a competition between decision processes to a competition between similarly valued items. (PsycINFO Database Record (c) 2016 APA, all rights reserved).
Kaspar, Roman; Hartig, Johannes
2016-03-01
The care of older people was described as involving substantial emotion-related affordances. Scholars in vocational training and nursing disagree whether emotion-related skills could be conceptualized and assessed as a professional competence. Studies on emotion work and empathy regularly neglect the multidimensionality of these phenomena and their relation to the care process, and are rarely conclusive with respect to nursing behavior in practice. To test the status of emotion-related skills as a facet of client-directed geriatric nursing competence, 402 final-year nursing students from 24 German schools responded to a 62-item computer-based test. 14 items were developed to represent emotion-related affordances. Multi-dimensional IRT modeling was employed to assess a potential subdomain structure. Emotion-related test items did not form a separate subdomain, and were found to be discriminating across the whole competence continuum. Tasks concerning emotion work and empathy are reliable indicators for various levels of client-directed nursing competence. Claims for a distinct emotion-related competence in geriatric nursing, however, appear excessive with a process-oriented perspective.
Shouryabi, Ali Asghar; Ghahrisarabi, Alireza; Anboohi, Sima Zohari; Nasiri, Malihe; Rassouli, Maryam
2017-01-01
Background Nursing competence is highly related to patient outcomes and patient safety issues, especially in intensive care units. Competence assessment tools are needed specifically for intensive care nursing. Objective This study was performed to determine psychometric properties of the Intensive and Critical Care Nursing Competence Scale version-1 between Iranian Nurses. Methods The present study was a methodological research in which 289 nurses of Intensive Care Units from nine hospitals in Shahid Beheshti University of Medical Sciences in Tehran were selected between 2015 and 2016. The original version of the scale was translated into Persian and back-translated into English, and the comments of the developer were applied. The validity of the scale was the determined quality (content validity and face validity) and quantity (confirmatory factor analysis). Reliability of the scale was reported by Cronbach’s alpha coefficient and Intra class Correlation Coefficient. SPSS-PC (v.21) and LISREL (v.8.5) were used to analyze the data. Results The intensive and critical care nursing competence scale version-1 is a self-assessment test that consists of 144 items and four domains which are the knowledge base, the skill base, the attitudes and values base and the experience base, which are divided into clinical competence and professional competence. Content and face validity was confirmed by 10 experts and 10 practitioner nurses in the intensive care units. In confirmatory factor analysis, all fitness indexes, except goodness of fit index (0.64), confirmed the four-factor structure of the ICCN-CS-1. The results of the factor analysis, load factor between 0.304 and 0.727 items was estimated; only 4 items out of 144 items, that were loaded were less than 0.3 due to high Cronbach’s alpha coefficient (0.984–0.986), all items were preserved, no item was removed and 4 subscales of the original scale were confirmed. Conclusion The results of this study indicated that the Persian version of “The Intensive and Critical Care Nursing Competence Scale version-1” is a valid and reliable scale for the assessment of competency among Iranian nurses, and it can be used as a reliable scale in nursing management, education and research. PMID:29403620
Writing Multiple Choice Outcome Questions to Assess Knowledge and Competence.
Brady, Erik D
2015-11-01
Few articles contemplate the need for good guidance in question item-writing in the continuing education (CE) space. Although many of the core principles of sound item design translate to the CE health education team, the need exists for specific examples for nurse educators that clearly describe how to measure changes in competence and knowledge using multiple choice items. In this article, some keys points and specific examples for nursing CE providers are shared. Copyright 2015, SLACK Incorporated.
Lohse, Barbara
2015-04-01
Eating competence is an important behavioral construct, shown to be associated with healthful lifestyle practices, including dietary quality, weight management, physical activity, and sleep duration. A 16-item instrument to measure eating competence, the Satter Eating Competence Inventory was previously validated in a general sample and subsequently, a 16-item instrument was developed to address specific concerns of low-income persons; 12 items were common to both instruments. The purpose of this study was to determine if the low-income version could be applied to a general audience, simplifying intervention evaluation and facilitating cross-study comparison. Both surveys were fully completed by 127 parents (89% white; 35.8 ± 5.3 y; 86% college graduates; 51% eating competent) of preschool-age children; 96 of whom were not considered low-income. Cognitive interviews with 14 parents of varying eating competence levels clarified and confirmed findings. Scores were highly correlated (r = .98) and only 2 of the 96 were not congruently classified for eating competence. Mean difference between the two versions was .24 ± 1.55. The general audience version explained 95% of the variance in the low-income version score. Findings support the low-income version of the Satter Eating Competence Inventory for general audience use as the Satter Eating Competence Inventory 2.0. Copyright © 2014 Elsevier Ltd. All rights reserved.
ERIC Educational Resources Information Center
Donovan, Courtney; Green, Kathy E.; Seidel, Kent
2017-01-01
Core competencies essential for effective teaching were identified via a literature review and a review of standards for teacher education, and vetted by state groups with interests in teacher education. Survey items based on these competencies asked teacher candidates, graduates, and teacher education program faculty how well the program prepared…
ERIC Educational Resources Information Center
Pietsch, James; Walker, Richard; Chapman, Elaine
2003-01-01
Examines the relationship among self-concept, self-efficacy, and performance in mathematics among 416 high school students. Confirmatory factor analyses supported the existence of two self-concept components--a competency component and an affective component. Self-efficacy items and the competency items of self-concept also loaded on a single…
ERIC Educational Resources Information Center
Köhler, Carmen; Pohl, Steffi; Carstensen, Claus H.
2015-01-01
When competence tests are administered, subjects frequently omit items. These missing responses pose a threat to correctly estimating the proficiency level. Newer model-based approaches aim to take nonignorable missing data processes into account by incorporating a latent missing propensity into the measurement model. Two assumptions are typically…
ERIC Educational Resources Information Center
Köhler, Carmen; Pohl, Steffi; Carstensen, Claus H.
2017-01-01
Competence data from low-stakes educational large-scale assessment studies allow for evaluating relationships between competencies and other variables. The impact of item-level nonresponse has not been investigated with regard to statistics that determine the size of these relationships (e.g., correlations, regression coefficients). Classical…
Craike, Melinda Jane; Polman, Remco; Eime, Rochelle; Symons, Caroline; Harvey, Jack; Payne, Warren
2014-02-01
This study investigated the association between the different types of behavior regulation and competence on sport and physical activity (PA) and perceived health, and the influence of school year level (ie, year 7 and year 11) and setting (ie, metropolitan and rural) on these relationships. A cross sectional self-complete survey was conducted. Competence was measured using the 5-item perceived competence subscale of the 21-item Athletic Identity Questionnaire (AIQ); behavior regulation was measured using a modified version of the Behavior Regulation in Exercise Questionnaire (BREQ-2); PA was measured using an item to assess if adolescents are meeting recommended levels of PA; and perceived health was measured using the Short Form 1 (SF-1). This study included 732 participants, 71.2% from metropolitan schools, and 66.8% in year 7. Self-determined behavior regulation and competence were positively associated with PA and health. Intrinsic motivation was more strongly related to older adolescents' PA than it was for younger adolescents. Behavior regulators and competence were more strongly associated with health than PA. The findings of this study suggest that strategies that enhance intrinsic motivation and PA competence may improve the health of adolescent females; enhancing these may lead to greater health regardless of level of PA.
Feng, Danjun; Li, Hongyao; Meng, Lu; Zhong, Gengkun
2018-02-19
The recovery of people with psychiatric disabilities requires high-quality nursing care. However, the existing research on the nursing competencies needed for caring for people with psychiatric disabilities have been based on a narrow competency framework. By adopting a broader competency framework, this study aimed to find the competencies needed for the nursing care of people with psychiatric disabilities in a hospital environment. Accordingly, a questionnaire will be developed to measure these competences. First, a literature review and interviews with psychiatrists, psychiatric nurses, and people with psychiatric disabilities were conducted to develop the pool of competency items. Second, a pilot study was conducted to review the initial pool of items. Finally, a survey of 581 psychiatric nurses was used to conduct a series of principal component analyses to explore the structure of the questionnaire. The 17-item questionnaire included 5 factors, which accounted for 68.60% of the total variance: sense of responsibility, vocational identification, agreeableness, cooperation capacity, and carefulness; the Cronbach's alpha coefficients were 0.85, 0.85, 0.74, 0.80, and 0.77, respectively. Most of the competencies belonged to attitudes, values, and traits, which were overlooked in previous studies. The questionnaire has satisfactory internal reliability and structural validity, and could contribute some to the selection of the psychiatric workforce.
Bimodal Bilinguals Co-activate Both Languages during Spoken Comprehension
Shook, Anthony; Marian, Viorica
2012-01-01
Bilinguals have been shown to activate their two languages in parallel, and this process can often be attributed to overlap in input between the two languages. The present study examines whether two languages that do not overlap in input structure, and that have distinct phonological systems, such as American Sign Language (ASL) and English, are also activated in parallel. Hearing ASL-English bimodal bilinguals’ and English monolinguals’ eye-movements were recorded during a visual world paradigm, in which participants were instructed, in English, to select objects from a display. In critical trials, the target item appeared with a competing item that overlapped with the target in ASL phonology. Bimodal bilinguals looked more at competing items than at phonologically unrelated items, and looked more at competing items relative to monolinguals, indicating activation of the sign-language during spoken English comprehension. The findings suggest that language co-activation is not modality specific, and provide insight into the mechanisms that may underlie cross-modal language co-activation in bimodal bilinguals, including the role that top-down and lateral connections between levels of processing may play in language comprehension. PMID:22770677
The Study of Smartphone Usage Competency Assessment and Training for the Elderly.
Lu, Sheng-Chieh; Wen, Tzu-Ning; Chang, Po-Lun
2017-01-01
This study aimed at developing an assessment of smartphone usage competence and constructing a training program for the elderly. A list of smartphone usage competencies with 34 items was defined through expert survey and panel. Based on the competence and previous literature, a training program and learning aids were designed in this study. There were 41 participants in our program. The results of self-administrated smartphone usage ability questionnaire indicated that all competencies were significantly improved after training. However, the results also demonstrated that some items were still difficult for the elderly to comprehend. Overall, this study provided a first exploration of defining smartphone usage competency and built a training program for the elderly. With strong suggestion, future mobile health (mHealth) services can follow this study to insure the smartphone usage ability of the elderly.
Hernández, Maciel M; Robins, Richard W; Widaman, Keith F; Conger, Rand D
2016-06-01
This study examined factors that relate to academic competence and expectations from elementary to middle school for 674 fifth grade students (50% boys; M age = 10.86 years) of Mexican origin. Models predicting academic competence and expectations were estimated using a Structural Equation Modeling (SEM) framework, with longitudinal data from fifth to eighth grades. School belonging (i.e., social and emotional connectedness to school) predicted greater academic competence and expectations over time. Findings indicate that student feelings of belonging in school may act as a resource that promotes academic competence and expectations. Furthermore, family income, parent education, and generational status had direct effects on academic competence and expectations to some degree, suggesting the importance of contextual factors in this process.
Hernández, Maciel M.; Robins, Richard W.; Widaman, Keith F.; Conger, Rand D.
2014-01-01
This study examined factors that relate to academic competence and expectations from elementary to middle school for 674 fifth grade students (50% boys; Mage = 10.86 years) of Mexican origin. Models predicting academic competence and expectations were estimated using a Structural Equation Modeling (SEM) framework, with longitudinal data from fifth to eighth grades. School belonging (i.e., social and emotional connectedness to school) predicted greater academic competence and expectations over time. Findings indicate that student feelings of belonging in school may act as a resource that promotes academic competence and expectations. Furthermore, family income, parent education, and generational status had direct effects on academic competence and expectations to some degree, suggesting the importance of contextual factors in this process. PMID:27231419
Assessment of Competence in EVAR Procedures: A Novel Rating Scale Developed by the Delphi Technique.
Strøm, M; Lönn, L; Bech, B; Schroeder, T V; Konge, L
2017-07-01
To develop a procedure specific global rating scale for assessment of operator competence in endovascular aortic repair (EVAR). A Delphi approach was used to achieve expert consensus. A panel of 32 international experts (median 300 EVAR procedures, range 200-3000) from vascular surgery (n = 21) and radiology (n = 11) was established. The first Delphi round was based on a review of endovascular skills assessment papers, stent graft instructions for use, and structured interviews. It led to a primary pool of 83 items that were formulated as global rating scale items with tentative anchors. Iterative Delphi rounds were executed. The panellists rated the importance of each item on a 5 point Likert scale. Consensus was defined as 80% of the panel rating an item 4 or 5 in the primary round and 90% in subsequent rounds. Consensus on the final assessment tool was defined as Cronbach's alpha > .8 after a minimum of three rounds. Thirty-two of 35 invited experts participated. Three rounds of surveys were completed with a completion rate of 100% in the first two rounds and 91% in round three. The 83 primary assessment items were supplemented with five items suggested by the panel and reduced to seven pivotal assessment items that reached consensus, Cronbach's alpha = 0.82. The seven item rating scale covers key elements of competence in EVAR stent placement and deployment. Each item has well defined grades with explicit anchors at unacceptable, acceptable, and superior performance on a 5 point Likert scale. The Delphi methodology allowed for international consensus on a new procedure specific global rating scale for assessment of competence in EVAR. The resulting scale, EndoVascular Aortic Repair Assessment of Technical Expertise (EVARATE), represents key elements in the procedure. EVARATE constitutes an assessment tool for providing structured feedback to endovascular operators in training. Copyright © 2017 European Society for Vascular Surgery. Published by Elsevier Ltd. All rights reserved.
What can we learn from PISA?: Investigating PISA's approach to scientific literacy
NASA Astrophysics Data System (ADS)
Schwab, Cheryl Jean
This dissertation is an investigation of the relationship between the multidimensional conception of scientific literacy and its assessment. The Programme for International Student Assessment (PISA), developed under the auspices of the Organization for Economic Cooperation and Development (OECD), offers a unique opportunity to evaluate the assessment of scientific literacy. PISA developed a continuum of performance for scientific literacy across three competencies (i.e., process, content, and situation). Foundational to the interpretation of PISA science assessment is PISA's definition of scientific literacy, which I argue incorporates three themes drawn from history: (a) scientific way of thinking, (b) everyday relevance of science, and (c) scientific literacy for all students. Three coordinated studies were conducted to investigate the validity of PISA science assessment and offer insight into the development of items to assess scientific 2 literacy. Multidimensional models of the internal structure of the PISA 2003 science items were found not to reflect the complex character of PISA's definition of scientific literacy. Although the multidimensional models across the three competencies significantly decreased the G2 statistic from the unidimensional model, high correlations between the dimensions suggest that the dimensions are similar. A cognitive analysis of student verbal responses to PISA science items revealed that students were using competencies of scientific literacy, but the competencies were not elicited by the PISA science items at the depth required by PISA's definition of scientific literacy. Although student responses contained only knowledge of scientific facts and simple scientific concepts, students were using more complex skills to interpret and communicate their responses. Finally the investigation of different scoring approaches and item response models illustrated different ways to interpret student responses to assessment items. These analyses highlighted the complexities of students' responses to the PISA science items and the use of the ordered partition model to accommodate different but equal item responses. The results of the three investigations are used to discuss ways to improve the development and interpretation of PISA's science items.
McGrane, J A; Butow, P N; Sze, M; Eisenbruch, M; Goldstein, D; King, M T
2014-12-01
The purpose of this study was to assess the invariance of a culturally competent multi-lingual unmet needs survey. A cross-sectional study was conducted among immigrants of Arabic-, Chinese- and Greek-speaking backgrounds, and Anglo-Australian-born controls, recruited through Cancer Registries (n = 591) and oncology clinics (n = 900). The survey included four subscales, with newly developed items addressing unmet need in culturally competent health information and patient support (CCHIPS), and items adapted from existing questionnaires addressing physical and daily living (PDL), sexuality (SEX) and survivorship (SURV) unmet need. The survey was translated into Arabic, Chinese and Greek. Rasch analysis was carried out on the four domains. Whilst many items were mistargeted to less prevalent areas of unmet need, causing substantial floor effects in person estimates, reliability indices were acceptable. The CCHIPS domain showed differential item functioning (DIF) for cultural background and language, and the PDL domain showed DIF for treatment phase and gender. The results for SEX and SURV domains were limited by floor effects and missing responses. All domains showed adequate fit to the model after DIF was resolved and a small number of items were deleted. The study highlights the intricacies in designing a culturally competent survey that can be applied to culturally and linguistically diverse groups across different treatment contexts. Overall, the results demonstrate that this survey is somewhat invariant with respect to these factors. Future refinements are suggested to enhance the survey's cultural competence and general validity.
A Diagnostic Study of Pre-Service Teachers' Competency in Multiple-Choice Item Development
ERIC Educational Resources Information Center
Asim, Alice E.; Ekuri, Emmanuel E.; Eni, Eni I.
2013-01-01
Large class size is an issue in testing at all levels of Education. As a panacea to this, multiple choice test formats has become very popular. This case study was designed to diagnose pre-service teachers' competency in constructing questions (IQT); direct questions (DQT); and best answer (BAT) varieties of multiple choice items. Subjects were 88…
ERIC Educational Resources Information Center
Kim, Yu-Ri; Park, Jiyeon; Lee, Suk-Hyang
2015-01-01
The purpose of this study is to develop a Teaching competency index in special education and to investigate Korean pre-service special educators' (PSSEs') perceptions regarding each item of the index. Based on a review of the literature on exemplary instruction in special education, we developed an index composed of 44 items. The six sub-domains…
Chatterji, Madhabi; Graham, Mark J; Wyer, Peter C
2009-12-01
The complex competency labeled practice-based learning and improvement (PBLI) by the Accreditation Council for Graduate Medical Education (ACGME) incorporates core knowledge in evidence-based medicine (EBM). The purpose of this study was to operationally define a "PBLI-EBM" domain for assessing resident physician competence. The authors used an iterative design process to first content analyze and map correspondences between ACGME and EBM literature sources. The project team, including content and measurement experts and residents/fellows, parsed, classified, and hierarchically organized embedded learning outcomes using a literature-supported cognitive taxonomy. A pool of 141 items was produced from the domain and assessment specifications. The PBLI-EBM domain and resulting items were content validated through formal reviews by a national panel of experts. The final domain represents overlapping PBLI and EBM cognitive dimensions measurable through written, multiple-choice assessments. It is organized as 4 subdomains of clinical action: Therapy, Prognosis, Diagnosis, and Harm. Four broad cognitive skill branches (Ask, Acquire, Appraise, and Apply) are subsumed under each subdomain. Each skill branch is defined by enabling skills that specify the cognitive processes, content, and conditions pertinent to demonstrable competence. Most items passed content validity screening criteria and were prepared for test form assembly and administration. The operational definition of PBLI-EBM competence is based on a rigorously developed and validated domain and item pool, and substantially expands conventional understandings of EBM. The domain, assessment specifications, and procedures outlined may be used to design written assessments to tap important cognitive dimensions of the overall PBLI competency, as given by ACGME. For more comprehensive coverage of the PBLI competency, such instruments need to be complemented with performance assessments.
Chatterji, Madhabi; Graham, Mark J.; Wyer, Peter C.
2009-01-01
Purpose The complex competency labeled practice-based learning and improvement (PBLI) by the Accreditation Council for Graduate Medical Education (ACGME) incorporates core knowledge in evidence-based medicine (EBM). The purpose of this study was to operationally define a “PBLI-EBM” domain for assessing resident physician competence. Method The authors used an iterative design process to first content analyze and map correspondences between ACGME and EBM literature sources. The project team, including content and measurement experts and residents/fellows, parsed, classified, and hierarchically organized embedded learning outcomes using a literature-supported cognitive taxonomy. A pool of 141 items was produced from the domain and assessment specifications. The PBLI-EBM domain and resulting items were content validated through formal reviews by a national panel of experts. Results The final domain represents overlapping PBLI and EBM cognitive dimensions measurable through written, multiple-choice assessments. It is organized as 4 subdomains of clinical action: Therapy, Prognosis, Diagnosis, and Harm. Four broad cognitive skill branches (Ask, Acquire, Appraise, and Apply) are subsumed under each subdomain. Each skill branch is defined by enabling skills that specify the cognitive processes, content, and conditions pertinent to demonstrable competence. Most items passed content validity screening criteria and were prepared for test form assembly and administration. Conclusions The operational definition of PBLI-EBM competence is based on a rigorously developed and validated domain and item pool, and substantially expands conventional understandings of EBM. The domain, assessment specifications, and procedures outlined may be used to design written assessments to tap important cognitive dimensions of the overall PBLI competency, as given by ACGME. For more comprehensive coverage of the PBLI competency, such instruments need to be complemented with performance assessments. PMID:21975994
NASA Astrophysics Data System (ADS)
Jean, Ming-Der; Jiang, Ji-Bin; Chien, Jia-Yi
2017-11-01
The purpose of this study was to construct the indicators of professional competencies of the nanotechnology-based sputtering system industry based on industry requirements and analyse the core competencies of the industry for promoting the human resource of physical vapour deposition technology. The document analysis, expert interview, and Delphi technique surveys were considered and the survey items with 32 items divided into 7 domains were selected according to consensus opinions of 10 experts by the Delphi survey technique. Through three questionnaire surveys' analysis, the professional competence scales for the K-S tests showed a good internal consistency. The findings of this study provide guidelines for professional competence for nanotechnology-based sputtering technology by applying surface heat-treatment industry. These guidelines can also reveal the practical competency requirements of nanotechnology-based sputtering technology to deal with any subsequent challenges, future developments, and invisible services for students in a technology institute programme.
Automatic Item Generation of Probability Word Problems
ERIC Educational Resources Information Center
Holling, Heinz; Bertling, Jonas P.; Zeuch, Nina
2009-01-01
Mathematical word problems represent a common item format for assessing student competencies. Automatic item generation (AIG) is an effective way of constructing many items with predictable difficulties, based on a set of predefined task parameters. The current study presents a framework for the automatic generation of probability word problems…
Machine Shop. Criterion-Referenced Test (CRT) Item Bank.
ERIC Educational Resources Information Center
Davis, Diane, Ed.
This drafting criterion-referenced test item bank is keyed to the machine shop competency profile developed by industry and education professionals in Missouri. The 16 references used for drafting the test items are listed. Test items are arranged under these categories: orientation to machine shop; performing mathematical calculations; performing…
Frewing, Tyla M; Rapp, John T; Pastrana, Sarah J
2015-09-01
To date, researchers have not identified an efficient methodology for selecting items that will compete with automatically reinforced behavior. In the present study, we identified high preference, high stereotypy (HP-HS), high preference, low stereotypy (HP-LS), low preference, high stereotypy (LP-HS), and low preference, low stereotypy (LP-LS) items based on response allocation to items and engagement in stereotypy during one to three, 30-min free-operant competing stimulus assessments (CSAs). The results showed that access to HP-LS items decreased stereotypy for all four participants; however, the results for other items were only predictive for one participant. Reanalysis of the CSA results revealed that the HP-LS item was typically identified by (a) the combined results of the first 10 min of the three 30-min assessments or (b) the results of one 30-min assessment. The clinical implications for the use of this method, as well as future directions for research, are briefly discussed. © The Author(s) 2015.
Health Literacy Practices and Educational Competencies for Health Professionals: A Consensus Study
Coleman, Clifford A.; Hudson, Stan; Maine, Lucinda L.
2013-01-01
Health care professionals often lack adequate knowledge about health literacy and the skills needed to address low health literacy among patients and their caregivers. Many promising practices for mitigating the effects of low health literacy are not used consistently. Improving health literacy training for health care professionals has received increasing emphasis in recent years. The development and evaluation of curricula for health professionals has been limited by the lack of agreed-upon educational competencies in this area. This study aimed to identify a set of health literacy educational competencies and target behaviors, or practices, relevant to the training of all health care professionals. The authors conducted a thorough literature review to identify a comprehensive list of potential health literacy competencies and practices, which they categorized into 1 or more educational domains (i.e., knowledge, skills, attitudes) or a practice domain. The authors stated each item in operationalized language following Bloom's Taxonomy. The authors then used a modified Delphi method to identify consensus among a group of 23 health professions education experts representing 11 fields in the health professions. Participants rated their level of agreement as to whether a competency or practice was both appropriate and important for all health professions students. A predetermined threshold of 70% agreement was used to define consensus. After 4 rounds of ratings and modifications, consensus agreement was reached on 62 out of 64 potential educational competencies (24 knowledge items, 27 skill items, and 11 attitude items), and 32 out of 33 potential practices. This study is the first known attempt to develop consensus on a list of health literacy practices and to translate recommended health literacy practices into an agreed-upon set of measurable educational competencies for health professionals. Further work is needed to prioritize the competencies and practices in terms of relative importance. PMID:24093348
Wangensteen, Sigrid; Finnbakk, Elisabeth; Adolfsson, Annsofie; Kristjansdottir, Gudrun; Roodbol, Petrie; Ward, Helen; Fagerström, Lisbeth
2018-03-01
Nursing practice requires application of knowledge, skills and values in various combinations and has undergone substantial changes the last decades. An increased focus on inter-professional collaboration and possible new and more independent roles for nurses are described. A variety of programs have been developed in order to educate registered nurses (RN) to meet the changes and demands in health and nursing care throughout the world. The aims were to 1) describe nurses' self-assessment of clinical competence and need for further training, and 2) explore possible differences between nurses in specialist vs master's programs. A cross-sectional survey design was applied. 97 nurses in postgraduate programs from five countries responded (response rate 45%). A revised version of the Professional Nurse Self-Assessment Scale of clinical core competencies (PROFFNurseSASII) was used for data collection. Independent student t-test and regression analyses were carried out. The respondents rated their competence highest in taking full responsibility, cooperation with other health professionals and in acting ethically. Items where they considered themselves needing further training most were competence on medications, interaction and side effects and differential diagnoses. For all items, nurses in master's programs rated their competence higher than nurses in the specialist programs. Nurses in specialist programs rated their need for more training for all items higher than nurses in master's degree programs, and for 47 out of the 50 items these differences were statistically significant. Even though the nurses rated their competence high for important competence aspects such as taking responsibility and cooperation with other health professionals, it is worrying that their need for further training was highest for effects and interaction of various types of medications. Further studies are needed to conclude if and how master's education improves patient outcome. Copyright © 2017 Elsevier Ltd. All rights reserved.
[Development of a Japanese version of a short form of the Profile of Emotional Competence].
Nozaki, Yuki; Koyasu, Masuo
2015-06-01
Emotional competence refers to individual differences in the ability to appropriately identity, understand, express, regulate, and utilize one's own emotions and those of others. This study developed a Japanese version of a short form of the Profile of Emotional Competence, a measure that allows the comprehensive assessment of intra- and interpersonal emotional competence with shorter items, and investigated its reliability and validity. In Study 1, we selected items for a short version and compared it with the full scale in terms of scores, internal consistency, and validity. In Study 2, we examined the short form's test-retest reliability. Results supported the original two-factor model and the measure had adequate reliability and validity. We discuss the construct validity and practical applicability of the short form of the Profile of Emotional Competence.
Core competency model for the family planning public health nurse.
Hewitt, Caroline M; Roye, Carol; Gebbie, Kristine M
2014-01-01
A core competency model for family planning public health nurses has been developed, using a three stage Delphi Method with an expert panel of 40 family planning senior administrators, community/public health nursing faculty and seasoned family planning public health nurses. The initial survey was developed from the 2011 Title X Family Planning program priorities. The 32-item survey was distributed electronically via SurveyMonkey(®). Panelist attrition was low, and participation robust resulting in the final 28-item model, suggesting that the Delphi Method was a successful technique through which to achieve consensus. Competencies with at least 75% consensus were included in the model and those competencies were primarily related to education/counseling and administration of medications and contraceptives. The competencies identified have implications for education/training, certification and workplace performance. © 2014 Wiley Periodicals, Inc.
Development of a State-Wide Competency Test for Marketing Education. Final Report.
ERIC Educational Resources Information Center
Smith, Clifton L.
A project was conducted to develop a valid, competency-referenced test on the core competencies identified for the Missouri Fundamentals of Marketing curriculum. During the project: (1) multiple-choice test items based on the core competencies in the Fundamentals of Marketing curriculum were developed; (2) instructions for onsite administration of…
The Social Validity Assessment of Social Competence Intervention Behavior Goals
ERIC Educational Resources Information Center
Hurley, Jennifer J.; Wehby, Joseph H.; Feurer, Irene D.
2010-01-01
Social validation is the value judgment from society on the importance of a study. The social validity of behavior goals used in the social competence intervention literature was assessed using the Q-sort technique. The stimulus items were 80 different social competence behavior goals taken from 78 classroom-based social competence intervention…
[Developing Perceived Competence Scale (PCS) for Adolescents].
Özer, Arif; Gençtanirim Kurt, Dilek; Kizildağ, Seval; Demırtaş Zorbaz, Selen; Arici Şahın, Fatma; Acar, Tülin; Ergene, Tuncay
2016-01-01
In this study, Perceived Competence Scale was developed to measure high school students' perceived competence. Scale development process was verified on three different samples. Participants of the research are some high school students in 2011-2012 academic terms from Ankara. Participants' numbers are incorporated in exploratory factor analysis, confirmatory factor analysis and test-retest reliability respectively, as follows: 372, 668 and 75. Internal consistency coefficients (Cronbach's and stratified α) are calculated separately for each group. For data analysis Factor 8.02 and LISREL 8.70 package programs were used. According to results of the analyses, internal consistency coefficients (α) are .90 - .93 for academic competence, .82 - .86 for social competence in the samples that exploratory and confirmatory factor analysis performed. For the whole scale internal consistency coefficient (stratified α) is calculated as .91. As a result of test-retest reliability, adjusted correlation coefficients (r) are .94 for social competence and .90 for academic competence. In addition, to fit indexes and regression weights obtained from factor analysis, findings related convergent and discriminant validity, indicating that competence can be addressed in two dimensions which are academic (16 items) and social (14 items).
Barnett, Lisa M; Ridgers, Nicola D; Zask, Avigdor; Salmon, Jo
2015-01-01
To determine reliability and face validity of an instrument to assess young children's perceived fundamental movement skill competence. Validation and reliability study. A pictorial instrument based on the Test Gross Motor Development-2 assessed perceived locomotor (six skills) and object control (six skills) competence using the format and item structure from the physical competence subscale of the Pictorial Scale of Perceived Competence and Acceptance for Young Children. Sample 1 completed object control items in May (n=32) and locomotor items in October 2012 (n=23) at two time points seven days apart. Children were asked at the end of the test-retest their understanding of what was happening in each picture to determine face validity. Sample 2 (n=58) completed 12 items in November 2012 on a single occasion to test internal reliability only. Sample 1 children were aged 5-7 years (M=6.0, SD=0.8) at object control assessment and 5-8 years at locomotor assessment (M=6.5, SD=0.9). Sample 2 children were aged 6-8 years (M=7.2, SD=0.73). Intra-class correlations assessed in Sample 1 children were excellent for object control (intra-class correlation=0.78), locomotor (intra-class correlation=0.82) and all 12 skills (intra-class correlations=0.83). Face validity was acceptable. Internal consistency was adequate in both samples for each subscale and all 12 skills (alpha range 0.60-0.81). This study has provided preliminary evidence for instrument reliability and face validity. This enables future alignment between the measurement of perceived and actual fundamental movement skill competence in young children. Crown Copyright © 2014. Published by Elsevier Ltd. All rights reserved.
A new scale for disaster nursing core competencies: Development and psychometric testing.
Al Thobaity, Abdulellah; Williams, Brett; Plummer, Virginia
2016-02-01
All nurses must have core competencies in preparing for, responding to and recovering from a disaster. In the Kingdom of Saudi Arabia (KSA), as in many other countries, disaster nursing core competencies are not fully understood and lack reliable, validated tools. Thus, it is imperative to develop a scale for exploring disaster nursing core competencies, roles and barriers in the KSA. This study's objective is to develop a valid, reliable scale that identifies and explores core competencies of disaster nursing, nurses' roles in disaster management and barriers to developing disaster nursing in the KSA. This study developed a new scale testing its validity and reliability. A principal component analysis (PCA) was used to develop and test psychometric properties of the new scale. The PCA used a purposive sample of nurses from emergency departments in two hospitals in the KSA. Participants rated 93 paper-based, self-report questionnaire items from 1 to 10 on a Likert scale. PCA using Varimax rotation was conducted to explore factors emerging from responses. The study's participants were 132 nurses (66% response rate). PCA of the 93 questionnaire items revealed 49 redundant items (which were deleted) and 3 factors with eigenvalues of >1. The remaining 44 items accounted for 77.3% of the total variance. The overall Cronbach's alpha was 0.96 for all factors: 0.98 for Factor 1, 0.92 for Factor 2 and 0.86 for Factor 3. This study provided a validated, reliable scale for exploring nurses' core competencies, nurses' roles and barriers to developing disaster nursing in the KSA. The new scale has many implications, such as for improving education, planning and curricula. Crown Copyright © 2015. Published by Elsevier Ltd. All rights reserved.
NASA Astrophysics Data System (ADS)
Peoples, Shelagh
The purpose of this study was to determine which of three competing models will provide, reliable, interpretable, and responsive measures of elementary students' understanding of the nature of science (NOS). The Nature of Science Instrument-Elementary (NOSI-E), a 28-item Rasch-based instrument, was used to assess students' NOS understanding. The NOS construct was conceptualized using five construct dimensions (Empirical, Inventive, Theory-laden, Certainty and Socially & Culturally Embedded). The competing models represent three internal models for the NOS construct. One postulate is that the NOS construct is unidimensional where one latent construct explains the relationship between the 28 items of the NOSI-E. Alternatively, the NOS construct is composed of five independent unidimensional constructs (the consecutive approach). Lastly, the NOS construct is multidimensional and composed of five inter-related but separate dimensions. A validity argument was developed that hypothesized that the internal structure of the NOS construct is best represented by the multidimensional Rasch model. Four sets of analyses were performed in which the three representations were compared. These analyses addressed five validity aspects (content, substantive, generalizability, structural and external) of construct validity. The vast body of evidence supported the claim that the NOS construct is composed of five separate but inter-related dimensions that is best represented by the multidimensional Rasch model. The results of the multidimensional analyses indicated that the items of the five subscales were of excellent technical quality, exhibited no differential item functioning (based on gender), had an item hierarchy that conformed to theoretical expectations; and together formed subscales of reasonable reliability (> 0.7 on each subscale) that were responsive to change in the construct. Theory-laden scores from the multidimensional model predicted students' science achievement with scores from all five NOS dimensions significantly predicting students' perceptions of the constructivist nature of their classroom learning environment. The NOSI-E instrument is a theoretically grounded scale that can measure elementary students' NOS understanding and appears suitable for use in science education research.
Picho, Katherine; Gilliland, William R; Artino, Anthony R; DeZee, Kent J; Dong, Ting; McManigle, John E; Cruess, David F; Durning, Steven J
2015-04-01
This study assessed alumni perceptions of their preparedness for clinical practice using the Accreditation Council for Graduate Medical Education (ACGME) competencies. We hypothesized that our alumni's perception of preparedness would be highest for military-unique practice and professionalism and lowest for system-based practice and practice-based learning and improvement. 1,189 alumni who graduated from the Uniformed Services University (USU) between 1980 and 2001 completed a survey modeled to assess the ACGME competencies on a 5-point, Likert-type scale. Specifically, self-reports of competencies related to patient care, communication and interpersonal skills, medical knowledge, professionalism, systems-based practice, practice-based learning and improvement, and military-unique practice were evaluated. Consistent with our expectations as the nation's military medical school, our graduates were most confident in their preparedness for military-unique practice, which included items assessing military leadership (M = 4.30, SD = 0.65). USU graduates also indicated being well prepared for the challenges of residency education in the domain of professionalism (M = 4.02, SD = 0.72). Self-reports were also high for competencies related to patient care (M = 3.86, SD = 0.68), communication and interpersonal skills (M = 3.88, SD = 0.66), and medical knowledge (M = 3.78, SD = 0.73). Consistent with expectations, systems-based practice (M = 3.50, SD = 0.70) and practice-based learning and improvement (M = 3.57, SD = 0.62) were the lowest rated competencies, although self-reported preparedness was still quite high. Our findings suggest that, from the perspective of our graduates, USU is providing both an effective military-unique curriculum and is preparing trainees for residency training. Further, these results support the notion that graduates are prepared to lead and to practice medicine in austere environments. Compared to other competencies that were assessed, self-ratings for systems-based practice and practice-based learning and improvement were the lowest, which suggests the need to continue to improve USU education in these areas. Reprint & Copyright © 2015 Association of Military Surgeons of the U.S.
ERIC Educational Resources Information Center
Saß, Steffani; Schütte, Kerstin
2016-01-01
Solving test items might require abilities in test-takers other than the construct the test was designed to assess. Item and student characteristics such as item format or reading comprehension can impact the test result. This experiment is based on cognitive theories of text and picture comprehension. It examines whether integration aids, which…
Development of the Holistic Nursing Competence Scale.
Takase, Miyuki; Teraoka, Sachiko
2011-12-01
This study developed a scale to measure the nursing competence of Japanese registered nurses and to test its psychometric properties. Following the derivation of scale items and pilot testing, the final version of the scale was administered to 331 nurses to establish its internal consistency, as well as its construct and criterion-related validity. Using an exploratory and a confirmatory factor analysis, 36 items with a five-factor structure were retained to form the Holistic Nursing Competence Scale. These factors illustrate nurses' general aptitude and their competencies in staff education and management, ethical practice, the provision of nursing care, and professional development. The Scale has a positive correlation with the length of clinical experience. A Cronbach's alpha coefficient was 0.967. The Scale is a reliable and valid measure, helping both nurses and organizations to correctly evaluate nurses' competence and identify their needs for professional development. © 2011 Blackwell Publishing Asia Pty Ltd.
ERIC Educational Resources Information Center
Taskinen, Päivi H.; Steimel, Jochen; Gräfe, Linda; Engell, Sebastian; Frey, Andreas
2015-01-01
This study examined students' competencies in engineering education at the university level. First, we developed a competency model in one specific field of engineering: process dynamics and control. Then, the theoretical model was used as a frame to construct test items to measure students' competencies comprehensively. In the empirical…
Boyd, Elizabeth; Grant, Tim
2005-01-01
The introduction of women officers into HM Prison Service raised questions regarding women's ability to perform what had traditionally been a male role. Existing research is inconclusive as to whether female prison officers are as competent as male prison officers, and whether there are gender differences in job performance. This study examined prisoners' perceptions of male and female prison officers' performance. The hypotheses were that overall competence and professionalism ratings would not differ for men and women officers, but that there would be differences in how men and women were perceived to perform their roles. Women were expected to be rated as more communicative, more empathic and less disciplining. The Prison Officer Competency Rating Scale (PORS) was designed for this study. Ratings on the PORS for male and female officers were given by 57 adult male prisoners. There was no significant difference in prisoners' ratings of overall competence of men and women officers. Of the PORS subscales, there were no gender differences in Discipline and Control, Communication or Empathy, but there was a significant difference in Professionalism, where prisoners rated women as more professional. The failure to find any differences between men and women in overall job competence, or on communication, empathy and discipline, as perceived by prisoners, suggests that men and women may be performing their jobs similarly in many respects. Women were rated as more professional, and items contributing to this scale related to respecting privacy and keeping calm in difficult situations, where there may be inherent gender biases.
Nicholson, Patricia; Griffin, Patrick; Gillis, Shelley; Wu, Margaret; Dunning, Trisha
2013-09-01
Concern about the process of identifying underlying competencies that contribute to effective nursing performance has been debated with a lack of consensus surrounding an approved measurement instrument for assessing clinical performance. Although a number of methodologies are noted in the development of competency-based assessment measures, these studies are not without criticism. The primary aim of the study was to develop and validate a Performance Based Scoring Rubric, which included both analytical and holistic scales. The aim included examining the validity and reliability of the rubric, which was designed to measure clinical competencies in the operating theatre. The fieldwork observations of 32 nurse educators and preceptors assessing the performance of 95 instrument nurses in the operating theatre were used in the calibration of the rubric. The Rasch model, a particular model among Item Response Models, was used in the calibration of each item in the rubric in an attempt at improving the measurement properties of the scale. This is done by establishing the 'fit' of the data to the conditions demanded by the Rasch model. Acceptable reliability estimates, specifically a high Cronbach's alpha reliability coefficient (0.940), as well as empirical support for construct and criterion validity for the rubric were achieved. Calibration of the Performance Based Scoring Rubric using Rasch model revealed that the fit statistics for most items were acceptable. The use of the Rasch model offers a number of features in developing and refining healthcare competency-based assessments, improving confidence in measuring clinical performance. The Rasch model was shown to be useful in developing and validating a competency-based assessment for measuring the competence of the instrument nurse in the operating theatre with implications for use in other areas of nursing practice. Crown Copyright © 2012. Published by Elsevier Ltd. All rights reserved.
Food-safety educational goals for dietetics and hospitality students.
Scheule, B
2000-08-01
To identify food-safety educational goals for dietetics and hospitality management students. Written questionnaires were used to identify educational goals and the most important food safety competencies for entry-level dietitians and foodservice managers. The sample included all directors of didactic programs in dietetics approved by the American Dietetic Association and baccalaureate-degree hospitality programs with membership in the Council on Hotel, Restaurant, and Institutional Education. Fifty-one percent of the directors responded. Descriptive statistics were calculated. chi 2 analysis and independent t tests were used to compare educators' responses for discrete and continuous variables, respectively. Exploratory factor analysis grouped statements about food safety competence. Internal consistency of factors was measured using Cronbach alpha. Thirty-four percent of dietetics programs and 70% of hospitality programs required or offered food safety certification. Dietetics educators reported multiple courses with food safety information, whereas hospitality educators identified 1 or 2 courses. In general, the educators rated food-safety competencies as very important or essential. Concepts related to Hazard Analysis and Critical Control Points (HAACP), irradiation, and pasteurization were rated less highly, compared with other items. Competencies related to reasons for outbreaks of foodborne illness were rated as most important. Food safety certification of dietitians and an increased emphasis on HAACP at the undergraduate level or during the practice component are suggested. Research is recommended to assess the level of food-safety competence expected by employers of entry-level dietitians and foodservice managers.
Separating Cognitive and Content Domains in Mathematical Competence
ERIC Educational Resources Information Center
Harks, Birgit; Klieme, Eckhard; Hartig, Johannes; Leiss, Dominik
2014-01-01
The present study investigates the empirical separability of mathematical (a) content domains, (b) cognitive domains, and (c) content-specific cognitive domains. There were 122 items representing two content domains (linear equations vs. theorem of Pythagoras) combined with two cognitive domains (modeling competence vs. technical competence)…
Ohio Agriscience Lesson Plans.
ERIC Educational Resources Information Center
Sommers, Robert D., II, Comp.; Waidelich, William D., Comp.
This document, which is intended for Ohio agriculture teachers, contains lesson plans for an eight-unit competency-based course in agriscience. Each lesson plan contains some or all of the following items: (1) unit title; (2) competency/terminal performance objective; (3) competency builders/pupil performance objectives; (4) list of applied…
Tilbury, Claire; Haanstra, Tsjitske M; Leichtenberg, Claudia S; Verdegaal, Suzan H M; Ostelo, Raymond W; de Vet, Henrica C W; Nelissen, Rob G H H; Vliet Vlieland, Thea P M
2016-10-01
The aims of this study were to assess patients' preoperative expectations of the outcome of total hip or knee arthroplasty (THA/TKA) regarding specific aspects of functioning and to determine to what extent each expectation was fulfilled after 1 year. This was a prospective cohort study. Preoperative expectations and their fulfillment after 1 year were measured with the Hospital for Special Surgery Hip/Knee arthroplasty Expectations Surveys. Preoperative and postoperative scores were subtracted to calculate whether expectations were unfulfilled, fulfilled, or exceeded. A total of 343 THA and 322 TKA patients with complete follow-up were included. Preoperatively, >60% of patients (both THA/TKA) expected to get back to normal or have much improvement in 19 of 20 (THA) and 12 of 19 (TKA) items. Expectations were fulfilled or exceeded in >60% of patients in all 20 items for THA and 17 of 19 items for TKA. In THA, items with the largest proportions patients with unfulfilled expectations (>30%) were "improvement in walking ability: long distances" (31%), "walking stairs" (33%), and "improve ability to cut toenails" (38%). In TKA, expectations for 12 of 19 items were unfulfilled in >30% of patients, with the largest proportions seen for "being able to kneel down" (44%) and "being able to squat" (47%). Although for most items, >60% of THA and TKA patients indicated that their expectations were met or exceeded, there was a substantial number of patients, particularly TKA patients, having unfulfilled expectations. These need more attention in preoperative patient information and education. Copyright © 2016 Elsevier Inc. All rights reserved.
An Evaluation of the Clinical Performance of Newly Qualified Nurses: A Competency Based Assessment.
ERIC Educational Resources Information Center
O'Connor, S. E.; Pearce, J.; Smith, R. L.; Voegeli, D.; Walton, P.
2001-01-01
Senior nurses' (n=139) expectations of 36 beginning nurses were compared with the beginners' competence ratings by their clinical preceptors. Senior nurses' expectations were lower than the actual competence demonstrated by the graduates, suggesting that assessment instruments should not be derived solely from supervisor expectations. (SK)
ERIC Educational Resources Information Center
Dickerson, Amy M.; Hoffman, John L.; Anan, Baramee Peper; Brown, Kelsey F.; Vong, Linda K.; Bresciani, Marilee J.; Monzon, Reynaldo; Oyler, Jessica
2011-01-01
This survey research project compared and contrasted faculty and SSAO expectations for discrete new professional competencies. Findings revealed few significant differences. This study further examined differences between expected and perceived levels of new professional competency. Significant gaps emerged for fiscal management, planning,…
Weech-Maldonado, Robert; Carle, Adam; Weidmer, Beverly; Hurtado, Margarita; Ngo-Metzger, Quyen; Hays, Ron D
2012-09-01
There is a need for reliable and valid measures of cultural competence (CC) from the patient's perspective. This paper evaluates the reliability and validity of the Consumer Assessments of Healthcare Providers and Systems (CAHPS) CC item set. Using 2008 survey data, we assessed the internal consistency of the CAHPS CC scales using the Cronbach α's and examined the validity of the measures using exploratory and confirmatory factor analysis, multitrait scaling analysis, and regression analysis. A random stratified sample (based on race/ethnicity and language) of 991 enrollees, younger than 65 years, from 2 Medicaid managed care plans in California and New York. CAHPS CC item set after excluding screener items and ratings. Confirmatory factor analysis (Comparative Fit Index=0.98, Tucker Lewis Index=0.98, and Root Mean Square Error or Approximation=0.06) provided support for a 7-factor structure: Doctor Communication--Positive Behaviors, Doctor Communication--Negative Behaviors, Doctor Communication--Health Promotion, Doctor Communication--Alternative Medicine, Shared Decision-Making, Equitable Treatment, and Trust. Item-total correlations (corrected for item overlap) for the 7 scales exceeded 0.40. Exploratory factor analysis showed support for 1 additional factor: Access to Interpreter Services. Internal consistency reliability estimates ranged from 0.58 (Alternative Medicine) to 0.92 (Positive Behaviors) and was 0.70 or higher for 4 of the 8 composites. All composites were positively and significantly associated with the overall doctor rating. The CAHPS CC 26-item set demonstrates adequate measurement properties and can be used as a supplemental item set to the CAHPS Clinician and Group Surveys in assessing culturally competent care from the patient's perspective.
Criterion-Referenced Test (CRT) Items for Air Conditioning, Heating and Refrigeration.
ERIC Educational Resources Information Center
Davis, Diane, Ed.
These criterion-referenced test (CRT) items for air conditioning, heating, and refrigeration are keyed to the Missouri Air Conditioning, Heating, and Refrigeration Competency Profile. The items are designed to work with both the Vocational Instructional Management System and Vocational Administrative Management System. For word processing and…
Mothers' Expectancies and Young Adolescents' Perceived Physical Competence: A Yearlong Study.
ERIC Educational Resources Information Center
Bois, Julien E.; Sarrazin, Philippe G.; Brustad, Robert J.; Trouilloud, David O.; Cury, Francois
2002-01-01
Investigated the role of mothers' expectancies in shaping their child's perceived physical competence. Structural equation modeling revealed that mothers' perceptions of their child's physical competence predicted their child's own perceived physical competence 1 year later, independent of the child's previously demonstrated physical ability and…
Content Analysis of Chemistry Curricula in Germany Case Study: Chemical Reactions
ERIC Educational Resources Information Center
Timofte, Roxana S.
2015-01-01
Curriculum-assessment alignment is a well known foundation for good practice in educational assessment, for items' curricular validity purposes. Nowadays instruments are designed to measure pupils' competencies in one or more areas of competence. Sub-competence areas could be defined theoretically and statistical analysis of empirical data by…
Development and Initial Examination of the School Psychology Multicultural Competence Scale
ERIC Educational Resources Information Center
Malone, Celeste M.; Briggs, Candyce; Ricks, Elizabeth; Middleton, Kyndra; Fisher, Sycarah; Connell, James
2016-01-01
This study reports on the initial development and examination of the School Psychology Multicultural Competence Scale (SPMCS), a 45-item self-report measure for evaluating school psychologists' multicultural competence in the primary domains of school psychology practice (i.e., assessment, consultation, intervention). A sample of 312 school…
Initial Factor Analysis and Cross-Validation of the Multicultural Teaching Competencies Inventory
ERIC Educational Resources Information Center
Prieto, Loreto R.
2012-01-01
The Multicultural Teaching Competencies Inventory (MTCI) contains items based on the tri-parte model of cultural competencies established by Sue and associates (Sue et al., 1992, 1982, 2003) that identify multicultural Awareness, Knowledge, and Skill as central characteristics of a culturally sensitive professional. The development and validation…
Nurse competence scale: development and psychometric testing.
Meretoja, Riitta; Isoaho, Hannu; Leino-Kilpi, Helena
2004-07-01
Self-assessment assists nurses to maintain and improve their practice by identifying their strengths and areas that may need to be further developed. Professional competence profiles encourage them to take an active part in the learning process of continuing education. Although competence recognition offers a way to motivate practising nurses to produce quality care, few measuring tools are available for this purpose. This paper describes the development and testing of the Nurse Competence Scale, an instrument with which the level of nurse competence can be assessed in different hospital work environments. The categories of the Nurse Competence Scale were derived from Benner's From Novice to Expert competency framework. A seven-step approach, including literature review and six expert groups, was used to identify and validate the indicators of nurse competence. After a pilot test, psychometric testing of the Nurse Competence Scale (content, construct and concurrent validity, and internal consistency) was undertaken with 498 nurses. The 73-item scale consists of seven categories, with responses on a visual analogy scale format. The frequency of using competencies was additionally tested with a four-point scale. Self-assessed overall scores indicated a high level of competence across categories. The Nurse Competence Scale data were normally distributed. The higher the frequency of using competencies, the higher was the self-assessed level of competence. Age and length of work experience had a positive but not very strong correlation with level of competence. According to the item analysis, the categories of the Nurse Competence Scale showed good internal consistency. The results provide strong evidence of the reliability and validity of the Nurse Competence Scale.
Development of the PROMIS coping expectancies of smoking item banks.
Shadel, William G; Edelen, Maria Orlando; Tucker, Joan S; Stucky, Brian D; Hansen, Mark; Cai, Li
2014-09-01
Smoking is a coping strategy for many smokers who then have difficulty finding new ways to cope with negative affect when they quit. This paper describes analyses conducted to develop and evaluate item banks for assessing the coping expectancies of smoking for daily and nondaily smokers. Using data from a large sample of daily (N = 4,201) and nondaily (N = 1,183) smokers, we conducted a series of item factor analyses, item response theory analyses, and differential item functioning (DIF) analyses (according to gender, age, and ethnicity) to arrive at a unidimensional set of items for daily and nondaily smokers. We also evaluated performance of short forms (SFs) and computer adaptive tests (CATs) for assessing coping expectancies of smoking. For both daily and nondaily smokers, the unidimensional Coping Expectancies item banks (21 items) are relatively DIF free and are highly reliable (0.96 and 0.97, respectively). A common 4-item SF for daily and nondaily smokers also showed good reliability (0.85). Adaptive tests required an average of 4.3 and 3.7 items for simulated daily and nondaily respondents, respectively, and achieved reliabilities of 0.91 for both when the maximum test length was 10 items. This research provides a new set of items that can be used to reliably assess coping expectancies of smoking, through a SF, CAT, or a tailored set selected for a specific research purpose. © The Author 2014. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.
Valente, Ana Rita S; Hall, Andreia; Alvelos, Helena; Leahy, Margaret; Jesus, Luis M T
2018-04-12
The appropriate use of language in context depends on the speaker's pragmatic language competencies. A coding system was used to develop a specific and adult-focused self-administered questionnaire to adults who stutter and adults who do not stutter, The Assessment of Language Use in Social Contexts for Adults, with three categories: precursors, basic exchanges, and extended literal/non-literal discourse. This paper presents the content validity, item analysis, reliability coefficients and evidences of construct validity of the instrument. Content validity analysis was based on a two-stage process: first, 11 pragmatic questionnaires were assessed to identify items that probe each pragmatic competency and to create the first version of the instrument; second, items were assessed qualitatively by an expert panel composed by adults who stutter and controls, and quantitatively and qualitatively by an expert panel composed by clinicians. A pilot study was conducted with five adults who stutter and five controls to analyse items and calculate reliability. Construct validity evidences were obtained using the hypothesized relationships method and factor analysis with 28 adults who stutter and 28 controls. Concerning content validity, the questionnaires assessed up to 13 pragmatic competencies. Qualitative and quantitative analysis revealed ambiguities in items construction. Disagreement between experts was solved through item modification. The pilot study showed that the instrument presented internal consistency and temporal stability. Significant differences between adults who stutter and controls and different response profiles revealed the instrument's underlying construct. The instrument is reliable and presented evidences of construct validity.
Preservice Teachers' Critical Thinking Dispositions and Web 2.0 Competencies
ERIC Educational Resources Information Center
Sendag, Serkan; Erol, Osman; Sezgin, Sezan; Dulkadir, Nihal
2015-01-01
The aim of this study was to investigate the associations between preservice teachers' Web 2.0 competencies and their critical thinking disposition (CTD). The study employed an associational research design using California Critical Thinking Disposition-Inventory (CCTD-I) and a Web 2.0 competency questionnaire including items related to Web 2.0…
ERIC Educational Resources Information Center
Honea, Heather; Castro, Iana A.; Peter, Paula
2017-01-01
Although past research has spent considerable effort identifying competencies and academic activities that are associated with workplace readiness, the literature is largely silent regarding what might best serve as evidence to employers that a graduate possesses specific marketing competencies. In the current research, we develop a comprehensive…
Cavallo, Cheryl L; Richter, Randy R
2004-01-01
Development of attitudes of physical therapists (PTs) toward physical therapist assistants (PTAs) begins during their professional education, and attitudes are influenced further by clinical experiences. The purpose of this study was to understand attitudes of student PTs toward PTAs. We surveyed 66 clinical intern students enrolled in an entry-level master of physical therapy program. PT students received the same survey before and after their full-time clinical internship. Eleven Likert scale items were used to assess students' attitudes toward PTAs in the areas of competence, financial remuneration, and job security. One item was designed to determine whether PT students' level of contact with PTAs influenced attitudes. A random sample of 13 (20.9%) students who returned surveys were asked to participate in a telephone interview designed to enrich the quantitative data. After item analysis, five of the scale items were eliminated from the analyses due to poor internal consistency. Cronbach's alpha of the remaining six scale items was 0.75. Survey results reveal that PT students maintain an overall positive attitude toward PTAs before and after full-time clinical internship. Qualitative interview data support this finding. Students' attitudes in specific areas of PTA competence were negative and positive, however. The negative attitude may have been based on the students' beliefs that PTAs are not competent to perform physical therapy in situations that are changing or unpredictable. Positive attitudes may have been reflective of the students' beliefs that PTAs are competent to implement established plans of care. Student ranking of four professional issues showed a significant difference before and after full-time clinical internships.
Iglesias-Parra, Maria Rosa; García-Guerrero, Alfonso; García-Mayor, Silvia; Kaknani-Uttumchandani, Shakira; León-Campos, Álvaro; Morales-Asencio, José Miguel
2015-07-01
To develop an evaluation system of clinical competencies for the practicum of nursing students based on the Nursing Interventions Classification (NIC). Psychometric validation study: the first two phases addressed definition and content validation, and the third phase consisted of a cross-sectional study for analyzing reliability. The study population was undergraduate nursing students and clinical tutors. Through the Delphi technique, 26 competencies and 91 interventions were isolated. Cronbach's α was 0.96. Factor analysis yielded 18 factors that explained 68.82% of the variance. Overall inter-item correlation was 0.26, and total-item correlation ranged between 0.66 and 0.19. A competency system for the nursing practicum, structured on the NIC, is a reliable method for assessing and evaluating clinical competencies. Further evaluations in other contexts are needed. The availability of standardized language systems in the nursing discipline supposes an ideal framework to develop the nursing curricula. © 2015 Sigma Theta Tau International.
Webster, Joseph B
2009-03-01
To determine the performance and change over time when incorporating questions in the core competency domains of practice-based learning and improvement (PBLI), systems-based practice (SBP), and professionalism (PROF) into the national PM&R Self-Assessment Examination for Residents (SAER). Prospective, longitudinal analysis. The national Self-Assessment Examination for Residents (SAER) in Physical Medicine and Rehabilitation, which is administered annually. Approximately 1100 PM&R residents who take the examination annually. Inclusion of progressively more challenging questions in the core competency domains of PBLI, SBP, and PROF. Individual test item level of difficulty (P value) and discrimination (point biserial index). Compared with the overall test, questions in the subtopic areas of PBLI, SBP, and PROF were relatively easier and less discriminating (correlation of resident performance on these domains compared with that on the total test). These differences became smaller during the 3-year time period. The difficulty level of the questions in each of the subtopic domains was raised during the 3 year period to a level close to the overall exam. Discrimination of the test items improved or remained stable. This study demonstrates that, with careful item writing and review, multiple-choice items in the PBLI, SBP, and PROF domains can be successfully incorporated into an annual, national self-assessment examination for residents. The addition of these questions had value in assessing competency while not compromising the overall validity and reliability of the exam. It is yet to be determined if resident performance on these questions corresponds to performance on other measures of competency in the areas of PBLI, SBP, and PROF.
Methodology for Developing and Evaluating the PROMIS® Smoking Item Banks
Cai, Li; Stucky, Brian D.; Tucker, Joan S.; Shadel, William G.; Edelen, Maria Orlando
2014-01-01
Introduction: This article describes the procedures used in the PROMIS® Smoking Initiative for the development and evaluation of item banks, short forms (SFs), and computerized adaptive tests (CATs) for the assessment of 6 constructs related to cigarette smoking: nicotine dependence, coping expectancies, emotional and sensory expectancies, health expectancies, psychosocial expectancies, and social motivations for smoking. Methods: Analyses were conducted using response data from a large national sample of smokers. Items related to each construct were subjected to extensive item factor analyses and evaluation of differential item functioning (DIF). Final item banks were calibrated, and SF assessments were developed for each construct. The performance of the SFs and the potential use of the item banks for CAT administration were examined through simulation study. Results: Item selection based on dimensionality assessment and DIF analyses produced item banks that were essentially unidimensional in structure and free of bias. Simulation studies demonstrated that the constructs could be accurately measured with a relatively small number of carefully selected items, either through fixed SFs or CAT-based assessment. Illustrative results are presented, and subsequent articles provide detailed discussion of each item bank in turn. Conclusions: The development of the PROMIS smoking item banks provides researchers with new tools for measuring smoking-related constructs. The use of the calibrated item banks and suggested SF assessments will enhance the quality of score estimates, thus advancing smoking research. Moreover, the methods used in the current study, including innovative approaches to item selection and SF construction, may have general relevance to item bank development and evaluation. PMID:23943843
Taylor, Rachel M; Feltbower, Richard G; Aslam, Natasha; Raine, Rosalind; Whelan, Jeremy S; Gibson, Faith
2016-01-01
Objectives To provide international consensus on the competencies required by healthcare professionals in order to provide specialist care for teenagers and young adults (TYA) with cancer. Design Modified e-Delphi survey. Setting International, multicentre study. Participants Experts were defined as professionals having worked in TYA cancer care for more than 12 months. They were identified through publications and professional organisations. Methods Round 1, developed from a previous qualitative study, included 87 closed-ended questions with responses on a nine-point Likert scale and further open-ended responses to identify other skills, knowledge and attitudes. Round 2 contained only items with no consensus in round 1 and suggestions of additional items of competency. Consensus was defined as a median score ranging from 7 to 9 and strength of agreement using mean absolute deviation of the median. Results A total of 179 registered to be members of the expert panel; valid responses were available from 158 (88%) in round 1 and 136/158 (86%) in round 2. The majority of participants were nurses (35%) or doctors (39%) from Europe (55%) or North America (35%). All 87 items in round 1 reached consensus with an additional 15 items identified for round 2, which also reached consensus. The strength of agreement was mostly high for statements. The areas of competence rated most important were agreed to be: ‘Identify the impact of disease on young people's life’ (skill), ‘Know about side effects of treatment and how this might be different to those experienced by children or older adults’ (knowledge), ‘Honesty’ (attitude) and ‘Listen to young people's concerns’ (aspect of communication). Conclusions Given the high degree of consensus, this list of competencies should influence education curriculum, professional development and inform workforce planning. Variation in strength of agreement for some competencies between professional groups should be explored further in pursuit of effective multidisciplinary team working. PMID:27142859
Gattinger, Heidrun; Senn, Beate; Hantikainen, Virpi; Köpke, Sascha; Ott, Stefan; Leino-Kilpi, Helena
2017-01-01
Impaired mobility is a prevalent condition among care-dependent persons living in nursing homes. Therefore, competence development of nursing staff in mobility care is important. This study aimed to develop and initially test the Kinaesthetics Competence Self-Evaluation (KCSE) scale for assessing nursing staff's competence in mobility care. The KCSE scale was developed based on an analysis of the concept of nurses' competence in kinaesthetics. Kinaesthetics is a training concept that provides theory and practice about movement foundations that comprise activities of daily living. The scale contains 28 items and four subscales (attitude, dynamic state, knowledge and skills). Content validity was assessed by determining the content validity index within two expert panels. Internal consistency and construct validity were tested within a cross-sectional study in three nursing homes in the German-speaking region of Switzerland between September and November 2015. The content validity index for the entire scale was good (0.93). Based on a sample of nursing staff ( n = 180) the internal consistency results were good for the whole scale (Cronbach's alpha = 0.91) and for the subscales knowledge and skills (α = 0.91, 0.86), acceptable for the subscale attitude (α = 0.63) and weak for the subscale dynamic state (α = 0.54). Most items showed acceptable inter-item and item-total correlations. Based on the exploratory factor analysis, four factors explaining 52% of the variance were extracted. The newly developed KCSE scale is a promising instrument for measuring nursing staff's attitude, dynamic state, knowledge, and skills in mobility care based on kinaesthetics. Despite the need for further psychometric evaluation, the KCSE scale can be used in clinical practice to evaluate competence in mobility care based on kinaesthetics and to identify educational needs for nursing staff.
Han, Paul K J; Joekes, Katherine; Mills, Greg; Gutheil, Caitlin; Smith, Kahsi; Cochran, Nancy E; Elwyn, Glyn
2016-12-01
To develop and evaluate a brief observational measure of clinical risk communication competence. A 4-item checklist-type measure, the BRISK (Brief Risk Information Skill) Scale, was developed by selecting and refining items from a more comprehensive measure of clinical risk communication competence. Six volunteer raters received brief training on the measure and then used the BRISK Scale to evaluate 52 video-recorded encounters between 2nd-year medical students and standardized patients conducted as part of an Observed Structured Clinical Examination (OSCE) involving a risk communication task. Internal consistency reliability, inter-rater reliability, and criterion validity were assessed. Raters reported no difficulties using the BRISK Scale; scores across all raters and subjects ranged from 0 to 16 with a mean score of 6.49 (SD=3.17). The BRISK Scale showed good internal consistency reliability (α=0.64), and inter-rater reliability at the scale level (Intraclass Correlation Coefficient (ICC)=0.79 for consistency, and 0.75 for absolute agreement) and individual-item level (ICC range: 0.62-.91). Novice raters' BRISK Scale scores were highly correlated (r=0.84, p<0.01) with expert raters' scores on the Risk Communication Content measure, a more comprehensive measure of risk communication competence. The BRISK Scale is a promising new brief observational measure of clinical risk communication competence. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.
Hernández-Padilla, José M; Granero-Molina, José; Márquez-Hernández, Verónica V; Suthers, Fiona; López-Entrambasaguas, Olga M; Fernández-Sola, Cayetano
2017-06-01
Rapid and accurate interpretation of cardiac arrhythmias by nurses has been linked with safe practice and positive patient outcomes. Although training in electrocardiogram rhythm recognition is part of most undergraduate nursing programmes, research continues to suggest that nurses and nursing students lack competence in recognising cardiac rhythms. In order to promote patient safety, nursing educators must develop valid and reliable assessment tools that allow the rigorous assessment of this competence before nursing students are allowed to practise without supervision. The aim of this study was to develop and psychometrically evaluate a toolkit to holistically assess competence in electrocardiogram rhythm recognition. Following a convenience sampling technique, 293 nursing students from a nursing faculty in a Spanish university were recruited for the study. The following three instruments were developed and psychometrically tested: an electrocardiogram knowledge assessment tool (ECG-KAT), an electrocardiogram skills assessment tool (ECG-SAT) and an electrocardiogram self-efficacy assessment tool (ECG-SES). Reliability and validity (content, criterion and construct) of these tools were meticulously examined. A high Cronbach's alpha coefficient demonstrated the excellent reliability of the instruments (ECG-KAT=0.89; ECG-SAT=0.93; ECG-SES=0.98). An excellent context validity index (scales' average content validity index>0.94) and very good criterion validity were evidenced for all the tools. Regarding construct validity, principal component analysis revealed that all items comprising the instruments contributed to measure knowledge, skills or self-efficacy in electrocardiogram rhythm recognition. Moreover, known-groups analysis showed the tools' ability to detect expected differences in competence between groups with different training experiences. The three-instrument toolkit developed showed excellent psychometric properties for measuring competence in electrocardiogram rhythm recognition.
Cognitive Abilities Explain Wording Effects in the Rosenberg Self-Esteem Scale.
Gnambs, Timo; Schroeders, Ulrich
2017-12-01
There is consensus that the 10 items of the Rosenberg Self-Esteem Scale (RSES) reflect wording effects resulting from positively and negatively keyed items. The present study examined the effects of cognitive abilities on the factor structure of the RSES with a novel, nonparametric latent variable technique called local structural equation models. In a nationally representative German large-scale assessment including 12,437 students competing measurement models for the RSES were compared: a bifactor model with a common factor and a specific factor for all negatively worded items had an optimal fit. Local structural equation models showed that the unidimensionality of the scale increased with higher levels of reading competence and reasoning, while the proportion of variance attributed to the negatively keyed items declined. Wording effects on the factor structure of the RSES seem to represent a response style artifact associated with cognitive abilities.
Examining student heuristic usage in a hydrogen bonding assessment.
Miller, Kathryn; Kim, Thomas
2017-09-01
This study investigates the role of representational competence in student responses to an assessment of hydrogen bonding. The assessment couples the use of a multiple-select item ("Choose all that apply") with an open-ended item to allow for an examination of students' cognitive processes as they relate to the assignment of hydrogen bonding within a structural representation. Response patterns from the multiple-select item implicate heuristic usage as a contributing factor to students' incorrect responses. The use of heuristics is further supported by the students' corresponding responses to the open-ended assessment item. Taken together, these data suggest that poor representational competence may contribute to students' previously observed inability to correctly navigate the concept of hydrogen bonding. © 2017 by The International Union of Biochemistry and Molecular Biology, 45(5):411-416, 2017. © 2017 The International Union of Biochemistry and Molecular Biology.
Development of the PROMIS positive emotional and sensory expectancies of smoking item banks.
Tucker, Joan S; Shadel, William G; Edelen, Maria Orlando; Stucky, Brian D; Li, Zhen; Hansen, Mark; Cai, Li
2014-09-01
The positive emotional and sensory expectancies of cigarette smoking include improved cognitive abilities, positive affective states, and pleasurable sensorimotor sensations. This paper describes development of Positive Emotional and Sensory Expectancies of Smoking item banks that will serve to standardize the assessment of this construct among daily and nondaily cigarette smokers. Data came from daily (N = 4,201) and nondaily (N =1,183) smokers who completed an online survey. To identify a unidimensional set of items, we conducted item factor analyses, item response theory analyses, and differential item functioning analyses. Additionally, we evaluated the performance of fixed-item short forms (SFs) and computer adaptive tests (CATs) to efficiently assess the construct. Eighteen items were included in the item banks (15 common across daily and nondaily smokers, 1 unique to daily, 2 unique to nondaily). The item banks are strongly unidimensional, highly reliable (reliability = 0.95 for both), and perform similarly across gender, age, and race/ethnicity groups. A SF common to daily and nondaily smokers consists of 6 items (reliability = 0.86). Results from simulated CATs indicated that, on average, less than 8 items are needed to assess the construct with adequate precision using the item banks. These analyses identified a new set of items that can assess the positive emotional and sensory expectancies of smoking in a reliable and standardized manner. Considerable efficiency in assessing this construct can be achieved by using the item bank SF, employing computer adaptive tests, or selecting subsets of items tailored to specific research or clinical purposes. © The Author 2014. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.
Kwiatkoski, Danielle Ritter; Mantovani, Maria de Fátima; Pereira, Evani Marques; Bortolato-Major, Carina; Mattei, Ângela Taís; Peres, Aida Maris
2017-01-01
ABSTRACT Objective: translating and transculturally adapting the Clinical Competence Questionnaire to Brazilian senior undergraduate Nursing students, as well as measuring psychometric properties of the questionnaire. Method: a methodological study carried out in six steps: translation of the Clinical Competence Questionnaire instrument, consensus of the translations, back-translation, analysis by an expert committee, pre-testing and then presentation of the cross-cultural adaptation process to the developers. Psychometric properties were measured using Cronbach's alpha, intraclass correlation coefficient and content validity index. Results: the instrument was translated, transculturally adapted and its final version consisted of 48 items. Cronbach's alpha coefficient was 0.90, and the agreement index of the items was 99% for students and 98% for evaluators. Conclusion: the Clinical Competence Questionnaire was translated and adapted to Brazilian students, and the psychometric properties of the Portuguese version of the questionnaire presented satisfactory internal consistency regarding the studied sample. PMID:28591303
Insight into team competence in medical, nursing and respiratory therapy students.
Sigalet, Elaine L; Donnon, Tyrone L; Grant, Vincent
2015-01-01
This study provides information for educators about levels of competence in teams comprised of medical, nursing and respiratory therapy students after receiving a simulation-based team-training (SBT) curriculum with and without an additional formalized 30-min team-training (TT) module. A two-group pre- and post-test research design was used to evaluate team competence with respect to leadership, roles and responsibilities, communication, situation awareness and resource utilization. All scenarios were digitally recorded and evaluated using the KidSIM Team Performance Scale by six experts from medicine, nursing and respiratory therapy. The lowest scores occurred for items that reflected situation awareness. All teams improved their aggregate scores from Time 1 to Time 2 (p < 0.05). Student teams in the intervention group achieved significantly higher performance scores at Time 1 (Cohen's d = 0.92, p < 0.001) and Time 2 (d = 0.61, p < 0.01). All student teams demonstrated significant improvement in their ability to work more effectively by Time 2. The results suggest that situational awareness is an advanced expectation for the undergraduate student team. The provision of a formalized TT module prior to engaging student teams in a simulation-based TT curriculum led to significantly higher performances at Time 1 and 2.
Predicting problem behaviors with multiple expectancies: expanding expectancy-value theory.
Borders, Ashley; Earleywine, Mitchell; Huey, Stanley J
2004-01-01
Expectancy-value theory emphasizes the importance of outcome expectancies for behavioral decisions, but most tests of the theory focus on a single behavior and a single expectancy. However, the matching law suggests that individuals consider expected outcomes for both the target behavior and alternative behaviors when making decisions. In this study, we expanded expectancy-value theory to evaluate the contributions of two competing expectancies to adolescent behavior problems. One hundred twenty-one high school students completed measures of behavior problems, expectancies for both acting out and academic effort, and perceived academic competence. Students' self-reported behavior problems covaried mostly with perceived competence and academic expectancies and only nominally with problem behavior expectancies. We suggest that behavior problems may result from students perceiving a lack of valued or feasible alternative behaviors, such as studying. We discuss implications for interventions and suggest that future research continue to investigate the contribution of alternative expectancies to behavioral decisions.
Schoolchildren's Consumption of Competitive Foods and Beverages, Excluding a la Carte
ERIC Educational Resources Information Center
Kakarala, Madhuri; Keast, Debra R.; Hoerr, Sharon
2010-01-01
Background: Competitive foods/beverages are those in school vending machines, school stores, snack bars, special sales, and items sold a la carte in the school cafeteria that compete with United States Department of Agriculture (USDA) meal program offerings. Grouping a la carte items with less nutritious items allowed in less regulated venues may…
Applications of NLP Techniques to Computer-Assisted Authoring of Test Items for Elementary Chinese
ERIC Educational Resources Information Center
Liu, Chao-Lin; Lin, Jen-Hsiang; Wang, Yu-Chun
2010-01-01
The authors report an implemented environment for computer-assisted authoring of test items and provide a brief discussion about the applications of NLP techniques for computer assisted language learning. Test items can serve as a tool for language learners to examine their competence in the target language. The authors apply techniques for…
Federal Register 2010, 2011, 2012, 2013, 2014
2013-06-14
...: Request for information and comment on priority knowledge and competency items to address in training and... competencies currently needed by B Readers. The information obtained will be used in the development of the new... been training physicians and certifying competence in the use of the ILO system to classify film-based...
Improvement of debate competence: an outcome of an introductory course for medical humanities.
Chun, Kyung Hee; Lee, Young Hwan
2016-03-01
Academic debate is an effective method to enhance the competences of critical thinking, problem solving, communication skills and cooperation skills. The present study examined the improvement of debate competence which is an outcome of debate-based flipped learning. A questionnaire was administrated to second-year premedical school students at Yeungnam University. In total 45 students participated in the survey. The survey questionnaire was composed of 60 items of eight subfactors on debate competence. To investigate the homogeneous of low and high achievement groups, 18 items on empathy and 75 items on critical thinking scales were used. To compare the pretest with posttest scores, data was analyzed using paired sample t-test. There were no significant differences between low and high achievement groups by average grade at the beginning of the semester. There was a significant improvement in high achievers on the logical argumentation (p<0.001), proficiency in inquiry (p<0.01), active participation (p<0.001), ability to investigate and analyze (p<0.001), observance of debate rules (p<0.05), and acceptability (p<0.05). Even in low achievers, active participation (p<0.05) and ability to investigate and analyze (p<0.01) were significantly improved. Results showed that students could improve their debate competence by the debate-based flipped learning. A prospective and comparative study on the communication and teamwork competences needs to be conducted in the future. It is suggested that in-depth discussion for the curriculum design and teaching will be needed in terms of the effectiveness and the outcomes of the medical humanities.
Improvement of debate competence: an outcome of an introductory course for medical humanities
Chun, Kyung Hee; Lee, Young Hwan
2016-01-01
Purpose: Academic debate is an effective method to enhance the competences of critical thinking, problem solving, communication skills and cooperation skills. The present study examined the improvement of debate competence which is an outcome of debate-based flipped learning. Methods: A questionnaire was administrated to second-year premedical school students at Yeungnam University. In total 45 students participated in the survey. The survey questionnaire was composed of 60 items of eight subfactors on debate competence. To investigate the homogeneous of low and high achievement groups, 18 items on empathy and 75 items on critical thinking scales were used. To compare the pretest with posttest scores, data was analyzed using paired sample t-test. Results: There were no significant differences between low and high achievement groups by average grade at the beginning of the semester. There was a significant improvement in high achievers on the logical argumentation (p<0.001), proficiency in inquiry (p<0.01), active participation (p<0.001), ability to investigate and analyze (p<0.001), observance of debate rules (p<0.05), and acceptability (p<0.05). Even in low achievers, active participation (p<0.05) and ability to investigate and analyze (p<0.01) were significantly improved. Conclusion: Results showed that students could improve their debate competence by the debate-based flipped learning. A prospective and comparative study on the communication and teamwork competences needs to be conducted in the future. It is suggested that in-depth discussion for the curriculum design and teaching will be needed in terms of the effectiveness and the outcomes of the medical humanities. PMID:26838572
Methodology for developing and evaluating the PROMIS smoking item banks.
Hansen, Mark; Cai, Li; Stucky, Brian D; Tucker, Joan S; Shadel, William G; Edelen, Maria Orlando
2014-09-01
This article describes the procedures used in the PROMIS Smoking Initiative for the development and evaluation of item banks, short forms (SFs), and computerized adaptive tests (CATs) for the assessment of 6 constructs related to cigarette smoking: nicotine dependence, coping expectancies, emotional and sensory expectancies, health expectancies, psychosocial expectancies, and social motivations for smoking. Analyses were conducted using response data from a large national sample of smokers. Items related to each construct were subjected to extensive item factor analyses and evaluation of differential item functioning (DIF). Final item banks were calibrated, and SF assessments were developed for each construct. The performance of the SFs and the potential use of the item banks for CAT administration were examined through simulation study. Item selection based on dimensionality assessment and DIF analyses produced item banks that were essentially unidimensional in structure and free of bias. Simulation studies demonstrated that the constructs could be accurately measured with a relatively small number of carefully selected items, either through fixed SFs or CAT-based assessment. Illustrative results are presented, and subsequent articles provide detailed discussion of each item bank in turn. The development of the PROMIS smoking item banks provides researchers with new tools for measuring smoking-related constructs. The use of the calibrated item banks and suggested SF assessments will enhance the quality of score estimates, thus advancing smoking research. Moreover, the methods used in the current study, including innovative approaches to item selection and SF construction, may have general relevance to item bank development and evaluation. © The Author 2013. Published by Oxford University Press on behalf of the Society for Research on Nicotine and Tobacco. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.
Leadership competencies in the context of health services.
Jahrami, Haitham; Marnoch, Gordon; Gray, Ann Marie
2008-05-01
In a rapidly changing health-care environment, clinicians are increasingly called upon to assume complex leadership responsibilities. The research was undertaken to develop an understanding of the limits to the conceptual and methodological basis of leadership competency modelling in health services context. Data were collected from all of the clinicians in a Psychiatric Hospital, Bahrain using a researcher-developed questionnaire. Data were gathered to critically assess the validity of the competency-based approach to leadership on the basis of subjects' capacity to discriminate in terms of importance and accomplishment between the items featured in a research tool containing a comprehensive list of 124 leadership competencies. The results of the analyses indicate a weak identification with the competencies in the sense of revealing low levels of discriminatory sophistication on the part of subjects. The study design was limited to participants working in single hospital; therefore, the conclusions made cannot yet be regarded categorically as generalizable. Leadership selection, development and education activities may not achieve their ultimate outcomes due to the subject identification problem associated with the competence approach. It might be necessary to reconsider the efficiency of human resource activities that rely solely on the competency approach. The conceptual basis of leadership competence in health services has been previously neglected. This research casts doubt on competency approaches to leadership if based on subject identification with pre-defined items.
Sommer, Johanna; Lanier, Cédric; Perron, Noelle Junod; Nendaz, Mathieu; Clavet, Diane; Audétat, Marie-Claude
2016-04-01
The aim of this study was to develop a descriptive tool for peer review of clinical teaching skills. Two analogies framed our research: (1) between the patient-centered and the learner-centered approach; (2) between the structures of clinical encounters (Calgary-Cambridge communication model) and teaching sessions. During the course of one year, each step of the action research was carried out in collaboration with twelve clinical teachers from an outpatient general internal medicine clinic and with three experts in medical education. The content validation consisted of a literature review, expert opinion and the participatory research process. Interrater reliability was evaluated by three clinical teachers coding thirty audiotaped standardized learner-teacher interactions. This tool contains sixteen items covering the process and content of clinical supervisions. Descriptors define the expected teaching behaviors for three levels of competence. Interrater reliability was significant for eleven items (Kendall's coefficient p<0.05). This peer assessment tool has high reliability and can be used to facilitate the acquisition of teaching skills. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.
Parker, Andrew M; Bruine de Bruin, Wändi; Fischhoff, Baruch
2015-01-01
Most behavioral decision research takes place in carefully controlled laboratory settings, and examination of relationships between performance and specific real-world decision outcomes is rare. One prior study shows that people who perform better on hypothetical decision tasks, assessed using the Adult Decision-Making Competence (A-DMC) measure, also tend to experience better real-world decision outcomes, as reported on the Decision Outcomes Inventory (DOI). The DOI score reflects avoidance of outcomes that could result from poor decisions, ranging from serious (e.g., bankruptcy) to minor (e.g., blisters from sunburn). The present analyses go beyond the initial work, which focused on the overall DOI score, by analyzing the relationships between specific decision outcomes and A-DMC performance. Most outcomes are significantly more likely among people with lower A-DMC scores, even after taking into account two variables expected to produce worse real-world decision outcomes: younger age and lower socio-economic status. We discuss the usefulness of DOI as a measure of successful real-world decision-making.
From time-based to competency-based standards: core transitional competencies in plastic surgery.
Lutz, Kristina; Yazdani, Arjang; Ross, Douglas
2015-01-01
Competency-based medical education is becoming increasingly prevalent and is likely to be mandated by the Royal College in the near future. The objective of this study was to define the core technical competencies that should be possessed by plastic surgery residents as they transition into their senior (presently postgraduate year 3) years of training. A list of potential core competencies was generated using a modified Delphi method that included the investigators and 6 experienced, academic plastic surgeons from across Canada and the United States. Generated items were divided into 7 domains: basic surgical skills, anesthesia, hand surgery, cutaneous surgery, esthetic surgery, breast surgery, and craniofacial surgery. Members of the Delphi group were asked to rank particular skills on a 4-point scale with anchored descriptors. Item reduction resulted in a survey consisting of 48 skills grouped into the aforementioned domains. This self-administered survey was distributed to all Canadian program directors (n = 11) via e-mail for validation and further item reduction. The response rate was 100% (11/11). Using the average rankings of program directors, 26 "core" skills were identified. There was agreement of core skills across all domains except for breast surgery and esthetic surgery. Of them, 7 skills were determined to be above the level of a trainee at this stage; a further 15 skills were agreed to be important, but not core, competencies. Overall, 26 competencies have been identified as "core" for plastic surgery residents to possess as they begin their senior, on-service years. The nature of these skills makes them suitable for teaching in a formal, simulated environment, which would ensure that all plastic surgery trainees are competent in these tasks as they transition to their senior years of residency. Copyright © 2014 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.
Umar, Sulaiman; Man, Norsida; Nawi, Nolila Mohd; Latif, Ismail Abd; Samah, Bahaman Abu
2017-06-01
The study described the perceived importance of, and proficiency in core agricultural extension competencies among extension workers in Peninsular Malaysia; and evaluating the resultant deficits in the competencies. The Borich's Needs Assessment Model was used to achieve the objectives of the study. A sample of 298 respondents was randomly selected and interviewed using a pre-tested structured questionnaire. Thirty-three core competency items were assessed. Instrument validity and reliability were ensured. The cross-sectional data obtained was analysed using SPSS for descriptive statistics including mean weighted discrepancy score (MWDS). Results of the study showed that on a scale of 5, the most important core extension competency items according to respondents' perception were: "Making good use of information and communication technologies/access and use of web-based resources" (M=4.86, SD=0.23); "Conducting needs assessments" (M=4.84, SD=0.16); "organizing extension campaigns" (M=4.82, SD=0.47) and "Managing groups and teamwork" (M=4.81, SD=0.76). In terms of proficiency, the highest competency identified by the respondents was "Conducting farm and home visits (M=3.62, SD=0.82) followed by 'conducting meetings effectively' (M=3.19, SD=0.72); "Conducting focus group discussions" (M=3.16, SD=0.32) and "conducting community forums" (M=3.13, SD=0.64). The discrepancies implying competency deficits were widest in "Acquiring and allocating resources" (MWDS=12.67); use of information and communication technologies (ICTs) and web-based resources in agricultural extension (MWDS=12.59); and report writing and sharing the results and impacts (MWDS=11.92). It is recommended that any intervention aimed at developing the capacity of extension workers in Peninsular Malaysia should prioritize these core competency items in accordance with the deficits established in this study. Copyright © 2017 Elsevier Ltd. All rights reserved.
ERIC Educational Resources Information Center
Retnawati, Heri; Kartowagiran, Badrun; Arlinwibowo, Janu; Sulistyaningsih, Eny
2017-01-01
The quality of national examination items plays an enormous role in identifying students' competencies mastery and their difficulties. This study aims to identify the difficult items in the Junior High School Mathematics National Examination, to find the factors that cause students' difficulty and to reveal the strategies that the teachers and the…
ERIC Educational Resources Information Center
Buccelli, Pamela
A study compared the perceptions of Pennsylvania laboratory directors and medical technology educators relative to career-entry competencies for associate degree medical laboratory technicians (MLTs) and baccalaureate medical technology (MT) graduates. A 55-item competency questionnaire was administered to 265 hospital laboratory directors and 40…
Improving nurse practitioners' competence with genetics: Effectiveness of an online course.
Whitt, Karen J; Macri, Charles; O'Brien, Travis J; Wright, Stephanie
2016-03-01
The purpose of this study was to assess the effectiveness of an online genetics course for improving nurse practitioners' knowledge, competence, and comfort with genetic principles and their application to clinical practice. A genetics knowledge test and survey were administered to 232 nurse practitioner students, between 2011 and 2013, before and after completing a 15-week online genetics course taught by a multidisciplinary team of instructors at a private east coast U.S. university. The 65-item survey allowed participants to rate competence regarding genetic principles, diseases, and terminology, as well as comfort performing various clinical tasks related to genetics. The 21-item knowledge test contained multiple choice questions regarding core competencies in genetics. Paired t-tests were used to compare mean pre- and postscores. Participants significantly increased postcourse knowledge (p < .001) and comfort with genetic core competencies and clinical skills related to genetics (p < .001). This study demonstrates the effectiveness of an online genetics course for increasing nurse practitioners' knowledge, competence, and confidence with genetics and identifies specific topics educators should consider when designing curricula for nurse practitioners. Findings from this study can improve genetics education for nurse practitioners, which will in turn improve patient health. ©2015 American Association of Nurse Practitioners.
Smit, Eline Suzanne; Dima, Alexandra Lelia; Immerzeel, Stephanie Annette Maria; van den Putte, Bas; Williams, Geoffrey Colin
2017-05-08
Web-based health behavior change interventions may be more effective if they offer autonomy-supportive communication facilitating the internalization of motivation for health behavior change. Yet, at this moment no validated tools exist to assess user-perceived autonomy-support of such interventions. The aim of this study was to develop and validate the virtual climate care questionnaire (VCCQ), a measure of perceived autonomy-support in a virtual care setting. Items were developed based on existing questionnaires and expert consultation and were pretested among experts and target populations. The virtual climate care questionnaire was administered in relation to Web-based interventions aimed at reducing consumption of alcohol (Study 1; N=230) or cannabis (Study 2; N=228). Item properties, structural validity, and reliability were examined with item-response and classical test theory methods, and convergent and divergent validity via correlations with relevant concepts. In Study 1, 20 of 23 items formed a one-dimensional scale (alpha=.97; omega=.97; H=.66; mean 4.9 [SD 1.0]; range 1-7) that met the assumptions of monotonicity and invariant item ordering. In Study 2, 16 items fitted these criteria (alpha=.92; H=.45; omega=.93; mean 4.2 [SD 1.1]; range 1-7). Only 15 items remained in the questionnaire in both studies, thus we proceeded to the analyses of the questionnaire's reliability and construct validity with a 15-item version of the virtual climate care questionnaire. Convergent validity of the resulting 15-item virtual climate care questionnaire was confirmed by positive associations with autonomous motivation (Study 1: r=.66, P<.001; Study 2: r=.37, P<.001) and perceived competence for reducing alcohol intake (Study 1: r=.52, P<.001). Divergent validity could only be confirmed by the nonsignificant association with perceived competence for learning (Study 2: r=.05, P=.48). The virtual climate care questionnaire accurately assessed participants' perceived autonomy-support offered by two Web-based health behavior change interventions. Overall, the scale showed the expected properties and relationships with relevant concepts, and the studies presented suggest this first version of the virtual climate care questionnaire to be reasonably valid and reliable. As a result, the current version may cautiously be used in future research and practice to measure perceived support for autonomy within a virtual care climate. Future research efforts are required that focus on further investigating the virtual climate care questionnaire's divergent validity, on determining the virtual climate care questionnaire's validity and reliability when used in the context of Web-based interventions aimed at improving nonaddictive or other health behaviors, and on developing and validating a short form virtual climate care questionnaire. ©Eline Suzanne Smit, Alexandra Lelia Dima, Stephanie Annette Maria Immerzeel, Bas van den Putte, Geoffrey Colin Williams. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 08.05.2017.
Multi-institutional validation of a web-based core competency assessment system.
Tabuenca, Arnold; Welling, Richard; Sachdeva, Ajit K; Blair, Patrice G; Horvath, Karen; Tarpley, John; Savino, John A; Gray, Richard; Gulley, Julie; Arnold, Teresa; Wolfe, Kevin; Risucci, Donald A
2007-01-01
The Association of Program Directors in Surgery and the Division of Education of the American College of Surgeons developed and implemented a web-based system for end-of-rotation faculty assessment of ACGME core competencies of residents. This study assesses its reliability and validity across multiple programs. Each assessment included ratings (1-5 scale) on 23 items reflecting the 6 core competencies. A total of 4241 end-of-rotation assessments were completed for 332 general surgery residents (> or =5 evaluations each) at 5 sites during the 2004-2005 and 2005-2006 academic years. The mean rating for each resident on each item was computed for each academic year. The mean rating of items representing each competency was computed for each resident. Additional data included USMLE and ABSITE scores, PGY, and status in program (categorical, designated preliminary, and undesignated preliminary). Coefficient alpha was greater than 0.90 for each competency score. Mean ratings for each competency increased significantly (p < 0.01) as a function of PGY. Mean ratings for professionalism and interpersonal/communication skills (IPC) were significantly higher than all other competencies at all PGY levels. Competency ratings of PGY 1 residents correlated significantly with USMLE Step I, ranging from (r = 0.26, p < 0.01) for Professionalism to (r = 0.41, p < 0.001) for Systems-Based Practice. Ratings of Knowledge (r = 0.31, p < 0.01), Practice-Based Learning & Improvement (PBLI; r = 0.22, p < 0.05), and Systems-Based Practice (r = 0.20, p < 0.05) correlated significantly with 2005 ABSITE Total Percentile. Ratings of all competencies correlated significantly with the 2006 ABSITE Total Percentile Score (range: r = 0.20, p < 0.05 for professionalism to r = 0.35, p < 0.001 for knowledge). Categorical and designated preliminary residents received significantly higher ratings (p < 0.05) than nondesignated preliminaries for knowledge, patient care, PBLI, and systems-based practice only. Faculty ratings of core competencies are internally consistent. The pattern of statistically significant correlations between competency ratings and USMLE and ABSITE scores supports the postdictive and concurrent validity, respectively, of faculty perceptions of resident knowledge. The pattern of increased ratings as a function of PGY supports the construct validity of faculty ratings of resident core competencies.
Miller's Pyramid and Core Competency Assessment: A Study in Relationship Construct Validity.
Williams, Betsy White; Byrne, Phil D; Welindt, Dillon; Williams, Michael V
2016-01-01
Continuous professional development relies on the link between performance and an educational process aimed at improving knowledge and skill. One of the most broadly used frameworks for assessing skills is Miller's Pyramid. This Pyramid has a series of levels of achievement beginning with knowledge (at the base) and ending with routine application in the clinical setting. The purpose of this study was to determine the degree of convergence of two measurement methods, one based on Miller's framework, the second using the Accreditation Council for Graduate Medical Education/American Board of Medical Specialties (ACGME/ABMS) Core Competency framework. The data were gathered from the faculty of a large, Midwestern regional health care provider and hospital system. Data from 264 respondents were studied. The 360° data were from raters of physicians holding supervisory roles in the organization. The scale items were taken from an instrument that has been validated for both structure and known group prediction. The Miller scale was purposely built for this application. The questions were designed to describe each level of the model. The Miller scale was reduced to a single dimension. This result was then regressed on the items from the 360° item ratings. Results of a multivariate analysis of variance isolated a significant relationship between the Miller's Pyramid score and the competency items (P < 0.001). These findings demonstrate a relationship between measures based on Miller's framework and behavioral measures based on the ABMS/ACGME core competencies. Equally important is the finding that while they are related they are not identical. These findings have implications for continuous professional development programing design.
Science Literacy: How do High School Students Solve PISA Test Items?
NASA Astrophysics Data System (ADS)
Wati, F.; Sinaga, P.; Priyandoko, D.
2017-09-01
The Programme for International Students Assessment (PISA) does assess students’ science literacy in a real-life contexts and wide variety of situation. Therefore, the results do not provide adequate information for the teacher to excavate students’ science literacy because the range of materials taught at schools depends on the curriculum used. This study aims to investigate the way how junior high school students in Indonesia solve PISA test items. Data was collected by using PISA test items in greenhouse unit employed to 36 students of 9th grade. Students’ answer was analyzed qualitatively for each item based on competence tested in the problem. The way how students answer the problem exhibits their ability in particular competence which is influenced by a number of factors. Those are students’ unfamiliarity with test construction, low performance on reading, low in connecting available information and question, and limitation on expressing their ideas effectively and easy-read. As the effort, selected PISA test items can be used in accordance teaching topic taught to familiarize students with science literacy.
Lin, Monica H; Kwan, Virginia S Y; Cheung, Anna; Fiske, Susan T
2005-01-01
The Stereotype Content Model hypothesizes anti-Asian American stereotypes differentiating two dimensions: (excessive) competence and (deficient) sociability. The Scale of Anti-Asian American Stereotypes (SAAAS) shows this envious mixed prejudice in six studies. Study 1 began with 131 racial attitude items. Studies 2 and 3 tested 684 respondents on a focused 25-item version. Studies 4 and 5 tested the final 25-item SAAAS on 222 respondents at three campuses; scores predicted outgroup friendships, cultural experiences, and (over)estimated campus presence. Study 6 showed that allegedly low sociability, rather than excessively high competence, drives rejection of Asian Americans, consistent with system justification theory. The SAAAS demonstrates mixed, envious anti-Asian American prejudice, contrasting with more-often-studied contemptuous racial prejudices (i.e., against Blacks).
Lacasse, Miriam; Théorêt, Johanne; Tessier, Sylvie; Arsenault, Louise
2014-01-01
The CanMEDS-Family Medicine (CanMEDS-FM) framework defines the expected terminal enabling competencies (EC) for family medicine (FM) residency training in Canada. However, benchmarks throughout the 2-year program are not yet defined. This study aimed to identify expected time frames for achievement of the CanMEDS-FM competencies during FM residency training and create a developmental benchmarks scale for family medicine residency training. This 2011-2012 study followed a Delphi methodology. Selected faculty and clinical teachers identified, via questionnaire, the expected time of EC achievement from beginning of residency to one year in practice (0, 6, 12, […] 36 months). The 15-85th percentile intervals became the expected competency achievement interval. Content validity of the obtained benchmarks was assessed through a second Delphi round. The 1st and 2nd rounds were completed by 33 and 27 respondents, respectively. A developmental benchmarks scale was designed after the 1st round to illustrate expectations regarding achievement of each EC. The 2nd round (content validation) led to minor adjustments (1.9±2.7 months) of intervals for 44 of the 92 competencies, the others remaining unchanged. The Laval Developmental Benchmarks Scale for Family Medicine clarifies expectations regarding achievement of competencies throughout FM training. In a competency-based education system this now allows identification and management of outlying residents, both those excelling and needing remediation. Further research should focus on assessment of the scale reliability after pilot implementation in family medicine clinical teaching units at Laval University, and corroborate the established timeline in other sites.
Development and validation of the simulation-based learning evaluation scale.
Hung, Chang-Chiao; Liu, Hsiu-Chen; Lin, Chun-Chih; Lee, Bih-O
2016-05-01
The instruments that evaluate a student's perception of receiving simulated training are English versions and have not been tested for reliability or validity. The aim of this study was to develop and validate a Chinese version Simulation-Based Learning Evaluation Scale (SBLES). Four stages were conducted to develop and validate the SBLES. First, specific desired competencies were identified according to the National League for Nursing and Taiwan Nursing Accreditation Council core competencies. Next, the initial item pool was comprised of 50 items related to simulation that were drawn from the literature of core competencies. Content validity was established by use of an expert panel. Finally, exploratory factor analysis and confirmatory factor analysis were conducted for construct validity, and Cronbach's coefficient alpha determined the scale's internal consistency reliability. Two hundred and fifty students who had experienced simulation-based learning were invited to participate in this study. Two hundred and twenty-five students completed and returned questionnaires (response rate=90%). Six items were deleted from the initial item pool and one was added after an expert panel review. Exploratory factor analysis with varimax rotation revealed 37 items remaining in five factors which accounted for 67% of the variance. The construct validity of SBLES was substantiated in a confirmatory factor analysis that revealed a good fit of the hypothesized factor structure. The findings tally with the criterion of convergent and discriminant validity. The range of internal consistency for five subscales was .90 to .93. Items were rated on a 5-point scale from 1 (strongly disagree) to 5 (strongly agree). The results of this study indicate that the SBLES is valid and reliable. The authors recommend that the scale could be applied in the nursing school to evaluate the effectiveness of simulation-based learning curricula. Copyright © 2016 Elsevier Ltd. All rights reserved.
ERIC Educational Resources Information Center
Al-Habashneh, Maher Hussein; Najjar, Nabil Juma
2017-01-01
This study aimed at constructing a criterion-reference test to measure the research and statistical competencies of graduate students at the Jordanian governmental universities, the test has to be in its first form of (50) multiple choice items, then the test was introduced to (5) arbitrators with competence in measurement and evaluation to…
ERIC Educational Resources Information Center
Guardiola Castillo, Irma V.
2014-01-01
The purpose of this study was to explore teachers' and school counselors' perceptions of their cultural competence in working with newly arrived Latino immigrant students by using a mixed instrument with closed-ended and open-ended items. Multicultural Counseling Competencies (MCC) served as the theoretical framework for this study (Sue,…
ERIC Educational Resources Information Center
Conchado Peiró, Andrea; Bas Cerdá, María del Carmen; Gharaibeh, Khaled M.; Kaylani, Hazem
2017-01-01
The objective of this study is to identify the competencies required to achieve success in the transition from higher education to the labour market based on the perceptions of employers. This paper analyses the assessments made by a group of engineering company employers. An item-battery of 20 competencies was grouped into 3 dimensions by using…
Chan, Jason C K; Erdman, Matthew R; Davis, Sara D
2015-09-01
The mechanism responsible for retrieval-induced forgetting has been the subject of rigorous theoretical debate, with some researchers postulating that retrieval-induced forgetting can be explained by interference (J. G .W. Raaijmakers & E. Jakab, 2013) or context reinstatement (T. R. Jonker, P. Seli, & C. M. MacLeod, 2013), whereas others claim that retrieval-induced forgetting is better explained by inhibition (M. C. Anderson, 2003). A fundamental assumption of the inhibition account is that nonpracticed items are suppressed because they compete for retrieval during initial testing. In the current study, we manipulated competition in a novel interpolated testing paradigm by having subjects learn the nonpracticed items either before (high-competition condition) or after (low-competition condition) they practiced retrieval of the target items. We found retrieval-induced forgetting for the nonpracticed competitors only when they were studied before retrieval practice. This result provides support for a critical assumption of the inhibition account. (c) 2015 APA, all rights reserved).
Durak, Halil Ibrahim; Certuğ, Agah; Calişkan, Ayhan; van Dalen, Jan
2006-03-01
Although the Basic Life Support (BLS) ability of a medical student is a crucial competence, poor BLS training programs have been documented worldwide. Better training designs are needed. This study aims to share detailed descriptions and the test results of two cognitive-constructivist training models for the BLS skills in the first year of medical curriculum. A BLS skills training module was implemented in the first year curriculum in the course of 6 years (1997-2003). The content was derived from the European Resuscitation Council Guidelines. Initially, a competence-based model was used and was upgraded to a cognitive apprenticeship model in 2000. The main performance-content type that was expected at the end of the course was: competent application of BLS procedures on manikins and peers at an OSCE as well as 60% achievement in a test consisting of 25 MCQ items. A retrospective cohort survey design using exam results and a self-completed anonymous student ratings' questionnaire were used in order to test models. Training time for individual students varied from 21 to 29 hours. One thousand seven hundred and sixty students were trained. Fail rates were very low (1.0-2.2%). The students were highly satisfied with the module during the 6 years. In the first year of the medical curriculum, a competence-based or cognitive apprenticeship model using cognitive-constructivist designs of skills training with 9 hours theoretical and 12-20 hours long practical sessions took place in groups of 12-17 students; medical students reached a degree of competence to sufficiently perform BLS skills on the manikins and their peers. The cognitive-constructivist designs for skills training are associated with high student satisfaction. However, the lack of controls limits the extrapolation of this conclusion.
NASA Astrophysics Data System (ADS)
Wilder, Anna
The purpose of this study was to investigate the effects of a visualization-centered curriculum, Hemoglobin: A Case of Double Identity, on conceptual understanding and representational competence in high school biology. Sixty-nine students enrolled in three sections of freshman biology taught by the same teacher participated in this study. Online Chemscape Chime computer-based molecular visualizations were incorporated into the 10-week curriculum to introduce students to fundamental structure and function relationships. Measures used in this study included a Hemoglobin Structure and Function Test, Mental Imagery Questionnaire, Exam Difficulty Survey, the Student Assessment of Learning Gains, the Group Assessment of Logical Thinking, the Attitude Toward Science in School Assessment, audiotapes of student interviews, students' artifacts, weekly unit activity surveys, informal researcher observations and a teacher's weekly questionnaire. The Hemoglobin Structure and Function Test, consisting of Parts A and B, was administered as a pre and posttest. Part A used exclusively verbal test items to measure conceptual understanding, while Part B used visual-verbal test items to measure conceptual understanding and representational competence. Results of the Hemoglobin Structure and Function pre and posttest revealed statistically significant gains in conceptual understanding and representational competence, suggesting the visualization-centered curriculum implemented in this study was effective in supporting positive learning outcomes. The large positive correlation between posttest results on Part A, comprised of all-verbal test items, and Part B, using visual-verbal test items, suggests this curriculum supported students' mutual development of conceptual understanding and representational competence. Evidence based on student interviews, Student Assessment of Learning Gains ratings and weekly activity surveys indicated positive attitudes toward the use of Chemscape Chime software and the computer-based molecular visualization activities as learning tools. Evidence from these same sources also indicated that students felt computer-based molecular visualization activities in conjunction with other classroom activities supported their learning. Implications for instructional design are discussed.
Gopichandran, Vijayaprasad; Wouters, Edwin; Chetlapalli, Satish Kumar
2015-05-03
Trust in physicians is the unwritten covenant between the patient and the physician that the physician will do what is in the best interest of the patient. This forms the undercurrent of all healthcare relationships. Several scales exist for assessment of trust in physicians in developed healthcare settings, but to our knowledge none of these have been developed in a developing country context. To develop and validate a new trust in physician scale for a developing country setting. Dimensions of trust in physicians, which were identified in a previous qualitative study in the same setting, were used to develop a scale. This scale was administered among 616 adults selected from urban and rural areas of Tamil Nadu, south India, using a multistage sampling cross sectional survey method. The individual items were analysed using a classical test approach as well as item response theory. Cronbach's α was calculated and the item to total correlation of each item was assessed. After testing for unidimensionality and absence of local dependence, a 2 parameter logistic Semajima's graded response model was fit and item characteristics assessed. Competence, assurance of treatment, respect for the physician and loyalty to the physician were important dimensions of trust. A total of 31 items were developed using these dimensions. Of these, 22 were selected for final analysis. The Cronbach's α was 0.928. The item to total correlations were acceptable for all the 22 items. The item response analysis revealed good item characteristic curves and item information for all the items. Based on the item parameters and item information, a final 12 item scale was developed. The scale performs optimally in the low to moderate trust range. The final 12 item trust in physician scale has a good construct validity and internal consistency. Published by the BMJ Publishing Group Limited. For permission to use (where not already granted under a licence) please go to http://group.bmj.com/group/rights-licensing/permissions.
Gopichandran, Vijayaprasad; Wouters, Edwin; Chetlapalli, Satish Kumar
2015-01-01
Trust in physicians is the unwritten covenant between the patient and the physician that the physician will do what is in the best interest of the patient. This forms the undercurrent of all healthcare relationships. Several scales exist for assessment of trust in physicians in developed healthcare settings, but to our knowledge none of these have been developed in a developing country context. Objectives To develop and validate a new trust in physician scale for a developing country setting. Methods Dimensions of trust in physicians, which were identified in a previous qualitative study in the same setting, were used to develop a scale. This scale was administered among 616 adults selected from urban and rural areas of Tamil Nadu, south India, using a multistage sampling cross sectional survey method. The individual items were analysed using a classical test approach as well as item response theory. Cronbach's α was calculated and the item to total correlation of each item was assessed. After testing for unidimensionality and absence of local dependence, a 2 parameter logistic Semajima's graded response model was fit and item characteristics assessed. Results Competence, assurance of treatment, respect for the physician and loyalty to the physician were important dimensions of trust. A total of 31 items were developed using these dimensions. Of these, 22 were selected for final analysis. The Cronbach's α was 0.928. The item to total correlations were acceptable for all the 22 items. The item response analysis revealed good item characteristic curves and item information for all the items. Based on the item parameters and item information, a final 12 item scale was developed. The scale performs optimally in the low to moderate trust range. Conclusions The final 12 item trust in physician scale has a good construct validity and internal consistency. PMID:25941182
Pathways of Influence: Chinese Parents' Expectations, Parenting Styles, and Child Social Competence
ERIC Educational Resources Information Center
Ren, Lixin; Edwards, Carolyn Pope
2015-01-01
This study examines relations among Chinese parents' expectations for children's development of social-emotional skills, parenting styles, and child social competence. A total of 154 parents with preschool-aged children from mainland China completed questionnaires measuring their timing of expectations for children's mastery of social-emotional…
Behar-Horenstein, Linda S; Garvan, Cyndi W; Moore, Thomas E; Catalanotto, Frank A
2013-08-01
Valid and reliable instruments to measure and assess cultural competence for oral health care providers are scarce in the literature, and most published scales have been contested due to a lack of item analysis and internal estimates of reliability. The purposes of this study were, first, to develop a standardized instrument to measure dental students' knowledge of diversity, skills in culturally competent patient-centered communication, and use of culture-centered practices in patient care and, second, to provide preliminary validity support for this instrument. The initial instrument used in this study was a thirty-six-item Likert-scale survey entitled the Knowledge, Efficacy, and Practices Instrument for Oral Health Providers (KEPI-OHP). This instrument is an adaption of an initially thirty-three-item version of the Multicultural Awareness, Knowledge, and Skills Scale-Counselor Edition (MAKSS-CE), a scale that assesses factors related to social justice, cultural differences among clients, and cross-cultural client management. After the authors conducted cognitive and expert interviews, focus groups, pilot testing, and item analysis, their initial instrument was reduced to twenty-eight items. The KEPI-OHP was then distributed to 916 dental students (response rate=48.6 percent) across the United States to measure its reliability and assess its validity. Both exploratory and confirmatory factor analyses were conducted to test the scale's validity. The modification of the survey into a sensible instrument with a relatively clear factor structure using factor analysis resulted in twenty items. A scree test suggested three expressive factors, which were retained for rotation. Bentler's comparative fit and Bentler and Bonnett's non-normed indices were 0.95 and 0.92, respectively. A three-factor solution, including efficacy of assessment, knowledge of diversity, and culture-centered practice subscales, comprised of twenty-items was identified. The KEPI-OHP was found to have reasonable internal consistency reliability to warrant its use for baseline and repeated measures in assessing changes in dental students' growth in cultural competence across four-year dental curricula.
ERIC Educational Resources Information Center
Lu, Junfei; Woo, Hongryun
2017-01-01
In this study, 74 master's-level counseling students from various programs completed a questionnaire inquiring about their perceived program environment in relation to the topics of spirituality and religion (S/R), program emphasis on nine specific S/R competencies, as well as their outcome expectations toward being S/R competent through training.…
Defining a Leader Role curriculum for radiation oncology: A global Delphi consensus study.
Turner, Sandra; Seel, Matthew; Trotter, Theresa; Giuliani, Meredith; Benstead, Kim; Eriksen, Jesper G; Poortmans, Philip; Verfaillie, Christine; Westerveld, Henrike; Cross, Shamira; Chan, Ming-Ka; Shaw, Timothy
2017-05-01
The need for radiation oncologists and other radiation oncology (RO) professionals to lead quality improvement activities and contribute to shaping the future of our specialty is self-evident. Leadership knowledge, skills and behaviours, like other competencies, can be learned (Blumenthal et al., 2012). The objective of this study was to define a globally applicable competency set specific to radiation oncology for the CanMEDS Leader Role (Frank et al., 2015). A modified Delphi consensus process delivering two rounds of on-line surveys was used. Participants included trainees, radiation/clinical oncologists and other RO team members (radiation therapists, physicists, and nurses), professional educators and patients. 72 of 95 (76%) invitees from nine countries completed the Round 1 (R1) survey. Of the 72 respondents to RI, 70 completed Round 2 (R2) (97%). In R1, 35 items were deemed for 'inclusion' and 21 for 'exclusion', leaving 41 'undetermined'. After review of items, informed by participant comments, 14 competencies from the 'inclusion' group went into the final curriculum; 12 from the 'undetermined' group went to R2. In R2, 6 items reached consensus for inclusion. This process resulted in 20 RO Leader Role competencies with apparent global applicability. This is the first step towards developing learning, teaching and assessment tools for this important area of training. Copyright © 2017 Elsevier B.V. All rights reserved.
Moskoei, Sara; Mohtashami, Jamileh; Ghalenoeei, Mahdie; Nasiri, Maliheh; Tafreshi, Mansoreh Zaghari
2017-01-01
Introduction Evaluation of clinical competency in nurses has a distinct importance in healthcare due to its significant impact on improving the quality of patient care and creation of opportunities for professional promotion. This is a psychometric study for development of the “Clinical Competency of Mental Health Nursing”(CCMHN) rating scale. Methods In this methodological research that was conducted in 2015, in Tehran, Iran, the main items were developed after literature review and the validity and reliability of the tool were identified. The face, content (content validity ratio and content validity index) and construct validities were calculated. For face and content validity, experts’ comments were used. Exploratory factor analysis was used to determine the construct validity. The reliability of scale was determined by the internal consistency and inter-rater correlation. The collected data were analyzed by SPSS version 16, using descriptive statistical analysis. Results A scale with 45 items in two parts including Emotional/Moral and Specific Care competencies was developed. Content validity ratio and content validity index were 0.88, 0.97 respectively. Exploratory factor analysis indicated two factors: The first factor with 23.93 eigenvalue and second factor with eigenvalue 2.58. Cronbach’s alpha coefficient for determination of internal consistency was 0.98 and the ICC for confirmation inter-rater correlation was 0.98. Conclusion A scale with 45 items and two areas was developed with appropriate validity and reliability. This scale can be used to assess the clinical competency in nursing students and mental health nurses. PMID:28607650
Web-based education in systems-based practice: a randomized trial.
Kerfoot, B Price; Conlin, Paul R; Travison, Thomas; McMahon, Graham T
2007-02-26
All accredited US residency programs are expected to offer curricula and evaluate their residents in 6 general competencies. Medical schools are now adopting similar competency frameworks. We investigated whether a Web-based program could effectively teach and assess elements of systems-based practice. We enrolled 276 medical students and 417 residents in the fields of surgery, medicine, obstetrics-gynecology, and emergency medicine in a 9-week randomized, controlled, crossover educational trial. Participants were asked to sequentially complete validated Web-based modules on patient safety and the US health care system. The primary outcome measure was performance on a 26-item validated online test administered before, between, and after the participants completed the modules. Six hundred forty (92.4%) of the 693 enrollees participated in the study; 512 (80.0%) of the participants completed all 3 tests. Participants' test scores improved significantly after completion of the first module (P<.001). Overall learning from the 9-week Web-based program, as measured by the increase in scores (posttest scores minus pretest scores), was 16 percentage points (95% confidence interval, 14-17 percentage points; P<.001) in public safety topics and 22 percentage points (95% confidence interval, 20-23 percentage points; P<.001) in US health care system topics. A Web-based educational program on systems-based practice competencies generated significant and durable learning across a broad range of medical students and residents.
Grant, Estée C; Grant, Vincent J; Bhanji, Farhan; Duff, Jonathan P; Cheng, Adam; Lockyer, Jocelyn M
2012-07-01
It is critical that competency in pediatric resuscitation is achieved and assessed during residency or post graduate medical training. The purpose of this study was to create and evaluate a tool to measure all elements of pediatric resuscitation team leadership competence. An initial set of items, derived from a literature review and a brainstorming session, were refined to a 26 item assessment tool through the use of Delphi methodology. The tool was tested using videos of standardized resuscitations. A psychometric assessment of the evidence for instrument validity and reliability was undertaken. The performance of 30 residents on two videotaped scenarios was assessed by 4 pediatricians using the tool, with 12 items assessing 'leadership and communication skills' (LCS) and 14 items assessing 'knowledge and clinical skills' (KCS). The instrument showed evidence of reliability; the Cronbach's alpha and generalizability co-efficients for the overall instrument were α=0.818 and Ep(2)=0.76, for LCS were α=0.827 and Ep(2)=0.844, and for KCS were α=0.673 and Ep(2)=0.482. While validity was initially established through literature review and brainstorming by the panel of experts, it was further built through the high strength of correlation between global scores and scores for overall performance (r=0.733), LCS (r=0.718) and KCS (r=0.662) as well as the factor analysis which accounted for 40.2% of the variance. The results of the study demonstrate that the instrument is a valid and reliable tool to evaluate pediatric resuscitation team leader competence. Copyright © 2012 Elsevier Ireland Ltd. All rights reserved.
ERIC Educational Resources Information Center
Garrido, Mariquita; Payne, David A.
Minimum competency cut-off scores on a statistics exam were estimated under four conditions: the Angoff judging method with item data (n=20), and without data available (n=19); and the Modified Angoff method with (n=19), and without (n=19) item data available to judges. The Angoff method required free response percentage estimates (0-100) percent,…
Bachmann, Justin M.; Goggins, Kathryn M.; Nwosu, Samuel K.; Schildcrout, Jonathan S.; Kripalani, Sunil; Wallston, Kenneth A.
2017-01-01
Objective Evaluate the effect of perceived health competence, a patient’s belief in his or her ability to achieve health-related goals, on health behavior and health-related quality of life. Methods We analyzed 2063 patients hospitalized with acute coronary syndrome and/or congestive heart failure at a large academic hospital in the United States. Multivariable linear regression models investigated associations between the two-item perceived health competence scale (PHCS-2) and positive health behaviors such as medication adherence and exercise (Health Behavior Index) as well as health-related quality of life (5-item Patient Reported Outcome Information Measurement System Global Health Scale). Results After multivariable adjustment, perceived health competence was highly associated with health behaviors (p<0.001) and health-related quality of life (p<0.001). Low perceived health competence was associated with a decrease in health-related quality of life between hospitalization and 90 days after discharge (p<0.001). Conclusions Perceived health competence predicts health behavior and health-related quality of life in patients hospitalized with cardiovascular disease as well as change in health-related quality of life after discharge. Practice implications Patients with low perceived health competence may be at risk for a decline in health-related quality of life after hospitalization and thus a potential target for counseling and other behavioral interventions. PMID:27450479
Bachmann, Justin M; Goggins, Kathryn M; Nwosu, Samuel K; Schildcrout, Jonathan S; Kripalani, Sunil; Wallston, Kenneth A
2016-12-01
Evaluate the effect of perceived health competence, a patient's belief in his or her ability to achieve health-related goals, on health behavior and health-related quality of life. We analyzed 2063 patients hospitalized with acute coronary syndrome and/or congestive heart failure at a large academic hospital in the United States. Multivariable linear regression models investigated associations between the two-item perceived health competence scale (PHCS-2) and positive health behaviors such as medication adherence and exercise (Health Behavior Index) as well as health-related quality of life (5-item Patient Reported Outcome Information Measurement System Global Health Scale). After multivariable adjustment, perceived health competence was highly associated with health behaviors (p<0.001) and health-related quality of life (p<0.001). Low perceived health competence was associated with a decrease in health-related quality of life between hospitalization and 90days after discharge (p<0.001). Perceived health competence predicts health behavior and health-related quality of life in patients hospitalized with cardiovascular disease as well as change in health-related quality of life after discharge. Patients with low perceived health competence may be at risk for a decline in health-related quality of life after hospitalization and thus a potential target for counseling and other behavioral interventions. Copyright © 2016 Elsevier Ireland Ltd. All rights reserved.
Yang, Fang Yu; Zhao, Rong Rong; Liu, Yi Si; Wu, Ying; Jin, Ning Ning; Li, Rui Ying; Shi, Shu Ping; Shao, Yue Ying; Guo, Ming; Arthur, David; Elliott, Malcolm
2013-12-01
A review of the literature showed that the core competencies needed by newly graduated Chinese nurses were not as of yet undocumented. To develop a psychometrically sound instrument for identifying and measuring the core competencies needed by Chinese nursing baccalaureate graduates. Descriptive correlational and multicentre study. Seven major tertiary teaching hospitals and three major medical universities in Beijing. 790 subjects, including patients, nursing faculty members, doctors and nurses. A reliable and valid self-report instrument, consisting of 58 items, was developed using multiple methods. It was then distributed to 790 subjects to measure nursing competency in a broader Chinese context. The psychometric characteristics of reliability and validity were supported by descriptive and inferential analyses. The final instrument consists of six dimensions with 47 items. The content validity index was 0.90. The overall scale reliability was 0.97 with dimensions range from 0.87 to 0.94. Six domains of core competencies were identified: professionalism; direct care; support and communication; application of professional knowledge; personal traits; and critical thinking and innovation. The findings of this study provide valuable evidence for a psychometrically sound measurement tool, as well as for competency-based nursing curriculum reform. Copyright © 2013 Elsevier Ltd. All rights reserved.
Selecting Items for Criterion-Referenced Tests.
ERIC Educational Resources Information Center
Mellenbergh, Gideon J.; van der Linden, Wim J.
1982-01-01
Three item selection methods for criterion-referenced tests are examined: the classical theory of item difficulty and item-test correlation; the latent trait theory of item characteristic curves; and a decision-theoretic approach for optimal item selection. Item contribution to the standardized expected utility of mastery testing is discussed. (CM)
Differential item functioning magnitude and impact measures from item response theory models.
Kleinman, Marjorie; Teresi, Jeanne A
2016-01-01
Measures of magnitude and impact of differential item functioning (DIF) at the item and scale level, respectively are presented and reviewed in this paper. Most measures are based on item response theory models. Magnitude refers to item level effect sizes, whereas impact refers to differences between groups at the scale score level. Reviewed are magnitude measures based on group differences in the expected item scores and impact measures based on differences in the expected scale scores. The similarities among these indices are demonstrated. Various software packages are described that provide magnitude and impact measures, and new software presented that computes all of the available statistics conveniently in one program with explanations of their relationships to one another.
West, Courtney; Landry, Karen; Graham, Anna; Graham, Lori; Cianciolo, Anna T; Kalet, Adina; Rosen, Michael; Sherman, Deborah Witt
2015-01-01
SGEA 2015 CONFERENCE ABSTRACT (EDITED). Evaluating Interprofessional Teamwork During a Large-Scale Simulation. Courtney West, Karen Landry, Anna Graham, and Lori Graham. CONSTRUCT: This study investigated the multidimensional measurement of interprofessional (IPE) teamwork as part of large-scale simulation training. Healthcare team function has a direct impact on patient safety and quality of care. However, IPE team training has not been the norm. Recognizing the importance of developing team-based collaborative care, our College of Nursing implemented an IPE simulation activity called Disaster Day and invited other professions to participate. The exercise consists of two sessions: one in the morning and another in the afternoon. The disaster scenario is announced just prior to each session, which consists of team building, a 90-minute simulation, and debriefing. Approximately 300 Nursing, Medicine, Pharmacy, Emergency Medical Technicians, and Radiology students and over 500 standardized and volunteer patients participated in the Disaster Day event. To improve student learning outcomes, we created 3 competency-based instruments to evaluate collaborative practice in multidimensional fashion during this exercise. A 20-item IPE Team Observation Instrument designed to assess interprofessional team's attainment of Interprofessional Education Collaborative (IPEC) competencies was completed by 20 faculty and staff observing the Disaster Day simulation. One hundred sixty-six standardized patients completed a 10-item Standardized Patient IPE Team Evaluation Instrument developed from the IPEC competencies and adapted items from the 2014 Henry et al. PIVOT Questionnaire. This instrument assessed the standardized or volunteer patient's perception of the team's collaborative performance. A 29-item IPE Team's Perception of Collaborative Care Questionnaire, also created from the IPEC competencies and divided into 5 categories of Values/Ethics, Roles and Responsibilities, Communication, Teamwork, and Self-Evaluation, was completed by 188 students including 99 from Nursing, 43 from Medicine, 6 from Pharmacy, and 40 participants who belonged to more than one component, were students at another institution, or did not indicate their institution. The team instrument was designed to assess each team member's perception of how well the team and him- or herself met the competencies. Five of the items on the team perceptions questionnaire mirrored items on the standardized patient evaluation: demonstrated leadership practices that led to effective teamwork, discussed care and decisions about that care with patient, described roles and responsibilities clearly, worked well together to coordinate care, and good/effective communication. Internal consistency reliability of the IPE Team Observation Instrument was 0.80. In 18 of the 20 items, more than 50% of observers indicated the item was demonstrated. Of those, 6 of the items were observed by 50% to 75% of the observers, and the remaining 12 were observed by more than 80% of the observers. Internal consistency reliability of the IPE Team's Perception of Collaborative Care Instrument was 0.95. The mean response score-1 (strongly disagree) to 4 (strongly agree)-was calculated for each section of the instrument. The overall mean score was 3.57 (SD = .11). Internal consistency reliability of the Standardized Patient IPE Team Evaluation Instrument was 0.87. The overall mean score was 3.28 (SD = .17). The ratings for the 5 items shared by the standardized patient and team perception instruments were compared using independent sample t tests. Statistically significant differences (p < .05) were present in each case, with the students rating themselves higher on average than the standardized patients did (mean differences between 0.2 and 0.6 on a scale of 1-4). Multidimensional, competency-based instruments appear to provide a robust view of IPE teamwork; however, challenges remain. Due to the large scale of the simulation exercise, observation-based assessment did not function as well as self- and standardized patient-based assessment. To promote greater variation in observer assessments during future Disaster Day simulations, we plan to adjust the rating scale from "not observed," "observed," and "not applicable" to a 4-point scale and reexamine interrater reliability.
Development of The Science Processes Test.
ERIC Educational Resources Information Center
Ludeman, Robert R.
Presented is a description and copy of a test manual developed to include items in the test on the basis of children's performance; each item correlated highly with performance on an external criterion. The external criterion was the Individual Competency Measures of the elementary science program Science - A Process Approach (SAPA). The test…
ERIC Educational Resources Information Center
Koen, Joshua D.; Aly, Mariam; Wang, Wei-Chun; Yonelinas, Andrew P.
2013-01-01
A prominent finding in recognition memory is that studied items are associated with more variability in memory strength than new items. Here, we test 3 competing theories for why this occurs--the "encoding variability," "attention failure", and "recollection" accounts. Distinguishing among these theories is critical…
ERIC Educational Resources Information Center
Shemick, John M.
1983-01-01
In a project to identify and verify professional competencies for beginning industrial education teachers, researchers found a 173-item questionnaire unwieldy. Using multiple-matrix sampling, they distributed subsets of items to respondents, resulting in adequate returns as well as duplication, postage, and time savings. (SK)
Item Dependency in an Objective Structured Clinical Examination
ERIC Educational Resources Information Center
Iramaneerat, Cherdsak; Myford, Carol M.; Yudkowsky, Rachel
2006-01-01
An Objective Structured Clinical Examination (OSCE) is an assessment approach employed in medical education, in which residents rotate through multiple stations of standardized clinical tasks to evaluate their clinical competence. Because items used to evaluate residents' performance in each OSCE station are linked to the same task and are rated…
ERIC Educational Resources Information Center
Kundu, Madan M.; Dutta, Alo; Chan, Fong; Torres, Viviana; Fleming, Kayla
2011-01-01
Purpose: To validate an 80-item self-report measure, A Systems Approach to Placement: Self-Assessment for Students and Counselors (SAP-SASC), designed to identify critical areas of knowledge, skills, and competencies possessed by rehabilitation counselors in state vocational rehabilitation (VR) agency settings. Participants: 275 rehabilitation…
State Minimum Competency Testing Programs. Resource Catalog. Final Report.
ERIC Educational Resources Information Center
Mills, Gladys H.
Focusing on state-mandated minimum competency testing programs, this annotated bibliography cites 200 items selected from more than 700. The Resource Catalog is intended for state education policy makers and therefore includes resource and study guides; legislative and board action; conference speeches, reports and proceedings; curriculum guides,…
Culturally Competent Services: Bibliography of Materials from the NCEMCH Library.
ERIC Educational Resources Information Center
National Center for Education in Maternal and Child Health, Arlington, VA.
Culled from the National Center for Education in Maternal and Child Health reference collection, this list contains 186 materials which focus on assessing current services for cultural sensitivity, developing culturally competent services, or providing services in a multicultural health care context. Audiovisual items are included. Each listing…
CASAS: An Effective Measurement System for Life Skills.
ERIC Educational Resources Information Center
Stiles, Richard L.; And Others
The California Adult Student Assessment System (CASAS) is a comprehensive educational system designed to enable adult educators to develop and evaluate a life skills curriculum for competency based educational programs. The system comprises the CASAS Competency List, the CASAS Item Bank, the User's Manual, the Curriculum Index and Matrix, and…
Review of Multidisciplinary Measures of Cultural Competence for Use in Social Work Education
ERIC Educational Resources Information Center
Krentzman, Amy R.; Townsend, Aloen L.
2008-01-01
This study reviews extant measures of cultural competence from many disciplines and evaluates their suitability for social work education based on 8 criteria: validity, reliability, relevance to social justice, item clarity, definition of diversity, coherence, social desirability, and appropriateness for social work. Nineteen instruments met…
Science Competencies That Go Unassessed
ERIC Educational Resources Information Center
Gilmer, Penny J.; Sherdan, Danielle M.; Oosterhof, Albert; Rohani, Faranak; Rouby, Aaron
2011-01-01
Present large-scale assessments require the use of item formats, such as multiple choice, that can be administered and scored efficiently. This limits competencies that can be measured by these assessments. An alternative approach to large-scale assessments is being investigated that would include the use of complex performance assessments. As…
Psychiatry Resident Training in Cultural Competence: An Educator's Toolkit.
Corral, Irma; Johnson, Toni L; Shelton, Pheston G; Glass, Oliver
2017-06-01
Resident physicians training in psychiatry in the U.S. are required to master a body of knowledge related to cultural psychiatry; are expected to adopt attitudes that endorse the principles of cultural competence; and finally are expected to acquire specific cultural competence skills that facilitate working effectively with diverse patients. This article first provides an overview of the Accreditation Council for Graduate Medical Education (ACGME) competencies related to cultural competence, as well as the American Academy of Child and Adolescent Psychiatry's (AACAP) recommendations for the cultural competence training of child/adolescent fellows. Next, numerous print and electronic resources that can be used in cultural competence education in psychiatry are reviewed and discussed. Finally, we conclude by providing recommendations for psychiatry residency programs that we culled from model cultural competence curricula.
Boyle, M; Butcher, R; Kenney, C
1998-03-01
Intensive care orientation programs have become an accepted component of intensive care education. To date, however, there have been no Australian-based standards defining the appropriate level of competence to be attained upon completion of orientation. The aim of this study was to validate a set of aims, competencies and educational objectives that could form the basis of intensive care orientation and which would ensure an outcome standard of safe and effective practice. An initial document containing a statement of the desired outcome goal, six competency statements and 182 educational objectives was developed through a review of the orientation programs developed by the investigators. The Delphi technique was used to gain consensus among 13 nurses recognised for their expertise in intensive care education. The expert group rated the acceptability of each of the study items and provided suggestions for objectives to be included. An approval rating of 80 per cent was required to retain each of the study items, with the document refined through three Delphi rounds. The final document contains a validated statement of outcome goal, competencies and educational objectives for intensive care orientation programs.
Can Hospital Cultural Competency Reduce Disparities in Patient Experiences with Care?
Weech-Maldonado, Robert; Elliott, Marc N.; Pradhan, Rohit; Schiller, Cameron; Hall, Allyson; Hays, Ron D.
2013-01-01
Background Cultural competency has been espoused as an organizational strategy to reduce health disparities in care. Objective To examine the relationship between hospital cultural competency and inpatient experiences with care. Research Design The first model predicted Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) scores from hospital random effects, plus fixed effects for hospital cultural competency, individual race/ethnicity/language, and case-mix variables. The second model tested if the association between a hospital’s cultural competency and HCAHPS scores differed for minority and non-Hispanic white patients. Subjects The National CAHPS® Benchmarking Database’s (NCBD) HCAHPS Surveys and the Cultural Competency Assessment Tool of Hospitals (CCATH) Surveys for California hospitals were merged, resulting in 66 hospitals and 19,583 HCAHPS respondents in 2006. Measures Dependent variables include ten HCAHPS measures: six composites (communication with doctors, communication with nurses, staff responsiveness, pain control, communication about medications, and discharge information), two individual items (cleanliness, and quietness of patient rooms), and two global items (overall hospital rating, and whether patient would recommend hospital). Results Hospitals with greater cultural competency have better HCAHPS scores for doctor communication, hospital rating, and hospital recommendation. Furthermore, HCAHPS scores for minorities were higher at hospitals with greater cultural competency on four other dimensions: nurse communication, staff responsiveness, quiet room, and pain control. Conclusions Greater hospital cultural competency may improve overall patient experiences, but may particularly benefit minorities in their interactions with nurses and hospital staff. Such effort may not only serve longstanding goals of reducing racial/ethnic disparities in inpatient experience, but may also contribute to general quality improvement. PMID:23064277
Krall, Jodi Stotts; Lohse, Barbara
2010-01-01
Examine the validity of a self-report measure of eating competence with low-income women. Twenty-five females (18-49 years old) recruited from low-income venues in Pennsylvania completed cognitive testing through an iterative interview process. Respondents' oral responses were compared to researchers' intended meaning of ecSatter Inventory (ecSI) items; responses were mapped to evaluate the similarity between respondents' internally generated answers and their ecSI choices for survey items; and scored responses were compared among participants. Interview findings provided a rationale for modifying the ecSI prior to use with low-income women. Four items were misinterpreted for various reasons, including problems with clarity and wording. The modified ecSI, termed the ecSatter Inventory for Low-Income (ecSI/LI), was comprehended as intended by researchers. Congruence of cognitive responses and ecS/LI scores further supported the instrument's validity. Cognitive testing resulted in the development of an instrument to measure eating competence in low-income adults. The ecSI/LI requires validation with a large, heterogeneous low-income sample. Copyright 2010 Society for Nutrition Education. Published by Elsevier Inc. All rights reserved.
A study of Korean students' creativity in science using structural equation modeling
NASA Astrophysics Data System (ADS)
Jo, Son Mi
Through the review of creativity research I have found that studies lack certain crucial parts: (a) a theoretical framework for the study of creativity in science, (b) studies considering the unique components related to scientific creativity, and (c) studies of the interactions among key components through simultaneous analyses. The primary purpose of this study is to explore the dynamic interactions among four components (scientific proficiency, intrinsic motivation, creative competence, context supporting creativity) related to scientific creativity under the framework of scientific creativity. A total of 295 Korean middle school students participated. Well-known and commonly used measurements were selected and developed. Two scientific achievement scores and one score measured by performance-based assessment were used to measure student scientific knowledge/inquiry skills. Six items selected from the study of Lederman, Abd-El-Khalick, Bell, and Schwartz (2002) were used to assess how well students understand the nature of science. Five items were selected from the subscale of the scientific attitude inventory version II (Moore & Foy, 1997) to assess student attitude toward science. The Test of Creative Thinking-Drawing Production (Urban & Jellen, 1996) was used to measure creative competence. Eight items chosen from the 15 items of the Work Preference Inventory (1994) were applied to measure students' intrinsic motivation. To assess the level of context supporting creativity, eight items were adapted from measurement of the work environment (Amabile, Conti, Coon, Lazenby, and Herron, 1996). To assess scientific creativity, one open-ended science problem was used and three raters rated the level of scientific creativity through the Consensual Assessment Technique (Amabile, 1996). The results show that scientific proficiency and creative competence correlates with scientific creativity. Intrinsic motivation and context components do not predict scientific creativity. The strength of relationships between scientific proficiency and scientific creativity (estimate parameter=0.43) and creative competence and scientific creativity (estimate parameter=0.17) are similar [chi2.05(1)=0.670, P>.05]. In specific analysis of structural model, I found that creative competence and scientific proficiency play a role of partial mediators among three components (general creativity, scientific proficiency, and scientific creativity). The moderate effects of intrinsic motivation and context component were investigated, but the moderation effects were not found.
Development of the outcome expectancy scale for self-care among periodontal disease patients.
Kakudate, Naoki; Morita, Manabu; Fukuhara, Shunichi; Sugai, Makoto; Nagayama, Masato; Isogai, Emiko; Kawanami, Masamitsu; Chiba, Itsuo
2011-12-01
The theory of self-efficacy states that specific efficacy expectations affect behaviour. Two types of efficacy expectations are described within the theory. Self-efficacy expectations are the beliefs in the capacity to perform a specific behaviour. Outcome expectations are the beliefs that carrying out a specific behaviour will lead to a desired outcome. To develop and examine the reliability and validity of an outcome expectancy scale for self-care (OESS) among periodontal disease patients. A 34-item scale was tested on 101 patients at a dental clinic. Accuracy was improved by item analysis, and internal consistency and test-retest stability were investigated. Concurrent validity was tested by examining associations of the OESS score with the self-efficacy scale for self-care (SESS) score and plaque index score. Construct validity was examined by comparing OESS scores between periodontal patients at initial visit (group 1) and those continuing maintenance care (group 2). Item analysis identified 13 items for the OESS. Factor analysis extracted three factors: social-, oral- and self-evaluative outcome expectancy. Cronbach's alpha coefficient for the OESS was 0.90. A significant association was observed between test and retest scores, and between the OESS and SESS and plaque index scores. Further, group 2 had a significantly higher mean OESS score than group 1. We developed a 13-item OESS with high reliability and validity which may be used to assess outcome expectancy for self-care. A patient's psychological condition with regard to behaviour and affective status can be accurately evaluated using the OESS with SESS. © 2011 Blackwell Publishing Ltd.
Health education and competency scale: Development and testing.
Hwang, Huei-Lih; Kuo, Mei-Ling; Tu, Chin-Tang
2018-02-01
To develop a tool for measuring competency in conducting health education and to evaluate its psychometric properties in a population of entry-level nurses. Until now, no generic instrument has been developed specifically for measuring competency in health education, which is an essential competency for nurses. Existing scales are either insufficient for psychometric evaluation or are designed specifically for senior nurses. To evaluate curricula and courses designed for entry-level nurses, educators require an instrument for measuring improvement in core competency from baseline to determine whether the minimum level of ability has been achieved. Item development for the survey instrument used for data collection in this study was based on the results of a literature review. The self-evaluated Health Education Competency Scale developed in this study was used to survey 457 nursing students at two nursing schools and 165 clinical nurses at a medical centre in south Taiwan in 2016. The participants were randomly divided into two equal groups. One group was analysed by exploratory factor analysis with varimax rotation, and one group was analysed by confirmatory factor analysis. Factor analysis yielded a four-factor (assessment, pedagogy, motivation and empowerment) solution (18 items) that accounted for 75.9% of the variance. The total scale and subscales had good reliabilities and construct validity coefficients. For measuring competency in entry-level nurses, the Health Education Competency Scale had a good data fit and sound psychometric properties. The proposed scale can be used to assess health education competency for college nursing students and practising nurses. Furthermore, it can provide educators with valuable insight into the minimum competencies required for entry-level nurses to deliver quality health care to clients and can guide them in the practice of client-based teaching. © 2017 John Wiley & Sons Ltd.
Motherhood: a potential source of bias in employment decisions.
Heilman, Madeline E; Okimoto, Tyler G
2008-01-01
Results of 2 experimental studies in which job incumbents were said to be applying for promotions to traditionally male positions demonstrated bias against mothers in competence expectations and in screening recommendations. This bias occurred regardless of whether the research participants were students (Study 1) or working people (Study 2). Although anticipated job commitment, achievement striving, and dependability were rated as generally lower for parents than for nonparents, anticipated competence was uniquely low for mothers. Mediational analyses indicated that, as predicted, negativity in competence expectations, not anticipated job commitment or achievement striving, promoted the motherhood bias in screening recommendations; expected deficits in agentic behaviors, not in dependability, were found to fuel these competence expectations. These findings suggest that motherhood can indeed hinder the career advancement of women and that it is the heightened association with gender stereotypes that occurs when women are mothers that is the source of motherhood's potentially adverse consequences. 2008 APA
Identifying predictors of physics item difficulty: A linear regression approach
NASA Astrophysics Data System (ADS)
Mesic, Vanes; Muratovic, Hasnija
2011-06-01
Large-scale assessments of student achievement in physics are often approached with an intention to discriminate students based on the attained level of their physics competencies. Therefore, for purposes of test design, it is important that items display an acceptable discriminatory behavior. To that end, it is recommended to avoid extraordinary difficult and very easy items. Knowing the factors that influence physics item difficulty makes it possible to model the item difficulty even before the first pilot study is conducted. Thus, by identifying predictors of physics item difficulty, we can improve the test-design process. Furthermore, we get additional qualitative feedback regarding the basic aspects of student cognitive achievement in physics that are directly responsible for the obtained, quantitative test results. In this study, we conducted a secondary analysis of data that came from two large-scale assessments of student physics achievement at the end of compulsory education in Bosnia and Herzegovina. Foremost, we explored the concept of “physics competence” and performed a content analysis of 123 physics items that were included within the above-mentioned assessments. Thereafter, an item database was created. Items were described by variables which reflect some basic cognitive aspects of physics competence. For each of the assessments, Rasch item difficulties were calculated in separate analyses. In order to make the item difficulties from different assessments comparable, a virtual test equating procedure had to be implemented. Finally, a regression model of physics item difficulty was created. It has been shown that 61.2% of item difficulty variance can be explained by factors which reflect the automaticity, complexity, and modality of the knowledge structure that is relevant for generating the most probable correct solution, as well as by the divergence of required thinking and interference effects between intuitive and formal physics knowledge structures. Identified predictors point out the fundamental cognitive dimensions of student physics achievement at the end of compulsory education in Bosnia and Herzegovina, whose level of development influenced the test results within the conducted assessments.
ERIC Educational Resources Information Center
Kruger, Cornè Gerda; Van Rensburg, Ona Janse; De Witt, Marike W.
2016-01-01
Meeting teacher expectations for a professional development programme (PDP) is expected to strengthen sustainable applied competence as programme outcome since teachers will be more motivated to apply the programme content in practice. A revised distance learning (DL) programme was augmented by a practical component comprising a work-integrated…
Rudaś, Dariusz; Skórczewski, Krzysztof
2011-01-01
The restructuring of the State Sanitary Inspectorate was determined by the need to adjust the existing system to the new structure- and task-oriented standards introduced by the administrative reforms at the provincial level. This brought about a lot of changes in the way State County Sanitary Inspectors operate. For first few months after the enforcement of the Act of January 23.2009 amending certain acts regarding reorganization and redistribution of competences of the public administration at the provincial level (Journal of Laws, No. 92, item. 753, 2009) brought about a lot of ambiguities and expectations. Such unresolved issues are typical for the initial or transition period after implementation of a new law. The approach to the operation of the State Sanitary Inspectorate at the county level depicted in the article lays the emphasis on the challenges in the legal and task-oriented domain that arose after coming into force of the aforementioned amendment. By way of conclusion, the authors of the article briefly summaries the practical outcomes of the transformations undergone by the State Sanitary Inspectorate at the county level.
Identifying gaps between current and expected ICT competencies of nurses in Serbia.
Paunic, Sanja; Stojkovic, Ivana
2014-01-01
Introducing of ICT in the health care system in Serbia started 19 years ago and systematic training of nurses and technicians has not been realized yet. The primary objective of this paper is to determine the gap between the sets of ICT competencies of nurses and technicians acquiring education and experience and the necessary skill set required for their daily work. The qualitative research included questioning of the focus group of experts and 400 nurses and technicians employed in secondary and tertiary health institutions in Serbia. Based on the analysis of existing literature we choose the Informatics competencies for nurses at four levels of practice (Staggers, Gassert, Curran, 2001), and for the purposes of this study, we used a list of competencies of the first, and partially of the second and third level. At the start, the group of 12 experts had the task to eliminate some of listed competencies to express the subjective expectations of the ICT competencies of nurses. After that nurses and medical technicians were expected to grade, by Likert scale, their level of knowledge and skills for each of the 39 competencies, respectively. The answers were analyzed using measure of central tendency and distribution of results was done by median. Comparison of perceived competence of the nurses and the desired/expected level by managers shows that there is difference in 25 of the 39 offered statements. Managers expect that nurses are great users of administrative applications for staff scheduling and for maintaining employee records, while nurses declared that these programs they use relatively poorly or not at all. The larger gap is also observed when it comes to computer skill for documenting patient care--experts expect that nurses do it well, and nurses, again, estimate that their documentation skills are relatively poor. The same situation is with use of ICT for patient education. It can be concluded that further training is required in the field of ICT, either through additional training in the workplace, either through formal education. Due to the fact that ICT competencies are becoming part of the basic, functional sets, it should be considered the correction of curricula of secondary schools for nurses.
ERIC Educational Resources Information Center
Goddard, Roger D.; LoGerfo, Laura F.
2007-01-01
This article presents a theoretical rationale and empirical evidence regarding the validity of scores obtained from two competing approaches to operationalizing scale items to measure emergent organizational properties. The authors consider whether items in scales intended to measure organizational properties should prompt survey takers to provide…
Food and Nutrition (Intermediate). Performance Objectives and Criterion-Referenced Test Items.
ERIC Educational Resources Information Center
Missouri Univ., Columbia. Instructional Materials Lab.
This document contains competencies and criterion-referenced test items for the Intermediate Food and Nutrition semester course in Missouri that were derived from the duties and tasks of the Missouri homemaker and identified and validated by home economics teachers and subject matter specialists. The guide is designed to assist home economics…
Identifying Predictors of Physics Item Difficulty: A Linear Regression Approach
ERIC Educational Resources Information Center
Mesic, Vanes; Muratovic, Hasnija
2011-01-01
Large-scale assessments of student achievement in physics are often approached with an intention to discriminate students based on the attained level of their physics competencies. Therefore, for purposes of test design, it is important that items display an acceptable discriminatory behavior. To that end, it is recommended to avoid extraordinary…
Criterion-Referenced Test (CRT) Items for Building Trades.
ERIC Educational Resources Information Center
Davis, Diane, Ed.
This test item bank is intended to help instructors construct criterion-referenced tests for secondary-level courses in building trades. The bank is keyed to the Missouri Building Trades Competency Profile, which was developed by industry and education professionals in Missouri, and is designed to be used in conjunction with the Vocational…
Examining Student Heuristic Usage in a Hydrogen Bonding Assessment
ERIC Educational Resources Information Center
Miller, Kathryn; Kim, Thomas
2017-01-01
This study investigates the role of representational competence in student responses to an assessment of hydrogen bonding. The assessment couples the use of a multiple-select item ("Choose all that apply") with an open-ended item to allow for an examination of students' cognitive processes as they relate to the assignment of hydrogen…
Calibrating Item Families and Summarizing the Results Using Family Expected Response Functions
ERIC Educational Resources Information Center
Sinharay, Sandip; Johnson, Matthew S.; Williamson, David M.
2003-01-01
Item families, which are groups of related items, are becoming increasingly popular in complex educational assessments. For example, in automatic item generation (AIG) systems, a test may consist of multiple items generated from each of a number of item models. Item calibration or scoring for such an assessment requires fitting models that can…
A Model and Measure of Mobile Communication Competence
ERIC Educational Resources Information Center
Bakke, Emil
2010-01-01
This article deals with two studies that develop a measure and model of mobile communication competence (MCC). The first study examines the dimensionality of the measure by conducting an exploratory factor analysis on 350 students at a large university in the midwestern United States. Results identified six constructs across 24 items: willingness…
ERIC Educational Resources Information Center
Morris, Annie; Lafontaine, Marc; Pichette, François; de Serres, Linda
2013-01-01
This study investigated the relationships between various affective variables and two measures of competence in English, for 190 South Korean high school students. A 55-item questionnaire was used to measure attitudes (Attitudes toward English Speakers and their Communities and Attitudes toward the English-speaking Culture), motivation…
2014-07-01
item measure as a measure of children’s interpersonal competence and social adjustment in the classroom . Preschool Social Competence Scale...Assessment System for Children (BASC) ADHD Monitor. Circle Pines, MN: American Guidance Service. Keane, T., Fairbank, J., Caddell, J., Zimering, R
Ohio Marketing Management and Research. Technical Competency Profile (TCP).
ERIC Educational Resources Information Center
Ray, Gayl M.; Wilson, Nick; Mangini, Rick
This document provides a framework for a broad-based secondary and postsecondary curriculum to prepare students for employment in marketing management and research (MMR). The first part of the technical competency profile (TCP) contains the following items: an explanation of the purpose and scope of Ohio's TCPs; college tech prep program…
Ohio Medical Office Management. Technical Competency Profile (TCP).
ERIC Educational Resources Information Center
Ray, Gayl M.; Wilson, Nick; Mangini, Rick
This document provides a framework for a broad-based secondary and postsecondary curriculum to prepare students for employment in medical office management. The first part of the technical competency profile (TCP) contains the following items: an explanation of the purpose and scope of Ohio's TCPs; college tech prep program standards; an overview…
ERIC Educational Resources Information Center
Wang, Ning; Young, Thomas; Wilhite, Stephen C.; Marczyk, Geoffrey
2011-01-01
This article reports the development and validation studies of the Widener Emotional Learning Scale (WELS), a self-report measure, for assessing students' social and emotional competence in higher education. Conceptual specifications, item development, psychometric properties, and factor structure of the instrument are reported in the article. The…
ERIC Educational Resources Information Center
Hukkelberg, Silje; Ogden, Terje
2016-01-01
The study investigated dimensionality in the Home and Community Social Behaviour Scales (HCSBS) that assess social competence (Peer Relations and Self-Management/Compliance) and antisocial behaviour (Defiant/Disruptive and Antisocial/Aggressive behaviour) in children and adolescents. The four scales comprising 64 items were completed by 551…
ERIC Educational Resources Information Center
Anthony, Christopher James; DiPerna, James Clyde
2017-01-01
The Academic Competence Evaluation Scales-Teacher Form (ACES-TF; DiPerna & Elliott, 2000) was developed to measure student academic skills and enablers (interpersonal skills, engagement, motivation, and study skills). Although ACES-TF scores have demonstrated psychometric adequacy, the length of the measure may be prohibitive for certain…
Self-assessed efficacy of a clinical musculoskeletal anatomy workshop: A preliminary survey.
Saavedra, Miguel Ángel; Navarro-Zarza, José E; Alvarez-Nemegyei, José; Canoso, Juan J; Kalish, Robert A; Villaseñor-Ovies, Pablo; Hernández-Díaz, Cristina
2015-01-01
To survey the efficacy of a practical workshop on clinical musculoskeletal anatomy held in five American countries. A self-assessment competence questionnaire sent to participants 1-3 months after the workshop. Results were compared to the results of a practical, instructor-assessed, pre-workshop test. The response rate of participants was 76.4%. The overall, self-assessed competence score for anatomical items that had been included in the pre-test was 76.9 (scale 0-100) as compared to an overall score of 48.1 in the practical, pre-workshop test (p<0.001). For items that were addressed in the workshop, but not included in the pre-test, self-assessed competence was rated at 62.9. Differences in anatomical knowledge between individuals from different countries and professional groups noted in the practical pre-test were no longer present in the post-test self-assessment. From this preliminary data and supporting evidence from the literature we believe that our anatomy workshop provides an effective didactic tool for increasing competence in musculoskeletal anatomy. Copyright © 2014 Elsevier España, S.L.U. All rights reserved.
Assessing children’s competence to consent in research by a standardized tool: a validity study
2012-01-01
Background Currently over 50% of drugs prescribed to children have not been evaluated properly for use in their age group. One key reason why children have been excluded from clinical trials is that they are not considered able to exercise meaningful autonomy over the decision to participate. Dutch law states that competence to consent can be presumed present at the age of 12 and above; however, in pediatric practice children’s competence is not that clearly presented and the transition from assent to active consent is gradual. A gold standard for competence assessment in children does not exist. In this article we describe a study protocol on the development of a standardized tool for assessing competence to consent in research in children and adolescents. Methods/design In this study we modified the MacCAT-CR, the best evaluated competence assessment tool for adults, for use in children and adolescents. We will administer the tool prospectively to a cohort of pediatric patients from 6 to18 years during the selection stages of ongoing clinical trials. The outcomes of the MacCAT-CR interviews will be compared to a reference standard, established by the judgments of clinical investigators, and an expert panel consisting of child psychiatrists, child psychologists and medical ethicists. The reliability, criterion-related validity and reproducibility of the tool will be determined. As MacCAT-CR is a multi-item scale consisting of 13 items, power was justified at 130–190 subjects, providing a minimum of 10–15 observations per item. MacCAT-CR outcomes will be correlated with age, life experience, IQ, ethnicity, socio-economic status and competence judgment of the parent(s). It is anticipated that 160 participants will be recruited over 2 years to complete enrollment. Discussion A validity study on an assessment tool of competence to consent is strongly needed in research practice, particularly in the child and adolescent population. In this study we will establish a reference standard of children’s competence to consent, combined with validation of an assessment instrument. Results can facilitate responsible involvement of children in clinical trials by further development of guidelines, health-care policies and legal policies. PMID:23009102
Psychometric Properties of a 36-Item Version of the “Stress Management Competency Indicator Tool”
Toderi, Stefano; Sarchielli, Guido
2016-01-01
The development of supervisors’ behaviours has been proposed as an innovative approach for the reduction of employees’ work stress. The UK Health and Safety Executive (HSE) developed the “Stress Management Competency Indicator Tool” (SMCIT), designed to be used within a learning and development intervention. However, its psychometric properties have never been evaluated, and the length of the questionnaire (66 items) limits its practical applicability. We developed a brief 36-item version of the questionnaire, assessed its psychometric properties and studied the relationship with the employees’ psychosocial work environment. 353 employees filled in the brief SMCIT and the “Stress Management Indicator Tool”. The latter is a self-report questionnaire developed by the UK HSE, measuring workers’ perceptions of seven dimensions of the psychosocial work environment that if not properly managed can lead to harm. Data were analysed with structural equation modelling and multiple regressions. The results confirmed the factorial structure of the brief SMCIT questionnaire and mainly supported the convergent validity and internal consistency of the scales. Furthermore, with few exceptions, the relations hypothesized between supervisors’ competencies and the psychosocial work environment were confirmed, supporting the criterion validity of the revised questionnaire and the UK HSE framework. We conclude that the brief 36-item version of the SMCIT represents an important step toward the development of interventions directed at supervisors and we discuss the practical implications for work stress prevention. PMID:27827940
Validity of portfolio assessment: which qualities determine ratings?
Driessen, Erik W; Overeem, Karlijn; van Tartwijk, Jan; van der Vleuten, Cees P M; Muijtjens, Arno M M
2006-09-01
The portfolio is becoming increasingly accepted as a valuable tool for learning and assessment. The validity of portfolio assessment, however, may suffer from bias due to irrelevant qualities, such as lay-out and writing style. We examined the possible effects of such qualities in a portfolio programme aimed at stimulating Year 1 medical students to reflect on their professional and personal development. In later curricular years, this portfolio is also used to judge clinical competence. We developed an instrument, the Portfolio Analysis Scoring Inventory, to examine the impact of form and content aspects on portfolio assessment. The Inventory consists of 15 items derived from interviews with experienced mentors, the literature, and the criteria for reflective competence used in the regular portfolio assessment procedure. Forty portfolios, selected from 231 portfolios for which ratings from the regular assessment procedure were available, were rated by 2 researchers, independently, using the Inventory. Regression analysis was used to estimate the correlation between the ratings from the regular assessment and those resulting from the Inventory items. Inter-rater agreement ranged from 0.46 to 0.87. The strongest predictor of the variance in the regular ratings was 'quality of reflection' (R 0.80; R2 66%). No further items accounted for a significant proportion of variance. Irrelevant items, such as writing style and lay-out, had negligible effects. The absence of an impact of irrelevant criteria appears to support the validity of the portfolio assessment procedure. Further studies should examine the portfolio's validity for the assessment of clinical competence.
Consensus development on the essential competencies for Iranian public health nutritionists.
Sadeghi-Ghotbabadi, Farzaneh; Shakibazadeh, Elham; Omidvar, Nasrin; Mortazavi, Fathieh; Kolahdooz, Fariba
2015-03-01
To assess key experts' opinion regarding essential competencies required for effective public health nutrition practice within the health-care system of Iran. Qualitative study using the modified Delphi technique through an email-delivered questionnaire. Iran. Fifty-five experts were contacted through email. The inclusion criterion for the study panel was being in a relevant senior-level position in nutrition science or public health nutrition in Iran. In the first round, forty-two out of fifty-five experts responded to the questionnaire (response rate=76 %). A sixty-five-item questionnaire was designed with nine competency areas, including 'nutrition science', 'planning and implementing nutritional interventions', 'health and nutrition services', 'advocacy and communication', 'assessment and analysis', 'evaluation', 'cultural, social and political aspects', 'using technology' and 'leadership and management'. All experts who had participated in the first round completed a modified version of the questionnaire with seventy-seven items in the second round. The experts scored 'nutrition science' as the most essential competency area, while more applied areas such as 'management and leadership' were less emphasized. In both rounds, the mean difference between the opinions of the necessity of each area was 5.6 %. The Iranian experts had general agreement on most of the core competency areas of public health nutritionists. The results indicated the need for capacity building and revisions to educational curricula for public health nutritionist programmes, with more emphasis on skill-based competency development.
Reliability and validity of the Nurse Practitioners' Roles and Competencies Scale.
Lin, Li-Chun; Lee, Sheuan; Ueng, Steve Wen-Neng; Tang, Woung-Ru
2016-01-01
The objective of this study was to test the reliability and construct validity of the Nurse Practitioners' Roles and Competencies Scale. The role of nurse practitioners has attracted international attention. The advanced nursing role played by nurse practitioners varies with national conditions and medical environments. To date, no suitable measurement tool has been available for assessing the roles and competencies of nurse practitioners in Asian countries. Secondary analysis of data from three studies related to nurse practitioners' role competencies. We analysed data from 563 valid questionnaires completed in three studies to identify the factor structure of the Nurse Practitioners' Roles and Competencies Scale. To this end, we performed exploratory factor analysis using principal component analysis extraction with varimax orthogonal rotation. The internal consistency reliabilities of the overall scale and its subscales were examined using Cronbach's alpha coefficient. The scale had six factors: professionalism, direct care, clinical research, practical guidance, medical assistance, as well as leadership and reform. These factors explained 67·5% of the total variance in nurse practitioners' role competencies. Cronbach's alpha coefficient for the overall scale was 0·98, and those of its subscales ranged from 0·83-0·97. The internal consistency reliability and construct validity of the Nurse Practitioners' Roles and Competencies Scale were good. The high internal consistency reliabilities suggest item redundancy, which should be minimised by using item response theory to enhance the applicability of this questionnaire for future academic and clinical studies. The Nurse Practitioners' Roles and Competencies Scale can be used as a tool for assessing the roles and competencies of nurse practitioners in Taiwan. Our findings can also serve as a reference for other Asian countries to develop the nurse practitioner role. © 2015 John Wiley & Sons Ltd.
Cognitive interviews guide design of a new CAM patient expectations questionnaire.
Sherman, Karen J; Eaves, Emery R; Ritenbaugh, Cheryl; Hsu, Clarissa; Cherkin, Daniel C; Turner, Judith A
2014-01-25
No consistent relationship exists between pre-treatment expectations and therapeutic benefit from various complementary and alternative medicine (CAM) therapies in clinical trials. However, many different expectancy measures have been used in those studies, with no validated questionnaires clearly focused on CAM and pain. We undertook cognitive interviews as part of a process to develop and validate such a questionnaire. We reviewed questions about expectations of benefits of acupuncture, chiropractic, massage, or yoga for pain. Components of the questions - verbs, nouns, response options, terms and phrases describing back pain - were identified. Using seven different cognitive interview scripts, we conducted 39 interviews to evaluate how individuals with chronic low back pain understood these individual components in the context of expectancy questions for a therapy they had not yet received. Chosen items were those with the greatest agreement and least confusion among participants, and were closest to the meanings intended by the investigators. The questionnaire drafted for psychometric evaluation had 18 items covering various domains of expectancy. "Back pain" was the most consistently interpreted descriptor for this condition. The most understandable response options were 0-10 scales, a structure used throughout the questionnaire, with 0 always indicating no change, and 10 anchored with an absolute descriptor such as "complete relief". The use of words to describe midpoints was found to be confusing. The word "expect" held different and shifting meanings for participants. Thus paired items comparing "hope" and "realistically expect" were chosen to evaluate 5 different aspects of treatment expectations (back pain; back dysfunction and global effects; impact of back pain on specific areas of life; sleep, mood, and energy; coping). "Impact of back pain" on various areas of life was found to be a consistently meaningful concept, and more global than "interference". Cognitive interviews identified wordings with considerable agreement among both participants and investigators. Some items widely used in clinical studies had different meanings to participants than investigators, or were confusing to participants. The final 18-item questionnaire is undergoing psychometric evaluation with goals of streamlining as well as identifying best items for use when questionnaire length is constrained.
ERIC Educational Resources Information Center
Sungur, Semra; Senler, Burcu
2010-01-01
The present study aimed at investigating elementary students' academic motivation (intrinsic motivation, external regulation, introjected regulation, identified regulation, and amotivation), achievement goals (mastery approach goals, mastery avoidance goals, performance approach goals, performance avoidance goals), competence expectancies, and…
Angus, Steven; Vu, T Robert; Halvorsen, Andrew J; Aiyer, Meenakshy; McKown, Kevin; Chmielewski, Amy F; McDonald, Furman S
2014-03-01
The transition from medical student to intern may cause stress and burnout in new interns and the delivery of suboptimal patient care. Despite a formal set of subinternship curriculum guidelines, program directors have expressed concern regarding the skill set of new interns and the lack of standardization in that skill set among interns from different medical schools. To address these issues, the Accreditation Council for Graduate Medical Education's Next Accreditation System focuses on the development of a competency-based education continuum spanning undergraduate, graduate, and continuing medical education. In 2010, the Clerkship Directors in Internal Medicine subinternship task force, in collaboration with the Association of Program Directors in Internal Medicine survey committee, surveyed internal medicine residency program directors to determine which competencies or skills they expected from new medical school graduates. The authors summarized the results using categories of interest. In both an item rank list and free-text responses, program directors were nearly uniform in ranking the skills they deemed most important for new interns-organization and time management and prioritization skills; effective communication skills; basic clinical skills; and knowing when to ask for assistance. Stakeholders should use the results of this survey as they develop a milestone-based curriculum for the fourth year of medical school and for the internal medicine subinternship. By doing so, they should develop a standardized set of skills that meet program directors' expectations, reduce the stress of transitions across the educational continuum, and improve the quality of patient care.
Identifying context-specific competencies required by community Australian Football sports trainers.
Donaldson, Alex; Finch, Caroline F
2012-08-01
First-aid is a recommended injury prevention and risk management strategy in community sport; however, little is known about the sport-specific competencies required by first-aid providers. To achieve expert consensus on the competencies required by community Australian Football (community-AF) sports trainers. A three-round online Delphi process. Community-AF. 16 Australian sports first-aid and community-AF experts. Rating of competencies as either 'essential', 'expected', 'ideal' or 'not required'. Results After Round 3, 47 of the 77 (61%) competencies were endorsed as 'essential' or 'expected' for a sports trainer to effectively perform the activities required to the standards expected at a community-AF club by ≥75% of experts. These competencies covered: the role of the sports trainer; the responsibilities of the sports trainer; emergency management; injury and illness assessment and immediate management; taping; and injury prevention and risk management. Four competencies (5%) were endorsed as 'ideal' or 'not required' by ≥85% of experts and were excluded from further consideration. The 26 competencies where consensus was not reached were retained as second-tier, optional competencies. Sports trainers are important members of on-field first-aid teams, providing support to both injured players and other sports medicine professionals. The competencies identified in this study provide the basis of a proposed two-tiered community-AF-specific sports trainer education structure that can be implemented by the peak sports body. This includes six mandatory modules, relating to the 'required' competencies, and a further six optional modules covering competencies on which consensus was not reached.
Rotthoff, Thomas; Ostapczuk, Martin Stefan; de Bruin, Judith; Kröncke, Klaus-Dietrich; Decking, Ulrich; Schneider, Matthias; Ritz-Timme, Stefanie
2012-11-07
A mission statement (MS) sets out the long-term goals of an institution and is supposed to be suited for studying learning environments. Yet, hardly any study has tested this issue so far. The aim of the present study was the development and psychometric evaluation of an MS-Questionnaire (MSQ) focusing on explicit competencies. We investigated to what extent the MSQ captures the construct of learning environment and how well a faculty is following--in its perception--a competency orientation in a competency-based curriculum. A questionnaire was derived from the MS "teaching" (Medical Faculty, Heinrich-Heine University Düsseldorf) which was based on (inter-) nationally accepted goals and recommendations for a competency based medical education. The MSQ was administered together with the Dundee Ready Education Environment Measure (DREEM) to 1119 students and 258 teachers. Cronbach's alpha was used to analyze the internal consistency of the items. Explorative factor analyses were performed to analyze homogeneity of the items within subscales and factorial validity of the MSQ. Item discrimination was assessed by means of part-whole corrected discrimination indices, and convergent validity was analyzed with respect to DREEM. Demographic variations of the respondents were used to analyze the inter-group variations in their responses. Students and teachers perceived the MS implementation as "moderate" and on average, students differed significantly in their perception of the MS. They thought implementation of the MS was less successful than faculty did. Women had a more positive perception of educational climate than their male colleagues and clinical students perceived the implementation of the MS on all dimensions significantly worse than preclinical students. The psychometric properties of the MSQ were very satisfactory: Item discrimination was high. Similarly to DREEM, the MSQ was highly reliable among students (α = 0.92) and teachers (α = 0.93). In both groups, the MSQ correlated highly positively with DREEM (r = 0.79 and 0.80, p < 0.001 each). Factor analyses did not reproduce the three areas of the MS perfectly. The subscales, however, could be identified as such both among teachers and students. The perceived implementation of faculty-specific goals can be measured in an institution to some considerable extent by means of a questionnaire developed on the basis of the institution's MS. Our MSQ provides a reliable instrument to measure the learning climate with a strong focus on competencies which are increasingly considered crucial in medical education. The questionnaire thus offers additional information beyond the DREEM. Our site-specific results imply that our own faculty is not yet fully living up to its competency-based MS. In general, the MSQ might prove useful for faculty development to the increasing number of faculties seeking to measure their perceived competency orientation in a competency-based curriculum.
Risk Competence in Dealing With Alcohol and Other Drugs in Adolescence.
Nagy, Ede; Verres, Rolf; Grevenstein, Dennis
2017-12-06
Adolescence is a critical phase for the development substance use patterns. We propose that individual competence in dealing with psychoactive substances is crucial for the development of healthy substance use behavior and prevention of substance misuse or addiction. We present a new concept of health related skills in dealing with alcohol and other drugs in adolescence, its operationalization and validation. Our conception of risk competence (RICO) consists of the four major factors being Reflective, Informed, Self-Controlled and Life-Oriented, and their sub-facets. Based on a sample of N = 753 adolescents we used classical test theory as well as item response theory to create a new measure of RICO. Validity was investigated in a new sample of N = 229 with regard to substance use, risk perception, and measures of personality (Big Five, sense of coherence, general self-efficacy). RICO contains 7 scales with 28 items that measure independent aspects of risk competence. Cross-sectional criterion validity for most of the scales could be shown. Conclusions/Importance: The new RICO scales are a valid measure of different aspects of risk competence in dealing with psychoactive substances. The questionnaire can be used in general research settings, but may also be applied to assess the effects of interventions.
Zand, Debra; Pierce, Katherine; Thomson, Nicole; Baig, M. Waseem; Teodorescu, Cristiana; Nibras, Sohail; Maxim, Rolanda
2014-01-01
Little research has empirically addressed the relationships among parental knowledge of child development, parental attunement, parental expectations, and child independence in predicting the social competence of infants and toddlers with special health care needs. We used baseline data from the Strengthening Families Project, a prevention intervention study that tested Bavolek’s Nurturing Program for Parents and Their Children with Health Challenges to explore the roles of these variables in predicting social competence in infants and toddlers with special health care needs. Bivariate relationships among the study variables were explored and used to develop and test a model for predicting social competence among these children. Study findings pointed to a combination of indirect and direct influences of parent variables in predicting social competence. Results indicated that parents who encouraged healthy behaviors for developing a sense of power/independence were more likely to have children with social competence developing on schedule. Elements related to parental expectations, however, did not have the hypothesized relationships to social competence. The present study provides preliminary data to support the development of knowledge based interventions. Within medical settings, such interventions may indeed maximize benefit while minimizing cost. PMID:27417463
ERIC Educational Resources Information Center
Shulruf, Boaz; Jones, Phil; Turner, Rolf
2015-01-01
The determination of Pass/Fail decisions over Borderline grades, (i.e., grades which do not clearly distinguish between the competent and incompetent examinees) has been an ongoing challenge for academic institutions. This study utilises the Objective Borderline Method (OBM) to determine examinee ability and item difficulty, and from that…
ERIC Educational Resources Information Center
Liau, Albert Kienfie; Chow, Daryl; Tan, Teck Kiang; Senf, Konrad
2011-01-01
The purpose of this study was to establish the reliability and validity of the scores on a brief strengths-based assessment, the 22-item Personal Strengths Inventory (PSI). In Study 1, findings from exploratory factor analysis of 410 adolescents provided evidence for a five-factor solution--social competence (four items), emotional awareness (five…
ERIC Educational Resources Information Center
Balboni, Giulia; Tasso, Alessandra; Muratori, Filippo; Cubelli, Roberto
2016-01-01
We investigated which item subsets of the Vineland-II can discriminate low-functioning preschoolers with ASD from matched peers with other neurodevelopmental disorders, using a regression analysis derived from a normative sample to account for cognitive and linguistic competencies. At variance with the typical profile, a pattern with Communication…
Evaluating the Validity of the Nisonger Child Behavior Rating Form--Parent Version
ERIC Educational Resources Information Center
Norris, Megan; Lecavalier, Luc
2011-01-01
Youth with intellectual and developmental disabilities (IDD) experience high rates of emotional and behavior problems. The Nisonger Child Behavior Rating Form (NCBRF) is one of the few tools developed to assess these problems in this population. It consists of a 10-item Social Competence section and a 66-item Problem Behavior section. The goal of…
ERIC Educational Resources Information Center
Weller, Peter D.; Anderson, Michael C.; Gómez-Ariza, Carlos J.; Bajo, M. Teresa
2013-01-01
Retrieving memories can impair recall of other related traces. Items affected by this retrieval-induced forgetting (RIF) are often less accessible when tested with independent probes, a characteristic known as cue independence. Cue independence has been interpreted as evidence for inhibitory mechanisms that suppress competing items during…
ERIC Educational Resources Information Center
Randall, Jennifer; Engelhard, George, Jr.
2010-01-01
The psychometric properties and multigroup measurement invariance of scores across subgroups, items, and persons on the "Reading for Meaning" items from the Georgia Criterion Referenced Competency Test (CRCT) were assessed in a sample of 778 seventh-grade students. Specifically, we sought to determine the extent to which score-based…
ERIC Educational Resources Information Center
Gillem, Angela R.; Bartoli, Eleonora; Bertsch, Kristin N.; McCarthy, Maureen A.; Constant, Kerra; Marrero-Meisky, Sheila; Robbins, Steven J.; Bellamy, Scarlett
2016-01-01
The Multicultural Counseling and Psychotherapy Test (MCPT), a measure of multicultural counseling competence (MCC), was validated in 2 phases. In Phase 1, the authors administered 451 test items derived from multicultural guidelines in counseling and psychology to 32 multicultural experts and 30 nonexperts. In Phase 2, the authors administered the…
Using the Competing Values Framework (CVF) to Examine Teacher Satisfaction in Tennessee Schools
ERIC Educational Resources Information Center
Gulosino, Charisse A.; Jones, Laquetta; Franceschini, Louis
2016-01-01
The primary aim of this study is to use the survey items from the TELL Tennessee Survey (2013) using the Competing Values Framework (CVF) to determine whether teachers' observations about a set of topically organized school climate dimensions and performance levels are associated with teacher satisfaction. Specifically, the study sets out to…
2013-07-01
interpersonal competence and social adjustment in the classroom . Preschool Social Competence Scale – Teachers will complete this 39-item measure which...Children (BASC) ADHD Monitor. Circle Pines, MN: American Guidance Service. Keane, T., Fairbank, J., Caddell, J., Zimering, R., Taylor, K., & Mora, C
ERIC Educational Resources Information Center
Gulosino, Charisse; Franceschini, Louis, III; Hardman, Portia
2016-01-01
The primary aim of this study is to use the survey items from the TELL Tennessee Survey (2013) using the Competing Values Framework (CVF) (Quinn and Rohrbaugh's model of organizational effectiveness) to determine whether teachers' observations about a set of topically organized school climate dimensions and school performance levels are associated…
ERIC Educational Resources Information Center
Ahmad, Tunku Badariah Tunku; Zubairi, Ainol Madziah; Ibrahim, Mohd Burhan; Othman, Joharry; Rahman, Nik Suryani Abd; Rahman, Zainurin Abd; Nordin, Mohamad Sahari; Nor, Zainab Mohd
2014-01-01
This paper reports the findings of a national study involving 534 lecturers from 33 higher learning institutions in Malaysia to find out their self-reported practices and perceived competencies in assessment for learning. Data were collected using a 24-item assessment practice inventory drawn from five of the six standards stipulated in an…
ERIC Educational Resources Information Center
Waters, Everett; And Others
1985-01-01
Two studies illustrating a methodology for describing similarities and distinctions between related constructs are reported. In Study 1, psychologists described behavioral and personality characteristics of preschool children through definitions of social competence and self-esteem using Q-set items. In Study 2, the relation between conceptual…
ERIC Educational Resources Information Center
Bullis, Michael; Reiman, John
1992-01-01
The Transition Competence Battery for Deaf Adolescents and Young Adults (TCB) measures employment and independent living skills. The TCB was standardized on students (N from 180 to 230 for the different subtests) from both mainstreamed and residential settings. Item statistics and subtest reliabilities were adequate; evidence of construct validity…
Developing a Scale for Perceptions of Competency in Teaching Quality
ERIC Educational Resources Information Center
Tasci, Guntay; Atar, Burcu
2016-01-01
The purpose of this study was to develop a measurement instrument for determining pre-service teachers' perceptions of competency in providing quality teaching. The initial phase of the instrument was consisted of 54 items that were composed based on theory and literature. The initial form was applied to 232 pre-service teachers. An exploratory…
Knight, Andrew J
2008-01-01
The purpose of this study was to compare perceptions of professional competency between preinternship music therapy students and internship supervisors. Preinternship music therapy students and internship supervisors were asked to fill out the Internship Concerns Questionnaire (ICQ-ST, student; ICQ-SU, supervisor). Participants (N = 106) included 85 students at 16 AMTA-approved universities (n = 85), and 21 internship supervisors at active AMTA national roster internship sites (n = 21). Twenty items on the ICQ were rated on a Likert-type scale, and 1 item (Part B) asked the participant to indicate any other concerns not addressed in the ICQ. Music therapy interns and supervisors differed significantly in their mean ratings on 2 of the 20 items: "Communicating with facility staff" (p = .025) and "Maintaining client confidence" (p = .016). In both cases the student interns reported a significantly lower mean level of concern about getting assistance in these areas than did their supervisors. The present study suggests that music therapy educators may better prepare music therapy students for a successful internship by evaluating the perceptual gaps in professional training expectations between students and supervisors prior to the internship. Internship supervisors may also benefit from student's own perceptions of their knowledge and skills upon beginning the internship. Ultimately, the student is responsible for being prepared to begin the process from intern to beginning professional at the start of the internship, and to commit to gaining as much as possible from the combination of academic and clinical experiences available to them.
Spiritually Competent Practice with Individuals and Families Dealing with Medical Conditions
ERIC Educational Resources Information Center
Sperry, Len
2011-01-01
Counselors and psychotherapists are increasingly expected to provide services that are spiritually competent. Those counseling individuals and families where medical concerns are a focus would do well to consider the implications of spiritual competence in their work. The article defines spiritual competence, describes spiritual competencies, and…
Preparing for practice: Nursing intern and faculty perceptions on clinical experiences.
AlThiga, Hanan; Mohidin, Sharifah; Park, Yoon Soo; Tekian, Ara
2017-04-01
Clinical experience and exposure to real patients are required elements of nursing education. Trainees in nursing are expected to be prepared adequately for the hard-working environment, increasing patient complexity, and higher-level competencies. This study investigates differences between nursing interns and clinical faculty on actual and perceived importance of educational preparation and development of clinical competencies, focusing on the nursing curriculum and transition to practice. A convenient sampling technique with a mixed-methods design was used to collect quantitative and qualitative data, by surveying and interviewing nursing interns and faculty members from King Abdul-Aziz University in Saudi Arabia; data collection occurred in December 2015. The survey (23 items) and focused interviews measured perceptions of clinical instruction and experience. Descriptive statistics and t-tests were used to analyze differences in mean ratings between actual and perceived importance. Themes collected from narrative interview data were summarized. Significant differences were found between nursing interns (n = 46) and faculty (n = 29) perceptions of actual clinical teaching and experiences and its importance including the clinical teaching and the development of clinical competence, p < .01. Moreover, nursing interns rated actual experiences of knowledge base and skills significantly lower than faculty perceptions, p = .001. Narrative data provided in-depth information on factors contributing and hindering the learning and teaching environment. Findings from this study call for clinical instruction and experiences to take a step further to meet current practice standards and to improve patient safety in the health professions education of nurses.
Tools of the trade: Improving nurses' ability to access and evaluate research.
Sleutel, Martha R; Bullion, John W; Sullivan, Ronnie
2018-03-01
To evaluate the effect of a manager-required RN competency on staff nurses' perceived knowledge, ability and frequency of information-seeking activities. Basing clinical practice on research and standards of care is essential to delivering appropriate care with optimal outcomes. Nurses' information-seeking abilities are critical for acquiring evidence-based answers to aid clinical decision-making, yet nurses under-utilize library resources and report barriers. A unit manager sought to test the effect of an innovative competency for acquiring and appraising evidence for practice. This longitudinal descriptive study evaluated 28 nurses before and after a 1-hr class, as well as 5 months later. The class covered library information services and the basics of critiquing research articles. Nurses had statistically significant improvements in four of five items measuring knowledge/ability and four of five items measuring frequency of information-seeking activities. At 5 months, most knowledge/ability items increased. There was no effect of nurse characteristics on outcomes. A required competency improved nurses' knowledge, ability and frequency of acquiring and appraising evidence with a single 1-hr class and a hands-on practice activity. Unit managers can have great impact on nurses' use of evidence for practice. © 2018 John Wiley & Sons Ltd.
Mitchell, Andrew Edward Paul
2017-04-01
In this study, we investigated the effects of training on knowledge acquisition and core competencies in cognitive and behavioral therapy (CBT). Forty-three students attended 15 half-day, weekly sessions and were tested with the Cognitive Therapy Awareness Scale (CTAS) at weeks 1 and 15 in a before and after study. The students' case studies were assessed with competency items 7-12 on the Cognitive Rating Scale-Revised (CTS-R). Improvements in the CTAS were modest. Key competencies on the CTS-R subscales at week 15 were also observed. CBT knowledge acquisition might improve patients' outcomes through impact on competencies. © 2015 Wiley Periodicals, Inc.
Ogunyemi, Dotun; Eno, Michelle; Rad, Steve; Fong, Alex; Alexander, Carolyn; Azziz, Ricardo
2010-01-01
Objective The purpose of this article was to develop and determine the utility of a compliance form in evaluating and teaching the Accreditation Council for Graduate Medical Education competencies of professionalism, practice-based learning and improvement, and systems-based practice. Methods In 2006, we introduced a 17-item compliance form in an obstetrics and gynecology residency program. The form prospectively monitored residents on attendance at required activities (5 items), accountability of required obligations (9 items), and completion of assigned projects (3 items). Scores were compared to faculty evaluations of residents, resident status as a contributor or a concerning resident, and to the residents' conflict styles, using the Thomas-Kilmann Conflict MODE Instrument. Results Our analysis of 18 residents for academic year 2007–2008 showed a mean (standard error of mean) of 577 (65.3) for postgraduate year (PGY)-1, 692 (42.4) for PGY-2, 535 (23.3) for PGY-3, and 651.6 (37.4) for PGY-4. Non-Hispanic white residents had significantly higher scores on compliance, faculty evaluations on interpersonal and communication skills, and competence in systems-based practice. Contributing residents had significantly higher scores on compliance compared with concerning residents. Senior residents had significantly higher accountability scores compared with junior residents, and junior residents had increased project completion scores. Attendance scores increased and accountability scores decreased significantly between the first and second 6 months of the academic year. There were positive correlations between compliance scores with competing and collaborating conflict styles, and significant negative correlations between compliance with avoiding and accommodating conflict styles. Conclusions Maintaining a compliance form allows residents and residency programs to focus on issues that affect performance and facilitate assessment of the ACGME competencies. Postgraduate year, behavior, and conflict styles appear to be associated with compliance. A lack of association with faculty evaluations suggests measurement of different perceptions of residents' behavior. PMID:21976093
Ogunyemi, Dotun; Eno, Michelle; Rad, Steve; Fong, Alex; Alexander, Carolyn; Azziz, Ricardo
2010-09-01
The purpose of this article was to develop and determine the utility of a compliance form in evaluating and teaching the Accreditation Council for Graduate Medical Education competencies of professionalism, practice-based learning and improvement, and systems-based practice. In 2006, we introduced a 17-item compliance form in an obstetrics and gynecology residency program. The form prospectively monitored residents on attendance at required activities (5 items), accountability of required obligations (9 items), and completion of assigned projects (3 items). Scores were compared to faculty evaluations of residents, resident status as a contributor or a concerning resident, and to the residents' conflict styles, using the Thomas-Kilmann Conflict MODE Instrument. Our analysis of 18 residents for academic year 2007-2008 showed a mean (standard error of mean) of 577 (65.3) for postgraduate year (PGY)-1, 692 (42.4) for PGY-2, 535 (23.3) for PGY-3, and 651.6 (37.4) for PGY-4. Non-Hispanic white residents had significantly higher scores on compliance, faculty evaluations on interpersonal and communication skills, and competence in systems-based practice. Contributing residents had significantly higher scores on compliance compared with concerning residents. Senior residents had significantly higher accountability scores compared with junior residents, and junior residents had increased project completion scores. Attendance scores increased and accountability scores decreased significantly between the first and second 6 months of the academic year. There were positive correlations between compliance scores with competing and collaborating conflict styles, and significant negative correlations between compliance with avoiding and accommodating conflict styles. Maintaining a compliance form allows residents and residency programs to focus on issues that affect performance and facilitate assessment of the ACGME competencies. Postgraduate year, behavior, and conflict styles appear to be associated with compliance. A lack of association with faculty evaluations suggests measurement of different perceptions of residents' behavior.
Real and Artificial Differential Item Functioning in Polytomous Items
ERIC Educational Resources Information Center
Andrich, David; Hagquist, Curt
2015-01-01
Differential item functioning (DIF) for an item between two groups is present if, for the same person location on a variable, persons from different groups have different expected values for their responses. Applying only to dichotomously scored items in the popular Mantel-Haenszel (MH) method for detecting DIF in which persons are classified by…
A Quasi-Parametric Method for Fitting Flexible Item Response Functions
ERIC Educational Resources Information Center
Liang, Longjuan; Browne, Michael W.
2015-01-01
If standard two-parameter item response functions are employed in the analysis of a test with some newly constructed items, it can be expected that, for some items, the item response function (IRF) will not fit the data well. This lack of fit can also occur when standard IRFs are fitted to personality or psychopathology items. When investigating…
Adolescent pregnancy: do expectations affect intentions?
Stevens-Simon, Catherine; Sheeder, Jeanelle; Beach, Roberta; Harter, Susan
2005-09-01
To establish the relationship between expectations about the effects of childbearing on specific aspects of life and the strength of the desire to remain nonpregnant during adolescence. We hypothesized that the absence of negative childbearing expectations is associated with an increase in the odds that sexually active, inadequately contracepting teenage girls are cognitively susceptible to conception. A racially and ethnically diverse group of 351 nulligravida, inadequately contracepting teenagers was studied. Participants responded to 60 items that asked about their expectation about the effects of becoming pregnant and not doing so. Analyses were performed to determine the factorial structure of the childbearing expectations items and their relationship to cognitive susceptibility to conception, defined as the lack of desire to remain nonpregnant. The analysis yielded a 9-factor solution for the childbearing expectations items. All 9 sub-scales exhibited acceptable reliability coefficients, stable factor patterns, and correlated significantly with the desire to remain nonpregnant. A dose-dependent relationship suggestive of causality was also apparent. In stepwise regression the sub-scales that assessed the anticipated effect of childbearing on future plans, self-esteem, and boyfriend relations remained significant and accounted for 56% of the variance in the desire to remain nonpregnant. The lengthy research instrument was reduced to an 8-item screening tool without loss of psychometric integrity or explanatory power. Childbearing expectations reflect distinct concepts and account for a significant portion of the variance in the desire to remain nonpregnant during adolescence. Thus the 8-item screening tool we validated might be used to formulate a differential diagnosis for the enigmatic behavior of teens who say they do not "want" to become pregnant but do not "mind" doing so enough to try to avoid conceiving by default.
Biomedical research competencies for osteopathic medical students
Cruser, des Anges; Dubin, Bruce; Brown, Sarah K; Bakken, Lori L; Licciardone, John C; Podawiltz, Alan L; Bulik, Robert J
2009-01-01
Background Without systematic exposure to biomedical research concepts or applications, osteopathic medical students may be generally under-prepared to efficiently consume and effectively apply research and evidence-based medicine information in patient care. The academic literature suggests that although medical residents are increasingly expected to conduct research in their post graduate training specialties, they generally have limited understanding of research concepts. With grant support from the National Center for Complementary and Alternative Medicine, and a grant from the Osteopathic Heritage Foundation, the University of North Texas Health Science Center (UNTHSC) is incorporating research education in the osteopathic medical school curriculum. The first phase of this research education project involved a baseline assessment of students' understanding of targeted research concepts. This paper reports the results of that assessment and discusses implications for research education during medical school. Methods Using a novel set of research competencies supported by the literature as needed for understanding research information, we created a questionnaire to measure students' confidence and understanding of selected research concepts. Three matriculating medical school classes completed the on-line questionnaire. Data were analyzed for differences between groups using analysis of variance and t-tests. Correlation coefficients were computed for the confidence and applied understanding measures. We performed a principle component factor analysis of the confidence items, and used multiple regression analyses to explore how confidence might be related to the applied understanding. Results Of 496 total incoming, first, and second year medical students, 354 (71.4%) completed the questionnaire. Incoming students expressed significantly more confidence than first or second year students (F = 7.198, df = 2, 351, P = 0.001) in their ability to understand the research concepts. Factor analyses of the confidence items yielded conceptually coherent groupings. Regression analysis confirmed a relationship between confidence and applied understanding referred to as knowledge. Confidence scores were important in explaining variability in knowledge scores of the respondents. Conclusion Medical students with limited understanding of research concepts may struggle to understand the medical literature. Assessing medical students' confidence to understand and objectively measured ability to interpret basic research concepts can be used to incorporate competency based research material into the existing curriculum. PMID:19825171
Achieved Competencies and Satisfaction in Temporomandibular Disorders and Orofacial Pain Education.
Nordin, Sara; Dawson, Andreas; Ekberg, Ewa Carin
2016-01-01
To assess dental students' achieved competencies and perceived satisfaction with their temporomandibular disorders (TMD) and orofacial pain education and to compare these with the results of their final examination in TMD and orofacial pain. Dental students from two consecutive classes (2011/2012 and 2012/2013) at the Department of Orofacial Pain and Jaw Function at the dental school in Malmö, Sweden completed two self-evaluations, one at the beginning of semester seven and one at the end of semester eight. The questionnaire that they were given concerned achieved competencies and satisfaction with education in TMD and orofacial pain. Items focused on anatomy, physiology, and clinical training. Students estimated their competence and satisfaction on a numeric rating scale and described their idea of treating TMD and orofacial pain patients on a verbal rating scale. Outcome variables were tested with paired samples t test for differences over time and independent samples t test for between-class comparisons; both were adjusted for multiple testing with Bonferroni correction. Significant improvement in all items was observed for achieved competencies and satisfaction in both classes between semester seven and semester eight (P < .05). No differences in competencies or satisfaction occurred between classes at the end of the clinical course in semester eight (P > .05). This study has shown that expansion in undergraduate TMD and orofacial pain education at the dental school in Malmö has allowed all students to develop the same level of competence, independent of prior experience. The study also pointed out that continuous evaluation and enhancement of TMD and orofacial pain education in undergraduate dental education is beneficial.
Wong, Camilla L.; Norris, Mireille; Sinha, Samir S.; Zorzitto, Maria L.; Madala, Sushma; Hamid, Jemila S.
2016-01-01
Background The Team Standardized Assessment of a Clinical Encounter Report (StACER) was designed for use in Geriatric Medicine residency programs to evaluate Communicator and Collaborator competencies. Methods The Team StACER was completed by two geriatricians and interdisciplinary team members based on observations during a geriatric medicine team meeting. Postgraduate trainees were recruited from July 2010–November 2013. Inter-rater reliability between two geriatricians and between all team members was determined. Internal consistency of items for the constructs Communicator and Collaborator competencies was calculated. Raters completed a survey previously administered to Canadian geriatricians to assess face validity. Trainees completed a survey to determine the usefulness of this instrument as a feedback tool. Results Thirty postgraduate trainees participated. The prevalence-adjusted bias-adjusted kappa range inter-rater reliability for Communicator and Collaborator items were 0.87–1.00 and 0.86–1.00, respectively. The Cronbach’s alpha coefficient for Communicator and Collaborator items was 0.997 (95% CI: 0.993–1.00) and 0.997 (95% CI: 0.997–1.00), respectively. The instrument lacked discriminatory power, as all trainees scored “meets requirements” in the overall assessment. Niney-three per cent and 86% of trainees found feedback useful for developing Communicator and Collaborator competencies, respectively. Conclusions The Team StACER has adequate inter-rater reliability and internal consistency. Poor discriminatory power and face validity challenge the merit of using this evaluation tool. Trainees felt the tool provided useful feedback on Collaborator and Communicator competencies. PMID:28050222
Pharmacist perceptions of new competency standards
Maitreemit, Pagamas; Pongcharoensuk, Petcharat; Kapol, Nattiya; Armstrong, Edward P.
2008-01-01
Objective To suggest revisions to the Thai pharmacy competency standards and determine the perceptions of Thai pharmacy practitioners and faculty about the proposed pharmacy competency standards. Methods The current competency standards were revised by brainstorming session with nine Thai pharmacy experts according to their perceptions of society’s pharmacy needs. The revised standards were proposed and validated by 574 pharmacy practitioners and faculty members by using a written questionnaire. The respondents were classified based on their practice setting. Results The revision of pharmacy competency standard proposed the integration and addition to current competencies. Of 830 distributed questionnaires, 574 completed questionnaires were received (69.2% response rate). The proposed new competency standards contained 7 domains and 46 competencies. The majority of the respondents were supportive of all 46 proposed competencies. The highest ranked domain was Domain 1 (Practice Pharmacy within Laws, Professional Standards, and Ethics). The second and third highest expectations of pharmacy graduates were Domain 4 (Provide pharmaceutical care) and Domain 3 (Communicate and disseminate knowledge effectively). Conclusion The expectation for pharmacy graduates’ competencies were high and respondents encouraged additional growth in multidisciplinary efforts to improve patient care. PMID:25177401
When less is more: validating a brief scale to rate interprofessional team competencies.
Lie, Désirée A; Richter-Lagha, Regina; Forest, Christopher P; Walsh, Anne; Lohenry, Kevin
2017-01-01
There is a need for validated and easy-to-apply behavior-based tools for assessing interprofessional team competencies in clinical settings. The seven-item observer-based Modified McMaster-Ottawa scale was developed for the Team Objective Structured Clinical Encounter (TOSCE) to assess individual and team performance in interprofessional patient encounters. We aimed to improve scale usability for clinical settings by reducing item numbers while maintaining generalizability; and to explore the minimum number of observed cases required to achieve modest generalizability for giving feedback. We administered a two-station TOSCE in April 2016 to 63 students split into 16 newly-formed teams, each consisting of four professions. The stations were of similar difficulty. We trained sixteen faculty to rate two teams each. We examined individual and team performance scores using generalizability (G) theory and principal component analysis (PCA). The seven-item scale shows modest generalizability (.75) with individual scores. PCA revealed multicollinearity and singularity among scale items and we identified three potential items for removal. Reducing items for individual scores from seven to four (measuring Collaboration, Roles, Patient/Family-centeredness, and Conflict Management) changed scale generalizability from .75 to .73. Performance assessment with two cases is associated with reasonable generalizability (.73). Students in newly-formed interprofessional teams show a learning curve after one patient encounter. Team scores from a two-station TOSCE demonstrate low generalizability whether the scale consisted of four (.53) or seven items (.55). The four-item Modified McMaster-Ottawa scale for assessing individual performance in interprofessional teams retains the generalizability and validity of the seven-item scale. Observation of students in teams interacting with two different patients provides reasonably reliable ratings for giving feedback. The four-item scale has potential for assessing individual student skills and the impact of IPE curricula in clinical practice settings. IPE: Interprofessional education; SP: Standardized patient; TOSCE: Team objective structured clinical encounter.
Objectivity of the Subjective Quality: Convergence on Competencies Expected of Doctoral Graduates
ERIC Educational Resources Information Center
Kariyana, Israel; Sonn, Reynold A.; Marongwe, Newlin
2017-01-01
This study assessed the competencies expected of doctoral graduates. Twelve purposefully sampled education experts provided the data. A case study design within a qualitative approach was adopted. Data were gathered through interviews and thematically analysed. Member checking ensured data trustworthiness. Factors affecting the quality of a…
ERIC Educational Resources Information Center
Jenkins-Guarnieri, Michael A.; Vaughan, Angela L.; Wright, Stephen L.
2015-01-01
We adapted a work self-determination measure to create the Basic Needs Satisfaction at College Scale. Confirmatory factor analysis and item response theory analyses with data from 525 adults supported a 3-factor model with 13 items most sensitive for lower to middle range levels of the autonomy, competence, and relatedness constructs.
ERIC Educational Resources Information Center
Liu, Xiufeng; Ruiz, Miguel E.
2008-01-01
This article reports a study on using data mining to predict K-12 students' competence levels on test items related to energy. Data sources are the 1995 Third International Mathematics and Science Study (TIMSS), 1999 TIMSS-Repeat, 2003 Trend in International Mathematics and Science Study (TIMSS), and the National Assessment of Educational…
ERIC Educational Resources Information Center
Cheek, Jimmy G.; McGhee, Max B.
The central purpose of this study was to develop and field test written criterion-referenced tests for the ornamental horticulture component of applied principles of agribusiness and natural resources occupations programs. The test items were to be used by secondary agricultural education students in Florida. Based upon the objectives identified…
New Year's res-illusions: food shopping in the new year competes with healthy intentions.
Pope, Lizzy; Hanks, Andrew S; Just, David R; Wansink, Brian
2014-01-01
How do the holidays--and the possible New Year's resolutions that follow--influence a household's purchase patterns of healthier foods versus less healthy foods? This has important implications for both holiday food shopping and post-holiday shopping. 207 households were recruited to participate in a randomized-controlled trial conducted at two regional-grocery chain locations in upstate New York. Item-level transaction records were tracked over a seven-month period (July 2010 to March 2011). The cooperating grocer's proprietary nutrient-rating system was used to designate "healthy," and "less healthy" items. Calorie data were extracted from online nutritional databases. Expenditures and calories purchased for the holiday period (Thanksgiving-New Year's), and the post-holiday period (New Year's-March), were compared to baseline (July-Thanksgiving) amounts. During the holiday season, household food expenditures increased 15% compared to baseline ($105.74 to $121.83; p<0.001), with 75% of additional expenditures accounted for by less-healthy items. Consistent with what one would expect from New Year's resolutions, sales of healthy foods increased 29.4% ($13.24/week) after the holiday season compared to baseline, and 18.9% ($9.26/week) compared to the holiday period. Unfortunately, sales of less-healthy foods remained at holiday levels ($72.85/week holiday period vs. $72.52/week post-holiday). Calories purchased each week increased 9.3% (450 calories per serving/week) after the New Year compared to the holiday period, and increased 20.2% (890 calories per serving/week) compared to baseline. Despite resolutions to eat more healthfully after New Year's, consumers may adjust to a new "status quo" of increased less-healthy food purchasing during the holidays, and dubiously fulfill their New Year's resolutions by spending more on healthy foods. Encouraging consumers to substitute healthy items for less-healthy items may be one way for practitioners and public health officials to help consumers fulfill New Year's resolutions, and reverse holiday weight gain.
Development of a Multi-Domain Assessment Tool for Quality Improvement Projects.
Rosenbluth, Glenn; Burman, Natalie J; Ranji, Sumant R; Boscardin, Christy K
2017-08-01
Improving the quality of health care and education has become a mandate at all levels within the medical profession. While several published quality improvement (QI) assessment tools exist, all have limitations in addressing the range of QI projects undertaken by learners in undergraduate medical education, graduate medical education, and continuing medical education. We developed and validated a tool to assess QI projects with learner engagement across the educational continuum. After reviewing existing tools, we interviewed local faculty who taught QI to understand how learners were engaged and what these faculty wanted in an ideal assessment tool. We then developed a list of competencies associated with QI, established items linked to these competencies, revised the items using an iterative process, and collected validity evidence for the tool. The resulting Multi-Domain Assessment of Quality Improvement Projects (MAQIP) rating tool contains 9 items, with criteria that may be completely fulfilled, partially fulfilled, or not fulfilled. Interrater reliability was 0.77. Untrained local faculty were able to use the tool with minimal guidance. The MAQIP is a 9-item, user-friendly tool that can be used to assess QI projects at various stages and to provide formative and summative feedback to learners at all levels.
ERIC Educational Resources Information Center
Victor, Akinfolarin Akinwale
2017-01-01
This study analyses principals' managerial competencies for effective management of school resources in secondary schools in Anambra State. The study was conducted in Anambra State. The study population comprised 257 principals in public secondary schools in the State. The study adopted a descriptive survey design. A 24 items researcher developed…
ERIC Educational Resources Information Center
Ollis, Cindy L.
2010-01-01
The Coping Competence Questionnaire (CCQ), based on the reformulated learned helplessness theory, was designed to assess a general stress resistance versus a propensity towards learned helplessness with a brief, 12-item self-report questionnaire. In this study the CCQ was administered to 247 undergraduate students, who were then paired, in groups…
Keisling, Bruce L; Bishop, Elizabeth A; Roth, Jenness M
2017-05-01
Background While the MCH Leadership Competencies and family as a discipline have been required elements of Leadership Education in Neurodevelopmental and related Disabilities (LEND) programs for over a decade, little research has been published on the efficacy of either programmatic component in the development of the next generation of leaders who can advocate and care for Maternal and Child Health (MCH) populations. Objective To test the effectiveness of integrating the family discipline through implementation of parent led curricula on trainees' content knowledge, skills, and leadership development in family-centered care, according to the MCH Leadership Competencies. Methods One hundred and two long-term (≥ 300 h) LEND trainees completed a clinical and leadership training program which featured intensive parent led curricula supported by a full-time family faculty member. Trainees rated themselves on the five Basic and Advanced skill items that comprise MCH Leadership Competency 8: Family-centered Care at the beginning and conclusion of their LEND traineeship. Results When compared to their initial scores, trainees rated themselves significantly higher across all family-centered leadership competency items at the completion of their LEND traineeship. Conclusions The intentional engagement of a full-time family faculty member and parent led curricula that include didactic and experiential components are associated with greater identification and adoption by trainees of family-centered attitudes, skills, and practices. However, the use of the MCH Leadership Competencies as a quantifiable measure of program evaluation, particularly leadership development, is limited.
Motor competence and physical fitness in adolescents.
Gísladóttir, Ordís; Haga, Monika; Sigmundsson, Hermundur
2014-01-01
In this study we examined the relationship between physical fitness and motor competence in adolescents aged 15 to 16 years. A sample of 94 adolescents participated in the study. To test motor competence, the Movement Assessment Battery for Children-2 was used. Physical fitness was assessed using the following test items: standing broad jump, 20-m dash, reduced Cooper test, and sit-and-reach test. The results revealed a significant but weak relationship (0.248) between motor competence and physical fitness for the whole sample. More specifically, the correlation between the 2 variables was significant for girls (0.353) but not for boys (0.248). The relatively weak relationship between motor competence and physical fitness suggests that motor competence might not be critical in adolescents to maintain their physical fitness.
ERIC Educational Resources Information Center
Michaelides, Michalis P.
2006-01-01
Consistent behavior is a desirable characteristic that common items are expected to have when administered to different groups. Findings from the literature have established that items do not always behave in consistent ways; item indices and IRT item parameter estimates of the same items differ when obtained from different administrations.…
Lin, Hsien-Cheng
2016-05-01
To understand the relationships among certain key factors such as organizational climate, self-efficacy and outcome expectation on registered nurses, with regard to the development of registered nurses' cross-cultural competence. The focus is specifically on the use of a social cognitive framework for nurses for providing intercultural nursing care to international patients. This study also aims to examine the relationship between nurses' cross-cultural competence and nursing intellectual capital. Given the influence of globalization on healthcare services, healthcare providers need to have enough cross-cultural competence to effectively care for patients from different cultures. Thus, the development of cross-cultural competence in nursing care has become an important issue. A quantitative method and a cross-sectional design were employed in this study. Data were collected from 309 RN working in 16 healthcare institutions in Taiwan from May to August 2013. Structural equation modelling, in combination with the smart partial least squares method, was used to measure the relationships in the research model. The results show that outcome expectation has a stronger impact on nurses' cross-cultural competence than self-efficacy. In addition, it was found that the cross-cultural competence of nurses has a positive impact on nursing intellectual capital. Nursing supervisors should promote a higher level of outcome expectation on nurses to enhance the improvement of their cross-cultural competence. Raising the cross-cultural competence of nurses will aid in the accumulation of nursing intellectual capital. © 2016 John Wiley & Sons Ltd.
Shrivastava, Archana; Srivastava, Arun
2016-01-01
Purpose - This paper aims to find out accredited social health activists' (ASHA) communication competence and effectiveness while working as leaders with groups in the rural setting. ASHA, as the "first point of contact" for pregnant women in rural areas, plays a significant role in building awareness and disseminating key information at critical times (e.g. antenatal and post-natal period), promotes healthy maternal and newborn care practices and facilitates identification and referral of maternal and newborn complications. ASHA plays critical role of a leader in bridging the gap between health system and community. In the entire process, effective communication competency is the key to her effectiveness. Design/methodology/approach - The study adopts seven items from the farmers communication (FACOM) scale of communication measures developed by Udai Pareek and Y.P Singh. Preliminary editing of the items was done keeping certain points in mind such as the items should not be judgemental, should be acts of behaviour, should be observable and should be simple. This scale was adopted for the study, as it was designed to measure farmers' communication competence and suited the context. The evaluation criteria included the seven essential elements of communication identified in the FACOM scale. Findings - Results from the study identified a need to sensitise ASHAs on the critical role of effective communication and need for investing more in building her capacity for health communication. The trainings being imparted to ASHAs have to be strengthened in terms of communication skills. They should focus upon developing all three variables of communication skills equally and integrating them to get desired results. Research limitations/implications - The study was conducted in one state while the programme is running across the country. The sample size was small. Practical implications - The learning of the study will help in developing a better understanding of the beneficiaries' perspectives and their expectations regarding ASHAs communication process in the leadership role which she performs. Such understanding will not only be instructive but may also prove transformative for the benefit of both ASHAs and her community, whose support is critical to the success of the programme. This learning will feed into the policy planning and communication and capacity building strategy of the ASHA programme and may lead to better and more effective strategies and tools of communication. Originality/value - Research study is original. Keeping the observers' status in mind, questionnaire was translated in Hindi language. Twenty ASHAs were selected randomly from small villages of Uttar Pradesh, the largest state in India. The scale was presented to at least five observers (all females) for one ASHA. These observers/judges were the ones who knew ASHA well and with whom she had communicated at some point of time as part of her work.
A Competency Model for Clinical Physicians in China: A Cross-Sectional Survey
Liu, Zhuang; Tian, Lei; Chang, Qing; Sun, Baozhi; Zhao, Yuhong
2016-01-01
Background Around the world, regulatory bodies have taken the lead in determining the competencies required to become a physician. As a first step in addressing this project, it was decided to develop a set of core competencies that were unique to China and that might serve as a basis for medical education. The purpose of this paper was to construct a competency model for clinical physicians in China. Methods Data was collected using a cross-sectional survey of 6247 clinicians from seven administrative regions (31 provinces, autonomous regions and municipalities directly under the central government) in China. The total sample was randomly divided into two sub-samples, an initial sample (Sample 1) and a replication sample (Sample 2). Independent exploratory factor analysis was conducted in each sample and the results were compared to determine the stability. After that the confirmatory factor analysis was used to ascertain the competency model for physicians. The reliability, convergent and discriminant validity of competency-based instrument were also examined. Results 76 items with 8 dimensions were identified, accounting for 68.41% of the construct’s total variance in the initial sample and 67.47% in the replication sample. For the two samples, the overall scale reliability (Cronbach’s alpha) was both 0.985 with dimensions from 0.905 to 0.954 for the initial sample and from 0.902 to 0.955 for the replication sample after deleting the items. In confirmatory factor analysis, the result showed that all items had acceptable goodness of fit index. RMSEA and SRMR were less than 0.08 (RMSEA = 0.046, SRMR = 0.040), while GFI, NFI, IFI, and CFI were higher than 0.9 (GFI = 0.905, NFI = 0.903, IFI = 0.909, CFI = 0.909), leading to acceptable construct validity. All construct reliability values of the factors were higher than 0.70, and all average variance extracted values exceeded 0.50. Thus, we considered the reliability and validity of the 8 dimensions were acceptable. Conclusions The instrument was shown to be both valid and reliable for measuring clinical physicians’ competency in China. The results of the competency-based instrument can be used by ministry of health and administrators of hospitals to assess physicians’ competencies, encourage and guide them to modify their behaviors according to the evaluation criteria, and also cultivate physicians with strong clinical practice, innovation and independent scientific research ability. Through these measurements and understandings, the overall level of clinical physicians will be increased in China. PMID:27935991
A COMPARISON OF TEACHING METHODS BUILDING CULTURAL COMPETENCY INFORMED BY CONTACT THEORY.
Stough-Hunter, Anjel; Guinan, Jill; Hart, Julie P
2016-01-01
This study examines students' levels of cultural competency before and after taking three different semester-long courses dealing with diversity and cultural competence with each course representing a different teaching methodology. A new 20-item survey, designed for students across disciplines, was used to measure cultural competency among 226 students from the fall of2012 to the spring of2 015. Differences were examined between scores before and after taking each class, as well as differences between classes. There were significant improvements in all three groups, and a significant difference between two of the three classes in the improvement of scores.
Expectations for Visual Function: An Initial Evaluation of a New Clinical Instrument.
ERIC Educational Resources Information Center
Corn, Anne L.; Webne, Steve L.
2001-01-01
A study explored the internal consistency of items in a visual screening instrument developed by Project PAVE: Expectations for Visual Functioning (EVF). The test includes 20 items that evaluate a child's functional use of vision. A pilot test involving 129 teachers indicates the EFV is internally consistent. (Contains three references.) (CR)
Investigating expectation effects using multiple physiological measures
Siller, Alexander; Ambach, Wolfgang; Vaitl, Dieter
2015-01-01
The study aimed at experimentally investigating whether the human body can anticipate future events under improved methodological conditions. Previous studies have reported contradictory results for the phenomenon typically called presentiment. If the positive findings are accurate, they call into doubt our views about human perception, and if they are inaccurate, a plausible conventional explanation might be based on the experimental design of the previous studies, in which expectation due to item sequences was misinterpreted as presentiment. To address these points, we opted to collect several physiological variables, to test different randomization types and to manipulate subjective significance individually. For the latter, we combined a mock crime scenario, in which participants had to steal specific items, with a concealed information test (CIT), in which the participants had to conceal their knowledge when interrogated about items they had stolen or not stolen. We measured electrodermal activity, respiration, finger pulse, heart rate (HR), and reaction times. The participants (n = 154) were assigned randomly to four different groups. Items presented in the CIT were either drawn with replacement (full) or without replacement (pseudo) and were either presented category-wise (cat) or regardless of categories (nocat). To understand how these item sequences influence expectation and modulate physiological reactions, we compared the groups with respect to effect sizes for stolen vs. not stolen items. Group pseudo_cat yielded the highest effect sizes, and pseudo_nocat yielded the lowest. We could not find any evidence of presentiment but did find evidence of physiological correlates of expectation. Due to the design differing fundamentally from previous studies, these findings do not allow for conclusions on the question whether the expectation bias is being confounded with presentiment. PMID:26500600
Novice nurse educator entry-level competency to teach: a national study.
Poindexter, Kathleen
2013-10-01
Expert nurse clinicians who are transitioning into academic positions after successful clinical careers often find they are unprepared to assume their new educator roles. Although nursing clinical expertise may be a necessary expectation, this knowledge is not sufficient to assume a nurse educator position. The purpose of this study was to identify essential entry-level nurse educator competencies, as reported by nurse administrators of accredited prelicensure nursing programs in the United States. Responses were categorized according to the type of academic institution housing the prelicensure nursing program and type of entry-level nurse educator position. A total of 374 program administrators representing 48 states participated, for a 44% response rate. The results indicate that administrators expect entry-level nurse educators to acquire teaching competencies prior to obtaining an entry-level position. Expected proficiency levels of competencies differed based on the position type and the academic setting. Copyright 2013, SLACK Incorporated.
Stochastic Approximation Methods for Latent Regression Item Response Models
ERIC Educational Resources Information Center
von Davier, Matthias; Sinharay, Sandip
2010-01-01
This article presents an application of a stochastic approximation expectation maximization (EM) algorithm using a Metropolis-Hastings (MH) sampler to estimate the parameters of an item response latent regression model. Latent regression item response models are extensions of item response theory (IRT) to a latent variable model with covariates…
Kohrt, Brandon A.; Jordans, Mark J.D.; Rai, Sauharda; Shrestha, Pragya; Luitel, Nagendra P.; Ramaiya, Megan; Singla, Daisy; Patel, Vikram
2015-01-01
Lack of reliable and valid measures of therapist competence is a barrier to dissemination and implementation of psychological treatments in global mental health. We developed the ENhancing Assessment of Common Therapeutic factors (ENACT) rating scale for training and supervision across settings varied by culture and access to mental health resources. We employed a four-step process in Nepal: (1) Item generation: We extracted 1,081 items (grouped into 104 domains) from 56 existing tools; role-plays with Nepali therapists generated 11 additional domains. (2) Item relevance: From the 115 domains, Nepali therapists selected 49 domains of therapeutic importance and high comprehensibility. (3) Item utility: We piloted the ENACT scale through rating role-play videotapes, patient session transcripts, and live observations of primary care workers in trainings for psychological treatments and the Mental Health Gap Action Programme (mhGAP). (4) Inter-rater reliability was acceptable for experts (intraclass correlation coefficient, ICC(2,7)=0.88 (95% confidence interval (CI) 0.81—0.93), N=7) and non-specialists (ICC(1,3)=0.67 (95% CI 0.60—0.73), N=34). In sum, the ENACT scale is an 18-item assessment for common factors in psychological treatments, including task-sharing initiatives with non-specialists across cultural settings. Further research is needed to evaluate applications for therapy quality and association with patient outcomes. PMID:25847276
Sense of competence in dementia care staff (SCIDS) scale: development, reliability, and validity.
Schepers, Astrid Kristine; Orrell, Martin; Shanahan, Niamh; Spector, Aimee
2012-07-01
Sense of competence in dementia care staff (SCIDS) may be associated with more positive attitudes to dementia among care staff and better outcomes for those being cared for. There is a need for a reliable and valid measure of sense of competence specific to dementia care staff. This study describes the development and evaluation of a measure to assess "sense of competence" in dementia care staff and reports on its psychometric properties. The systematic measure development process involved care staff and experts. For item selection and assessment of psychometric properties, a pilot study (N = 37) and a large-scale study (N = 211) with a test-retest reliability (N = 58) sub-study were undertaken. The final measure consists of 17 items across four subscales with acceptable to good internal consistency and moderate to substantial test-retest reliability. As predicted, the measure was positively associated with work experience, job satisfaction, and person-centered approaches to dementia care, giving a first indication for its validity. The SCIDS scale provides a useful and user-friendly means of measuring sense of competence in care staff. It has been developed using a robust process and has adequate psychometric properties. Further exploration of the construct and the scale's validity is warranted. It may be useful to assess the impact of training and perceived abilities and skills in dementia care.
Reconciling findings of emotion-induced memory enhancement and impairment of preceding items
Knight, Marisa; Mather, Mara
2009-01-01
A large body of work reveals that people remember emotionally arousing information better than neutral information. However, previous research reveals contradictory effects of emotional events on memory for neutral events that precede or follow them: in some studies emotionally arousing items impair memory for immediately preceding or following items and in others arousing items enhance memory for preceding items. By demonstrating both emotion-induced enhancement and impairment, Experiments 1 and 2 clarified the conditions under which these effects are likely to occur. The results suggest that emotion-induced enhancement is most likely to occur for neutral items that: (1) precede (and so are poised to predict the onset of) emotionally arousing items, (2) have high attentional weights at encoding, and (3) are tested after a delay period of a week rather than within the same experiment session. In contrast, emotion-induced impairment is most likely to occur for neutral items near the onset of emotional arousal that are overshadowed by highly activated competing items during encoding. PMID:20001121
An Analysis of Intercultural Communicative Competence: Hotel Front Office Personnel in Bangkok
ERIC Educational Resources Information Center
Inkaew, Manachai
2016-01-01
When we consider a strategy for dealing with globalization, it can be seen that intercultural interactions and encounters are very important and appropriate as effective outcomes are expected. Therefore, the need to assess the intercultural communicative competence (ICC) of those expected to achieve these outcomes is worth consideration. This…
Vukovic, Dejana; Bjegovic-Mikanovic, Vesna; Otok, Robert; Czabanowska, Katarzyna; Nikolic, Zeljka; Laaser, Ulrich
2014-02-01
To explore largely unknown experience and expectations of European employers of public health professionals with regard to competences required to perform in the best way for the public health. A survey targeting employers in Europe was carried out September 2011–October 2012. The web-based questionnaire on public health competences and expected performance levels was returned by 63 organisations out of 109 contacted (57.8 %) as provided by Schools and Departments of Public Health (SDPH) in 30 European countries. The assessment of the current and desired levels of performance did not show significant differences between employer categories. However, current and desired levels across all employers differ significantly (p < 0.001), varying around a difference of one rank of a five-point scale. On the other hand, SDPH rank the exit qualifications of their graduates with one exception (presumed competences in preparedness for public health emergencies) higher than the current performance level as determined by employers, i.e. closer to their expectations. SDPH should reconsider priorities and question their estimate of exit qualifications in close contact with potential employers of their graduates.
Prescribing behavior of general practitioners: competition matters.
Schaumans, Catherine
2015-04-01
General Practitioners (GP) have limited means to compete. As quality is hard to observe by patients, GPs have incentives to signal quality by using instruments patients perceive as quality. I investigate whether GPs prescribe more units when confronted with more competition. As there is no monetary benefit in doing so, this type of (perceived) quality competition originates from GPs satisfying patients' expectations. Market level data on per capita and per contact number of items prescribed by GPs is studied for the Belgian market of General Practitioners. I hypothesize that GP competition has a positive impact on the prescribed volume, after controlling for medical needs and GP characteristics. Properly controlling for medical needs implies the use of a two-stage linear regression model. The analysis indicates that a higher number of GPs per capita results in a higher number of units prescribed by GPs, both per capita and per contact. This is consistent with quality competition in the GP market, while inconsistent with alternatives explanations (GP scarcity, GP inducement and GP dispersing prescription in time). GPs prescribe more units when there is more competition to satisfy patients' expectations. The paper thus presents empirical evidence of (perceived) quality competition. Copyright © 2015 Elsevier Ireland Ltd. All rights reserved.
Kiljunen, Outi; Kankkunen, Päivi; Partanen, Pirjo; Välimäki, Tarja
2017-11-22
Structural and cultural changes in the care of older people have influenced nursing practice, creating a need to identify current competency requirements for nurses working in care homes. Family members have an important role in ensuring the well-being of older people living in care homes, and family members' can provide valuable information about competence requirements. To explore the expectations of the care home residents' family members regarding the competence of nurses in care homes for older people. A qualitative descriptive design was used. Semi-structured interviews were conducted with 18 care home residents' family members between March and September 2016. Participants were recruited with help from regional associations and member associations of The Central Association of Carers in Finland and from regional associations of The Alzheimer's Society of Finland. The snowball technique was also used. The data were analysed using inductive content analysis. Ethics committee approval was obtained from the university committee on research ethics, and written informed consent was obtained from participants. The care home residents' family members expected that nurses would be able to interact with and treat people respectfully. Reflective collaboration between the nurse and a family member was also emphasised. Family members expected nurses to provide high-quality basic care and nursing and support residents' well-being individually and holistically. Family members' expectations reflect the need for ethical and interactional competence in the care home. In addition, evidence-based practice competencies are required to provide high-quality care. Nurses' ability to provide person-centred, individual and holistic care is vital to ensure care home residents' well-being. © 2017 Nordic College of Caring Science.
Naming and Categorization in Healthy Participants: Crowded Domains and Blurred Effects of Gender.
Moreno-Martínez, Francisco Javier; Moratilla-Pérez, Iván
2016-09-20
The study of category-specific effects has produced compelling insights into the structure, organization and functioning of cognitive processes. According to some accounts, the greater intra-category structural similarity for living things (LT) contributes to faster access to superordinate pictorial information, making LT easier to classify than structurally dissimilar items (i.e., nonliving things: NLT). Conversely, LT would be harder to name than NLT, as they must compete with within-domain structurally similar items in order to be properly discriminated. Additionally, it has been reported that men perform better with NLT than women, whereas women surpass men with LT but the reasons for this remain unclear. In the current study, we explored both the visual crowding hypothesis and the effects of gender by testing the performance of 40 healthy participants in classification and naming tasks. Analyses revealed that LT were classified significantly faster than NLT (η p 2 = .11), but named significantly slower (η p 2 = .25). Interestingly, the same results persisted after removing atypical categories that are known to distort the interpretation of data from the analyses. Moreover, we did not find the expected effects of gender. Men were more accurate than women naming NLT (η p 2 = .13), and women did not surpass men in any task.
Assessment of adolescents' motivation for educational attainment.
Cham, Heining; Hughes, Jan N; West, Stephen G; Im, Myung Hee
2014-06-01
The Adolescent Motivation for Educational Attainment Questionnaire is a 32-item questionnaire (we drew 20 items from 3 subscales of the Educational Motivation Questionnaire; Murdock, 1999) that was developed to measure multiple potential dimensions of adolescents' motivation to complete high school and enroll in post-secondary education, including competence and effort beliefs; perceived value of education; and peer, teacher, and parent support for educational attainment. We assessed a multiethnic sample (N = 569) of low-achieving students who started 1st grade together in 1 urban and 2 small city school districts. Participants were assessed over 2 consecutive years (Grades 8 and 9 given prior grade retention, or Grades 9 and 10 if not retained). Exploratory factor analyses identified 4 correlated dimensions underlying the questionnaire responses. Subsequent confirmatory factor analyses provided support for a bifactor model, which includes a general factor of students' basic educational motivation, and specific factors of (a) teacher educational expectations, (b) peer aspirations, and (c) value of education. Measurement invariance of the bifactor model was established across students' gender and ethnicity (Caucasian, African American, and Hispanic) and year of testing. Criterion-related validity of the general and specific factors with students' school belonging, student-teacher warmth and conflict, disciplinary practices, letter grade, conduct problems, and behavioral engagement was examined. Practical implications of the measure are discussed.
Assessment of Adolescents’ Motivation for Educational Attainment
Cham, Heining; Hughes, Jan N.; West, Stephen G.; Im, Myung Hee
2015-01-01
The Adolescent Motivation for Educational Attainment Questionnaire is a 32-item questionnaire (we drew 20 items from 3 subscales of the Educational Motivation Questionnaire; Murdock, 1999) that was developed to measure multiple potential dimensions of adolescents’ motivation to complete high school and enroll in post-secondary education, including competence and effort beliefs; perceived value of education; and peer, teacher, and parent support for educational attainment. We assessed a multiethnic sample (N = 569) of low-achieving students who started 1st grade together in 1 urban and 2 small city school districts. Participants were assessed over 2 consecutive years (Grades 8 and 9 given prior grade retention, or Grades 9 and 10 if not retained). Exploratory factor analyses identified 4 correlated dimensions underlying the questionnaire responses. Subsequent confirmatory factor analyses provided support for a bifactor model, which includes a general factor of students’ basic educational motivation, and specific factors of (a) teacher educational expectations, (b) peer aspirations, and (c) value of education. Measurement invariance of the bifactor model was established across students’ gender and ethnicity (Caucasian, African American, and Hispanic) and year of testing. Criterion-related validity of the general and specific factors with students’ school belonging, student–teacher warmth and conflict, disciplinary practices, letter grade, conduct problems, and behavioral engagement was examined. Practical implications of the measure are discussed. PMID:24588748
Dojeiji, Sue; Byszewski, Anna; Wood, Tim
2015-01-01
There is a paucity of evidence-based literature on the essential communication and collaboration skills to guide health care teams in conducting and assessing their performance in the Family Conference (FC). The authors developed and collected validity evidence for a rating scale of team FC performance, the Family Conference Rating Scale (FCRS). In phase 1, essential FC communication and collaboration skills were identified through a review of existing communication tools and literature on team functioning; a draft 34-item scale was developed. In phase 2, the scale was narrowed to a 6-category, 9-point scale with descriptors of expected behaviours through an iterative process: testing of the scale on 10 FC transcripts by two experts, soliciting feedback from a focus group of seven health care providers, and testing by non-experts on 49 live FCs. In phase 3, scores on the revised scale were validated by 10 health care providers from different disciplines by rating three videos of FCs of variable quality. Raters were able to detect inter-video variation in FC quality. The reliability of the FCRS was 0.95 and the inter-rater reliability, 0.68. The FCRS may enhance the ability of health professions educators to teach and assess interprofessional patient-centred communication and collaboration competencies.
A psychometric evaluation of an advanced pharmacy practice experience clinical competency framework.
Douglas Ried, L; Doty, Randell E; Nemire, Ruth E
2015-03-25
To assess the psychometric properties of the clinical competency framework known as the System of Universal Clinical Competency Evaluation in the Sunshine State (SUCCESS), including its internal consistency and content, construct, and criterion validity. Sub-competency items within each hypothesized competency pair were subjected to principal components factor analysis to demonstrate convergent and discriminant validity. Varimax rotation was conducted for each competency pair (eg, competency 1 vs competency 2, competency 1 vs competency 3, competency 2 vs competency 3). Internal consistency was evaluated using Cronbach alpha. Of the initial 78 pairings, 44 (56%) demonstrated convergent and discriminant validity. Five pairs of competencies were unidimensional. Of the 34 pairs where at least 1 competency was multidimensional, most (91%) were from competencies 7, 11, and 12, indicating modifications were warranted in those competencies. After reconfiguring the competencies, 76 (94%) of the 81 pairs resulted in 2 factors as required. A unidimensional factor emerged when all 13 of the competencies were entered into a factor analysis. The internal consistency of all of the competencies was satisfactory. Psychometric evaluation shows the SUCCESS framework demonstrates adequate reliability and validity for most competencies. However, it also provides guidance where improvements are needed as part of a continuous quality improvement program.
What Does it Mean to Know a Language, Or How Do You Get Someone to Perform His Competence?
ERIC Educational Resources Information Center
Spolsky, Bernard
Fries' definition of knowing a language rejects the layman's notion that the criterion is knowing a certain number of words. It involves, rather, knowing a set of items--sound segments, sentence patterns, lexical items--which must be made a matter of automatic habit. Various approaches to testing someone's use of a language have failed to take…
A Student Assessment Tool for Standardized Patient Simulations (SAT-SPS): Psychometric analysis.
Castro-Yuste, Cristina; García-Cabanillas, María José; Rodríguez-Cornejo, María Jesús; Carnicer-Fuentes, Concepción; Paloma-Castro, Olga; Moreno-Corral, Luis Javier
2018-05-01
The evaluation of the level of clinical competence acquired by the student is a complex process that must meet various requirements to ensure its quality. The psychometric analysis of the data collected by the assessment tools used is a fundamental aspect to guarantee the student's competence level. To conduct a psychometric analysis of an instrument which assesses clinical competence in nursing students at simulation stations with standardized patients in OSCE-format tests. The construct of clinical competence was operationalized as a set of observable and measurable behaviors, measured by the newly-created Student Assessment Tool for Standardized Patient Simulations (SAT-SPS), which was comprised of 27 items. The categories assigned to the items were 'incorrect or not performed' (0), 'acceptable' (1), and 'correct' (2). 499 nursing students. Data were collected by two independent observers during the assessment of the students' performance at a four-station OSCE with standardized patients. Descriptive statistics were used to summarize the variables. The difficulty levels and floor and ceiling effects were determined for each item. Reliability was analyzed using internal consistency and inter-observer reliability. The validity analysis was performed considering face validity, content and construct validity (through exploratory factor analysis), and criterion validity. Internal reliability and inter-observer reliability were higher than 0.80. The construct validity analysis suggested a three-factor model accounting for 37.1% of the variance. These three factors were named 'Nursing process', 'Communication skills', and 'Safe practice'. A significant correlation was found between the scores obtained and the students' grades in general, as well as with the grades obtained in subjects with clinical content. The assessment tool has proven to be sufficiently reliable and valid for the assessment of the clinical competence of nursing students using standardized patients. This tool has three main components: the nursing process, communication skills, and safety management. Copyright © 2018 Elsevier Ltd. All rights reserved.
ERIC Educational Resources Information Center
Ahmad, Shaharuddin; Ishak, Noriah Mohd; Ismail, Khaidzir; Selamat, Jumali
2010-01-01
Generic competency is an instrument to assess and measure personal trait of students using 13 constructs with 102 items. Students' abilities to master each of the 13 constructs are very important in order for them to improve their marketability values. This is because nowadays employer is not only looking at the academic intellectual but the most…
ERIC Educational Resources Information Center
Tondeur, Jo; Aesaert, Koen; Pynoo, Bram; van Braak, Johan; Fraeyman, Norbert; Erstad, Ola
2017-01-01
The main objective of this study is to develop a self-report instrument to measure preservice teachers' ICT competencies in education. The questionnaire items of this instrument are based on an existing comprehensive framework and were created with input from experts in the field. The data were collected from a sample of 931 final-year preservice…
Ohde, Sachiko; Deshpande, Gautam A; Takahashi, Osamu; Fukui, Tsuguya
2014-07-12
In Japan, all trainee physicians must begin clinical practice in a standardized, mandatory junior residency program, which encompasses the first two years of post-graduate medical training (PGY1 - PGY2). Implemented in 2004 to foster primary care skills, the comprehensive rotation program (CRP) requires junior residents to spend 14 months rotating through a comprehensive array of clinical departments including internal medicine, surgery, anesthesiology, obstetrics-gynecology (OBGYN), pediatrics, psychiatry, and rural medicine. In 2010, Japan's health ministry relaxed this curricular requirement, allowing training programs to offer a limited rotation program (LRP), in which core departments constitute 10 months of training, with electives geared towards residents' choice of career specialty comprising the remaining 14 months. The effectiveness of primary care skill acquisition during early training warrants evaluation. This study assesses self-reported confidence with clinical competencies, as well as case experience, between residents in CRP versus LRP curricula. A nation-wide cross-sectional study of all PGY2 physicians in Japan was conducted in March 2011. Primary outcomes were self-report confidence for 98 clinical competency items, and number of cases experienced for 85 common diseases. We compared confidence scores and case experience between residents in CRP and LRP programs, adjusting for parameters relevant to training. Among 7506 PGY2 residents, 5052 replied to the survey (67.3%). Of 98 clinical competency items, CRP residents reported higher confidence in 12 items compared to those in an LRP curriculum, 10 of which remained significantly higher after adjustment. CRP trainees reported lower confidence scores in none of the items. Out of 85 diseases, LRP residents reported less experience with 11 diseases. CRP trainees reported lower case experience with one disease, though this did not remain significant on adjusted analysis. Confidence and case experience with OBGYN- and pediatrics-related items were particularly low among LRP trainees. Residents in the specialty-oriented LRP curriculum showed less confidence and less case experience compared to peers training in the broader CRP residency curriculum. In order to foster competence in independent primary care practice, junior residency programs requiring experience in a breadth of core departments should continue to be mandated to ensure adequate primary care skills.
Developing criterion-based competencies for tele-intensive care unit.
Schleifer, Sarah Joy; Carroll, Karen; Moseley, Marthe J
2014-01-01
Over the last 5 years, telemedicine has developed nursing roles that differ from traditional bedside care. In the midst of this transition, current competency development models focused on task completion may not be the most effective form of proficiency validation. The procedure of competency creation for the role of tele-intensive care unit registered nurse requires a thoughtful process using stakeholders from institutional leadership to frontline staff. The process must include stakeholder approval to ensure appropriate buy-in and follow-through on the agreed-upon criteria. This can be achieved using a standardized method of concept stimulation related to the behaviors, not a memorized list of tasks, expected of a telemedicine registered nurse. This process serves as the foundation for the development of criterion-based competency statements that then allows for clearer expectations. Continually reviewing the written competencies, ensuring current applicability, and revising as needed are necessities for maintaining competence and, therefore, patient safety.
Lai, N; Nalliah, S; Jutti, R C; Hla, Y; Lim, V K E
2009-08-01
The educational environment is widely considered to be a major factor affecting students' motivation and learning outcomes. Although students' perceptions of their educational environment are often reported, we are unaware of any published reports that relate this information to students' clinical competence, either self-perceived or objectively measured. We aimed to correlate students' perceptions of their learning environment and their self-perceived competence in clinical, practical and personal skills, using validated scales. Subjects included a cohort of 71 final-year medical students who were posted to a peripheral campus affiliated with a district hospital. Two questionnaires were administered concurrently: a modified DREEM (50 items) to assess the learning environment and an abbreviated IMU Student Competency Survey (29 items) to examine self-perceived competence across a wide range of skills and work-readiness. We correlated the major domains in both surveys using Spearman's Correlation. Fifty-nine students (83%) completed the questionnaires. Comparing correlations of the five major domains of the modified DREEM questionnaire ("Perception of learning", "Perception of teachers", "Academic self-perception", "Perception of atmosphere" and "Social self-perception") with all subscales in the abbreviated IMU Student Competency Survey (clinical, practical, personal skills and overall work-readiness), we found that academic self-perception domain had the strongest correlations (r:0.405 to 0.579, p:0.002 to < 0.001) and perception of teachers bears the weakest correlations (r:0.171 to 0.284, p:0.254 to 0.031). Self-perceived competence in practical skills in the IMU Student Competency Survey correlated the weakest with all domains of the modified DREEM (r:0.206 to 0.405, p:0.124 to 0.002). The overall weak-to-moderate correlations between perceptions of learning environment and self-perceived clinical competence suggest that other factors might interact with the learning environment to determine students' confidence and achievements.
Schmidt-Huber, Marion; Netzel, Janine; Kiesewetter, Jan
2017-01-01
Background and objective: There is a need for young physicians to take a responsible role in clinical teams, comparable to a leadership role. However, today’s medical curricula barely consider the development of leadership competencies. Acquisition of leadership skills are currently a by-product of medical education, even though it seems to be a competency relevant for physicians’ success. Therefore, an innovative leadership training program for young physicians was developed and validated. Training conceptualisation were based upon findings of critical incidents interviews (N=19) with relevant personnel (e.g. experienced doctors/nurses, residents) and upon evidence-based leadership contents focusing on ethical leadership behaviors. Method: The training consists of four sessions (3-4 hours each) and provided evidence-based lectures of leadership theory and effective leader behaviors, interactive training elements and a simulation-based approach with professional role players focusing on interprofessional collaboration with care staff. Training evaluation was assessed twice after completion of the program (N=37). Assessments included items from validated and approved evaluation instruments regarding diverse learning outcomes (satisfaction/reaction, learning, self-efficacy, and application/transfer) and transfer indicators. Furthermore, training success predictors were assessed based on stepwise regression analysis. In addition, long-term trainings effects and behavioral changes were analysed. Results: Various learning outcomes are achieved (self-reported training satisfaction, usefulness of the content and learning effects) and results show substantial transfer effects of the training contents and a strengthened awareness for the leadership role (e.g. self-confidence, ideas dealing with work-related problems in a role as responsible physician). We identified competence of trainer, training of applied tools, awareness of job expectations, and the opportunity to learn from experiences of other participants as predictors of training success. Additionally, we found long-term training effects and participants reported an increase in specific competencies, relevant for effective interprofessional collaboration (active perspective-taking, communication, conflict management, personal competencies). Conclusion: The training of leadership competencies for young physicians seems feasible to develop constructive influence strategies for a successful interprofessional collaboration in early career stages. The simulation-based approach is beneficial for residents to practice leadership behaviour in realistic job situations. PMID:28890925
Schmidt-Huber, Marion; Netzel, Janine; Kiesewetter, Jan
2017-01-01
Background and objective: There is a need for young physicians to take a responsible role in clinical teams, comparable to a leadership role. However, today's medical curricula barely consider the development of leadership competencies. Acquisition of leadership skills are currently a by-product of medical education, even though it seems to be a competency relevant for physicians' success. Therefore, an innovative leadership training program for young physicians was developed and validated. Training conceptualisation were based upon findings of critical incidents interviews ( N =19) with relevant personnel (e.g. experienced doctors/nurses, residents) and upon evidence-based leadership contents focusing on ethical leadership behaviors. Method: The training consists of four sessions (3-4 hours each) and provided evidence-based lectures of leadership theory and effective leader behaviors, interactive training elements and a simulation-based approach with professional role players focusing on interprofessional collaboration with care staff. Training evaluation was assessed twice after completion of the program ( N =37). Assessments included items from validated and approved evaluation instruments regarding diverse learning outcomes (satisfaction/reaction, learning, self-efficacy, and application/transfer) and transfer indicators. Furthermore, training success predictors were assessed based on stepwise regression analysis. In addition, long-term trainings effects and behavioral changes were analysed. Results: Various learning outcomes are achieved (self-reported training satisfaction, usefulness of the content and learning effects) and results show substantial transfer effects of the training contents and a strengthened awareness for the leadership role (e.g. self-confidence, ideas dealing with work-related problems in a role as responsible physician). We identified competence of trainer, training of applied tools, awareness of job expectations, and the opportunity to learn from experiences of other participants as predictors of training success. Additionally, we found long-term training effects and participants reported an increase in specific competencies, relevant for effective interprofessional collaboration (active perspective-taking, communication, conflict management, personal competencies). Conclusion: The training of leadership competencies for young physicians seems feasible to develop constructive influence strategies for a successful interprofessional collaboration in early career stages. The simulation-based approach is beneficial for residents to practice leadership behaviour in realistic job situations.
Malaysian dental graduates' competence in holistic care: what do graduates and employers think?
Yusof, Zamros Y M; Jaafar, Nasruddin; Jallaludin, Raja-Latifah R; Abu-Hassan, Mohamed I; Razak, Ishak A
2010-12-01
The purpose of this study was to explore the University of Malaya (UM) dental graduates' competence in holistic care in real settings from the employers' and graduates' perspectives. A self-administered questionnaire consisting of ten domains was sent to thirty senior dental officers of the Ministry of Health (MOH) and 164 UM graduates. In this article, nineteen major competencies that best represent the graduates' competence in the provision of holistic care are discussed. Each competency was rated on a scale of 1 (very poor) to 4 (very good) and was categorized as "poor and of major concern" (if less than 60 percent of respondents scored good or very good), "satisfactory and of minor concern" (60-69 percent), or "excellent" (70 percent and above). One hundred and six out of 164 graduates (64.6 percent) and twenty-nine out of thirty employers (96.7 percent) responded. Overall, the employers rated the graduates lower than what the graduates rated themselves on all items. While the graduates felt they were excellent and satisfactory in sixteen out of nineteen items (84.2 percent), the employers felt they were poor in fourteen out of nineteen (73.7 percent). Both groups agreed that the graduates were excellent in communication, but poor in life-saving skills, obtaining patient's family and psychosocial histories, and recognizing signs and symptoms (not intraoral) indicating the presence of a systemic disease. In conclusion, although the graduates felt competent in the majority of the holistic care competencies, the employers had some reservations over such claims. Outcomes of the study led to recommendations to incorporate longer community-based learning hours, an improved behavioral science component, a module for special care patients, and multidepartmental collaborative teachings in the new integrated program aimed for implementation in 2011.
Applying Bayesian Item Selection Approaches to Adaptive Tests Using Polytomous Items
ERIC Educational Resources Information Center
Penfield, Randall D.
2006-01-01
This study applied the maximum expected information (MEI) and the maximum posterior-weighted information (MPI) approaches of computer adaptive testing item selection to the case of a test using polytomous items following the partial credit model. The MEI and MPI approaches are described. A simulation study compared the efficiency of ability…
Using Item Response Theory to Describe the Nonverbal Literacy Assessment (NVLA)
ERIC Educational Resources Information Center
Fleming, Danielle; Wilson, Mark; Ahlgrim-Delzell, Lynn
2018-01-01
The Nonverbal Literacy Assessment (NVLA) is a literacy assessment designed for students with significant intellectual disabilities. The 218-item test was initially examined using confirmatory factor analysis. This method showed that the test worked as expected, but the items loaded onto a single factor. This article uses item response theory to…
Grilo Diogo, Pedro; Barbosa, Joselina; Ferreira, Maria Amélia
2015-12-19
The Tuning Project is an initiative funded by the European Commission that developed core competences for primary medical degrees in Europe. Students' grouped self-assessments are used for program evaluation and improvement of curricula. The TEST study aimed to assess how do Portuguese medical graduates self-assess their acquisition of core competences and experiences of contact with patients in core settings according to the Tuning framework. Translation of the Tuning's competences (Clinical Practice - CP), Knowledge (K) items and Clinical Settings (CS) was performed. Questionnaires were created in paper and electronic formats and distributed to 1591 graduates from seven Portuguese medical schools (July 2014). Items were rated in a 6-point Likert scale (0-5) of levels of competence. Exploratory factor analysis (EFA) was conducted and Cronbach's alpha was used to evaluate the internal consistency of the questionnaire. Kruskal-Wallis and Dunn's tests were used for multiple comparisons. Three hundred eighty seven questionnaires were analyzed, corresponding to 24% of the target population. EFA yielded an 11-factor solution for CP and a 6-factor solution for K items. The median value of CP factors was 2.8 (p25 = 2.0; p75 = 3.5) and the median value of K factors was 2.6 (2.0; 3.2). Factor scores ranged from 1.3 (Legal principles) to 4.0 (Ethical principles). Clinical presentations, psychological aspects of illness, evidence-based medicine and promotion of health showed the highest results. Lower scores were detected in medical emergencies, practical procedures, prescribing drugs and legal principles. More than 90% of graduates experienced having contact with patients in 8 CS but only 24% of graduates had contact in all 14 CS. Graduates had the least contact with patients in the emergency rooms, intensive care units, palliative, rehabilitation and anesthetic care. Significant differences (p < 0.05) among schools were detected in 8 factors and 7 settings. We developed a valid questionnaire supporting national SWOT analysis on the acquisition of core competences in medical education. Results suggest that Portuguese graduates are not fully prepared for clinical practice. Curricular improvements in core competences and the educational development of the transition period between undergraduate and postgraduate education ought to be considered. Outcome-based program evaluation relying on graduates' grouped self-assessments contributes to inform changes in medical education.
Wood, Dana; Kurtz-Costes, Beth; Okeke-Adeyanju, Ndidi; Rowley, Stephanie J.
2010-01-01
The role of African American mothers’ academic gender stereotype endorsement in shaping achievement-related expectations for and perceptions of their own children was examined. Mothers (N = 334) of 7th and 8th graders completed measures of expectations for their children’s future educational attainment, perceptions of their children’s academic competence, and academic gender stereotypes. Consistent with hypotheses, mothers held less favorable expectations for sons and perceived sons to be less academically competent than daughters. In addition, mothers reported stereotypes favoring girls over boys in academic domains; stereotype endorsement, in turn, was related to mothers’ educational expectations for and beliefs about the academic competence of their own children, even with youths’ actual achievement controlled. Negative stereotypes about the academic abilities of African American boys may create a negative feedback loop, thereby contributing to the maintenance of the gender gap in African Americans’ educational outcomes. PMID:20648228
Wood, Dana; Kurtz-Costes, Beth; Okeke-Adeyanju, Ndidi; Rowley, Stephanie J
2009-05-01
The role of African American mothers' academic gender stereotype endorsement in shaping achievement-related expectations for and perceptions of their own children was examined. Mothers (N = 334) of 7th and 8th graders completed measures of expectations for their children's future educational attainment, perceptions of their children's academic competence, and academic gender stereotypes. Consistent with hypotheses, mothers held less favorable expectations for sons and perceived sons to be less academically competent than daughters. In addition, mothers reported stereotypes favoring girls over boys in academic domains; stereotype endorsement, in turn, was related to mothers' educational expectations for and beliefs about the academic competence of their own children, even with youths' actual achievement controlled. Negative stereotypes about the academic abilities of African American boys may create a negative feedback loop, thereby contributing to the maintenance of the gender gap in African Americans' educational outcomes.
Lai, N M; Sivalingam, N; Ramesh, J C
2007-11-01
We evaluated the progress in the self-perceived competence of medical students in a range of common clinical, practical and personal skills, in their final six months of training. The study was conducted on 65 final-year medical students undertaking their senior clerkship training at International Medical University, Malaysia. Questionnaire surveys were conducted at the beginning and the end of the six-month period, with 44 items covering clinical, practical, personal skills and readiness to work. Correlations were performed for experience and self-perceived competence, with the respective skills. 64 students returned the first survey and 63 returned the second survey. When the two survey results were compared, significant increases were found in self-perceived competence for the majority of the skills examined. The items with no significant improvement were divided into those which the students were already proficient in before senior clerkship, and those in which experience and confidence remained poor at the end of training. There were significant, but moderate, correlations between the experience and confidence of all common practical skills (correlation coefficients: 0.348-0.522, p-value is less than 0.001 for all items). At the end of training, students were, in general, more prepared to work as house officers (mean rating in the first survey: 3.05, second survey: 3.97, p-value is less than 0.001). Significant progresses in clinical experience and confidence can be observed in the final stages of medical training. The findings of inadequate improvements in some skills call for dedicated training sessions and strengthening of on-site supervision.
Mancuso, Carol A; Wentzel, Catherine H; Ghomrawi, Hassan M K; Kelly, Bryan T
2017-05-01
To develop a patient-derived expectations survey for hip preservation surgery. Patients were eligible if they were undergoing primary hip surgery and were recruited in person or by telephone. The survey was developed in 3 phases. During phase 1, 64 patients were interviewed preoperatively and asked open-ended questions about their expectations of surgery; a draft survey was assembled by categorizing responses. During phase 2, the survey was administered twice to another group of 50 patients preoperatively to assess test-retest reliability and concordance was measured with weighted kappa values and intraclass correlations. All patients also completed valid standard hip surveys electronically. During phase 3, final items were selected, factor analysis was performed, and a scoring system was developed. In phase 1, 509 expectations were volunteered from which 21 distinct categories were discerned and became the items for the draft survey. In phase 2, the draft survey was completed twice, 4 days apart. In phase 3, all 21 items were retained for the final survey addressing pain, mobility, sports, resumption of active lifestyles, future function, and psychological well-being. An overall score is calculated from the number of items expected and the amount of improvement expected, and ranges from 0 to 100; higher is more expectations. For phase 2 patients, mean scores for both administrations were 82, Cronbach alpha coefficients were 0.88 and 0.91, and the intraclass correlation was 0.92. A higher score (i.e., greater expectations) was associated with worse hip condition measured by standard hip surveys (P ≤ .05). We developed a patient-derived survey that is valid, reliable, and addresses a spectrum of expectations. The survey generates an overall score that is easy to calculate and interpret and offers a practical and comprehensive way to record patients' preoperative expectations. Level II, prognostic study, prospective sample. Copyright © 2016 Arthroscopy Association of North America. Published by Elsevier Inc. All rights reserved.
ERIC Educational Resources Information Center
Ogelman, Hulya Gulay; Seven, Serdal
2012-01-01
The purpose of this study was to investigate the effect social information processing levels has on the social competence (entering a peer group, response towards provocation, response to failure, response to success, social expectations, teacher expectations, reactive aggression, proactive aggression) and peer relationship (prosocial behaviour,…
ERIC Educational Resources Information Center
Academic Senate for California Community Colleges, Sacramento.
This document on Academic Literacies is an update of the original 1982 Statement on Competencies in English Expected of Entering College Freshmen. Incorporating findings from a Web-based survey submitted to faculty across the disciplines at the University of California , the California State Universities, and the California Community Colleges, and…
ERIC Educational Resources Information Center
Academic Senate for California Community Colleges, Sacramento.
These joint statements by the Academic Senates of the California Community Colleges, the California State University, and the University of California address the concern that students are underprepared for college-level work. First, "Statement on Competencies in English and Mathematics Expected of Entering Freshmen," which was prepared…
Measuring adherence and competence of dynamic therapists in the treatment of cocaine dependence
Barber, Jacques P.; Krakauer, Ilana; Calvo, Naomi; Badgio, Peter C.; Faude, Jeffrey
1997-01-01
This article presents the development of a new 82-item rating scale of therapist adherence and competence for supportive-expressive (SE) dynamic psychotherapy for the treatment of cocaine dependence. Sixty- four items are rated for adherence, appropriateness, and quality of prescribed interventions. As part of the pilot/training phase of the National Institute on Drug Abuse Collaborative Cocaine Treatment Study, two independent expert judges rated 32 audiotapes of SE therapy sessions with cocaine-dependent patients, 10 tapes of cognitive therapy (CT) sessions, and 10 tapes of individual drug counseling (IDC) sessions. Reliability was acceptable for adherence but poor for quality and appropriateness. SE therapists used more expressive (interpretative) techniques than did either CT therapists or IDC counselors, and they used more supportive techniques than did IDC counselors. PMID:9058557
Towards a Competency Model: A Review of the Literature and the Competency Standards
ERIC Educational Resources Information Center
El Asame, Maryam; Wakrim, Mohamed
2018-01-01
Competency-based approaches using information and communication technologies have been the main solution of the organization's expectations in all fields (public and private) to increase the products' quality and employees' capacity. Furthermore, the concept of competency can have several different definitions, which may make it difficult to…
Competency Mapping of Teachers in Tertiary Education
ERIC Educational Resources Information Center
Sugumar, V. Raji
2009-01-01
Competency of teachers assumes a lot of importance in the era of knowledge society who are expected to produce students of high calibre. In India however competency development and mapping still remains an unexplored process. Not much study has been done on competency mapping in higher education sector, thus the present study is ventured upon. The…
Examining Perception of Competency through Practicum Competencies Outline
ERIC Educational Resources Information Center
Esposito, Giovanna; Freda, Maria Francesca; Bosco, Valentina
2015-01-01
Purpose: This study aims to examine the self-perceived competencies of 231 Italian students enrolled in a psychological degree program and involved in a practicum. It analyzes the subjective perception of the competences that students expect to develop, acknowledge as developed and that might be inferred from tasks performed during the practicum;…
Three controversies over item disclosure in medical licensure examinations.
Park, Yoon Soo; Yang, Eunbae B
2015-01-01
In response to views on public's right to know, there is growing attention to item disclosure - release of items, answer keys, and performance data to the public - in medical licensure examinations and their potential impact on the test's ability to measure competence and select qualified candidates. Recent debates on this issue have sparked legislative action internationally, including South Korea, with prior discussions among North American countries dating over three decades. The purpose of this study is to identify and analyze three issues associated with item disclosure in medical licensure examinations - 1) fairness and validity, 2) impact on passing levels, and 3) utility of item disclosure - by synthesizing existing literature in relation to standards in testing. Historically, the controversy over item disclosure has centered on fairness and validity. Proponents of item disclosure stress test takers' right to know, while opponents argue from a validity perspective. Item disclosure may bias item characteristics, such as difficulty and discrimination, and has consequences on setting passing levels. To date, there has been limited research on the utility of item disclosure for large scale testing. These issues requires ongoing and careful consideration.
Evaluating cultural competence among Japanese clinical nurses: Analyses of a translated scale.
Noji, Ariko; Mochizuki, Yuki; Nosaki, Akiko; Glaser, Dale; Gonzales, Lucia; Mizobe, Akiko; Kanda, Katsuya
2017-06-01
This paper describes the factor analysis testing and construct validation of the Japanese version of the Caffrey Cultural Competence Health Services (J-CCCHS). The inventory, composed of 28 items, was translated using language and subject matter experts. Psychometric testing (exploratory factor, alpha reliability, and confirmatory factor analyses) was undertaken with nurses (N = 7494, 92% female, mean age 32.6 years) from 19 hospitals across Japan. Principal components extraction with varimax rotation yielded a 5-factor solution (62.31% variance explained) that was labeled: knowledge, comfort-proximal, comfort-distal, awareness, and awareness of national policy. Cronbach α for the subscales ranged from 0.756 to 0.892. In confirmatory factor analysis using the robust maximum likelihood estimator, the chi-square test was as follows: χ 2 (340) = 14604.44, P < .001. After correlated errors were introduced, there was evidence of improved model fit (χ 2 (335) = 8681.61, P < .05) but the other indices showed improvement (RMSEA = .058 [90% CI, 0.057-0.059], TLI = .891, CFI = .903, and SRMR = .059). The discriminating power of the J-CCCHS was indicated by statistically mean differences in J-CCCHS subscale scores between predefined groups. Taking into consideration that this is the first foray into construct validation for this instrument, and that fit was improved when a subsequent data driven model was tested, and it has the ability to distinguish between known groups that are expected to differ in cultural competence, the instrument can be of value to clinicians and educators alike. © 2017 John Wiley & Sons Australia, Ltd.
Starfelt, Louise Charlotte; Young, Ross McD; White, Katherine M; Palk, Gavan
2016-01-01
Alcohol expectancies likely play a role in people's perceptions of alcohol-involved sexual violence. However, no appropriate measure exists to examine this link comprehensively. The aim of this research was to develop an alcohol expectancy measure which captures young adults' beliefs about alcohol's role in sexual aggression and victimization. Two cross-sectional samples of young Australian adults (18-25 years) were recruited for scale development (Phase 1) and scale validation (Phase 2). In Phase 1, participants (N = 201; 38.3% males) completed an online survey with an initial pool of alcohol expectancy items stated in terms of three targets (self, men, women) to identify the scale's factor structure and most effective items. A revised alcohol expectancy scale was then administered online to 322 young adults (39.6% males) in Phase 2. To assess the predictive, convergent, and discriminant validity of the scale, participants also completed established measures of personality, social desirability, alcohol use, general and context-specific alcohol expectancies, and impulsiveness. Principal axis factoring (Phase 1) and confirmatory factor analysis (Phase 2) resulted in a target-equivalent five-factor structure for the final 66-item Drinking Expectancy Sexual Vulnerabilities Questionnaire (DESV-Q). The factors were labeled (1) Sexual Coercion, (2) Sexual Vulnerability, (3) Confidence, (4) Self-Centeredness, and (5) Negative Cognitive and Behavioral Changes. The measure demonstrated effective items, high internal consistency, and satisfactory predictive, convergent, and discriminant validity. The DESV-Q is a purpose-specific instrument that could be used in future research to elucidate people's attributions for alcohol-involved sexual aggression and victimization.
Paradoxical effects of alcohol information on alcohol outcome expectancies.
Krank, Marvin D; Ames, Susan L; Grenard, Jerry L; Schoenfeld, Tara; Stacy, Alan W
2010-07-01
Cognitive associations with alcohol predict both current and future use in youth and young adults. Much cognitive and social cognitive research suggests that exposure to information may have unconscious influences on thinking and behavior. The present study assessed the impact of information statements on the accessibility of alcohol outcome expectancies. The 2 studies reported here investigated the effects of exposure to alcohol statements typical of informational approaches to prevention on the accessibility of alcohol outcome expectancies. High school and university students were presented with information statements about the effects of alcohol and other commercial products. The alcohol statements were taken from expectancy questionnaires. Some of these statements were presented as facts and others as myths. The retention of detailed information about these statements was manipulated by (i) divided attention versus focused attention or (ii) immediate versus delayed testing. Accessibility of personal alcohol outcome expectancies was subsequently measured using an open-ended question about the expected effects of alcohol. Participants reported more alcohol outcomes seen during the information task as personal expectations about the effects of alcohol use than similar unseen items. Paradoxically, myth statements were also more likely to be reported as expectancies than unseen items in all conditions. Additionally, myth statements were generated less often than fact statements only under the condition of immediate testing with strong content processing instructions. These observations are consistent with findings from cognitive research where familiarity in the absence of explicit memory can have an unconscious influence on performance. In particular, the exposure to these items in an informational format increases accessibility of the seen items even when the participants were told that they were myths. The findings have implications for the development of effective prevention materials.
Paradoxical Effects of Alcohol Information on Alcohol Outcome Expectancies
Krank, Marvin D.; Ames, Susan L.; Grenard, Jerry L.; Schoenfeld, Tara; Stacy, Alan W.
2014-01-01
Background Cognitive associations with alcohol predict both current and future use in youth and young adults. Much cognitive and social cognitive research suggests that exposure to information may have unconscious influences on thinking and behavior. The present study assessed the impact of information statements on the accessibility of alcohol outcome expectancies. Methods The 2 studies reported here investigated the effects of exposure to alcohol statements typical of informational approaches to prevention on the accessibility of alcohol outcome expectancies. High school and university students were presented with information statements about the effects of alcohol and other commercial products. The alcohol statements were taken from expectancy questionnaires. Some of these statements were presented as facts and others as myths. The retention of detailed information about these statements was manipulated by (i) divided attention versus focused attention or (ii) immediate versus delayed testing. Accessibility of personal alcohol outcome expectancies was subsequently measured using an open-ended question about the expected effects of alcohol. Results Participants reported more alcohol outcomes seen during the information task as personal expectations about the effects of alcohol use than similar unseen items. Paradoxically, myth statements were also more likely to be reported as expectancies than unseen items in all conditions. Additionally, myth statements were generated less often than fact statements only under the condition of immediate testing with strong content processing instructions. Conclusions These observations are consistent with findings from cognitive research where familiarity in the absence of explicit memory can have an unconscious influence on performance. In particular, the exposure to these items in an informational format increases accessibility of the seen items even when the participants were told that they were myths. The findings have implications for the development of effective prevention materials. PMID:20477773
Research Directions in Database Security IV
1993-07-01
second algorithm, which is based on multiversion timestamp ordering, is that high level transactions can be forced to read arbitrarily old data values...system. The first, the single ver- sion model, stores only the latest veision of each data item, while the second, the 88 multiversion model, stores... Multiversion Database Model In the standard database model, where there is only one version of each data item, all transactions compete for the most recent
ERIC Educational Resources Information Center
Sturges, Diana; Maurer, Trent W.; Allen, Deborah; Gatch, Delena Bell; Shankar, Padmini
2016-01-01
This project used a nonexperimental design with a convenience sample and studied the relationship between academic motivation, grade expectation, and academic performance in 1,210 students enrolled in undergraduate human anatomy and physiology (HAP) classes over a 2-yr period. A 42-item survey that included 28 items of the adapted academic…
Song, Jingjing; Zuo, Bin
2016-01-01
The purpose of the current study was to identify the functional significance of conflicting stereotypes and to identify the dominant category in such conflicts. In the present research we examined the conflicting crossed categories of age and wealth with regard to warmth and competence perceptions. It was found (Pilot Study and Study 1) that the old-rich targets presented a conflicting stereotype group in the perception of warmth, whereas young-poor targets presented a conflicting stereotype group in the perception of competence. In addition, the old stereotype dominated the warmth evaluation of old-rich targets, whereas the poor stereotype dominated the competence evaluation of young-poor targets. In Study 2, participants provided warmth and competence evaluations after they learned about the targets' behaviors which demonstrated high or low warmth and high or low competence. The results suggest that for the warmth evaluation of the old-rich target the category that did not match the behavior (i.e., contradicted the stereotype expectation) was more salient and drove judgments. However, the effect of stereotype expectation violation was not found in the competence evaluation of the young-poor target. The results are discussed in terms of their implications for understanding factors that activate and inhibit stereotyped perceptions. PMID:27818640
ERIC Educational Resources Information Center
Smith, Derrick; Rosenblum, L. Penny
2013-01-01
Introduction: The purpose of the study presented here was the initial validation of a comprehensive set of competencies focused solely on the Nemeth code. Methods: Using the Delphi method, 20 expert panelists were recruited to participate in the study on the basis of their past experience in teaching a university-level course in the Nemeth code.…
Eggleton, Kyle; Goodyear-Smith, Felicity; Henning, Marcus; Jones, Rhys; Shulruf, Boaz
2017-03-01
The aim of this study was to develop an instrument (University of Auckland General Practice Report of Educational Environment: UAGREE) with robust psychometric properties that measured the educational environment of undergraduate primary care. The questions were designed to incorporate measurements of the teaching of cultural competence. Following a structured consensus process and an initial pilot, a list of 55 questions was developed. All Year 5 and 6 students completing a primary care attachment at Auckland University were invited to complete the questionnaire. The results were analysed using exploratory factor analysis and confirmatory factor analysis resulting in a 16-item instrument. Three factors were identified explaining 53% of the variance. The items' reliability within the factors were high (Learning: 0.894; Teaching: 0.871; Cultural competence: 0.857). Multiple groups analysis by gender; and separately across ethnic groups did not find significant differences between groups. UAGREE is a specific instrument measuring the undergraduate primary care educational environment. Its questions fit within established theoretical educational environment frameworks and the incorporation of cultural competence questions reflects the importance of teaching cultural competence within medicine. The psychometric properties of UAGREE suggest that it is a reliable and valid measure of the primary care education environment.
Choi, Jimmy; Fiszdon, Joanna M; Medalia, Alice
2010-09-01
Expectancy-value theory, a widely accepted model of motivation, posits that expectations of success on a learning task and the individual value placed on the task are central determinants of motivation to learn. This is supported by research in healthy controls suggesting that beliefs of self-and-content mastery can be so influential they can predict the degree of improvement on challenging cognitive tasks even more so than general cognitive ability. We examined components of expectancy-value theory (perceived competency and task value), along with baseline arithmetic performance and neuropsychological performance, as possible predictors of learning outcome in a sample of 70 outpatients with schizophrenia randomized to 1 of 2 different arithmetic learning conditions and followed up after 3 months. Results indicated that as with nonpsychiatric samples, perceived self-competency for the learning task was significantly related to perceptions of task value attributed to the learning task. Baseline expectations of success predicted persistence of learning on the task at 3-month follow-up, even after accounting for variance attributable to different arithmetic instruction, baseline arithmetic ability, attention, and self-reports of task interest and task value. We also found that expectation of success is a malleable construct, with posttraining improvements persisting at follow-up. These findings support the notion that expectancy-value theory is operative in schizophrenia. Thus, similar to the nonpsychiatric population, treatment benefits may be enhanced and better maintained if remediation programs also focus on perceptions of self-competency for the training tasks. Treatment issues related to instilling self-efficacy in cognitive recovery programs are discussed.
Age differences in memory control: evidence from updating and retrieval-practice tasks.
Lechuga, Maria Teresa; Moreno, Virginia; Pelegrina, Santiago; Gómez-Ariza, Carlos J; Bajo, Maria Teresa
2006-11-01
Some contemporary approaches suggest that inhibitory mechanisms play an important role in cognitive development. In addition, several authors distinguish between intentional and unintentional inhibitory processes in cognition. We report two experiments aimed at exploring possible developmental changes in these two types of inhibitory mechanisms. In Experiment 1, an updating task was used. This task requires that participants intentionally suppress irrelevant information from working memory. In Experiment 2, the retrieval-practice task was used. Retrieval practice of a subset of studied items is thought to involve unintentional inhibitory processes to overcome interference from competing memories. As a result, suppressed items become forgotten in a later memory test. Results of the experiments indicated that younger children (8) were less efficient than older children (12) and adults at intentionally suppressing information (updating task). However, when the task required unintentional inhibition of competing items (retrieval-practice task), this developmental trend was not found and children and adults showed similar levels of retrieval-induced forgetting. The results are discussed in terms of the development of efficient inhibition and the distinction between intentional and unintentional inhibitions.
ERIC Educational Resources Information Center
Hutchinson, Tom; And Others
This curriculum for technical students aims at linking the identity of the learner, his initial linguistic and technical competence, and his expectations with the competence expected of him on entering the technical college. The materials of the curriculum make use of a wide variety of information and data sources such as school-level science…
ERIC Educational Resources Information Center
Smith, Clifton L.
This guide, developed by a project to revise the minimum core competencies for the advanced marketing course in secondary marketing education in Missouri, contains four sections. The first section explains competency-based marketing education, including its mission, nature, curriculum, and the fundamentals of competency-based instruction. The…
ERIC Educational Resources Information Center
Smith, Clifton L.
This guide, developed by a project to revise the minimum core competencies for the Fundamentals of Marketing course in secondary marketing education in Missouri, contains four sections. The first section explains competency-based marketing education, including its mission, nature, curriculum, and the fundamentals of competency-based instruction.…
The assessment of pathologists/laboratory medicine physicians through a multisource feedback tool.
Lockyer, Jocelyn M; Violato, Claudio; Fidler, Herta; Alakija, Pauline
2009-08-01
There is increasing interest in ensuring that physicians demonstrate the full range of Accreditation Council for Graduate Medical Education competencies. To determine whether it is possible to develop a feasible and reliable multisource feedback instrument for pathologists and laboratory medicine physicians. Surveys with 39, 30, and 22 items were developed to assess individual physicians by 8 peers, 8 referring physicians, and 8 coworkers (eg, technologists, secretaries), respectively, using 5-point scales and an unable-to-assess category. Physicians completed a self-assessment survey. Items addressed key competencies related to clinical competence, collaboration, professionalism, and communication. Data from 101 pathologists and laboratory medicine physicians were analyzed. The mean number of respondents per physician was 7.6, 7.4, and 7.6 for peers, referring physicians, and coworkers, respectively. The reliability of the internal consistency, measured by Cronbach alpha, was > or = .95 for the full scale of all instruments. Analysis indicated that the medical peer, referring physician, and coworker instruments achieved a generalizability coefficient of .78, .81, and .81, respectively. Factor analysis showed 4 factors on the peer questionnaire accounted for 68.8% of the total variance: reports and clinical competency, collaboration, educational leadership, and professional behavior. For the referring physician survey, 3 factors accounted for 66.9% of the variance: professionalism, reports, and clinical competency. Two factors on the coworker questionnaire accounted for 59.9% of the total variance: communication and professionalism. It is feasible to assess this group of physicians using multisource feedback with instruments that are reliable.
Hishinuma, Yuri; Horiuchi, Shigeko; Yanai, Haruo
2016-01-01
Clinical education is an extremely important process in cultivating healthcare professionals, and the quality of educators has a major impact on the quality of future practitioners. Although practicing clinical midwives contribute to the education of pre-registered midwives and those qualified within the past year (new midwives), the factors defining the educational competencies of clinical midwives have not been clarified. The purpose of this study was to explore the factors that define the mentoring competencies of clinical midwives involved in educating new midwives. An exploratory quantitative research study. Questionnaires were distributed to 694 midwives who had previously conducted educational activities with new midwives at the 63 facilities whose administrator or nurse manager in charge of all staff, including midwives, consented to participate. Of the 694 midwives, 464 (66.9%) returned the questionnaire and 451 (65.1%) valid responses were analyzed. Exploratory factor analyses were performed on the following three concepts: [competency as a professional], [competency as an educator], and [personal characteristics]. [Competency as a professional] consisted of two factors:
Interprofessional Teamwork Education: Moving Toward the Patient-Centered Approach.
Moradi, Kamran; Najarkolai, Atena Rahmati; Keshmiri, Fatemeh
2016-10-01
HOW TO OBTAIN CONTACT HOURS BY READING THIS ISSUE Instructions: 1.3 contact hours will be awarded by Villanova University College of Nursing upon successful completion of this activity. A contact hour is a unit of measurement that denotes 60 minutes of an organized learning activity. This is a learner-based activity. Villanova University College of Nursing does not require submission of your answers to the quiz. A contact hour certificate will be awarded after you register, pay the registration fee, and complete the evaluation form online at http://goo.gl/gMfXaf. In order to obtain contact hours you must: 1. Read the article, "Interprofessional Teamwork Education: Moving Toward the Patient-Centered Approach," found on pages 449-460, carefully noting any tables and other illustrative materials that are included to enhance your knowledge and understanding of the content. Be sure to keep track of the amount of time (number of minutes) you spend reading the article and completing the quiz. 2. Read and answer each question on the quiz. After completing all of the questions, compare your answers to those provided within this issue. If you have incorrect answers, return to the article for further study. 3. Go to the Villanova website to register for contact hour credit. You will be asked to provide your name, contact information, and a VISA, MasterCard, or Discover card number for payment of the $20.00 fee. Once you complete the online evaluation, a certificate will be automatically generated. This activity is valid for continuing education credit until September 30, 2019. CONTACT HOURS This activity is co-provided by Villanova University College of Nursing and SLACK Incorporated. Villanova University College of Nursing is accredited as a provider of continuing nursing education by the American Nurses Credentialing Center's Commission on Accreditation. OBJECTIVES Explain the recommended framework in teaching and implementing interprofessional competencies. Identify suggested core competencies to implement interprofessional collaborative practice. DISCLOSURE STATEMENT Neither the planners nor the author have any conflicts of interest to disclose. The aim of this study is to develop and contextualize a competency framework for interprofessional teamwork in Iran. The study was conducted in three phases. First, the competencies of interprofessional teamwork were extracted from the literature. In the second phase, the content validity of the initial framework was assessed by the experts through the Delphi rounds. Content validity ratio (CVR) and item-level content validity index (I-CVI) were used for quantitative analysis. Finally, in the third phase, the importance and utility of interprofessional teamwork competencies were assessed by the experts. Initial framework was constructed with 28 competencies. Quantitative analysis by CVR indicated a score of less than .49 for three items. These items were excluded from the framework. The I-CVI for all items in the framework was higher than .78. The final framework was developed and validated with 16 competencies. The developed framework is recommended for teaching and assessment of interprofessional teamwork competencies. J Contin Educ Nurs. 2016;47(10):449-460. Copyright 2016, SLACK Incorporated.
Perspective: Toward a competency framework for faculty.
Milner, Robert J; Gusic, Maryellen E; Thorndyke, Luanne E
2011-10-01
Today, faculty in academic medicine face challenges in all three mission areas--research, education, and patient care--and require a broad set of competencies to survive in this changing environment. To support faculty and to design assessments that match new expectations, the authors argue that it is essential to capture the full scope of skills, knowledge, and behaviors necessary for a successful faculty member. Thus, it is timely to explore and define competencies for faculty in academic medicine. The authors describe three approaches to identifying faculty competencies. Each reveals diverse but overlapping sets of competency domains, reflecting the breadth of activities expected of today's faculty. To organize these competencies into a coherent framework, the authors propose a model based on a typology of competency. A key feature of the model is the division between occupational competencies, which are largely role-specific, and personal competencies, which are necessary for all faculty. A competency framework also must be developmental, to reflect the growth in skills, knowledge, and behaviors from trainee to expert and to allow for an individual's changing roles over a career. Such a competency framework will inform professional development activities and require assessment of competence. The generation of competencies also will reveal areas of faculty practice that are poorly measured, requiring new tools to be incorporated into existing processes of faculty evaluation. The authors provide general principles to guide the identification of a competency framework for faculty and invite the academic medicine community to engage in further discussion.
Hopmans, Cornelis J; den Hoed, Pieter T; Wallenburg, Iris; van der Laan, Lijkckle; van der Harst, Erwin; van der Elst, Maarten; Mannaerts, Guido H H; Dawson, Imro; van Lanschot, Jan J B; Ijzermans, Jan N M
2013-01-01
Currently, most surgical training programs are focused on the development and evaluation of professional competencies. Also in the Netherlands, competency-based training and assessment programs were introduced to restructure postgraduate medical training. The current surgical residency program is based on the Canadian Medical Education Directives for Specialists (CanMEDS) competencies and uses assessment tools to evaluate residents' competence progression. In this study, we examined the attitude of surgical residents and attending surgeons toward a competency-based training and assessment program used to restructure general surgical training in the Netherlands in 2009. In 2011, all residents (n = 51) and attending surgeons (n = 108) in 1 training region, consisting of 7 hospitals, were surveyed. Participants were asked to rate the importance of the CanMEDS competencies and the suitability of the adopted assessment tools. Items were rated on a 5-point Likert scale and considered relevant when at least 80% of the respondents rated an item with a score of 4 or 5 (indicating a positive attitude). Reliability was evaluated by calculating the Cronbach's α, and the Mann-Whitney test was applied to assess differences between groups. The response rate was 88% (n = 140). The CanMEDS framework demonstrated good reliability (Cronbach's α = 0.87). However, the importance of the competencies 'Manager' (78%) and 'Health Advocate' (70%) was undervalued. The assessment tools failed to achieve an acceptable reliability (Cronbach's α = 0.55), and individual tools were predominantly considered unsuitable for assessment. Exceptions were the tools 'in-training evaluation report' (91%) and 'objective structured assessment of technical skill' (82%). No significant differences were found between the residents and the attending surgeons. This study has demonstrated that, 2 years after the reform of the general surgical residency program, residents and attending surgeons in a large training region in the Netherlands do not acknowledge the importance of all CanMEDS competencies and consider the assessment tools generally unsuitable for competence evaluation. Copyright © 2013 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.
Towards a culturally competent health professional: a South African case study.
Matthews, Margaret; Van Wyk, Jacqueline
2018-05-22
South Africa (SA) has a growing multilingual and multicultural population of approximately 55 million people, and faces service delivery challenges due to a shortage in skilled health professionals. Many health care facilities still depict distinct racial and ethnic characteristics that date back to the apartheid era, and there are reports of racial intolerance or preferential treatment at some facilities. There is limited literature in South Africa on cultural competence or on how to train health professionals to provide culturally competent care. This paper describes a study conducted to gain a better understanding of final year medical students' perceptions regarding concepts related to cultural and linguistic competence in the SA healthcare setting. An exploratory, cross-sectional, analytical study used a questionnaire to collect data from final year students at the medical school. The demographic profile indicated considerable diversity in the respondents for languages spoken, ethnicity and religion. Responses indicated a level of cultural awareness and, according to the Cross Framework, a position of cultural pre-competence. This position was supported by the majority expressing high levels of agreement with the items deemed to indicate responsiveness: a desire for cultural competence to be promoted in the medical curriculum and for professional development to improve delivery of services and support to linguistically and culturally diverse groups. No significant association was found when analysing the latter item against demographic grouping variables. However, although not significant, a diminishing trend emerged in the rankings of monolingualism, bilingualism and multilingualism, suggesting that the ability to speak more than one language could possibly be a facilitating factor in acquiring cultural competence. In response, it is recommended that specific learning objectives be included in the medical curriculum. Understanding of concepts related to both individual and institutional cultural competence would improve insights into their relevance in responding to the challenges related to culture in SA healthcare. Further research in teaching cultural competence is recommended. In order to respond to local needs, this should include research at a community level to analyse patients' perspectives and satisfaction with the cultural competence of healthcare providers and organisations serving the SA public.
Michael, Rinat; Cinamon, Rachel Gali; Most, Tova
2015-01-01
The study examined the contribution of parents' occupational status and expectations regarding persons with hearing loss to career-related support they provide their deaf and hard of hearing (dhh) adolescent children. Thirty-eight parents completed the Evaluation of Occupational Competence Scale (Weisel & Cinamon, 2005), the Evaluation of Family Competence Scale (Caprara, Regalia, Scabini, Barbaranelli, & Bandura, 2004), the Career-Related Parent Support Scale (Turner, Alliman-Brissett, Lapan, Udipi, & Ergun, 2003), and a background questionnaire. Parents' occupational expectations were positively correlated with their family expectations regarding deaf persons. Parents' occupational status contributed to expectations of success for deaf persons in prestigious occupations with high communication demands. Different types of expectations contributed to career-related parental support. Implications for theory and practice are discussed.
Intercultural-global competencies for the 21st century and beyond.
Esterhuizen, Philip; Kirkpatrick, Mary K
2015-05-01
Increased diversity exists in Anglo-Saxon countries, such as Australia, the United Kingdom, and the United States. By 2050, no single ethnic group is expected to be in a majority in the United States. Health care reform points to an urgent need for health care professionals, such as nursing, medicine, allied health, nutrition, and other interdisciplinary health care team members, to serve a multi-ethnic population by developing intercultural-global and 21st-century competencies. Nurse educators must acknowledge the need to familiarize themselves and integrate these competencies into university and continuing education programs by evaluating and reporting outcomes. All nurses can be expected to have these competencies as global citizens through local, intercultural, and global interactions and exchanges. Copyright 2015, SLACK Incorporated.
Sources of difficulty in assessment: example of PISA science items
NASA Astrophysics Data System (ADS)
Le Hebel, Florence; Montpied, Pascale; Tiberghien, Andrée; Fontanieu, Valérie
2017-03-01
The understanding of what makes a question difficult is a crucial concern in assessment. To study the difficulty of test questions, we focus on the case of PISA, which assesses to what degree 15-year-old students have acquired knowledge and skills essential for full participation in society. Our research question is to identify PISA science item characteristics that could influence the item's proficiency level. It is based on an a-priori item analysis and a statistical analysis. Results show that only the cognitive complexity and the format out of the different characteristics of PISA science items determined in our a-priori analysis have an explanatory power on an item's proficiency levels. The proficiency level cannot be explained by the dependence/independence of the information provided in the unit and/or item introduction and the competence. We conclude that in PISA, it appears possible to anticipate a high proficiency level, that is, students' low scores for items displaying a high cognitive complexity. In the case of a middle or low cognitive complexity level item, the cognitive complexity level is not sufficient to predict item difficulty. Other characteristics play a crucial role in item difficulty. We discuss anticipating the difficulties in assessment in a broader perspective.
ERIC Educational Resources Information Center
Mahmud, Jumailiyah; Sutikno, Muzayanah; Naga, Dali S.
2016-01-01
The aim of this study is to determine variance difference between maximum likelihood and expected A posteriori estimation methods viewed from number of test items of aptitude test. The variance presents an accuracy generated by both maximum likelihood and Bayes estimation methods. The test consists of three subtests, each with 40 multiple-choice…
ERIC Educational Resources Information Center
Engelen, Ron J. H.; And Others
Fisher's information measure for the item difficulty parameter in the Rasch model and its marginal and conditional formulations are investigated. It is shown that expected item information in the unconditional model equals information in the marginal model, provided the assumption of sampling examinees from an ability distribution is made. For the…
Evaluator Training Needs and Competencies: A Gap Analysis
ERIC Educational Resources Information Center
Galport, Nicole; Azzam, Tarek
2017-01-01
The systematic identification of evaluator competency training needs is crucial for the development of evaluators and the establishment of evaluation as a profession. Insight into essential competencies could help align training programs with field-specific needs, therefore clarifying expectations between evaluators, educators, and employers. This…
Retrieval-induced forgetting in recall: competitor interference revisited.
Verde, Michael F
2013-09-01
Participants studied category-exemplar pairs (FRUIT Cherry, FRUIT Grape) and then practiced some of the items (Cherry). In Experiment 1, practice that involved retrieving the item from memory suppressed recall of related items (Grape), a finding known as the retrieval-induced forgetting (RIF) effect. In Experiment 2, practice that involved studying the item without retrieval produced no RIF effect. Both retrieval and nonretrieval practice facilitated the subsequent recall of practiced items (Cherry). The dissociation between "strengthening" of practiced items and forgetting of related items is thought to be evidence that RIF is the result of inhibition during earlier retrieval attempts rather than interference from competing memories at retrieval. However, simulations of the SAM-REM model show that competitor interference can account for this dissociation. Experiments 3-6 supported the predictions of the model by demonstrating that nonretrieval practice can produce the RIF effect under conditions that emphasize context encoding or increase the number of competitors. PsycINFO Database Record (c) 2013 APA, all rights reserved.
Environmental health training: a survey of family practice residency program directors.
Musham, C; Bellack, J P; Graber, D R; Holmes, D
1996-01-01
The Institute of Medicine and the American College of Physicians have advocated that physicians broaden their participation in the environmental aspects of medical care. Accordingly, both organizations recommend training of future primary care physicians for greater competency in and appreciation of this area of medicine. This study assessed the present emphasis on environmental health in family practice residency programs by examining the extent program directors expect graduates to have specific competencies in environmental medicine. A written survey was mailed to directors of all 393 family practice residency programs listed in the 1993 Directory of Family Practice Residency Programs. Respondents were asked to indicate the extent to which each of eight environmental health competencies was expected of their graduates. The list of environmental health competencies was based on the literature and on interviews with family practice educators. Perceptions about the "present" and "ideal" environmental health emphasis in their programs were also measured. A total of 262 completed surveys were returned for a response rate of 67%. Respondents reported that they expected their graduates to have general knowledge of and competence in environmental health areas that pertain to patient care. Competencies with social and political implications were least likely to be expected. Two thirds of respondents indicated that "minimal emphasis" is presently placed on environmental health. Seventy percent indicated that the "ideal" amount of emphasis placed on this topic is "moderate." This survey's results suggest that family practice residency program directors expect their graduates to know basic environmental health concepts and be skilled in related aspects of patient care. The development of environmental health training programs must take into account that environmental health may be viewed as a topic of secondary importance and that in most residencies, faculty expertise in this area is limited. For this reason, a self-tutoring strategy, aimed toward the educational needs of both faculty and residents, is recommended.
Vertical stratification of the nutritional value of fruit: macronutrients and condensed tannins.
Houle, Alain; Conklin-Brittain, Nancy L; Wrangham, Richard W
2014-12-01
Competing successfully for the best feeding sites is an important behavioral strategy but little is known about how feeding sites vary nutritionally within a fruit tree. To answer this question we tested how the nutritional value of a fruit is influenced by its ripeness and its height within the tree crown. A complementary objective was to assess the nutritional value of the midripe fruit, a food item rarely mentioned in the literature despite being exploited on a daily basis by many frugivores. We measured how the dry weight of pulp, water content, and concentration of macronutrients and condensed tannins varied within the tree crowns of 15 fruit species. Collections occurred early in the fruiting cycle, so as to assess the amount of food in the tree before its exploitation by primates. We found that (1) the upper crown produced fruit densities 4.2 times higher, and a fruit crop 4.8 times larger, than the lower crown of the same tree; (2) considering only midripe and ripe stages, upper-crown fruits contained 28.6% more dry pulp, 21.1% more water, and 13.5% more sugars per dry matter than lower-crown fruits of the same tree; (3) midripe fruits contained 80% of the concentrations of sugars of ripe fruits, making them a sweeter food item than one would expect from the intermediate color of their epidermis; (4) cellulose, hemicellulose, proteins, and ash proportionally decreased in concentration while dry pulp and sugars increased during ripening; and (5) ripe fruits were usually rare in the tree (<0.5% of all fruit available) compared to midripe fruits (3-8%). Overall, upper-crown feeding sites produced a higher density and quality of food than lower-crown sites of the same tree. Our data therefore provide a clear nutritional explanation for why tree-feeding frugivores compete for the highest feeding sites. © 2014 Wiley Periodicals, Inc.
Clinical competence of Guatemalan and Mexican physicians for family dysfunction management.
Cabrera-Pivaral, Carlos Enrique; Orozco-Valerio, María de Jesús; Celis-de la Rosa, Alfredo; Covarrubias-Bermúdez, María de Los Ángeles; Zavala-González, Marco Antonio
2017-01-01
To evaluate the clinical competence of Mexican and Guatemalan physicians to management the family dysfunction. Cross comparative study in four care units first in Guadalajara, Mexico, and four in Guatemala, Guatemala, based on a purposeful sampling, involving 117 and 100 physicians, respectively. Clinical competence evaluated by validated instrument integrated for 187 items. Non-parametric descriptive and inferential statistical analysis was performed. The percentage of Mexican physicians with high clinical competence was 13.7%, medium 53%, low 24.8% and defined by random 8.5%. For the Guatemalan physicians'14% was high, average 63%, and 23% defined by random. There were no statistically significant differences between healthcare country units, but between the medium of Mexicans (0.55) and Guatemalans (0.55) (p = 0.02). The proportion of the high clinical competency of Mexican physicians' was as Guatemalans.
ERIC Educational Resources Information Center
Moore, Debra M.; Pershing, James A.
Common elements of definitions of competency-based vocational education (CBVE) are: (1) CBVE is an instructional process; (2) students must develop competencies; (3) competency includes skill, knowledge, and attitudes; and (4) the outcome is successful job performance. Advantages of CBVE include: (1) students' awareness of what is expected of them…
Aligning interprofessional education collaborative sub-competencies to a progression of learning.
Patel Gunaldo, Tina; Brisolara, Kari Fitzmorris; Davis, Alison H; Moore, Robert
2017-05-01
In the United States, the Interprofessional Education Collaborative (IPEC) developed four core competencies for interprofessional collaborative practice. Even though the IPEC competencies and respective sub-competencies were not created in a hierarchal manner, one might reflect upon a logical progression of learning as well as learners accruing skills allowing them to master one level of learning and building on the aggregate of skills before advancing to the next level. The Louisiana State University Health-New Orleans Center for Interprofessional Education and Collaborative Practice (CIPECP) determined the need to align the sub-competencies with the level of behavioural expectations in order to simplify the process of developing an interprofessional education experience targeted to specific learning levels. In order to determine the most effective alignment, CIPECP discussions revolved around current programmatic expectations across the institution. Faculty recognised the need to align sub-competencies with student learning objectives. Simultaneously, a progression of learning existing within each of the four IPEC domains was noted. Ultimately, the faculty and staff team agreed upon categorising the sub-competencies in a hierarchical manner for the four domains into either a "basic, intermediate, or advanced" level of competency.
Galipeau, James; Cobey, Kelly D.; Barbour, Virginia; Baskin, Patricia; Bell-Syer, Sally; Deeks, Jonathan; Garner, Paul; Shamseer, Larissa; Sharon, Straus; Tugwell, Peter; Winker, Margaret; Moher, David
2017-01-01
Background: Scientific editors (i.e., those who make decisions on the content and policies of a journal) have a central role in the editorial process at biomedical journals. However, very little is known about the training needs of these editors or what competencies are required to perform effectively in this role. Methods: We conducted a survey of perceptions and training needs among scientific editors from major editorial organizations around the world, followed by a modified Delphi process in which we invited the same scientific editors to rate the importance of competency-related statements obtained from a previous scoping review. Results: A total of 148 participants completed the survey of perceptions and training needs. At least 80% of participants agreed on six of the 38 skill and expertise-related statements presented to them as being important or very important to their role as scientific editors. At least 80% agreed on three of the 38 statements as necessary skills they perceived themselves as possessing (well or very well). The top five items on participants’ list of top training needs were training in statistics, research methods, publication ethics, recruiting and dealing with peer reviewers, and indexing of journals. The three rounds of the Delphi were completed by 83, 83, and 73 participants, respectively, which ultimately produced a list of 23 “highly rated” competency-related statements and another 86 “included” items. Conclusion: Both the survey and the modified Delphi process will be critical for understanding knowledge and training gaps among scientific editors when designing curriculum around core competencies in the future. PMID:28979768
Galipeau, James; Cobey, Kelly D; Barbour, Virginia; Baskin, Patricia; Bell-Syer, Sally; Deeks, Jonathan; Garner, Paul; Shamseer, Larissa; Sharon, Straus; Tugwell, Peter; Winker, Margaret; Moher, David
2017-01-01
Background: Scientific editors (i.e., those who make decisions on the content and policies of a journal) have a central role in the editorial process at biomedical journals. However, very little is known about the training needs of these editors or what competencies are required to perform effectively in this role. Methods: We conducted a survey of perceptions and training needs among scientific editors from major editorial organizations around the world, followed by a modified Delphi process in which we invited the same scientific editors to rate the importance of competency-related statements obtained from a previous scoping review. Results: A total of 148 participants completed the survey of perceptions and training needs. At least 80% of participants agreed on six of the 38 skill and expertise-related statements presented to them as being important or very important to their role as scientific editors. At least 80% agreed on three of the 38 statements as necessary skills they perceived themselves as possessing (well or very well). The top five items on participants' list of top training needs were training in statistics, research methods, publication ethics, recruiting and dealing with peer reviewers, and indexing of journals. The three rounds of the Delphi were completed by 83, 83, and 73 participants, respectively, which ultimately produced a list of 23 "highly rated" competency-related statements and another 86 "included" items. Conclusion: Both the survey and the modified Delphi process will be critical for understanding knowledge and training gaps among scientific editors when designing curriculum around core competencies in the future.
Lopes, V P; Barnett, L M; Saraiva, L; Gonçalves, C; Bowe, S J; Abbott, G; Rodrigues, L P
2016-09-01
It is important to assess young children's perceived Fundamental Movement Skill (FMS) competence in order to examine the role of perceived FMS competence in motivation toward physical activity. Children's perceptions of motor competence may vary according to the culture/country of origin; therefore, it is also important to measure perceptions in different cultural contexts. The purpose was to assess the face validity, internal consistency, test-retest reliability and construct validity of the 12 FMS items in the Pictorial Scale for Perceived Movement Skill Competence for Young Children (PMSC) in a Portuguese sample. Two hundred one Portuguese children (girls, n = 112), 5 to 10 years of age (7.6 ± 1.4), participated. All children completed the PMSC once. Ordinal alpha assessed internal consistency. A random subsamples (n = 47) were reassessed one week later to determine test-retest reliability with Bland-Altman method. Children were asked questions after the second administration to determine face validity. Construct validity was assessed on the whole sample with a Bayesian Structural Equation Modelling (BSEM) approach. The hypothesized theoretical model used the 12 items and two hypothesized factors: object control and locomotor skills. The majority of children correctly identified the skills and could understand most of the pictures. Test-retest reliability analysis was good, with an agreement ration between 0.99 and 1.02. Ordinal alpha values ranged from acceptable (object control 0.73, locomotor 0.68) to good (all FMS 0.81). The hypothesized BSEM model had an adequate fit. The PMSC can be used to investigate perceptions of children's FMS competence. This instrument can also be satisfactorily used among Portuguese children. © 2016 John Wiley & Sons Ltd.
Johnson, Christina; Wilhelmsson, Susan; Börjeson, Sussanne; Lindberg, Malou
2015-06-01
The aim of this study was to develop a self-assessment tool aiming to raise telenurses' awareness of their communication and interpersonal competence, and highlight areas in need of improvement. Several studies have revealed the need for development of communication competence in telenursing. Structured analyses of conversations with patients/callers, is one way to increase telenurses' awareness of their unique communication and interpersonal competence. Instrument development, Validation assessment using the method Content Validity Index. The process to determine content validity was done in two stages; the development stage and the assessment stage. The development stage started with a literature search. The assessment stage was separated into two phases, assessment by an expert group and assessment and test by telenurses. The telenurses also participated in consensus discussions. A telenursing self-assessment tool with 58 items was developed. The items were sorted into five sections according to the nursing process. This study describes the thorough development process of the telenursing self-assessment tool to be used by telenurses in order to become aware of their unique communication and interpersonal competence when analysing their own conversations with patients/callers. As a formative tool it is meant to provide self-direction, feedback and coaching, and create learning opportunities. The self-assessment tool helps the telenurse to follow the nursing process, to be patient-centred, and it is meant to provide self-direction, feedback, and coaching, as well as create learning opportunities. The tool can contribute to the development of communication and interpersonal competence in telephone advice nursing. Further development of the tool may provide an objective scoring instrument for evaluating communication training and education in the field. © 2014 John Wiley & Sons Ltd.
NASA Astrophysics Data System (ADS)
Mahatmavidya, P. A.; Soesanto, R. P.; Kurniawati, A.; Andrawina, L.
2018-03-01
Human resource is an important factor for a company to gain competitiveness, therefore competencies of each individual in a company is a basic characteristic that is taken into account. The increasing employee’s competency will affect directly to the company's performance. The purpose of this research is to improve the quality of human resources of maintenance staff in manufacturing company by designing competency measurement instrument that aims to assess the competency of employees. The focus of this research is the mechanical expertise of maintenance staff. SECI method is used in this research for managing knowledge that is held by senior employees regarding employee competence of mechanical expertise. The SECI method converts the knowledge of a person's tacit knowledge into an explicit knowledge so that the knowledge can be used by others. The knowledge that is gathered from SECI method is converted into a list of competence and break down into the detailed competency. Based on the results of this research, it is known that 11 general competencies, 17 distinctive competencies, 20 indicators, and 20 item list for assessing the competencies are developed. From the result of competency breakdown, the five-level instrument of measurement is designed which can assist in assessing employee’s competency for mechanical expertise.
ERIC Educational Resources Information Center
Casabianca, Jodi M.; Lewis, Charles
2015-01-01
Loglinear smoothing (LLS) estimates the latent trait distribution while making fewer assumptions about its form and maintaining parsimony, thus leading to more precise item response theory (IRT) item parameter estimates than standard marginal maximum likelihood (MML). This article provides the expectation-maximization algorithm for MML estimation…
A Comparison Study of Item Exposure Control Strategies in MCAT
ERIC Educational Resources Information Center
Mao, Xiuzhen; Ozdemir, Burhanettin; Wang, Yating; Xiu, Tao
2016-01-01
Four item selection indexes with and without exposure control are evaluated and compared in multidimensional computerized adaptive testing (CAT). The four item selection indices are D-optimality, Posterior expectation Kullback-Leibler information (KLP), the minimized error variance of the linear combination score with equal weight (V1), and the…
ERIC Educational Resources Information Center
Chen, Ping
2017-01-01
Calibration of new items online has been an important topic in item replenishment for multidimensional computerized adaptive testing (MCAT). Several online calibration methods have been proposed for MCAT, such as multidimensional "one expectation-maximization (EM) cycle" (M-OEM) and multidimensional "multiple EM cycles"…
A Comparison of Item Selection Techniques for Testlets
ERIC Educational Resources Information Center
Murphy, Daniel L.; Dodd, Barbara G.; Vaughn, Brandon K.
2010-01-01
This study examined the performance of the maximum Fisher's information, the maximum posterior weighted information, and the minimum expected posterior variance methods for selecting items in a computerized adaptive testing system when the items were grouped in testlets. A simulation study compared the efficiency of ability estimation among the…
Three controversies over item disclosure in medical licensure examinations
Park, Yoon Soo; Yang, Eunbae B.
2015-01-01
In response to views on public's right to know, there is growing attention to item disclosure – release of items, answer keys, and performance data to the public – in medical licensure examinations and their potential impact on the test's ability to measure competence and select qualified candidates. Recent debates on this issue have sparked legislative action internationally, including South Korea, with prior discussions among North American countries dating over three decades. The purpose of this study is to identify and analyze three issues associated with item disclosure in medical licensure examinations – 1) fairness and validity, 2) impact on passing levels, and 3) utility of item disclosure – by synthesizing existing literature in relation to standards in testing. Historically, the controversy over item disclosure has centered on fairness and validity. Proponents of item disclosure stress test takers’ right to know, while opponents argue from a validity perspective. Item disclosure may bias item characteristics, such as difficulty and discrimination, and has consequences on setting passing levels. To date, there has been limited research on the utility of item disclosure for large scale testing. These issues requires ongoing and careful consideration. PMID:26374693
2012-01-01
Background Within the 52 health districts in South Africa, the family physician is seen as the clinical leader within a multi-professional district health team. Family physicians must be competent to meet 90% of the health needs of the communities in their districts. The eight university departments of Family Medicine have identified five unit standards, broken down into 85 training outcomes, for postgraduate training. The family medicine registrar must prove at the end of training that all the required training outcomes have been attained. District health managers must be assured that the family physician is competent to deliver the expected service. The Colleges of Medicine of South Africa (CMSA) require a portfolio to be submitted as part of the uniform assessment of all registrars applying to write the national fellowship examinations. This study aimed to achieve a consensus on the contents and principles of the first national portfolio for use in family medicine training in South Africa. Methods A workshop held at the WONCA Africa Regional Conference in 2009 explored the purpose and broad contents of the portfolio. The 85 training outcomes, ideas from the WONCA workshop, the literature, and existing portfolios in the various universities were used to develop a questionnaire that was tested for content validity by a panel of 31 experts in family medicine in South Africa, via the Delphi technique in four rounds. Eighty five content items (national learning outcomes) and 27 principles were tested. Consensus was defined as 70% agreement. For those items that the panel thought should be included, they were also asked how to provide evidence for the specific item in the portfolio, and how to assess that evidence. Results Consensus was reached on 61 of the 85 national learning outcomes. The panel recommended that 50 be assessed by the portfolio and 11 should not be. No consensus could be reached on the remaining 24 outcomes and these were also omitted from the portfolio. The panel recommended that various types of evidence be included in the portfolio. The panel supported 26 of the 27 principles, but could not reach consensus on whether the portfolio should reflect on the relationship between the supervisor and registrar. Conclusion A portfolio was developed and distributed to the eight departments of Family Medicine in South Africa, and the CMSA, to be further tested in implementation. PMID:22385468
Jenkins, Louis; Mash, Bob; Derese, Anselme
2012-03-03
Within the 52 health districts in South Africa, the family physician is seen as the clinical leader within a multi-professional district health team. Family physicians must be competent to meet 90% of the health needs of the communities in their districts. The eight university departments of Family Medicine have identified five unit standards, broken down into 85 training outcomes, for postgraduate training. The family medicine registrar must prove at the end of training that all the required training outcomes have been attained. District health managers must be assured that the family physician is competent to deliver the expected service. The Colleges of Medicine of South Africa (CMSA) require a portfolio to be submitted as part of the uniform assessment of all registrars applying to write the national fellowship examinations. This study aimed to achieve a consensus on the contents and principles of the first national portfolio for use in family medicine training in South Africa. A workshop held at the WONCA Africa Regional Conference in 2009 explored the purpose and broad contents of the portfolio. The 85 training outcomes, ideas from the WONCA workshop, the literature, and existing portfolios in the various universities were used to develop a questionnaire that was tested for content validity by a panel of 31 experts in family medicine in South Africa, via the Delphi technique in four rounds. Eighty five content items (national learning outcomes) and 27 principles were tested. Consensus was defined as 70% agreement. For those items that the panel thought should be included, they were also asked how to provide evidence for the specific item in the portfolio, and how to assess that evidence. Consensus was reached on 61 of the 85 national learning outcomes. The panel recommended that 50 be assessed by the portfolio and 11 should not be. No consensus could be reached on the remaining 24 outcomes and these were also omitted from the portfolio. The panel recommended that various types of evidence be included in the portfolio. The panel supported 26 of the 27 principles, but could not reach consensus on whether the portfolio should reflect on the relationship between the supervisor and registrar. A portfolio was developed and distributed to the eight departments of Family Medicine in South Africa, and the CMSA, to be further tested in implementation.
Perceptions of morality and competence in (non)interdependent games.
Krueger, Joachim I; DiDonato, Theresa E
2010-05-01
Individuals' actions and their stated beliefs affect how others perceive them. In a prisoner's dilemma, a defector who expects others to cooperate is perceived as less moral than a defector who expects others to defect; a cooperator who expects others to defect is perceived as less competent than a cooperator who expects others to cooperate (Experiment 1). This pattern suggests that in a context of interdependence, a stated expectation that the behavior of others will resemble one's own may protect one's social reputation. When outcomes are not interdependent, expectations do not moderate the effects of behavior on reputation (Experiment 2). In such a context, inductive reasoning is sufficient to explain social projection. Both types of results are replicated in a modified N-person social dilemma (Experiment 3), further validating the inductive-reasoning hypothesis. Copyright 2010 Elsevier B.V. All rights reserved.
Competency-Based Occupational Programs: Identification, Structuring, and Evaluation.
ERIC Educational Resources Information Center
Pensacola Junior Coll., FL.
This publication presents results of the third phase of a Pensacola Junior College project to develop certain vocational programs as competency-based education. A brief narrative discusses the entire project--especially phase 3, which involved identification and definition of those competencies expected by an employer using input from an advisory…
Holding Courses Accountable for Competencies Central to the Degree
ERIC Educational Resources Information Center
Schneider, Carol Geary
2013-01-01
The author of this article questions what has been gained from Berrett's exploration of the connections between competency development and individual required courses. She concludes from this analysis that students' competency development is a responsibility that cuts across many courses and many levels of expected student proficiency. To put it…
The Relationship of Family Variables to Head Start Children's Preacademic Competence.
ERIC Educational Resources Information Center
Mantzicopoulos, Panayota Y.
1997-01-01
Examined contribution of family variables such as parenting and literacy activities to the pre-academic competence of 93 Head Start children. Found that maternal educational expectations, home literacy variables, and maternal school involvement were predictive of children's competence even after accounting for the effects of maternal education,…
Students' Perceptions toward Academic Competencies: The Case of German First-Year Students
ERIC Educational Resources Information Center
Mah, Dana-Kristin; Ifenthaler, Dirk
2018-01-01
Students often enter higher education academically unprepared and with unrealistic perceptions and expectations regarding academic competencies for their studies. However, preparedness and realistic perceptions are important factors for student retention. With regard to a proposed model of five academic competencies (time management, learning…
A scoping review of competencies for scientific editors of biomedical journals.
Galipeau, James; Barbour, Virginia; Baskin, Patricia; Bell-Syer, Sally; Cobey, Kelly; Cumpston, Miranda; Deeks, Jon; Garner, Paul; MacLehose, Harriet; Shamseer, Larissa; Straus, Sharon; Tugwell, Peter; Wager, Elizabeth; Winker, Margaret; Moher, David
2016-02-02
Biomedical journals are the main route for disseminating the results of health-related research. Despite this, their editors operate largely without formal training or certification. To our knowledge, no body of literature systematically identifying core competencies for scientific editors of biomedical journals exists. Therefore, we aimed to conduct a scoping review to determine what is known on the competency requirements for scientific editors of biomedical journals. We searched the MEDLINE®, Cochrane Library, Embase®, CINAHL, PsycINFO, and ERIC databases (from inception to November 2014) and conducted a grey literature search for research and non-research articles with competency-related statements (i.e. competencies, knowledge, skills, behaviors, and tasks) pertaining to the role of scientific editors of peer-reviewed health-related journals. We also conducted an environmental scan, searched the results of a previous environmental scan, and searched the websites of existing networks, major biomedical journal publishers, and organizations that offer resources for editors. A total of 225 full-text publications were included, 25 of which were research articles. We extracted a total of 1,566 statements possibly related to core competencies for scientific editors of biomedical journals from these publications. We then collated overlapping or duplicate statements which produced a list of 203 unique statements. Finally, we grouped these statements into seven emergent themes: (1) dealing with authors, (2) dealing with peer reviewers, (3) journal publishing, (4) journal promotion, (5) editing, (6) ethics and integrity, and (7) qualities and characteristics of editors. To our knowledge, this scoping review is the first attempt to systematically identify possible competencies of editors. Limitations are that (1) we may not have captured all aspects of a biomedical editor's work in our searches, (2) removing redundant and overlapping items may have led to the elimination of some nuances between items, (3) restricting to certain databases, and only French and English publications, may have excluded relevant publications, and (4) some statements may not necessarily be competencies. This scoping review is the first step of a program to develop a minimum set of core competencies for scientific editors of biomedical journals which will be followed by a training needs assessment, a Delphi exercise, and a consensus meeting.
Evaluation of a Cultural Competence Intervention with Implications for the Nurse-Patient Encounter
NASA Astrophysics Data System (ADS)
Bradford, Althea Betty
A short-term intervention on participants' knowledge of cultural competence was provided to 38 students in a baccalaureate nursing program at Winston-Salem State University (WSSU). The study examined the effectiveness of this intervention. Although WSSU is a Historically Black University, the majority of students in this program were White. Six tools were used for data collection. The Cultural Competence Survey consisted of 19 Likert Scale items that also gave participants an opportunity to elaborate on each response. Four tools allowed participants to provide written answers to prompts related to cultural competence. The final tool made it possible for the investigator to record impressions and reflections regarding various aspects of the study. Results showed that the students are familiar with cultural competence and want to avoid stereotypical behavior in their nurse-patient encounters. The study suggests a need for education in cultural competence in three areas: 1) accepting that cultural competence is a lifelong endeavor, 2) understanding patients from a holistic perspective, and 3) recognizing that all people have biases; however, the competent nurse is self-aware and has been educated to recognize biased behavior.
'Putting it into words': developing the RCGP competency descriptors to include 'at-risk behaviours'.
Jones, Tim; Tracey, Sue
2012-11-01
As part of the Royal College of General Practitioners' (RCGP) arrangements to satisfy the GMC's requirement for Work Place Based Assessment (WPBAs) a range of 12 WPBA competencies was drawn up. Further to this the RCGP produced descriptors of the behaviours that would demonstrate a trainee had gained competence in that area. Recently the RCGP have expanded the rating scale available to educational supervisors at the time of a review to allow for a finding of 'Needs Further Development (NFD) - below expectations'. In the North of Scotland Deanery it has been recognised that a number of trainees are struggling to demonstrate competency in WPBA and to complete training. Reviewing how we could help these trainees and their educational supervisors there was recognition that early identification of these trainees would assist remedial action. Additionally, having reliable indicators of behaviours associated with a trainee in difficulty would aid the assessment of a trainee as 'NFD - below expectations'. Although many reliable descriptors of 'at-risk' behaviour exist, within frameworks and systems for doctors felt to be in difficulty these systems lie outwith the WPBA competency framework. This paper describes the work undertaken in the North of Scotland Deanery to modify the original table of descriptors for the 12 WPBA competencies to include an 'NFD - below expectations'/'at-risk' behaviours column. The descriptors of behaviours associated with trainees in difficulty have been aligned to the 12 WPBA competencies and used to populate the additional column in the descriptor table. The expectation is that the expanded table of descriptors will assist both in early identification of trainees' at-risk behaviours so that formative work can be engaged in at an early stage in an attachment, and also in the objective assessment of a trainee at an educational supervisor's review if they're in difficulties.
Paschoal, Sérgio Márcio Pacheco; Filho, Wilson Jacob; Litvoc, Júlio
2008-01-01
OBJECTIVE To describe item reduction and its distribution into dimensions in the construction process of a quality of life evaluation instrument for the elderly. METHODS The sampling method was chosen by convenience through quotas, with selection of elderly subjects from four programs to achieve heterogeneity in the “health status”, “functional capacity”, “gender”, and “age” variables. The Clinical Impact Method was used, consisting of the spontaneous and elicited selection by the respondents of relevant items to the construct Quality of Life in Old Age from a previously elaborated item pool. The respondents rated each item’s importance using a 5-point Likert scale. The product of the proportion of elderly selecting the item as relevant (frequency) and the mean importance score they attributed to it (importance) represented the overall impact of that item in their quality of life (impact). The items were ordered according to their impact scores and the top 46 scoring items were grouped in dimensions by three experts. A review of the negative items was performed. RESULTS One hundred and ninety three people (122 women and 71 men) were interviewed. Experts distributed the 46 items into eight dimensions. Closely related items were grouped and dimensions not reaching the minimum expected number of items received additional items resulting in eight dimensions and 43 items. DISCUSSION The sample was heterogeneous and similar to what was expected. The dimensions and items demonstrated the multidimensionality of the construct. The Clinical Impact Method was appropriate to construct the instrument, which was named Elderly Quality of Life Index - EQoLI. An accuracy process will be examined in the future. PMID:18438571
New Year’s Res-Illusions: Food Shopping in the New Year Competes with Healthy Intentions
Pope, Lizzy; Hanks, Andrew S.; Just, David R.; Wansink, Brian
2014-01-01
Objective How do the holidays – and the possible New Year’s resolutions that follow – influence a household’s purchase patterns of healthier foods versus less healthy foods? This has important implications for both holiday food shopping and post-holiday shopping. Methods 207 households were recruited to participate in a randomized-controlled trial conducted at two regional-grocery chain locations in upstate New York. Item-level transaction records were tracked over a seven-month period (July 2010 to March 2011). The cooperating grocer’s proprietary nutrient-rating system was used to designate “healthy,” and “less healthy” items. Calorie data were extracted from online nutritional databases. Expenditures and calories purchased for the holiday period (Thanksgiving-New Year’s), and the post-holiday period (New Year’s-March), were compared to baseline (July-Thanksgiving) amounts. Results During the holiday season, household food expenditures increased 15% compared to baseline ($105.74 to $121.83; p<0.001), with 75% of additional expenditures accounted for by less-healthy items. Consistent with what one would expect from New Year’s resolutions, sales of healthy foods increased 29.4% ($13.24/week) after the holiday season compared to baseline, and 18.9% ($9.26/week) compared to the holiday period. Unfortunately, sales of less-healthy foods remained at holiday levels ($72.85/week holiday period vs. $72.52/week post-holiday). Calories purchased each week increased 9.3% (450 calories per serving/week) after the New Year compared to the holiday period, and increased 20.2% (890 calories per serving/week) compared to baseline. Conclusions Despite resolutions to eat more healthfully after New Year’s, consumers may adjust to a new “status quo” of increased less-healthy food purchasing during the holidays, and dubiously fulfill their New Year’s resolutions by spending more on healthy foods. Encouraging consumers to substitute healthy items for less-healthy items may be one way for practitioners and public health officials to help consumers fulfill New Year’s resolutions, and reverse holiday weight gain. PMID:25514158
Evidence against global attention filters selective for absolute bar-orientation in human vision.
Inverso, Matthew; Sun, Peng; Chubb, Charles; Wright, Charles E; Sperling, George
2016-01-01
The finding that an item of type A pops out from an array of distractors of type B typically is taken to support the inference that human vision contains a neural mechanism that is activated by items of type A but not by items of type B. Such a mechanism might be expected to yield a neural image in which items of type A produce high activation and items of type B low (or zero) activation. Access to such a neural image might further be expected to enable accurate estimation of the centroid of an ensemble of items of type A intermixed with to-be-ignored items of type B. Here, it is shown that as the number of items in stimulus displays is increased, performance in estimating the centroids of horizontal (vertical) items amid vertical (horizontal) distractors degrades much more quickly and dramatically than does performance in estimating the centroids of white (black) items among black (white) distractors. Together with previous findings, these results suggest that, although human vision does possess bottom-up neural mechanisms sensitive to abrupt local changes in bar-orientation, and although human vision does possess and utilize top-down global attention filters capable of selecting multiple items of one brightness or of one color from among others, it cannot use a top-down global attention filter capable of selecting multiple bars of a given absolute orientation and filtering bars of the opposite orientation in a centroid task.
Quality assessment of clinical education services in teaching hospitals located in Kerman, Iran.
Yazdi-Feyzabadi, Vahid; Gozashti, Mohammad Hossein; Komsari, Samane; Mohammadtaghizadeh, Sedigheh; Amiresmaili, Mohammadreza
2015-11-01
Clinical education is one of the most important components of the resource generation function of health systems, and it has a very important role in graduates' competency with respect to effective, practical education. This study aimed to assess the quality of clinical services in Kerman's teaching hospitals located in southeastern Iran. This cross-sectional study was conducted in 2011 on 303 medical students at different levels of medical education at Kerman's teaching hospitals. A modified SERVQUAL instrument was used to collect the data after its validity and reliability were checked. The data were analyzed by SPSS 18.0 using the paired t-test, Kruskal-Wallis, and post hoc tests, when appropriate. In all five dimensions of quality, gaps were observed between students' perceptions and expectations as follows: Assurance (mean = -1.18), Responsiveness (-1.56), Empathy (-1.4), Reliability (-1.27), and Tangibles (-1.21). There was a significant difference between the quality perceptions and expectations of the medical students (p < 0.001). A significant difference was observed between three educational levels, including externships, internships, and assistantships regarding the dimensions of the quality gaps (p < 0.001). The clinical services provided by teaching hospitals in the study did not meet the students' expectations at any of the three educational levels. As we precisely assessed the dimensions and items that had the higher quality gaps, it was apparent that, for most part, clinical education officials could improve the quality by designing interventions, which would not be very difficult to do.
Wilkinson, Krista M; Light, Janice
2011-12-01
Many individuals with complex communication needs may benefit from visual aided augmentative and alternative communication systems. In visual scene displays (VSDs), language concepts are embedded into a photograph of a naturalistic event. Humans play a central role in communication development and might be important elements in VSDs. However, many VSDs omit human figures. In this study, the authors sought to describe the distribution of visual attention to humans in naturalistic scenes as compared with other elements. Nineteen college students observed 8 photographs in which a human figure appeared near 1 or more items that might be expected to compete for visual attention (such as a Christmas tree or a table loaded with food). Eye-tracking technology allowed precise recording of participants' gaze. The fixation duration over a 7-s viewing period and latency to view elements in the photograph were measured. Participants fixated on the human figures more rapidly and for longer than expected based on the size of these figures, regardless of the other elements in the scene. Human figures attract attention in a photograph even when presented alongside other attractive distracters. Results suggest that humans may be a powerful means to attract visual attention to key elements in VSDs.
Patrick, Regan E; Kiang, Michael; Christensen, Bruce K
2015-12-01
Recent research has shown that patients with schizophrenia (SCZ) exhibit reduced directed forgetting (DF) for negative words, suggesting impaired ability to instantiate goal-directed inhibition in order to suppress a competing, emotion-driven responses (i.e., emotional memory enhancement). However, disrupted inhibition is not the only possible mechanism by which patients could manifest reduced emotional DF. Therefore, the primary objective of the current study was to use event-related brain potential (ERP) recordings to investigate alternative hypotheses. ERPs were recorded while patients and controls completed an item-method DF paradigm using negative and neutral words. The N2 indexed goal-directed inhibition of to-be-forgotten items. The late positive potential (LPP) indexed emotional memory enhancement for negative study items. The P300 indexed selective rehearsal of to-be-remembered items. The SCZ group exhibited a reduced DF effect overall, but this was not modulated by emotion. N2 amplitude at anterior sites was larger for forget versus remember cues in the control group only, but this effect was not modulated by emotion. LPP amplitude was greater for negative versus neutral words in both groups, independent of region. P300 amplitude at posterior sites was greater for remember versus forget cues in the control group only. These data suggest that reduced DF in SCZ may be due, in part, to both diminished goal-directed inhibition of to-be-forgotten items and reduced selective rehearsal of to-be-remembered items. However, these data do not support the hypothesis that goal-directed, inhibitory processes are disrupted by competing, emotion-driven processes in SCZ. Patients' ERP data also suggested that they did not exhibit disproportionately heightened encoding of emotional stimuli, nor did they have deficient selective rehearsal of to-be-remembered emotional items. Copyright © 2015 Elsevier B.V. All rights reserved.
Marchand, Alain; Haines, Victor Y; Dextras-Gauthier, Julie
2013-05-04
This study advances a measurement approach for the study of organizational culture in population-based occupational health research, and tests how different organizational culture types are associated with psychological distress, depression, emotional exhaustion, and well-being. Data were collected over a sample of 1,164 employees nested in 30 workplaces. Employees completed the 26-item OCP instrument. Psychological distress was measured with the General Health Questionnaire (12-item); depression with the Beck Depression Inventory (21-item); and emotional exhaustion with five items from the Maslach Burnout Inventory general survey. Exploratory factor analysis evaluated the dimensionality of the OCP scale. Multilevel regression models estimated workplace-level variations, and the contribution of organizational culture factors to mental health and well-being after controlling for gender, age, and living with a partner. Exploratory factor analysis of OCP items revealed four factors explaining about 75% of the variance, and supported the structure of the Competing Values Framework. Factors were labeled Group, Hierarchical, Rational and Developmental. Cronbach's alphas were high (0.82-0.89). Multilevel regression analysis suggested that the four culture types varied significantly between workplaces, and correlated with mental health and well-being outcomes. The Group culture type best distinguished between workplaces and had the strongest associations with the outcomes. This study provides strong support for the use of the OCP scale for measuring organizational culture in population-based occupational health research in a way that is consistent with the Competing Values Framework. The Group organizational culture needs to be considered as a relevant factor in occupational health studies.
Brouwers, Livia A M; Engels, Josephine A; Heerkens, Yvonne F; van der Beek, Allard J
2015-06-16
Most validated sustainable employability questionnaires are extensive and difficult to obtain. Our objective was to develop a usable and valid tool, a Vitality Scan, to determine possible signs of stagnation in one's functioning related to sustainable employability and to establish the instrument's internal consistency and construct validity. A literature review was performed and expert input was obtained to develop an online survey of 31 items. A sample of 1722 Dutch employees was recruited. Internal consistency was assessed by Cronbach's alpha. The underlying theoretical concepts were extracted by factor analysis using a principal component method. For construct validity, a priori hypotheses were defined for expected differences between known subgroups: 1) older workers would report more stagnation than younger workers, and 2) less educated workers would report more problems than the highly educated ones. Both hypotheses were statistically tested using ANOVA. Internal consistency measures and factor analysis resulted in five subscales with acceptable to good reliability (Cronbach's alpha 0.72-0.87). These subscales included: balance and competence, motivation and involvement, resilience, mental and physical health, and social support at work. Three items were removed following these analyses. In accordance with our a priori hypothesis 1, the ANOVA showed that older workers reported the most problems, while younger workers reported the least problems. However, hypothesis 2 was not confirmed: no significant differences were found for education level. The developed Vitality Scan - with the 28 remaining items - showed good measurement properties. It is applicable as a user-friendly, evaluative instrument for worker's sustainable employability. The scan's value for determining whether or not the employee is at risk for a decrease in functioning during present and future work, should be further tested.
Item Selection and Ability Estimation Procedures for a Mixed-Format Adaptive Test
ERIC Educational Resources Information Center
Ho, Tsung-Han; Dodd, Barbara G.
2012-01-01
In this study we compared five item selection procedures using three ability estimation methods in the context of a mixed-format adaptive test based on the generalized partial credit model. The item selection procedures used were maximum posterior weighted information, maximum expected information, maximum posterior weighted Kullback-Leibler…
Explaining Crossing DIF in Polytomous Items Using Differential Step Functioning Effects
ERIC Educational Resources Information Center
Penfield, Randall D.
2010-01-01
Crossing, or intersecting, differential item functioning (DIF) is a form of nonuniform DIF that exists when the sign of the between-group difference in expected item performance changes across the latent trait continuum. The presence of crossing DIF presents a problem for many statistics developed for evaluating DIF because positive and negative…
Library Specifications for a New Circulation System for Concordia University Libraries.
ERIC Educational Resources Information Center
Tallon, James
This study of library requirements for a new circulation system is organized into three sections: (1) items required for initial implementation in July 1982; (2) items relating to notice generation and activity statistics, with implementation expected by fall 1982; and (3) items provided in the system as initially implemented, with additional…
Sanders, Megan; Davis, Tyler; Love, Bradley C
2013-06-01
We evaluate two competing accounts of the relationship between beauty and category structure. According to the similarity-based view, beauty arises from category structure such that central items are favored due to their increased fluency. In contrast, the theory-based view holds that people's theories of beauty shape their perceptions of categories. In the present study, subjects learned to categorize abstract paintings into meaningfully labeled categories and rated the paintings' beauty, value, and typicality. Inconsistent with the similarity-based view, beauty ratings were highly correlated across conditions despite differences in fluency and assigned category structure. Consistent with the theory-based view, beautiful paintings were treated as central members for categories expected to contain beautiful paintings (e.g., art museum pieces), but not in others (e.g., student show pieces). These results suggest that the beauty of complex, real-world stimuli is not determined by fluency within category structure but, instead, interacts with people's prior knowledge to structure categories.
Job Tactics of Women in Banking.
ERIC Educational Resources Information Center
Larwood, Laurie; Kaplan, Mindy
1980-01-01
Investigated tactics used by women branch bank officers for succeeding in management. Results showed a high degree of agreement about the importance of a number of items, including the ability to make decisions and the demonstration of competence. (Author)
Competing stimuli in the treatment of multiply controlled problem behavior during hygiene routines.
Long, Ethan S; Hagopian, Louis P; Deleon, Iser G; Marhefka, Jean Marie; Resau, Dawn
2005-01-01
The current study describes the use of noncontingent competing stimuli in the treatment of problem behavior exhibited by three individuals during staff-assisted hygiene routines. Functional analyses revealed that particular topographies of problem behaviors appeared to be maintained by their own sensory consequences, whereas other topographies appeared to be maintained by escape from demands. Competing stimulus assessments were then conducted to identify items associated with low levels of automatically-maintained problem behavior and high levels of stimulus engagement. Stimuli associated with low levels of automatically-maintained problem behavior (competing stimuli) were then delivered noncontingently during staff-assisted hygiene routines that were problematic for each participant. In all three cases, substantial reductions in all problem behaviors were observed. These results are discussed in terms of the relative ease of this intervention and possible mechanisms underlying the effects of competing stimuli on behaviors maintained by different types of reinforcement.
Do infants have a sense of fairness?
Sloane, Stephanie; Baillargeon, Renée; Premack, David
2012-01-01
Two experiments examined infants’ expectations about how an experimenter should distribute resources and rewards to others. In Experiment 1, 19-month-olds expected an experimenter to divide two items equally, as opposed to unequally, between two individuals. Infants held no particular expectation when the individuals were replaced with inanimate objects, or when the experimenter simply removed covers in front of the individuals to reveal the items (instead of distributing them). In Experiment 2, 21-month-olds expected an experimenter to give a reward to each of two individuals when both had worked to complete an assigned chore, but not when one of the individuals had done all the work while the other played. Infants held this expectation only when the experimenter could determine through visual inspection who had worked and who had not. Together, these results provide converging evidence that infants in the second year of life already possess context sensitive-expectations relevant to fairness. PMID:22258431
Using a MaxEnt Classifier for the Automatic Content Scoring of Free-Text Responses
NASA Astrophysics Data System (ADS)
Sukkarieh, Jana Z.
2011-03-01
Criticisms against multiple-choice item assessments in the USA have prompted researchers and organizations to move towards constructed-response (free-text) items. Constructed-response (CR) items pose many challenges to the education community—one of which is that they are expensive to score by humans. At the same time, there has been widespread movement towards computer-based assessment and hence, assessment organizations are competing to develop automatic content scoring engines for such items types—which we view as a textual entailment task. This paper describes how MaxEnt Modeling is used to help solve the task. MaxEnt has been used in many natural language tasks but this is the first application of the MaxEnt approach to textual entailment and automatic content scoring.
Assessing child and adolescent pragmatic language competencies: toward evidence-based assessments.
Russell, Robert L; Grizzle, Kenneth L
2008-06-01
Using language appropriately and effectively in social contexts requires pragmatic language competencies (PLCs). Increasingly, deficits in PLCs are linked to child and adolescent disorders, including autism spectrum, externalizing, and internalizing disorders. As the role of PLCs expands in diagnosis and treatment of developmental psychopathology, psychologists and educators will need to appraise and select clinical and research PLC instruments for use in assessments and/or studies. To assist in this appraisal, 24 PLC instruments, containing 1,082 items, are assessed by addressing four questions: (1) Can PLC domains targeted by assessment items be reliably identified?, (2) What are the core PLC domains that emerge across the 24 instruments?, (3) Do PLC questionnaires and tests assess similar PLC domains?, and (4) Do the instruments achieve content, structural, diagnostic, and ecological validity? Results indicate that test and questionnaire items can be reliably categorized into PLC domains, that PLC domains featured in questionnaires and tests significantly differ, and that PLC instruments need empirical confirmation of their dimensional structure, content validity across all developmental age bands, and ecological validity. Progress in building a better evidence base for PLC assessments should be a priority in future research.
Power, Thomas J; Dombrowski, Stefan C; Watkins, Marley W; Mautone, Jennifer A; Eagle, John W
2007-06-01
Efforts to develop interventions to improve homework performance have been impeded by limitations in the measurement of homework performance. This study was conducted to develop rating scales for assessing homework performance among students in elementary and middle school. Items on the scales were intended to assess student strengths as well as deficits in homework performance. The sample included 163 students attending two school districts in the Northeast. Parents completed the 36-item Homework Performance Questionnaire - Parent Scale (HPQ-PS). Teachers completed the 22-item teacher scale (HPQ-TS) for each student for whom the HPQ-PS had been completed. A common factor analysis with principal axis extraction and promax rotation was used to analyze the findings. The results of the factor analysis of the HPQ-PS revealed three salient and meaningful factors: student task orientation/efficiency, student competence, and teacher support. The factor analysis of the HPQ-TS uncovered two salient and substantive factors: student responsibility and student competence. The findings of this study suggest that the HPQ is a promising set of measures for assessing student homework functioning and contextual factors that may influence performance. Directions for future research are presented.
Power, Thomas J.; Dombrowski, Stefan C.; Watkins, Marley W.; Mautone, Jennifer A.; Eagle, John W.
2007-01-01
Efforts to develop interventions to improve homework performance have been impeded by limitations in the measurement of homework performance. This study was conducted to develop rating scales for assessing homework performance among students in elementary and middle school. Items on the scales were intended to assess student strengths as well as deficits in homework performance. The sample included 163 students attending two school districts in the Northeast. Parents completed the 36-item Homework Performance Questionnaire – Parent Scale (HPQ-PS). Teachers completed the 22-item teacher scale (HPQ-TS) for each student for whom the HPQ-PS had been completed. A common factor analysis with principal axis extraction and promax rotation was used to analyze the findings. The results of the factor analysis of the HPQ-PS revealed three salient and meaningful factors: student task orientation/efficiency, student competence, and teacher support. The factor analysis of the HPQ-TS uncovered two salient and substantive factors: student responsibility and student competence. The findings of this study suggest that the HPQ is a promising set of measures for assessing student homework functioning and contextual factors that may influence performance. Directions for future research are presented. PMID:18516211
Wright, Brandy; Semaan, Salaam
2013-01-01
Objectives. We assessed expected ethics competencies of public health professionals in codes and competencies, reviewed ethics instruction at schools of public health, and recommended ways to bridge the gap between them. Methods. We reviewed the code of ethics and 3 sets of competencies, separating ethics-related competencies into 3 domains: professional, research, and public health. We reviewed ethics course requirements in 2010–2011 on the Internet sites of 46 graduate schools of public health and categorized courses as required, not required, or undetermined. Results. Half of schools (n = 23) required an ethics course for graduation (master’s or doctoral level), 21 did not, and 2 had no information. Sixteen of 23 required courses were 3-credit courses. Course content varied from 1 ethics topic to many topics addressing multiple ethics domains. Conclusions. Consistent ethics education and competency evaluation can be accomplished through a combination of a required course addressing the 3 domains, integration of ethics topics in other courses, and “booster” trainings. Enhancing ethics competence of public health professionals is important to address the ethical questions that arise in public health research, surveillance, practice, and policy. PMID:22994177
Bowen, Catherine E; Skirbekk, Vegard
2013-11-01
Why are older people perceived as more competent in some countries relative to others? In the current study, we investigate the extent to which national variation in perceptions of older people's competence is systematically related to national variation in the extent to which older people participate in paid and volunteer work. We used multilevel regression to analyze data from the European Social Survey and test the relationship between perceptions of older people's competence and older people's participation in paid and volunteer work across 28 countries. We controlled for a number of potentially confounding variables, including life expectancy as well as the gender ratio and average education of the older population in each country. We controlled for the average objective cognitive abilities of the older population in a subsample of 11 countries. Older people were perceived as more competent in countries in which more older people participated in paid or volunteer work, independent of life expectancy and the average education, gender makeup, and average cognitive abilities of the older population. The results suggest that older people's participation in paid and volunteer work is related to perceptions of older people's competence independent of older people's actual competence.
Examining the Cultural Competence of Third- and Fourth-Year Nutrition Students: A Pilot Study.
Hack, Rebekah; Hekmat, Sharareh; Ahmadi, Latifeh
2015-12-01
The purpose of this study was to provide preliminary Canadian research assessing nutrition students' cultural competence and to identify areas for future education initiatives in dietetic education that could ultimately improve dietitians' cultural competence. A mixed-methods study was conducted using a 24-item questionnaire that was administered to students enrolled in third- and fourth-year undergraduate nutrition classes (n = 133). In total, 115 questionnaires were analyzed for quantitative data, and 109 were analyzed for qualitative data. The students scored an overall medium-high level of cultural competence. Out of the 5 areas examined (skills, attitudes, awareness, desires, knowledge), students' multicultural knowledge scores were the lowest. It was found that a lower number of barriers to learning about other cultures were significantly associated with a higher overall cultural competence score, and taking a course in cultural foods significantly increased the students' knowledge and overall cultural competence (P ≤ 0.05). The qualitative data found that students felt the cultural competence curriculum had gaps and identified several ideas for improvement. In conclusion, this research data provides novel insights into the cultural competence of Canadian dietetic students and additionally supports future research and curriculum development to enhance cultural competence.
Statistical competencies for medical research learners: What is fundamental?
Enders, Felicity T; Lindsell, Christopher J; Welty, Leah J; Benn, Emma K T; Perkins, Susan M; Mayo, Matthew S; Rahbar, Mohammad H; Kidwell, Kelley M; Thurston, Sally W; Spratt, Heidi; Grambow, Steven C; Larson, Joseph; Carter, Rickey E; Pollock, Brad H; Oster, Robert A
2017-06-01
It is increasingly essential for medical researchers to be literate in statistics, but the requisite degree of literacy is not the same for every statistical competency in translational research. Statistical competency can range from 'fundamental' (necessary for all) to 'specialized' (necessary for only some). In this study, we determine the degree to which each competency is fundamental or specialized. We surveyed members of 4 professional organizations, targeting doctorally trained biostatisticians and epidemiologists who taught statistics to medical research learners in the past 5 years. Respondents rated 24 educational competencies on a 5-point Likert scale anchored by 'fundamental' and 'specialized.' There were 112 responses. Nineteen of 24 competencies were fundamental. The competencies considered most fundamental were assessing sources of bias and variation (95%), recognizing one's own limits with regard to statistics (93%), identifying the strengths, and limitations of study designs (93%). The least endorsed items were meta-analysis (34%) and stopping rules (18%). We have identified the statistical competencies needed by all medical researchers. These competencies should be considered when designing statistical curricula for medical researchers and should inform which topics are taught in graduate programs and evidence-based medicine courses where learners need to read and understand the medical research literature.
Fundamentals of Marketing. Missouri Marketing Education Curriculum. Competency Listing. Revised.
ERIC Educational Resources Information Center
Smith, Clifton L.
This guide lists the core curriculum competencies expected to be developed by students in secondary Fundamentals of Marketing courses in Missouri. It was developed through revision of the prior core curriculum by a project team with input from all the marketing instructors in the state. Competencies listed in the revised fundamentals of marketing…
ERIC Educational Resources Information Center
Cozzul, Marilyn Challis; Freeze, Rick; Lutfiyya, Zana Marie; Van Walleghem, John
2004-01-01
Educators often expect students with intellectual disabilities in inclusive elementary school classrooms to develop social competence through interactions with their peers. In this qualitative study, semi structured indepth interviews were used to investigate elementary school teachers' perspectives on student social competence, the quality of…
Validity of Subjective Self-Assessment of Digital Competence among Undergraduate Preservice Teachers
ERIC Educational Resources Information Center
Maderick, Joseph Andrew
2013-01-01
Technology is now integrated into the Technological Pedagogical Content Knowledge (TPACK) required to be a highly qualified 21st century teacher. Accurate measurement of digital competence has become critical. Self-assessment has been used widely to measure the digital competence of preservice teachers who are expected to integrate technology into…
ERIC Educational Resources Information Center
Gribble, Nigel; Dender, Alma; Lawrence, Emma; Manning, Kirrily; Falkmer, Torbjorn
2014-01-01
In the increasingly global world, skills in cultural competence now form part of the minimum standards of practice required for allied health professionals. During an international work-integrated learning (WIL) placement, allied health students' cultural competence is expected to be enhanced. The present study scrutinized reflective journals of…
A Method for Evaluating Competency in Assessment and Management of Suicide Risk
ERIC Educational Resources Information Center
Hung, Erick K.; Binder, Renee L.; Fordwood, Samantha R.; Hall, Stephen E.; Cramer, Robert J.; McNiel, Dale E.
2012-01-01
Objective: Although health professionals increasingly are expected to be able to assess and manage patients' risk for suicide, few methods are available to evaluate this competency. This report describes development of a competency-assessment instrument for suicide risk-assessment (CAI-S), and evaluates its use in an objective structured clinical…
Identifying core competencies for public health epidemiologists.
Bondy, Susan J; Johnson, Ian; Cole, Donald C; Bercovitz, Kim
2008-01-01
Public health authorities have prioritized the identification of competencies, yet little empirical data exist to support decisions on competency selection among particular disciplines. We sought perspectives on important competencies among epidemiologists familiar with or practicing in public health settings (local to national). Using a sequential, qualitative-quantitative mixed method design, we conducted key informant interviews with 12 public health practitioners familiar with front-line epidemiologists' practice, followed by a web-based survey of members of a provincial association of public health epidemiologists (90 respondents of 155 eligible) and a consensus workshop. Competency statements were drawn from existing core competency lists and those identified by key informants, and ranked by extent of agreement in importance for entry-level practitioners. Competencies in quantitative methods and analysis, critical appraisal of scientific evidence and knowledge transfer of scientific data to other members of the public health team were all regarded as very important for public health epidemiologists. Epidemiologist competencies focused on the provision, interpretation and 'translation' of evidence to inform decision-making by other public health professionals. Considerable tension existed around some potential competency items, particularly in the areas of more advanced database and data-analytic skills. Empirical data can inform discussions of discipline-specific competencies as one input to decisions about competencies appropriate for epidemiologists in the public health workforce.
High-fidelity nursing simulation: impact on student self-confidence and clinical competence.
Blum, Cynthia A; Borglund, Susan; Parcells, Dax
2010-01-01
Development of safe nursing practice in entry-level nursing students requires special consideration from nurse educators. The paucity of data supporting high-fidelity patient simulation effectiveness in this population informed the development of a quasi-experimental, quantitative study of the relationship between simulation and student self-confidence and clinical competence. Moreover, the study reports a novel approach to measuring self-confidence and competence of entry-level nursing students. Fifty-three baccalaureate students, enrolled in either a traditional or simulation-enhanced laboratory, participated during their first clinical rotation. Student self-confidence and faculty perception of student clinical competence were measured using selected scale items of the Lasater Clinical Judgment Rubric. The results indicated an overall improvement in self-confidence and competence across the semester, however, simulation did not significantly enhance these caring attributes. The study highlights the need for further examination of teaching strategies developed to promote the transfer of self-confidence and competence from the laboratory to the clinical setting.
Nine Constructs of Cultural Competence for Curriculum Development
Brookover, Cecile; Kennedy, Kathleen
2010-01-01
Objective To examine the self-administered Clinical Cultural Competency Questionnaire (CCCQ) and assess the perceived level of cultural competence of students in Xavier University of Louisiana College of Pharmacy to guide curriculum development within the 4-year academic program. Methods The CCCQ was administrated to each class of pharmacy students during spring 2009. Exploratory factor analysis with principal components and varimax rotation was conducted to build the constructs explaining the factors measuring students' self-assessment of cultural competence. Results Nine factors, including 46 items extracted from the CCCQ and explaining 79% of the total variance, were found as the best fit to measure students' self-assessment of cultural competence. Conclusions The CCCQ was found to be a practical, valid, and reliable self-assessment instrument to measure the perceived level of pharmacy students' knowledge, skills, attitudes, and encounters in cross-cultural environments. The questionnaire allowed the identification of students' needs for training in cultural competence and the development of a curriculum tailored to satisfy those needs. PMID:21436922
What makes a competent clinical teacher?
Wealthall, Stephen; Henning, Marcus
2012-01-01
Background Clinical teaching competency is a professional necessity ensuring that clinicians’ knowledge, skills and attitudes are effectively transmitted from experts to novices. The aim of this paper is to consider how clinical skills are transmitted from a historical and reflective perspective and to link these ideas with student and teacher perceptions of competence in clinical teaching. Methods The reflections are informed by a Delphi process and professional development survey designed to capture students’ and clinicians’ ideas about the attributes of a competent clinical teacher. In addition, the survey process obtained information on the importance and ‘teachability’ of these characteristics. Results Four key characteristics of the competent teacher emerged from the Delphi process: clinically competent, efficient organizer, group communicator and person–centred. In a subsequent survey, students were found to be more optimistic about the ‘teachability’ of these characteristics than clinicians and scored the attribute of person-centredness higher than clinicians. Clinicians, on the other hand, ascribed higher levels of importance to clinical competency, efficient organization and group communication than students. Conclusions The Delphi process created a non-threatening system for gathering student and clinician expectations of teachers and created a foundation for developing methods for evaluating clinical competency. This provided insights into differences between teachers’ and students’ expectations, their importance, and professional development. PMID:26451184
Sroczynski, Maureen; Gravlin, Gayle; Route, Paulette Seymour; Hoffart, Nancy; Creelman, Patricia
2011-01-01
Education and practice partnerships are key to effective academic program design and implementation in a time of decreasing supply and increasing demands on the nursing profession. An integrated education/practice competency model can positively impact patient safety, improve patient care, increase retention, and ensure a sufficient and competent nursing workforce, which is paramount to survival of the health care system. Through the contributions of nursing leaders from the broad spectrum of nursing and industry organizations within the state, the Massachusetts Nurse of the Future project developed a competency-based framework for the future design of nursing educational programs to meet current and future practice needs. The Massachusetts Nurse of the Future Nursing Core Competencies(©) expand on the Institute of Medicine's core competencies for all health care professionals and the Quality and Safety Education for Nurses competencies for quality and safety to define the expectations for all professional nurses of the future. The Massachusetts Nurse of the Future Nursing Core Competencies define the knowledge, attitude, and skills required as the minimal expectations for initial nursing practice following completion of a prelicensure professional nursing education program. These competencies are now being integrated into new models for seamless, coordinated nursing curriculum and transition into practice within the state and beyond. Copyright © 2011 Elsevier Inc. All rights reserved.
Ball, Lauren E; Leveritt, Michael D
2015-12-01
Nutrition is an important aspect of chronic disease prevention and management by primary health professionals, including GPs, dietitians, practice nurses, diabetes educators and exercise professionals. In order to better understand how to improve the delivery of nutrition care, it is important to have valid and reliable tools to measure self-perceived competence. This study aimed to develop a valid, structured, questionnaire that measures the self-perceived competence of primary health professionals to provide nutrition care to patients with chronic disease. The development of the questionnaire was carried out in four stages (1): preparation of scope and structure, through a literature review and consultation with an expert reference group (2); development of questionnaire items, which were refined through feedback from the reference group and 18 primary health professionals (3); investigation of internal consistency and concurrent validity through a pilot study on 118 primary health professionals (4) and investigation of test-retest reliability through a pilot study on 33 primary health professionals who completed the questionnaire twice, 2-3 weeks apart. Stages 1 and 2 resulted in four constructs and 35 questions in the questionnaire. Stage 3 confirmed internal consistency, with Cronbach's α ranging from 0.88 to 0.98 for each construct and 0.98 for all items combined. Dietitians scored significantly higher than speech pathologists (P < 0.05) in each construct, confirming concurrent validity. Stage 4 confirmed test-retest reliability, with correlation coefficients ranging from 0.89 to 0.94 for each construct and 0.95 for all items combined. The NUTrition COMPetence (NUTCOMP) questionnaire is a valid, reliable and suitable tool that can be used to directly inform professional development and identify opportunities to support safe and effective practice. © The Author 2015. Published by Oxford University Press. All rights reserved. For permissions, please e-mail: journals.permissions@oup.com.
Alla, Arben; Czabanowska, Katarzyna; Kijowska, Violetta; Roshi, Enver; Burazeri, Genc
2012-01-01
Our aim was to validate an international instrument measuring self-perceived competency level of family physicians in Albania. A representative sample of 57 family physicians operating in primary health care services was interviewed twice in March-April 2012 in Tirana (26 men and 31 women; median age: 46 years, inter-quartile range: 38-56 years). A structured questionnaire was administered [and subsequently re-administered after two weeks (test-retest)] to all family physicians aiming to self-assess physicians' level of abilities, skills and competencies regarding different domains of quality of health care. The questionnaire included 37 items organized into 6 subscales/domains. Answers for each item of the tool ranged from 1 ("novice" physicians) to 5 ("expert" physicians). An overall summary score (range: 37-185) and a subscale summary score for each domain were calculated for the test and retest procedures. Cronbach's alpha was used to assess the internal consistency for both the test and the retest procedures, whereas Spearman's rho was employed to assess the stability over time (test-retest reliability) of the instrument. Cronbach's alpha was 0.87 for the test and 0.86 for the retest procedure. Overall, Spearman's rho was 0.84 (P<0.001). The overall summary score for the 37 items of the instrument was 96.3±10.0 for the test and 97.3±10.1 for the retest. All the subscale summary scores were very similar for the test and the retest procedure. This study provides evidence on cross-cultural adaptation of an international instrument taping self-perceived level of competencies of family physicians in Albania. The questionnaire displayed a satisfactory internal consistency for both test and retest procedures in this sample of family physicians in Albania. Furthermore, the high test-retest reliability (stability over time) of the instrument suggests a good potential for wide scale application to nationally representative samples of family physicians in Albanian populations.
Parental Expectations of Their Adolescents' Teachers.
ERIC Educational Resources Information Center
Tatar, Moshe; Horenczyk, Gabriel
2000-01-01
Examines parental expectations of their children's teachers through use of the Expectations of Teachers questionnaire. Participating parents (N=765) reported greater expectations for help and assistance, followed by teaching competence and fairness on the part of the teacher. Mothers were found to hold higher fairness, help, and assistance…
Short forms of the Texas Social Behavior Inventory /TSBI/, an objective measure of self-esteem
NASA Technical Reports Server (NTRS)
Helmreich, R.; Stapp, J.
1974-01-01
Two short (16 item) forms of the Helmreich, Stapp, and Ervin (1974) Texas Social Behavior Inventory, a validated, objective measure of self-esteem or social competence are presented. Normative data and other statistics are described for males and females. Correlations between each short form and long (32-item) scale were .97. Factor analysis and part-whole correlations verified the similarity of the two forms. The utility of the scale in research is described.
van Ede, Freek; Niklaus, Marcel; Nobre, Anna C
2017-01-11
Although working memory is generally considered a highly dynamic mnemonic store, popular laboratory tasks used to understand its psychological and neural mechanisms (such as change detection and continuous reproduction) often remain relatively "static," involving the retention of a set number of items throughout a shared delay interval. In the current study, we investigated visual working memory in a more dynamic setting, and assessed the following: (1) whether internally guided temporal expectations can dynamically and reversibly prioritize individual mnemonic items at specific times at which they are deemed most relevant; and (2) the neural substrates that support such dynamic prioritization. Participants encoded two differently colored oriented bars into visual working memory to retrieve the orientation of one bar with a precision judgment when subsequently probed. To test for the flexible temporal control to access and retrieve remembered items, we manipulated the probability for each of the two bars to be probed over time, and recorded EEG in healthy human volunteers. Temporal expectations had a profound influence on working memory performance, leading to faster access times as well as more accurate orientation reproductions for items that were probed at expected times. Furthermore, this dynamic prioritization was associated with the temporally specific attenuation of contralateral α (8-14 Hz) oscillations that, moreover, predicted working memory access times on a trial-by-trial basis. We conclude that attentional prioritization in working memory can be dynamically steered by internally guided temporal expectations, and is supported by the attenuation of α oscillations in task-relevant sensory brain areas. In dynamic, everyday-like, environments, flexible goal-directed behavior requires that mental representations that are kept in an active (working memory) store are dynamic, too. We investigated working memory in a more dynamic setting than is conventional, and demonstrate that expectations about when mnemonic items are most relevant can dynamically and reversibly prioritize these items in time. Moreover, we uncover a neural substrate of such dynamic prioritization in contralateral visual brain areas and show that this substrate predicts working memory retrieval times on a trial-by-trial basis. This places the experimental study of working memory, and its neuronal underpinnings, in a more dynamic and ecologically valid context, and provides new insights into the neural implementation of attentional prioritization within working memory. Copyright © 2017 van Ede et al.
Teresi, Jeanne A.; Ocepek-Welikson, Katja; Kleinman, Marjorie; Ramirez, Mildred; Kim, Giyeon
2017-01-01
This is the first study of the measurement equivalence of the Patient Reported Outcomes Measurement Information System® (PROMIS®) Anxiety short forms in a large ethnically diverse sample. The psychometric properties and differential item functioning (DIF) were examined across different racial/ethnic, educational, age, gender and language groups. Methods These data are from individuals selected from cancer registries in the United States. For the analyses of race/ethnicity the reference group was non-Hispanic Whites (n = 2,263), the studied groups were non-Hispanic Blacks (n = 1,117), Hispanics (n = 1,043) and Asians/Pacific Islanders (n = 907). Within the Hispanic subsample, there were 335 interviews conducted in Spanish and 703 in English. The 11 anxiety items were from the PROMIS emotional disturbance item bank. DIF hypotheses were generated by content experts who rated whether or not they expected DIF to be present, and the direction of the DIF with respect to several comparison groups. The primary method used for DIF detection was the Wald test for examination of group differences in item response theory (IRT) item parameters accompanied by magnitude measures. Expected item scores were examined as measures of magnitude. The method used for quantification of the difference in the average expected item scores was the non-compensatory DIF (NCDIF) index. DIF impact was examined using expected scale score functions. Additionally, precision and reliabilities were examined using several methods. Results Although not hypothesized to show DIF for Asians/Pacific Islanders, every item evidenced DIF by at least one method. Two items showed DIF of higher magnitude for Asians/Pacific Islanders vs. Whites: “Many situations made me worry” and “I felt anxious”. However, the magnitude of DIF was small and the NCDIF statistics were not above threshold. The impact of DIF was negligible. For education, six items were identified with consistent DIF across methods: fearful, anxious, worried, hard to focus, uneasy and tense. However, the NCDIF was not above threshold and the impact of DIF on the scale was trivial. No items showed high magnitude DIF for gender. Two items showed slightly higher magnitude for age (although not above the cutoff): worried and fearful. The scale level impact was trivial. Only one item showed DIF with the Wald test after the Bonferroni correction for the language comparisons: “I felt fearful”. Two additional items were flagged in sensitivity analyses after Bonferroni correction, anxious and many situations made me worry. The latter item also showed DIF of higher magnitude, with an NCDIF value (0.144) above threshold. Individual impact was relatively small. Conclusions Although many items from the PROMIS short form anxiety measures were flagged with DIF, item level magnitude was low and scale level DIF impact was minimal; however, three items: anxious, worried and many situations made me worry might be singled out for further study. It is concluded that the PROMIS Anxiety short form evidenced good psychometric properties, was relatively invariant across the groups studied, and performed well among ethnically diverse subgroups of Blacks, Hispanic, White non-Hispanic and Asians/Pacific Islanders. In general more research with the Asians/Pacific Islanders group is needed. Further study of subgroups within these broad categories is recommended. PMID:28649483
Social competence: evaluation of assertiveness in Spanish adolescents.
Castedo, Antonio López; Juste, Margarita Pino; Alonso, José Domínguez
2015-02-01
Relations between assertiveness in adolescents' social behavior and demographic variables were assessed in 4,943 Spanish adolescents, ages 12 to 17 years, enrolled in 32 schools for Compulsory Secondary Education. Province of residence, school size, age, grade, and academic focus were statistically significant sources of variance in assertiveness scores. All effects were small. Patterns in responses indicate the items should be reviewed to improve the measure for adolescents, and as a tool for addressing teens' social competence in real life situations.
Development of the Social Efficacy and Social Outcome Expectations Scale
ERIC Educational Resources Information Center
Wright, Stephen L.; Wright, Dorothy A.; Jenkins-Guarnieri, Michael A.
2013-01-01
The current study developed an 18-item scale measuring individuals' social expectations in relationships related to their efficacy expectations (Subscale 1) and outcome expectations (Subscale 2) based on Bandura's self-efficacy theory. Results from exploratory and confirmatory factor analyses, using an undergraduate sample ("N" = 486),…
Optimizing the Use of Response Times for Item Selection in Computerized Adaptive Testing
ERIC Educational Resources Information Center
Choe, Edison M.; Kern, Justin L.; Chang, Hua-Hua
2018-01-01
Despite common operationalization, measurement efficiency of computerized adaptive testing should not only be assessed in terms of the number of items administered but also the time it takes to complete the test. To this end, a recent study introduced a novel item selection criterion that maximizes Fisher information per unit of expected response…
DeRosa, Branlyn Werba; Doshi, Kinjal; Schwartz, Lisa A.; Ginsberg, Jill; Mao, Jun J.; Straton, Joseph; Hobbie, Wendy; Rourke, Mary T.; Carlson, Claire; Ittenbach, Richard F.
2012-01-01
Background Adolescent and young adult survivors of childhood cancer are a vulnerable population. Health beliefs may be related to necessary follow-up care. Purpose This study seeks to develop a measure of health beliefs for adolescents and young adults with and without a history of cancer. Methods Inductive and deductive methods and focus groups were used to develop the Health Competence Beliefs Inventory. Cancer survivors (n=138) and comparison participants (n=130) completed the Health Competence Beliefs Inventory and other measures. Healthcare providers reported current medical problems. Results A series of iterative exploratory factor analyses generated a 21-item four-factor solution: (1) Health Perceptions; (2) Satisfaction with Healthcare; (3) Cognitive Competence; and (4) Autonomy. Survivors reported significantly different Health Competence Beliefs Inventory scale scores than comparisons (p<.05). The Health Competence Beliefs Inventory was associated with beliefs, affect, quality of life, posttraumatic stress symptoms, and medical problems. Conclusions The Health Competence Beliefs Inventory is a promising measure of adolescent and young adult perceptions of health and well-being. PMID:20936390
Asante, Isaac; Andoh, Irene; Muijtjens, Arno M M; Donkers, Jeroen
2017-05-01
To assess the stakeholders' perceptions on the competency of entry-level pharmacists and the use of written licensure examination as the primary assessment for licensure decisions on entry-level pharmacists who have completed the Pharmacy Internship Program 1 (PIP) in developing countries. A cross-sectional survey was conducted among stakeholders in which they completed a web-based 21-item pre-tested questionnaire to determine their views regarding the competency outcomes and assessment program for entry-level pharmacist. The stakeholders rated the entry-level pharmacists to possess all competencies except research skills. Stakeholders suggested improvement of the program by defining the competency framework and training preceptors. However, stakeholders disagree on using written examination as the primary assessment for licensure decision and suggested the incorporation of other performance-based assessments like preceptor's assessment reports. Stakeholders are uncertain on entry-level pharmacists in developing countries possessing adequate research competencies and think their assessment program for licensure need more than written examination to assess all required competencies. Copyright © 2017 Elsevier Inc. All rights reserved.
Hasselager, Asbjørn Børch; Lauritsen, Torsten; Kristensen, Tim; Bohnstedt, Cathrine; Sønderskov, Claus; Østergaard, Doris; Tolsgaard, Martin Grønnebæk
2018-01-18
Assessment of laypersons' Paediatric Basic Life Support (PBLS) skills is important to ensure acquisition of effective PBLS competencies. However limited evidence exists on which PBLS skills are essential for laypersons. The same challenges exist with respect to the assessment of foreign body airway obstruction management (FBAOM) skills. We aimed to establish international consensus on how to assess laypersons' PBLS and FBAOM skills. A Delphi consensus survey was conducted. Out of a total of 84 invited experts, 28 agreed to participate. During the first Delphi round experts suggested items to assess laypersons' PBLS and FBAOM skills. In the second round, the suggested items received comments from and were rated by 26 experts (93%) on a 5-point scale (1 = not relevant to 5 = essential). Revised items were anonymously presented in a third round for comments and 23 (82%) experts completed a re-rating. Items with a score above 3 by more than 80% of the experts in the third round were included in an assessment instrument. In the first round, 19 and 15 items were identified to assess PBLS and FBAOM skills, respectively. The ratings and comments from the last two rounds resulted in nine and eight essential assessment items for PBLS and FBAOM skills, respectively. The PBLS items included: "Responsiveness"," Call for help", "Open airway"," Check breathing", "Rescue breaths", "Compressions", "Ventilations", "Time factor" and "Use of AED". The FBAOM items included: "Identify different stages of foreign body airway obstruction", "Identify consciousness", "Call for help", "Back blows", "Chest thrusts/abdominal thrusts according to age", "Identify loss of consciousness and change to CPR", "Assessment of breathing" and "Ventilation". For assessment of laypersons some PBLS and FBAOM skills described in guidelines are more important than others. Four out of nine of PBLS skills focus on airway and breathing skills, supporting the major importance of these skills for laypersons' resuscitation attempts. International consensus on how to assess laypersons' paediatric basic life support and foreign body airway obstruction management skills was established. The assessment of these skills may help to determine when laypersons have acquired competencies. Not relevant.
Parent outcome expectancies for purchasing fruit and vegetables: a validation.
Baranowski, Tom; Watson, Kathy; Missaghian, Mariam; Broadfoot, Alison; Baranowski, Janice; Cullen, Karen; Nicklas, Theresa; Fisher, Jennifer; O'Donnell, Sharon
2007-03-01
To validate four scales -- outcome expectancies for purchasing fruit and for purchasing vegetables, and comparative outcome expectancies for purchasing fresh fruit and for purchasing fresh vegetables versus other forms of fruit and vegetables (F&V). Survey instruments were administered twice, separated by 6 weeks. Recruited in front of supermarkets and grocery stores; interviews conducted by telephone. One hundred and sixty-one food shoppers with children (18 years or younger). Single dimension scales were specified for fruit and for vegetable purchasing outcome expectancies, and for comparative (fresh vs. other) fruit and vegetable purchasing outcome expectancies. Item Response Theory parameter estimates revealed easily interpreted patterns in the sequence of items by difficulty of response. Fruit and vegetable purchasing and fresh fruit comparative purchasing outcome expectancy scales were significantly correlated with home F&V availability, after controlling for social desirability of response. Comparative fresh vegetable outcome expectancy scale was significantly bivariately correlated with home vegetable availability, but not after controlling for social desirability. These scales are available to help better understand family F&V purchasing decisions.
Loughlin-Presnal, John; Bierman, Karen L
2017-09-01
Using a longitudinal mediation framework and a low-income sample, this study had 2 aims: (a) to model bidirectional associations between parent academic expectations and child academic outcomes from first through fifth grade, and (b) to explore 3 mediators of parental influence: parent involvement in child schooling, child learning behaviors, and child perceived academic competence. Participants included 356 children and their caregivers (89% mothers) recruited from Head Start centers (58% European American, 25% African American, 17% Latino). At each time point (grades 1, 2, 3, 5), parents rated their academic expectations, teachers rated parent involvement and child learning behaviors, and children rated their self-perceptions of their academic competence. Bidirectional longitudinal associations emerged between parent academic expectations and child academic outcomes. Child learning behaviors mediated this association from first to third grade, whereas child perceived academic competence mediated from second to fifth grade. Parallel cross-lagged models replicated these findings with child academic outcomes assessed using a test of reading achievement and teacher ratings of academic performance. (PsycINFO Database Record (c) 2017 APA, all rights reserved).
Use of SERVQUAL to assess clinicians' satisfaction with the blood transfusion service.
Raspollini, E; Pappalettera, M; Riccardi, D; Parravicini, A; Sestili, S; Rebulla, P; Sirchia, G
1997-01-01
Limited information is available on the level of satisfaction of clinicians with services delivered by blood banks. The purpose of this study was to evaluate the satisfaction of clinicians with our blood transfusion service. We prepared a questionnaire based on SERVQUAL, a method used to measure customers' appreciation of quality of service, by assessing the gap between perceived and expected quality. The questionnaire consisted of 14 items grouped according to five dimensions of quality of service: assurance, empathy, responsiveness, reliability, tangibles. Clinicians were asked to give two scores on a scale from 1 to 7 for each item, score (e) representing what they expected from an 'excellent' service, score (r) how they graded the service received. We considered wide differences in scores of service expectation and receipt for a question to be indicative of either service above expected levels (r > e) or service below expectation (r < e); similar scores for both expected and received service (within 1 point on the grading scale) were taken to indicate that the service received was that which was expected. A total of 184 questionnaires (49%) were returned. For the 14 items considered, the proportion of clinicians expressing levels of satisfaction similar to or above expectation ranged from 67 to 96%. Three critical areas, which clinicians considered important (expectation scores 6-7) were associated with satisfaction below expectation in more than 20% of responders. They were: clarity of procedures, clarity of blood request forms, and convenience of blood request and issuing times, which were rated as important by 77, 80 and 72% of clinicians, respectively. SERVQUAL was useful to gather information on the level of clinicians' satisfaction with our transfusion service.
A systematic model to compare nurses' optimal and actual competencies in the clinical setting.
Meretoja, Riitta; Koponen, Leena
2012-02-01
This paper is a report of a study to develop a model to compare nurses' optimal and actual competencies in the clinical setting. Although future challenge is to focus the developmental and educational targets in health care, limited information is available on methods for how to predict optimal competencies. A multidisciplinary group of 24 experts on perioperative care were recruited to this study. They anticipated the effects of future challenges on perioperative care and specified the level of optimal competencies by using the Nurse Competence Scale before and after group discussions. The expert group consensus discussions were held to achieve the highest possible agreement on the overall level of optimal competencies. Registered Nurses (n = 87) and their nurse managers from five different units conducted assessments of the actual level of nurse competence with the Nurse Competence Scale instrument. Data were collected in 2006-2007. Group consensus discussions solidified experts' anticipations about the optimal competence level. This optimal competence level was significantly higher than the nurses' self-reported actual or nurse managers' assessed level of actual competence. The study revealed some competence items that were seen as key challenges for future education of professional nursing practice. It is important that the multidisciplinary experts in a particular care context develop a share understanding of the future competency requirements of patient care. Combining optimal competence profiles to systematic competence assessments contribute to targeted continual learning and educational interventions. © 2011 Blackwell Publishing Ltd.
Berkenbosch, L; Bax, M; Scherpbier, A; Heyligers, I; Muijtjens, A M M; Busari, J O
2013-04-01
The Dutch postgraduate medical training has been revised to focus on seven competencies. The role as manager is one of these competencies. Recent studies show that this competency receives little attention during the residency training. In an earlier study, we discovered that residents perceived their competency as managers to be moderate. In this study, we investigated how medical specialists perceived the managerial competencies of medical residents and their need for management education. In September 2010, a 46-item questionnaire was designed which examined medical specialists' perceptions of the competency and needs of residents in the field of medical management. Two hundred ninety-eight specialists were invited via email to participate. Hundred twenty-nine specialists (43.3%) responded to our survey. They rated the residents' competencies in contract negotiating skills, knowledge of the healthcare system, and specialist department poorly. They felt that residents were competent in updating their medical knowledge. Ninety-four percent reported a need for training in management among residents. Preferred topics were time management and healthcare organization. The preferred training method was a workshop given during residency by an extramural expert. Dutch medical specialists perceive the management competencies of residents in some areas to be inadequate. They feel that training in medical management during residency is necessary.
ERIC Educational Resources Information Center
Pattanapichet, Fasawang; Chinokul, Sumalee
2011-01-01
This article investigates the competencies needed for oral communication in English among Thai undergraduate public relations students for handling public relations job interviews and performing entry-level public relations work. To identify these competencies, the study identified and involved all of the stakeholders in the data reliability…
ERIC Educational Resources Information Center
Marín-Díaz, Verónica; González-López, Ignacio; Flores, Jorge Figueroa
2014-01-01
Determining the professional competencies of a degree is an arduous task that sometimes does not respond to the reality of what society expects for such studies. This article attempts to determine what competencies students in the field of Educational Psychology, which were determined by them. This study was conducted in three different…
ERIC Educational Resources Information Center
Sampson, Demetrios G.
2009-01-01
In the context of the emerging paradigm of Lifelong Learning, competence-based learning is gradually attracting the attention of the Technology-Enhanced Learning community, since it appears to meet the 21st Century learning and training expectations of both individuals and organisations. On the other hand, the paradigm of Learning Objects--as a…
ERIC Educational Resources Information Center
Hoffman, John L.; Bresciani, Marilee J.
2012-01-01
This mixed method study explored the professional competencies that administrators expect from entry-, mid-, and senior-level professionals as reflected in 1,759 job openings posted in 2008. Knowledge, skill, and dispositional competencies were identified during the qualitative phase of the study. Statistical analysis of the prevalence of…
Rapid Forgetting Results From Competition Over Time Between Items in Visual Working Memory
2016-01-01
Working memory is now established as a fundamental cognitive process across a range of species. Loss of information held in working memory has the potential to disrupt many aspects of cognitive function. However, despite its significance, the mechanisms underlying rapid forgetting remain unclear, with intense recent debate as to whether it is interference between stored items that leads to loss of information or simply temporal decay. Here we show that both factors are essential and interact in a highly specific manner. Although a single item can be maintained in memory with high fidelity, multiple items compete in working memory, progressively degrading each other’s representations as time passes. Specifically, interaction between items is associated with both worsening precision and increased reporting errors of object features over time. Importantly, during the period of maintenance, although items are no longer visible, maintenance resources can be selectively redeployed to protect the probability to recall the correct feature and the precision with which cued items can be recalled, as if it was the only item in memory. These findings reveal that the biased competition concept could be applied not only to perceptual processes but also to active maintenance of working memory representations over time. PMID:27668485
Heydari, Abbas; Kareshki, Hossein; Armat, Mohammad Reza
2016-01-01
Nurses' professional competence is a crucial factor in clinical practice. Systematic evaluation of nurses' competence and its related factors are essential for enhancing the quality of nursing care. This study aimed to assess the nurses' competence level and its possible relationship with their personality and emotional intelligence. Using a cross-sectional survey design, three instruments including Nurse Competence Scale, short form of Schutte Self Report Emotional Intelligence Test, and the short 10-item version of Big Five Factor Inventory, were administered simultaneously to a randomized stratified sample of 220 nurses working in hospitals affiliated to Mashhad University of Medical Sciences. Data analysis was performed using SPSS 11.5. Majority of nurses rated themselves as "good" and "very good", with the highest scores in "managing situations" and "work role" dimensions of nurse competence. A relatively similar pattern of scores was seen in competence dimensions, personality and emotional intelligence, among male and female nurses. Emotional intelligence and personality scores showed a significant relationship with nurses' competence, explaining almost 20% of variations in nurse competence scores. Iranian nurses evaluated their overall professional competence at similar level of the nurses in other countries. Knowledge about the nurses' competence level and its related factors, including personality and emotional intelligence, may help nurse managers in enhancing nurses' professional competence through appropriate task assignments and conducting in-service educational programs, thus improving the health status of patients.
Crogan, Neva L; Evans, Bronwynne C
2006-11-01
Lack of nursing home resident satisfaction with meals often results in reduced food intake, leading to poor nutritional status, weight loss, functional decline, and depression. The purpose of this article is to describe the development and initial testing of the 28-item revised Food Expectations-Long-Term Care (FoodEx-LTC) questionnaire with a convenience sample of nursing home residents (N = 61). Because of possible respondent burden, the original 44-item, five-domain FoodEx-LTC was revised, resulting in the deletion of 16 redundant items and those with inter-item correlations less than .25. Coefficient alpha scores ranged from .65 to .82, and test-retest correlations ranged from .79 to .88, dependent on domain. This revised instrument has good initial validity and reliability, resulting in a shorter instrument that accurately assesses nursing home resident satisfaction with food and food service.
[Civil competence assessment of the mental disorders involved in contract dispute].
Zhang, Qin-Ting; Pang, Yan-Xia; Cai, Wei-Xiong; Tang, Tao; Wang, Jian-Jun
2009-04-01
To search the criteria for evaluating the civil competence of the mental disorders involved in contract dispute. Data on the interviewee's mental status and the forensic expertise were collected retrospectively. And 6 indexes were selected and graded: awareness of situation, factual understanding of issues, appreciation of likely consequences, rational manipulation of information, functioning in one's own environment and communication of choice. All of the data were analyzed by SPSS. Fifty six cases were included and interviewee's civil competence was graded to three levels: full civil competence, diminished civil competence, and no civil competence. These cases included two types of contract: the real estate related contract (38 cases) and the labor related contract (14 cases). All of the 6 indexes were well correlated to the forensic expertise. The related coefficient was from 0.703 to 0.834, and the interrelated coefficient of the 6 items was also high, from 0.712 to 0.877. It is feasible to divide the civil competence of the mental disorders into three grades. As the basis, these 6 indexes mentioned above are representative and can be applied in further standardized and quantified assessment of civil competence.
Warehousing Competency Profile. Apprenticeship Training.
ERIC Educational Resources Information Center
Alberta Learning, Edmonton. Apprenticeship and Industry Training.
This document presents information about the apprenticeship training program of Alberta, Canada, in general and the warehousing program in particular. The first part of the document discusses the following items: Alberta's apprenticeship and industry training system; the apprenticeship and industry training committee structure; local…
2013-01-01
Background This study advances a measurement approach for the study of organizational culture in population-based occupational health research, and tests how different organizational culture types are associated with psychological distress, depression, emotional exhaustion, and well-being. Methods Data were collected over a sample of 1,164 employees nested in 30 workplaces. Employees completed the 26-item OCP instrument. Psychological distress was measured with the General Health Questionnaire (12-item); depression with the Beck Depression Inventory (21-item); and emotional exhaustion with five items from the Maslach Burnout Inventory general survey. Exploratory factor analysis evaluated the dimensionality of the OCP scale. Multilevel regression models estimated workplace-level variations, and the contribution of organizational culture factors to mental health and well-being after controlling for gender, age, and living with a partner. Results Exploratory factor analysis of OCP items revealed four factors explaining about 75% of the variance, and supported the structure of the Competing Values Framework. Factors were labeled Group, Hierarchical, Rational and Developmental. Cronbach’s alphas were high (0.82-0.89). Multilevel regression analysis suggested that the four culture types varied significantly between workplaces, and correlated with mental health and well-being outcomes. The Group culture type best distinguished between workplaces and had the strongest associations with the outcomes. Conclusions This study provides strong support for the use of the OCP scale for measuring organizational culture in population-based occupational health research in a way that is consistent with the Competing Values Framework. The Group organizational culture needs to be considered as a relevant factor in occupational health studies. PMID:23642223
Use of a Video Scoring Anchor for Rapid Serial Assessment of Social Communication in Toddlers.
Marrus, Natasha; Kennon-McGill, Stefanie; Harris, Brooke; Zhang, Yi; Glowinski, Anne L; Constantino, John N
2018-03-14
Reciprocal social behavior (RSB), an early-emerging capacity to engage in social contingency-which is foundational for both social learning and social competency-is hypothesized to be disrupted in autism spectrum disorder (ASD). The ability to quantify the full range of RSB during the toddler period, when core symptoms of ASD often arise, is pivotal for evaluating early risk for ASD, characterizing social development, and tracking response to early interventions. However, important parameters of variation in RSB-especially prior to the development of verbal language-can be nuanced and difficult to characterize using questionnaire-based methods. To address this challenge, we developed a system for measuring quantitative variation in RSB in toddlers (ages 18 - 30 months) that incorporated not only standard questionnaire data from caregivers but also a novel set of video-referenced items, through which a respondent compares the behavior of a subject to that observed in a short video of a young child manifesting a highly competent level of social communication. Testing of this measure in a general population sample of twins confirmed that both the video-referenced items and the RSB Total Score (video-referenced items plus non-video-referenced items) displayed unimodal, continuous distributions, strong internal consistency, marked preservation of individual differences, and extremely high heritability. In addition, video-referenced items were particularly sensitive to quantifying incremental changes in social communication, a major element of RSB, over the course of early childhood development. Scores on the vrRSB clearly differentiated children with and without ASD and these data comprise an initial validation of this promising method for quantifying early RSB-cross-sectionally, over time, and as a function of early intervention.
NASA Astrophysics Data System (ADS)
Amarulloh, R. R.; Utari, S.; Feranie, S.
2017-02-01
The aim of this study was to investigate the effectiveness of writing-to-learn assignment in a levels of inquiry learning to improve vocational school student’s science literacy competence and knowledge on the subject of temperature and heat. This study used quasi experiment research methods. The data were obtained using 16 item of science literacy instrument with essay format. The result shows that there was a significant difference on the improvement of science literacy ability between the experimental class and control class. A significant difference occurred in the evaluating and designing experiments competency, interpretating data and science evidence competency, and procedural knowledge. Therefore it can be concluded that the implementation of levels of inquiry with writing-to-learn assignment can improve vocational student’s science literacy competence and knowledge.
Oristrell, J; Oliva, J C; Casanovas, A; Comet, R; Jordana, R; Navarro, M
2014-01-01
The Computer Book of the Internal Medicine resident (CBIMR) is a computer program that was validated to analyze the acquisition of competences in teams of Internal Medicine residents. To analyze the characteristics of the rotations during the Internal Medicine residency and to identify the variables associated with the acquisition of clinical and communication skills, the achievement of learning objectives and resident satisfaction. All residents of our service (n=20) participated in the study during a period of 40 months. The CBIMR consisted of 22 self-assessment questionnaires specific for each rotation, with items on services (clinical workload, disease protocolization, resident responsibilities, learning environment, service organization and teamwork) and items on educational outcomes (acquisition of clinical and communication skills, achievement of learning objectives, overall satisfaction). Associations between services features and learning outcomes were analyzed using bivariate and multivariate analysis. An intense clinical workload, high resident responsibilities and disease protocolization were associated with the acquisition of clinical skills. High clinical competence and teamwork were both associated with better communication skills. Finally, an adequate learning environment was associated with increased clinical competence, the achievement of educational goals and resident satisfaction. Potentially modifiable variables related with the operation of clinical services had a significant impact on the acquisition of clinical and communication skills, the achievement of educational goals, and resident satisfaction during the specialized training in Internal Medicine. Copyright © 2013 Elsevier España, S.L. All rights reserved.
Mere exposure effect: A consequence of direct and indirect fluency-preference links.
Willems, Sylvie; Van der Linden, Martial
2006-06-01
In three experiments, picture quality between test items was manipulated to examine whether subjects' expectations about the fluency normally associated with these different stimuli might influence the effects of fluency on preference or familiarity-based recognition responses. The results showed that fluency due to pre-exposure influenced responses less when objects were presented with high picture quality, suggesting that attributions of fluency to preference and familiarity are adjusted according to expectations about the different test pictures. However, this expectations influence depended on subjects' awareness of these different quality levels. Indeed, imperceptible differences seemed not to induce expectations about the test item fluency. In this context, fluency due to both picture quality and pre-exposure influenced direct responses. Conversely, obvious, and noticed, differences in test picture quality did no affect responses, suggesting that expectations moderated attributions of fluency only when fluency normally associated with these different stimuli was perceptible but difficult to assess.
Bravo, Diamond Y.; Umaña-Taylor, Adriana J.; Toomey, Russell B.; Updegraff, Kimberly A.; Jahromi, Laudan B.
2017-01-01
The current longitudinal study examined how Mexican-origin adolescent mothers’ (N = 204) reports of acculturative stress during late adolescence were associated with their educational attainment and engagement in risky behaviors in young adulthood, 4 years post-partum; we also examined whether this association was mediated by discrepancies between adolescents’ educational aspirations and expectations. Findings revealed that mothers’ greater reports of stress regarding English competency pressures and pressures to assimilate were associated with a larger gap between their aspirations and expectations. Mothers’ reports of greater stress from pressures against assimilation, however, were associated with a smaller gap between aspirations and expectations. As expected, a larger gap between aspirations and expectations was associated with lower educational attainment and increased engagement in risky behaviors. Finally, significant mediation emerged, suggesting that the influence of stress from English competency pressures and pressures to assimilate on young mothers’ educational attainment and engagement in risky behaviors was mediated through the aspiration–expectation gap. Findings are discussed with respect to understanding discrepancies between young mothers’ aspirations and expectations in the context of acculturative stress. PMID:29263563
Development of learning objectives for neurology in a veterinary curriculum: part II: postgraduates.
Lin, Yu-Wei; Volk, Holger A; Penderis, Jacques; Anderson, Thomas J; Añor, Sonia; Lujan-Feliu-Pascual, Alejandro; Stein, Veronika M; Tipold, Andrea; Ehlers, Jan P
2015-01-27
Specialization in veterinary medicine in Europe is organized through the Colleges of the European Board of Veterinary Specialization. To inform updating of the curriculum for residents of the European College of Veterinary Neurology (ECVN) job analysis was used. Defining job competencies of diploma holders in veterinary neurology can be used as references for curriculum design of resident training. With the support of the diplomates of the ECVN and the members of the European Society of Veterinary Neurology (ESVN) a mixed-method research, including a qualitative search of objectives and quantitative ranking with 149 Likert scale questions and 48 free text questions in 9 categories in a survey was conducted. In addition, opinions of different groups were subjected to statistical analysis and the result compared. A return rate of 62% (n = 213/341) was achieved. Of the competencies identified by the Delphi process, 75% objectives were expected to attain expert level; 24% attain advanced level; 1% entry level. In addition, the exercise described the 11 highly ranked competencies, the 3 most frequently seen diseases of the central and peripheral nervous systems and the most frequently used immunosuppressive, antiepileptic and chemotherapeutic drugs. The outcomes of this "Delphi job analysis" provide a powerful tool to align the curriculum for ECVN resident training and can be adapted to the required job competencies, based on expectations. The expectation is that for majority of these competencies diplomates should attain an expert level. Besides knowledge and clinical skills, residents and diplomates are expected to demonstrate high standards in teaching and communication. The results of this study will help to create a European curriculum for postgraduate education in veterinary neurology.
Guiding Young Children's Digital Media Use: SES-Differences in Mediation Concerns and Competence.
Nikken, Peter; Opree, Suzanna J
2018-01-01
Previous research about parents' mediation of their young children's (digital) media use has predominantly focused on the different types, determinants, and effectiveness of parental mediation strategies. Although research on parents' perceived mediation concerns and competences is scarce, it is known that, compared to mothers and high-educated parents, fathers and low-educated parents experience greater insecurity (i.e., higher concern and lower competence) when applying media mediation. Based on Bourdieu's theory of social capital it may be expected that-in addition to educational level-marital status and family income predict parents' perceived mediation concerns and competences: Family demographics may predict parents' media proficiency and adoption of new media technologies and these media ecological factors may, in turn, affect perceived concerns and competences. To test this assumption, survey data were collected among 1029 parents of children between the ages of 1 to 9 years. We found that parents' basic media proficiency was lower in low income, low educated, and single-parent families, whereas parents' advanced media proficiency was only lower in low educated and single-parent families. As expected, parents' ease of active co-use was positively associated with parents' basic proficiency, ease of restrictive mediation by basic and advanced proficiency, and ease of imposing technical restrictions by advanced media proficiency. Parents' perceived mediation concerns were, however, unrelated to parents' media proficiency. Also, as expected, low educated parents were less inclined to adopt new media technologies. Adoption of new media was negatively related to perceived mediation concerns, yet did not predict parents' perceived competence.
ERIC Educational Resources Information Center
Klein-Collins, Rebecca
2012-01-01
Today the U.S. higher education system is facing a crisis regarding its perceived quality. One model for improving quality is competency-based education, in which an institution clearly defines the specific competencies expected of its graduates. A key challenge is how to help more people, particularly adults, succeed at the post¬secondary level…
Digital Competence--An Emergent Boundary Concept for Policy and Educational Research
ERIC Educational Resources Information Center
Ilomäki, Liisa; Paavola, Sami; Lakkala, Minna; Kantosalo, Anna
2016-01-01
Digital competence is an evolving concept related to the development of digital technology and the political aims and expectations of citizenship in a knowledge society. It is regarded as a core competence in policy papers; in educational research it is not yet a standardized concept. We suggest that it is a useful boundary concept, which can be…
ERIC Educational Resources Information Center
Wamala, Robert
2016-01-01
Purpose: Prospective students of law are required to demonstrate competence in certain disciplines to attain admission to law school. The grounding in the disciplines is expected to demonstrate competencies required to excel academically in law school. The purpose of this study is to investigate the relevance of the law school admission test to…
ERIC Educational Resources Information Center
Buccelli, Pamela
Presented is a project that developed a competency-based clinical chemistry course for associate degree medical laboratory technicians (MLT) in a medical technology (MT) baccalaureate program. Content of the course was based upon competencies expected of medical technologists at career-entry as defined in the statements adopted in 1976 by the…
ERIC Educational Resources Information Center
California State Univ., Sacramento. Academic Senate.
This guide communicates the increasing need in California for young people to develop skills in languages other than English, and to direct attention to assessing these skills in terms of language use competency in realistic situations rather than in terms of courses taken or units earned. The guide recognizes successive stages of competency and…
Montanes, P; Goldblum, M C; Boller, F
1996-08-01
The present study was conducted to assess the hypothesis that visual similarity between exemplars within a semantic category may affect differentially the recognition process of living and nonliving things, according to task demands, in patients with semantic memory disorders. Thirty-nine Alzheimer's patients and 39 normal elderly subjects were presented with a task in which they had to classify pictures and words, depicting either living or nonliving things, at two levels of classification: subordinate (e.g., mammals versus birds or tools versus vehicles) and attribute (e.g., wild versus domestic animals or fast versus slow vehicles). Contrary to previous results (Montañes, Goldblum, & Boller, 1995) in a naming task, but as expected, living things were better classified than nonliving ones by both controls and patients. As expected, classifications at the subordinate level also gave rise to better performance than classifications at the attribute level. Although (and somewhat unexpectedly) no advantage of picture over word classification emerged, some effects consistent with the hypothesis that visual similarity affects picture classification emerged, in particular within a subgroup of patients with predominant verbal deficits and the most severe semantic memory disorders. This subgroup obtained a better score on classification of pictures than of words depicting living items (that share many visual features) when classification is at the subordinate level (for which visual similarity is a reliable clue to classification), but met with major difficulties when classifying those pictures at the attribute level (for which shared visual features are not reliable clues to classification). These results emphasize the fact that some "normal" effects specific to items in living and nonliving categories have to be considered among the factors causing selective category-specific deficits in patients, as well as their relevance in achieving tasks which require either differentiation between competing exemplars in the same semantic category (naming) or detection of resemblance between those exemplars (categorization).
Cox, Robin S; Danford, Taryn
2014-04-01
Competency models attempt to define what makes expert performers "experts." Successful disaster psychosocial planning and the institutionalizing of psychosocial response within emergency management require clearly-defined skill sets. This necessitates anticipating both the short- and long-term psychosocial implications of a disaster or health emergency (ie, pandemic) by developing effective and sustained working relationships among psychosocial providers, programs, and other planning partners. The following article outlines recommended competencies for psychosocial responders to enable communities and organizations to prepare for and effectively manage a disaster response. Competency-based models are founded on observable performance or behavioral indicators, attitudes, traits, or personalities related to effective performance in a specific role or job. After analyzing the literature regarding competency-based frameworks, a proposed competency framework that details 13 competency domains is suggested. Each domain describes a series of competencies and suggests behavioral indicators for each competency and, where relevant, associated training expectations. These domains have been organized under three distinct categories or types of competencies: general competency domains; disaster psychosocial intervention competency domains; and disaster psychosocial program leadership and coordination competency domains. Competencies do not replace job descriptions nor should they be confused with performance assessments. What they can do is update and revise job descriptions; orient existing and new employees to their disaster/emergency roles and responsibilities; target training needs; provide the basis for ongoing self-assessment by agencies and individuals as they evaluate their readiness to respond; and provide a job- or role-relevant basis for performance appraisal dimensions or standards and review discussions. Using a modular approach to psychosocial planning, service providers can improve their response capacity by utilizing differences in levels of expertise and training. The competencies outlined in this paper can thus be used to standardize expectations about levels of psychosocial support interventions. In addition this approach provides an adaptable framework that can be adjusted for various contexts.
Reliability and Validity of the Professional Counseling Performance Evaluation
ERIC Educational Resources Information Center
Shepherd, J. Brad; Britton, Paula J.; Kress, Victoria E.
2008-01-01
The definition and measurement of counsellor trainee competency is an issue that has received increased attention yet lacks quantitative study. This research evaluates item responses, scale reliability and intercorrelations, interrater agreement, and criterion-related validity of the Professional Performance Fitness Evaluation/Professional…
A New Movement Breaks a Sweat.
ERIC Educational Resources Information Center
Durkee, Robert
2000-01-01
Discusses new organizations which monitor production of apparel and other items under possible sweatshop conditions in the context of institutional policies concerning production of licensed products with college/university logos (such as sweatshirts). Reviews controversy concerning the competing organizations, the Fair Labor Association, and the…
Occupation Competency Profile: Steel Detailer Program.
ERIC Educational Resources Information Center
Alberta Learning, Edmonton. Apprenticeship and Industry Training.
This document presents information about the apprenticeship training program of Alberta, Canada, in general and the steel detailer program in particular. The first part of the document discusses the following items: Alberta's apprenticeship and industry training system; the apprenticeship and industry training committee structure; local…
Competency-Based Instructional Programs in Animal Agriculture.
ERIC Educational Resources Information Center
Amberson, Max L.
1980-01-01
Agricultural educators will be expected to come closer to identifying specific knowledge, skills, attitudes, and experiences that students develop as a result of teachers' efforts. Making animal agriculture courses competency-based would be a first step towards this end. (LRA)
Emotional Competence as a Positive Youth Development Construct: A Conceptual Review
Lau, Patrick S. Y.; Wu, Florence K. Y.
2012-01-01
The concept of emotional competence as a positive youth development construct is reviewed in this paper. Differences between emotional intelligence and emotional competence are discussed and an operational definition is adopted. Assessment methods of emotional competence with an emphasis on its quantitative nature are introduced. In the discussion of theories of emotional competence, the functionalist and developmental perspectives and the relationships with positive youth development are highlighted. Possible antecedents, especially the influence of early child-caregiver, and expected outcomes of emotional competence are examined. Practical ways to promote emotional competence among adolescents, particularly the role of parents and teachers, and the future direction of research are also discussed. PMID:22666176
Worldwide Emerging Environmental Issues Affecting the U.S. Military
2010-11-01
in Cancun , Mexico, November 29-December 10, 2010, expectations of reaching agreement for a post-Kyoto greenhouse gas emissions treaty are low...and analysis of this report. Expanded details for some items are in the Appendix beginning on page 13. Item 1. NATO’s New Strategic Concept...by Diminishing Low-Cost Phosphorus…………………..2 Item 4. Renewed Protection for Refugees in Latin America………………………………….2 Item 5. Technological Advances
Stepp, Stephanie D; Yu, Lan; Miller, Joshua D; Hallquist, Michael N; Trull, Timothy J; Pilkonis, Paul A
2012-04-01
Mounting evidence suggests that several inventories assessing both normal personality and personality disorders measure common dimensional personality traits (i.e., Antagonism, Constraint, Emotional Instability, Extraversion, and Unconventionality), albeit providing unique information along the underlying trait continuum. We used Widiger and Simonsen's (2005) pantheoretical integrative model of dimensional personality assessment as a guide to create item pools. We then used Item Response Theory (IRT) to compare the assessment of these five personality traits across three established dimensional measures of personality: the Schedule for Nonadaptive and Adaptive Personality (SNAP), the Temperament and Character Inventory (TCI), and the Revised NEO Personality Inventory (NEO PI-R). We found that items from each inventory map onto these five common personality traits in predictable ways. The IRT analyses, however, documented considerable variability in the item and test information derived from each inventory. Our findings support the notion that the integration of multiple perspectives will provide greater information about personality while minimizing the weaknesses of any single instrument.
Development and Validation of the Adolescent Psychological Need Support in Exercise Questionnaire.
Emm-Collison, Lydia G; Standage, Martyn; Gillison, Fiona B
2016-10-01
Grounded within self-determination theory (SDT; Deci & Ryan, 2000; Ryan & Deci, in press), three studies were conducted to develop and psychometrically test a measure of adolescents' perceptions of psychological need support for exercise (viz., for autonomy, competence, and relatedness): the Adolescent Psychological Need Support in Exercise Questionnaire (APNSEQ). In Study 1, 34 items were developed in collaboration with an expert panel. Through categorical confirmatory factor analysis and item response theory, responses from 433 adolescents were used to identify the best fitting and performing items in Study 2. Here, a three-factor nine-item measure showed good fit to the data. In Study 3, responses from an independent sample of 373 adolescents provided further evidence for the nine-item solution as well as for internal consistency, criterion validity, and invariance across gender and social agent (friends, family, and physical education teacher). The APNSEQ was supported as a measure of adolescents' perceptions of psychological need support within the context of exercise.
Stepp, Stephanie D.; Yu, Lan; Miller, Joshua D.; Hallquist, Michael N.; Trull, Timothy J.; Pilkonis, Paul A.
2013-01-01
Mounting evidence suggests that several inventories assessing both normal personality and personality disorders measure common dimensional personality traits (i.e., Antagonism, Constraint, Emotional Instability, Extraversion, and Unconventionality), albeit providing unique information along the underlying trait continuum. We used Widiger and Simonsen’s (2005) pantheoretical integrative model of dimensional personality assessment as a guide to create item pools. We then used Item Response Theory (IRT) to compare the assessment of these five personality traits across three established dimensional measures of personality: the Schedule for Nonadaptive and Adaptive Personality (SNAP), the Temperament and Character Inventory (TCI), and the Revised NEO Personality Inventory (NEO PI-R). We found that items from each inventory map onto these five common personality traits in predictable ways. The IRT analyses, however, documented considerable variability in the item and test information derived from each inventory. Our findings support the notion that the integration of multiple perspectives will provide greater information about personality while minimizing the weaknesses of any single instrument. PMID:22452759
Yamada, Yohei; Tsukimoto, Takashi; Hirano, Tetsuji
2010-02-01
Remembering some of the studied (target) items impairs subsequent remembrance of relevant (non-target) items. This phenomenon, retrieval-induced forgetting (RIF), occurs when non-targets actively compete with the retrieval of a target. Researchers suggest that suppression mechanisms reduce interference from relevant items to facilitate the retrieval of target items (Anderson, 2003). Competition-dependence is one of the properties that support the suppression hypothesis (Anderson, Bjork, & Bjork, 1994). In the present study, we manipulated the type of retrieval practice (normal, last-letter, or category-name) in order to vary the degree of competition between the target and the non-targets. For the high-scoring retrieval practice group, RIF occurred in the normal retrieval condition, but not in the last-letter or in the category-name conditions. For the low-scoring retrieval practice group, RIF did not occur in any of the conditions. These findings provide new evidence that the occurrence of RIF depends on the degree of competition between a target item and related non-target items during retrieval practice.
Odéen, Magnus; Westerlund, Hugo; Theorell, Töres; Leineweber, Constanze; Eriksen, Hege R; Ursin, Holger
2013-06-01
Coping has traditionally been measured with inventories containing many items meant to identify specific coping strategies. An alternative is to develop a shorter inventory that focusses on coping expectancies which may determine the extent to which an individual attempts to cope actively. This paper explores the usefulness and validity of a simplified seven-item questionnaire (Theoretically Originated Measure of the Cognitive Activation Theory of Stress, TOMCATS) for response outcome expectancies defined either as positive ("coping"), negative ("hopelessness"), or none ("helplessness"). The definitions are based on the Cognitive Activation Theory of Stress (CATS; Ursin and Eriksen, Psychoneuroendocrinology, 29(5):567–92, 2004). The questionnaire was tested in two different samples. First, the questionnaire was compared with a traditional test of coping and then tested for validity in relation to socioeconomic differences in self-reported health. The first study was a comparison of the brief TOMCATS with a short version of the Utrecht Coping List (UCL; Eriksen et al., Scand J Psychol, 38(3):175–82, 1997). Both questionnaires were tested in a population of 1,704 Norwegian municipality workers. The second study was a cross-sectional analysis of TOMCATS, subjective and objective socioeconomic status, and health in a representative sample of the Swedish working population in 2003–2005 (N = 11,441). In the first study, the coping item in the TOMCATS questionnaire showed an expected significant positive correlation with the UCL factors of instrumental mastery-oriented coping and negative correlations with passive and depressive scores. There were also the expected correlations for the helplessness and hopelessness scores, but there was no clear distinction between helplessness and hopelessness in the way they correlated with the UCL. In the second study, the coping item in TOMCATS and the three-item helplessness scores showed clear and monotonous gradients over a subjective socioeconomic status (SES) ladder. Positive response outcome expectancy ("coping") was related to high subjective SES and no expectancy ("helplessness") to low subjective SES. In a model including age and sex, TOMCATS scores explained more variance (r 2 = 0.16) in self-reported health than both subjective (r 2 = 0.08) and objective SES (r 2 = 0.02). The brief TOMCATS questionnaire showed acceptable and significant correlations with a traditional coping questionnaire and is sensitive enough to register systematic differences in response outcome expectancies across the socioeconomic ladder. The results furthermore confirm that psychological and learning factors contribute to the socioeconomic gradient in health.
Adaptability of Physicians Offering Primary Care to the Poor: Social Competency Revisited
Loignon, Christine; Boudreault-Fournier,, Alexandrine
2013-01-01
This paper attempts to go deeper into the topic of social competency of physicians who provide primary care to populations living in poverty in Montreal. Adaptability as well as the ability to tailor practices according to patient expectations, needs and capabilities were found to be important in the development of the concept of social competency. The case of paternalism is used to demonstrate how a historically and socially contested medical approach is readapted by players in certain contexts in order to better meet patient expectations. This paper presents data collected in a qualitative study comprising 25 semi-supervised interviews with physicians recognized by their peers as having developed exemplary practices in Montreal's impoverished neighbourhoods. PMID:24289940
Muhamad, Zailani; Ramli, Ayiesah; Amat, Salleh
2015-05-01
The aim of this study was to determine the content validity, internal consistency, test-retest reliability and inter-rater reliability of the Clinical Competency Evaluation Instrument (CCEVI) in assessing the clinical performance of physiotherapy students. This study was carried out between June and September 2013 at University Kebangsaan Malaysia (UKM), Kuala Lumpur, Malaysia. A panel of 10 experts were identified to establish content validity by evaluating and rating each of the items used in the CCEVI with regards to their relevance in measuring students' clinical competency. A total of 50 UKM undergraduate physiotherapy students were assessed throughout their clinical placement to determine the construct validity of these items. The instrument's reliability was determined through a cross-sectional study involving a clinical performance assessment of 14 final-year undergraduate physiotherapy students. The content validity index of the entire CCEVI was 0.91, while the proportion of agreement on the content validity indices ranged from 0.83-1.00. The CCEVI construct validity was established with factor loading of ≥0.6, while internal consistency (Cronbach's alpha) overall was 0.97. Test-retest reliability of the CCEVI was confirmed with a Pearson's correlation range of 0.91-0.97 and an intraclass coefficient correlation range of 0.95-0.98. Inter-rater reliability of the CCEVI domains ranged from 0.59 to 0.97 on initial and subsequent assessments. This pilot study confirmed the content validity of the CCEVI. It showed high internal consistency, thereby providing evidence that the CCEVI has moderate to excellent inter-rater reliability. However, additional refinement in the wording of the CCEVI items, particularly in the domains of safety and documentation, is recommended to further improve the validity and reliability of the instrument.
Riddoch, M Jane; Riveros, Rodrigo; Humphreys, Glyn W
2011-02-01
Patients with extinction show a characteristic impairment in the identification of objects when two items are presented simultaneously, typically reporting the ipsilesional item only. The effect is thought to be due to a spatial bias advantaging the ipsilesional item under conditions of competing concurrent stimulation. Action relations between objects can result in recovery from extinction as the object pair may be perceived as a single group rather than competing perceptual units. However, objects interacting together can also have implied motion. Here we test whether implied motion is necessary to generate recovery from extinction. We varied orthogonally whether animate and inanimate objects were paired together in positions related or unrelated to action. Implied motion was greater when an animate object was present than when both stimuli were inanimate. Despite this, recovery from extinction was greater when actions were shown between inanimate objects. We suggest that actions between inanimate objects are perceived more easily due to the surfaces of these stimuli being designed for functional goals (e.g., the flat surface of a hammer head is designed to hit the flattened head of a nail). Attention is sensitive to the fit between potential action and the functional properties of objects, and not just to implied motion between stimuli.
Cicutto, Lisa; Gleason, Melanie; Haas-Howard, Christy; Jenkins-Nygren, Lynn; Labonde, Susan; Patrick, Kathy
2017-08-01
School health teams commonly address the needs of students with asthma, which requires specific knowledge and skills. To develop a skilled school health team, a competency-based framework for managing asthma in schools was developed. A modified Delphi with 31 panelists was completed. Consensus (≥80% agreement) was reached for all 148 items regarding the appropriateness as a minimum competency for asthma care in schools. The resultant Colorado Competency Framework for Asthma Care in Schools guided the development and pilot testing of a continuing education curriculum for school nurses. Pre- and postassessments demonstrated significant improvements in knowledge and self-confidence related to asthma care in schools and inhaler technique skills. This work is the first to use a consensus process to identify a framework of minimum competencies for providing asthma care in schools. This framework informed a continuing education curriculum that resulted in improved knowledge, confidence, and skills for school nurses.
NASA Astrophysics Data System (ADS)
Conchado Peiró, Andrea; Bas Cerdá, María del Carmen; Gharaibeh, Khaled M.; Kaylani, Hazem
2017-09-01
The objective of this study is to identify the competencies required to achieve success in the transition from higher education to the labour market based on the perceptions of employers. This paper analyses the assessments made by a group of engineering company employers. An item-battery of 20 competencies was grouped into 3 dimensions by using factor analysis. Subsequently, respondents' scores were also clustered into three groups and characterised through contingency tables. The competencies demanded by employers were grouped into business and finance, problem-solving and strategic planning. Significant differences were found between responses from employers working in medium and small companies, who placed more importance on competencies related to problem-solving and strategic planning, and employers in big companies, who were more concerned about the difficulties of finding well-trained graduates. The findings from this paper have important implications for research in the areas of higher education and organisations that usually employ graduate engineers.
Nøvik, Torunn Stene; Jozefiak, Thomas
2014-04-01
Studies about changes in the prevalence of emotional and behaviour problems across time are lacking, especially among younger children. To determine if the level of parent-reported emotional and behaviour problems and competencies in young Norwegian school children had changed across a 16-year time interval. We compared parent reports obtained by the Child Behavior Checklist in two samples of children aged 7-9 years from the general population assessed in 1991 and 2007. The results demonstrated overall stability or slight decreases of emotional and behaviour problems and a significant increase in competencies, mainly due to increased activity and social competence scores in the 2007 sample. Boys obtained higher scores than girls in Total Problems, Externalizing and Attention problems at both time points and there was a high stability of the rank order of items. The findings suggest stability in child emotional and behaviour problems, and an increase of competencies across the period.
ERIC Educational Resources Information Center
Alderman, Donald L.; Holland, Paul W.
The Test of English as a Foreign Language (TOEFL) was examined for instances in which the item performance of examinees with comparable scores differed according to their native languages. A chi-square procedure, sensitive to deviations of less than ten percent from the expected frequencies of correct item responses across several language groups,…
ERIC Educational Resources Information Center
Wei, Youhua; Morgan, Rick
2016-01-01
As an alternative to common-item equating when common items do not function as expected, the single-group growth model (SGGM) scaling uses common examinees or repeaters to link test scores on different forms. The SGGM scaling assumes that, for repeaters taking adjacent administrations, the conditional distribution of scale scores in later…
ERIC Educational Resources Information Center
Schmitt, T. A.; Sass, D. A.; Sullivan, J. R.; Walker, C. M.
2010-01-01
Imposed time limits on computer adaptive tests (CATs) can result in examinees having difficulty completing all items, thus compromising the validity and reliability of ability estimates. In this study, the effects of speededness were explored in a simulated CAT environment by varying examinee response patterns to end-of-test items. Expectedly,…
ERIC Educational Resources Information Center
Lee, Yi-Hsuan; Zhang, Jinming
2008-01-01
The method of maximum-likelihood is typically applied to item response theory (IRT) models when the ability parameter is estimated while conditioning on the true item parameters. In practice, the item parameters are unknown and need to be estimated first from a calibration sample. Lewis (1985) and Zhang and Lu (2007) proposed the expected response…
Monsalve, Irene F.; Pérez, Alejandro; Molinaro, Nicola
2014-01-01
During language comprehension, semantic contextual information is used to generate expectations about upcoming items. This has been commonly studied through the N400 event-related potential (ERP), as a measure of facilitated lexical retrieval. However, the associative relationships in multi-word expressions (MWE) may enable the generation of a categorical expectation, leading to lexical retrieval before target word onset. Processing of the target word would thus reflect a target-identification mechanism, possibly indexed by a P3 ERP component. However, given their time overlap (200–500 ms post-stimulus onset), differentiating between N400/P3 ERP responses (averaged over multiple linguistically variable trials) is problematic. In the present study, we analyzed EEG data from a previous experiment, which compared ERP responses to highly expected words that were placed either in a MWE or a regular non-fixed compositional context, and to low predictability controls. We focused on oscillatory dynamics and regression analyses, in order to dissociate between the two contexts by modeling the electrophysiological response as a function of item-level parameters. A significant interaction between word position and condition was found in the regression model for power in a theta range (~7–9 Hz), providing evidence for the presence of qualitative differences between conditions. Power levels within this band were lower for MWE than compositional contexts when the target word appeared later on in the sentence, confirming that in the former lexical retrieval would have taken place before word onset. On the other hand, gamma-power (~50–70 Hz) was also modulated by predictability of the item in all conditions, which is interpreted as an index of a similar “matching” sub-step for both types of contexts, binding an expected representation and the external input. PMID:25161630
NASA Astrophysics Data System (ADS)
Diana, S.
2018-05-01
Research about the effect of Peer Assisted Learning (PAL) strategy on Plant Anatomy Course, which aims to improve anatomic competencies of prospective student’s biology teacher, has been done. This study used a quasi-experimental pre-test post-test control group design. The draft includes a group of students who were given a pre-test which is then followed by observing the PAL treatment process and post-test. The other students group (control) was given the pre-test and post-test only. The PAL program began with a discussion between the lecturer and the tutor about the pretest results and then discussion between the tutors and their tutees in the class about the responses items. After that, all students were assigned to answer a set of response items, and then did the posttest. The results showed that the PAL strategy can increase student’s anatomic literacy significantly and can increase student’s anatomic lab skills no significantly. Thus the PAL strategy implementation has a potential to improve student’s anatomic competencies. The generally students weaknesses were they lack practice in interpreting of research results in the graphs form and rarely shared about anatomic lab skills. All students respond positively to the PAL strategy.
Quality assessment of clinical education services in teaching hospitals located in Kerman, Iran
Yazdi-Feyzabadi, Vahid; Gozashti, Mohammad Hossein; Komsari, Samane; Mohammadtaghizadeh, Sedigheh; Amiresmaili, Mohammadreza
2015-01-01
Introduction Clinical education is one of the most important components of the resource generation function of health systems, and it has a very important role in graduates’ competency with respect to effective, practical education. This study aimed to assess the quality of clinical services in Kerman’s teaching hospitals located in southeastern Iran. Methods This cross-sectional study was conducted in 2011 on 303 medical students at different levels of medical education at Kerman’s teaching hospitals. A modified SERVQUAL instrument was used to collect the data after its validity and reliability were checked. The data were analyzed by SPSS 18.0 using the paired t-test, Kruskal-Wallis, and post hoc tests, when appropriate. Results In all five dimensions of quality, gaps were observed between students’ perceptions and expectations as follows: Assurance (mean = −1.18), Responsiveness (−1.56), Empathy (−1.4), Reliability (−1.27), and Tangibles (−1.21). There was a significant difference between the quality perceptions and expectations of the medical students (p < 0.001). A significant difference was observed between three educational levels, including externships, internships, and assistantships regarding the dimensions of the quality gaps (p < 0.001). Conclusion The clinical services provided by teaching hospitals in the study did not meet the students’ expectations at any of the three educational levels. As we precisely assessed the dimensions and items that had the higher quality gaps, it was apparent that, for most part, clinical education officials could improve the quality by designing interventions, which would not be very difficult to do. PMID:26767094
Grouping and binding in visual short-term memory.
Quinlan, Philip T; Cohen, Dale J
2012-09-01
Findings of 2 experiments are reported that challenge the current understanding of visual short-term memory (VSTM). In both experiments, a single study display, containing 6 colored shapes, was presented briefly and then probed with a single colored shape. At stake is how VSTM retains a record of different objects that share common features: In the 1st experiment, 2 study items sometimes shared a common feature (either a shape or a color). The data revealed a color sharing effect, in which memory was much better for items that shared a common color than for items that did not. The 2nd experiment showed that the size of the color sharing effect depended on whether a single pair of items shared a common color or whether 2 pairs of items were so defined-memory for all items improved when 2 color groups were presented. In explaining performance, an account is advanced in which items compete for a fixed number of slots, but then memory recall for any given stored item is prone to error. A critical assumption is that items that share a common color are stored together in a slot as a chunk. The evidence provides further support for the idea that principles of perceptual organization may determine the manner in which items are stored in VSTM. PsycINFO Database Record (c) 2012 APA, all rights reserved.
Measures of emergency preparedness contributing to nursing home resilience.
Lane, Sandi J; McGrady, Elizabeth
2017-12-13
Resilience approaches have been successfully applied in crisis management, disaster response, and high reliability organizations and have the potential to enhance existing systems of nursing home disaster preparedness. This study's purpose was to determine how the Center for Medicare and Medicaid Services (CMS) "Emergency Preparedness Checklist Recommended Tool for Effective Health Care Facility Planning" contributes to organizational resilience by identifying the benchmark resilience items addressed by the CMS Emergency Preparedness Checklist and items not addressed by the CMS Emergency Preparedness Checklist, and to recommend tools and processes to improve resilience for nursing homes. The CMS Emergency Preparedness Checklist items were compared to the Resilience Benchmark Tool items; similar items were considered matches. Resilience Benchmark Tool items with no CMS Emergency Preparedness Checklist item matches were considered breaches in nursing home resilience. The findings suggest that the CMS Emergency Preparedness Checklist can be used to measure some aspects of resilience, however, there were many resilience factors not addressed. For nursing homes to prepare and respond to crisis situations, organizations need to embrace a culture that promotes individual resilience-related competencies that when aggregated enable the organization to improve its resiliency. Social workers have the skills and experience to facilitate this change.
Judd, Belinda K; Scanlan, Justin N; Alison, Jennifer A; Waters, Donna; Gordon, Christopher J
2016-08-05
Despite the recent widespread adoption of simulation in clinical education in physiotherapy, there is a lack of validated tools for assessment in this setting. The Assessment of Physiotherapy Practice (APP) is a comprehensive tool used in clinical placement settings in Australia to measure professional competence of physiotherapy students. The aim of the study was to evaluate the validity of the APP for student assessment in simulation settings. A total of 1260 APPs were collected, 971 from students in simulation and 289 from students in clinical placements. Rasch analysis was used to examine the construct validity of the APP tool in three different simulation assessment formats: longitudinal assessment over 1 week of simulation; longitudinal assessment over 2 weeks; and a short-form (25 min) assessment of a single simulation scenario. Comparison with APPs from 5 week clinical placements in hospital and clinic-based settings were also conducted. The APP demonstrated acceptable fit to the expectations of the Rasch model for the 1 and 2 week clinical simulations, exhibiting unidimensional properties that were able to distinguish different levels of student performance. For the short-form simulation, nine of the 20 items recorded greater than 25 % of scores as 'not-assessed' by clinical educators which impacted on the suitability of the APP tool in this simulation format. The APP was a valid assessment tool when used in longitudinal simulation formats. A revised APP may be required for assessment in short-form simulation scenarios.
Heydari, Abbas; Kareshki, Hossein; Armat, Mohammad Reza
2016-01-01
Introduction: Nurses' professional competence is a crucial factor in clinical practice. Systematic evaluation of nurses’ competence and its related factors are essential for enhancing the quality of nursing care. This study aimed to assess the nurses’ competence level and its possible relationship with their personality and emotional intelligence. Methods: Using a cross-sectional survey design, three instruments including Nurse Competence Scale, short form of Schutte Self Report Emotional Intelligence Test, and the short 10-item version of Big Five Factor Inventory, were administered simultaneously to a randomized stratified sample of 220 nurses working in hospitals affiliated to Mashhad University of Medical Sciences. Data analysis was performed using SPSS 11.5. Results: Majority of nurses rated themselves as "good" and "very good", with the highest scores in "managing situations" and "work role" dimensions of nurse competence. A relatively similar pattern of scores was seen in competence dimensions, personality and emotional intelligence, among male and female nurses. Emotional intelligence and personality scores showed a significant relationship with nurses’ competence, explaining almost 20% of variations in nurse competence scores. Conclusion: Iranian nurses evaluated their overall professional competence at similar level of the nurses in other countries. Knowledge about the nurses’ competence level and its related factors, including personality and emotional intelligence, may help nurse managers in enhancing nurses' professional competence through appropriate task assignments and conducting in-service educational programs, thus improving the health status of patients. PMID:27354976
Development of three new scales for assessing clients' perspectives on premarital counseling.
Schumm, W R; West, D R
2001-06-01
Within a subsample of 73 men and 179 women from a larger study of current and former members of the Christian Church (Disciples of Christ), three new scales were developed to assess the value attributed to premarital counseling, quality of premarital counseling received, and a pastor's competence at premarital counseling. Although internal consistency reliability as measured by Cronbach alpha was marginally acceptable (.61) for the latter three-item scale, it was adequate for the three-item value (.84) and the seven-item quality (.87) scales. Evidence for construct validity was limited with respect to demographic variables for social class, sex, and religiosity. Those who attended church more frequently and women reported lower quality of premarital counseling.
Two objective measures of self-esteem.
Lorr, M; Wunderlich, R A
1986-01-01
Two scales were constructed to assess self-esteem, conceptualized as reflecting (a) feelings of competence and efficacy, and (b) perceived positive appraisal from significant others. To control for response bias a paired choice format was chosen for the items constructed. A buffer scale designed to measure social assertiveness was also included. Data were collected on three samples of high school boys. The item intercorrelations were subjected to principal component analyses followed by Varimax rotations. In each of the three analyses factors of Confidence, Popularity (Social Approval), and Social Assertiveness emerged. The revised self-esteem scales, each defined by 11 items, have been shown to have acceptable reliability and some concurrent validity based on correlations with the well-known Rosenberg Self-Esteem Scale.
Woeber, Kate
2018-07-01
The learning goals and evaluation strategies of competency-based midwifery programs must be explicit and well-defined. In the US, didactic learning is evaluated through a standardized certification examination, but standardized clinical competence evaluation is lacking. The Midwifery Competency Assessment Tool (MCAT) has been adapted from the International Confederation of Midwives' (ICM) "Essential Competencies" and from the American College of Nurse-Midwives' (ACNM) "Core Competencies", with student self-evaluation based on Benner's Novice-to-Expert theory. The MCAT allows for the measurement and monitoring of competence development in all domains of full-scope practice over the course of the midwifery program. Strengths of the MCAT are that it provides clear learning goals and performance evaluations for students, ensures and communicates content mapping across a curriculum, and highlights strengths and gaps in clinical opportunities at individual clinical sites and for entire programs. Challenges of the MCAT lie in balancing the number of competency items to be measured with the tedium of form completion, in ensuring the accuracy of student self-evaluation, and in determining "adequate" competence achievement when particular clinical opportunities are limited. Use of the MCAT with competency-based clinical education may facilitate a more standardized approach to clinical evaluation, as well as a more strategic approach to clinical site development and use. Copyright © 2018 Elsevier Ltd. All rights reserved.
Perceptions of perioperative nursing competence: a cross-country comparison.
Gillespie, Brigid M; Harbeck, Emma B; Falk-Brynhildsen, Karin; Nilsson, Ulrica; Jaensson, Maria
2018-01-01
Throughout many countries, professional bodies rely on yearly self-assessment of competence for ongoing registration; therefore, nursing competence is pivotal to safe clinical practice. Our aim was to describe and compare perioperative nurses' perceptions of competence in four countries, while examining the effect of specialist education and years of experience in the operating room. We conducted a secondary analysis of cross-sectional surveys from four countries including; Australia, Canada, Scotland, and Sweden. The 40-item Perceived Perioperative Competence Scale-Revised (PPCS-R), was used with a total sample of 768 respondents. We used a factorial design to examine the influence of country, years of experience in the operating room and specialist education on nurses' reported perceived perioperative competence. Regardless of country origin, nurses with specialist qualifications reported higher perceived perioperative competence when compared to nurses without specialist education. However, cross-country differences were dependent on nurses' number of years of experience in the operating room. Nurses from Sweden with 6-10 years of experience in the operating room reported lower perceived perioperative competence when compared to Australian nurses. In comparing nurses with > 10 years of experience, Swedish nurses reported significantly lower perceived perioperative competence when compared to nurses from Australia, Canada and Scotland. Researchers need to consider educational level and years of experience in the perioperative context when examining constructs such as competence.
Guy, Jacqui; Taylor, Christine; Roden, Janet; Blundell, Jennifer; Tolhurst, Gerda
2011-04-01
The Australian nurse teacher competencies were introduced in 1996; however, the researchers perceived that changes to the health care system and a nursing workforce shortage may have affected nurse teacher roles over the past decade. This study aimed to explore perceptions of nurse teachers on the applicability of the current Australian nurse teacher competencies to practice, and modify the nurse teacher competencies to better reflect current practice. Methodology utilized mixed methods, and data collection was via focus groups, telephone interviews, and survey data. Results revealed that participants were mostly positive about the original competency statements, although there were some variations between items. Themes that emerged from the qualitative data were: changing trends in health care; preparation for teaching; understanding of the competencies, contextual influences on education role; nurse teachers as change agents, and resource management. Conclusions were that the Australian nurse teacher competencies (1996) were reflective of the current generic roles of nurse teachers however some of the competencies needed reframing to meet the current needs of nurse teachers. However, changes needed to be made in areas such as reducing complex language, inclusion of technology, and cultural competencies. Nurse teachers were supportive of the research because they valued the teacher competencies for reflection on their practice and the development of portfolios, job descriptions and performance appraisals. Copyright © 2010. Published by Elsevier Ltd.
Apprenticeship in Washington: Effective, Underutilized. Studies in Industry and Employment.
ERIC Educational Resources Information Center
Kamimura, Gary
Washington's apprenticeship program was compared to other programs providing preparation for employment. The following were among the items considered in the comparative analysis: gains in job-specific skill competencies; relationship of training to postprogram employment; participant satisfaction; employer satisfaction; employment opportunities;…
Ko, Nai-Ying; Hsieh, Chia-Yin; Chen, Yen-Chin; Tsai, Chen-Hsi; Liu, Hsiao-Ying; Liu, Li-Fang
2015-08-01
Since 2005, the Taiwan Centers for Disease Control (Taiwan CDC) initiated an HIV case management program in AIDS-designated hospitals to provide integrative services and risk-reduction counseling for HIV-infected individuals. In light of the increasingly complex and highly specialized nature of clinical care, expanding and improving competency-based professional education is important to enhance the quality of HIV/AIDS care. The aim of this study was to develop the essential competency framework for HIV care for HIV case managers in Taiwan. We reviewed essential competencies of HIV care from Canada, the United Kingdom, and several African countries and devised descriptions of the roles of case managers and of the associated core competencies for HIV care in Taiwan. The modified Delphi technique was used to evaluate the draft framework of these roles and core competencies. A total of 15 HIV care experts were invited to join the expert panel to review and rank the draft framework. The final framework consisted of 7 roles and 27 competencies for HIV case managers. In Round 1, only 3 items did not receive consensus approval from the experts. After modification based on opinions of the experts, 7 roles and 27 competencies received 97.06% consensus approval in Round 2 and were organized into the final framework for HIV case managers. These roles and associated core competencies were: HIV Care Expert (9 competencies), Communicator (1 competency), Collaborator (4 competencies), Navigator (2 competencies), Manager (4 competencies), Advocate (2 competencies), and Professional (5 competencies). The authors developed an essential competency framework for HIV care using the consensus of a multidisciplinary expert panel. Curriculum developers and advanced nurses and practitioners may use this framework to support developments and to ensure a high quality of HIV care.
Bourgault, Annette M; Smith, Sherry
2004-01-01
Multi-levelled critical care competency statements were developed based on the levels of novice to expert (Benner, 1984). These competency statements provide a framework for the development of knowledge and skills specific to critical care. The purpose of this tool is to guide personal development in critical care, facilitating the assessment of individual learning needs. Competency levels are attained through the completion of performance criteria. Multi-levelled competency statements define clear expectations for the new orientee, in addition to providing a framework for the advancement of the intermediate and experienced nurse.
Psychometric Testing of the Persian Version of the Perceived Perioperative Competence Scale-Revised.
Ajorpaz, Neda Mirbagher; Tafreshi, Mansoureh Zagheri; Mohtashami, Jamileh; Zayeri, Farid; Rahemi, Zahra
2017-12-01
The clinical competence of nursing students in operating room (OR) is an important issue in nursing education. The purpose of this study was to evaluate the psychometric properties of the Persian Perceived Perioperative Competence Scale-Revised (PPCS-R) instrument. This cross-sectional study was conducted across 12 universities in Iran. The psychometric properties and factor structure of the PPCS-R for OR students was examined. Based on the results of factor analysis, seven items were removed from the original version of the scale. The fitness indices of the Persian scale include comparative fit index (CFI) = .90, goodness-of-fit-index (GFI) = .86, adjusted goodness-of-fit index (AGFI) = .90, normed fit index (NFI) = .84, and root mean square error of approximation (RMSEA) = .04. High validity and reliability indicated the scale's value for measuring perceived perioperative competence of Iranian OR students.
Hatamizadeh, N; Ghasemi, M; Saeedi, A; Kazemnejad, A
2008-11-01
Although educational main streaming of children with special needs formally began in Iran since 1992 there is little information whether hearing impaired children feel competent in regular schools. To determine the perceived competence and school adjustment of hearing impaired children in mainstream primary school settings, the self-perception profile was administered to 60 mainstreamed hard of hearing children and 60 classmates with normal hearing matched for gender by a single interviewer. The instrument comprised 28 items, 23 of which were similar to those of 'adapted test Image for children with cochlear implants' asking children about their feelings about their own cognitive, physical, socio-emotional and communication competence and school adjustment. The Cronbach alpha coefficient for the instrument was 0.93. Hard of hearing children rated their competence significantly poorer than their hearing classmates for all domains. Mean differences for the five domains ranged from 0.48 (for physical competence) to 0.90 (for school adjustment) on a scale of 1-4. There were no significant differences between girls' and boys' competence, in either the hearing or the hearing impaired groups. Classifying overall scores for perceived competence into four groups ('poor competence', 'low competence', 'moderate competence' and 'high competence'), 23.4% of hearing impaired children but none of the hearing classmates rated themselves as having low or poor competence. On the other hand 85% of hearing children and only 18.3% of hearing impaired children rated themselves as highly competent. We suggest that periodical assessments of mainstreamed children might help to identify those children who are having difficulty adapting to their environment.
Cognitive Expectancies for Hypnotic Use among Older Adult Veterans with Chronic Insomnia.
Fung, Constance H; Martin, Jennifer L; Josephson, Karen; Fiorentino, Lavinia; Dzierzewski, Joseph M; Jouldjian, Stella; Song, Yeonsu; Rodriguez Tapia, Juan Carlos; Mitchell, Michael N; Alessi, Cathy A
2018-01-01
To examine relationships between cognitive expectancies about sleep and hypnotics and use of medications commonly used for insomnia (hypnotics). We analyzed baseline data from older veterans who met diagnostic criteria for insomnia and were enrolled in a trial comparing CBTI delivered by a supervised, sleep educator to an attention control condition (N = 159; 97% male, mean age 72 years). We classified individuals as hypnotic users (N = 23) vs. non-users (N = 135) based upon medication diaries. Associations between hypnotic status and Dysfunctional Beliefs and Attitudes about Sleep-16 (DBAS) total score (0-10, higher = worse) and two DBAS medication item scores (Item 1: "…better off taking a sleeping pill rather than having a poor night's sleep;" Item 2: "Medication… probably the only solution to sleeplessness"; 0-10, higher = worse) were examined in logistic regression models. Higher scores on the DBAS medication items (both odds ratios = 1.3; p-values < .001) were significantly associated with hypnotic use. DBAS-16 total score was not associated with hypnotic use. Cognitive expectancy (dysfunctional beliefs) about hypnotics was associated with hypnotic use in older adults with chronic insomnia disorder. Strategies that specifically target dysfunctional beliefs about hypnotics are needed and may impact hypnotic use in older adults.
Rapid forgetting results from competition over time between items in visual working memory.
Pertzov, Yoni; Manohar, Sanjay; Husain, Masud
2017-04-01
Working memory is now established as a fundamental cognitive process across a range of species. Loss of information held in working memory has the potential to disrupt many aspects of cognitive function. However, despite its significance, the mechanisms underlying rapid forgetting remain unclear, with intense recent debate as to whether it is interference between stored items that leads to loss of information or simply temporal decay. Here we show that both factors are essential and interact in a highly specific manner. Although a single item can be maintained in memory with high fidelity, multiple items compete in working memory, progressively degrading each other's representations as time passes. Specifically, interaction between items is associated with both worsening precision and increased reporting errors of object features over time. Importantly, during the period of maintenance, although items are no longer visible, maintenance resources can be selectively redeployed to protect the probability to recall the correct feature and the precision with which cued items can be recalled, as if it was the only item in memory. These findings reveal that the biased competition concept could be applied not only to perceptual processes but also to active maintenance of working memory representations over time. (PsycINFO Database Record (c) 2017 APA, all rights reserved).
New competencies for the 21st century dental public health specialist.
Altman, Donald; Mascarenhas, Ana Karina
2016-09-01
The American Board of Dental Public Health (ABDPH) currently recognizes 10 core competencies, which identify the skills, knowledge and understanding expected of all dental public health specialists. The last update to the competencies was 1998. The American Board of Dental Public Health, along with the American Association of Public Health Dentistry and its many partners, initiated a process to revise the competencies. This report presents the process and the new competencies for the dental public health specialist of the 21 st century. Each of the developed competencies is supported by a "statement of intent". These competencies take effect immediately. The new competencies will be used in testing candidates for specialty status beginning with the 2018 ABDPH examination. © 2016 American Association of Public Health Dentistry and American Board of Dental Public Health.
A test of the California competency-based differentiated role model.
Keating, Sarah B; Rutledge, Dana N; Sargent, Arlene; Walker, Polly
2003-01-01
To address the incongruence between the expectations of nursing service and education in California, the Education Industry Interface Task Force of the California Strategic Planning Committee for Nursing developed descriptions to assist employers and educators in clearly differentiating practice and educational competencies. The completion of the Competency-Based Role Differentiation Model resulted in the need to test the model for its utility in the service setting, in education, and for career planning for nurses. Three alpha demonstration sites were selected based on representative geographical regions of California. The sites were composed of tri-partnerships consisting of a medical center, an associate degree in nursing program, and a baccalaureate nursing program. Observers rated senior students and new graduates in medical-surgical units on their behaviors in teacher and leadership care provider and care coordinator roles. The alpha demonstration study results were as expected. That is, senior students practice predominantly at a novice level in teacher and management/leadership care provider functions and new graduates practice predominately at the competent level. New graduates are more likely to take on novice and competent care coordinator roles. The CBRDM may be useful for practice and education settings to evaluate student and nurse performance, to define role expectations, and to identify the preparation necessary for the roles. It is useful for all of nursing as it continues to define its levels of practice and their relationship to on-the-job performance, curriculum development, and carrier planning.
Smolen, Tomasz; Chuderski, Adam
2015-01-01
Fluid intelligence (Gf) is a crucial cognitive ability that involves abstract reasoning in order to solve novel problems. Recent research demonstrated that Gf strongly depends on the individual effectiveness of working memory (WM). We investigated a popular claim that if the storage capacity underlay the WM-Gf correlation, then such a correlation should increase with an increasing number of items or rules (load) in a Gf-test. As often no such link is observed, on that basis the storage-capacity account is rejected, and alternative accounts of Gf (e.g., related to executive control or processing speed) are proposed. Using both analytical inference and numerical simulations, we demonstrated that the load-dependent change in correlation is primarily a function of the amount of floor/ceiling effect for particular items. Thus, the item-wise WM correlation of a Gf-test depends on its overall difficulty, and the difficulty distribution across its items. When the early test items yield huge ceiling, but the late items do not approach floor, that correlation will increase throughout the test. If the early items locate themselves between ceiling and floor, but the late items approach floor, the respective correlation will decrease. For a hallmark Gf-test, the Raven-test, whose items span from ceiling to floor, the quadratic relationship is expected, and it was shown empirically using a large sample and two types of WMC tasks. In consequence, no changes in correlation due to varying WM/Gf load, or lack of them, can yield an argument for or against any theory of WM/Gf. Moreover, as the mathematical properties of the correlation formula make it relatively immune to ceiling/floor effects for overall moderate correlations, only minor changes (if any) in the WM-Gf correlation should be expected for many psychological tests.
Essays on Causal Inference for Public Policy
ERIC Educational Resources Information Center
Zajonc, Tristan
2012-01-01
Effective policymaking requires understanding the causal effects of competing proposals. Relevant causal quantities include proposals' expected effect on different groups of recipients, the impact of policies over time, the potential trade-offs between competing objectives, and, ultimately, the optimal policy. This dissertation studies causal…
Use of Multi-Disciplinary Projects To Develop Competence.
ERIC Educational Resources Information Center
Trotman-Dickenson, Danusia
1992-01-01
Undergraduate technology and business students at the Polytechnic of Wales (United Kingdom) participated in multi-disciplinary team projects to experience real life business challenges and develop competences that employers expect in professionals. Lists characteristics of successful multi-disciplinary projects, discusses cost and industry…
Kedem, Leia E; Evans, Ellen M; Chapman-Novakofski, Karen
2014-11-01
Lifestyle interventions commonly measure psychosocial beliefs as precursors to positive behavior change, but often overlook questionnaire validation. This can affect measurement accuracy if the survey has been developed for a different population, as differing behavioral influences may affect instrument validity. The present study aimed to explore psychometric properties of self-efficacy and outcome expectation scales-originally developed for younger children-in a population of female college freshmen (N = 268). Exploratory principal component analysis was used to investigate underlying data patterns and assess validity of previously published subscales. Composite scores for reliable subscales (Cronbach's α ≥ .70) were calculated to help characterize self-efficacy and outcome expectation beliefs in this population. The outcome expectation factor structure clearly comprised of positive (α = .81-.90) and negative outcomes (α = .63-.67). The self-efficacy factor structure included themes of motivation and effort (α = .75-.94), but items pertaining to hunger and availability cross-loaded often. Based on cross-loading patterns and low Cronbach's alpha values, respectively, self-efficacy items regarding barriers to healthy eating and negative outcome expectation items should be refined to improve reliability. Composite scores suggested that eating healthfully was associated with positive outcomes, but self-efficacy to do so was lower. Thus, dietary interventions for college students may be more successful by including skill-building activities to enhance self-efficacy and increase the likelihood of behavior change. © The Author(s) 2014.
Riley, Barbara; Harvey, Jean; Di Ruggiero, Erica; Potvin, Louise
2015-01-01
Population health intervention research (PHIR) is a relatively new research field that studies interventions that can improve health and health equity at a population level. Competencies are one way to give legitimacy and definition to a field. An initial set of PHIR competencies was developed with leadership from a multi-sector group in Canada. This paper describes the development process for these competencies and their possible uses. Methods to develop the competencies included key informant interviews; a targeted review of scientific and gray literature; a 2-round, online adapted Delphi study with a 24-member panel; and a focus group with 9 international PHIR experts. The resulting competencies consist of 25 items grouped into 6 categories. They include principles of good science applicable though not exclusive to PHIR, and more suitable for PHIR teams rather than individuals. This initial set of competencies, released in 2013, may be used to develop graduate student curriculum, recruit trainees and faculty to academic institutions, plan non-degree professional development, and develop job descriptions for PHIR-related research and professional positions. The competencies provide some initial guideposts for the field and will need to be adapted as the PHIR field matures and to meet unique needs of different jurisdictions.
Riley, Barbara; Harvey, Jean; Di Ruggiero, Erica; Potvin, Louise
2015-01-01
Population health intervention research (PHIR) is a relatively new research field that studies interventions that can improve health and health equity at a population level. Competencies are one way to give legitimacy and definition to a field. An initial set of PHIR competencies was developed with leadership from a multi-sector group in Canada. This paper describes the development process for these competencies and their possible uses. Methods to develop the competencies included key informant interviews; a targeted review of scientific and gray literature; a 2-round, online adapted Delphi study with a 24-member panel; and a focus group with 9 international PHIR experts. The resulting competencies consist of 25 items grouped into 6 categories. They include principles of good science applicable though not exclusive to PHIR, and more suitable for PHIR teams rather than individuals. This initial set of competencies, released in 2013, may be used to develop graduate student curriculum, recruit trainees and faculty to academic institutions, plan non-degree professional development, and develop job descriptions for PHIR-related research and professional positions. The competencies provide some initial guideposts for the field and will need to be adapted as the PHIR field matures and to meet unique needs of different jurisdictions. PMID:26844160
Skill Development in the Psychology Major: What Do Undergraduate Students Expect?
ERIC Educational Resources Information Center
Gaither, George A.; Butler, Darrell L.
2005-01-01
The present study examined undergraduate students' expectations for how well psychology majors develop 60 skills corresponding to five of the American Psychological Association's Task Force on Undergraduate Psychology Major Competencies (APA, 2002) suggested learning goals. This study also examined where students expect psychology majors to get…
Calorimetry of low mass Pu239 items
DOE Office of Scientific and Technical Information (OSTI.GOV)
Cremers, Teresa L; Sampson, Thomas E
2010-01-01
Calorimetric assay has the reputation of providing the highest precision and accuracy of all nondestructive assay measurements. Unfortunately, non-destructive assay practitioners and measurement consumers often extend, inappropriately, the high precision and accuracy of calorimetric assay to very low mass items. One purpose of this document is to present more realistic expectations for the random uncertainties associated with calorimetric assay for weapons grade plutonium items with masses of 200 grams or less.